[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:08:14.524675 21266 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.196.190:35291
I20260709 12:08:14.526358 21266 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:08:14.527505 21266 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:14.544461 21273 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:14.544785 21275 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:14.545888 21272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:14.547355 21266 server_base.cc:1061] running on GCE node
I20260709 12:08:15.752187 21266 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:15.752418 21266 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:15.752678 21266 hybrid_clock.cc:648] HybridClock initialized: now 1783598895752653 us; error 0 us; skew 500 ppm
I20260709 12:08:15.753551 21266 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:15.760149 21266 webserver.cc:533] Webserver started at http://127.20.196.190:41829/ using document root <none> and password file <none>
I20260709 12:08:15.761045 21266 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:15.761283 21266 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:15.761756 21266 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:15.767767 21266 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894355727-21266-0/minicluster-data/master-0-root/instance:
uuid: "857e1fbcb5ad40829664d29dc0dd624e"
format_stamp: "Formatted at 2026-07-09 12:08:15 on dist-test-slave-h6sg"
I20260709 12:08:15.775725 21266 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.003s	sys 0.004s
I20260709 12:08:15.780938 21281 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:15.782096 21266 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:08:15.782455 21266 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894355727-21266-0/minicluster-data/master-0-root
uuid: "857e1fbcb5ad40829664d29dc0dd624e"
format_stamp: "Formatted at 2026-07-09 12:08:15 on dist-test-slave-h6sg"
I20260709 12:08:15.782842 21266 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894355727-21266-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894355727-21266-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894355727-21266-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:15.843446 21266 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:15.845047 21266 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:08:15.845522 21266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:15.921418 21266 rpc_server.cc:307] RPC server started. Bound to: 127.20.196.190:35291
I20260709 12:08:15.921489 21332 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.196.190:35291 every 8 connection(s)
I20260709 12:08:15.929327 21333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:15.951601 21333 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 857e1fbcb5ad40829664d29dc0dd624e: Bootstrap starting.
I20260709 12:08:15.957544 21333 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 857e1fbcb5ad40829664d29dc0dd624e: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:15.959508 21333 log.cc:826] T 00000000000000000000000000000000 P 857e1fbcb5ad40829664d29dc0dd624e: Log is configured to *not* fsync() on all Append() calls
I20260709 12:08:15.964031 21333 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 857e1fbcb5ad40829664d29dc0dd624e: No bootstrap required, opened a new log
I20260709 12:08:15.985638 21333 raft_consensus.cc:359] T 00000000000000000000000000000000 P 857e1fbcb5ad40829664d29dc0dd624e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "857e1fbcb5ad40829664d29dc0dd624e" member_type: VOTER }
I20260709 12:08:15.986287 21333 raft_consensus.cc:385] T 00000000000000000000000000000000 P 857e1fbcb5ad40829664d29dc0dd624e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:15.986696 21333 raft_consensus.cc:740] T 00000000000000000000000000000000 P 857e1fbcb5ad40829664d29dc0dd624e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 857e1fbcb5ad40829664d29dc0dd624e, State: Initialized, Role: FOLLOWER
I20260709 12:08:15.987681 21333 consensus_queue.cc:260] T 00000000000000000000000000000000 P 857e1fbcb5ad40829664d29dc0dd624e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "857e1fbcb5ad40829664d29dc0dd624e" member_type: VOTER }
I20260709 12:08:15.988196 21333 raft_consensus.cc:399] T 00000000000000000000000000000000 P 857e1fbcb5ad40829664d29dc0dd624e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:08:15.988525 21333 raft_consensus.cc:493] T 00000000000000000000000000000000 P 857e1fbcb5ad40829664d29dc0dd624e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:08:15.988896 21333 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 857e1fbcb5ad40829664d29dc0dd624e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:15.993059 21333 raft_consensus.cc:515] T 00000000000000000000000000000000 P 857e1fbcb5ad40829664d29dc0dd624e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "857e1fbcb5ad40829664d29dc0dd624e" member_type: VOTER }
I20260709 12:08:15.993853 21333 leader_election.cc:304] T 00000000000000000000000000000000 P 857e1fbcb5ad40829664d29dc0dd624e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 857e1fbcb5ad40829664d29dc0dd624e; no voters: 
I20260709 12:08:15.995697 21333 leader_election.cc:290] T 00000000000000000000000000000000 P 857e1fbcb5ad40829664d29dc0dd624e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:08:15.996109 21336 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 857e1fbcb5ad40829664d29dc0dd624e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:15.998831 21336 raft_consensus.cc:697] T 00000000000000000000000000000000 P 857e1fbcb5ad40829664d29dc0dd624e [term 1 LEADER]: Becoming Leader. State: Replica: 857e1fbcb5ad40829664d29dc0dd624e, State: Running, Role: LEADER
I20260709 12:08:15.999806 21336 consensus_queue.cc:237] T 00000000000000000000000000000000 P 857e1fbcb5ad40829664d29dc0dd624e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "857e1fbcb5ad40829664d29dc0dd624e" member_type: VOTER }
I20260709 12:08:16.000828 21333 sys_catalog.cc:565] T 00000000000000000000000000000000 P 857e1fbcb5ad40829664d29dc0dd624e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:08:16.012214 21337 sys_catalog.cc:455] T 00000000000000000000000000000000 P 857e1fbcb5ad40829664d29dc0dd624e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "857e1fbcb5ad40829664d29dc0dd624e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "857e1fbcb5ad40829664d29dc0dd624e" member_type: VOTER } }
I20260709 12:08:16.012795 21337 sys_catalog.cc:458] T 00000000000000000000000000000000 P 857e1fbcb5ad40829664d29dc0dd624e [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:16.014308 21338 sys_catalog.cc:455] T 00000000000000000000000000000000 P 857e1fbcb5ad40829664d29dc0dd624e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 857e1fbcb5ad40829664d29dc0dd624e. Latest consensus state: current_term: 1 leader_uuid: "857e1fbcb5ad40829664d29dc0dd624e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "857e1fbcb5ad40829664d29dc0dd624e" member_type: VOTER } }
I20260709 12:08:16.015079 21338 sys_catalog.cc:458] T 00000000000000000000000000000000 P 857e1fbcb5ad40829664d29dc0dd624e [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:16.016459 21346 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:08:16.029644 21346 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:08:16.031903 21266 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:08:16.046043 21346 catalog_manager.cc:1383] Generated new cluster ID: 7c284ff079d047ae800cfe739c7524a2
I20260709 12:08:16.046370 21346 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:08:16.069448 21346 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:08:16.071079 21346 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:08:16.083911 21346 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 857e1fbcb5ad40829664d29dc0dd624e: Generated new TSK 0
I20260709 12:08:16.084947 21346 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:08:16.105379 21266 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:16.115083 21355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:16.115931 21356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:16.123283 21358 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:16.123481 21266 server_base.cc:1061] running on GCE node
I20260709 12:08:16.124504 21266 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:16.124765 21266 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:16.124969 21266 hybrid_clock.cc:648] HybridClock initialized: now 1783598896124951 us; error 0 us; skew 500 ppm
I20260709 12:08:16.125792 21266 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:16.129843 21266 webserver.cc:533] Webserver started at http://127.20.196.129:45883/ using document root <none> and password file <none>
I20260709 12:08:16.130559 21266 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:16.130816 21266 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:16.131184 21266 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:16.132715 21266 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894355727-21266-0/minicluster-data/ts-0-root/instance:
uuid: "4e29cd095ba14aefbe4f8bf484bf87b1"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-h6sg"
I20260709 12:08:16.139777 21266 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:08:16.145026 21363 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:16.145934 21266 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.002s
I20260709 12:08:16.146291 21266 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894355727-21266-0/minicluster-data/ts-0-root
uuid: "4e29cd095ba14aefbe4f8bf484bf87b1"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-h6sg"
I20260709 12:08:16.146673 21266 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894355727-21266-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894355727-21266-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894355727-21266-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:16.173272 21266 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:16.175143 21266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:16.178009 21266 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:16.183609 21266 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:16.183923 21266 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:16.184250 21266 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:16.184480 21266 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:16.278550 21266 rpc_server.cc:307] RPC server started. Bound to: 127.20.196.129:38551
I20260709 12:08:16.278599 21425 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.196.129:38551 every 8 connection(s)
I20260709 12:08:16.286352 21266 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:16.296348 21430 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:16.303730 21431 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:16.305778 21433 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:16.306896 21266 server_base.cc:1061] running on GCE node
I20260709 12:08:16.307994 21266 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:16.308233 21266 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:16.308429 21266 hybrid_clock.cc:648] HybridClock initialized: now 1783598896308411 us; error 0 us; skew 500 ppm
I20260709 12:08:16.309036 21266 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:16.312776 21266 webserver.cc:533] Webserver started at http://127.20.196.130:40849/ using document root <none> and password file <none>
I20260709 12:08:16.313408 21266 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:16.313661 21266 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:16.313958 21266 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:16.314736 21426 heartbeater.cc:344] Connected to a master server at 127.20.196.190:35291
I20260709 12:08:16.315251 21426 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:16.315444 21266 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894355727-21266-0/minicluster-data/ts-1-root/instance:
uuid: "75785880ee25461b9ae096483d4fa6af"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-h6sg"
I20260709 12:08:16.316495 21426 heartbeater.cc:507] Master 127.20.196.190:35291 requested a full tablet report, sending...
I20260709 12:08:16.320114 21298 ts_manager.cc:194] Registered new tserver with Master: 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129:38551)
I20260709 12:08:16.323171 21298 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60170
I20260709 12:08:16.325150 21266 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.006s	sys 0.003s
I20260709 12:08:16.329979 21438 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:16.330906 21266 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:08:16.331308 21266 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894355727-21266-0/minicluster-data/ts-1-root
uuid: "75785880ee25461b9ae096483d4fa6af"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-h6sg"
I20260709 12:08:16.331615 21266 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894355727-21266-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894355727-21266-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894355727-21266-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:16.349820 21266 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:16.351140 21266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:16.353528 21266 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:16.356398 21266 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:16.356630 21266 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:16.356870 21266 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:16.357049 21266 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:16.451812 21266 rpc_server.cc:307] RPC server started. Bound to: 127.20.196.130:38339
I20260709 12:08:16.451992 21500 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.196.130:38339 every 8 connection(s)
I20260709 12:08:16.459540 21266 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:16.468981 21504 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:16.472865 21505 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:16.474320 21501 heartbeater.cc:344] Connected to a master server at 127.20.196.190:35291
I20260709 12:08:16.474766 21501 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:16.475944 21501 heartbeater.cc:507] Master 127.20.196.190:35291 requested a full tablet report, sending...
I20260709 12:08:16.478654 21298 ts_manager.cc:194] Registered new tserver with Master: 75785880ee25461b9ae096483d4fa6af (127.20.196.130:38339)
I20260709 12:08:16.480552 21298 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60180
W20260709 12:08:16.483409 21507 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:16.485380 21266 server_base.cc:1061] running on GCE node
I20260709 12:08:16.486397 21266 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:16.486579 21266 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:16.486788 21266 hybrid_clock.cc:648] HybridClock initialized: now 1783598896486753 us; error 0 us; skew 500 ppm
I20260709 12:08:16.487412 21266 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:16.491991 21266 webserver.cc:533] Webserver started at http://127.20.196.131:36603/ using document root <none> and password file <none>
I20260709 12:08:16.492471 21266 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:16.492674 21266 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:16.492949 21266 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:16.494112 21266 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894355727-21266-0/minicluster-data/ts-2-root/instance:
uuid: "d433900e5e4f4756b982e1f6fe549fa7"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-h6sg"
I20260709 12:08:16.498780 21266 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:08:16.502568 21512 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:16.504204 21266 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:08:16.504532 21266 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894355727-21266-0/minicluster-data/ts-2-root
uuid: "d433900e5e4f4756b982e1f6fe549fa7"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-h6sg"
I20260709 12:08:16.504900 21266 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894355727-21266-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894355727-21266-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894355727-21266-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:16.533093 21266 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:16.534528 21266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:16.536252 21266 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:16.538504 21266 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:16.538756 21266 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:16.539075 21266 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:16.539299 21266 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:16.648743 21266 rpc_server.cc:307] RPC server started. Bound to: 127.20.196.131:43271
I20260709 12:08:16.648909 21574 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.196.131:43271 every 8 connection(s)
I20260709 12:08:16.668648 21575 heartbeater.cc:344] Connected to a master server at 127.20.196.190:35291
I20260709 12:08:16.669098 21575 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:16.670071 21575 heartbeater.cc:507] Master 127.20.196.190:35291 requested a full tablet report, sending...
I20260709 12:08:16.672791 21298 ts_manager.cc:194] Registered new tserver with Master: d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131:43271)
I20260709 12:08:16.673868 21266 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016627226s
I20260709 12:08:16.674561 21298 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60188
I20260709 12:08:16.740444 21298 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60202:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:08:16.745378 21298 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:08:16.879709 21466 tablet_service.cc:1511] Processing CreateTablet for tablet 3b12c0d1f9484064b965191731a2a7d3 (DEFAULT_TABLE table=test-workload [id=937e1c0ad061413fa80beffc07a271af]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:08:16.881439 21466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b12c0d1f9484064b965191731a2a7d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:16.881507 21465 tablet_service.cc:1511] Processing CreateTablet for tablet e394f7ee8d92438f9429acae83270427 (DEFAULT_TABLE table=test-workload [id=937e1c0ad061413fa80beffc07a271af]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:08:16.882853 21465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e394f7ee8d92438f9429acae83270427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:16.889631 21462 tablet_service.cc:1511] Processing CreateTablet for tablet d7232d0c08da499d9ceaf0ecbf7983f9 (DEFAULT_TABLE table=test-workload [id=937e1c0ad061413fa80beffc07a271af]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:08:16.890408 21460 tablet_service.cc:1511] Processing CreateTablet for tablet 8c39dd9aa7c74311a6d6987771803595 (DEFAULT_TABLE table=test-workload [id=937e1c0ad061413fa80beffc07a271af]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:08:16.888260 21464 tablet_service.cc:1511] Processing CreateTablet for tablet 468c279623b041e0b7cdb26c8976000e (DEFAULT_TABLE table=test-workload [id=937e1c0ad061413fa80beffc07a271af]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:08:16.893816 21463 tablet_service.cc:1511] Processing CreateTablet for tablet 37d20a28cb9f4b37ac61e4a17d6949d3 (DEFAULT_TABLE table=test-workload [id=937e1c0ad061413fa80beffc07a271af]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:08:16.894990 21462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7232d0c08da499d9ceaf0ecbf7983f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:16.895658 21464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 468c279623b041e0b7cdb26c8976000e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:16.892282 21461 tablet_service.cc:1511] Processing CreateTablet for tablet 030565532533437291655b1a62f632ae (DEFAULT_TABLE table=test-workload [id=937e1c0ad061413fa80beffc07a271af]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:08:16.899353 21460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c39dd9aa7c74311a6d6987771803595. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:16.903278 21461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 030565532533437291655b1a62f632ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:16.907354 21463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37d20a28cb9f4b37ac61e4a17d6949d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:16.912292 21391 tablet_service.cc:1511] Processing CreateTablet for tablet 3b12c0d1f9484064b965191731a2a7d3 (DEFAULT_TABLE table=test-workload [id=937e1c0ad061413fa80beffc07a271af]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:08:16.913612 21391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b12c0d1f9484064b965191731a2a7d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:16.916246 21390 tablet_service.cc:1511] Processing CreateTablet for tablet e394f7ee8d92438f9429acae83270427 (DEFAULT_TABLE table=test-workload [id=937e1c0ad061413fa80beffc07a271af]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:08:16.917552 21390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e394f7ee8d92438f9429acae83270427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:16.939472 21593 tablet_bootstrap.cc:492] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af: Bootstrap starting.
I20260709 12:08:16.942658 21538 tablet_service.cc:1511] Processing CreateTablet for tablet 468c279623b041e0b7cdb26c8976000e (DEFAULT_TABLE table=test-workload [id=937e1c0ad061413fa80beffc07a271af]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:08:16.949988 21538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 468c279623b041e0b7cdb26c8976000e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:16.935587 21540 tablet_service.cc:1511] Processing CreateTablet for tablet 3b12c0d1f9484064b965191731a2a7d3 (DEFAULT_TABLE table=test-workload [id=937e1c0ad061413fa80beffc07a271af]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:08:16.953033 21387 tablet_service.cc:1511] Processing CreateTablet for tablet d7232d0c08da499d9ceaf0ecbf7983f9 (DEFAULT_TABLE table=test-workload [id=937e1c0ad061413fa80beffc07a271af]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:08:16.953135 21389 tablet_service.cc:1511] Processing CreateTablet for tablet 468c279623b041e0b7cdb26c8976000e (DEFAULT_TABLE table=test-workload [id=937e1c0ad061413fa80beffc07a271af]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:08:16.944844 21537 tablet_service.cc:1511] Processing CreateTablet for tablet 37d20a28cb9f4b37ac61e4a17d6949d3 (DEFAULT_TABLE table=test-workload [id=937e1c0ad061413fa80beffc07a271af]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:08:16.961001 21387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7232d0c08da499d9ceaf0ecbf7983f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:16.944998 21384 tablet_service.cc:1511] Processing CreateTablet for tablet 8c96a750d4384f449614e6bfcea47a96 (DEFAULT_TABLE table=test-workload [id=937e1c0ad061413fa80beffc07a271af]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:08:16.947984 21536 tablet_service.cc:1511] Processing CreateTablet for tablet d7232d0c08da499d9ceaf0ecbf7983f9 (DEFAULT_TABLE table=test-workload [id=937e1c0ad061413fa80beffc07a271af]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:08:16.952929 21385 tablet_service.cc:1511] Processing CreateTablet for tablet 8c39dd9aa7c74311a6d6987771803595 (DEFAULT_TABLE table=test-workload [id=937e1c0ad061413fa80beffc07a271af]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:08:16.964731 21539 tablet_service.cc:1511] Processing CreateTablet for tablet e394f7ee8d92438f9429acae83270427 (DEFAULT_TABLE table=test-workload [id=937e1c0ad061413fa80beffc07a271af]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:08:16.947103 21535 tablet_service.cc:1511] Processing CreateTablet for tablet 030565532533437291655b1a62f632ae (DEFAULT_TABLE table=test-workload [id=937e1c0ad061413fa80beffc07a271af]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:08:16.959216 21465 tablet_service.cc:1511] Processing CreateTablet for tablet 8c96a750d4384f449614e6bfcea47a96 (DEFAULT_TABLE table=test-workload [id=937e1c0ad061413fa80beffc07a271af]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:08:16.967516 21388 tablet_service.cc:1511] Processing CreateTablet for tablet 37d20a28cb9f4b37ac61e4a17d6949d3 (DEFAULT_TABLE table=test-workload [id=937e1c0ad061413fa80beffc07a271af]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:08:16.968750 21533 tablet_service.cc:1511] Processing CreateTablet for tablet 8c96a750d4384f449614e6bfcea47a96 (DEFAULT_TABLE table=test-workload [id=937e1c0ad061413fa80beffc07a271af]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:08:16.972460 21540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b12c0d1f9484064b965191731a2a7d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:16.956298 21534 tablet_service.cc:1511] Processing CreateTablet for tablet 8c39dd9aa7c74311a6d6987771803595 (DEFAULT_TABLE table=test-workload [id=937e1c0ad061413fa80beffc07a271af]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:08:16.978829 21383 tablet_service.cc:1511] Processing CreateTablet for tablet b11009396a6546e881059dd95f05bc94 (DEFAULT_TABLE table=test-workload [id=937e1c0ad061413fa80beffc07a271af]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:08:16.979561 21389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 468c279623b041e0b7cdb26c8976000e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:16.964111 21386 tablet_service.cc:1511] Processing CreateTablet for tablet 030565532533437291655b1a62f632ae (DEFAULT_TABLE table=test-workload [id=937e1c0ad061413fa80beffc07a271af]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:08:16.979923 21459 tablet_service.cc:1511] Processing CreateTablet for tablet b11009396a6546e881059dd95f05bc94 (DEFAULT_TABLE table=test-workload [id=937e1c0ad061413fa80beffc07a271af]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:08:16.986801 21536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7232d0c08da499d9ceaf0ecbf7983f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:16.996377 21384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c96a750d4384f449614e6bfcea47a96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:16.997951 21386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 030565532533437291655b1a62f632ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:16.996424 21532 tablet_service.cc:1511] Processing CreateTablet for tablet b11009396a6546e881059dd95f05bc94 (DEFAULT_TABLE table=test-workload [id=937e1c0ad061413fa80beffc07a271af]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:08:16.994081 21465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c96a750d4384f449614e6bfcea47a96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.001904 21535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 030565532533437291655b1a62f632ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.005069 21532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b11009396a6546e881059dd95f05bc94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.006318 21459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b11009396a6546e881059dd95f05bc94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.004310 21385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c39dd9aa7c74311a6d6987771803595. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.009187 21537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37d20a28cb9f4b37ac61e4a17d6949d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.019279 21388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37d20a28cb9f4b37ac61e4a17d6949d3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:08:17.021173 21345 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:08:17.031484 21534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c39dd9aa7c74311a6d6987771803595. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.035960 21539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e394f7ee8d92438f9429acae83270427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.036105 21383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b11009396a6546e881059dd95f05bc94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.085047 21533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c96a750d4384f449614e6bfcea47a96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.206003 21594 tablet_bootstrap.cc:492] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1: Bootstrap starting.
I20260709 12:08:17.212957 21593 tablet_bootstrap.cc:654] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.246593 21595 tablet_bootstrap.cc:492] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7: Bootstrap starting.
I20260709 12:08:17.262135 21594 tablet_bootstrap.cc:654] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.269466 21593 tablet_bootstrap.cc:492] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af: No bootstrap required, opened a new log
I20260709 12:08:17.270016 21593 ts_tablet_manager.cc:1403] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af: Time spent bootstrapping tablet: real 0.350s	user 0.021s	sys 0.012s
I20260709 12:08:17.270366 21595 tablet_bootstrap.cc:654] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.273524 21593 raft_consensus.cc:359] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.274672 21593 raft_consensus.cc:385] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.275306 21593 raft_consensus.cc:740] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75785880ee25461b9ae096483d4fa6af, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.276531 21593 consensus_queue.cc:260] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.280992 21594 tablet_bootstrap.cc:492] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1: No bootstrap required, opened a new log
I20260709 12:08:17.281457 21594 ts_tablet_manager.cc:1403] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1: Time spent bootstrapping tablet: real 0.076s	user 0.011s	sys 0.012s
I20260709 12:08:17.283296 21595 tablet_bootstrap.cc:492] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7: No bootstrap required, opened a new log
I20260709 12:08:17.283890 21595 ts_tablet_manager.cc:1403] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.007s
I20260709 12:08:17.284621 21594 raft_consensus.cc:359] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } }
I20260709 12:08:17.285349 21594 raft_consensus.cc:385] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.285645 21594 raft_consensus.cc:740] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e29cd095ba14aefbe4f8bf484bf87b1, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.287726 21595 raft_consensus.cc:359] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.288515 21595 raft_consensus.cc:385] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.288729 21593 ts_tablet_manager.cc:1434] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af: Time spent starting tablet: real 0.018s	user 0.015s	sys 0.001s
I20260709 12:08:17.288900 21595 raft_consensus.cc:740] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d433900e5e4f4756b982e1f6fe549fa7, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.289814 21501 heartbeater.cc:499] Master 127.20.196.190:35291 was elected leader, sending a full tablet report...
I20260709 12:08:17.289387 21594 consensus_queue.cc:260] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } }
I20260709 12:08:17.289921 21595 consensus_queue.cc:260] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.297924 21426 heartbeater.cc:499] Master 127.20.196.190:35291 was elected leader, sending a full tablet report...
I20260709 12:08:17.299036 21575 heartbeater.cc:499] Master 127.20.196.190:35291 was elected leader, sending a full tablet report...
I20260709 12:08:17.300058 21595 ts_tablet_manager.cc:1434] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 12:08:17.301134 21595 tablet_bootstrap.cc:492] T b11009396a6546e881059dd95f05bc94 P d433900e5e4f4756b982e1f6fe549fa7: Bootstrap starting.
I20260709 12:08:17.306367 21594 ts_tablet_manager.cc:1434] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.009s
I20260709 12:08:17.307586 21594 tablet_bootstrap.cc:492] T 8c39dd9aa7c74311a6d6987771803595 P 4e29cd095ba14aefbe4f8bf484bf87b1: Bootstrap starting.
I20260709 12:08:17.308466 21595 tablet_bootstrap.cc:654] T b11009396a6546e881059dd95f05bc94 P d433900e5e4f4756b982e1f6fe549fa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.314139 21594 tablet_bootstrap.cc:654] T 8c39dd9aa7c74311a6d6987771803595 P 4e29cd095ba14aefbe4f8bf484bf87b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.319873 21593 tablet_bootstrap.cc:492] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af: Bootstrap starting.
I20260709 12:08:17.325485 21594 tablet_bootstrap.cc:492] T 8c39dd9aa7c74311a6d6987771803595 P 4e29cd095ba14aefbe4f8bf484bf87b1: No bootstrap required, opened a new log
I20260709 12:08:17.326100 21594 ts_tablet_manager.cc:1403] T 8c39dd9aa7c74311a6d6987771803595 P 4e29cd095ba14aefbe4f8bf484bf87b1: Time spent bootstrapping tablet: real 0.019s	user 0.005s	sys 0.011s
I20260709 12:08:17.350939 21594 raft_consensus.cc:359] T 8c39dd9aa7c74311a6d6987771803595 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.351758 21594 raft_consensus.cc:385] T 8c39dd9aa7c74311a6d6987771803595 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.352072 21594 raft_consensus.cc:740] T 8c39dd9aa7c74311a6d6987771803595 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e29cd095ba14aefbe4f8bf484bf87b1, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.352802 21594 consensus_queue.cc:260] T 8c39dd9aa7c74311a6d6987771803595 P 4e29cd095ba14aefbe4f8bf484bf87b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.354285 21593 tablet_bootstrap.cc:654] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.355193 21594 ts_tablet_manager.cc:1434] T 8c39dd9aa7c74311a6d6987771803595 P 4e29cd095ba14aefbe4f8bf484bf87b1: Time spent starting tablet: real 0.029s	user 0.018s	sys 0.013s
I20260709 12:08:17.356118 21594 tablet_bootstrap.cc:492] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1: Bootstrap starting.
I20260709 12:08:17.365612 21594 tablet_bootstrap.cc:654] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.378165 21595 tablet_bootstrap.cc:492] T b11009396a6546e881059dd95f05bc94 P d433900e5e4f4756b982e1f6fe549fa7: No bootstrap required, opened a new log
I20260709 12:08:17.378870 21595 ts_tablet_manager.cc:1403] T b11009396a6546e881059dd95f05bc94 P d433900e5e4f4756b982e1f6fe549fa7: Time spent bootstrapping tablet: real 0.078s	user 0.050s	sys 0.019s
I20260709 12:08:17.379598 21593 tablet_bootstrap.cc:492] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af: No bootstrap required, opened a new log
I20260709 12:08:17.380143 21593 ts_tablet_manager.cc:1403] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af: Time spent bootstrapping tablet: real 0.061s	user 0.013s	sys 0.006s
I20260709 12:08:17.381884 21595 raft_consensus.cc:359] T b11009396a6546e881059dd95f05bc94 P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.382619 21595 raft_consensus.cc:385] T b11009396a6546e881059dd95f05bc94 P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.382910 21593 raft_consensus.cc:359] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.383667 21593 raft_consensus.cc:385] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.384016 21593 raft_consensus.cc:740] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75785880ee25461b9ae096483d4fa6af, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.384851 21593 consensus_queue.cc:260] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.386936 21593 ts_tablet_manager.cc:1434] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:08:17.387794 21593 tablet_bootstrap.cc:492] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af: Bootstrap starting.
I20260709 12:08:17.388053 21594 tablet_bootstrap.cc:492] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1: No bootstrap required, opened a new log
I20260709 12:08:17.388502 21594 ts_tablet_manager.cc:1403] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.007s
I20260709 12:08:17.382928 21595 raft_consensus.cc:740] T b11009396a6546e881059dd95f05bc94 P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d433900e5e4f4756b982e1f6fe549fa7, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.390102 21595 consensus_queue.cc:260] T b11009396a6546e881059dd95f05bc94 P d433900e5e4f4756b982e1f6fe549fa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.391407 21594 raft_consensus.cc:359] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.392096 21594 raft_consensus.cc:385] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.392395 21594 raft_consensus.cc:740] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e29cd095ba14aefbe4f8bf484bf87b1, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.393088 21594 consensus_queue.cc:260] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.394447 21595 ts_tablet_manager.cc:1434] T b11009396a6546e881059dd95f05bc94 P d433900e5e4f4756b982e1f6fe549fa7: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:08:17.395299 21595 tablet_bootstrap.cc:492] T d7232d0c08da499d9ceaf0ecbf7983f9 P d433900e5e4f4756b982e1f6fe549fa7: Bootstrap starting.
I20260709 12:08:17.395447 21594 ts_tablet_manager.cc:1434] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 12:08:17.396389 21594 tablet_bootstrap.cc:492] T d7232d0c08da499d9ceaf0ecbf7983f9 P 4e29cd095ba14aefbe4f8bf484bf87b1: Bootstrap starting.
I20260709 12:08:17.404264 21594 tablet_bootstrap.cc:654] T d7232d0c08da499d9ceaf0ecbf7983f9 P 4e29cd095ba14aefbe4f8bf484bf87b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.405084 21593 tablet_bootstrap.cc:654] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.408893 21595 tablet_bootstrap.cc:654] T d7232d0c08da499d9ceaf0ecbf7983f9 P d433900e5e4f4756b982e1f6fe549fa7: Neither blocks nor log segments found. Creating new log.
W20260709 12:08:17.410271 21576 tablet.cc:2406] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:08:17.415897 21594 tablet_bootstrap.cc:492] T d7232d0c08da499d9ceaf0ecbf7983f9 P 4e29cd095ba14aefbe4f8bf484bf87b1: No bootstrap required, opened a new log
I20260709 12:08:17.416409 21594 ts_tablet_manager.cc:1403] T d7232d0c08da499d9ceaf0ecbf7983f9 P 4e29cd095ba14aefbe4f8bf484bf87b1: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.007s
I20260709 12:08:17.418756 21593 tablet_bootstrap.cc:492] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af: No bootstrap required, opened a new log
I20260709 12:08:17.419279 21593 ts_tablet_manager.cc:1403] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.003s
I20260709 12:08:17.419411 21594 raft_consensus.cc:359] T d7232d0c08da499d9ceaf0ecbf7983f9 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.420348 21594 raft_consensus.cc:385] T d7232d0c08da499d9ceaf0ecbf7983f9 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.420861 21594 raft_consensus.cc:740] T d7232d0c08da499d9ceaf0ecbf7983f9 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e29cd095ba14aefbe4f8bf484bf87b1, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.421605 21594 consensus_queue.cc:260] T d7232d0c08da499d9ceaf0ecbf7983f9 P 4e29cd095ba14aefbe4f8bf484bf87b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.422923 21593 raft_consensus.cc:359] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.427166 21593 raft_consensus.cc:385] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.427492 21593 raft_consensus.cc:740] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75785880ee25461b9ae096483d4fa6af, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.428239 21593 consensus_queue.cc:260] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.430398 21593 ts_tablet_manager.cc:1434] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 12:08:17.431419 21593 tablet_bootstrap.cc:492] T d7232d0c08da499d9ceaf0ecbf7983f9 P 75785880ee25461b9ae096483d4fa6af: Bootstrap starting.
I20260709 12:08:17.424291 21594 ts_tablet_manager.cc:1434] T d7232d0c08da499d9ceaf0ecbf7983f9 P 4e29cd095ba14aefbe4f8bf484bf87b1: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:08:17.439844 21594 tablet_bootstrap.cc:492] T 8c96a750d4384f449614e6bfcea47a96 P 4e29cd095ba14aefbe4f8bf484bf87b1: Bootstrap starting.
I20260709 12:08:17.446290 21594 tablet_bootstrap.cc:654] T 8c96a750d4384f449614e6bfcea47a96 P 4e29cd095ba14aefbe4f8bf484bf87b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.438856 21593 tablet_bootstrap.cc:654] T d7232d0c08da499d9ceaf0ecbf7983f9 P 75785880ee25461b9ae096483d4fa6af: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.461182 21595 tablet_bootstrap.cc:492] T d7232d0c08da499d9ceaf0ecbf7983f9 P d433900e5e4f4756b982e1f6fe549fa7: No bootstrap required, opened a new log
I20260709 12:08:17.461547 21593 tablet_bootstrap.cc:492] T d7232d0c08da499d9ceaf0ecbf7983f9 P 75785880ee25461b9ae096483d4fa6af: No bootstrap required, opened a new log
I20260709 12:08:17.461623 21595 ts_tablet_manager.cc:1403] T d7232d0c08da499d9ceaf0ecbf7983f9 P d433900e5e4f4756b982e1f6fe549fa7: Time spent bootstrapping tablet: real 0.066s	user 0.019s	sys 0.034s
I20260709 12:08:17.462993 21593 ts_tablet_manager.cc:1403] T d7232d0c08da499d9ceaf0ecbf7983f9 P 75785880ee25461b9ae096483d4fa6af: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.000s
I20260709 12:08:17.465140 21594 tablet_bootstrap.cc:492] T 8c96a750d4384f449614e6bfcea47a96 P 4e29cd095ba14aefbe4f8bf484bf87b1: No bootstrap required, opened a new log
I20260709 12:08:17.465643 21594 ts_tablet_manager.cc:1403] T 8c96a750d4384f449614e6bfcea47a96 P 4e29cd095ba14aefbe4f8bf484bf87b1: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.007s
I20260709 12:08:17.465720 21595 raft_consensus.cc:359] T d7232d0c08da499d9ceaf0ecbf7983f9 P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.465891 21593 raft_consensus.cc:359] T d7232d0c08da499d9ceaf0ecbf7983f9 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.466526 21595 raft_consensus.cc:385] T d7232d0c08da499d9ceaf0ecbf7983f9 P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.466710 21593 raft_consensus.cc:385] T d7232d0c08da499d9ceaf0ecbf7983f9 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.466893 21595 raft_consensus.cc:740] T d7232d0c08da499d9ceaf0ecbf7983f9 P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d433900e5e4f4756b982e1f6fe549fa7, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.467095 21593 raft_consensus.cc:740] T d7232d0c08da499d9ceaf0ecbf7983f9 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75785880ee25461b9ae096483d4fa6af, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.467869 21593 consensus_queue.cc:260] T d7232d0c08da499d9ceaf0ecbf7983f9 P 75785880ee25461b9ae096483d4fa6af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.467908 21595 consensus_queue.cc:260] T d7232d0c08da499d9ceaf0ecbf7983f9 P d433900e5e4f4756b982e1f6fe549fa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.469437 21594 raft_consensus.cc:359] T 8c96a750d4384f449614e6bfcea47a96 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.470279 21594 raft_consensus.cc:385] T 8c96a750d4384f449614e6bfcea47a96 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.470589 21593 ts_tablet_manager.cc:1434] T d7232d0c08da499d9ceaf0ecbf7983f9 P 75785880ee25461b9ae096483d4fa6af: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:08:17.470651 21594 raft_consensus.cc:740] T 8c96a750d4384f449614e6bfcea47a96 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e29cd095ba14aefbe4f8bf484bf87b1, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.471609 21594 consensus_queue.cc:260] T 8c96a750d4384f449614e6bfcea47a96 P 4e29cd095ba14aefbe4f8bf484bf87b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.474335 21594 ts_tablet_manager.cc:1434] T 8c96a750d4384f449614e6bfcea47a96 P 4e29cd095ba14aefbe4f8bf484bf87b1: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:08:17.475709 21594 tablet_bootstrap.cc:492] T b11009396a6546e881059dd95f05bc94 P 4e29cd095ba14aefbe4f8bf484bf87b1: Bootstrap starting.
I20260709 12:08:17.476728 21595 ts_tablet_manager.cc:1434] T d7232d0c08da499d9ceaf0ecbf7983f9 P d433900e5e4f4756b982e1f6fe549fa7: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:08:17.477238 21593 tablet_bootstrap.cc:492] T 8c39dd9aa7c74311a6d6987771803595 P 75785880ee25461b9ae096483d4fa6af: Bootstrap starting.
I20260709 12:08:17.477659 21595 tablet_bootstrap.cc:492] T 37d20a28cb9f4b37ac61e4a17d6949d3 P d433900e5e4f4756b982e1f6fe549fa7: Bootstrap starting.
I20260709 12:08:17.480957 21599 raft_consensus.cc:493] T d7232d0c08da499d9ceaf0ecbf7983f9 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:17.481518 21599 raft_consensus.cc:515] T d7232d0c08da499d9ceaf0ecbf7983f9 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.484508 21599 leader_election.cc:290] T d7232d0c08da499d9ceaf0ecbf7983f9 P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129:38551), d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131:43271)
I20260709 12:08:17.504890 21595 tablet_bootstrap.cc:654] T 37d20a28cb9f4b37ac61e4a17d6949d3 P d433900e5e4f4756b982e1f6fe549fa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.506958 21599 raft_consensus.cc:493] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:17.507781 21594 tablet_bootstrap.cc:654] T b11009396a6546e881059dd95f05bc94 P 4e29cd095ba14aefbe4f8bf484bf87b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.505882 21593 tablet_bootstrap.cc:654] T 8c39dd9aa7c74311a6d6987771803595 P 75785880ee25461b9ae096483d4fa6af: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.507490 21599 raft_consensus.cc:515] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.510768 21599 leader_election.cc:290] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129:38551), d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131:43271)
I20260709 12:08:17.527246 21595 tablet_bootstrap.cc:492] T 37d20a28cb9f4b37ac61e4a17d6949d3 P d433900e5e4f4756b982e1f6fe549fa7: No bootstrap required, opened a new log
I20260709 12:08:17.527747 21595 ts_tablet_manager.cc:1403] T 37d20a28cb9f4b37ac61e4a17d6949d3 P d433900e5e4f4756b982e1f6fe549fa7: Time spent bootstrapping tablet: real 0.050s	user 0.009s	sys 0.011s
I20260709 12:08:17.531749 21595 raft_consensus.cc:359] T 37d20a28cb9f4b37ac61e4a17d6949d3 P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.532852 21595 raft_consensus.cc:385] T 37d20a28cb9f4b37ac61e4a17d6949d3 P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.533180 21595 raft_consensus.cc:740] T 37d20a28cb9f4b37ac61e4a17d6949d3 P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d433900e5e4f4756b982e1f6fe549fa7, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.533931 21595 consensus_queue.cc:260] T 37d20a28cb9f4b37ac61e4a17d6949d3 P d433900e5e4f4756b982e1f6fe549fa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.535780 21593 tablet_bootstrap.cc:492] T 8c39dd9aa7c74311a6d6987771803595 P 75785880ee25461b9ae096483d4fa6af: No bootstrap required, opened a new log
I20260709 12:08:17.536227 21595 ts_tablet_manager.cc:1434] T 37d20a28cb9f4b37ac61e4a17d6949d3 P d433900e5e4f4756b982e1f6fe549fa7: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.006s
I20260709 12:08:17.536294 21593 ts_tablet_manager.cc:1403] T 8c39dd9aa7c74311a6d6987771803595 P 75785880ee25461b9ae096483d4fa6af: Time spent bootstrapping tablet: real 0.059s	user 0.015s	sys 0.004s
I20260709 12:08:17.537264 21595 tablet_bootstrap.cc:492] T 8c39dd9aa7c74311a6d6987771803595 P d433900e5e4f4756b982e1f6fe549fa7: Bootstrap starting.
I20260709 12:08:17.540737 21593 raft_consensus.cc:359] T 8c39dd9aa7c74311a6d6987771803595 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.541560 21593 raft_consensus.cc:385] T 8c39dd9aa7c74311a6d6987771803595 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.541919 21593 raft_consensus.cc:740] T 8c39dd9aa7c74311a6d6987771803595 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75785880ee25461b9ae096483d4fa6af, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.542646 21593 consensus_queue.cc:260] T 8c39dd9aa7c74311a6d6987771803595 P 75785880ee25461b9ae096483d4fa6af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.544157 21595 tablet_bootstrap.cc:654] T 8c39dd9aa7c74311a6d6987771803595 P d433900e5e4f4756b982e1f6fe549fa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.545264 21593 ts_tablet_manager.cc:1434] T 8c39dd9aa7c74311a6d6987771803595 P 75785880ee25461b9ae096483d4fa6af: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:08:17.547657 21593 tablet_bootstrap.cc:492] T 468c279623b041e0b7cdb26c8976000e P 75785880ee25461b9ae096483d4fa6af: Bootstrap starting.
I20260709 12:08:17.548898 21401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7232d0c08da499d9ceaf0ecbf7983f9" candidate_uuid: "75785880ee25461b9ae096483d4fa6af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" is_pre_election: true
I20260709 12:08:17.556368 21401 raft_consensus.cc:2468] T d7232d0c08da499d9ceaf0ecbf7983f9 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75785880ee25461b9ae096483d4fa6af in term 0.
I20260709 12:08:17.550076 21400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030565532533437291655b1a62f632ae" candidate_uuid: "75785880ee25461b9ae096483d4fa6af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" is_pre_election: true
I20260709 12:08:17.559114 21439 leader_election.cc:304] T d7232d0c08da499d9ceaf0ecbf7983f9 P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e29cd095ba14aefbe4f8bf484bf87b1, 75785880ee25461b9ae096483d4fa6af; no voters: 
I20260709 12:08:17.560040 21599 raft_consensus.cc:2804] T d7232d0c08da499d9ceaf0ecbf7983f9 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:17.560420 21599 raft_consensus.cc:493] T d7232d0c08da499d9ceaf0ecbf7983f9 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:17.560762 21599 raft_consensus.cc:3060] T d7232d0c08da499d9ceaf0ecbf7983f9 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:17.562381 21593 tablet_bootstrap.cc:654] T 468c279623b041e0b7cdb26c8976000e P 75785880ee25461b9ae096483d4fa6af: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.553179 21594 tablet_bootstrap.cc:492] T b11009396a6546e881059dd95f05bc94 P 4e29cd095ba14aefbe4f8bf484bf87b1: No bootstrap required, opened a new log
I20260709 12:08:17.563300 21594 ts_tablet_manager.cc:1403] T b11009396a6546e881059dd95f05bc94 P 4e29cd095ba14aefbe4f8bf484bf87b1: Time spent bootstrapping tablet: real 0.088s	user 0.011s	sys 0.010s
I20260709 12:08:17.565122 21601 raft_consensus.cc:493] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:17.565630 21601 raft_consensus.cc:515] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.566576 21595 tablet_bootstrap.cc:492] T 8c39dd9aa7c74311a6d6987771803595 P d433900e5e4f4756b982e1f6fe549fa7: No bootstrap required, opened a new log
I20260709 12:08:17.566561 21594 raft_consensus.cc:359] T b11009396a6546e881059dd95f05bc94 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.567186 21595 ts_tablet_manager.cc:1403] T 8c39dd9aa7c74311a6d6987771803595 P d433900e5e4f4756b982e1f6fe549fa7: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.009s
I20260709 12:08:17.567342 21594 raft_consensus.cc:385] T b11009396a6546e881059dd95f05bc94 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.567674 21594 raft_consensus.cc:740] T b11009396a6546e881059dd95f05bc94 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e29cd095ba14aefbe4f8bf484bf87b1, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.568640 21601 leader_election.cc:290] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129:38551), 75785880ee25461b9ae096483d4fa6af (127.20.196.130:38339)
I20260709 12:08:17.568408 21594 consensus_queue.cc:260] T b11009396a6546e881059dd95f05bc94 P 4e29cd095ba14aefbe4f8bf484bf87b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.570779 21594 ts_tablet_manager.cc:1434] T b11009396a6546e881059dd95f05bc94 P 4e29cd095ba14aefbe4f8bf484bf87b1: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 12:08:17.576298 21594 tablet_bootstrap.cc:492] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 4e29cd095ba14aefbe4f8bf484bf87b1: Bootstrap starting.
I20260709 12:08:17.577332 21595 raft_consensus.cc:359] T 8c39dd9aa7c74311a6d6987771803595 P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.578048 21595 raft_consensus.cc:385] T 8c39dd9aa7c74311a6d6987771803595 P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.578312 21595 raft_consensus.cc:740] T 8c39dd9aa7c74311a6d6987771803595 P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d433900e5e4f4756b982e1f6fe549fa7, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.584321 21594 tablet_bootstrap.cc:654] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 4e29cd095ba14aefbe4f8bf484bf87b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.585624 21595 consensus_queue.cc:260] T 8c39dd9aa7c74311a6d6987771803595 P d433900e5e4f4756b982e1f6fe549fa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.589469 21595 ts_tablet_manager.cc:1434] T 8c39dd9aa7c74311a6d6987771803595 P d433900e5e4f4756b982e1f6fe549fa7: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.003s
I20260709 12:08:17.590427 21595 tablet_bootstrap.cc:492] T 3b12c0d1f9484064b965191731a2a7d3 P d433900e5e4f4756b982e1f6fe549fa7: Bootstrap starting.
W20260709 12:08:17.589550 21439 leader_election.cc:343] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129:38551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:17.605149 21599 raft_consensus.cc:515] T d7232d0c08da499d9ceaf0ecbf7983f9 P 75785880ee25461b9ae096483d4fa6af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.606361 21601 raft_consensus.cc:493] T b11009396a6546e881059dd95f05bc94 P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:17.606854 21601 raft_consensus.cc:515] T b11009396a6546e881059dd95f05bc94 P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.611263 21550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7232d0c08da499d9ceaf0ecbf7983f9" candidate_uuid: "75785880ee25461b9ae096483d4fa6af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d433900e5e4f4756b982e1f6fe549fa7" is_pre_election: true
I20260709 12:08:17.616701 21601 leader_election.cc:290] T b11009396a6546e881059dd95f05bc94 P d433900e5e4f4756b982e1f6fe549fa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129:38551), 75785880ee25461b9ae096483d4fa6af (127.20.196.130:38339)
I20260709 12:08:17.616544 21549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030565532533437291655b1a62f632ae" candidate_uuid: "75785880ee25461b9ae096483d4fa6af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d433900e5e4f4756b982e1f6fe549fa7" is_pre_election: true
I20260709 12:08:17.614918 21550 raft_consensus.cc:2468] T d7232d0c08da499d9ceaf0ecbf7983f9 P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75785880ee25461b9ae096483d4fa6af in term 0.
W20260709 12:08:17.618925 21439 leader_election.cc:343] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:17.619372 21439 leader_election.cc:304] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 75785880ee25461b9ae096483d4fa6af; no voters: 4e29cd095ba14aefbe4f8bf484bf87b1, d433900e5e4f4756b982e1f6fe549fa7
I20260709 12:08:17.625042 21599 leader_election.cc:290] T d7232d0c08da499d9ceaf0ecbf7983f9 P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 1 election: Requested vote from peers 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129:38551), d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131:43271)
I20260709 12:08:17.627173 21599 raft_consensus.cc:2749] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:17.631160 21593 tablet_bootstrap.cc:492] T 468c279623b041e0b7cdb26c8976000e P 75785880ee25461b9ae096483d4fa6af: No bootstrap required, opened a new log
I20260709 12:08:17.631718 21593 ts_tablet_manager.cc:1403] T 468c279623b041e0b7cdb26c8976000e P 75785880ee25461b9ae096483d4fa6af: Time spent bootstrapping tablet: real 0.084s	user 0.006s	sys 0.028s
I20260709 12:08:17.632601 21594 tablet_bootstrap.cc:492] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 4e29cd095ba14aefbe4f8bf484bf87b1: No bootstrap required, opened a new log
I20260709 12:08:17.633422 21594 ts_tablet_manager.cc:1403] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 4e29cd095ba14aefbe4f8bf484bf87b1: Time spent bootstrapping tablet: real 0.057s	user 0.013s	sys 0.013s
I20260709 12:08:17.635880 21593 raft_consensus.cc:359] T 468c279623b041e0b7cdb26c8976000e P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.636667 21593 raft_consensus.cc:385] T 468c279623b041e0b7cdb26c8976000e P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.637789 21593 raft_consensus.cc:740] T 468c279623b041e0b7cdb26c8976000e P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75785880ee25461b9ae096483d4fa6af, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.639360 21593 consensus_queue.cc:260] T 468c279623b041e0b7cdb26c8976000e P 75785880ee25461b9ae096483d4fa6af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.637351 21594 raft_consensus.cc:359] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.643112 21593 ts_tablet_manager.cc:1434] T 468c279623b041e0b7cdb26c8976000e P 75785880ee25461b9ae096483d4fa6af: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.003s
I20260709 12:08:17.643325 21400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7232d0c08da499d9ceaf0ecbf7983f9" candidate_uuid: "75785880ee25461b9ae096483d4fa6af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1"
I20260709 12:08:17.643924 21400 raft_consensus.cc:3060] T d7232d0c08da499d9ceaf0ecbf7983f9 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:17.644867 21595 tablet_bootstrap.cc:654] T 3b12c0d1f9484064b965191731a2a7d3 P d433900e5e4f4756b982e1f6fe549fa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.640833 21594 raft_consensus.cc:385] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.647918 21594 raft_consensus.cc:740] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e29cd095ba14aefbe4f8bf484bf87b1, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.649680 21401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "468c279623b041e0b7cdb26c8976000e" candidate_uuid: "d433900e5e4f4756b982e1f6fe549fa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" is_pre_election: true
I20260709 12:08:17.650614 21399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11009396a6546e881059dd95f05bc94" candidate_uuid: "d433900e5e4f4756b982e1f6fe549fa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" is_pre_election: true
I20260709 12:08:17.649458 21594 consensus_queue.cc:260] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.651500 21399 raft_consensus.cc:2468] T b11009396a6546e881059dd95f05bc94 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d433900e5e4f4756b982e1f6fe549fa7 in term 0.
I20260709 12:08:17.653021 21594 ts_tablet_manager.cc:1434] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 4e29cd095ba14aefbe4f8bf484bf87b1: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:08:17.654309 21593 tablet_bootstrap.cc:492] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af: Bootstrap starting.
I20260709 12:08:17.656610 21594 tablet_bootstrap.cc:492] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1: Bootstrap starting.
W20260709 12:08:17.657228 21513 leader_election.cc:343] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129:38551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:17.657931 21550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7232d0c08da499d9ceaf0ecbf7983f9" candidate_uuid: "75785880ee25461b9ae096483d4fa6af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d433900e5e4f4756b982e1f6fe549fa7"
I20260709 12:08:17.658540 21550 raft_consensus.cc:3060] T d7232d0c08da499d9ceaf0ecbf7983f9 P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:17.678120 21600 raft_consensus.cc:493] T 8c39dd9aa7c74311a6d6987771803595 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:17.678678 21600 raft_consensus.cc:515] T 8c39dd9aa7c74311a6d6987771803595 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.679504 21513 leader_election.cc:304] T b11009396a6546e881059dd95f05bc94 P d433900e5e4f4756b982e1f6fe549fa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e29cd095ba14aefbe4f8bf484bf87b1, d433900e5e4f4756b982e1f6fe549fa7; no voters: 
I20260709 12:08:17.685068 21601 raft_consensus.cc:2804] T b11009396a6546e881059dd95f05bc94 P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:17.687384 21601 raft_consensus.cc:493] T b11009396a6546e881059dd95f05bc94 P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:17.687435 21600 leader_election.cc:290] T 8c39dd9aa7c74311a6d6987771803595 P 4e29cd095ba14aefbe4f8bf484bf87b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75785880ee25461b9ae096483d4fa6af (127.20.196.130:38339), d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131:43271)
I20260709 12:08:17.689535 21601 raft_consensus.cc:3060] T b11009396a6546e881059dd95f05bc94 P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:17.692116 21624 raft_consensus.cc:493] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:17.710732 21599 raft_consensus.cc:493] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:17.714058 21400 raft_consensus.cc:2468] T d7232d0c08da499d9ceaf0ecbf7983f9 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75785880ee25461b9ae096483d4fa6af in term 1.
I20260709 12:08:17.714555 21550 raft_consensus.cc:2468] T d7232d0c08da499d9ceaf0ecbf7983f9 P d433900e5e4f4756b982e1f6fe549fa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75785880ee25461b9ae096483d4fa6af in term 1.
I20260709 12:08:17.716430 21599 raft_consensus.cc:515] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.725456 21475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11009396a6546e881059dd95f05bc94" candidate_uuid: "d433900e5e4f4756b982e1f6fe549fa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75785880ee25461b9ae096483d4fa6af" is_pre_election: true
I20260709 12:08:17.731349 21600 raft_consensus.cc:493] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:17.718629 21624 raft_consensus.cc:515] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.733266 21439 leader_election.cc:304] T d7232d0c08da499d9ceaf0ecbf7983f9 P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e29cd095ba14aefbe4f8bf484bf87b1, 75785880ee25461b9ae096483d4fa6af; no voters: 
W20260709 12:08:17.735173 21516 leader_election.cc:343] T b11009396a6546e881059dd95f05bc94 P d433900e5e4f4756b982e1f6fe549fa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 75785880ee25461b9ae096483d4fa6af (127.20.196.130:38339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:17.733258 21600 raft_consensus.cc:515] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.727360 21476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "468c279623b041e0b7cdb26c8976000e" candidate_uuid: "d433900e5e4f4756b982e1f6fe549fa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75785880ee25461b9ae096483d4fa6af" is_pre_election: true
I20260709 12:08:17.744258 21595 tablet_bootstrap.cc:492] T 3b12c0d1f9484064b965191731a2a7d3 P d433900e5e4f4756b982e1f6fe549fa7: No bootstrap required, opened a new log
I20260709 12:08:17.744937 21595 ts_tablet_manager.cc:1403] T 3b12c0d1f9484064b965191731a2a7d3 P d433900e5e4f4756b982e1f6fe549fa7: Time spent bootstrapping tablet: real 0.155s	user 0.019s	sys 0.006s
I20260709 12:08:17.745447 21600 leader_election.cc:290] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75785880ee25461b9ae096483d4fa6af (127.20.196.130:38339), d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131:43271)
I20260709 12:08:17.745956 21600 raft_consensus.cc:493] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:17.746394 21600 raft_consensus.cc:515] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } }
I20260709 12:08:17.748948 21599 leader_election.cc:290] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129:38551), d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131:43271)
I20260709 12:08:17.749522 21599 raft_consensus.cc:2804] T d7232d0c08da499d9ceaf0ecbf7983f9 P 75785880ee25461b9ae096483d4fa6af [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:17.749897 21599 raft_consensus.cc:697] T d7232d0c08da499d9ceaf0ecbf7983f9 P 75785880ee25461b9ae096483d4fa6af [term 1 LEADER]: Becoming Leader. State: Replica: 75785880ee25461b9ae096483d4fa6af, State: Running, Role: LEADER
I20260709 12:08:17.750619 21550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d20a28cb9f4b37ac61e4a17d6949d3" candidate_uuid: "75785880ee25461b9ae096483d4fa6af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d433900e5e4f4756b982e1f6fe549fa7" is_pre_election: true
I20260709 12:08:17.746567 21476 raft_consensus.cc:2468] T 468c279623b041e0b7cdb26c8976000e P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d433900e5e4f4756b982e1f6fe549fa7 in term 0.
I20260709 12:08:17.750906 21595 raft_consensus.cc:359] T 3b12c0d1f9484064b965191731a2a7d3 P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } }
I20260709 12:08:17.751286 21550 raft_consensus.cc:2468] T 37d20a28cb9f4b37ac61e4a17d6949d3 P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75785880ee25461b9ae096483d4fa6af in term 0.
I20260709 12:08:17.751596 21595 raft_consensus.cc:385] T 3b12c0d1f9484064b965191731a2a7d3 P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.751940 21595 raft_consensus.cc:740] T 3b12c0d1f9484064b965191731a2a7d3 P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d433900e5e4f4756b982e1f6fe549fa7, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.752130 21516 leader_election.cc:304] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 75785880ee25461b9ae096483d4fa6af, d433900e5e4f4756b982e1f6fe549fa7; no voters: 4e29cd095ba14aefbe4f8bf484bf87b1
I20260709 12:08:17.753926 21439 leader_election.cc:304] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75785880ee25461b9ae096483d4fa6af, d433900e5e4f4756b982e1f6fe549fa7; no voters: 
I20260709 12:08:17.750733 21599 consensus_queue.cc:237] T d7232d0c08da499d9ceaf0ecbf7983f9 P 75785880ee25461b9ae096483d4fa6af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.765072 21600 leader_election.cc:290] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131:43271), 75785880ee25461b9ae096483d4fa6af (127.20.196.130:38339)
I20260709 12:08:17.756846 21595 consensus_queue.cc:260] T 3b12c0d1f9484064b965191731a2a7d3 P d433900e5e4f4756b982e1f6fe549fa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } }
I20260709 12:08:17.777774 21624 leader_election.cc:290] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129:38551), d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131:43271)
I20260709 12:08:17.785391 21593 tablet_bootstrap.cc:654] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.787554 21629 raft_consensus.cc:2804] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:17.788246 21629 raft_consensus.cc:493] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:17.798017 21594 tablet_bootstrap.cc:654] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.794380 21629 raft_consensus.cc:3060] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:17.810401 21601 raft_consensus.cc:515] T b11009396a6546e881059dd95f05bc94 P d433900e5e4f4756b982e1f6fe549fa7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
W20260709 12:08:17.813378 21516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:38339, user_credentials={real_user=slave}} blocked reactor thread for 61322.8us
I20260709 12:08:17.809682 21600 raft_consensus.cc:493] T 8c96a750d4384f449614e6bfcea47a96 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:17.815619 21550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e394f7ee8d92438f9429acae83270427" candidate_uuid: "75785880ee25461b9ae096483d4fa6af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d433900e5e4f4756b982e1f6fe549fa7" is_pre_election: true
I20260709 12:08:17.816045 21601 leader_election.cc:290] T b11009396a6546e881059dd95f05bc94 P d433900e5e4f4756b982e1f6fe549fa7 [CANDIDATE]: Term 1 election: Requested vote from peers 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129:38551), 75785880ee25461b9ae096483d4fa6af (127.20.196.130:38339)
I20260709 12:08:17.814158 21600 raft_consensus.cc:515] T 8c96a750d4384f449614e6bfcea47a96 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.817732 21400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11009396a6546e881059dd95f05bc94" candidate_uuid: "d433900e5e4f4756b982e1f6fe549fa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1"
I20260709 12:08:17.818306 21400 raft_consensus.cc:3060] T b11009396a6546e881059dd95f05bc94 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:17.819818 21600 leader_election.cc:290] T 8c96a750d4384f449614e6bfcea47a96 P 4e29cd095ba14aefbe4f8bf484bf87b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75785880ee25461b9ae096483d4fa6af (127.20.196.130:38339), d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131:43271)
W20260709 12:08:17.819818 21439 leader_election.cc:343] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:17.821908 21631 raft_consensus.cc:2804] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:17.822314 21631 raft_consensus.cc:493] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:17.822656 21631 raft_consensus.cc:3060] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:17.822942 21476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11009396a6546e881059dd95f05bc94" candidate_uuid: "d433900e5e4f4756b982e1f6fe549fa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75785880ee25461b9ae096483d4fa6af"
I20260709 12:08:17.824100 21600 raft_consensus.cc:493] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:17.826593 21595 ts_tablet_manager.cc:1434] T 3b12c0d1f9484064b965191731a2a7d3 P d433900e5e4f4756b982e1f6fe549fa7: Time spent starting tablet: real 0.081s	user 0.018s	sys 0.005s
I20260709 12:08:17.827924 21600 raft_consensus.cc:515] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.830070 21600 leader_election.cc:290] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75785880ee25461b9ae096483d4fa6af (127.20.196.130:38339), d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131:43271)
I20260709 12:08:17.836024 21595 tablet_bootstrap.cc:492] T 8c96a750d4384f449614e6bfcea47a96 P d433900e5e4f4756b982e1f6fe549fa7: Bootstrap starting.
I20260709 12:08:17.832966 21295 catalog_manager.cc:5697] T d7232d0c08da499d9ceaf0ecbf7983f9 P 75785880ee25461b9ae096483d4fa6af reported cstate change: term changed from 0 to 1, leader changed from <none> to 75785880ee25461b9ae096483d4fa6af (127.20.196.130). New cstate: current_term: 1 leader_uuid: "75785880ee25461b9ae096483d4fa6af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } health_report { overall_health: UNKNOWN } } }
W20260709 12:08:17.832192 21516 leader_election.cc:343] T b11009396a6546e881059dd95f05bc94 P d433900e5e4f4756b982e1f6fe549fa7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 75785880ee25461b9ae096483d4fa6af (127.20.196.130:38339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:17.851300 21630 raft_consensus.cc:493] T 8c39dd9aa7c74311a6d6987771803595 P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:17.851886 21630 raft_consensus.cc:515] T 8c39dd9aa7c74311a6d6987771803595 P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.864383 21630 leader_election.cc:290] T 8c39dd9aa7c74311a6d6987771803595 P d433900e5e4f4756b982e1f6fe549fa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129:38551), 75785880ee25461b9ae096483d4fa6af (127.20.196.130:38339)
I20260709 12:08:17.865795 21475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e394f7ee8d92438f9429acae83270427" candidate_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75785880ee25461b9ae096483d4fa6af" is_pre_election: true
I20260709 12:08:17.865239 21399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c39dd9aa7c74311a6d6987771803595" candidate_uuid: "d433900e5e4f4756b982e1f6fe549fa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" is_pre_election: true
I20260709 12:08:17.865896 21474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b12c0d1f9484064b965191731a2a7d3" candidate_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75785880ee25461b9ae096483d4fa6af" is_pre_election: true
I20260709 12:08:17.867988 21476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c39dd9aa7c74311a6d6987771803595" candidate_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75785880ee25461b9ae096483d4fa6af" is_pre_election: true
I20260709 12:08:17.869243 21594 tablet_bootstrap.cc:492] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1: No bootstrap required, opened a new log
I20260709 12:08:17.869686 21594 ts_tablet_manager.cc:1403] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1: Time spent bootstrapping tablet: real 0.213s	user 0.018s	sys 0.001s
I20260709 12:08:17.870210 21476 raft_consensus.cc:2468] T 8c39dd9aa7c74311a6d6987771803595 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e29cd095ba14aefbe4f8bf484bf87b1 in term 0.
I20260709 12:08:17.868659 21475 raft_consensus.cc:2468] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e29cd095ba14aefbe4f8bf484bf87b1 in term 0.
I20260709 12:08:17.872172 21473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c96a750d4384f449614e6bfcea47a96" candidate_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75785880ee25461b9ae096483d4fa6af" is_pre_election: true
I20260709 12:08:17.872275 21474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d20a28cb9f4b37ac61e4a17d6949d3" candidate_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75785880ee25461b9ae096483d4fa6af" is_pre_election: true
I20260709 12:08:17.868677 21399 raft_consensus.cc:2468] T 8c39dd9aa7c74311a6d6987771803595 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d433900e5e4f4756b982e1f6fe549fa7 in term 0.
I20260709 12:08:17.873899 21401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d20a28cb9f4b37ac61e4a17d6949d3" candidate_uuid: "75785880ee25461b9ae096483d4fa6af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" is_pre_election: true
I20260709 12:08:17.871114 21472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c39dd9aa7c74311a6d6987771803595" candidate_uuid: "d433900e5e4f4756b982e1f6fe549fa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75785880ee25461b9ae096483d4fa6af" is_pre_election: true
W20260709 12:08:17.877900 21367 leader_election.cc:343] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 75785880ee25461b9ae096483d4fa6af (127.20.196.130:38339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:17.880707 21513 leader_election.cc:304] T 8c39dd9aa7c74311a6d6987771803595 P d433900e5e4f4756b982e1f6fe549fa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e29cd095ba14aefbe4f8bf484bf87b1, d433900e5e4f4756b982e1f6fe549fa7; no voters: 
I20260709 12:08:17.881225 21367 leader_election.cc:304] T 8c39dd9aa7c74311a6d6987771803595 P 4e29cd095ba14aefbe4f8bf484bf87b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e29cd095ba14aefbe4f8bf484bf87b1, 75785880ee25461b9ae096483d4fa6af; no voters: 
I20260709 12:08:17.881547 21630 raft_consensus.cc:2804] T 8c39dd9aa7c74311a6d6987771803595 P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:17.881920 21630 raft_consensus.cc:493] T 8c39dd9aa7c74311a6d6987771803595 P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:17.878685 21398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e394f7ee8d92438f9429acae83270427" candidate_uuid: "75785880ee25461b9ae096483d4fa6af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" is_pre_election: true
W20260709 12:08:17.882053 21367 leader_election.cc:343] T 8c96a750d4384f449614e6bfcea47a96 P 4e29cd095ba14aefbe4f8bf484bf87b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 75785880ee25461b9ae096483d4fa6af (127.20.196.130:38339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:17.882694 21630 raft_consensus.cc:3060] T 8c39dd9aa7c74311a6d6987771803595 P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:17.882915 21398 raft_consensus.cc:2468] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75785880ee25461b9ae096483d4fa6af in term 0.
I20260709 12:08:17.883280 21367 leader_election.cc:304] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e29cd095ba14aefbe4f8bf484bf87b1, 75785880ee25461b9ae096483d4fa6af; no voters: 
I20260709 12:08:17.878031 21401 raft_consensus.cc:2468] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75785880ee25461b9ae096483d4fa6af in term 0.
I20260709 12:08:17.880483 21472 raft_consensus.cc:2468] T 8c39dd9aa7c74311a6d6987771803595 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d433900e5e4f4756b982e1f6fe549fa7 in term 0.
I20260709 12:08:17.885957 21635 raft_consensus.cc:2804] T 8c39dd9aa7c74311a6d6987771803595 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:17.886726 21600 raft_consensus.cc:2804] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:17.888154 21600 raft_consensus.cc:493] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:17.888036 21439 leader_election.cc:304] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e29cd095ba14aefbe4f8bf484bf87b1, 75785880ee25461b9ae096483d4fa6af; no voters: d433900e5e4f4756b982e1f6fe549fa7
I20260709 12:08:17.886413 21635 raft_consensus.cc:493] T 8c39dd9aa7c74311a6d6987771803595 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:17.889282 21594 raft_consensus.cc:359] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.889799 21594 raft_consensus.cc:385] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.890065 21594 raft_consensus.cc:740] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e29cd095ba14aefbe4f8bf484bf87b1, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.888672 21600 raft_consensus.cc:3060] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:17.890919 21594 consensus_queue.cc:260] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.890899 21599 raft_consensus.cc:2804] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:17.889247 21635 raft_consensus.cc:3060] T 8c39dd9aa7c74311a6d6987771803595 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:17.892282 21599 raft_consensus.cc:493] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:17.893326 21599 raft_consensus.cc:3060] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:17.893392 21550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c39dd9aa7c74311a6d6987771803595" candidate_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d433900e5e4f4756b982e1f6fe549fa7" is_pre_election: true
I20260709 12:08:17.893435 21593 tablet_bootstrap.cc:492] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af: No bootstrap required, opened a new log
I20260709 12:08:17.896638 21593 ts_tablet_manager.cc:1403] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af: Time spent bootstrapping tablet: real 0.242s	user 0.017s	sys 0.010s
I20260709 12:08:17.899672 21549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e394f7ee8d92438f9429acae83270427" candidate_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d433900e5e4f4756b982e1f6fe549fa7" is_pre_election: true
I20260709 12:08:17.902024 21594 ts_tablet_manager.cc:1434] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.002s
I20260709 12:08:17.903610 21594 tablet_bootstrap.cc:492] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1: Bootstrap starting.
I20260709 12:08:17.902427 21546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d20a28cb9f4b37ac61e4a17d6949d3" candidate_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d433900e5e4f4756b982e1f6fe549fa7" is_pre_election: true
I20260709 12:08:17.908499 21400 raft_consensus.cc:2468] T b11009396a6546e881059dd95f05bc94 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d433900e5e4f4756b982e1f6fe549fa7 in term 1.
I20260709 12:08:17.912546 21513 leader_election.cc:304] T b11009396a6546e881059dd95f05bc94 P d433900e5e4f4756b982e1f6fe549fa7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e29cd095ba14aefbe4f8bf484bf87b1, d433900e5e4f4756b982e1f6fe549fa7; no voters: 75785880ee25461b9ae096483d4fa6af
I20260709 12:08:17.913897 21546 raft_consensus.cc:2468] T 37d20a28cb9f4b37ac61e4a17d6949d3 P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e29cd095ba14aefbe4f8bf484bf87b1 in term 0.
I20260709 12:08:17.914500 21633 raft_consensus.cc:2804] T b11009396a6546e881059dd95f05bc94 P d433900e5e4f4756b982e1f6fe549fa7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:17.916574 21633 raft_consensus.cc:697] T b11009396a6546e881059dd95f05bc94 P d433900e5e4f4756b982e1f6fe549fa7 [term 1 LEADER]: Becoming Leader. State: Replica: d433900e5e4f4756b982e1f6fe549fa7, State: Running, Role: LEADER
W20260709 12:08:17.923301 21364 leader_election.cc:343] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:17.909065 21629 raft_consensus.cc:515] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.907258 21547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c96a750d4384f449614e6bfcea47a96" candidate_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d433900e5e4f4756b982e1f6fe549fa7" is_pre_election: true
I20260709 12:08:17.926811 21633 consensus_queue.cc:237] T b11009396a6546e881059dd95f05bc94 P d433900e5e4f4756b982e1f6fe549fa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.915964 21548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b12c0d1f9484064b965191731a2a7d3" candidate_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d433900e5e4f4756b982e1f6fe549fa7" is_pre_election: true
I20260709 12:08:17.911806 21593 raft_consensus.cc:359] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } }
I20260709 12:08:17.939507 21629 leader_election.cc:290] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 1 election: Requested vote from peers 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129:38551), d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131:43271)
I20260709 12:08:17.945650 21474 raft_consensus.cc:2393] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e29cd095ba14aefbe4f8bf484bf87b1 in current term 1: Already voted for candidate 75785880ee25461b9ae096483d4fa6af in this term.
I20260709 12:08:17.938446 21593 raft_consensus.cc:385] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.940830 21548 raft_consensus.cc:2468] T 3b12c0d1f9484064b965191731a2a7d3 P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e29cd095ba14aefbe4f8bf484bf87b1 in term 0.
I20260709 12:08:17.947997 21546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d20a28cb9f4b37ac61e4a17d6949d3" candidate_uuid: "75785880ee25461b9ae096483d4fa6af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d433900e5e4f4756b982e1f6fe549fa7"
I20260709 12:08:17.948630 21593 raft_consensus.cc:740] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75785880ee25461b9ae096483d4fa6af, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.949483 21546 raft_consensus.cc:3060] T 37d20a28cb9f4b37ac61e4a17d6949d3 P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:17.949760 21593 consensus_queue.cc:260] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } }
I20260709 12:08:17.955047 21364 leader_election.cc:304] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e29cd095ba14aefbe4f8bf484bf87b1, d433900e5e4f4756b982e1f6fe549fa7; no voters: 
I20260709 12:08:17.955113 21400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d20a28cb9f4b37ac61e4a17d6949d3" candidate_uuid: "75785880ee25461b9ae096483d4fa6af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1"
I20260709 12:08:17.955833 21400 raft_consensus.cc:3060] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:17.957312 21593 ts_tablet_manager.cc:1434] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.000s
I20260709 12:08:17.957412 21595 tablet_bootstrap.cc:654] T 8c96a750d4384f449614e6bfcea47a96 P d433900e5e4f4756b982e1f6fe549fa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.958376 21593 tablet_bootstrap.cc:492] T 8c96a750d4384f449614e6bfcea47a96 P 75785880ee25461b9ae096483d4fa6af: Bootstrap starting.
W20260709 12:08:17.961208 21364 leader_election.cc:343] T 8c96a750d4384f449614e6bfcea47a96 P 4e29cd095ba14aefbe4f8bf484bf87b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:17.963507 21364 leader_election.cc:304] T 8c96a750d4384f449614e6bfcea47a96 P 4e29cd095ba14aefbe4f8bf484bf87b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e29cd095ba14aefbe4f8bf484bf87b1; no voters: 75785880ee25461b9ae096483d4fa6af, d433900e5e4f4756b982e1f6fe549fa7
I20260709 12:08:17.976637 21364 leader_election.cc:304] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e29cd095ba14aefbe4f8bf484bf87b1, d433900e5e4f4756b982e1f6fe549fa7; no voters: 75785880ee25461b9ae096483d4fa6af
I20260709 12:08:17.979562 21642 raft_consensus.cc:2749] T 8c96a750d4384f449614e6bfcea47a96 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:17.985411 21642 raft_consensus.cc:2804] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:17.986021 21642 raft_consensus.cc:493] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:17.986536 21642 raft_consensus.cc:3060] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:17.988251 21594 tablet_bootstrap.cc:654] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.992745 21593 tablet_bootstrap.cc:654] T 8c96a750d4384f449614e6bfcea47a96 P 75785880ee25461b9ae096483d4fa6af: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.997911 21594 tablet_bootstrap.cc:492] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1: No bootstrap required, opened a new log
I20260709 12:08:17.998626 21594 ts_tablet_manager.cc:1403] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1: Time spent bootstrapping tablet: real 0.096s	user 0.006s	sys 0.010s
I20260709 12:08:17.999994 21635 raft_consensus.cc:515] T 8c39dd9aa7c74311a6d6987771803595 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:18.002781 21595 tablet_bootstrap.cc:492] T 8c96a750d4384f449614e6bfcea47a96 P d433900e5e4f4756b982e1f6fe549fa7: No bootstrap required, opened a new log
I20260709 12:08:18.008701 21595 ts_tablet_manager.cc:1403] T 8c96a750d4384f449614e6bfcea47a96 P d433900e5e4f4756b982e1f6fe549fa7: Time spent bootstrapping tablet: real 0.173s	user 0.017s	sys 0.015s
I20260709 12:08:18.004103 21630 raft_consensus.cc:515] T 8c39dd9aa7c74311a6d6987771803595 P d433900e5e4f4756b982e1f6fe549fa7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:18.005046 21600 raft_consensus.cc:515] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:17.999995 21631 raft_consensus.cc:515] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:18.013836 21550 raft_consensus.cc:2393] T 8c39dd9aa7c74311a6d6987771803595 P d433900e5e4f4756b982e1f6fe549fa7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e29cd095ba14aefbe4f8bf484bf87b1 in current term 1: Already voted for candidate d433900e5e4f4756b982e1f6fe549fa7 in this term.
I20260709 12:08:18.018342 21631 leader_election.cc:290] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [CANDIDATE]: Term 1 election: Requested vote from peers 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129:38551), 75785880ee25461b9ae096483d4fa6af (127.20.196.130:38339)
I20260709 12:08:18.017639 21594 raft_consensus.cc:359] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:18.019152 21594 raft_consensus.cc:385] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.019332 21635 leader_election.cc:290] T 8c39dd9aa7c74311a6d6987771803595 P 4e29cd095ba14aefbe4f8bf484bf87b1 [CANDIDATE]: Term 1 election: Requested vote from peers 75785880ee25461b9ae096483d4fa6af (127.20.196.130:38339), d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131:43271)
I20260709 12:08:18.020342 21630 leader_election.cc:290] T 8c39dd9aa7c74311a6d6987771803595 P d433900e5e4f4756b982e1f6fe549fa7 [CANDIDATE]: Term 1 election: Requested vote from peers 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129:38551), 75785880ee25461b9ae096483d4fa6af (127.20.196.130:38339)
I20260709 12:08:18.019539 21594 raft_consensus.cc:740] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e29cd095ba14aefbe4f8bf484bf87b1, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.022280 21472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c39dd9aa7c74311a6d6987771803595" candidate_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75785880ee25461b9ae096483d4fa6af"
I20260709 12:08:18.023048 21472 raft_consensus.cc:3060] T 8c39dd9aa7c74311a6d6987771803595 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.024451 21594 consensus_queue.cc:260] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:18.025761 21475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "468c279623b041e0b7cdb26c8976000e" candidate_uuid: "d433900e5e4f4756b982e1f6fe549fa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75785880ee25461b9ae096483d4fa6af"
I20260709 12:08:18.033419 21398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c39dd9aa7c74311a6d6987771803595" candidate_uuid: "d433900e5e4f4756b982e1f6fe549fa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1"
I20260709 12:08:18.034148 21593 tablet_bootstrap.cc:492] T 8c96a750d4384f449614e6bfcea47a96 P 75785880ee25461b9ae096483d4fa6af: No bootstrap required, opened a new log
I20260709 12:08:18.023617 21600 leader_election.cc:290] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1 [CANDIDATE]: Term 1 election: Requested vote from peers 75785880ee25461b9ae096483d4fa6af (127.20.196.130:38339), d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131:43271)
I20260709 12:08:18.034787 21593 ts_tablet_manager.cc:1403] T 8c96a750d4384f449614e6bfcea47a96 P 75785880ee25461b9ae096483d4fa6af: Time spent bootstrapping tablet: real 0.077s	user 0.005s	sys 0.013s
I20260709 12:08:18.023872 21599 raft_consensus.cc:515] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:18.036672 21594 ts_tablet_manager.cc:1434] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.002s
I20260709 12:08:18.037611 21398 raft_consensus.cc:2393] T 8c39dd9aa7c74311a6d6987771803595 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d433900e5e4f4756b982e1f6fe549fa7 in current term 1: Already voted for candidate 4e29cd095ba14aefbe4f8bf484bf87b1 in this term.
I20260709 12:08:18.038300 21476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e394f7ee8d92438f9429acae83270427" candidate_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75785880ee25461b9ae096483d4fa6af"
I20260709 12:08:18.034245 21548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c39dd9aa7c74311a6d6987771803595" candidate_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d433900e5e4f4756b982e1f6fe549fa7"
I20260709 12:08:18.034791 21473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c39dd9aa7c74311a6d6987771803595" candidate_uuid: "d433900e5e4f4756b982e1f6fe549fa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75785880ee25461b9ae096483d4fa6af"
I20260709 12:08:18.035262 21475 raft_consensus.cc:3060] T 468c279623b041e0b7cdb26c8976000e P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.025930 21401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "468c279623b041e0b7cdb26c8976000e" candidate_uuid: "d433900e5e4f4756b982e1f6fe549fa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1"
I20260709 12:08:18.036890 21547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e394f7ee8d92438f9429acae83270427" candidate_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d433900e5e4f4756b982e1f6fe549fa7"
I20260709 12:08:18.041404 21401 raft_consensus.cc:3060] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:08:18.042824 21345 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:08:18.043836 21516 leader_election.cc:304] T 8c39dd9aa7c74311a6d6987771803595 P d433900e5e4f4756b982e1f6fe549fa7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d433900e5e4f4756b982e1f6fe549fa7; no voters: 4e29cd095ba14aefbe4f8bf484bf87b1, 75785880ee25461b9ae096483d4fa6af
I20260709 12:08:18.044370 21599 leader_election.cc:290] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 1 election: Requested vote from peers 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129:38551), d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131:43271)
I20260709 12:08:18.045344 21476 raft_consensus.cc:2393] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4e29cd095ba14aefbe4f8bf484bf87b1 in current term 1: Already voted for candidate 75785880ee25461b9ae096483d4fa6af in this term.
I20260709 12:08:18.045964 21630 raft_consensus.cc:2749] T 8c39dd9aa7c74311a6d6987771803595 P d433900e5e4f4756b982e1f6fe549fa7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:08:18.048478 21547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e394f7ee8d92438f9429acae83270427" candidate_uuid: "75785880ee25461b9ae096483d4fa6af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d433900e5e4f4756b982e1f6fe549fa7"
W20260709 12:08:18.049964 21439 leader_election.cc:343] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.049619 21595 raft_consensus.cc:359] T 8c96a750d4384f449614e6bfcea47a96 P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:18.050612 21595 raft_consensus.cc:385] T 8c96a750d4384f449614e6bfcea47a96 P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.050535 21398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e394f7ee8d92438f9429acae83270427" candidate_uuid: "75785880ee25461b9ae096483d4fa6af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1"
I20260709 12:08:18.051029 21595 raft_consensus.cc:740] T 8c96a750d4384f449614e6bfcea47a96 P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d433900e5e4f4756b982e1f6fe549fa7, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.051441 21398 raft_consensus.cc:2393] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 75785880ee25461b9ae096483d4fa6af in current term 1: Already voted for candidate 4e29cd095ba14aefbe4f8bf484bf87b1 in this term.
W20260709 12:08:18.054711 21364 leader_election.cc:343] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.052078 21595 consensus_queue.cc:260] T 8c96a750d4384f449614e6bfcea47a96 P d433900e5e4f4756b982e1f6fe549fa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:18.059499 21439 leader_election.cc:304] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 75785880ee25461b9ae096483d4fa6af; no voters: 4e29cd095ba14aefbe4f8bf484bf87b1, d433900e5e4f4756b982e1f6fe549fa7
I20260709 12:08:18.060160 21593 raft_consensus.cc:359] T 8c96a750d4384f449614e6bfcea47a96 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:18.061025 21593 raft_consensus.cc:385] T 8c96a750d4384f449614e6bfcea47a96 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.061342 21593 raft_consensus.cc:740] T 8c96a750d4384f449614e6bfcea47a96 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75785880ee25461b9ae096483d4fa6af, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.061434 21599 raft_consensus.cc:2749] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:08:18.062986 21595 ts_tablet_manager.cc:1434] T 8c96a750d4384f449614e6bfcea47a96 P d433900e5e4f4756b982e1f6fe549fa7: Time spent starting tablet: real 0.052s	user 0.009s	sys 0.000s
I20260709 12:08:18.062810 21593 consensus_queue.cc:260] T 8c96a750d4384f449614e6bfcea47a96 P 75785880ee25461b9ae096483d4fa6af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:18.065445 21599 raft_consensus.cc:493] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.065925 21595 tablet_bootstrap.cc:492] T e394f7ee8d92438f9429acae83270427 P d433900e5e4f4756b982e1f6fe549fa7: Bootstrap starting.
I20260709 12:08:18.066493 21593 ts_tablet_manager.cc:1434] T 8c96a750d4384f449614e6bfcea47a96 P 75785880ee25461b9ae096483d4fa6af: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 12:08:18.066517 21599 raft_consensus.cc:515] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } }
I20260709 12:08:18.067934 21593 tablet_bootstrap.cc:492] T b11009396a6546e881059dd95f05bc94 P 75785880ee25461b9ae096483d4fa6af: Bootstrap starting.
I20260709 12:08:18.070161 21547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b12c0d1f9484064b965191731a2a7d3" candidate_uuid: "75785880ee25461b9ae096483d4fa6af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d433900e5e4f4756b982e1f6fe549fa7" is_pre_election: true
I20260709 12:08:18.071324 21547 raft_consensus.cc:2468] T 3b12c0d1f9484064b965191731a2a7d3 P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75785880ee25461b9ae096483d4fa6af in term 0.
I20260709 12:08:18.073312 21599 leader_election.cc:290] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131:43271), 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129:38551)
I20260709 12:08:18.075578 21439 leader_election.cc:304] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75785880ee25461b9ae096483d4fa6af, d433900e5e4f4756b982e1f6fe549fa7; no voters: 
I20260709 12:08:18.076292 21398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b12c0d1f9484064b965191731a2a7d3" candidate_uuid: "75785880ee25461b9ae096483d4fa6af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" is_pre_election: true
I20260709 12:08:18.077126 21599 raft_consensus.cc:2804] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.077710 21599 raft_consensus.cc:493] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.078172 21599 raft_consensus.cc:3060] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.083950 21593 tablet_bootstrap.cc:654] T b11009396a6546e881059dd95f05bc94 P 75785880ee25461b9ae096483d4fa6af: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.085018 21595 tablet_bootstrap.cc:654] T e394f7ee8d92438f9429acae83270427 P d433900e5e4f4756b982e1f6fe549fa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.090808 21593 tablet_bootstrap.cc:492] T b11009396a6546e881059dd95f05bc94 P 75785880ee25461b9ae096483d4fa6af: No bootstrap required, opened a new log
I20260709 12:08:18.091286 21593 ts_tablet_manager.cc:1403] T b11009396a6546e881059dd95f05bc94 P 75785880ee25461b9ae096483d4fa6af: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.000s
I20260709 12:08:18.093307 21595 tablet_bootstrap.cc:492] T e394f7ee8d92438f9429acae83270427 P d433900e5e4f4756b982e1f6fe549fa7: No bootstrap required, opened a new log
I20260709 12:08:18.093873 21595 ts_tablet_manager.cc:1403] T e394f7ee8d92438f9429acae83270427 P d433900e5e4f4756b982e1f6fe549fa7: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.009s
I20260709 12:08:18.093945 21593 raft_consensus.cc:359] T b11009396a6546e881059dd95f05bc94 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:18.094730 21593 raft_consensus.cc:385] T b11009396a6546e881059dd95f05bc94 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.095006 21593 raft_consensus.cc:740] T b11009396a6546e881059dd95f05bc94 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75785880ee25461b9ae096483d4fa6af, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.095656 21593 consensus_queue.cc:260] T b11009396a6546e881059dd95f05bc94 P 75785880ee25461b9ae096483d4fa6af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:18.096501 21367 leader_election.cc:304] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e29cd095ba14aefbe4f8bf484bf87b1; no voters: 75785880ee25461b9ae096483d4fa6af, d433900e5e4f4756b982e1f6fe549fa7
I20260709 12:08:18.097092 21472 raft_consensus.cc:2468] T 8c39dd9aa7c74311a6d6987771803595 P 75785880ee25461b9ae096483d4fa6af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e29cd095ba14aefbe4f8bf484bf87b1 in term 1.
I20260709 12:08:18.097761 21475 raft_consensus.cc:2468] T 468c279623b041e0b7cdb26c8976000e P 75785880ee25461b9ae096483d4fa6af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d433900e5e4f4756b982e1f6fe549fa7 in term 1.
I20260709 12:08:18.098278 21595 raft_consensus.cc:359] T e394f7ee8d92438f9429acae83270427 P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:18.099103 21595 raft_consensus.cc:385] T e394f7ee8d92438f9429acae83270427 P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.099172 21516 leader_election.cc:304] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75785880ee25461b9ae096483d4fa6af, d433900e5e4f4756b982e1f6fe549fa7; no voters: 
I20260709 12:08:18.099503 21595 raft_consensus.cc:740] T e394f7ee8d92438f9429acae83270427 P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d433900e5e4f4756b982e1f6fe549fa7, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.100319 21595 consensus_queue.cc:260] T e394f7ee8d92438f9429acae83270427 P d433900e5e4f4756b982e1f6fe549fa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:18.100597 21600 raft_consensus.cc:2749] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:08:18.101403 21631 raft_consensus.cc:2804] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.102154 21546 raft_consensus.cc:2468] T 37d20a28cb9f4b37ac61e4a17d6949d3 P d433900e5e4f4756b982e1f6fe549fa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75785880ee25461b9ae096483d4fa6af in term 1.
I20260709 12:08:18.102807 21631 raft_consensus.cc:697] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [term 1 LEADER]: Becoming Leader. State: Replica: d433900e5e4f4756b982e1f6fe549fa7, State: Running, Role: LEADER
I20260709 12:08:18.103108 21400 raft_consensus.cc:2468] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75785880ee25461b9ae096483d4fa6af in term 1.
I20260709 12:08:18.103996 21631 consensus_queue.cc:237] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:18.105970 21439 leader_election.cc:304] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e29cd095ba14aefbe4f8bf484bf87b1, 75785880ee25461b9ae096483d4fa6af; no voters: 
I20260709 12:08:18.107534 21638 raft_consensus.cc:2764] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:08:18.108865 21595 ts_tablet_manager.cc:1434] T e394f7ee8d92438f9429acae83270427 P d433900e5e4f4756b982e1f6fe549fa7: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:08:18.109684 21367 leader_election.cc:304] T 8c39dd9aa7c74311a6d6987771803595 P 4e29cd095ba14aefbe4f8bf484bf87b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e29cd095ba14aefbe4f8bf484bf87b1, 75785880ee25461b9ae096483d4fa6af; no voters: d433900e5e4f4756b982e1f6fe549fa7
I20260709 12:08:18.112495 21595 tablet_bootstrap.cc:492] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7: Bootstrap starting.
I20260709 12:08:18.112929 21295 catalog_manager.cc:5697] T b11009396a6546e881059dd95f05bc94 P d433900e5e4f4756b982e1f6fe549fa7 reported cstate change: term changed from 0 to 1, leader changed from <none> to d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131). New cstate: current_term: 1 leader_uuid: "d433900e5e4f4756b982e1f6fe549fa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:18.110167 21629 raft_consensus.cc:2804] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.115190 21629 raft_consensus.cc:697] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [term 1 LEADER]: Becoming Leader. State: Replica: 75785880ee25461b9ae096483d4fa6af, State: Running, Role: LEADER
I20260709 12:08:18.116130 21629 consensus_queue.cc:237] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:18.119558 21638 raft_consensus.cc:2804] T 8c39dd9aa7c74311a6d6987771803595 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.120306 21638 raft_consensus.cc:697] T 8c39dd9aa7c74311a6d6987771803595 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 LEADER]: Becoming Leader. State: Replica: 4e29cd095ba14aefbe4f8bf484bf87b1, State: Running, Role: LEADER
I20260709 12:08:18.121429 21638 consensus_queue.cc:237] T 8c39dd9aa7c74311a6d6987771803595 P 4e29cd095ba14aefbe4f8bf484bf87b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:18.122525 21595 tablet_bootstrap.cc:654] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.127552 21593 ts_tablet_manager.cc:1434] T b11009396a6546e881059dd95f05bc94 P 75785880ee25461b9ae096483d4fa6af: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 12:08:18.143822 21595 tablet_bootstrap.cc:492] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7: No bootstrap required, opened a new log
I20260709 12:08:18.144371 21595 ts_tablet_manager.cc:1403] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.009s
I20260709 12:08:18.145785 21295 catalog_manager.cc:5697] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 reported cstate change: term changed from 0 to 1, leader changed from <none> to d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131). New cstate: current_term: 1 leader_uuid: "d433900e5e4f4756b982e1f6fe549fa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:18.147150 21629 raft_consensus.cc:493] T 8c96a750d4384f449614e6bfcea47a96 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.146912 21595 raft_consensus.cc:359] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:18.147701 21595 raft_consensus.cc:385] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.148006 21595 raft_consensus.cc:740] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d433900e5e4f4756b982e1f6fe549fa7, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.148918 21595 consensus_queue.cc:260] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:18.151628 21595 ts_tablet_manager.cc:1434] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:08:18.147778 21629 raft_consensus.cc:515] T 8c96a750d4384f449614e6bfcea47a96 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:18.157160 21629 leader_election.cc:290] T 8c96a750d4384f449614e6bfcea47a96 P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129:38551), d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131:43271)
I20260709 12:08:18.157397 21400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c96a750d4384f449614e6bfcea47a96" candidate_uuid: "75785880ee25461b9ae096483d4fa6af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" is_pre_election: true
I20260709 12:08:18.158017 21400 raft_consensus.cc:2468] T 8c96a750d4384f449614e6bfcea47a96 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75785880ee25461b9ae096483d4fa6af in term 0.
I20260709 12:08:18.158718 21550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c96a750d4384f449614e6bfcea47a96" candidate_uuid: "75785880ee25461b9ae096483d4fa6af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d433900e5e4f4756b982e1f6fe549fa7" is_pre_election: true
I20260709 12:08:18.159071 21439 leader_election.cc:304] T 8c96a750d4384f449614e6bfcea47a96 P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e29cd095ba14aefbe4f8bf484bf87b1, 75785880ee25461b9ae096483d4fa6af; no voters: 
I20260709 12:08:18.159389 21550 raft_consensus.cc:2468] T 8c96a750d4384f449614e6bfcea47a96 P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75785880ee25461b9ae096483d4fa6af in term 0.
I20260709 12:08:18.162709 21629 raft_consensus.cc:2804] T 8c96a750d4384f449614e6bfcea47a96 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.163210 21629 raft_consensus.cc:493] T 8c96a750d4384f449614e6bfcea47a96 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.163555 21629 raft_consensus.cc:3060] T 8c96a750d4384f449614e6bfcea47a96 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.186331 21638 raft_consensus.cc:493] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.186894 21638 raft_consensus.cc:515] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:18.187911 21632 raft_consensus.cc:493] T b11009396a6546e881059dd95f05bc94 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.188381 21632 raft_consensus.cc:515] T b11009396a6546e881059dd95f05bc94 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:18.190203 21550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030565532533437291655b1a62f632ae" candidate_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d433900e5e4f4756b982e1f6fe549fa7" is_pre_election: true
I20260709 12:08:18.190384 21632 leader_election.cc:290] T b11009396a6546e881059dd95f05bc94 P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129:38551), d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131:43271)
I20260709 12:08:18.190927 21550 raft_consensus.cc:2468] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e29cd095ba14aefbe4f8bf484bf87b1 in term 0.
I20260709 12:08:18.190943 21474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030565532533437291655b1a62f632ae" candidate_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75785880ee25461b9ae096483d4fa6af" is_pre_election: true
I20260709 12:08:18.191973 21474 raft_consensus.cc:2468] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e29cd095ba14aefbe4f8bf484bf87b1 in term 0.
I20260709 12:08:18.192096 21546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11009396a6546e881059dd95f05bc94" candidate_uuid: "75785880ee25461b9ae096483d4fa6af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d433900e5e4f4756b982e1f6fe549fa7" is_pre_election: true
I20260709 12:08:18.193609 21400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11009396a6546e881059dd95f05bc94" candidate_uuid: "75785880ee25461b9ae096483d4fa6af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" is_pre_election: true
I20260709 12:08:18.193821 21642 raft_consensus.cc:515] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } }
I20260709 12:08:18.194397 21400 raft_consensus.cc:2393] T b11009396a6546e881059dd95f05bc94 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 75785880ee25461b9ae096483d4fa6af in current term 1: Already voted for candidate d433900e5e4f4756b982e1f6fe549fa7 in this term.
I20260709 12:08:18.195188 21367 leader_election.cc:304] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e29cd095ba14aefbe4f8bf484bf87b1, 75785880ee25461b9ae096483d4fa6af; no voters: 
I20260709 12:08:18.196055 21401 raft_consensus.cc:2468] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d433900e5e4f4756b982e1f6fe549fa7 in term 1.
I20260709 12:08:18.196245 21642 leader_election.cc:290] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [CANDIDATE]: Term 1 election: Requested vote from peers d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131:43271), 75785880ee25461b9ae096483d4fa6af (127.20.196.130:38339)
I20260709 12:08:18.196781 21642 raft_consensus.cc:2804] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.197091 21642 raft_consensus.cc:493] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.197387 21642 raft_consensus.cc:3060] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.192238 21638 leader_election.cc:290] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75785880ee25461b9ae096483d4fa6af (127.20.196.130:38339), d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131:43271)
I20260709 12:08:18.202479 21439 leader_election.cc:304] T b11009396a6546e881059dd95f05bc94 P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 75785880ee25461b9ae096483d4fa6af; no voters: 4e29cd095ba14aefbe4f8bf484bf87b1, d433900e5e4f4756b982e1f6fe549fa7
I20260709 12:08:18.206503 21474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b12c0d1f9484064b965191731a2a7d3" candidate_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75785880ee25461b9ae096483d4fa6af"
I20260709 12:08:18.198716 21599 raft_consensus.cc:515] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } }
I20260709 12:08:18.222318 21599 leader_election.cc:290] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 1 election: Requested vote from peers d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131:43271), 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129:38551)
I20260709 12:08:18.199564 21398 raft_consensus.cc:2393] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 75785880ee25461b9ae096483d4fa6af in current term 1: Already voted for candidate 4e29cd095ba14aefbe4f8bf484bf87b1 in this term.
I20260709 12:08:18.220490 21632 raft_consensus.cc:3060] T b11009396a6546e881059dd95f05bc94 P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.222968 21474 raft_consensus.cc:2393] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4e29cd095ba14aefbe4f8bf484bf87b1 in current term 1: Already voted for candidate 75785880ee25461b9ae096483d4fa6af in this term.
I20260709 12:08:18.224889 21550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b12c0d1f9484064b965191731a2a7d3" candidate_uuid: "75785880ee25461b9ae096483d4fa6af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d433900e5e4f4756b982e1f6fe549fa7"
I20260709 12:08:18.225478 21550 raft_consensus.cc:3060] T 3b12c0d1f9484064b965191731a2a7d3 P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.226553 21295 catalog_manager.cc:5697] T 8c39dd9aa7c74311a6d6987771803595 P 4e29cd095ba14aefbe4f8bf484bf87b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129). New cstate: current_term: 1 leader_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:18.229363 21398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b12c0d1f9484064b965191731a2a7d3" candidate_uuid: "75785880ee25461b9ae096483d4fa6af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1"
I20260709 12:08:18.230144 21398 raft_consensus.cc:2393] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 75785880ee25461b9ae096483d4fa6af in current term 1: Already voted for candidate 4e29cd095ba14aefbe4f8bf484bf87b1 in this term.
I20260709 12:08:18.231455 21599 consensus_queue.cc:1048] T d7232d0c08da499d9ceaf0ecbf7983f9 P 75785880ee25461b9ae096483d4fa6af [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:18.202378 21546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b12c0d1f9484064b965191731a2a7d3" candidate_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d433900e5e4f4756b982e1f6fe549fa7"
I20260709 12:08:18.234793 21364 leader_election.cc:304] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e29cd095ba14aefbe4f8bf484bf87b1; no voters: 75785880ee25461b9ae096483d4fa6af, d433900e5e4f4756b982e1f6fe549fa7
I20260709 12:08:18.235949 21600 raft_consensus.cc:2749] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:08:18.255175 21599 consensus_queue.cc:1048] T d7232d0c08da499d9ceaf0ecbf7983f9 P 75785880ee25461b9ae096483d4fa6af [LEADER]: Connected to new peer: Peer: permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:18.292157 21629 raft_consensus.cc:515] T 8c96a750d4384f449614e6bfcea47a96 P 75785880ee25461b9ae096483d4fa6af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:18.294381 21629 leader_election.cc:290] T 8c96a750d4384f449614e6bfcea47a96 P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 1 election: Requested vote from peers 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129:38551), d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131:43271)
I20260709 12:08:18.292433 21550 raft_consensus.cc:2468] T 3b12c0d1f9484064b965191731a2a7d3 P d433900e5e4f4756b982e1f6fe549fa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75785880ee25461b9ae096483d4fa6af in term 1.
I20260709 12:08:18.292157 21642 raft_consensus.cc:515] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:18.296909 21642 leader_election.cc:290] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1 [CANDIDATE]: Term 1 election: Requested vote from peers 75785880ee25461b9ae096483d4fa6af (127.20.196.130:38339), d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131:43271)
I20260709 12:08:18.297798 21474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030565532533437291655b1a62f632ae" candidate_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75785880ee25461b9ae096483d4fa6af"
I20260709 12:08:18.297045 21439 leader_election.cc:304] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 75785880ee25461b9ae096483d4fa6af, d433900e5e4f4756b982e1f6fe549fa7; no voters: 4e29cd095ba14aefbe4f8bf484bf87b1
I20260709 12:08:18.298421 21474 raft_consensus.cc:3060] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.298506 21398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c96a750d4384f449614e6bfcea47a96" candidate_uuid: "75785880ee25461b9ae096483d4fa6af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1"
I20260709 12:08:18.299041 21629 raft_consensus.cc:2804] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.299144 21398 raft_consensus.cc:3060] T 8c96a750d4384f449614e6bfcea47a96 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.300263 21629 raft_consensus.cc:697] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [term 1 LEADER]: Becoming Leader. State: Replica: 75785880ee25461b9ae096483d4fa6af, State: Running, Role: LEADER
I20260709 12:08:18.301309 21629 consensus_queue.cc:237] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } }
I20260709 12:08:18.303365 21550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c96a750d4384f449614e6bfcea47a96" candidate_uuid: "75785880ee25461b9ae096483d4fa6af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d433900e5e4f4756b982e1f6fe549fa7"
I20260709 12:08:18.303921 21550 raft_consensus.cc:3060] T 8c96a750d4384f449614e6bfcea47a96 P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.314718 21546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030565532533437291655b1a62f632ae" candidate_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d433900e5e4f4756b982e1f6fe549fa7"
I20260709 12:08:18.315470 21546 raft_consensus.cc:3060] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.334467 21631 consensus_queue.cc:1048] T b11009396a6546e881059dd95f05bc94 P d433900e5e4f4756b982e1f6fe549fa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:18.382326 21631 raft_consensus.cc:493] T e394f7ee8d92438f9429acae83270427 P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.382762 21631 raft_consensus.cc:515] T e394f7ee8d92438f9429acae83270427 P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:18.384976 21631 leader_election.cc:290] T e394f7ee8d92438f9429acae83270427 P d433900e5e4f4756b982e1f6fe549fa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129:38551), 75785880ee25461b9ae096483d4fa6af (127.20.196.130:38339)
I20260709 12:08:18.385452 21400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e394f7ee8d92438f9429acae83270427" candidate_uuid: "d433900e5e4f4756b982e1f6fe549fa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" is_pre_election: true
I20260709 12:08:18.385568 21472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e394f7ee8d92438f9429acae83270427" candidate_uuid: "d433900e5e4f4756b982e1f6fe549fa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75785880ee25461b9ae096483d4fa6af" is_pre_election: true
I20260709 12:08:18.386260 21400 raft_consensus.cc:2393] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d433900e5e4f4756b982e1f6fe549fa7 in current term 1: Already voted for candidate 4e29cd095ba14aefbe4f8bf484bf87b1 in this term.
I20260709 12:08:18.386286 21472 raft_consensus.cc:2393] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d433900e5e4f4756b982e1f6fe549fa7 in current term 1: Already voted for candidate 75785880ee25461b9ae096483d4fa6af in this term.
I20260709 12:08:18.387624 21513 leader_election.cc:304] T e394f7ee8d92438f9429acae83270427 P d433900e5e4f4756b982e1f6fe549fa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d433900e5e4f4756b982e1f6fe549fa7; no voters: 4e29cd095ba14aefbe4f8bf484bf87b1, 75785880ee25461b9ae096483d4fa6af
I20260709 12:08:18.388352 21398 raft_consensus.cc:2468] T 8c96a750d4384f449614e6bfcea47a96 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75785880ee25461b9ae096483d4fa6af in term 1.
I20260709 12:08:18.389324 21474 raft_consensus.cc:2468] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e29cd095ba14aefbe4f8bf484bf87b1 in term 1.
I20260709 12:08:18.389539 21439 leader_election.cc:304] T 8c96a750d4384f449614e6bfcea47a96 P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e29cd095ba14aefbe4f8bf484bf87b1, 75785880ee25461b9ae096483d4fa6af; no voters: 
I20260709 12:08:18.388835 21631 raft_consensus.cc:3060] T e394f7ee8d92438f9429acae83270427 P d433900e5e4f4756b982e1f6fe549fa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.390726 21367 leader_election.cc:304] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e29cd095ba14aefbe4f8bf484bf87b1, 75785880ee25461b9ae096483d4fa6af; no voters: 
I20260709 12:08:18.391249 21629 raft_consensus.cc:2804] T 8c96a750d4384f449614e6bfcea47a96 P 75785880ee25461b9ae096483d4fa6af [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.392005 21629 raft_consensus.cc:697] T 8c96a750d4384f449614e6bfcea47a96 P 75785880ee25461b9ae096483d4fa6af [term 1 LEADER]: Becoming Leader. State: Replica: 75785880ee25461b9ae096483d4fa6af, State: Running, Role: LEADER
I20260709 12:08:18.392827 21642 raft_consensus.cc:2804] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.393363 21642 raft_consensus.cc:697] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 LEADER]: Becoming Leader. State: Replica: 4e29cd095ba14aefbe4f8bf484bf87b1, State: Running, Role: LEADER
I20260709 12:08:18.392928 21629 consensus_queue.cc:237] T 8c96a750d4384f449614e6bfcea47a96 P 75785880ee25461b9ae096483d4fa6af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:18.394151 21642 consensus_queue.cc:237] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:18.387826 21632 raft_consensus.cc:2749] T b11009396a6546e881059dd95f05bc94 P 75785880ee25461b9ae096483d4fa6af [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:18.399376 21633 consensus_queue.cc:1048] T b11009396a6546e881059dd95f05bc94 P d433900e5e4f4756b982e1f6fe549fa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:18.394205 21550 raft_consensus.cc:2468] T 8c96a750d4384f449614e6bfcea47a96 P d433900e5e4f4756b982e1f6fe549fa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75785880ee25461b9ae096483d4fa6af in term 1.
I20260709 12:08:18.409832 21295 catalog_manager.cc:5697] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129). New cstate: current_term: 1 leader_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:18.413304 21296 catalog_manager.cc:5697] T 8c96a750d4384f449614e6bfcea47a96 P 75785880ee25461b9ae096483d4fa6af reported cstate change: term changed from 0 to 1, leader changed from <none> to 75785880ee25461b9ae096483d4fa6af (127.20.196.130). New cstate: current_term: 1 leader_uuid: "75785880ee25461b9ae096483d4fa6af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:18.432636 21295 catalog_manager.cc:5697] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af reported cstate change: term changed from 0 to 1, leader changed from <none> to 75785880ee25461b9ae096483d4fa6af (127.20.196.130). New cstate: current_term: 1 leader_uuid: "75785880ee25461b9ae096483d4fa6af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:18.434777 21295 catalog_manager.cc:5697] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af reported cstate change: term changed from 0 to 1, leader changed from <none> to 75785880ee25461b9ae096483d4fa6af (127.20.196.130). New cstate: current_term: 1 leader_uuid: "75785880ee25461b9ae096483d4fa6af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:18.492089 21546 raft_consensus.cc:2468] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e29cd095ba14aefbe4f8bf484bf87b1 in term 1.
I20260709 12:08:18.559175 21629 consensus_queue.cc:1048] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [LEADER]: Connected to new peer: Peer: permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:18.563437 21642 consensus_queue.cc:1048] T 8c39dd9aa7c74311a6d6987771803595 P 4e29cd095ba14aefbe4f8bf484bf87b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:18.577070 21658 consensus_queue.cc:1048] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:18.585425 21633 consensus_queue.cc:1048] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:18.585372 21600 consensus_queue.cc:1048] T 8c39dd9aa7c74311a6d6987771803595 P 4e29cd095ba14aefbe4f8bf484bf87b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:18.586845 21630 consensus_queue.cc:1048] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:18.611073 21631 raft_consensus.cc:2749] T e394f7ee8d92438f9429acae83270427 P d433900e5e4f4756b982e1f6fe549fa7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:18.835812 21642 consensus_queue.cc:1048] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:18.840250 21624 consensus_queue.cc:1048] T 8c96a750d4384f449614e6bfcea47a96 P 75785880ee25461b9ae096483d4fa6af [LEADER]: Connected to new peer: Peer: permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:18.842732 21642 consensus_queue.cc:1048] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:18.847465 21658 consensus_queue.cc:1048] T 8c96a750d4384f449614e6bfcea47a96 P 75785880ee25461b9ae096483d4fa6af [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:18.850005 21658 consensus_queue.cc:1048] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [LEADER]: Connected to new peer: Peer: permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:18.898794 21629 consensus_queue.cc:1048] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:08:19.045871 21345 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:08:20.048018 21345 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:08:20.184561 21629 raft_consensus.cc:493] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:20.185055 21629 raft_consensus.cc:515] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:20.186838 21629 leader_election.cc:290] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129:38551), d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131:43271)
I20260709 12:08:20.187605 21398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e394f7ee8d92438f9429acae83270427" candidate_uuid: "75785880ee25461b9ae096483d4fa6af" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" is_pre_election: true
I20260709 12:08:20.187852 21546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e394f7ee8d92438f9429acae83270427" candidate_uuid: "75785880ee25461b9ae096483d4fa6af" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d433900e5e4f4756b982e1f6fe549fa7" is_pre_election: true
I20260709 12:08:20.188124 21398 raft_consensus.cc:2468] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75785880ee25461b9ae096483d4fa6af in term 1.
I20260709 12:08:20.188424 21546 raft_consensus.cc:2468] T e394f7ee8d92438f9429acae83270427 P d433900e5e4f4756b982e1f6fe549fa7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75785880ee25461b9ae096483d4fa6af in term 1.
I20260709 12:08:20.189316 21439 leader_election.cc:304] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e29cd095ba14aefbe4f8bf484bf87b1, 75785880ee25461b9ae096483d4fa6af; no voters: 
I20260709 12:08:20.190057 21629 raft_consensus.cc:2804] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:08:20.190414 21629 raft_consensus.cc:493] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:20.190750 21629 raft_consensus.cc:3060] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.195222 21629 raft_consensus.cc:515] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:20.196705 21629 leader_election.cc:290] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 2 election: Requested vote from peers 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129:38551), d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131:43271)
I20260709 12:08:20.197582 21398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e394f7ee8d92438f9429acae83270427" candidate_uuid: "75785880ee25461b9ae096483d4fa6af" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1"
I20260709 12:08:20.197693 21546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e394f7ee8d92438f9429acae83270427" candidate_uuid: "75785880ee25461b9ae096483d4fa6af" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d433900e5e4f4756b982e1f6fe549fa7"
I20260709 12:08:20.198220 21398 raft_consensus.cc:3060] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.198240 21546 raft_consensus.cc:3060] T e394f7ee8d92438f9429acae83270427 P d433900e5e4f4756b982e1f6fe549fa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.204766 21398 raft_consensus.cc:2468] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75785880ee25461b9ae096483d4fa6af in term 2.
I20260709 12:08:20.204766 21546 raft_consensus.cc:2468] T e394f7ee8d92438f9429acae83270427 P d433900e5e4f4756b982e1f6fe549fa7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75785880ee25461b9ae096483d4fa6af in term 2.
I20260709 12:08:20.205991 21439 leader_election.cc:304] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75785880ee25461b9ae096483d4fa6af, d433900e5e4f4756b982e1f6fe549fa7; no voters: 
I20260709 12:08:20.206637 21629 raft_consensus.cc:2804] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:20.207144 21629 raft_consensus.cc:697] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [term 2 LEADER]: Becoming Leader. State: Replica: 75785880ee25461b9ae096483d4fa6af, State: Running, Role: LEADER
I20260709 12:08:20.207850 21629 consensus_queue.cc:237] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:20.215108 21297 catalog_manager.cc:5697] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af reported cstate change: term changed from 0 to 2, leader changed from <none> to 75785880ee25461b9ae096483d4fa6af (127.20.196.130). New cstate: current_term: 2 leader_uuid: "75785880ee25461b9ae096483d4fa6af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:20.367173 21475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b12c0d1f9484064b965191731a2a7d3"
dest_uuid: "75785880ee25461b9ae096483d4fa6af"
mode: GRACEFUL
new_leader_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1"
 from {username='slave'} at 127.0.0.1:44916
I20260709 12:08:20.367796 21475 raft_consensus.cc:606] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [term 1 LEADER]: Received request to transfer leadership to TS 4e29cd095ba14aefbe4f8bf484bf87b1
I20260709 12:08:20.373064 21475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e394f7ee8d92438f9429acae83270427"
dest_uuid: "75785880ee25461b9ae096483d4fa6af"
mode: GRACEFUL
new_leader_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1"
 from {username='slave'} at 127.0.0.1:44916
I20260709 12:08:20.373539 21475 raft_consensus.cc:606] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [term 2 LEADER]: Received request to transfer leadership to TS 4e29cd095ba14aefbe4f8bf484bf87b1
I20260709 12:08:20.386454 21546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "468c279623b041e0b7cdb26c8976000e"
dest_uuid: "d433900e5e4f4756b982e1f6fe549fa7"
mode: GRACEFUL
new_leader_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1"
 from {username='slave'} at 127.0.0.1:35162
I20260709 12:08:20.387061 21546 raft_consensus.cc:606] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [term 1 LEADER]: Received request to transfer leadership to TS 4e29cd095ba14aefbe4f8bf484bf87b1
I20260709 12:08:20.392051 21475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37d20a28cb9f4b37ac61e4a17d6949d3"
dest_uuid: "75785880ee25461b9ae096483d4fa6af"
mode: GRACEFUL
new_leader_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1"
 from {username='slave'} at 127.0.0.1:44916
I20260709 12:08:20.392534 21475 raft_consensus.cc:606] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [term 1 LEADER]: Received request to transfer leadership to TS 4e29cd095ba14aefbe4f8bf484bf87b1
I20260709 12:08:20.407814 21398 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "030565532533437291655b1a62f632ae"
dest_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1"
mode: GRACEFUL
new_leader_uuid: "75785880ee25461b9ae096483d4fa6af"
 from {username='slave'} at 127.0.0.1:58506
I20260709 12:08:20.408267 21398 raft_consensus.cc:606] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 LEADER]: Received request to transfer leadership to TS 75785880ee25461b9ae096483d4fa6af
I20260709 12:08:20.412955 21398 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c39dd9aa7c74311a6d6987771803595"
dest_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1"
mode: GRACEFUL
new_leader_uuid: "75785880ee25461b9ae096483d4fa6af"
 from {username='slave'} at 127.0.0.1:58506
I20260709 12:08:20.413383 21398 raft_consensus.cc:606] T 8c39dd9aa7c74311a6d6987771803595 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 LEADER]: Received request to transfer leadership to TS 75785880ee25461b9ae096483d4fa6af
I20260709 12:08:20.506804 21600 raft_consensus.cc:993] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1: : Instructing follower 75785880ee25461b9ae096483d4fa6af to start an election
I20260709 12:08:20.507385 21690 raft_consensus.cc:1081] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 LEADER]: Signalling peer 75785880ee25461b9ae096483d4fa6af to start an election
I20260709 12:08:20.508936 21475 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "030565532533437291655b1a62f632ae"
dest_uuid: "75785880ee25461b9ae096483d4fa6af"
 from {username='slave'} at 127.0.0.1:44900
I20260709 12:08:20.509418 21475 raft_consensus.cc:493] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:20.509725 21475 raft_consensus.cc:3060] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.513993 21475 raft_consensus.cc:515] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:20.515571 21475 leader_election.cc:290] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 2 election: Requested vote from peers 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129:38551), d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131:43271)
I20260709 12:08:20.516487 21398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030565532533437291655b1a62f632ae" candidate_uuid: "75785880ee25461b9ae096483d4fa6af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1"
I20260709 12:08:20.516865 21546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030565532533437291655b1a62f632ae" candidate_uuid: "75785880ee25461b9ae096483d4fa6af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d433900e5e4f4756b982e1f6fe549fa7"
I20260709 12:08:20.517114 21398 raft_consensus.cc:3055] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:20.517418 21546 raft_consensus.cc:3060] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.517439 21398 raft_consensus.cc:740] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4e29cd095ba14aefbe4f8bf484bf87b1, State: Running, Role: LEADER
I20260709 12:08:20.518358 21398 consensus_queue.cc:260] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:20.519683 21398 raft_consensus.cc:3060] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.524098 21546 raft_consensus.cc:2468] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75785880ee25461b9ae096483d4fa6af in term 2.
I20260709 12:08:20.525242 21439 leader_election.cc:304] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75785880ee25461b9ae096483d4fa6af, d433900e5e4f4756b982e1f6fe549fa7; no voters: 
I20260709 12:08:20.525698 21398 raft_consensus.cc:2468] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75785880ee25461b9ae096483d4fa6af in term 2.
I20260709 12:08:20.525977 21629 raft_consensus.cc:2804] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:20.526484 21629 raft_consensus.cc:697] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [term 2 LEADER]: Becoming Leader. State: Replica: 75785880ee25461b9ae096483d4fa6af, State: Running, Role: LEADER
I20260709 12:08:20.527244 21629 consensus_queue.cc:237] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:20.534337 21297 catalog_manager.cc:5697] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af reported cstate change: term changed from 1 to 2, leader changed from 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129) to 75785880ee25461b9ae096483d4fa6af (127.20.196.130). New cstate: current_term: 2 leader_uuid: "75785880ee25461b9ae096483d4fa6af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:20.542932 21680 raft_consensus.cc:993] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af: : Instructing follower 4e29cd095ba14aefbe4f8bf484bf87b1 to start an election
I20260709 12:08:20.543440 21629 raft_consensus.cc:1081] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [term 1 LEADER]: Signalling peer 4e29cd095ba14aefbe4f8bf484bf87b1 to start an election
I20260709 12:08:20.544803 21398 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b12c0d1f9484064b965191731a2a7d3"
dest_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1"
 from {username='slave'} at 127.0.0.1:58486
I20260709 12:08:20.545243 21398 raft_consensus.cc:493] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:20.545495 21398 raft_consensus.cc:3060] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.550001 21398 raft_consensus.cc:515] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } }
I20260709 12:08:20.551465 21398 leader_election.cc:290] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [CANDIDATE]: Term 2 election: Requested vote from peers d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131:43271), 75785880ee25461b9ae096483d4fa6af (127.20.196.130:38339)
I20260709 12:08:20.552237 21546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b12c0d1f9484064b965191731a2a7d3" candidate_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d433900e5e4f4756b982e1f6fe549fa7"
I20260709 12:08:20.552526 21475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b12c0d1f9484064b965191731a2a7d3" candidate_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "75785880ee25461b9ae096483d4fa6af"
I20260709 12:08:20.552940 21546 raft_consensus.cc:3060] T 3b12c0d1f9484064b965191731a2a7d3 P d433900e5e4f4756b982e1f6fe549fa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.553022 21475 raft_consensus.cc:3055] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:20.553380 21475 raft_consensus.cc:740] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 75785880ee25461b9ae096483d4fa6af, State: Running, Role: LEADER
I20260709 12:08:20.554039 21475 consensus_queue.cc:260] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } }
I20260709 12:08:20.554939 21475 raft_consensus.cc:3060] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.557824 21546 raft_consensus.cc:2468] T 3b12c0d1f9484064b965191731a2a7d3 P d433900e5e4f4756b982e1f6fe549fa7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e29cd095ba14aefbe4f8bf484bf87b1 in term 2.
I20260709 12:08:20.558780 21364 leader_election.cc:304] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e29cd095ba14aefbe4f8bf484bf87b1, d433900e5e4f4756b982e1f6fe549fa7; no voters: 
I20260709 12:08:20.559295 21475 raft_consensus.cc:2468] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e29cd095ba14aefbe4f8bf484bf87b1 in term 2.
I20260709 12:08:20.559549 21690 raft_consensus.cc:2804] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:20.560042 21690 raft_consensus.cc:697] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 2 LEADER]: Becoming Leader. State: Replica: 4e29cd095ba14aefbe4f8bf484bf87b1, State: Running, Role: LEADER
I20260709 12:08:20.560863 21690 consensus_queue.cc:237] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } }
I20260709 12:08:20.567776 21297 catalog_manager.cc:5697] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 reported cstate change: term changed from 1 to 2, leader changed from 75785880ee25461b9ae096483d4fa6af (127.20.196.130) to 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129). New cstate: current_term: 2 leader_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:20.604373 21546 raft_consensus.cc:1275] T e394f7ee8d92438f9429acae83270427 P d433900e5e4f4756b982e1f6fe549fa7 [term 2 FOLLOWER]: Refusing update from remote peer 75785880ee25461b9ae096483d4fa6af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:08:20.605556 21629 consensus_queue.cc:1048] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [LEADER]: Connected to new peer: Peer: permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:20.615643 21398 raft_consensus.cc:1275] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 2 FOLLOWER]: Refusing update from remote peer 75785880ee25461b9ae096483d4fa6af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:08:20.617127 21695 consensus_queue.cc:1048] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:20.624951 21629 raft_consensus.cc:993] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af: : Instructing follower 4e29cd095ba14aefbe4f8bf484bf87b1 to start an election
I20260709 12:08:20.625452 21695 raft_consensus.cc:1081] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [term 2 LEADER]: Signalling peer 4e29cd095ba14aefbe4f8bf484bf87b1 to start an election
I20260709 12:08:20.626938 21398 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e394f7ee8d92438f9429acae83270427"
dest_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1"
 from {username='slave'} at 127.0.0.1:58486
I20260709 12:08:20.627440 21398 raft_consensus.cc:493] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:20.627734 21398 raft_consensus.cc:3060] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:20.632529 21398 raft_consensus.cc:515] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:20.634513 21398 leader_election.cc:290] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1 [CANDIDATE]: Term 3 election: Requested vote from peers 75785880ee25461b9ae096483d4fa6af (127.20.196.130:38339), d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131:43271)
I20260709 12:08:20.635133 21475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e394f7ee8d92438f9429acae83270427" candidate_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "75785880ee25461b9ae096483d4fa6af"
I20260709 12:08:20.635699 21475 raft_consensus.cc:3055] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:20.636010 21475 raft_consensus.cc:740] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 75785880ee25461b9ae096483d4fa6af, State: Running, Role: LEADER
I20260709 12:08:20.636595 21546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e394f7ee8d92438f9429acae83270427" candidate_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "d433900e5e4f4756b982e1f6fe549fa7"
I20260709 12:08:20.636770 21475 consensus_queue.cc:260] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:20.637319 21546 raft_consensus.cc:3060] T e394f7ee8d92438f9429acae83270427 P d433900e5e4f4756b982e1f6fe549fa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:20.637998 21475 raft_consensus.cc:3060] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:20.643481 21699 raft_consensus.cc:993] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7: : Instructing follower 4e29cd095ba14aefbe4f8bf484bf87b1 to start an election
I20260709 12:08:20.644546 21475 raft_consensus.cc:2468] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e29cd095ba14aefbe4f8bf484bf87b1 in term 3.
I20260709 12:08:20.644966 21631 raft_consensus.cc:1081] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [term 1 LEADER]: Signalling peer 4e29cd095ba14aefbe4f8bf484bf87b1 to start an election
I20260709 12:08:20.647014 21367 leader_election.cc:304] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e29cd095ba14aefbe4f8bf484bf87b1, 75785880ee25461b9ae096483d4fa6af; no voters: 
I20260709 12:08:20.646900 21398 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "468c279623b041e0b7cdb26c8976000e"
dest_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1"
 from {username='slave'} at 127.0.0.1:58498
I20260709 12:08:20.647815 21690 raft_consensus.cc:2804] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:20.647965 21398 raft_consensus.cc:493] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:20.648315 21690 raft_consensus.cc:697] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 3 LEADER]: Becoming Leader. State: Replica: 4e29cd095ba14aefbe4f8bf484bf87b1, State: Running, Role: LEADER
I20260709 12:08:20.648525 21398 raft_consensus.cc:3060] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.649155 21690 consensus_queue.cc:237] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:20.650461 21546 raft_consensus.cc:2468] T e394f7ee8d92438f9429acae83270427 P d433900e5e4f4756b982e1f6fe549fa7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e29cd095ba14aefbe4f8bf484bf87b1 in term 3.
I20260709 12:08:20.655082 21398 raft_consensus.cc:515] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:20.656549 21297 catalog_manager.cc:5697] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1 reported cstate change: term changed from 2 to 3, leader changed from 75785880ee25461b9ae096483d4fa6af (127.20.196.130) to 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129). New cstate: current_term: 3 leader_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:20.657305 21475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "468c279623b041e0b7cdb26c8976000e" candidate_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "75785880ee25461b9ae096483d4fa6af"
I20260709 12:08:20.657433 21398 leader_election.cc:290] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1 [CANDIDATE]: Term 2 election: Requested vote from peers 75785880ee25461b9ae096483d4fa6af (127.20.196.130:38339), d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131:43271)
I20260709 12:08:20.657640 21546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "468c279623b041e0b7cdb26c8976000e" candidate_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d433900e5e4f4756b982e1f6fe549fa7"
I20260709 12:08:20.657915 21475 raft_consensus.cc:3060] T 468c279623b041e0b7cdb26c8976000e P 75785880ee25461b9ae096483d4fa6af [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.658214 21546 raft_consensus.cc:3055] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:20.658563 21546 raft_consensus.cc:740] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d433900e5e4f4756b982e1f6fe549fa7, State: Running, Role: LEADER
I20260709 12:08:20.659312 21546 consensus_queue.cc:260] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:20.660257 21546 raft_consensus.cc:3060] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.663614 21475 raft_consensus.cc:2468] T 468c279623b041e0b7cdb26c8976000e P 75785880ee25461b9ae096483d4fa6af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e29cd095ba14aefbe4f8bf484bf87b1 in term 2.
I20260709 12:08:20.664605 21367 leader_election.cc:304] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e29cd095ba14aefbe4f8bf484bf87b1, 75785880ee25461b9ae096483d4fa6af; no voters: 
I20260709 12:08:20.665292 21690 raft_consensus.cc:2804] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:20.665759 21690 raft_consensus.cc:697] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 2 LEADER]: Becoming Leader. State: Replica: 4e29cd095ba14aefbe4f8bf484bf87b1, State: Running, Role: LEADER
I20260709 12:08:20.666015 21546 raft_consensus.cc:2468] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e29cd095ba14aefbe4f8bf484bf87b1 in term 2.
I20260709 12:08:20.666543 21690 consensus_queue.cc:237] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:20.673422 21297 catalog_manager.cc:5697] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1 reported cstate change: term changed from 1 to 2, leader changed from d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131) to 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129). New cstate: current_term: 2 leader_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:20.761615 21600 raft_consensus.cc:993] T 8c39dd9aa7c74311a6d6987771803595 P 4e29cd095ba14aefbe4f8bf484bf87b1: : Instructing follower 75785880ee25461b9ae096483d4fa6af to start an election
I20260709 12:08:20.762161 21690 raft_consensus.cc:1081] T 8c39dd9aa7c74311a6d6987771803595 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 LEADER]: Signalling peer 75785880ee25461b9ae096483d4fa6af to start an election
I20260709 12:08:20.763605 21475 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8c39dd9aa7c74311a6d6987771803595"
dest_uuid: "75785880ee25461b9ae096483d4fa6af"
 from {username='slave'} at 127.0.0.1:44900
I20260709 12:08:20.764098 21475 raft_consensus.cc:493] T 8c39dd9aa7c74311a6d6987771803595 P 75785880ee25461b9ae096483d4fa6af [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:20.764371 21475 raft_consensus.cc:3060] T 8c39dd9aa7c74311a6d6987771803595 P 75785880ee25461b9ae096483d4fa6af [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.768965 21475 raft_consensus.cc:515] T 8c39dd9aa7c74311a6d6987771803595 P 75785880ee25461b9ae096483d4fa6af [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:20.770694 21475 leader_election.cc:290] T 8c39dd9aa7c74311a6d6987771803595 P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 2 election: Requested vote from peers 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129:38551), d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131:43271)
I20260709 12:08:20.771174 21629 raft_consensus.cc:993] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af: : Instructing follower 4e29cd095ba14aefbe4f8bf484bf87b1 to start an election
I20260709 12:08:20.771451 21398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c39dd9aa7c74311a6d6987771803595" candidate_uuid: "75785880ee25461b9ae096483d4fa6af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1"
I20260709 12:08:20.771601 21629 raft_consensus.cc:1081] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [term 1 LEADER]: Signalling peer 4e29cd095ba14aefbe4f8bf484bf87b1 to start an election
I20260709 12:08:20.771665 21546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c39dd9aa7c74311a6d6987771803595" candidate_uuid: "75785880ee25461b9ae096483d4fa6af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d433900e5e4f4756b982e1f6fe549fa7"
I20260709 12:08:20.772114 21398 raft_consensus.cc:3055] T 8c39dd9aa7c74311a6d6987771803595 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:20.772253 21546 raft_consensus.cc:3060] T 8c39dd9aa7c74311a6d6987771803595 P d433900e5e4f4756b982e1f6fe549fa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.772441 21398 raft_consensus.cc:740] T 8c39dd9aa7c74311a6d6987771803595 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4e29cd095ba14aefbe4f8bf484bf87b1, State: Running, Role: LEADER
I20260709 12:08:20.773313 21400 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37d20a28cb9f4b37ac61e4a17d6949d3"
dest_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1"
 from {username='slave'} at 127.0.0.1:58486
I20260709 12:08:20.773258 21398 consensus_queue.cc:260] T 8c39dd9aa7c74311a6d6987771803595 P 4e29cd095ba14aefbe4f8bf484bf87b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:20.773878 21400 raft_consensus.cc:493] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:20.774300 21400 raft_consensus.cc:3060] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.774549 21398 raft_consensus.cc:3060] T 8c39dd9aa7c74311a6d6987771803595 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.777122 21546 raft_consensus.cc:2468] T 8c39dd9aa7c74311a6d6987771803595 P d433900e5e4f4756b982e1f6fe549fa7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75785880ee25461b9ae096483d4fa6af in term 2.
I20260709 12:08:20.778060 21439 leader_election.cc:304] T 8c39dd9aa7c74311a6d6987771803595 P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75785880ee25461b9ae096483d4fa6af, d433900e5e4f4756b982e1f6fe549fa7; no voters: 
I20260709 12:08:20.778707 21629 raft_consensus.cc:2804] T 8c39dd9aa7c74311a6d6987771803595 P 75785880ee25461b9ae096483d4fa6af [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:20.779160 21629 raft_consensus.cc:697] T 8c39dd9aa7c74311a6d6987771803595 P 75785880ee25461b9ae096483d4fa6af [term 2 LEADER]: Becoming Leader. State: Replica: 75785880ee25461b9ae096483d4fa6af, State: Running, Role: LEADER
I20260709 12:08:20.779951 21629 consensus_queue.cc:237] T 8c39dd9aa7c74311a6d6987771803595 P 75785880ee25461b9ae096483d4fa6af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:20.780650 21398 raft_consensus.cc:2468] T 8c39dd9aa7c74311a6d6987771803595 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75785880ee25461b9ae096483d4fa6af in term 2.
I20260709 12:08:20.780752 21400 raft_consensus.cc:515] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:20.783485 21400 leader_election.cc:290] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [CANDIDATE]: Term 2 election: Requested vote from peers 75785880ee25461b9ae096483d4fa6af (127.20.196.130:38339), d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131:43271)
I20260709 12:08:20.783388 21475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d20a28cb9f4b37ac61e4a17d6949d3" candidate_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "75785880ee25461b9ae096483d4fa6af"
I20260709 12:08:20.783702 21546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d20a28cb9f4b37ac61e4a17d6949d3" candidate_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d433900e5e4f4756b982e1f6fe549fa7"
I20260709 12:08:20.783988 21475 raft_consensus.cc:3055] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:20.784250 21546 raft_consensus.cc:3060] T 37d20a28cb9f4b37ac61e4a17d6949d3 P d433900e5e4f4756b982e1f6fe549fa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.784338 21475 raft_consensus.cc:740] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 75785880ee25461b9ae096483d4fa6af, State: Running, Role: LEADER
I20260709 12:08:20.785368 21475 consensus_queue.cc:260] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:20.786530 21475 raft_consensus.cc:3060] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.788071 21297 catalog_manager.cc:5697] T 8c39dd9aa7c74311a6d6987771803595 P 75785880ee25461b9ae096483d4fa6af reported cstate change: term changed from 1 to 2, leader changed from 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129) to 75785880ee25461b9ae096483d4fa6af (127.20.196.130). New cstate: current_term: 2 leader_uuid: "75785880ee25461b9ae096483d4fa6af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:20.789965 21546 raft_consensus.cc:2468] T 37d20a28cb9f4b37ac61e4a17d6949d3 P d433900e5e4f4756b982e1f6fe549fa7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e29cd095ba14aefbe4f8bf484bf87b1 in term 2.
I20260709 12:08:20.791049 21364 leader_election.cc:304] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e29cd095ba14aefbe4f8bf484bf87b1, d433900e5e4f4756b982e1f6fe549fa7; no voters: 
I20260709 12:08:20.791958 21690 raft_consensus.cc:2804] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:20.792806 21475 raft_consensus.cc:2468] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e29cd095ba14aefbe4f8bf484bf87b1 in term 2.
I20260709 12:08:20.793100 21690 raft_consensus.cc:697] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 2 LEADER]: Becoming Leader. State: Replica: 4e29cd095ba14aefbe4f8bf484bf87b1, State: Running, Role: LEADER
I20260709 12:08:20.793897 21690 consensus_queue.cc:237] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:20.801339 21297 catalog_manager.cc:5697] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 reported cstate change: term changed from 1 to 2, leader changed from 75785880ee25461b9ae096483d4fa6af (127.20.196.130) to 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129). New cstate: current_term: 2 leader_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:20.943958 21400 raft_consensus.cc:1275] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 2 FOLLOWER]: Refusing update from remote peer 75785880ee25461b9ae096483d4fa6af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.945327 21629 consensus_queue.cc:1048] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.953536 21546 raft_consensus.cc:1275] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7 [term 2 FOLLOWER]: Refusing update from remote peer 75785880ee25461b9ae096483d4fa6af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.955086 21629 consensus_queue.cc:1048] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [LEADER]: Connected to new peer: Peer: permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:21.053558 21546 raft_consensus.cc:1275] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [term 2 FOLLOWER]: Refusing update from remote peer 4e29cd095ba14aefbe4f8bf484bf87b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:21.054873 21690 consensus_queue.cc:1048] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:21.065811 21475 raft_consensus.cc:1275] T 468c279623b041e0b7cdb26c8976000e P 75785880ee25461b9ae096483d4fa6af [term 2 FOLLOWER]: Refusing update from remote peer 4e29cd095ba14aefbe4f8bf484bf87b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:21.067430 21600 consensus_queue.cc:1048] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:21.075699 21546 raft_consensus.cc:1275] T 3b12c0d1f9484064b965191731a2a7d3 P d433900e5e4f4756b982e1f6fe549fa7 [term 2 FOLLOWER]: Refusing update from remote peer 4e29cd095ba14aefbe4f8bf484bf87b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:21.077104 21600 consensus_queue.cc:1048] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:21.091207 21475 raft_consensus.cc:1275] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [term 2 FOLLOWER]: Refusing update from remote peer 4e29cd095ba14aefbe4f8bf484bf87b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:21.092449 21690 consensus_queue.cc:1048] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:21.118103 21475 raft_consensus.cc:1275] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [term 3 FOLLOWER]: Refusing update from remote peer 4e29cd095ba14aefbe4f8bf484bf87b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:08:21.119374 21690 consensus_queue.cc:1048] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:21.127239 21546 raft_consensus.cc:1275] T e394f7ee8d92438f9429acae83270427 P d433900e5e4f4756b982e1f6fe549fa7 [term 3 FOLLOWER]: Refusing update from remote peer 4e29cd095ba14aefbe4f8bf484bf87b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:08:21.128747 21600 consensus_queue.cc:1048] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:21.172892 21546 raft_consensus.cc:1275] T 8c39dd9aa7c74311a6d6987771803595 P d433900e5e4f4756b982e1f6fe549fa7 [term 2 FOLLOWER]: Refusing update from remote peer 75785880ee25461b9ae096483d4fa6af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:21.174043 21629 consensus_queue.cc:1048] T 8c39dd9aa7c74311a6d6987771803595 P 75785880ee25461b9ae096483d4fa6af [LEADER]: Connected to new peer: Peer: permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:21.182319 21400 raft_consensus.cc:1275] T 8c39dd9aa7c74311a6d6987771803595 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 2 FOLLOWER]: Refusing update from remote peer 75785880ee25461b9ae096483d4fa6af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:21.183903 21695 consensus_queue.cc:1048] T 8c39dd9aa7c74311a6d6987771803595 P 75785880ee25461b9ae096483d4fa6af [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:21.197152 21475 raft_consensus.cc:1275] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [term 2 FOLLOWER]: Refusing update from remote peer 4e29cd095ba14aefbe4f8bf484bf87b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:21.198408 21707 consensus_queue.cc:1048] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:21.206686 21546 raft_consensus.cc:1275] T 37d20a28cb9f4b37ac61e4a17d6949d3 P d433900e5e4f4756b982e1f6fe549fa7 [term 2 FOLLOWER]: Refusing update from remote peer 4e29cd095ba14aefbe4f8bf484bf87b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:21.208531 21690 consensus_queue.cc:1048] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:23.446314 21266 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:08:23.447208 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:23.464190 21475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "030565532533437291655b1a62f632ae"
dest_uuid: "75785880ee25461b9ae096483d4fa6af"
mode: GRACEFUL
new_leader_uuid: "d433900e5e4f4756b982e1f6fe549fa7"
 from {username='slave'} at 127.0.0.1:44932
I20260709 12:08:23.464721 21475 raft_consensus.cc:606] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [term 2 LEADER]: Received request to transfer leadership to TS d433900e5e4f4756b982e1f6fe549fa7
I20260709 12:08:23.475111 21400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "468c279623b041e0b7cdb26c8976000e"
dest_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1"
mode: GRACEFUL
new_leader_uuid: "d433900e5e4f4756b982e1f6fe549fa7"
 from {username='slave'} at 127.0.0.1:58522
I20260709 12:08:23.475585 21400 raft_consensus.cc:606] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 2 LEADER]: Received request to transfer leadership to TS d433900e5e4f4756b982e1f6fe549fa7
I20260709 12:08:23.476670 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:08:23.477102 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:23.615715 21720 raft_consensus.cc:993] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af: : Instructing follower d433900e5e4f4756b982e1f6fe549fa7 to start an election
I20260709 12:08:23.616220 21712 raft_consensus.cc:1081] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [term 2 LEADER]: Signalling peer d433900e5e4f4756b982e1f6fe549fa7 to start an election
I20260709 12:08:23.617763 21546 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "030565532533437291655b1a62f632ae"
dest_uuid: "d433900e5e4f4756b982e1f6fe549fa7"
 from {username='slave'} at 127.0.0.1:35150
I20260709 12:08:23.618209 21546 raft_consensus.cc:493] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:23.618489 21546 raft_consensus.cc:3060] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:23.622359 21546 raft_consensus.cc:515] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:23.623769 21546 leader_election.cc:290] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7 [CANDIDATE]: Term 3 election: Requested vote from peers 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129:38551), 75785880ee25461b9ae096483d4fa6af (127.20.196.130:38339)
I20260709 12:08:23.624696 21400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030565532533437291655b1a62f632ae" candidate_uuid: "d433900e5e4f4756b982e1f6fe549fa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1"
I20260709 12:08:23.624811 21475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030565532533437291655b1a62f632ae" candidate_uuid: "d433900e5e4f4756b982e1f6fe549fa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "75785880ee25461b9ae096483d4fa6af"
I20260709 12:08:23.625162 21400 raft_consensus.cc:3060] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:23.625372 21475 raft_consensus.cc:3055] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:23.625775 21475 raft_consensus.cc:740] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 75785880ee25461b9ae096483d4fa6af, State: Running, Role: LEADER
I20260709 12:08:23.626586 21475 consensus_queue.cc:260] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:23.627653 21475 raft_consensus.cc:3060] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:23.631204 21400 raft_consensus.cc:2468] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d433900e5e4f4756b982e1f6fe549fa7 in term 3.
I20260709 12:08:23.632211 21513 leader_election.cc:304] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e29cd095ba14aefbe4f8bf484bf87b1, d433900e5e4f4756b982e1f6fe549fa7; no voters: 
I20260709 12:08:23.632513 21475 raft_consensus.cc:2468] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d433900e5e4f4756b982e1f6fe549fa7 in term 3.
I20260709 12:08:23.632866 21700 raft_consensus.cc:2804] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:23.634111 21700 raft_consensus.cc:697] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7 [term 3 LEADER]: Becoming Leader. State: Replica: d433900e5e4f4756b982e1f6fe549fa7, State: Running, Role: LEADER
I20260709 12:08:23.634783 21700 consensus_queue.cc:237] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:23.641768 21298 catalog_manager.cc:5697] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7 reported cstate change: term changed from 2 to 3, leader changed from 75785880ee25461b9ae096483d4fa6af (127.20.196.130) to d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131). New cstate: current_term: 3 leader_uuid: "d433900e5e4f4756b982e1f6fe549fa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:23.847465 21690 raft_consensus.cc:993] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1: : Instructing follower d433900e5e4f4756b982e1f6fe549fa7 to start an election
I20260709 12:08:23.847918 21690 raft_consensus.cc:1081] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 2 LEADER]: Signalling peer d433900e5e4f4756b982e1f6fe549fa7 to start an election
I20260709 12:08:23.849385 21546 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "468c279623b041e0b7cdb26c8976000e"
dest_uuid: "d433900e5e4f4756b982e1f6fe549fa7"
 from {username='slave'} at 127.0.0.1:35154
I20260709 12:08:23.849874 21546 raft_consensus.cc:493] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:23.850210 21546 raft_consensus.cc:3060] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:23.853945 21546 raft_consensus.cc:515] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:23.855320 21546 leader_election.cc:290] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [CANDIDATE]: Term 3 election: Requested vote from peers 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129:38551), 75785880ee25461b9ae096483d4fa6af (127.20.196.130:38339)
I20260709 12:08:23.856195 21400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "468c279623b041e0b7cdb26c8976000e" candidate_uuid: "d433900e5e4f4756b982e1f6fe549fa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1"
I20260709 12:08:23.856494 21475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "468c279623b041e0b7cdb26c8976000e" candidate_uuid: "d433900e5e4f4756b982e1f6fe549fa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "75785880ee25461b9ae096483d4fa6af"
I20260709 12:08:23.856734 21400 raft_consensus.cc:3055] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:23.857080 21400 raft_consensus.cc:740] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4e29cd095ba14aefbe4f8bf484bf87b1, State: Running, Role: LEADER
I20260709 12:08:23.857103 21475 raft_consensus.cc:3060] T 468c279623b041e0b7cdb26c8976000e P 75785880ee25461b9ae096483d4fa6af [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:23.857874 21400 consensus_queue.cc:260] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:23.858925 21400 raft_consensus.cc:3060] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:23.861863 21475 raft_consensus.cc:2468] T 468c279623b041e0b7cdb26c8976000e P 75785880ee25461b9ae096483d4fa6af [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d433900e5e4f4756b982e1f6fe549fa7 in term 3.
I20260709 12:08:23.862828 21516 leader_election.cc:304] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75785880ee25461b9ae096483d4fa6af, d433900e5e4f4756b982e1f6fe549fa7; no voters: 
I20260709 12:08:23.863509 21400 raft_consensus.cc:2468] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d433900e5e4f4756b982e1f6fe549fa7 in term 3.
I20260709 12:08:23.863633 21700 raft_consensus.cc:2804] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:23.864140 21700 raft_consensus.cc:697] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [term 3 LEADER]: Becoming Leader. State: Replica: d433900e5e4f4756b982e1f6fe549fa7, State: Running, Role: LEADER
I20260709 12:08:23.864931 21700 consensus_queue.cc:237] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:23.870923 21298 catalog_manager.cc:5697] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 reported cstate change: term changed from 2 to 3, leader changed from 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129) to d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131). New cstate: current_term: 3 leader_uuid: "d433900e5e4f4756b982e1f6fe549fa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:24.159096 21400 raft_consensus.cc:1275] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 3 FOLLOWER]: Refusing update from remote peer d433900e5e4f4756b982e1f6fe549fa7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:24.160243 21700 consensus_queue.cc:1048] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:24.168906 21475 raft_consensus.cc:1275] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [term 3 FOLLOWER]: Refusing update from remote peer d433900e5e4f4756b982e1f6fe549fa7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:24.170380 21700 consensus_queue.cc:1048] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:24.337803 21400 raft_consensus.cc:1275] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 3 FOLLOWER]: Refusing update from remote peer d433900e5e4f4756b982e1f6fe549fa7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:24.339025 21733 consensus_queue.cc:1048] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:24.349364 21475 raft_consensus.cc:1275] T 468c279623b041e0b7cdb26c8976000e P 75785880ee25461b9ae096483d4fa6af [term 3 FOLLOWER]: Refusing update from remote peer d433900e5e4f4756b982e1f6fe549fa7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:24.350648 21731 consensus_queue.cc:1048] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:24.478080 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:24.483546 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:24.483887 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:25.484889 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:25.489863 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:25.490285 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:26.491263 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:26.495940 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:26.496349 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:27.497260 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:27.502126 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:27.502573 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:28.503729 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:28.508778 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:28.509195 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:29.510118 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:29.514844 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:29.515272 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:30.516166 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:30.521142 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:30.521545 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:31.522356 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:31.527144 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:31.527537 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:32.528549 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:32.533896 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:32.534330 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:33.561476 21266 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:08:33.566109 21400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b12c0d1f9484064b965191731a2a7d3"
dest_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1"
mode: GRACEFUL
new_leader_uuid: "75785880ee25461b9ae096483d4fa6af"
 from {username='slave'} at 127.0.0.1:58506
I20260709 12:08:33.566787 21400 raft_consensus.cc:606] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 2 LEADER]: Received request to transfer leadership to TS 75785880ee25461b9ae096483d4fa6af
I20260709 12:08:33.571148 21400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e394f7ee8d92438f9429acae83270427"
dest_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1"
mode: GRACEFUL
new_leader_uuid: "75785880ee25461b9ae096483d4fa6af"
 from {username='slave'} at 127.0.0.1:58506
I20260709 12:08:33.571554 21400 raft_consensus.cc:606] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 3 LEADER]: Received request to transfer leadership to TS 75785880ee25461b9ae096483d4fa6af
I20260709 12:08:33.575783 21546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "468c279623b041e0b7cdb26c8976000e"
dest_uuid: "d433900e5e4f4756b982e1f6fe549fa7"
mode: GRACEFUL
new_leader_uuid: "75785880ee25461b9ae096483d4fa6af"
 from {username='slave'} at 127.0.0.1:35162
I20260709 12:08:33.576143 21546 raft_consensus.cc:606] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [term 3 LEADER]: Received request to transfer leadership to TS 75785880ee25461b9ae096483d4fa6af
I20260709 12:08:33.580547 21400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37d20a28cb9f4b37ac61e4a17d6949d3"
dest_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1"
mode: GRACEFUL
new_leader_uuid: "75785880ee25461b9ae096483d4fa6af"
 from {username='slave'} at 127.0.0.1:58506
I20260709 12:08:33.580938 21400 raft_consensus.cc:606] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 2 LEADER]: Received request to transfer leadership to TS 75785880ee25461b9ae096483d4fa6af
I20260709 12:08:33.587638 21546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "030565532533437291655b1a62f632ae"
dest_uuid: "d433900e5e4f4756b982e1f6fe549fa7"
mode: GRACEFUL
new_leader_uuid: "75785880ee25461b9ae096483d4fa6af"
 from {username='slave'} at 127.0.0.1:35162
I20260709 12:08:33.588034 21546 raft_consensus.cc:606] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7 [term 3 LEADER]: Received request to transfer leadership to TS 75785880ee25461b9ae096483d4fa6af
I20260709 12:08:33.613557 21745 raft_consensus.cc:993] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 4e29cd095ba14aefbe4f8bf484bf87b1: : Instructing follower 75785880ee25461b9ae096483d4fa6af to start an election
I20260709 12:08:33.614099 21747 raft_consensus.cc:1081] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 2 LEADER]: Signalling peer 75785880ee25461b9ae096483d4fa6af to start an election
I20260709 12:08:33.615729 21475 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37d20a28cb9f4b37ac61e4a17d6949d3"
dest_uuid: "75785880ee25461b9ae096483d4fa6af"
 from {username='slave'} at 127.0.0.1:44900
I20260709 12:08:33.616178 21475 raft_consensus.cc:493] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:33.616473 21475 raft_consensus.cc:3060] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:33.621023 21475 raft_consensus.cc:515] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:33.623121 21475 leader_election.cc:290] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 3 election: Requested vote from peers 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129:38551), d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131:43271)
I20260709 12:08:33.623799 21400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d20a28cb9f4b37ac61e4a17d6949d3" candidate_uuid: "75785880ee25461b9ae096483d4fa6af" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1"
I20260709 12:08:33.624159 21546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d20a28cb9f4b37ac61e4a17d6949d3" candidate_uuid: "75785880ee25461b9ae096483d4fa6af" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d433900e5e4f4756b982e1f6fe549fa7"
I20260709 12:08:33.624513 21400 raft_consensus.cc:3055] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:33.624644 21546 raft_consensus.cc:3060] T 37d20a28cb9f4b37ac61e4a17d6949d3 P d433900e5e4f4756b982e1f6fe549fa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:33.624835 21400 raft_consensus.cc:740] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4e29cd095ba14aefbe4f8bf484bf87b1, State: Running, Role: LEADER
I20260709 12:08:33.625557 21400 consensus_queue.cc:260] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:33.626412 21400 raft_consensus.cc:3060] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:33.628755 21546 raft_consensus.cc:2468] T 37d20a28cb9f4b37ac61e4a17d6949d3 P d433900e5e4f4756b982e1f6fe549fa7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75785880ee25461b9ae096483d4fa6af in term 3.
I20260709 12:08:33.629817 21439 leader_election.cc:304] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75785880ee25461b9ae096483d4fa6af, d433900e5e4f4756b982e1f6fe549fa7; no voters: 
I20260709 12:08:33.630553 21738 raft_consensus.cc:2804] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:33.630913 21400 raft_consensus.cc:2468] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75785880ee25461b9ae096483d4fa6af in term 3.
I20260709 12:08:33.631626 21738 raft_consensus.cc:697] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [term 3 LEADER]: Becoming Leader. State: Replica: 75785880ee25461b9ae096483d4fa6af, State: Running, Role: LEADER
I20260709 12:08:33.632525 21738 consensus_queue.cc:237] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:33.639274 21298 catalog_manager.cc:5697] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af reported cstate change: term changed from 2 to 3, leader changed from 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129) to 75785880ee25461b9ae096483d4fa6af (127.20.196.130). New cstate: current_term: 3 leader_uuid: "75785880ee25461b9ae096483d4fa6af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:33.739401 21700 raft_consensus.cc:993] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7: : Instructing follower 75785880ee25461b9ae096483d4fa6af to start an election
I20260709 12:08:33.739791 21700 raft_consensus.cc:1081] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7 [term 3 LEADER]: Signalling peer 75785880ee25461b9ae096483d4fa6af to start an election
I20260709 12:08:33.741019 21475 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "030565532533437291655b1a62f632ae"
dest_uuid: "75785880ee25461b9ae096483d4fa6af"
 from {username='slave'} at 127.0.0.1:44892
I20260709 12:08:33.741451 21475 raft_consensus.cc:493] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:33.741688 21475 raft_consensus.cc:3060] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:33.745525 21475 raft_consensus.cc:515] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:33.746785 21475 leader_election.cc:290] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 4 election: Requested vote from peers 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129:38551), d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131:43271)
I20260709 12:08:33.747555 21400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030565532533437291655b1a62f632ae" candidate_uuid: "75785880ee25461b9ae096483d4fa6af" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1"
I20260709 12:08:33.747805 21546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030565532533437291655b1a62f632ae" candidate_uuid: "75785880ee25461b9ae096483d4fa6af" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d433900e5e4f4756b982e1f6fe549fa7"
I20260709 12:08:33.748023 21400 raft_consensus.cc:3060] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:33.748302 21546 raft_consensus.cc:3055] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:08:33.748574 21546 raft_consensus.cc:740] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d433900e5e4f4756b982e1f6fe549fa7, State: Running, Role: LEADER
I20260709 12:08:33.749191 21546 consensus_queue.cc:260] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:33.750079 21546 raft_consensus.cc:3060] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:33.752076 21400 raft_consensus.cc:2468] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75785880ee25461b9ae096483d4fa6af in term 4.
I20260709 12:08:33.752869 21439 leader_election.cc:304] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e29cd095ba14aefbe4f8bf484bf87b1, 75785880ee25461b9ae096483d4fa6af; no voters: 
I20260709 12:08:33.753450 21738 raft_consensus.cc:2804] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:08:33.753847 21738 raft_consensus.cc:697] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [term 4 LEADER]: Becoming Leader. State: Replica: 75785880ee25461b9ae096483d4fa6af, State: Running, Role: LEADER
I20260709 12:08:33.754838 21546 raft_consensus.cc:2468] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75785880ee25461b9ae096483d4fa6af in term 4.
I20260709 12:08:33.754591 21738 consensus_queue.cc:237] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:33.761162 21298 catalog_manager.cc:5697] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af reported cstate change: term changed from 3 to 4, leader changed from d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131) to 75785880ee25461b9ae096483d4fa6af (127.20.196.130). New cstate: current_term: 4 leader_uuid: "75785880ee25461b9ae096483d4fa6af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:33.827957 21745 raft_consensus.cc:993] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1: : Instructing follower 75785880ee25461b9ae096483d4fa6af to start an election
I20260709 12:08:33.828401 21747 raft_consensus.cc:1081] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 3 LEADER]: Signalling peer 75785880ee25461b9ae096483d4fa6af to start an election
I20260709 12:08:33.829721 21475 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e394f7ee8d92438f9429acae83270427"
dest_uuid: "75785880ee25461b9ae096483d4fa6af"
 from {username='slave'} at 127.0.0.1:44900
I20260709 12:08:33.830186 21475 raft_consensus.cc:493] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:33.830490 21475 raft_consensus.cc:3060] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:33.834463 21475 raft_consensus.cc:515] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:33.835776 21475 leader_election.cc:290] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 4 election: Requested vote from peers 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129:38551), d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131:43271)
I20260709 12:08:33.836551 21400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e394f7ee8d92438f9429acae83270427" candidate_uuid: "75785880ee25461b9ae096483d4fa6af" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1"
I20260709 12:08:33.836828 21546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e394f7ee8d92438f9429acae83270427" candidate_uuid: "75785880ee25461b9ae096483d4fa6af" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "d433900e5e4f4756b982e1f6fe549fa7"
I20260709 12:08:33.837097 21400 raft_consensus.cc:3055] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:08:33.837312 21546 raft_consensus.cc:3060] T e394f7ee8d92438f9429acae83270427 P d433900e5e4f4756b982e1f6fe549fa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:33.837399 21400 raft_consensus.cc:740] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4e29cd095ba14aefbe4f8bf484bf87b1, State: Running, Role: LEADER
I20260709 12:08:33.838166 21400 consensus_queue.cc:260] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:33.839262 21400 raft_consensus.cc:3060] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:33.843324 21546 raft_consensus.cc:2468] T e394f7ee8d92438f9429acae83270427 P d433900e5e4f4756b982e1f6fe549fa7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75785880ee25461b9ae096483d4fa6af in term 4.
I20260709 12:08:33.844354 21439 leader_election.cc:304] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75785880ee25461b9ae096483d4fa6af, d433900e5e4f4756b982e1f6fe549fa7; no voters: 
I20260709 12:08:33.845043 21738 raft_consensus.cc:2804] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:08:33.845050 21400 raft_consensus.cc:2468] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75785880ee25461b9ae096483d4fa6af in term 4.
I20260709 12:08:33.845546 21738 raft_consensus.cc:697] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [term 4 LEADER]: Becoming Leader. State: Replica: 75785880ee25461b9ae096483d4fa6af, State: Running, Role: LEADER
I20260709 12:08:33.846346 21738 consensus_queue.cc:237] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:33.850152 21754 raft_consensus.cc:993] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7: : Instructing follower 75785880ee25461b9ae096483d4fa6af to start an election
I20260709 12:08:33.850626 21700 raft_consensus.cc:1081] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [term 3 LEADER]: Signalling peer 75785880ee25461b9ae096483d4fa6af to start an election
I20260709 12:08:33.852016 21475 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "468c279623b041e0b7cdb26c8976000e"
dest_uuid: "75785880ee25461b9ae096483d4fa6af"
 from {username='slave'} at 127.0.0.1:44892
I20260709 12:08:33.852514 21475 raft_consensus.cc:493] T 468c279623b041e0b7cdb26c8976000e P 75785880ee25461b9ae096483d4fa6af [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:33.852787 21475 raft_consensus.cc:3060] T 468c279623b041e0b7cdb26c8976000e P 75785880ee25461b9ae096483d4fa6af [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:33.853673 21298 catalog_manager.cc:5697] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af reported cstate change: term changed from 3 to 4, leader changed from 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129) to 75785880ee25461b9ae096483d4fa6af (127.20.196.130). New cstate: current_term: 4 leader_uuid: "75785880ee25461b9ae096483d4fa6af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:33.856777 21475 raft_consensus.cc:515] T 468c279623b041e0b7cdb26c8976000e P 75785880ee25461b9ae096483d4fa6af [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:33.858392 21475 leader_election.cc:290] T 468c279623b041e0b7cdb26c8976000e P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 4 election: Requested vote from peers 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129:38551), d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131:43271)
I20260709 12:08:33.859555 21400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "468c279623b041e0b7cdb26c8976000e" candidate_uuid: "75785880ee25461b9ae096483d4fa6af" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1"
I20260709 12:08:33.859650 21546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "468c279623b041e0b7cdb26c8976000e" candidate_uuid: "75785880ee25461b9ae096483d4fa6af" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d433900e5e4f4756b982e1f6fe549fa7"
I20260709 12:08:33.860102 21400 raft_consensus.cc:3060] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:33.860235 21546 raft_consensus.cc:3055] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:08:33.860621 21546 raft_consensus.cc:740] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d433900e5e4f4756b982e1f6fe549fa7, State: Running, Role: LEADER
I20260709 12:08:33.861510 21546 consensus_queue.cc:260] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:33.862409 21546 raft_consensus.cc:3060] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:33.864987 21400 raft_consensus.cc:2468] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75785880ee25461b9ae096483d4fa6af in term 4.
I20260709 12:08:33.866024 21439 leader_election.cc:304] T 468c279623b041e0b7cdb26c8976000e P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e29cd095ba14aefbe4f8bf484bf87b1, 75785880ee25461b9ae096483d4fa6af; no voters: 
I20260709 12:08:33.866787 21738 raft_consensus.cc:2804] T 468c279623b041e0b7cdb26c8976000e P 75785880ee25461b9ae096483d4fa6af [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:08:33.866818 21546 raft_consensus.cc:2468] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75785880ee25461b9ae096483d4fa6af in term 4.
I20260709 12:08:33.867295 21738 raft_consensus.cc:697] T 468c279623b041e0b7cdb26c8976000e P 75785880ee25461b9ae096483d4fa6af [term 4 LEADER]: Becoming Leader. State: Replica: 75785880ee25461b9ae096483d4fa6af, State: Running, Role: LEADER
I20260709 12:08:33.867986 21738 consensus_queue.cc:237] T 468c279623b041e0b7cdb26c8976000e P 75785880ee25461b9ae096483d4fa6af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:33.873769 21298 catalog_manager.cc:5697] T 468c279623b041e0b7cdb26c8976000e P 75785880ee25461b9ae096483d4fa6af reported cstate change: term changed from 3 to 4, leader changed from d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131) to 75785880ee25461b9ae096483d4fa6af (127.20.196.130). New cstate: current_term: 4 leader_uuid: "75785880ee25461b9ae096483d4fa6af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:34.001235 21745 raft_consensus.cc:993] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1: : Instructing follower 75785880ee25461b9ae096483d4fa6af to start an election
I20260709 12:08:34.001686 21747 raft_consensus.cc:1081] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 2 LEADER]: Signalling peer 75785880ee25461b9ae096483d4fa6af to start an election
I20260709 12:08:34.003237 21475 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b12c0d1f9484064b965191731a2a7d3"
dest_uuid: "75785880ee25461b9ae096483d4fa6af"
 from {username='slave'} at 127.0.0.1:44900
I20260709 12:08:34.003625 21475 raft_consensus.cc:493] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:34.003930 21475 raft_consensus.cc:3060] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:34.007920 21475 raft_consensus.cc:515] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } }
I20260709 12:08:34.009228 21475 leader_election.cc:290] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 3 election: Requested vote from peers d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131:43271), 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129:38551)
I20260709 12:08:34.010069 21546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b12c0d1f9484064b965191731a2a7d3" candidate_uuid: "75785880ee25461b9ae096483d4fa6af" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d433900e5e4f4756b982e1f6fe549fa7"
I20260709 12:08:34.010627 21546 raft_consensus.cc:3060] T 3b12c0d1f9484064b965191731a2a7d3 P d433900e5e4f4756b982e1f6fe549fa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:34.010641 21400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b12c0d1f9484064b965191731a2a7d3" candidate_uuid: "75785880ee25461b9ae096483d4fa6af" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1"
I20260709 12:08:34.011229 21400 raft_consensus.cc:3055] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:34.011437 21400 raft_consensus.cc:740] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4e29cd095ba14aefbe4f8bf484bf87b1, State: Running, Role: LEADER
I20260709 12:08:34.012059 21400 consensus_queue.cc:260] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } }
I20260709 12:08:34.012866 21400 raft_consensus.cc:3060] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:34.016060 21546 raft_consensus.cc:2468] T 3b12c0d1f9484064b965191731a2a7d3 P d433900e5e4f4756b982e1f6fe549fa7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75785880ee25461b9ae096483d4fa6af in term 3.
I20260709 12:08:34.016686 21400 raft_consensus.cc:2468] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75785880ee25461b9ae096483d4fa6af in term 3.
I20260709 12:08:34.017042 21439 leader_election.cc:304] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75785880ee25461b9ae096483d4fa6af, d433900e5e4f4756b982e1f6fe549fa7; no voters: 
I20260709 12:08:34.017863 21738 raft_consensus.cc:2804] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:34.018347 21738 raft_consensus.cc:697] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [term 3 LEADER]: Becoming Leader. State: Replica: 75785880ee25461b9ae096483d4fa6af, State: Running, Role: LEADER
I20260709 12:08:34.018920 21738 consensus_queue.cc:237] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } }
I20260709 12:08:34.026260 21298 catalog_manager.cc:5697] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af reported cstate change: term changed from 2 to 3, leader changed from 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129) to 75785880ee25461b9ae096483d4fa6af (127.20.196.130). New cstate: current_term: 3 leader_uuid: "75785880ee25461b9ae096483d4fa6af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:34.130553 21400 raft_consensus.cc:1275] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 3 FOLLOWER]: Refusing update from remote peer 75785880ee25461b9ae096483d4fa6af: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:34.131717 21738 consensus_queue.cc:1048] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:34.141574 21546 raft_consensus.cc:1275] T 37d20a28cb9f4b37ac61e4a17d6949d3 P d433900e5e4f4756b982e1f6fe549fa7 [term 3 FOLLOWER]: Refusing update from remote peer 75785880ee25461b9ae096483d4fa6af: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:34.142750 21738 consensus_queue.cc:1048] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [LEADER]: Connected to new peer: Peer: permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:34.265815 21400 raft_consensus.cc:1275] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 4 FOLLOWER]: Refusing update from remote peer 75785880ee25461b9ae096483d4fa6af: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:34.267335 21400 raft_consensus.cc:1275] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 4 FOLLOWER]: Refusing update from remote peer 75785880ee25461b9ae096483d4fa6af: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:34.267254 21738 consensus_queue.cc:1048] T 468c279623b041e0b7cdb26c8976000e P 75785880ee25461b9ae096483d4fa6af [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:34.269655 21738 consensus_queue.cc:1048] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:08:34.270262 21398 raft_consensus.cc:1275] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 4 FOLLOWER]: Refusing update from remote peer 75785880ee25461b9ae096483d4fa6af: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:08:34.271663 21738 consensus_queue.cc:1048] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:34.279716 21546 raft_consensus.cc:1275] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [term 4 FOLLOWER]: Refusing update from remote peer 75785880ee25461b9ae096483d4fa6af: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:34.282660 21767 consensus_queue.cc:1048] T 468c279623b041e0b7cdb26c8976000e P 75785880ee25461b9ae096483d4fa6af [LEADER]: Connected to new peer: Peer: permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:08:34.297415 21546 raft_consensus.cc:1275] T e394f7ee8d92438f9429acae83270427 P d433900e5e4f4756b982e1f6fe549fa7 [term 4 FOLLOWER]: Refusing update from remote peer 75785880ee25461b9ae096483d4fa6af: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:08:34.298023 21550 raft_consensus.cc:1275] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7 [term 4 FOLLOWER]: Refusing update from remote peer 75785880ee25461b9ae096483d4fa6af: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:34.302067 21748 consensus_queue.cc:1048] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [LEADER]: Connected to new peer: Peer: permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:34.303994 21748 consensus_queue.cc:1048] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [LEADER]: Connected to new peer: Peer: permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:34.487521 21401 raft_consensus.cc:1275] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 3 FOLLOWER]: Refusing update from remote peer 75785880ee25461b9ae096483d4fa6af: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:34.488763 21748 consensus_queue.cc:1048] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:34.497474 21546 raft_consensus.cc:1275] T 3b12c0d1f9484064b965191731a2a7d3 P d433900e5e4f4756b982e1f6fe549fa7 [term 3 FOLLOWER]: Refusing update from remote peer 75785880ee25461b9ae096483d4fa6af: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:34.499428 21767 consensus_queue.cc:1048] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [LEADER]: Connected to new peer: Peer: permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:36.625289 21266 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:08:36.626166 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:36.633824 21475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "030565532533437291655b1a62f632ae"
dest_uuid: "75785880ee25461b9ae096483d4fa6af"
mode: GRACEFUL
new_leader_uuid: "d433900e5e4f4756b982e1f6fe549fa7"
 from {username='slave'} at 127.0.0.1:44932
I20260709 12:08:36.634465 21475 raft_consensus.cc:606] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [term 4 LEADER]: Received request to transfer leadership to TS d433900e5e4f4756b982e1f6fe549fa7
I20260709 12:08:36.636945 21475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37d20a28cb9f4b37ac61e4a17d6949d3"
dest_uuid: "75785880ee25461b9ae096483d4fa6af"
mode: GRACEFUL
new_leader_uuid: "d433900e5e4f4756b982e1f6fe549fa7"
 from {username='slave'} at 127.0.0.1:44932
I20260709 12:08:36.637365 21475 raft_consensus.cc:606] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [term 3 LEADER]: Received request to transfer leadership to TS d433900e5e4f4756b982e1f6fe549fa7
I20260709 12:08:36.639575 21475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b12c0d1f9484064b965191731a2a7d3"
dest_uuid: "75785880ee25461b9ae096483d4fa6af"
mode: GRACEFUL
new_leader_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1"
 from {username='slave'} at 127.0.0.1:44932
I20260709 12:08:36.640014 21475 raft_consensus.cc:606] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [term 3 LEADER]: Received request to transfer leadership to TS 4e29cd095ba14aefbe4f8bf484bf87b1
I20260709 12:08:36.642061 21475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "468c279623b041e0b7cdb26c8976000e"
dest_uuid: "75785880ee25461b9ae096483d4fa6af"
mode: GRACEFUL
new_leader_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1"
 from {username='slave'} at 127.0.0.1:44932
I20260709 12:08:36.642530 21475 raft_consensus.cc:606] T 468c279623b041e0b7cdb26c8976000e P 75785880ee25461b9ae096483d4fa6af [term 4 LEADER]: Received request to transfer leadership to TS 4e29cd095ba14aefbe4f8bf484bf87b1
I20260709 12:08:36.644775 21475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7232d0c08da499d9ceaf0ecbf7983f9"
dest_uuid: "75785880ee25461b9ae096483d4fa6af"
mode: GRACEFUL
new_leader_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1"
 from {username='slave'} at 127.0.0.1:44932
I20260709 12:08:36.645242 21475 raft_consensus.cc:606] T d7232d0c08da499d9ceaf0ecbf7983f9 P 75785880ee25461b9ae096483d4fa6af [term 1 LEADER]: Received request to transfer leadership to TS 4e29cd095ba14aefbe4f8bf484bf87b1
I20260709 12:08:36.646423 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:08:36.647061 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:36.842319 21775 raft_consensus.cc:993] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af: : Instructing follower d433900e5e4f4756b982e1f6fe549fa7 to start an election
I20260709 12:08:36.842904 21748 raft_consensus.cc:1081] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [term 3 LEADER]: Signalling peer d433900e5e4f4756b982e1f6fe549fa7 to start an election
I20260709 12:08:36.844357 21550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37d20a28cb9f4b37ac61e4a17d6949d3"
dest_uuid: "d433900e5e4f4756b982e1f6fe549fa7"
 from {username='slave'} at 127.0.0.1:35150
I20260709 12:08:36.844803 21550 raft_consensus.cc:493] T 37d20a28cb9f4b37ac61e4a17d6949d3 P d433900e5e4f4756b982e1f6fe549fa7 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:36.845081 21550 raft_consensus.cc:3060] T 37d20a28cb9f4b37ac61e4a17d6949d3 P d433900e5e4f4756b982e1f6fe549fa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:36.850286 21550 raft_consensus.cc:515] T 37d20a28cb9f4b37ac61e4a17d6949d3 P d433900e5e4f4756b982e1f6fe549fa7 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:36.852511 21550 leader_election.cc:290] T 37d20a28cb9f4b37ac61e4a17d6949d3 P d433900e5e4f4756b982e1f6fe549fa7 [CANDIDATE]: Term 4 election: Requested vote from peers 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129:38551), 75785880ee25461b9ae096483d4fa6af (127.20.196.130:38339)
I20260709 12:08:36.853502 21401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d20a28cb9f4b37ac61e4a17d6949d3" candidate_uuid: "d433900e5e4f4756b982e1f6fe549fa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1"
I20260709 12:08:36.853689 21475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d20a28cb9f4b37ac61e4a17d6949d3" candidate_uuid: "d433900e5e4f4756b982e1f6fe549fa7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "75785880ee25461b9ae096483d4fa6af"
I20260709 12:08:36.854202 21401 raft_consensus.cc:3060] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:36.854255 21475 raft_consensus.cc:3055] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:08:36.854578 21475 raft_consensus.cc:740] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 75785880ee25461b9ae096483d4fa6af, State: Running, Role: LEADER
I20260709 12:08:36.855230 21475 consensus_queue.cc:260] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:36.856084 21475 raft_consensus.cc:3060] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:36.859079 21401 raft_consensus.cc:2468] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d433900e5e4f4756b982e1f6fe549fa7 in term 4.
I20260709 12:08:36.860177 21475 raft_consensus.cc:2468] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d433900e5e4f4756b982e1f6fe549fa7 in term 4.
I20260709 12:08:36.860247 21513 leader_election.cc:304] T 37d20a28cb9f4b37ac61e4a17d6949d3 P d433900e5e4f4756b982e1f6fe549fa7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e29cd095ba14aefbe4f8bf484bf87b1, d433900e5e4f4756b982e1f6fe549fa7; no voters: 
I20260709 12:08:36.861248 21700 raft_consensus.cc:2804] T 37d20a28cb9f4b37ac61e4a17d6949d3 P d433900e5e4f4756b982e1f6fe549fa7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:08:36.862170 21700 raft_consensus.cc:697] T 37d20a28cb9f4b37ac61e4a17d6949d3 P d433900e5e4f4756b982e1f6fe549fa7 [term 4 LEADER]: Becoming Leader. State: Replica: d433900e5e4f4756b982e1f6fe549fa7, State: Running, Role: LEADER
I20260709 12:08:36.863085 21700 consensus_queue.cc:237] T 37d20a28cb9f4b37ac61e4a17d6949d3 P d433900e5e4f4756b982e1f6fe549fa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:36.869799 21296 catalog_manager.cc:5697] T 37d20a28cb9f4b37ac61e4a17d6949d3 P d433900e5e4f4756b982e1f6fe549fa7 reported cstate change: term changed from 3 to 4, leader changed from 75785880ee25461b9ae096483d4fa6af (127.20.196.130) to d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131). New cstate: current_term: 4 leader_uuid: "d433900e5e4f4756b982e1f6fe549fa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:36.888054 21748 raft_consensus.cc:993] T d7232d0c08da499d9ceaf0ecbf7983f9 P 75785880ee25461b9ae096483d4fa6af: : Instructing follower 4e29cd095ba14aefbe4f8bf484bf87b1 to start an election
I20260709 12:08:36.888535 21748 raft_consensus.cc:1081] T d7232d0c08da499d9ceaf0ecbf7983f9 P 75785880ee25461b9ae096483d4fa6af [term 1 LEADER]: Signalling peer 4e29cd095ba14aefbe4f8bf484bf87b1 to start an election
I20260709 12:08:36.890215 21782 raft_consensus.cc:993] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af: : Instructing follower d433900e5e4f4756b982e1f6fe549fa7 to start an election
I20260709 12:08:36.890710 21782 raft_consensus.cc:1081] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [term 4 LEADER]: Signalling peer d433900e5e4f4756b982e1f6fe549fa7 to start an election
I20260709 12:08:36.891283 21401 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d7232d0c08da499d9ceaf0ecbf7983f9"
dest_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1"
 from {username='slave'} at 127.0.0.1:58486
I20260709 12:08:36.892769 21401 raft_consensus.cc:493] T d7232d0c08da499d9ceaf0ecbf7983f9 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:36.893139 21401 raft_consensus.cc:3060] T d7232d0c08da499d9ceaf0ecbf7983f9 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:36.893953 21550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "030565532533437291655b1a62f632ae"
dest_uuid: "d433900e5e4f4756b982e1f6fe549fa7"
 from {username='slave'} at 127.0.0.1:35150
I20260709 12:08:36.894413 21550 raft_consensus.cc:493] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:36.894500 21775 raft_consensus.cc:993] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af: : Instructing follower 4e29cd095ba14aefbe4f8bf484bf87b1 to start an election
I20260709 12:08:36.894660 21550 raft_consensus.cc:3060] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:36.894948 21775 raft_consensus.cc:1081] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [term 3 LEADER]: Signalling peer 4e29cd095ba14aefbe4f8bf484bf87b1 to start an election
I20260709 12:08:36.896787 21398 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b12c0d1f9484064b965191731a2a7d3"
dest_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1"
 from {username='slave'} at 127.0.0.1:58486
I20260709 12:08:36.897327 21398 raft_consensus.cc:493] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:36.897679 21398 raft_consensus.cc:3060] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:36.899925 21550 raft_consensus.cc:515] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:36.901098 21401 raft_consensus.cc:515] T d7232d0c08da499d9ceaf0ecbf7983f9 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:36.901584 21550 leader_election.cc:290] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7 [CANDIDATE]: Term 5 election: Requested vote from peers 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129:38551), 75785880ee25461b9ae096483d4fa6af (127.20.196.130:38339)
I20260709 12:08:36.902429 21400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030565532533437291655b1a62f632ae" candidate_uuid: "d433900e5e4f4756b982e1f6fe549fa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1"
I20260709 12:08:36.902617 21475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "030565532533437291655b1a62f632ae" candidate_uuid: "d433900e5e4f4756b982e1f6fe549fa7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "75785880ee25461b9ae096483d4fa6af"
I20260709 12:08:36.902967 21400 raft_consensus.cc:3060] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:36.903064 21475 raft_consensus.cc:3055] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:08:36.903395 21475 raft_consensus.cc:740] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 75785880ee25461b9ae096483d4fa6af, State: Running, Role: LEADER
I20260709 12:08:36.904107 21475 consensus_queue.cc:260] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:36.905277 21475 raft_consensus.cc:3060] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:36.906009 21474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7232d0c08da499d9ceaf0ecbf7983f9" candidate_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "75785880ee25461b9ae096483d4fa6af"
I20260709 12:08:36.906499 21401 leader_election.cc:290] T d7232d0c08da499d9ceaf0ecbf7983f9 P 4e29cd095ba14aefbe4f8bf484bf87b1 [CANDIDATE]: Term 2 election: Requested vote from peers 75785880ee25461b9ae096483d4fa6af (127.20.196.130:38339), d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131:43271)
I20260709 12:08:36.906554 21474 raft_consensus.cc:3055] T d7232d0c08da499d9ceaf0ecbf7983f9 P 75785880ee25461b9ae096483d4fa6af [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:36.907091 21474 raft_consensus.cc:740] T d7232d0c08da499d9ceaf0ecbf7983f9 P 75785880ee25461b9ae096483d4fa6af [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 75785880ee25461b9ae096483d4fa6af, State: Running, Role: LEADER
I20260709 12:08:36.907438 21398 raft_consensus.cc:515] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } }
I20260709 12:08:36.907946 21474 consensus_queue.cc:260] T d7232d0c08da499d9ceaf0ecbf7983f9 P 75785880ee25461b9ae096483d4fa6af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:36.909188 21474 raft_consensus.cc:3060] T d7232d0c08da499d9ceaf0ecbf7983f9 P 75785880ee25461b9ae096483d4fa6af [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:36.909241 21398 leader_election.cc:290] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [CANDIDATE]: Term 4 election: Requested vote from peers d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131:43271), 75785880ee25461b9ae096483d4fa6af (127.20.196.130:38339)
I20260709 12:08:36.910871 21472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b12c0d1f9484064b965191731a2a7d3" candidate_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "75785880ee25461b9ae096483d4fa6af"
I20260709 12:08:36.911451 21472 raft_consensus.cc:3055] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:08:36.911737 21472 raft_consensus.cc:740] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 75785880ee25461b9ae096483d4fa6af, State: Running, Role: LEADER
I20260709 12:08:36.910871 21546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b12c0d1f9484064b965191731a2a7d3" candidate_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d433900e5e4f4756b982e1f6fe549fa7"
I20260709 12:08:36.912662 21550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7232d0c08da499d9ceaf0ecbf7983f9" candidate_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d433900e5e4f4756b982e1f6fe549fa7"
I20260709 12:08:36.913053 21546 raft_consensus.cc:3060] T 3b12c0d1f9484064b965191731a2a7d3 P d433900e5e4f4756b982e1f6fe549fa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:36.913247 21550 raft_consensus.cc:3060] T d7232d0c08da499d9ceaf0ecbf7983f9 P d433900e5e4f4756b982e1f6fe549fa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:36.912825 21472 consensus_queue.cc:260] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } }
I20260709 12:08:36.914275 21472 raft_consensus.cc:3060] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:36.912156 21475 raft_consensus.cc:2468] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d433900e5e4f4756b982e1f6fe549fa7 in term 5.
I20260709 12:08:36.917821 21516 leader_election.cc:304] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75785880ee25461b9ae096483d4fa6af, d433900e5e4f4756b982e1f6fe549fa7; no voters: 
I20260709 12:08:36.918604 21700 raft_consensus.cc:2804] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:08:36.919080 21700 raft_consensus.cc:697] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7 [term 5 LEADER]: Becoming Leader. State: Replica: d433900e5e4f4756b982e1f6fe549fa7, State: Running, Role: LEADER
I20260709 12:08:36.919734 21546 raft_consensus.cc:2468] T 3b12c0d1f9484064b965191731a2a7d3 P d433900e5e4f4756b982e1f6fe549fa7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e29cd095ba14aefbe4f8bf484bf87b1 in term 4.
I20260709 12:08:36.919803 21700 consensus_queue.cc:237] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:36.921078 21550 raft_consensus.cc:2468] T d7232d0c08da499d9ceaf0ecbf7983f9 P d433900e5e4f4756b982e1f6fe549fa7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e29cd095ba14aefbe4f8bf484bf87b1 in term 2.
I20260709 12:08:36.921317 21364 leader_election.cc:304] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e29cd095ba14aefbe4f8bf484bf87b1, d433900e5e4f4756b982e1f6fe549fa7; no voters: 
I20260709 12:08:36.923377 21783 raft_consensus.cc:2804] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:08:36.923484 21472 raft_consensus.cc:2468] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e29cd095ba14aefbe4f8bf484bf87b1 in term 4.
I20260709 12:08:36.923693 21364 leader_election.cc:304] T d7232d0c08da499d9ceaf0ecbf7983f9 P 4e29cd095ba14aefbe4f8bf484bf87b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e29cd095ba14aefbe4f8bf484bf87b1, d433900e5e4f4756b982e1f6fe549fa7; no voters: 
I20260709 12:08:36.926175 21400 raft_consensus.cc:2468] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d433900e5e4f4756b982e1f6fe549fa7 in term 5.
I20260709 12:08:36.928056 21786 raft_consensus.cc:2804] T d7232d0c08da499d9ceaf0ecbf7983f9 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:36.928458 21474 raft_consensus.cc:2468] T d7232d0c08da499d9ceaf0ecbf7983f9 P 75785880ee25461b9ae096483d4fa6af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e29cd095ba14aefbe4f8bf484bf87b1 in term 2.
I20260709 12:08:36.928767 21786 raft_consensus.cc:697] T d7232d0c08da499d9ceaf0ecbf7983f9 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 2 LEADER]: Becoming Leader. State: Replica: 4e29cd095ba14aefbe4f8bf484bf87b1, State: Running, Role: LEADER
I20260709 12:08:36.931454 21783 raft_consensus.cc:697] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 4 LEADER]: Becoming Leader. State: Replica: 4e29cd095ba14aefbe4f8bf484bf87b1, State: Running, Role: LEADER
I20260709 12:08:36.932019 21786 consensus_queue.cc:237] T d7232d0c08da499d9ceaf0ecbf7983f9 P 4e29cd095ba14aefbe4f8bf484bf87b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:36.932513 21783 consensus_queue.cc:237] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } }
I20260709 12:08:36.935299 21296 catalog_manager.cc:5697] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7 reported cstate change: term changed from 4 to 5, leader changed from 75785880ee25461b9ae096483d4fa6af (127.20.196.130) to d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131). New cstate: current_term: 5 leader_uuid: "d433900e5e4f4756b982e1f6fe549fa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:36.942256 21297 catalog_manager.cc:5697] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 reported cstate change: term changed from 3 to 4, leader changed from 75785880ee25461b9ae096483d4fa6af (127.20.196.130) to 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129). New cstate: current_term: 4 leader_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:36.953846 21297 catalog_manager.cc:5697] T d7232d0c08da499d9ceaf0ecbf7983f9 P 4e29cd095ba14aefbe4f8bf484bf87b1 reported cstate change: term changed from 1 to 2, leader changed from 75785880ee25461b9ae096483d4fa6af (127.20.196.130) to 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129). New cstate: current_term: 2 leader_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:37.252761 21775 raft_consensus.cc:993] T 468c279623b041e0b7cdb26c8976000e P 75785880ee25461b9ae096483d4fa6af: : Instructing follower 4e29cd095ba14aefbe4f8bf484bf87b1 to start an election
I20260709 12:08:37.253266 21782 raft_consensus.cc:1081] T 468c279623b041e0b7cdb26c8976000e P 75785880ee25461b9ae096483d4fa6af [term 4 LEADER]: Signalling peer 4e29cd095ba14aefbe4f8bf484bf87b1 to start an election
I20260709 12:08:37.254738 21400 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "468c279623b041e0b7cdb26c8976000e"
dest_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1"
 from {username='slave'} at 127.0.0.1:58486
I20260709 12:08:37.255198 21400 raft_consensus.cc:493] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:37.255470 21400 raft_consensus.cc:3060] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:37.259276 21400 raft_consensus.cc:515] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:37.260591 21400 leader_election.cc:290] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1 [CANDIDATE]: Term 5 election: Requested vote from peers 75785880ee25461b9ae096483d4fa6af (127.20.196.130:38339), d433900e5e4f4756b982e1f6fe549fa7 (127.20.196.131:43271)
I20260709 12:08:37.261377 21474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "468c279623b041e0b7cdb26c8976000e" candidate_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "75785880ee25461b9ae096483d4fa6af"
I20260709 12:08:37.261539 21546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "468c279623b041e0b7cdb26c8976000e" candidate_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "d433900e5e4f4756b982e1f6fe549fa7"
I20260709 12:08:37.261947 21474 raft_consensus.cc:3055] T 468c279623b041e0b7cdb26c8976000e P 75785880ee25461b9ae096483d4fa6af [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:08:37.261976 21546 raft_consensus.cc:3060] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:37.262324 21474 raft_consensus.cc:740] T 468c279623b041e0b7cdb26c8976000e P 75785880ee25461b9ae096483d4fa6af [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 75785880ee25461b9ae096483d4fa6af, State: Running, Role: LEADER
I20260709 12:08:37.262951 21474 consensus_queue.cc:260] T 468c279623b041e0b7cdb26c8976000e P 75785880ee25461b9ae096483d4fa6af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:37.263818 21474 raft_consensus.cc:3060] T 468c279623b041e0b7cdb26c8976000e P 75785880ee25461b9ae096483d4fa6af [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:37.266093 21546 raft_consensus.cc:2468] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e29cd095ba14aefbe4f8bf484bf87b1 in term 5.
I20260709 12:08:37.267241 21364 leader_election.cc:304] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e29cd095ba14aefbe4f8bf484bf87b1, d433900e5e4f4756b982e1f6fe549fa7; no voters: 
I20260709 12:08:37.267957 21783 raft_consensus.cc:2804] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:08:37.268425 21783 raft_consensus.cc:697] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 5 LEADER]: Becoming Leader. State: Replica: 4e29cd095ba14aefbe4f8bf484bf87b1, State: Running, Role: LEADER
I20260709 12:08:37.269119 21474 raft_consensus.cc:2468] T 468c279623b041e0b7cdb26c8976000e P 75785880ee25461b9ae096483d4fa6af [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e29cd095ba14aefbe4f8bf484bf87b1 in term 5.
I20260709 12:08:37.269213 21400 raft_consensus.cc:1275] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 4 FOLLOWER]: Refusing update from remote peer d433900e5e4f4756b982e1f6fe549fa7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:37.269250 21783 consensus_queue.cc:237] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } }
I20260709 12:08:37.270521 21700 consensus_queue.cc:1048] T 37d20a28cb9f4b37ac61e4a17d6949d3 P d433900e5e4f4756b982e1f6fe549fa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:37.281287 21474 raft_consensus.cc:1275] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [term 4 FOLLOWER]: Refusing update from remote peer d433900e5e4f4756b982e1f6fe549fa7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:37.281473 21297 catalog_manager.cc:5697] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1 reported cstate change: term changed from 4 to 5, leader changed from 75785880ee25461b9ae096483d4fa6af (127.20.196.130) to 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129). New cstate: current_term: 5 leader_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:37.282810 21776 consensus_queue.cc:1048] T 37d20a28cb9f4b37ac61e4a17d6949d3 P d433900e5e4f4756b982e1f6fe549fa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:08:37.345868 21474 raft_consensus.cc:1275] T d7232d0c08da499d9ceaf0ecbf7983f9 P 75785880ee25461b9ae096483d4fa6af [term 2 FOLLOWER]: Refusing update from remote peer 4e29cd095ba14aefbe4f8bf484bf87b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:37.347055 21783 consensus_queue.cc:1048] T d7232d0c08da499d9ceaf0ecbf7983f9 P 4e29cd095ba14aefbe4f8bf484bf87b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:37.350134 21400 raft_consensus.cc:1275] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 5 FOLLOWER]: Refusing update from remote peer d433900e5e4f4756b982e1f6fe549fa7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:08:37.350828 21472 raft_consensus.cc:1275] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [term 5 FOLLOWER]: Refusing update from remote peer d433900e5e4f4756b982e1f6fe549fa7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:08:37.351725 21776 consensus_queue.cc:1048] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e29cd095ba14aefbe4f8bf484bf87b1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:08:37.352553 21700 consensus_queue.cc:1048] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:08:37.357318 21546 raft_consensus.cc:1275] T d7232d0c08da499d9ceaf0ecbf7983f9 P d433900e5e4f4756b982e1f6fe549fa7 [term 2 FOLLOWER]: Refusing update from remote peer 4e29cd095ba14aefbe4f8bf484bf87b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:37.358935 21786 consensus_queue.cc:1048] T d7232d0c08da499d9ceaf0ecbf7983f9 P 4e29cd095ba14aefbe4f8bf484bf87b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:37.377674 21550 raft_consensus.cc:1275] T 3b12c0d1f9484064b965191731a2a7d3 P d433900e5e4f4756b982e1f6fe549fa7 [term 4 FOLLOWER]: Refusing update from remote peer 4e29cd095ba14aefbe4f8bf484bf87b1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:37.379971 21786 consensus_queue.cc:1048] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:08:37.394878 21472 raft_consensus.cc:1275] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [term 4 FOLLOWER]: Refusing update from remote peer 4e29cd095ba14aefbe4f8bf484bf87b1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:37.396273 21786 consensus_queue.cc:1048] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:37.648413 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:37.653458 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:37.653803 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:37.830474 21472 raft_consensus.cc:1275] T 468c279623b041e0b7cdb26c8976000e P 75785880ee25461b9ae096483d4fa6af [term 5 FOLLOWER]: Refusing update from remote peer 4e29cd095ba14aefbe4f8bf484bf87b1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:08:37.831768 21785 consensus_queue.cc:1048] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75785880ee25461b9ae096483d4fa6af" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 38339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:08:37.838797 21546 raft_consensus.cc:1275] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [term 5 FOLLOWER]: Refusing update from remote peer 4e29cd095ba14aefbe4f8bf484bf87b1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:08:37.840314 21785 consensus_queue.cc:1048] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d433900e5e4f4756b982e1f6fe549fa7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:08:38.654800 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:38.659633 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:38.660073 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:39.661244 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:39.666118 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:39.666518 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:40.667737 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:40.673213 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:40.673624 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:41.674633 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:41.679517 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:41.679971 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:42.680987 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:42.686661 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:42.687211 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:43.688424 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:43.693568 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:43.693924 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:44.695436 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:44.701493 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:44.702127 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:45.703510 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:45.709270 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:45.709833 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:46.738891 21266 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:08:46.739475 21266 tablet_server.cc:179] TabletServer@127.20.196.129:0 shutting down...
I20260709 12:08:46.768028 21266 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:08:46.768833 21266 tablet_replica.cc:333] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1: stopping tablet replica
I20260709 12:08:46.769498 21266 raft_consensus.cc:2243] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.770160 21266 raft_consensus.cc:2272] T 030565532533437291655b1a62f632ae P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.772424 21266 tablet_replica.cc:333] T b11009396a6546e881059dd95f05bc94 P 4e29cd095ba14aefbe4f8bf484bf87b1: stopping tablet replica
I20260709 12:08:46.773013 21266 raft_consensus.cc:2243] T b11009396a6546e881059dd95f05bc94 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.773527 21266 raft_consensus.cc:2272] T b11009396a6546e881059dd95f05bc94 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.775647 21266 tablet_replica.cc:333] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1: stopping tablet replica
I20260709 12:08:46.776178 21266 raft_consensus.cc:2243] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:08:46.776911 21266 raft_consensus.cc:2272] T 468c279623b041e0b7cdb26c8976000e P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.778411 21266 tablet_replica.cc:333] T 8c96a750d4384f449614e6bfcea47a96 P 4e29cd095ba14aefbe4f8bf484bf87b1: stopping tablet replica
I20260709 12:08:46.778909 21266 raft_consensus.cc:2243] T 8c96a750d4384f449614e6bfcea47a96 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.779386 21266 raft_consensus.cc:2272] T 8c96a750d4384f449614e6bfcea47a96 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.781062 21266 tablet_replica.cc:333] T d7232d0c08da499d9ceaf0ecbf7983f9 P 4e29cd095ba14aefbe4f8bf484bf87b1: stopping tablet replica
I20260709 12:08:46.781556 21266 raft_consensus.cc:2243] T d7232d0c08da499d9ceaf0ecbf7983f9 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:08:46.782287 21266 raft_consensus.cc:2272] T d7232d0c08da499d9ceaf0ecbf7983f9 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.783986 21266 tablet_replica.cc:333] T 8c39dd9aa7c74311a6d6987771803595 P 4e29cd095ba14aefbe4f8bf484bf87b1: stopping tablet replica
I20260709 12:08:46.784466 21266 raft_consensus.cc:2243] T 8c39dd9aa7c74311a6d6987771803595 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.784883 21266 raft_consensus.cc:2272] T 8c39dd9aa7c74311a6d6987771803595 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.787107 21266 tablet_replica.cc:333] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1: stopping tablet replica
I20260709 12:08:46.787596 21266 raft_consensus.cc:2243] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.788059 21266 raft_consensus.cc:2272] T e394f7ee8d92438f9429acae83270427 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:08:46.788025 21513 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:08:46.790069 21266 tablet_replica.cc:333] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 4e29cd095ba14aefbe4f8bf484bf87b1: stopping tablet replica
I20260709 12:08:46.790577 21266 raft_consensus.cc:2243] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.791014 21266 raft_consensus.cc:2272] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:08:46.791458 21513 consensus_peers.cc:597] T 37d20a28cb9f4b37ac61e4a17d6949d3 P d433900e5e4f4756b982e1f6fe549fa7 -> Peer 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129:38551): Couldn't send request to peer 4e29cd095ba14aefbe4f8bf484bf87b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:08:46.792680 21266 tablet_replica.cc:333] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1: stopping tablet replica
I20260709 12:08:46.793165 21266 raft_consensus.cc:2243] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:08:46.793944 21266 raft_consensus.cc:2272] T 3b12c0d1f9484064b965191731a2a7d3 P 4e29cd095ba14aefbe4f8bf484bf87b1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.881260 21266 tablet_server.cc:196] TabletServer@127.20.196.129:0 shutdown complete.
I20260709 12:08:46.909624 21266 tablet_server.cc:179] TabletServer@127.20.196.130:0 shutting down...
W20260709 12:08:46.924047 21516 consensus_peers.cc:597] T b11009396a6546e881059dd95f05bc94 P d433900e5e4f4756b982e1f6fe549fa7 -> Peer 75785880ee25461b9ae096483d4fa6af (127.20.196.130:38339): Couldn't send request to peer 75785880ee25461b9ae096483d4fa6af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:08:46.941939 21513 consensus_peers.cc:597] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7 -> Peer 4e29cd095ba14aefbe4f8bf484bf87b1 (127.20.196.129:38551): Couldn't send request to peer 4e29cd095ba14aefbe4f8bf484bf87b1. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:38551: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:08:46.944728 21266 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:08:46.945431 21266 tablet_replica.cc:333] T b11009396a6546e881059dd95f05bc94 P 75785880ee25461b9ae096483d4fa6af: stopping tablet replica
I20260709 12:08:46.946400 21266 raft_consensus.cc:2243] T b11009396a6546e881059dd95f05bc94 P 75785880ee25461b9ae096483d4fa6af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.946851 21266 raft_consensus.cc:2272] T b11009396a6546e881059dd95f05bc94 P 75785880ee25461b9ae096483d4fa6af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.948557 21266 tablet_replica.cc:333] T 8c96a750d4384f449614e6bfcea47a96 P 75785880ee25461b9ae096483d4fa6af: stopping tablet replica
I20260709 12:08:46.949045 21266 raft_consensus.cc:2243] T 8c96a750d4384f449614e6bfcea47a96 P 75785880ee25461b9ae096483d4fa6af [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:08:46.949760 21266 raft_consensus.cc:2272] T 8c96a750d4384f449614e6bfcea47a96 P 75785880ee25461b9ae096483d4fa6af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.951385 21266 tablet_replica.cc:333] T 468c279623b041e0b7cdb26c8976000e P 75785880ee25461b9ae096483d4fa6af: stopping tablet replica
I20260709 12:08:46.951870 21266 raft_consensus.cc:2243] T 468c279623b041e0b7cdb26c8976000e P 75785880ee25461b9ae096483d4fa6af [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.952275 21266 raft_consensus.cc:2272] T 468c279623b041e0b7cdb26c8976000e P 75785880ee25461b9ae096483d4fa6af [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.953836 21266 tablet_replica.cc:333] T 8c39dd9aa7c74311a6d6987771803595 P 75785880ee25461b9ae096483d4fa6af: stopping tablet replica
I20260709 12:08:46.954298 21266 raft_consensus.cc:2243] T 8c39dd9aa7c74311a6d6987771803595 P 75785880ee25461b9ae096483d4fa6af [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:08:46.955062 21266 raft_consensus.cc:2272] T 8c39dd9aa7c74311a6d6987771803595 P 75785880ee25461b9ae096483d4fa6af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.956525 21266 tablet_replica.cc:333] T d7232d0c08da499d9ceaf0ecbf7983f9 P 75785880ee25461b9ae096483d4fa6af: stopping tablet replica
I20260709 12:08:46.956996 21266 raft_consensus.cc:2243] T d7232d0c08da499d9ceaf0ecbf7983f9 P 75785880ee25461b9ae096483d4fa6af [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.957402 21266 raft_consensus.cc:2272] T d7232d0c08da499d9ceaf0ecbf7983f9 P 75785880ee25461b9ae096483d4fa6af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.959082 21266 tablet_replica.cc:333] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af: stopping tablet replica
I20260709 12:08:46.959571 21266 raft_consensus.cc:2243] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.959980 21266 raft_consensus.cc:2272] T 3b12c0d1f9484064b965191731a2a7d3 P 75785880ee25461b9ae096483d4fa6af [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.961575 21266 tablet_replica.cc:333] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af: stopping tablet replica
I20260709 12:08:46.962041 21266 raft_consensus.cc:2243] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.962443 21266 raft_consensus.cc:2272] T 37d20a28cb9f4b37ac61e4a17d6949d3 P 75785880ee25461b9ae096483d4fa6af [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.964072 21266 tablet_replica.cc:333] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af: stopping tablet replica
I20260709 12:08:46.964538 21266 raft_consensus.cc:2243] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.964936 21266 raft_consensus.cc:2272] T 030565532533437291655b1a62f632ae P 75785880ee25461b9ae096483d4fa6af [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.966583 21266 tablet_replica.cc:333] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af: stopping tablet replica
I20260709 12:08:46.967069 21266 raft_consensus.cc:2243] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:08:46.967814 21266 raft_consensus.cc:2272] T e394f7ee8d92438f9429acae83270427 P 75785880ee25461b9ae096483d4fa6af [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.995355 21266 tablet_server.cc:196] TabletServer@127.20.196.130:0 shutdown complete.
I20260709 12:08:47.013474 21266 tablet_server.cc:179] TabletServer@127.20.196.131:0 shutting down...
I20260709 12:08:47.041100 21266 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:08:47.041827 21266 tablet_replica.cc:333] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7: stopping tablet replica
I20260709 12:08:47.042476 21266 raft_consensus.cc:2243] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:08:47.043345 21266 raft_consensus.cc:2272] T 030565532533437291655b1a62f632ae P d433900e5e4f4756b982e1f6fe549fa7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:47.044968 21266 tablet_replica.cc:333] T e394f7ee8d92438f9429acae83270427 P d433900e5e4f4756b982e1f6fe549fa7: stopping tablet replica
I20260709 12:08:47.045478 21266 raft_consensus.cc:2243] T e394f7ee8d92438f9429acae83270427 P d433900e5e4f4756b982e1f6fe549fa7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:47.045923 21266 raft_consensus.cc:2272] T e394f7ee8d92438f9429acae83270427 P d433900e5e4f4756b982e1f6fe549fa7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:47.047703 21266 tablet_replica.cc:333] T 8c39dd9aa7c74311a6d6987771803595 P d433900e5e4f4756b982e1f6fe549fa7: stopping tablet replica
I20260709 12:08:47.048221 21266 raft_consensus.cc:2243] T 8c39dd9aa7c74311a6d6987771803595 P d433900e5e4f4756b982e1f6fe549fa7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:47.048669 21266 raft_consensus.cc:2272] T 8c39dd9aa7c74311a6d6987771803595 P d433900e5e4f4756b982e1f6fe549fa7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:47.050186 21266 tablet_replica.cc:333] T 3b12c0d1f9484064b965191731a2a7d3 P d433900e5e4f4756b982e1f6fe549fa7: stopping tablet replica
I20260709 12:08:47.050673 21266 raft_consensus.cc:2243] T 3b12c0d1f9484064b965191731a2a7d3 P d433900e5e4f4756b982e1f6fe549fa7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:47.051172 21266 raft_consensus.cc:2272] T 3b12c0d1f9484064b965191731a2a7d3 P d433900e5e4f4756b982e1f6fe549fa7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:47.052664 21266 tablet_replica.cc:333] T 37d20a28cb9f4b37ac61e4a17d6949d3 P d433900e5e4f4756b982e1f6fe549fa7: stopping tablet replica
I20260709 12:08:47.053126 21266 raft_consensus.cc:2243] T 37d20a28cb9f4b37ac61e4a17d6949d3 P d433900e5e4f4756b982e1f6fe549fa7 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:08:47.053835 21266 raft_consensus.cc:2272] T 37d20a28cb9f4b37ac61e4a17d6949d3 P d433900e5e4f4756b982e1f6fe549fa7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:47.055374 21266 tablet_replica.cc:333] T d7232d0c08da499d9ceaf0ecbf7983f9 P d433900e5e4f4756b982e1f6fe549fa7: stopping tablet replica
I20260709 12:08:47.055830 21266 raft_consensus.cc:2243] T d7232d0c08da499d9ceaf0ecbf7983f9 P d433900e5e4f4756b982e1f6fe549fa7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:47.056191 21266 raft_consensus.cc:2272] T d7232d0c08da499d9ceaf0ecbf7983f9 P d433900e5e4f4756b982e1f6fe549fa7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:47.057657 21266 tablet_replica.cc:333] T b11009396a6546e881059dd95f05bc94 P d433900e5e4f4756b982e1f6fe549fa7: stopping tablet replica
I20260709 12:08:47.058113 21266 raft_consensus.cc:2243] T b11009396a6546e881059dd95f05bc94 P d433900e5e4f4756b982e1f6fe549fa7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:08:47.058822 21266 raft_consensus.cc:2272] T b11009396a6546e881059dd95f05bc94 P d433900e5e4f4756b982e1f6fe549fa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:47.060437 21266 tablet_replica.cc:333] T 8c96a750d4384f449614e6bfcea47a96 P d433900e5e4f4756b982e1f6fe549fa7: stopping tablet replica
I20260709 12:08:47.060917 21266 raft_consensus.cc:2243] T 8c96a750d4384f449614e6bfcea47a96 P d433900e5e4f4756b982e1f6fe549fa7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:47.061296 21266 raft_consensus.cc:2272] T 8c96a750d4384f449614e6bfcea47a96 P d433900e5e4f4756b982e1f6fe549fa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:47.062722 21266 tablet_replica.cc:333] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7: stopping tablet replica
I20260709 12:08:47.063186 21266 raft_consensus.cc:2243] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:47.063619 21266 raft_consensus.cc:2272] T 468c279623b041e0b7cdb26c8976000e P d433900e5e4f4756b982e1f6fe549fa7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:47.091974 21266 tablet_server.cc:196] TabletServer@127.20.196.131:0 shutdown complete.
I20260709 12:08:47.109877 21266 master.cc:562] Master@127.20.196.190:35291 shutting down...
I20260709 12:08:47.157702 21353 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 12:08:47.313643 21266 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 857e1fbcb5ad40829664d29dc0dd624e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:08:47.314281 21266 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 857e1fbcb5ad40829664d29dc0dd624e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:47.314623 21266 tablet_replica.cc:333] T 00000000000000000000000000000000 P 857e1fbcb5ad40829664d29dc0dd624e: stopping tablet replica
I20260709 12:08:47.334619 21266 master.cc:584] Master@127.20.196.190:35291 shutdown complete.
4e29cd095ba14aefbe4f8bf484bf87b1  4
75785880ee25461b9ae096483d4fa6af  4
d433900e5e4f4756b982e1f6fe549fa7  1
4e29cd095ba14aefbe4f8bf484bf87b1  3
75785880ee25461b9ae096483d4fa6af  3
d433900e5e4f4756b982e1f6fe549fa7  3
4e29cd095ba14aefbe4f8bf484bf87b1  0
75785880ee25461b9ae096483d4fa6af  8
d433900e5e4f4756b982e1f6fe549fa7  1
4e29cd095ba14aefbe4f8bf484bf87b1  3
75785880ee25461b9ae096483d4fa6af  3
d433900e5e4f4756b982e1f6fe549fa7  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (32853 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:08:47.374790 21266 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.196.190:40929
I20260709 12:08:47.375974 21266 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:47.381675 21816 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:47.381719 21817 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:47.382795 21819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:47.382834 21266 server_base.cc:1061] running on GCE node
I20260709 12:08:47.384318 21266 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:47.384500 21266 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:47.384694 21266 hybrid_clock.cc:648] HybridClock initialized: now 1783598927384662 us; error 0 us; skew 500 ppm
I20260709 12:08:47.385227 21266 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:47.387930 21266 webserver.cc:533] Webserver started at http://127.20.196.190:35623/ using document root <none> and password file <none>
I20260709 12:08:47.388413 21266 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:47.388597 21266 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:47.388880 21266 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:47.389976 21266 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894355727-21266-0/minicluster-data/master-0-root/instance:
uuid: "b951ffce9822474a9bbe184dc18e5ebb"
format_stamp: "Formatted at 2026-07-09 12:08:47 on dist-test-slave-h6sg"
I20260709 12:08:47.394174 21266 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.006s
I20260709 12:08:47.397418 21824 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:47.398227 21266 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:08:47.398473 21266 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894355727-21266-0/minicluster-data/master-0-root
uuid: "b951ffce9822474a9bbe184dc18e5ebb"
format_stamp: "Formatted at 2026-07-09 12:08:47 on dist-test-slave-h6sg"
I20260709 12:08:47.398696 21266 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894355727-21266-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894355727-21266-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894355727-21266-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:47.427685 21266 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:47.428831 21266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:47.466070 21266 rpc_server.cc:307] RPC server started. Bound to: 127.20.196.190:40929
I20260709 12:08:47.466197 21875 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.196.190:40929 every 8 connection(s)
I20260709 12:08:47.470063 21876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.479287 21876 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b951ffce9822474a9bbe184dc18e5ebb: Bootstrap starting.
I20260709 12:08:47.483698 21876 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b951ffce9822474a9bbe184dc18e5ebb: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.487565 21876 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b951ffce9822474a9bbe184dc18e5ebb: No bootstrap required, opened a new log
I20260709 12:08:47.489583 21876 raft_consensus.cc:359] T 00000000000000000000000000000000 P b951ffce9822474a9bbe184dc18e5ebb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b951ffce9822474a9bbe184dc18e5ebb" member_type: VOTER }
I20260709 12:08:47.489977 21876 raft_consensus.cc:385] T 00000000000000000000000000000000 P b951ffce9822474a9bbe184dc18e5ebb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.490156 21876 raft_consensus.cc:740] T 00000000000000000000000000000000 P b951ffce9822474a9bbe184dc18e5ebb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b951ffce9822474a9bbe184dc18e5ebb, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.490801 21876 consensus_queue.cc:260] T 00000000000000000000000000000000 P b951ffce9822474a9bbe184dc18e5ebb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b951ffce9822474a9bbe184dc18e5ebb" member_type: VOTER }
I20260709 12:08:47.491256 21876 raft_consensus.cc:399] T 00000000000000000000000000000000 P b951ffce9822474a9bbe184dc18e5ebb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:08:47.491460 21876 raft_consensus.cc:493] T 00000000000000000000000000000000 P b951ffce9822474a9bbe184dc18e5ebb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:08:47.491672 21876 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b951ffce9822474a9bbe184dc18e5ebb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.495373 21876 raft_consensus.cc:515] T 00000000000000000000000000000000 P b951ffce9822474a9bbe184dc18e5ebb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b951ffce9822474a9bbe184dc18e5ebb" member_type: VOTER }
I20260709 12:08:47.495823 21876 leader_election.cc:304] T 00000000000000000000000000000000 P b951ffce9822474a9bbe184dc18e5ebb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b951ffce9822474a9bbe184dc18e5ebb; no voters: 
I20260709 12:08:47.496865 21876 leader_election.cc:290] T 00000000000000000000000000000000 P b951ffce9822474a9bbe184dc18e5ebb [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:08:47.497263 21879 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b951ffce9822474a9bbe184dc18e5ebb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:47.498533 21879 raft_consensus.cc:697] T 00000000000000000000000000000000 P b951ffce9822474a9bbe184dc18e5ebb [term 1 LEADER]: Becoming Leader. State: Replica: b951ffce9822474a9bbe184dc18e5ebb, State: Running, Role: LEADER
I20260709 12:08:47.499264 21879 consensus_queue.cc:237] T 00000000000000000000000000000000 P b951ffce9822474a9bbe184dc18e5ebb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b951ffce9822474a9bbe184dc18e5ebb" member_type: VOTER }
I20260709 12:08:47.499835 21876 sys_catalog.cc:565] T 00000000000000000000000000000000 P b951ffce9822474a9bbe184dc18e5ebb [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:08:47.504410 21881 sys_catalog.cc:455] T 00000000000000000000000000000000 P b951ffce9822474a9bbe184dc18e5ebb [sys.catalog]: SysCatalogTable state changed. Reason: New leader b951ffce9822474a9bbe184dc18e5ebb. Latest consensus state: current_term: 1 leader_uuid: "b951ffce9822474a9bbe184dc18e5ebb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b951ffce9822474a9bbe184dc18e5ebb" member_type: VOTER } }
I20260709 12:08:47.504328 21880 sys_catalog.cc:455] T 00000000000000000000000000000000 P b951ffce9822474a9bbe184dc18e5ebb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b951ffce9822474a9bbe184dc18e5ebb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b951ffce9822474a9bbe184dc18e5ebb" member_type: VOTER } }
I20260709 12:08:47.505316 21881 sys_catalog.cc:458] T 00000000000000000000000000000000 P b951ffce9822474a9bbe184dc18e5ebb [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:47.505472 21880 sys_catalog.cc:458] T 00000000000000000000000000000000 P b951ffce9822474a9bbe184dc18e5ebb [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:47.512408 21886 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:08:47.517913 21886 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:08:47.518877 21266 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:08:47.526515 21886 catalog_manager.cc:1383] Generated new cluster ID: 34920f3b6cdb4be792f63005d5a310d3
I20260709 12:08:47.526808 21886 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:08:47.554801 21886 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:08:47.555992 21886 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:08:47.568344 21886 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b951ffce9822474a9bbe184dc18e5ebb: Generated new TSK 0
I20260709 12:08:47.568887 21886 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:08:47.585908 21266 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:47.591687 21897 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:47.592918 21898 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:47.594465 21266 server_base.cc:1061] running on GCE node
W20260709 12:08:47.595243 21900 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:47.596148 21266 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:47.596326 21266 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:47.596450 21266 hybrid_clock.cc:648] HybridClock initialized: now 1783598927596439 us; error 0 us; skew 500 ppm
I20260709 12:08:47.596925 21266 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:47.599231 21266 webserver.cc:533] Webserver started at http://127.20.196.129:34347/ using document root <none> and password file <none>
I20260709 12:08:47.599709 21266 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:47.599903 21266 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:47.600170 21266 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:47.601374 21266 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894355727-21266-0/minicluster-data/ts-0-root/instance:
uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c"
format_stamp: "Formatted at 2026-07-09 12:08:47 on dist-test-slave-h6sg"
I20260709 12:08:47.605731 21266 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 12:08:47.608953 21905 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:47.609699 21266 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:08:47.609967 21266 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894355727-21266-0/minicluster-data/ts-0-root
uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c"
format_stamp: "Formatted at 2026-07-09 12:08:47 on dist-test-slave-h6sg"
I20260709 12:08:47.610203 21266 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894355727-21266-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894355727-21266-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894355727-21266-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:47.648859 21266 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:47.650002 21266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:47.651412 21266 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:47.653568 21266 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:47.653790 21266 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:47.654027 21266 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:47.654212 21266 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:47.693676 21266 rpc_server.cc:307] RPC server started. Bound to: 127.20.196.129:44261
I20260709 12:08:47.693763 21967 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.196.129:44261 every 8 connection(s)
I20260709 12:08:47.698526 21266 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:47.705641 21972 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:47.707752 21973 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:47.713749 21975 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:47.713820 21266 server_base.cc:1061] running on GCE node
I20260709 12:08:47.715708 21266 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:47.715978 21266 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:47.716195 21266 hybrid_clock.cc:648] HybridClock initialized: now 1783598927716174 us; error 0 us; skew 500 ppm
I20260709 12:08:47.716923 21266 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:47.717465 21968 heartbeater.cc:344] Connected to a master server at 127.20.196.190:40929
I20260709 12:08:47.717911 21968 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:47.718750 21968 heartbeater.cc:507] Master 127.20.196.190:40929 requested a full tablet report, sending...
I20260709 12:08:47.719635 21266 webserver.cc:533] Webserver started at http://127.20.196.130:42889/ using document root <none> and password file <none>
I20260709 12:08:47.720306 21266 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:47.720587 21266 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:47.720952 21266 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:47.721489 21841 ts_manager.cc:194] Registered new tserver with Master: 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129:44261)
I20260709 12:08:47.722244 21266 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894355727-21266-0/minicluster-data/ts-1-root/instance:
uuid: "4b7d59dcbbf84f1bb2b2049660a3d342"
format_stamp: "Formatted at 2026-07-09 12:08:47 on dist-test-slave-h6sg"
I20260709 12:08:47.723325 21841 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58152
I20260709 12:08:47.727029 21266 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:08:47.730345 21980 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:47.731181 21266 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:08:47.731422 21266 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894355727-21266-0/minicluster-data/ts-1-root
uuid: "4b7d59dcbbf84f1bb2b2049660a3d342"
format_stamp: "Formatted at 2026-07-09 12:08:47 on dist-test-slave-h6sg"
I20260709 12:08:47.731650 21266 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894355727-21266-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894355727-21266-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894355727-21266-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:47.750145 21266 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:47.751348 21266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:47.752707 21266 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:47.754869 21266 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:47.755113 21266 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:47.755390 21266 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:47.755540 21266 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:47.794281 21266 rpc_server.cc:307] RPC server started. Bound to: 127.20.196.130:40715
I20260709 12:08:47.794395 22042 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.196.130:40715 every 8 connection(s)
I20260709 12:08:47.799149 21266 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:47.806422 22046 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:47.806681 22047 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:47.809650 22049 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:47.810940 21266 server_base.cc:1061] running on GCE node
I20260709 12:08:47.811076 22043 heartbeater.cc:344] Connected to a master server at 127.20.196.190:40929
I20260709 12:08:47.811631 22043 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:47.812105 21266 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:47.812347 21266 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:47.812455 22043 heartbeater.cc:507] Master 127.20.196.190:40929 requested a full tablet report, sending...
I20260709 12:08:47.812556 21266 hybrid_clock.cc:648] HybridClock initialized: now 1783598927812537 us; error 0 us; skew 500 ppm
I20260709 12:08:47.813182 21266 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:47.814751 21841 ts_manager.cc:194] Registered new tserver with Master: 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130:40715)
I20260709 12:08:47.815747 21266 webserver.cc:533] Webserver started at http://127.20.196.131:37171/ using document root <none> and password file <none>
I20260709 12:08:47.816241 21841 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58160
I20260709 12:08:47.816258 21266 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:47.816737 21266 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:47.817039 21266 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:47.818346 21266 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894355727-21266-0/minicluster-data/ts-2-root/instance:
uuid: "3b7f4efcc13f42f4ab96addec306cee4"
format_stamp: "Formatted at 2026-07-09 12:08:47 on dist-test-slave-h6sg"
I20260709 12:08:47.822506 21266 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:08:47.825572 22054 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:47.826292 21266 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:08:47.826586 21266 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894355727-21266-0/minicluster-data/ts-2-root
uuid: "3b7f4efcc13f42f4ab96addec306cee4"
format_stamp: "Formatted at 2026-07-09 12:08:47 on dist-test-slave-h6sg"
I20260709 12:08:47.826846 21266 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894355727-21266-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894355727-21266-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894355727-21266-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:47.866837 21266 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:47.868117 21266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:47.869721 21266 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:47.871847 21266 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:47.872085 21266 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:47.872327 21266 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:47.872509 21266 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:47.917456 21266 rpc_server.cc:307] RPC server started. Bound to: 127.20.196.131:44695
I20260709 12:08:47.917603 22116 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.196.131:44695 every 8 connection(s)
I20260709 12:08:47.931874 22117 heartbeater.cc:344] Connected to a master server at 127.20.196.190:40929
I20260709 12:08:47.932235 22117 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:47.933132 22117 heartbeater.cc:507] Master 127.20.196.190:40929 requested a full tablet report, sending...
I20260709 12:08:47.935168 21841 ts_manager.cc:194] Registered new tserver with Master: 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131:44695)
I20260709 12:08:47.935479 21266 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014799081s
I20260709 12:08:47.936496 21841 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58176
I20260709 12:08:47.960637 21841 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58190:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:08:47.963498 21841 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:08:48.037552 22008 tablet_service.cc:1511] Processing CreateTablet for tablet 29408da1bbbe45658dd4f5d47cf5f343 (DEFAULT_TABLE table=test-workload [id=e8a8aabcfa7a4e60bc44c1f46859e4d0]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:08:48.039358 22008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29408da1bbbe45658dd4f5d47cf5f343. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.048626 22007 tablet_service.cc:1511] Processing CreateTablet for tablet fa5860143f19403b948282a6b7cd0009 (DEFAULT_TABLE table=test-workload [id=e8a8aabcfa7a4e60bc44c1f46859e4d0]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:08:48.050025 22007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa5860143f19403b948282a6b7cd0009. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.051077 21932 tablet_service.cc:1511] Processing CreateTablet for tablet fa5860143f19403b948282a6b7cd0009 (DEFAULT_TABLE table=test-workload [id=e8a8aabcfa7a4e60bc44c1f46859e4d0]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:08:48.052444 21932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa5860143f19403b948282a6b7cd0009. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.052116 21930 tablet_service.cc:1511] Processing CreateTablet for tablet 7a3260ab991547578698448eec0c9a1e (DEFAULT_TABLE table=test-workload [id=e8a8aabcfa7a4e60bc44c1f46859e4d0]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:08:48.052356 21928 tablet_service.cc:1511] Processing CreateTablet for tablet a1aa66b1382a4e29b37da4673524a913 (DEFAULT_TABLE table=test-workload [id=e8a8aabcfa7a4e60bc44c1f46859e4d0]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:08:48.053448 21930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a3260ab991547578698448eec0c9a1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.054148 21927 tablet_service.cc:1511] Processing CreateTablet for tablet 733e3d7ad96747ee94d57562d0fe9143 (DEFAULT_TABLE table=test-workload [id=e8a8aabcfa7a4e60bc44c1f46859e4d0]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:08:48.054502 21933 tablet_service.cc:1511] Processing CreateTablet for tablet 29408da1bbbe45658dd4f5d47cf5f343 (DEFAULT_TABLE table=test-workload [id=e8a8aabcfa7a4e60bc44c1f46859e4d0]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:08:48.055979 21927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 733e3d7ad96747ee94d57562d0fe9143. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.058348 21929 tablet_service.cc:1511] Processing CreateTablet for tablet 5b9c4b6520ef4335bed3196d7377bff3 (DEFAULT_TABLE table=test-workload [id=e8a8aabcfa7a4e60bc44c1f46859e4d0]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:08:48.058744 21926 tablet_service.cc:1511] Processing CreateTablet for tablet e190f1787d334b69a152e6d9ed4fa6c5 (DEFAULT_TABLE table=test-workload [id=e8a8aabcfa7a4e60bc44c1f46859e4d0]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:08:48.059676 21929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b9c4b6520ef4335bed3196d7377bff3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.060485 21933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29408da1bbbe45658dd4f5d47cf5f343. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.061640 21931 tablet_service.cc:1511] Processing CreateTablet for tablet 5d8234dd8acb4a8ebc63dc36e6f73c31 (DEFAULT_TABLE table=test-workload [id=e8a8aabcfa7a4e60bc44c1f46859e4d0]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:08:48.062922 21931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d8234dd8acb4a8ebc63dc36e6f73c31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.063607 21928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1aa66b1382a4e29b37da4673524a913. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.065056 21925 tablet_service.cc:1511] Processing CreateTablet for tablet 1c592155a37544428a176145caf18cf9 (DEFAULT_TABLE table=test-workload [id=e8a8aabcfa7a4e60bc44c1f46859e4d0]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:08:48.066308 21925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c592155a37544428a176145caf18cf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.068519 22082 tablet_service.cc:1511] Processing CreateTablet for tablet 29408da1bbbe45658dd4f5d47cf5f343 (DEFAULT_TABLE table=test-workload [id=e8a8aabcfa7a4e60bc44c1f46859e4d0]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:08:48.070387 22082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29408da1bbbe45658dd4f5d47cf5f343. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.071287 21924 tablet_service.cc:1511] Processing CreateTablet for tablet f45f49951c264158be7f17b17dc18bf7 (DEFAULT_TABLE table=test-workload [id=e8a8aabcfa7a4e60bc44c1f46859e4d0]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:08:48.072808 21924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f45f49951c264158be7f17b17dc18bf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.070204 22006 tablet_service.cc:1511] Processing CreateTablet for tablet 5d8234dd8acb4a8ebc63dc36e6f73c31 (DEFAULT_TABLE table=test-workload [id=e8a8aabcfa7a4e60bc44c1f46859e4d0]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:08:48.074712 22006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d8234dd8acb4a8ebc63dc36e6f73c31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.076195 21926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e190f1787d334b69a152e6d9ed4fa6c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.082340 22081 tablet_service.cc:1511] Processing CreateTablet for tablet fa5860143f19403b948282a6b7cd0009 (DEFAULT_TABLE table=test-workload [id=e8a8aabcfa7a4e60bc44c1f46859e4d0]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:08:48.084102 22081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa5860143f19403b948282a6b7cd0009. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.111430 22080 tablet_service.cc:1511] Processing CreateTablet for tablet 5d8234dd8acb4a8ebc63dc36e6f73c31 (DEFAULT_TABLE table=test-workload [id=e8a8aabcfa7a4e60bc44c1f46859e4d0]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:08:48.112380 22005 tablet_service.cc:1511] Processing CreateTablet for tablet 7a3260ab991547578698448eec0c9a1e (DEFAULT_TABLE table=test-workload [id=e8a8aabcfa7a4e60bc44c1f46859e4d0]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:08:48.112887 22080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d8234dd8acb4a8ebc63dc36e6f73c31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.114032 22005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a3260ab991547578698448eec0c9a1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.116212 22079 tablet_service.cc:1511] Processing CreateTablet for tablet 7a3260ab991547578698448eec0c9a1e (DEFAULT_TABLE table=test-workload [id=e8a8aabcfa7a4e60bc44c1f46859e4d0]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:08:48.116756 22004 tablet_service.cc:1511] Processing CreateTablet for tablet 5b9c4b6520ef4335bed3196d7377bff3 (DEFAULT_TABLE table=test-workload [id=e8a8aabcfa7a4e60bc44c1f46859e4d0]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:08:48.117559 22079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a3260ab991547578698448eec0c9a1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.118007 22004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b9c4b6520ef4335bed3196d7377bff3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.120098 22078 tablet_service.cc:1511] Processing CreateTablet for tablet 5b9c4b6520ef4335bed3196d7377bff3 (DEFAULT_TABLE table=test-workload [id=e8a8aabcfa7a4e60bc44c1f46859e4d0]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:08:48.121389 22078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b9c4b6520ef4335bed3196d7377bff3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.124485 22077 tablet_service.cc:1511] Processing CreateTablet for tablet a1aa66b1382a4e29b37da4673524a913 (DEFAULT_TABLE table=test-workload [id=e8a8aabcfa7a4e60bc44c1f46859e4d0]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:08:48.126068 22077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1aa66b1382a4e29b37da4673524a913. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.128439 22076 tablet_service.cc:1511] Processing CreateTablet for tablet 733e3d7ad96747ee94d57562d0fe9143 (DEFAULT_TABLE table=test-workload [id=e8a8aabcfa7a4e60bc44c1f46859e4d0]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:08:48.130021 22076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 733e3d7ad96747ee94d57562d0fe9143. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.132110 22075 tablet_service.cc:1511] Processing CreateTablet for tablet e190f1787d334b69a152e6d9ed4fa6c5 (DEFAULT_TABLE table=test-workload [id=e8a8aabcfa7a4e60bc44c1f46859e4d0]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:08:48.136512 22073 tablet_service.cc:1511] Processing CreateTablet for tablet f45f49951c264158be7f17b17dc18bf7 (DEFAULT_TABLE table=test-workload [id=e8a8aabcfa7a4e60bc44c1f46859e4d0]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:08:48.136677 22003 tablet_service.cc:1511] Processing CreateTablet for tablet a1aa66b1382a4e29b37da4673524a913 (DEFAULT_TABLE table=test-workload [id=e8a8aabcfa7a4e60bc44c1f46859e4d0]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:08:48.137990 22003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1aa66b1382a4e29b37da4673524a913. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.134550 22074 tablet_service.cc:1511] Processing CreateTablet for tablet 1c592155a37544428a176145caf18cf9 (DEFAULT_TABLE table=test-workload [id=e8a8aabcfa7a4e60bc44c1f46859e4d0]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:08:48.143432 22075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e190f1787d334b69a152e6d9ed4fa6c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.144665 22002 tablet_service.cc:1511] Processing CreateTablet for tablet 733e3d7ad96747ee94d57562d0fe9143 (DEFAULT_TABLE table=test-workload [id=e8a8aabcfa7a4e60bc44c1f46859e4d0]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:08:48.145408 22000 tablet_service.cc:1511] Processing CreateTablet for tablet 1c592155a37544428a176145caf18cf9 (DEFAULT_TABLE table=test-workload [id=e8a8aabcfa7a4e60bc44c1f46859e4d0]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:08:48.146029 22002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 733e3d7ad96747ee94d57562d0fe9143. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.146656 22000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c592155a37544428a176145caf18cf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.148639 22001 tablet_service.cc:1511] Processing CreateTablet for tablet e190f1787d334b69a152e6d9ed4fa6c5 (DEFAULT_TABLE table=test-workload [id=e8a8aabcfa7a4e60bc44c1f46859e4d0]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:08:48.149920 22001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e190f1787d334b69a152e6d9ed4fa6c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.156072 22132 tablet_bootstrap.cc:492] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4: Bootstrap starting.
I20260709 12:08:48.158237 21999 tablet_service.cc:1511] Processing CreateTablet for tablet f45f49951c264158be7f17b17dc18bf7 (DEFAULT_TABLE table=test-workload [id=e8a8aabcfa7a4e60bc44c1f46859e4d0]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:08:48.159976 21999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f45f49951c264158be7f17b17dc18bf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.163168 22073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f45f49951c264158be7f17b17dc18bf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.184089 22074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c592155a37544428a176145caf18cf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:48.199805 22134 tablet_bootstrap.cc:492] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c: Bootstrap starting.
I20260709 12:08:48.200492 22133 tablet_bootstrap.cc:492] T 29408da1bbbe45658dd4f5d47cf5f343 P 4b7d59dcbbf84f1bb2b2049660a3d342: Bootstrap starting.
I20260709 12:08:48.239987 22133 tablet_bootstrap.cc:654] T 29408da1bbbe45658dd4f5d47cf5f343 P 4b7d59dcbbf84f1bb2b2049660a3d342: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.241554 22132 tablet_bootstrap.cc:654] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.253213 22132 tablet_bootstrap.cc:492] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4: No bootstrap required, opened a new log
I20260709 12:08:48.253723 22132 ts_tablet_manager.cc:1403] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4: Time spent bootstrapping tablet: real 0.098s	user 0.010s	sys 0.009s
I20260709 12:08:48.256498 22132 raft_consensus.cc:359] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.257222 22132 raft_consensus.cc:385] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.257535 22132 raft_consensus.cc:740] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7f4efcc13f42f4ab96addec306cee4, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.258385 22132 consensus_queue.cc:260] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.264410 22134 tablet_bootstrap.cc:654] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.268005 22133 tablet_bootstrap.cc:492] T 29408da1bbbe45658dd4f5d47cf5f343 P 4b7d59dcbbf84f1bb2b2049660a3d342: No bootstrap required, opened a new log
I20260709 12:08:48.268550 22133 ts_tablet_manager.cc:1403] T 29408da1bbbe45658dd4f5d47cf5f343 P 4b7d59dcbbf84f1bb2b2049660a3d342: Time spent bootstrapping tablet: real 0.068s	user 0.017s	sys 0.012s
I20260709 12:08:48.272244 22133 raft_consensus.cc:359] T 29408da1bbbe45658dd4f5d47cf5f343 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.273140 22132 ts_tablet_manager.cc:1434] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4: Time spent starting tablet: real 0.019s	user 0.010s	sys 0.000s
I20260709 12:08:48.273554 22133 raft_consensus.cc:385] T 29408da1bbbe45658dd4f5d47cf5f343 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.273622 22117 heartbeater.cc:499] Master 127.20.196.190:40929 was elected leader, sending a full tablet report...
I20260709 12:08:48.274008 22134 tablet_bootstrap.cc:492] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c: No bootstrap required, opened a new log
I20260709 12:08:48.274019 22133 raft_consensus.cc:740] T 29408da1bbbe45658dd4f5d47cf5f343 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7d59dcbbf84f1bb2b2049660a3d342, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.274525 22132 tablet_bootstrap.cc:492] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4: Bootstrap starting.
I20260709 12:08:48.274559 22134 ts_tablet_manager.cc:1403] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c: Time spent bootstrapping tablet: real 0.075s	user 0.011s	sys 0.000s
I20260709 12:08:48.274966 22133 consensus_queue.cc:260] T 29408da1bbbe45658dd4f5d47cf5f343 P 4b7d59dcbbf84f1bb2b2049660a3d342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.277716 22134 raft_consensus.cc:359] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.278419 22134 raft_consensus.cc:385] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.278692 22134 raft_consensus.cc:740] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df5a1658ec74fa2a6e1b737cd0dac7c, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.279424 22134 consensus_queue.cc:260] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.283070 22132 tablet_bootstrap.cc:654] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.283655 22137 raft_consensus.cc:493] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.284305 22137 raft_consensus.cc:515] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.287886 22043 heartbeater.cc:499] Master 127.20.196.190:40929 was elected leader, sending a full tablet report...
I20260709 12:08:48.289844 22133 ts_tablet_manager.cc:1434] T 29408da1bbbe45658dd4f5d47cf5f343 P 4b7d59dcbbf84f1bb2b2049660a3d342: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.011s
I20260709 12:08:48.291502 22134 ts_tablet_manager.cc:1434] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.006s
I20260709 12:08:48.293540 22133 tablet_bootstrap.cc:492] T 7a3260ab991547578698448eec0c9a1e P 4b7d59dcbbf84f1bb2b2049660a3d342: Bootstrap starting.
I20260709 12:08:48.294870 22132 tablet_bootstrap.cc:492] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4: No bootstrap required, opened a new log
I20260709 12:08:48.295281 21968 heartbeater.cc:499] Master 127.20.196.190:40929 was elected leader, sending a full tablet report...
I20260709 12:08:48.295377 22132 ts_tablet_manager.cc:1403] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.000s
W20260709 12:08:48.298290 22044 tablet.cc:2406] T 29408da1bbbe45658dd4f5d47cf5f343 P 4b7d59dcbbf84f1bb2b2049660a3d342: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:08:48.299561 22134 tablet_bootstrap.cc:492] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 2df5a1658ec74fa2a6e1b737cd0dac7c: Bootstrap starting.
I20260709 12:08:48.298208 22132 raft_consensus.cc:359] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.300007 22132 raft_consensus.cc:385] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.300405 22132 raft_consensus.cc:740] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7f4efcc13f42f4ab96addec306cee4, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.301344 22132 consensus_queue.cc:260] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.299435 22137 leader_election.cc:290] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129:44261), 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130:40715)
I20260709 12:08:48.305825 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5860143f19403b948282a6b7cd0009" candidate_uuid: "3b7f4efcc13f42f4ab96addec306cee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" is_pre_election: true
I20260709 12:08:48.307327 22133 tablet_bootstrap.cc:654] T 7a3260ab991547578698448eec0c9a1e P 4b7d59dcbbf84f1bb2b2049660a3d342: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.307433 21943 raft_consensus.cc:2468] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b7f4efcc13f42f4ab96addec306cee4 in term 0.
I20260709 12:08:48.309168 22058 leader_election.cc:304] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2df5a1658ec74fa2a6e1b737cd0dac7c, 3b7f4efcc13f42f4ab96addec306cee4; no voters: 
I20260709 12:08:48.313694 22137 raft_consensus.cc:2804] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:48.315527 22137 raft_consensus.cc:493] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:48.316673 22137 raft_consensus.cc:3060] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.318393 22134 tablet_bootstrap.cc:654] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 2df5a1658ec74fa2a6e1b737cd0dac7c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.318651 22132 ts_tablet_manager.cc:1434] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4: Time spent starting tablet: real 0.023s	user 0.014s	sys 0.004s
I20260709 12:08:48.319626 22132 tablet_bootstrap.cc:492] T a1aa66b1382a4e29b37da4673524a913 P 3b7f4efcc13f42f4ab96addec306cee4: Bootstrap starting.
I20260709 12:08:48.325805 22133 tablet_bootstrap.cc:492] T 7a3260ab991547578698448eec0c9a1e P 4b7d59dcbbf84f1bb2b2049660a3d342: No bootstrap required, opened a new log
I20260709 12:08:48.326145 22137 raft_consensus.cc:515] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.326687 22133 ts_tablet_manager.cc:1403] T 7a3260ab991547578698448eec0c9a1e P 4b7d59dcbbf84f1bb2b2049660a3d342: Time spent bootstrapping tablet: real 0.033s	user 0.005s	sys 0.009s
I20260709 12:08:48.331738 22133 raft_consensus.cc:359] T 7a3260ab991547578698448eec0c9a1e P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.333637 22132 tablet_bootstrap.cc:654] T a1aa66b1382a4e29b37da4673524a913 P 3b7f4efcc13f42f4ab96addec306cee4: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.334765 22133 raft_consensus.cc:385] T 7a3260ab991547578698448eec0c9a1e P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.335332 22133 raft_consensus.cc:740] T 7a3260ab991547578698448eec0c9a1e P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7d59dcbbf84f1bb2b2049660a3d342, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.336974 22134 tablet_bootstrap.cc:492] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 2df5a1658ec74fa2a6e1b737cd0dac7c: No bootstrap required, opened a new log
I20260709 12:08:48.336787 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5860143f19403b948282a6b7cd0009" candidate_uuid: "3b7f4efcc13f42f4ab96addec306cee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c"
I20260709 12:08:48.334203 22137 leader_election.cc:290] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [CANDIDATE]: Term 1 election: Requested vote from peers 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129:44261), 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130:40715)
I20260709 12:08:48.337630 21943 raft_consensus.cc:3060] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.337850 22133 consensus_queue.cc:260] T 7a3260ab991547578698448eec0c9a1e P 4b7d59dcbbf84f1bb2b2049660a3d342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.338593 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5860143f19403b948282a6b7cd0009" candidate_uuid: "3b7f4efcc13f42f4ab96addec306cee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" is_pre_election: true
I20260709 12:08:48.340507 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5860143f19403b948282a6b7cd0009" candidate_uuid: "3b7f4efcc13f42f4ab96addec306cee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342"
W20260709 12:08:48.340947 22055 leader_election.cc:343] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130:40715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:48.340510 22133 ts_tablet_manager.cc:1434] T 7a3260ab991547578698448eec0c9a1e P 4b7d59dcbbf84f1bb2b2049660a3d342: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
W20260709 12:08:48.341833 22055 leader_election.cc:343] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130:40715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:48.342458 22133 tablet_bootstrap.cc:492] T 5b9c4b6520ef4335bed3196d7377bff3 P 4b7d59dcbbf84f1bb2b2049660a3d342: Bootstrap starting.
I20260709 12:08:48.342613 22134 ts_tablet_manager.cc:1403] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 2df5a1658ec74fa2a6e1b737cd0dac7c: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.011s
I20260709 12:08:48.345458 22134 raft_consensus.cc:359] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.346213 22134 raft_consensus.cc:385] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.346515 22134 raft_consensus.cc:740] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df5a1658ec74fa2a6e1b737cd0dac7c, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.348454 21943 raft_consensus.cc:2468] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b7f4efcc13f42f4ab96addec306cee4 in term 1.
I20260709 12:08:48.349262 22133 tablet_bootstrap.cc:654] T 5b9c4b6520ef4335bed3196d7377bff3 P 4b7d59dcbbf84f1bb2b2049660a3d342: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.350801 22134 consensus_queue.cc:260] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 2df5a1658ec74fa2a6e1b737cd0dac7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.352051 22137 raft_consensus.cc:493] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.352488 22137 raft_consensus.cc:515] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.353374 22134 ts_tablet_manager.cc:1434] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 2df5a1658ec74fa2a6e1b737cd0dac7c: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 12:08:48.354599 22134 tablet_bootstrap.cc:492] T 1c592155a37544428a176145caf18cf9 P 2df5a1658ec74fa2a6e1b737cd0dac7c: Bootstrap starting.
I20260709 12:08:48.354557 22137 leader_election.cc:290] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130:40715), 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129:44261)
I20260709 12:08:48.359452 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29408da1bbbe45658dd4f5d47cf5f343" candidate_uuid: "3b7f4efcc13f42f4ab96addec306cee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" is_pre_election: true
I20260709 12:08:48.360100 22018 raft_consensus.cc:2468] T 29408da1bbbe45658dd4f5d47cf5f343 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b7f4efcc13f42f4ab96addec306cee4 in term 0.
I20260709 12:08:48.361536 22055 leader_election.cc:304] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b7f4efcc13f42f4ab96addec306cee4, 4b7d59dcbbf84f1bb2b2049660a3d342; no voters: 
I20260709 12:08:48.362476 22137 raft_consensus.cc:2804] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:48.362893 22137 raft_consensus.cc:493] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:48.363317 22137 raft_consensus.cc:3060] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.364383 22134 tablet_bootstrap.cc:654] T 1c592155a37544428a176145caf18cf9 P 2df5a1658ec74fa2a6e1b737cd0dac7c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.367434 22132 tablet_bootstrap.cc:492] T a1aa66b1382a4e29b37da4673524a913 P 3b7f4efcc13f42f4ab96addec306cee4: No bootstrap required, opened a new log
I20260709 12:08:48.367722 22133 tablet_bootstrap.cc:492] T 5b9c4b6520ef4335bed3196d7377bff3 P 4b7d59dcbbf84f1bb2b2049660a3d342: No bootstrap required, opened a new log
I20260709 12:08:48.367937 22132 ts_tablet_manager.cc:1403] T a1aa66b1382a4e29b37da4673524a913 P 3b7f4efcc13f42f4ab96addec306cee4: Time spent bootstrapping tablet: real 0.049s	user 0.017s	sys 0.011s
I20260709 12:08:48.368183 22133 ts_tablet_manager.cc:1403] T 5b9c4b6520ef4335bed3196d7377bff3 P 4b7d59dcbbf84f1bb2b2049660a3d342: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.009s
I20260709 12:08:48.371318 22133 raft_consensus.cc:359] T 5b9c4b6520ef4335bed3196d7377bff3 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.372041 22133 raft_consensus.cc:385] T 5b9c4b6520ef4335bed3196d7377bff3 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.372393 22133 raft_consensus.cc:740] T 5b9c4b6520ef4335bed3196d7377bff3 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7d59dcbbf84f1bb2b2049660a3d342, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.372299 22132 raft_consensus.cc:359] T a1aa66b1382a4e29b37da4673524a913 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.373664 22132 raft_consensus.cc:385] T a1aa66b1382a4e29b37da4673524a913 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.374210 22132 raft_consensus.cc:740] T a1aa66b1382a4e29b37da4673524a913 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7f4efcc13f42f4ab96addec306cee4, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.375288 22132 consensus_queue.cc:260] T a1aa66b1382a4e29b37da4673524a913 P 3b7f4efcc13f42f4ab96addec306cee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.377615 22134 tablet_bootstrap.cc:492] T 1c592155a37544428a176145caf18cf9 P 2df5a1658ec74fa2a6e1b737cd0dac7c: No bootstrap required, opened a new log
I20260709 12:08:48.377794 22132 ts_tablet_manager.cc:1434] T a1aa66b1382a4e29b37da4673524a913 P 3b7f4efcc13f42f4ab96addec306cee4: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:08:48.378221 22134 ts_tablet_manager.cc:1403] T 1c592155a37544428a176145caf18cf9 P 2df5a1658ec74fa2a6e1b737cd0dac7c: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.004s
I20260709 12:08:48.378751 22132 tablet_bootstrap.cc:492] T e190f1787d334b69a152e6d9ed4fa6c5 P 3b7f4efcc13f42f4ab96addec306cee4: Bootstrap starting.
I20260709 12:08:48.381415 22134 raft_consensus.cc:359] T 1c592155a37544428a176145caf18cf9 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.382445 22134 raft_consensus.cc:385] T 1c592155a37544428a176145caf18cf9 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.382833 22134 raft_consensus.cc:740] T 1c592155a37544428a176145caf18cf9 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df5a1658ec74fa2a6e1b737cd0dac7c, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.383662 22134 consensus_queue.cc:260] T 1c592155a37544428a176145caf18cf9 P 2df5a1658ec74fa2a6e1b737cd0dac7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.385784 22132 tablet_bootstrap.cc:654] T e190f1787d334b69a152e6d9ed4fa6c5 P 3b7f4efcc13f42f4ab96addec306cee4: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.385826 22134 ts_tablet_manager.cc:1434] T 1c592155a37544428a176145caf18cf9 P 2df5a1658ec74fa2a6e1b737cd0dac7c: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:08:48.373438 22133 consensus_queue.cc:260] T 5b9c4b6520ef4335bed3196d7377bff3 P 4b7d59dcbbf84f1bb2b2049660a3d342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.386807 22137 raft_consensus.cc:515] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.388041 22133 ts_tablet_manager.cc:1434] T 5b9c4b6520ef4335bed3196d7377bff3 P 4b7d59dcbbf84f1bb2b2049660a3d342: Time spent starting tablet: real 0.019s	user 0.000s	sys 0.007s
I20260709 12:08:48.389024 22137 leader_election.cc:290] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4 [CANDIDATE]: Term 1 election: Requested vote from peers 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130:40715), 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129:44261)
I20260709 12:08:48.389086 22133 tablet_bootstrap.cc:492] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 4b7d59dcbbf84f1bb2b2049660a3d342: Bootstrap starting.
I20260709 12:08:48.390408 22134 tablet_bootstrap.cc:492] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c: Bootstrap starting.
I20260709 12:08:48.350195 22058 leader_election.cc:304] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2df5a1658ec74fa2a6e1b737cd0dac7c, 3b7f4efcc13f42f4ab96addec306cee4; no voters: 4b7d59dcbbf84f1bb2b2049660a3d342
I20260709 12:08:48.394214 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29408da1bbbe45658dd4f5d47cf5f343" candidate_uuid: "3b7f4efcc13f42f4ab96addec306cee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" is_pre_election: true
I20260709 12:08:48.395459 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29408da1bbbe45658dd4f5d47cf5f343" candidate_uuid: "3b7f4efcc13f42f4ab96addec306cee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c"
I20260709 12:08:48.397284 22133 tablet_bootstrap.cc:654] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 4b7d59dcbbf84f1bb2b2049660a3d342: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.399354 22134 tablet_bootstrap.cc:654] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.400446 22137 raft_consensus.cc:2804] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:48.400981 22137 raft_consensus.cc:697] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [term 1 LEADER]: Becoming Leader. State: Replica: 3b7f4efcc13f42f4ab96addec306cee4, State: Running, Role: LEADER
I20260709 12:08:48.401799 22137 consensus_queue.cc:237] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.406566 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29408da1bbbe45658dd4f5d47cf5f343" candidate_uuid: "3b7f4efcc13f42f4ab96addec306cee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342"
I20260709 12:08:48.407370 22018 raft_consensus.cc:3060] T 29408da1bbbe45658dd4f5d47cf5f343 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.409052 22133 tablet_bootstrap.cc:492] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 4b7d59dcbbf84f1bb2b2049660a3d342: No bootstrap required, opened a new log
I20260709 12:08:48.411652 22133 ts_tablet_manager.cc:1403] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 4b7d59dcbbf84f1bb2b2049660a3d342: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.006s
I20260709 12:08:48.419710 22134 tablet_bootstrap.cc:492] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c: No bootstrap required, opened a new log
I20260709 12:08:48.420281 22134 ts_tablet_manager.cc:1403] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.019s
I20260709 12:08:48.421952 22133 raft_consensus.cc:359] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.422669 22133 raft_consensus.cc:385] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.422976 22133 raft_consensus.cc:740] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7d59dcbbf84f1bb2b2049660a3d342, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.423246 22134 raft_consensus.cc:359] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.424109 22134 raft_consensus.cc:385] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:08:48.423403 22058 leader_election.cc:343] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129:44261): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:48.424576 22134 raft_consensus.cc:740] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df5a1658ec74fa2a6e1b737cd0dac7c, State: Initialized, Role: FOLLOWER
W20260709 12:08:48.424937 22058 leader_election.cc:343] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129:44261): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:48.425828 22134 consensus_queue.cc:260] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.423736 22133 consensus_queue.cc:260] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 4b7d59dcbbf84f1bb2b2049660a3d342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.428843 22134 ts_tablet_manager.cc:1434] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:08:48.429270 22018 raft_consensus.cc:2468] T 29408da1bbbe45658dd4f5d47cf5f343 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b7f4efcc13f42f4ab96addec306cee4 in term 1.
I20260709 12:08:48.429885 22134 tablet_bootstrap.cc:492] T 733e3d7ad96747ee94d57562d0fe9143 P 2df5a1658ec74fa2a6e1b737cd0dac7c: Bootstrap starting.
I20260709 12:08:48.430367 22133 ts_tablet_manager.cc:1434] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 4b7d59dcbbf84f1bb2b2049660a3d342: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 12:08:48.431327 22133 tablet_bootstrap.cc:492] T f45f49951c264158be7f17b17dc18bf7 P 4b7d59dcbbf84f1bb2b2049660a3d342: Bootstrap starting.
I20260709 12:08:48.431762 22139 raft_consensus.cc:493] T 7a3260ab991547578698448eec0c9a1e P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.432219 22139 raft_consensus.cc:515] T 7a3260ab991547578698448eec0c9a1e P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.435153 22132 tablet_bootstrap.cc:492] T e190f1787d334b69a152e6d9ed4fa6c5 P 3b7f4efcc13f42f4ab96addec306cee4: No bootstrap required, opened a new log
I20260709 12:08:48.431150 22055 leader_election.cc:304] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b7f4efcc13f42f4ab96addec306cee4, 4b7d59dcbbf84f1bb2b2049660a3d342; no voters: 2df5a1658ec74fa2a6e1b737cd0dac7c
I20260709 12:08:48.435633 22132 ts_tablet_manager.cc:1403] T e190f1787d334b69a152e6d9ed4fa6c5 P 3b7f4efcc13f42f4ab96addec306cee4: Time spent bootstrapping tablet: real 0.057s	user 0.011s	sys 0.025s
I20260709 12:08:48.437136 22134 tablet_bootstrap.cc:654] T 733e3d7ad96747ee94d57562d0fe9143 P 2df5a1658ec74fa2a6e1b737cd0dac7c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.437932 22137 raft_consensus.cc:2804] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:48.438498 22137 raft_consensus.cc:697] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4 [term 1 LEADER]: Becoming Leader. State: Replica: 3b7f4efcc13f42f4ab96addec306cee4, State: Running, Role: LEADER
I20260709 12:08:48.437235 22139 leader_election.cc:290] T 7a3260ab991547578698448eec0c9a1e P 4b7d59dcbbf84f1bb2b2049660a3d342 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129:44261), 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131:44695)
I20260709 12:08:48.439466 22137 consensus_queue.cc:237] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.441923 22133 tablet_bootstrap.cc:654] T f45f49951c264158be7f17b17dc18bf7 P 4b7d59dcbbf84f1bb2b2049660a3d342: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.444685 22144 raft_consensus.cc:493] T a1aa66b1382a4e29b37da4673524a913 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.445163 22144 raft_consensus.cc:515] T a1aa66b1382a4e29b37da4673524a913 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.447345 22144 leader_election.cc:290] T a1aa66b1382a4e29b37da4673524a913 P 3b7f4efcc13f42f4ab96addec306cee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129:44261), 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130:40715)
I20260709 12:08:48.448634 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1aa66b1382a4e29b37da4673524a913" candidate_uuid: "3b7f4efcc13f42f4ab96addec306cee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" is_pre_election: true
I20260709 12:08:48.444598 22132 raft_consensus.cc:359] T e190f1787d334b69a152e6d9ed4fa6c5 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.449604 22132 raft_consensus.cc:385] T e190f1787d334b69a152e6d9ed4fa6c5 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.449918 22132 raft_consensus.cc:740] T e190f1787d334b69a152e6d9ed4fa6c5 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7f4efcc13f42f4ab96addec306cee4, State: Initialized, Role: FOLLOWER
W20260709 12:08:48.450549 22058 leader_election.cc:343] T a1aa66b1382a4e29b37da4673524a913 P 3b7f4efcc13f42f4ab96addec306cee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129:44261): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:48.450637 22132 consensus_queue.cc:260] T e190f1787d334b69a152e6d9ed4fa6c5 P 3b7f4efcc13f42f4ab96addec306cee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.454391 22132 ts_tablet_manager.cc:1434] T e190f1787d334b69a152e6d9ed4fa6c5 P 3b7f4efcc13f42f4ab96addec306cee4: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:08:48.455688 22132 tablet_bootstrap.cc:492] T 1c592155a37544428a176145caf18cf9 P 3b7f4efcc13f42f4ab96addec306cee4: Bootstrap starting.
I20260709 12:08:48.463284 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1aa66b1382a4e29b37da4673524a913" candidate_uuid: "3b7f4efcc13f42f4ab96addec306cee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" is_pre_election: true
I20260709 12:08:48.463824 22140 raft_consensus.cc:493] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.464414 22140 raft_consensus.cc:515] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
W20260709 12:08:48.464805 22055 leader_election.cc:343] T a1aa66b1382a4e29b37da4673524a913 P 3b7f4efcc13f42f4ab96addec306cee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130:40715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:48.465279 22055 leader_election.cc:304] T a1aa66b1382a4e29b37da4673524a913 P 3b7f4efcc13f42f4ab96addec306cee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b7f4efcc13f42f4ab96addec306cee4; no voters: 2df5a1658ec74fa2a6e1b737cd0dac7c, 4b7d59dcbbf84f1bb2b2049660a3d342
I20260709 12:08:48.466944 22137 raft_consensus.cc:2749] T a1aa66b1382a4e29b37da4673524a913 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:48.470297 22092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3260ab991547578698448eec0c9a1e" candidate_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7f4efcc13f42f4ab96addec306cee4" is_pre_election: true
I20260709 12:08:48.472462 22140 leader_election.cc:290] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 2df5a1658ec74fa2a6e1b737cd0dac7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130:40715), 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131:44695)
W20260709 12:08:48.475263 21981 leader_election.cc:343] T 7a3260ab991547578698448eec0c9a1e P 4b7d59dcbbf84f1bb2b2049660a3d342 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131:44695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:48.476883 22133 tablet_bootstrap.cc:492] T f45f49951c264158be7f17b17dc18bf7 P 4b7d59dcbbf84f1bb2b2049660a3d342: No bootstrap required, opened a new log
I20260709 12:08:48.477350 22133 ts_tablet_manager.cc:1403] T f45f49951c264158be7f17b17dc18bf7 P 4b7d59dcbbf84f1bb2b2049660a3d342: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.005s
I20260709 12:08:48.480196 22133 raft_consensus.cc:359] T f45f49951c264158be7f17b17dc18bf7 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.480896 22133 raft_consensus.cc:385] T f45f49951c264158be7f17b17dc18bf7 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.481176 22133 raft_consensus.cc:740] T f45f49951c264158be7f17b17dc18bf7 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7d59dcbbf84f1bb2b2049660a3d342, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.481977 22133 consensus_queue.cc:260] T f45f49951c264158be7f17b17dc18bf7 P 4b7d59dcbbf84f1bb2b2049660a3d342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.473003 21839 catalog_manager.cc:5697] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131). New cstate: current_term: 1 leader_uuid: "3b7f4efcc13f42f4ab96addec306cee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:48.487154 22133 ts_tablet_manager.cc:1434] T f45f49951c264158be7f17b17dc18bf7 P 4b7d59dcbbf84f1bb2b2049660a3d342: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.001s
I20260709 12:08:48.488143 22133 tablet_bootstrap.cc:492] T fa5860143f19403b948282a6b7cd0009 P 4b7d59dcbbf84f1bb2b2049660a3d342: Bootstrap starting.
I20260709 12:08:48.488479 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d8234dd8acb4a8ebc63dc36e6f73c31" candidate_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" is_pre_election: true
I20260709 12:08:48.489002 22134 tablet_bootstrap.cc:492] T 733e3d7ad96747ee94d57562d0fe9143 P 2df5a1658ec74fa2a6e1b737cd0dac7c: No bootstrap required, opened a new log
I20260709 12:08:48.489079 22018 raft_consensus.cc:2468] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2df5a1658ec74fa2a6e1b737cd0dac7c in term 0.
I20260709 12:08:48.489495 22134 ts_tablet_manager.cc:1403] T 733e3d7ad96747ee94d57562d0fe9143 P 2df5a1658ec74fa2a6e1b737cd0dac7c: Time spent bootstrapping tablet: real 0.060s	user 0.015s	sys 0.019s
I20260709 12:08:48.490630 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3260ab991547578698448eec0c9a1e" candidate_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" is_pre_election: true
W20260709 12:08:48.492620 21984 leader_election.cc:343] T 7a3260ab991547578698448eec0c9a1e P 4b7d59dcbbf84f1bb2b2049660a3d342 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129:44261): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:48.493091 21984 leader_election.cc:304] T 7a3260ab991547578698448eec0c9a1e P 4b7d59dcbbf84f1bb2b2049660a3d342 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b7d59dcbbf84f1bb2b2049660a3d342; no voters: 2df5a1658ec74fa2a6e1b737cd0dac7c, 3b7f4efcc13f42f4ab96addec306cee4
I20260709 12:08:48.494144 22139 raft_consensus.cc:2749] T 7a3260ab991547578698448eec0c9a1e P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:48.494724 22133 tablet_bootstrap.cc:654] T fa5860143f19403b948282a6b7cd0009 P 4b7d59dcbbf84f1bb2b2049660a3d342: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.495600 22134 raft_consensus.cc:359] T 733e3d7ad96747ee94d57562d0fe9143 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.498203 22134 raft_consensus.cc:385] T 733e3d7ad96747ee94d57562d0fe9143 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.498533 22134 raft_consensus.cc:740] T 733e3d7ad96747ee94d57562d0fe9143 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df5a1658ec74fa2a6e1b737cd0dac7c, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.497912 22132 tablet_bootstrap.cc:654] T 1c592155a37544428a176145caf18cf9 P 3b7f4efcc13f42f4ab96addec306cee4: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.501900 22134 consensus_queue.cc:260] T 733e3d7ad96747ee94d57562d0fe9143 P 2df5a1658ec74fa2a6e1b737cd0dac7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.504215 22134 ts_tablet_manager.cc:1434] T 733e3d7ad96747ee94d57562d0fe9143 P 2df5a1658ec74fa2a6e1b737cd0dac7c: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:08:48.505215 22134 tablet_bootstrap.cc:492] T 7a3260ab991547578698448eec0c9a1e P 2df5a1658ec74fa2a6e1b737cd0dac7c: Bootstrap starting.
I20260709 12:08:48.505761 21906 leader_election.cc:304] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 2df5a1658ec74fa2a6e1b737cd0dac7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2df5a1658ec74fa2a6e1b737cd0dac7c, 4b7d59dcbbf84f1bb2b2049660a3d342; no voters: 
I20260709 12:08:48.510193 22140 raft_consensus.cc:2804] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:48.510573 22140 raft_consensus.cc:493] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:48.510892 22140 raft_consensus.cc:3060] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:08:48.512390 21889 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:08:48.518440 22134 tablet_bootstrap.cc:654] T 7a3260ab991547578698448eec0c9a1e P 2df5a1658ec74fa2a6e1b737cd0dac7c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.506994 21841 catalog_manager.cc:5697] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131). New cstate: current_term: 1 leader_uuid: "3b7f4efcc13f42f4ab96addec306cee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:48.521443 22140 raft_consensus.cc:515] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.527554 22133 tablet_bootstrap.cc:492] T fa5860143f19403b948282a6b7cd0009 P 4b7d59dcbbf84f1bb2b2049660a3d342: No bootstrap required, opened a new log
I20260709 12:08:48.531827 22092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d8234dd8acb4a8ebc63dc36e6f73c31" candidate_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7f4efcc13f42f4ab96addec306cee4" is_pre_election: true
I20260709 12:08:48.533280 22133 ts_tablet_manager.cc:1403] T fa5860143f19403b948282a6b7cd0009 P 4b7d59dcbbf84f1bb2b2049660a3d342: Time spent bootstrapping tablet: real 0.045s	user 0.027s	sys 0.007s
W20260709 12:08:48.534731 21906 leader_election.cc:343] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 2df5a1658ec74fa2a6e1b737cd0dac7c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131:44695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:48.537027 22133 raft_consensus.cc:359] T fa5860143f19403b948282a6b7cd0009 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.537829 22133 raft_consensus.cc:385] T fa5860143f19403b948282a6b7cd0009 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.538172 22133 raft_consensus.cc:740] T fa5860143f19403b948282a6b7cd0009 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7d59dcbbf84f1bb2b2049660a3d342, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.538658 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d8234dd8acb4a8ebc63dc36e6f73c31" candidate_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342"
I20260709 12:08:48.539255 22018 raft_consensus.cc:3060] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.538972 22133 consensus_queue.cc:260] T fa5860143f19403b948282a6b7cd0009 P 4b7d59dcbbf84f1bb2b2049660a3d342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.541188 22134 tablet_bootstrap.cc:492] T 7a3260ab991547578698448eec0c9a1e P 2df5a1658ec74fa2a6e1b737cd0dac7c: No bootstrap required, opened a new log
I20260709 12:08:48.541297 22133 ts_tablet_manager.cc:1434] T fa5860143f19403b948282a6b7cd0009 P 4b7d59dcbbf84f1bb2b2049660a3d342: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:08:48.541497 22092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d8234dd8acb4a8ebc63dc36e6f73c31" candidate_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7f4efcc13f42f4ab96addec306cee4"
I20260709 12:08:48.541695 22134 ts_tablet_manager.cc:1403] T 7a3260ab991547578698448eec0c9a1e P 2df5a1658ec74fa2a6e1b737cd0dac7c: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.014s
W20260709 12:08:48.542816 21906 leader_election.cc:343] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 2df5a1658ec74fa2a6e1b737cd0dac7c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131:44695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:48.543368 22140 leader_election.cc:290] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 2df5a1658ec74fa2a6e1b737cd0dac7c [CANDIDATE]: Term 1 election: Requested vote from peers 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130:40715), 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131:44695)
I20260709 12:08:48.539774 22132 tablet_bootstrap.cc:492] T 1c592155a37544428a176145caf18cf9 P 3b7f4efcc13f42f4ab96addec306cee4: No bootstrap required, opened a new log
I20260709 12:08:48.544094 22133 tablet_bootstrap.cc:492] T 1c592155a37544428a176145caf18cf9 P 4b7d59dcbbf84f1bb2b2049660a3d342: Bootstrap starting.
I20260709 12:08:48.544166 22132 ts_tablet_manager.cc:1403] T 1c592155a37544428a176145caf18cf9 P 3b7f4efcc13f42f4ab96addec306cee4: Time spent bootstrapping tablet: real 0.089s	user 0.023s	sys 0.011s
I20260709 12:08:48.546536 22018 raft_consensus.cc:2468] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df5a1658ec74fa2a6e1b737cd0dac7c in term 1.
I20260709 12:08:48.549094 21906 leader_election.cc:304] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 2df5a1658ec74fa2a6e1b737cd0dac7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2df5a1658ec74fa2a6e1b737cd0dac7c, 4b7d59dcbbf84f1bb2b2049660a3d342; no voters: 3b7f4efcc13f42f4ab96addec306cee4
I20260709 12:08:48.549304 22134 raft_consensus.cc:359] T 7a3260ab991547578698448eec0c9a1e P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.549990 22134 raft_consensus.cc:385] T 7a3260ab991547578698448eec0c9a1e P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.550237 22140 raft_consensus.cc:2804] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:48.550345 22134 raft_consensus.cc:740] T 7a3260ab991547578698448eec0c9a1e P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df5a1658ec74fa2a6e1b737cd0dac7c, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.551407 22134 consensus_queue.cc:260] T 7a3260ab991547578698448eec0c9a1e P 2df5a1658ec74fa2a6e1b737cd0dac7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.553174 22133 tablet_bootstrap.cc:654] T 1c592155a37544428a176145caf18cf9 P 4b7d59dcbbf84f1bb2b2049660a3d342: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.553093 22140 raft_consensus.cc:697] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 1 LEADER]: Becoming Leader. State: Replica: 2df5a1658ec74fa2a6e1b737cd0dac7c, State: Running, Role: LEADER
I20260709 12:08:48.554188 22140 consensus_queue.cc:237] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 2df5a1658ec74fa2a6e1b737cd0dac7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.547477 22132 raft_consensus.cc:359] T 1c592155a37544428a176145caf18cf9 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.557061 22132 raft_consensus.cc:385] T 1c592155a37544428a176145caf18cf9 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.557399 22132 raft_consensus.cc:740] T 1c592155a37544428a176145caf18cf9 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7f4efcc13f42f4ab96addec306cee4, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.558296 22132 consensus_queue.cc:260] T 1c592155a37544428a176145caf18cf9 P 3b7f4efcc13f42f4ab96addec306cee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.560256 22134 ts_tablet_manager.cc:1434] T 7a3260ab991547578698448eec0c9a1e P 2df5a1658ec74fa2a6e1b737cd0dac7c: Time spent starting tablet: real 0.018s	user 0.010s	sys 0.000s
I20260709 12:08:48.560793 22132 ts_tablet_manager.cc:1434] T 1c592155a37544428a176145caf18cf9 P 3b7f4efcc13f42f4ab96addec306cee4: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:08:48.561725 22134 tablet_bootstrap.cc:492] T f45f49951c264158be7f17b17dc18bf7 P 2df5a1658ec74fa2a6e1b737cd0dac7c: Bootstrap starting.
I20260709 12:08:48.562011 22139 raft_consensus.cc:493] T 5b9c4b6520ef4335bed3196d7377bff3 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.562496 22139 raft_consensus.cc:515] T 5b9c4b6520ef4335bed3196d7377bff3 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.564976 22139 leader_election.cc:290] T 5b9c4b6520ef4335bed3196d7377bff3 P 4b7d59dcbbf84f1bb2b2049660a3d342 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129:44261), 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131:44695)
I20260709 12:08:48.565702 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b9c4b6520ef4335bed3196d7377bff3" candidate_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" is_pre_election: true
I20260709 12:08:48.566336 21943 raft_consensus.cc:2468] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b7d59dcbbf84f1bb2b2049660a3d342 in term 0.
I20260709 12:08:48.566589 22092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b9c4b6520ef4335bed3196d7377bff3" candidate_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7f4efcc13f42f4ab96addec306cee4" is_pre_election: true
I20260709 12:08:48.561746 22132 tablet_bootstrap.cc:492] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 3b7f4efcc13f42f4ab96addec306cee4: Bootstrap starting.
I20260709 12:08:48.567552 21984 leader_election.cc:304] T 5b9c4b6520ef4335bed3196d7377bff3 P 4b7d59dcbbf84f1bb2b2049660a3d342 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2df5a1658ec74fa2a6e1b737cd0dac7c, 4b7d59dcbbf84f1bb2b2049660a3d342; no voters: 
W20260709 12:08:48.568095 21981 leader_election.cc:343] T 5b9c4b6520ef4335bed3196d7377bff3 P 4b7d59dcbbf84f1bb2b2049660a3d342 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131:44695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:48.568493 22139 raft_consensus.cc:2804] T 5b9c4b6520ef4335bed3196d7377bff3 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:48.568926 22139 raft_consensus.cc:493] T 5b9c4b6520ef4335bed3196d7377bff3 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:48.569442 22139 raft_consensus.cc:3060] T 5b9c4b6520ef4335bed3196d7377bff3 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.576458 22133 tablet_bootstrap.cc:492] T 1c592155a37544428a176145caf18cf9 P 4b7d59dcbbf84f1bb2b2049660a3d342: No bootstrap required, opened a new log
I20260709 12:08:48.577024 22133 ts_tablet_manager.cc:1403] T 1c592155a37544428a176145caf18cf9 P 4b7d59dcbbf84f1bb2b2049660a3d342: Time spent bootstrapping tablet: real 0.033s	user 0.021s	sys 0.009s
I20260709 12:08:48.580034 22133 raft_consensus.cc:359] T 1c592155a37544428a176145caf18cf9 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.580840 22132 tablet_bootstrap.cc:654] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 3b7f4efcc13f42f4ab96addec306cee4: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.581473 22133 raft_consensus.cc:385] T 1c592155a37544428a176145caf18cf9 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.581830 22133 raft_consensus.cc:740] T 1c592155a37544428a176145caf18cf9 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7d59dcbbf84f1bb2b2049660a3d342, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.580049 21839 catalog_manager.cc:5697] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 2df5a1658ec74fa2a6e1b737cd0dac7c reported cstate change: term changed from 0 to 1, leader changed from <none> to 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129). New cstate: current_term: 1 leader_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.582667 22133 consensus_queue.cc:260] T 1c592155a37544428a176145caf18cf9 P 4b7d59dcbbf84f1bb2b2049660a3d342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.581159 22134 tablet_bootstrap.cc:654] T f45f49951c264158be7f17b17dc18bf7 P 2df5a1658ec74fa2a6e1b737cd0dac7c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.580595 22139 raft_consensus.cc:515] T 5b9c4b6520ef4335bed3196d7377bff3 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.588973 22092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b9c4b6520ef4335bed3196d7377bff3" candidate_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7f4efcc13f42f4ab96addec306cee4"
W20260709 12:08:48.590720 21981 leader_election.cc:343] T 5b9c4b6520ef4335bed3196d7377bff3 P 4b7d59dcbbf84f1bb2b2049660a3d342 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131:44695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:48.591348 22139 leader_election.cc:290] T 5b9c4b6520ef4335bed3196d7377bff3 P 4b7d59dcbbf84f1bb2b2049660a3d342 [CANDIDATE]: Term 1 election: Requested vote from peers 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129:44261), 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131:44695)
I20260709 12:08:48.592650 22133 ts_tablet_manager.cc:1434] T 1c592155a37544428a176145caf18cf9 P 4b7d59dcbbf84f1bb2b2049660a3d342: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.003s
I20260709 12:08:48.597431 22133 tablet_bootstrap.cc:492] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342: Bootstrap starting.
I20260709 12:08:48.600121 22132 tablet_bootstrap.cc:492] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 3b7f4efcc13f42f4ab96addec306cee4: No bootstrap required, opened a new log
I20260709 12:08:48.600713 22132 ts_tablet_manager.cc:1403] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 3b7f4efcc13f42f4ab96addec306cee4: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.005s
I20260709 12:08:48.601269 22140 raft_consensus.cc:493] T 733e3d7ad96747ee94d57562d0fe9143 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.602193 22140 raft_consensus.cc:515] T 733e3d7ad96747ee94d57562d0fe9143 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.603099 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b9c4b6520ef4335bed3196d7377bff3" candidate_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c"
I20260709 12:08:48.603682 21943 raft_consensus.cc:3060] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.604892 22140 leader_election.cc:290] T 733e3d7ad96747ee94d57562d0fe9143 P 2df5a1658ec74fa2a6e1b737cd0dac7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130:40715), 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131:44695)
I20260709 12:08:48.606791 22092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "733e3d7ad96747ee94d57562d0fe9143" candidate_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7f4efcc13f42f4ab96addec306cee4" is_pre_election: true
I20260709 12:08:48.606765 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "733e3d7ad96747ee94d57562d0fe9143" candidate_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" is_pre_election: true
W20260709 12:08:48.609185 21906 leader_election.cc:343] T 733e3d7ad96747ee94d57562d0fe9143 P 2df5a1658ec74fa2a6e1b737cd0dac7c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130:40715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:48.609362 22132 raft_consensus.cc:359] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
W20260709 12:08:48.610001 21906 leader_election.cc:343] T 733e3d7ad96747ee94d57562d0fe9143 P 2df5a1658ec74fa2a6e1b737cd0dac7c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131:44695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:48.610195 22132 raft_consensus.cc:385] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.610474 22132 raft_consensus.cc:740] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7f4efcc13f42f4ab96addec306cee4, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.610433 21906 leader_election.cc:304] T 733e3d7ad96747ee94d57562d0fe9143 P 2df5a1658ec74fa2a6e1b737cd0dac7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df5a1658ec74fa2a6e1b737cd0dac7c; no voters: 3b7f4efcc13f42f4ab96addec306cee4, 4b7d59dcbbf84f1bb2b2049660a3d342
I20260709 12:08:48.611397 22132 consensus_queue.cc:260] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 3b7f4efcc13f42f4ab96addec306cee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.613703 22132 ts_tablet_manager.cc:1434] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 3b7f4efcc13f42f4ab96addec306cee4: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.003s
I20260709 12:08:48.615016 22132 tablet_bootstrap.cc:492] T 5b9c4b6520ef4335bed3196d7377bff3 P 3b7f4efcc13f42f4ab96addec306cee4: Bootstrap starting.
I20260709 12:08:48.615355 22140 raft_consensus.cc:2749] T 733e3d7ad96747ee94d57562d0fe9143 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:48.621768 22132 tablet_bootstrap.cc:654] T 5b9c4b6520ef4335bed3196d7377bff3 P 3b7f4efcc13f42f4ab96addec306cee4: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.623476 21943 raft_consensus.cc:2468] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7d59dcbbf84f1bb2b2049660a3d342 in term 1.
I20260709 12:08:48.624866 21984 leader_election.cc:304] T 5b9c4b6520ef4335bed3196d7377bff3 P 4b7d59dcbbf84f1bb2b2049660a3d342 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2df5a1658ec74fa2a6e1b737cd0dac7c, 4b7d59dcbbf84f1bb2b2049660a3d342; no voters: 3b7f4efcc13f42f4ab96addec306cee4
I20260709 12:08:48.626200 22169 raft_consensus.cc:2804] T 5b9c4b6520ef4335bed3196d7377bff3 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:48.627471 22169 raft_consensus.cc:697] T 5b9c4b6520ef4335bed3196d7377bff3 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 1 LEADER]: Becoming Leader. State: Replica: 4b7d59dcbbf84f1bb2b2049660a3d342, State: Running, Role: LEADER
I20260709 12:08:48.628443 22169 consensus_queue.cc:237] T 5b9c4b6520ef4335bed3196d7377bff3 P 4b7d59dcbbf84f1bb2b2049660a3d342 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.627626 22133 tablet_bootstrap.cc:654] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.630226 22134 tablet_bootstrap.cc:492] T f45f49951c264158be7f17b17dc18bf7 P 2df5a1658ec74fa2a6e1b737cd0dac7c: No bootstrap required, opened a new log
I20260709 12:08:48.630813 22134 ts_tablet_manager.cc:1403] T f45f49951c264158be7f17b17dc18bf7 P 2df5a1658ec74fa2a6e1b737cd0dac7c: Time spent bootstrapping tablet: real 0.069s	user 0.026s	sys 0.024s
I20260709 12:08:48.633387 22134 raft_consensus.cc:359] T f45f49951c264158be7f17b17dc18bf7 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.634152 22134 raft_consensus.cc:385] T f45f49951c264158be7f17b17dc18bf7 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.634538 22134 raft_consensus.cc:740] T f45f49951c264158be7f17b17dc18bf7 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df5a1658ec74fa2a6e1b737cd0dac7c, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.634855 22132 tablet_bootstrap.cc:492] T 5b9c4b6520ef4335bed3196d7377bff3 P 3b7f4efcc13f42f4ab96addec306cee4: No bootstrap required, opened a new log
I20260709 12:08:48.635413 22132 ts_tablet_manager.cc:1403] T 5b9c4b6520ef4335bed3196d7377bff3 P 3b7f4efcc13f42f4ab96addec306cee4: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.004s
I20260709 12:08:48.635573 22134 consensus_queue.cc:260] T f45f49951c264158be7f17b17dc18bf7 P 2df5a1658ec74fa2a6e1b737cd0dac7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.636677 22133 tablet_bootstrap.cc:492] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342: No bootstrap required, opened a new log
I20260709 12:08:48.638085 22133 ts_tablet_manager.cc:1403] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.000s
I20260709 12:08:48.638473 22134 ts_tablet_manager.cc:1434] T f45f49951c264158be7f17b17dc18bf7 P 2df5a1658ec74fa2a6e1b737cd0dac7c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:08:48.638451 22132 raft_consensus.cc:359] T 5b9c4b6520ef4335bed3196d7377bff3 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.639324 22132 raft_consensus.cc:385] T 5b9c4b6520ef4335bed3196d7377bff3 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.639674 22134 tablet_bootstrap.cc:492] T 29408da1bbbe45658dd4f5d47cf5f343 P 2df5a1658ec74fa2a6e1b737cd0dac7c: Bootstrap starting.
I20260709 12:08:48.639670 22132 raft_consensus.cc:740] T 5b9c4b6520ef4335bed3196d7377bff3 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7f4efcc13f42f4ab96addec306cee4, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.640661 22133 raft_consensus.cc:359] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.640740 22132 consensus_queue.cc:260] T 5b9c4b6520ef4335bed3196d7377bff3 P 3b7f4efcc13f42f4ab96addec306cee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.641435 22133 raft_consensus.cc:385] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.641767 22133 raft_consensus.cc:740] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7d59dcbbf84f1bb2b2049660a3d342, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.642539 22133 consensus_queue.cc:260] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.644500 22133 ts_tablet_manager.cc:1434] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:08:48.645234 22132 ts_tablet_manager.cc:1434] T 5b9c4b6520ef4335bed3196d7377bff3 P 3b7f4efcc13f42f4ab96addec306cee4: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:08:48.646311 22132 tablet_bootstrap.cc:492] T 7a3260ab991547578698448eec0c9a1e P 3b7f4efcc13f42f4ab96addec306cee4: Bootstrap starting.
I20260709 12:08:48.645356 22133 tablet_bootstrap.cc:492] T a1aa66b1382a4e29b37da4673524a913 P 4b7d59dcbbf84f1bb2b2049660a3d342: Bootstrap starting.
I20260709 12:08:48.652887 22132 tablet_bootstrap.cc:654] T 7a3260ab991547578698448eec0c9a1e P 3b7f4efcc13f42f4ab96addec306cee4: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.653206 22134 tablet_bootstrap.cc:654] T 29408da1bbbe45658dd4f5d47cf5f343 P 2df5a1658ec74fa2a6e1b737cd0dac7c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.653206 22133 tablet_bootstrap.cc:654] T a1aa66b1382a4e29b37da4673524a913 P 4b7d59dcbbf84f1bb2b2049660a3d342: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.657895 21841 catalog_manager.cc:5697] T 5b9c4b6520ef4335bed3196d7377bff3 P 4b7d59dcbbf84f1bb2b2049660a3d342 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.660779 22134 tablet_bootstrap.cc:492] T 29408da1bbbe45658dd4f5d47cf5f343 P 2df5a1658ec74fa2a6e1b737cd0dac7c: No bootstrap required, opened a new log
I20260709 12:08:48.661305 22134 ts_tablet_manager.cc:1403] T 29408da1bbbe45658dd4f5d47cf5f343 P 2df5a1658ec74fa2a6e1b737cd0dac7c: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.004s
I20260709 12:08:48.660379 22132 tablet_bootstrap.cc:492] T 7a3260ab991547578698448eec0c9a1e P 3b7f4efcc13f42f4ab96addec306cee4: No bootstrap required, opened a new log
I20260709 12:08:48.662065 22132 ts_tablet_manager.cc:1403] T 7a3260ab991547578698448eec0c9a1e P 3b7f4efcc13f42f4ab96addec306cee4: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 12:08:48.663066 22133 tablet_bootstrap.cc:492] T a1aa66b1382a4e29b37da4673524a913 P 4b7d59dcbbf84f1bb2b2049660a3d342: No bootstrap required, opened a new log
I20260709 12:08:48.663542 22133 ts_tablet_manager.cc:1403] T a1aa66b1382a4e29b37da4673524a913 P 4b7d59dcbbf84f1bb2b2049660a3d342: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.003s
I20260709 12:08:48.663839 22134 raft_consensus.cc:359] T 29408da1bbbe45658dd4f5d47cf5f343 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.664445 22132 raft_consensus.cc:359] T 7a3260ab991547578698448eec0c9a1e P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.665074 22132 raft_consensus.cc:385] T 7a3260ab991547578698448eec0c9a1e P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.665333 22132 raft_consensus.cc:740] T 7a3260ab991547578698448eec0c9a1e P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7f4efcc13f42f4ab96addec306cee4, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.665766 22134 raft_consensus.cc:385] T 29408da1bbbe45658dd4f5d47cf5f343 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.666092 22134 raft_consensus.cc:740] T 29408da1bbbe45658dd4f5d47cf5f343 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df5a1658ec74fa2a6e1b737cd0dac7c, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.665999 22132 consensus_queue.cc:260] T 7a3260ab991547578698448eec0c9a1e P 3b7f4efcc13f42f4ab96addec306cee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.666132 22133 raft_consensus.cc:359] T a1aa66b1382a4e29b37da4673524a913 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.666996 22133 raft_consensus.cc:385] T a1aa66b1382a4e29b37da4673524a913 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.667395 22133 raft_consensus.cc:740] T a1aa66b1382a4e29b37da4673524a913 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7d59dcbbf84f1bb2b2049660a3d342, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.667040 22134 consensus_queue.cc:260] T 29408da1bbbe45658dd4f5d47cf5f343 P 2df5a1658ec74fa2a6e1b737cd0dac7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.668052 22132 ts_tablet_manager.cc:1434] T 7a3260ab991547578698448eec0c9a1e P 3b7f4efcc13f42f4ab96addec306cee4: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:08:48.668265 22133 consensus_queue.cc:260] T a1aa66b1382a4e29b37da4673524a913 P 4b7d59dcbbf84f1bb2b2049660a3d342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.668947 22132 tablet_bootstrap.cc:492] T f45f49951c264158be7f17b17dc18bf7 P 3b7f4efcc13f42f4ab96addec306cee4: Bootstrap starting.
I20260709 12:08:48.670732 22133 ts_tablet_manager.cc:1434] T a1aa66b1382a4e29b37da4673524a913 P 4b7d59dcbbf84f1bb2b2049660a3d342: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:08:48.672122 22134 ts_tablet_manager.cc:1434] T 29408da1bbbe45658dd4f5d47cf5f343 P 2df5a1658ec74fa2a6e1b737cd0dac7c: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:08:48.673208 22134 tablet_bootstrap.cc:492] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c: Bootstrap starting.
I20260709 12:08:48.674728 22132 tablet_bootstrap.cc:654] T f45f49951c264158be7f17b17dc18bf7 P 3b7f4efcc13f42f4ab96addec306cee4: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.676842 22169 raft_consensus.cc:493] T 1c592155a37544428a176145caf18cf9 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.677315 22169 raft_consensus.cc:515] T 1c592155a37544428a176145caf18cf9 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.679436 22169 leader_election.cc:290] T 1c592155a37544428a176145caf18cf9 P 4b7d59dcbbf84f1bb2b2049660a3d342 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129:44261), 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131:44695)
I20260709 12:08:48.679526 22134 tablet_bootstrap.cc:654] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.680629 22092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c592155a37544428a176145caf18cf9" candidate_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7f4efcc13f42f4ab96addec306cee4" is_pre_election: true
I20260709 12:08:48.681224 22092 raft_consensus.cc:2468] T 1c592155a37544428a176145caf18cf9 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b7d59dcbbf84f1bb2b2049660a3d342 in term 0.
I20260709 12:08:48.682590 21981 leader_election.cc:304] T 1c592155a37544428a176145caf18cf9 P 4b7d59dcbbf84f1bb2b2049660a3d342 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b7f4efcc13f42f4ab96addec306cee4, 4b7d59dcbbf84f1bb2b2049660a3d342; no voters: 
I20260709 12:08:48.683447 22169 raft_consensus.cc:2804] T 1c592155a37544428a176145caf18cf9 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:48.683861 22169 raft_consensus.cc:493] T 1c592155a37544428a176145caf18cf9 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:48.684258 22169 raft_consensus.cc:3060] T 1c592155a37544428a176145caf18cf9 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.684290 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c592155a37544428a176145caf18cf9" candidate_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" is_pre_election: true
I20260709 12:08:48.685106 21943 raft_consensus.cc:2468] T 1c592155a37544428a176145caf18cf9 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b7d59dcbbf84f1bb2b2049660a3d342 in term 0.
I20260709 12:08:48.687000 22133 tablet_bootstrap.cc:492] T e190f1787d334b69a152e6d9ed4fa6c5 P 4b7d59dcbbf84f1bb2b2049660a3d342: Bootstrap starting.
I20260709 12:08:48.694105 22133 tablet_bootstrap.cc:654] T e190f1787d334b69a152e6d9ed4fa6c5 P 4b7d59dcbbf84f1bb2b2049660a3d342: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.700083 22169 raft_consensus.cc:515] T 1c592155a37544428a176145caf18cf9 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.705961 22134 tablet_bootstrap.cc:492] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c: No bootstrap required, opened a new log
I20260709 12:08:48.706461 22134 ts_tablet_manager.cc:1403] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.003s
I20260709 12:08:48.707126 22132 tablet_bootstrap.cc:492] T f45f49951c264158be7f17b17dc18bf7 P 3b7f4efcc13f42f4ab96addec306cee4: No bootstrap required, opened a new log
I20260709 12:08:48.707615 22132 ts_tablet_manager.cc:1403] T f45f49951c264158be7f17b17dc18bf7 P 3b7f4efcc13f42f4ab96addec306cee4: Time spent bootstrapping tablet: real 0.039s	user 0.016s	sys 0.012s
I20260709 12:08:48.707581 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c592155a37544428a176145caf18cf9" candidate_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c"
I20260709 12:08:48.708290 21943 raft_consensus.cc:3060] T 1c592155a37544428a176145caf18cf9 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.709367 22133 tablet_bootstrap.cc:492] T e190f1787d334b69a152e6d9ed4fa6c5 P 4b7d59dcbbf84f1bb2b2049660a3d342: No bootstrap required, opened a new log
I20260709 12:08:48.709156 22134 raft_consensus.cc:359] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.709760 22133 ts_tablet_manager.cc:1403] T e190f1787d334b69a152e6d9ed4fa6c5 P 4b7d59dcbbf84f1bb2b2049660a3d342: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.000s
I20260709 12:08:48.709790 22134 raft_consensus.cc:385] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.710188 22134 raft_consensus.cc:740] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df5a1658ec74fa2a6e1b737cd0dac7c, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.710223 22132 raft_consensus.cc:359] T f45f49951c264158be7f17b17dc18bf7 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.710948 22132 raft_consensus.cc:385] T f45f49951c264158be7f17b17dc18bf7 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.711531 22132 raft_consensus.cc:740] T f45f49951c264158be7f17b17dc18bf7 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7f4efcc13f42f4ab96addec306cee4, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.712380 22133 raft_consensus.cc:359] T e190f1787d334b69a152e6d9ed4fa6c5 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.712318 22132 consensus_queue.cc:260] T f45f49951c264158be7f17b17dc18bf7 P 3b7f4efcc13f42f4ab96addec306cee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.713299 22133 raft_consensus.cc:385] T e190f1787d334b69a152e6d9ed4fa6c5 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.713393 22092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c592155a37544428a176145caf18cf9" candidate_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7f4efcc13f42f4ab96addec306cee4"
I20260709 12:08:48.713645 22133 raft_consensus.cc:740] T e190f1787d334b69a152e6d9ed4fa6c5 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7d59dcbbf84f1bb2b2049660a3d342, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.713954 22092 raft_consensus.cc:3060] T 1c592155a37544428a176145caf18cf9 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.714633 22133 consensus_queue.cc:260] T e190f1787d334b69a152e6d9ed4fa6c5 P 4b7d59dcbbf84f1bb2b2049660a3d342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.715384 22139 raft_consensus.cc:493] T f45f49951c264158be7f17b17dc18bf7 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.715987 22139 raft_consensus.cc:515] T f45f49951c264158be7f17b17dc18bf7 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.718057 22139 leader_election.cc:290] T f45f49951c264158be7f17b17dc18bf7 P 4b7d59dcbbf84f1bb2b2049660a3d342 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129:44261), 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131:44695)
I20260709 12:08:48.720315 22091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f45f49951c264158be7f17b17dc18bf7" candidate_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7f4efcc13f42f4ab96addec306cee4" is_pre_election: true
I20260709 12:08:48.720808 22092 raft_consensus.cc:2468] T 1c592155a37544428a176145caf18cf9 P 3b7f4efcc13f42f4ab96addec306cee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7d59dcbbf84f1bb2b2049660a3d342 in term 1.
I20260709 12:08:48.720956 22091 raft_consensus.cc:2468] T f45f49951c264158be7f17b17dc18bf7 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b7d59dcbbf84f1bb2b2049660a3d342 in term 0.
I20260709 12:08:48.710974 22134 consensus_queue.cc:260] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.722357 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f45f49951c264158be7f17b17dc18bf7" candidate_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" is_pre_election: true
I20260709 12:08:48.722853 22137 raft_consensus.cc:493] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.722955 21942 raft_consensus.cc:2468] T f45f49951c264158be7f17b17dc18bf7 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b7d59dcbbf84f1bb2b2049660a3d342 in term 0.
I20260709 12:08:48.723347 22137 raft_consensus.cc:515] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.723963 22133 ts_tablet_manager.cc:1434] T e190f1787d334b69a152e6d9ed4fa6c5 P 4b7d59dcbbf84f1bb2b2049660a3d342: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 12:08:48.724581 21981 leader_election.cc:304] T 1c592155a37544428a176145caf18cf9 P 4b7d59dcbbf84f1bb2b2049660a3d342 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b7f4efcc13f42f4ab96addec306cee4, 4b7d59dcbbf84f1bb2b2049660a3d342; no voters: 
I20260709 12:08:48.725455 22137 leader_election.cc:290] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 3b7f4efcc13f42f4ab96addec306cee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129:44261), 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130:40715)
I20260709 12:08:48.725517 21981 leader_election.cc:304] T f45f49951c264158be7f17b17dc18bf7 P 4b7d59dcbbf84f1bb2b2049660a3d342 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b7f4efcc13f42f4ab96addec306cee4, 4b7d59dcbbf84f1bb2b2049660a3d342; no voters: 
I20260709 12:08:48.726047 22180 raft_consensus.cc:2804] T 1c592155a37544428a176145caf18cf9 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:48.727161 22132 ts_tablet_manager.cc:1434] T f45f49951c264158be7f17b17dc18bf7 P 3b7f4efcc13f42f4ab96addec306cee4: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.004s
I20260709 12:08:48.728060 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d8234dd8acb4a8ebc63dc36e6f73c31" candidate_uuid: "3b7f4efcc13f42f4ab96addec306cee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" is_pre_election: true
I20260709 12:08:48.730124 22134 ts_tablet_manager.cc:1434] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 12:08:48.730608 22169 leader_election.cc:290] T 1c592155a37544428a176145caf18cf9 P 4b7d59dcbbf84f1bb2b2049660a3d342 [CANDIDATE]: Term 1 election: Requested vote from peers 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129:44261), 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131:44695)
I20260709 12:08:48.731191 22169 raft_consensus.cc:2804] T f45f49951c264158be7f17b17dc18bf7 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:48.731534 22169 raft_consensus.cc:493] T f45f49951c264158be7f17b17dc18bf7 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:48.731863 22169 raft_consensus.cc:3060] T f45f49951c264158be7f17b17dc18bf7 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.734004 21943 raft_consensus.cc:2468] T 1c592155a37544428a176145caf18cf9 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7d59dcbbf84f1bb2b2049660a3d342 in term 1.
I20260709 12:08:48.736615 22132 tablet_bootstrap.cc:492] T 733e3d7ad96747ee94d57562d0fe9143 P 3b7f4efcc13f42f4ab96addec306cee4: Bootstrap starting.
I20260709 12:08:48.736967 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d8234dd8acb4a8ebc63dc36e6f73c31" candidate_uuid: "3b7f4efcc13f42f4ab96addec306cee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" is_pre_election: true
I20260709 12:08:48.738153 22018 raft_consensus.cc:2393] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b7f4efcc13f42f4ab96addec306cee4 in current term 1: Already voted for candidate 2df5a1658ec74fa2a6e1b737cd0dac7c in this term.
I20260709 12:08:48.739051 22180 raft_consensus.cc:697] T 1c592155a37544428a176145caf18cf9 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 1 LEADER]: Becoming Leader. State: Replica: 4b7d59dcbbf84f1bb2b2049660a3d342, State: Running, Role: LEADER
I20260709 12:08:48.739210 22055 leader_election.cc:304] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 3b7f4efcc13f42f4ab96addec306cee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b7f4efcc13f42f4ab96addec306cee4; no voters: 2df5a1658ec74fa2a6e1b737cd0dac7c, 4b7d59dcbbf84f1bb2b2049660a3d342
I20260709 12:08:48.739699 22134 tablet_bootstrap.cc:492] T e190f1787d334b69a152e6d9ed4fa6c5 P 2df5a1658ec74fa2a6e1b737cd0dac7c: Bootstrap starting.
I20260709 12:08:48.740280 22137 raft_consensus.cc:3060] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.739941 22180 consensus_queue.cc:237] T 1c592155a37544428a176145caf18cf9 P 4b7d59dcbbf84f1bb2b2049660a3d342 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.745777 22134 tablet_bootstrap.cc:654] T e190f1787d334b69a152e6d9ed4fa6c5 P 2df5a1658ec74fa2a6e1b737cd0dac7c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.750126 22137 raft_consensus.cc:2749] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 3b7f4efcc13f42f4ab96addec306cee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:48.750176 22169 raft_consensus.cc:515] T f45f49951c264158be7f17b17dc18bf7 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.753285 22169 leader_election.cc:290] T f45f49951c264158be7f17b17dc18bf7 P 4b7d59dcbbf84f1bb2b2049660a3d342 [CANDIDATE]: Term 1 election: Requested vote from peers 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129:44261), 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131:44695)
I20260709 12:08:48.754428 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f45f49951c264158be7f17b17dc18bf7" candidate_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c"
I20260709 12:08:48.754455 22091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f45f49951c264158be7f17b17dc18bf7" candidate_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7f4efcc13f42f4ab96addec306cee4"
I20260709 12:08:48.755600 22091 raft_consensus.cc:3060] T f45f49951c264158be7f17b17dc18bf7 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.757072 21841 catalog_manager.cc:5697] T 1c592155a37544428a176145caf18cf9 P 4b7d59dcbbf84f1bb2b2049660a3d342 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.759565 22132 tablet_bootstrap.cc:654] T 733e3d7ad96747ee94d57562d0fe9143 P 3b7f4efcc13f42f4ab96addec306cee4: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.762283 22091 raft_consensus.cc:2468] T f45f49951c264158be7f17b17dc18bf7 P 3b7f4efcc13f42f4ab96addec306cee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7d59dcbbf84f1bb2b2049660a3d342 in term 1.
I20260709 12:08:48.763325 21943 raft_consensus.cc:3060] T f45f49951c264158be7f17b17dc18bf7 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.768146 21981 leader_election.cc:304] T f45f49951c264158be7f17b17dc18bf7 P 4b7d59dcbbf84f1bb2b2049660a3d342 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b7f4efcc13f42f4ab96addec306cee4, 4b7d59dcbbf84f1bb2b2049660a3d342; no voters: 
I20260709 12:08:48.768949 22169 raft_consensus.cc:2804] T f45f49951c264158be7f17b17dc18bf7 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:48.769439 22169 raft_consensus.cc:697] T f45f49951c264158be7f17b17dc18bf7 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 1 LEADER]: Becoming Leader. State: Replica: 4b7d59dcbbf84f1bb2b2049660a3d342, State: Running, Role: LEADER
I20260709 12:08:48.770251 22169 consensus_queue.cc:237] T f45f49951c264158be7f17b17dc18bf7 P 4b7d59dcbbf84f1bb2b2049660a3d342 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.771899 21943 raft_consensus.cc:2468] T f45f49951c264158be7f17b17dc18bf7 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7d59dcbbf84f1bb2b2049660a3d342 in term 1.
I20260709 12:08:48.777120 22134 tablet_bootstrap.cc:492] T e190f1787d334b69a152e6d9ed4fa6c5 P 2df5a1658ec74fa2a6e1b737cd0dac7c: No bootstrap required, opened a new log
I20260709 12:08:48.777218 22180 raft_consensus.cc:493] T e190f1787d334b69a152e6d9ed4fa6c5 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.777695 22134 ts_tablet_manager.cc:1403] T e190f1787d334b69a152e6d9ed4fa6c5 P 2df5a1658ec74fa2a6e1b737cd0dac7c: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.023s
I20260709 12:08:48.777745 22180 raft_consensus.cc:515] T e190f1787d334b69a152e6d9ed4fa6c5 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.780104 22180 leader_election.cc:290] T e190f1787d334b69a152e6d9ed4fa6c5 P 4b7d59dcbbf84f1bb2b2049660a3d342 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129:44261), 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131:44695)
I20260709 12:08:48.780793 22134 raft_consensus.cc:359] T e190f1787d334b69a152e6d9ed4fa6c5 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.781306 22132 tablet_bootstrap.cc:492] T 733e3d7ad96747ee94d57562d0fe9143 P 3b7f4efcc13f42f4ab96addec306cee4: No bootstrap required, opened a new log
I20260709 12:08:48.781860 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e190f1787d334b69a152e6d9ed4fa6c5" candidate_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" is_pre_election: true
I20260709 12:08:48.782480 22134 raft_consensus.cc:385] T e190f1787d334b69a152e6d9ed4fa6c5 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.782189 22091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e190f1787d334b69a152e6d9ed4fa6c5" candidate_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7f4efcc13f42f4ab96addec306cee4" is_pre_election: true
I20260709 12:08:48.782161 21841 catalog_manager.cc:5697] T f45f49951c264158be7f17b17dc18bf7 P 4b7d59dcbbf84f1bb2b2049660a3d342 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.782923 22134 raft_consensus.cc:740] T e190f1787d334b69a152e6d9ed4fa6c5 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df5a1658ec74fa2a6e1b737cd0dac7c, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.783238 22091 raft_consensus.cc:2468] T e190f1787d334b69a152e6d9ed4fa6c5 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b7d59dcbbf84f1bb2b2049660a3d342 in term 0.
I20260709 12:08:48.784684 22134 consensus_queue.cc:260] T e190f1787d334b69a152e6d9ed4fa6c5 P 2df5a1658ec74fa2a6e1b737cd0dac7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.783423 22132 ts_tablet_manager.cc:1403] T 733e3d7ad96747ee94d57562d0fe9143 P 3b7f4efcc13f42f4ab96addec306cee4: Time spent bootstrapping tablet: real 0.047s	user 0.017s	sys 0.012s
I20260709 12:08:48.785629 21943 raft_consensus.cc:2468] T e190f1787d334b69a152e6d9ed4fa6c5 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b7d59dcbbf84f1bb2b2049660a3d342 in term 0.
I20260709 12:08:48.788061 21981 leader_election.cc:304] T e190f1787d334b69a152e6d9ed4fa6c5 P 4b7d59dcbbf84f1bb2b2049660a3d342 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b7f4efcc13f42f4ab96addec306cee4, 4b7d59dcbbf84f1bb2b2049660a3d342; no voters: 
I20260709 12:08:48.788442 22132 raft_consensus.cc:359] T 733e3d7ad96747ee94d57562d0fe9143 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.788846 22180 raft_consensus.cc:2804] T e190f1787d334b69a152e6d9ed4fa6c5 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:48.789115 22132 raft_consensus.cc:385] T 733e3d7ad96747ee94d57562d0fe9143 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.789225 22180 raft_consensus.cc:493] T e190f1787d334b69a152e6d9ed4fa6c5 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:48.789422 22132 raft_consensus.cc:740] T 733e3d7ad96747ee94d57562d0fe9143 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7f4efcc13f42f4ab96addec306cee4, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.790515 22180 raft_consensus.cc:3060] T e190f1787d334b69a152e6d9ed4fa6c5 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.790930 22132 consensus_queue.cc:260] T 733e3d7ad96747ee94d57562d0fe9143 P 3b7f4efcc13f42f4ab96addec306cee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.793025 22132 ts_tablet_manager.cc:1434] T 733e3d7ad96747ee94d57562d0fe9143 P 3b7f4efcc13f42f4ab96addec306cee4: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:08:48.790166 22134 ts_tablet_manager.cc:1434] T e190f1787d334b69a152e6d9ed4fa6c5 P 2df5a1658ec74fa2a6e1b737cd0dac7c: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:08:48.797829 22180 raft_consensus.cc:515] T e190f1787d334b69a152e6d9ed4fa6c5 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.799925 22180 leader_election.cc:290] T e190f1787d334b69a152e6d9ed4fa6c5 P 4b7d59dcbbf84f1bb2b2049660a3d342 [CANDIDATE]: Term 1 election: Requested vote from peers 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129:44261), 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131:44695)
I20260709 12:08:48.800853 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e190f1787d334b69a152e6d9ed4fa6c5" candidate_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c"
I20260709 12:08:48.801581 22091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e190f1787d334b69a152e6d9ed4fa6c5" candidate_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7f4efcc13f42f4ab96addec306cee4"
I20260709 12:08:48.802240 22091 raft_consensus.cc:3060] T e190f1787d334b69a152e6d9ed4fa6c5 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.801481 21943 raft_consensus.cc:3060] T e190f1787d334b69a152e6d9ed4fa6c5 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.807819 22091 raft_consensus.cc:2468] T e190f1787d334b69a152e6d9ed4fa6c5 P 3b7f4efcc13f42f4ab96addec306cee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7d59dcbbf84f1bb2b2049660a3d342 in term 1.
I20260709 12:08:48.808696 21981 leader_election.cc:304] T e190f1787d334b69a152e6d9ed4fa6c5 P 4b7d59dcbbf84f1bb2b2049660a3d342 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b7f4efcc13f42f4ab96addec306cee4, 4b7d59dcbbf84f1bb2b2049660a3d342; no voters: 
I20260709 12:08:48.809350 22180 raft_consensus.cc:2804] T e190f1787d334b69a152e6d9ed4fa6c5 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:48.809782 21943 raft_consensus.cc:2468] T e190f1787d334b69a152e6d9ed4fa6c5 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7d59dcbbf84f1bb2b2049660a3d342 in term 1.
I20260709 12:08:48.809759 22180 raft_consensus.cc:697] T e190f1787d334b69a152e6d9ed4fa6c5 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 1 LEADER]: Becoming Leader. State: Replica: 4b7d59dcbbf84f1bb2b2049660a3d342, State: Running, Role: LEADER
I20260709 12:08:48.810783 22180 consensus_queue.cc:237] T e190f1787d334b69a152e6d9ed4fa6c5 P 4b7d59dcbbf84f1bb2b2049660a3d342 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.818668 21841 catalog_manager.cc:5697] T e190f1787d334b69a152e6d9ed4fa6c5 P 4b7d59dcbbf84f1bb2b2049660a3d342 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.823288 22137 raft_consensus.cc:493] T 733e3d7ad96747ee94d57562d0fe9143 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.823727 22137 raft_consensus.cc:515] T 733e3d7ad96747ee94d57562d0fe9143 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.825505 22137 leader_election.cc:290] T 733e3d7ad96747ee94d57562d0fe9143 P 3b7f4efcc13f42f4ab96addec306cee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129:44261), 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130:40715)
I20260709 12:08:48.826190 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "733e3d7ad96747ee94d57562d0fe9143" candidate_uuid: "3b7f4efcc13f42f4ab96addec306cee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" is_pre_election: true
I20260709 12:08:48.826797 21943 raft_consensus.cc:2468] T 733e3d7ad96747ee94d57562d0fe9143 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b7f4efcc13f42f4ab96addec306cee4 in term 0.
I20260709 12:08:48.826797 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "733e3d7ad96747ee94d57562d0fe9143" candidate_uuid: "3b7f4efcc13f42f4ab96addec306cee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" is_pre_election: true
I20260709 12:08:48.827558 22018 raft_consensus.cc:2468] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b7f4efcc13f42f4ab96addec306cee4 in term 0.
I20260709 12:08:48.827877 22058 leader_election.cc:304] T 733e3d7ad96747ee94d57562d0fe9143 P 3b7f4efcc13f42f4ab96addec306cee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2df5a1658ec74fa2a6e1b737cd0dac7c, 3b7f4efcc13f42f4ab96addec306cee4; no voters: 
I20260709 12:08:48.828586 22137 raft_consensus.cc:2804] T 733e3d7ad96747ee94d57562d0fe9143 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:48.828944 22137 raft_consensus.cc:493] T 733e3d7ad96747ee94d57562d0fe9143 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:48.829217 22137 raft_consensus.cc:3060] T 733e3d7ad96747ee94d57562d0fe9143 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.831470 21943 raft_consensus.cc:3060] T 29408da1bbbe45658dd4f5d47cf5f343 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.834966 22137 raft_consensus.cc:515] T 733e3d7ad96747ee94d57562d0fe9143 P 3b7f4efcc13f42f4ab96addec306cee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.837826 22144 consensus_queue.cc:1048] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.838097 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "733e3d7ad96747ee94d57562d0fe9143" candidate_uuid: "3b7f4efcc13f42f4ab96addec306cee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c"
I20260709 12:08:48.838275 22137 leader_election.cc:290] T 733e3d7ad96747ee94d57562d0fe9143 P 3b7f4efcc13f42f4ab96addec306cee4 [CANDIDATE]: Term 1 election: Requested vote from peers 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129:44261), 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130:40715)
I20260709 12:08:48.838678 21942 raft_consensus.cc:3060] T 733e3d7ad96747ee94d57562d0fe9143 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.839152 22137 consensus_queue.cc:1048] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.839411 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "733e3d7ad96747ee94d57562d0fe9143" candidate_uuid: "3b7f4efcc13f42f4ab96addec306cee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342"
I20260709 12:08:48.839939 22018 raft_consensus.cc:3060] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.845973 21942 raft_consensus.cc:2468] T 733e3d7ad96747ee94d57562d0fe9143 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b7f4efcc13f42f4ab96addec306cee4 in term 1.
I20260709 12:08:48.846043 22018 raft_consensus.cc:2468] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b7f4efcc13f42f4ab96addec306cee4 in term 1.
I20260709 12:08:48.847380 22055 leader_election.cc:304] T 733e3d7ad96747ee94d57562d0fe9143 P 3b7f4efcc13f42f4ab96addec306cee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b7f4efcc13f42f4ab96addec306cee4, 4b7d59dcbbf84f1bb2b2049660a3d342; no voters: 
I20260709 12:08:48.848052 22137 raft_consensus.cc:2804] T 733e3d7ad96747ee94d57562d0fe9143 P 3b7f4efcc13f42f4ab96addec306cee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:48.860771 22137 raft_consensus.cc:697] T 733e3d7ad96747ee94d57562d0fe9143 P 3b7f4efcc13f42f4ab96addec306cee4 [term 1 LEADER]: Becoming Leader. State: Replica: 3b7f4efcc13f42f4ab96addec306cee4, State: Running, Role: LEADER
I20260709 12:08:48.861792 22137 consensus_queue.cc:237] T 733e3d7ad96747ee94d57562d0fe9143 P 3b7f4efcc13f42f4ab96addec306cee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.877697 21840 catalog_manager.cc:5697] T 733e3d7ad96747ee94d57562d0fe9143 P 3b7f4efcc13f42f4ab96addec306cee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131). New cstate: current_term: 1 leader_uuid: "3b7f4efcc13f42f4ab96addec306cee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:48.891891 22018 raft_consensus.cc:3060] T fa5860143f19403b948282a6b7cd0009 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.894016 22194 consensus_queue.cc:1048] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:48.895265 22140 raft_consensus.cc:493] T 7a3260ab991547578698448eec0c9a1e P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.895753 22140 raft_consensus.cc:515] T 7a3260ab991547578698448eec0c9a1e P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.898342 22140 leader_election.cc:290] T 7a3260ab991547578698448eec0c9a1e P 2df5a1658ec74fa2a6e1b737cd0dac7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130:40715), 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131:44695)
I20260709 12:08:48.898528 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3260ab991547578698448eec0c9a1e" candidate_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" is_pre_election: true
I20260709 12:08:48.900578 22016 raft_consensus.cc:2468] T 7a3260ab991547578698448eec0c9a1e P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2df5a1658ec74fa2a6e1b737cd0dac7c in term 0.
I20260709 12:08:48.899844 22091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3260ab991547578698448eec0c9a1e" candidate_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7f4efcc13f42f4ab96addec306cee4" is_pre_election: true
I20260709 12:08:48.901965 22091 raft_consensus.cc:2468] T 7a3260ab991547578698448eec0c9a1e P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2df5a1658ec74fa2a6e1b737cd0dac7c in term 0.
I20260709 12:08:48.903419 21906 leader_election.cc:304] T 7a3260ab991547578698448eec0c9a1e P 2df5a1658ec74fa2a6e1b737cd0dac7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2df5a1658ec74fa2a6e1b737cd0dac7c, 3b7f4efcc13f42f4ab96addec306cee4; no voters: 
I20260709 12:08:48.904690 22140 raft_consensus.cc:2804] T 7a3260ab991547578698448eec0c9a1e P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:48.905108 22140 raft_consensus.cc:493] T 7a3260ab991547578698448eec0c9a1e P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:48.905496 22140 raft_consensus.cc:3060] T 7a3260ab991547578698448eec0c9a1e P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.907081 22194 consensus_queue.cc:1048] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:48.912194 22140 raft_consensus.cc:515] T 7a3260ab991547578698448eec0c9a1e P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.916373 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3260ab991547578698448eec0c9a1e" candidate_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342"
I20260709 12:08:48.916568 22091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3260ab991547578698448eec0c9a1e" candidate_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7f4efcc13f42f4ab96addec306cee4"
I20260709 12:08:48.916898 22017 raft_consensus.cc:3060] T 7a3260ab991547578698448eec0c9a1e P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.917219 22091 raft_consensus.cc:3060] T 7a3260ab991547578698448eec0c9a1e P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.922502 22091 raft_consensus.cc:2468] T 7a3260ab991547578698448eec0c9a1e P 3b7f4efcc13f42f4ab96addec306cee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df5a1658ec74fa2a6e1b737cd0dac7c in term 1.
I20260709 12:08:48.923543 21906 leader_election.cc:304] T 7a3260ab991547578698448eec0c9a1e P 2df5a1658ec74fa2a6e1b737cd0dac7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2df5a1658ec74fa2a6e1b737cd0dac7c, 3b7f4efcc13f42f4ab96addec306cee4; no voters: 
I20260709 12:08:48.922962 22140 leader_election.cc:290] T 7a3260ab991547578698448eec0c9a1e P 2df5a1658ec74fa2a6e1b737cd0dac7c [CANDIDATE]: Term 1 election: Requested vote from peers 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130:40715), 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131:44695)
I20260709 12:08:48.924261 22140 raft_consensus.cc:2804] T 7a3260ab991547578698448eec0c9a1e P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:48.924665 22140 raft_consensus.cc:697] T 7a3260ab991547578698448eec0c9a1e P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 1 LEADER]: Becoming Leader. State: Replica: 2df5a1658ec74fa2a6e1b737cd0dac7c, State: Running, Role: LEADER
I20260709 12:08:48.924736 22017 raft_consensus.cc:2468] T 7a3260ab991547578698448eec0c9a1e P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df5a1658ec74fa2a6e1b737cd0dac7c in term 1.
I20260709 12:08:48.925558 22140 consensus_queue.cc:237] T 7a3260ab991547578698448eec0c9a1e P 2df5a1658ec74fa2a6e1b737cd0dac7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:48.933123 21841 catalog_manager.cc:5697] T 7a3260ab991547578698448eec0c9a1e P 2df5a1658ec74fa2a6e1b737cd0dac7c reported cstate change: term changed from 0 to 1, leader changed from <none> to 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129). New cstate: current_term: 1 leader_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:49.059618 22194 raft_consensus.cc:493] T 5b9c4b6520ef4335bed3196d7377bff3 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:49.060163 22194 raft_consensus.cc:515] T 5b9c4b6520ef4335bed3196d7377bff3 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:49.061910 22194 leader_election.cc:290] T 5b9c4b6520ef4335bed3196d7377bff3 P 3b7f4efcc13f42f4ab96addec306cee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129:44261), 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130:40715)
I20260709 12:08:49.062209 22140 raft_consensus.cc:493] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:49.062849 21940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b9c4b6520ef4335bed3196d7377bff3" candidate_uuid: "3b7f4efcc13f42f4ab96addec306cee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" is_pre_election: true
I20260709 12:08:49.062750 22140 raft_consensus.cc:515] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:49.063143 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b9c4b6520ef4335bed3196d7377bff3" candidate_uuid: "3b7f4efcc13f42f4ab96addec306cee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" is_pre_election: true
I20260709 12:08:49.063675 21940 raft_consensus.cc:2393] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b7f4efcc13f42f4ab96addec306cee4 in current term 1: Already voted for candidate 4b7d59dcbbf84f1bb2b2049660a3d342 in this term.
I20260709 12:08:49.064633 22058 leader_election.cc:304] T 5b9c4b6520ef4335bed3196d7377bff3 P 3b7f4efcc13f42f4ab96addec306cee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b7f4efcc13f42f4ab96addec306cee4; no voters: 2df5a1658ec74fa2a6e1b737cd0dac7c, 4b7d59dcbbf84f1bb2b2049660a3d342
I20260709 12:08:49.065399 22194 raft_consensus.cc:3060] T 5b9c4b6520ef4335bed3196d7377bff3 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:49.065588 22140 leader_election.cc:290] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130:40715), 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131:44695)
I20260709 12:08:49.065451 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1aa66b1382a4e29b37da4673524a913" candidate_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" is_pre_election: true
I20260709 12:08:49.066289 22017 raft_consensus.cc:2468] T a1aa66b1382a4e29b37da4673524a913 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2df5a1658ec74fa2a6e1b737cd0dac7c in term 0.
I20260709 12:08:49.066284 22091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1aa66b1382a4e29b37da4673524a913" candidate_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7f4efcc13f42f4ab96addec306cee4" is_pre_election: true
I20260709 12:08:49.067066 22091 raft_consensus.cc:2468] T a1aa66b1382a4e29b37da4673524a913 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2df5a1658ec74fa2a6e1b737cd0dac7c in term 0.
I20260709 12:08:49.067463 21906 leader_election.cc:304] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2df5a1658ec74fa2a6e1b737cd0dac7c, 4b7d59dcbbf84f1bb2b2049660a3d342; no voters: 
I20260709 12:08:49.068177 22140 raft_consensus.cc:2804] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:49.068535 22140 raft_consensus.cc:493] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:49.068873 22140 raft_consensus.cc:3060] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:49.072714 22194 raft_consensus.cc:2749] T 5b9c4b6520ef4335bed3196d7377bff3 P 3b7f4efcc13f42f4ab96addec306cee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:49.075192 22140 raft_consensus.cc:515] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:49.076679 22140 leader_election.cc:290] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c [CANDIDATE]: Term 1 election: Requested vote from peers 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130:40715), 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131:44695)
I20260709 12:08:49.077749 22091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1aa66b1382a4e29b37da4673524a913" candidate_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7f4efcc13f42f4ab96addec306cee4"
I20260709 12:08:49.077669 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1aa66b1382a4e29b37da4673524a913" candidate_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342"
I20260709 12:08:49.078361 22091 raft_consensus.cc:3060] T a1aa66b1382a4e29b37da4673524a913 P 3b7f4efcc13f42f4ab96addec306cee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:49.078445 22017 raft_consensus.cc:3060] T a1aa66b1382a4e29b37da4673524a913 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:49.082718 22091 raft_consensus.cc:2468] T a1aa66b1382a4e29b37da4673524a913 P 3b7f4efcc13f42f4ab96addec306cee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df5a1658ec74fa2a6e1b737cd0dac7c in term 1.
I20260709 12:08:49.082738 22017 raft_consensus.cc:2468] T a1aa66b1382a4e29b37da4673524a913 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df5a1658ec74fa2a6e1b737cd0dac7c in term 1.
I20260709 12:08:49.083930 21906 leader_election.cc:304] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2df5a1658ec74fa2a6e1b737cd0dac7c, 3b7f4efcc13f42f4ab96addec306cee4; no voters: 
I20260709 12:08:49.084535 22140 raft_consensus.cc:2804] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:49.084920 22140 raft_consensus.cc:697] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 1 LEADER]: Becoming Leader. State: Replica: 2df5a1658ec74fa2a6e1b737cd0dac7c, State: Running, Role: LEADER
I20260709 12:08:49.085672 22140 consensus_queue.cc:237] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:49.091869 21841 catalog_manager.cc:5697] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c reported cstate change: term changed from 0 to 1, leader changed from <none> to 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129). New cstate: current_term: 1 leader_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:49.116848 22140 consensus_queue.cc:1048] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 2df5a1658ec74fa2a6e1b737cd0dac7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:49.116693 22180 consensus_queue.cc:1048] T 5b9c4b6520ef4335bed3196d7377bff3 P 4b7d59dcbbf84f1bb2b2049660a3d342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:49.125384 22169 consensus_queue.cc:1048] T 5b9c4b6520ef4335bed3196d7377bff3 P 4b7d59dcbbf84f1bb2b2049660a3d342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:49.137586 22140 consensus_queue.cc:1048] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 2df5a1658ec74fa2a6e1b737cd0dac7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:49.188481 22092 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "29408da1bbbe45658dd4f5d47cf5f343"
dest_uuid: "3b7f4efcc13f42f4ab96addec306cee4"
mode: GRACEFUL
new_leader_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c"
 from {username='slave'} at 127.0.0.1:56342
I20260709 12:08:49.189175 22092 raft_consensus.cc:606] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4 [term 1 LEADER]: Received request to transfer leadership to TS 2df5a1658ec74fa2a6e1b737cd0dac7c
I20260709 12:08:49.194391 22092 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa5860143f19403b948282a6b7cd0009"
dest_uuid: "3b7f4efcc13f42f4ab96addec306cee4"
mode: GRACEFUL
new_leader_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c"
 from {username='slave'} at 127.0.0.1:56342
I20260709 12:08:49.195140 22092 raft_consensus.cc:606] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [term 1 LEADER]: Received request to transfer leadership to TS 2df5a1658ec74fa2a6e1b737cd0dac7c
I20260709 12:08:49.214401 22017 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b9c4b6520ef4335bed3196d7377bff3"
dest_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342"
mode: GRACEFUL
new_leader_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c"
 from {username='slave'} at 127.0.0.1:59948
I20260709 12:08:49.215045 22017 raft_consensus.cc:606] T 5b9c4b6520ef4335bed3196d7377bff3 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 1 LEADER]: Received request to transfer leadership to TS 2df5a1658ec74fa2a6e1b737cd0dac7c
I20260709 12:08:49.227602 21940 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1aa66b1382a4e29b37da4673524a913"
dest_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c"
mode: GRACEFUL
new_leader_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342"
 from {username='slave'} at 127.0.0.1:47974
I20260709 12:08:49.228124 21940 raft_consensus.cc:606] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 1 LEADER]: Received request to transfer leadership to TS 4b7d59dcbbf84f1bb2b2049660a3d342
I20260709 12:08:49.233685 22092 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "733e3d7ad96747ee94d57562d0fe9143"
dest_uuid: "3b7f4efcc13f42f4ab96addec306cee4"
mode: GRACEFUL
new_leader_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342"
 from {username='slave'} at 127.0.0.1:56342
I20260709 12:08:49.234171 22092 raft_consensus.cc:606] T 733e3d7ad96747ee94d57562d0fe9143 P 3b7f4efcc13f42f4ab96addec306cee4 [term 1 LEADER]: Received request to transfer leadership to TS 4b7d59dcbbf84f1bb2b2049660a3d342
I20260709 12:08:49.234788 22180 consensus_queue.cc:1048] T e190f1787d334b69a152e6d9ed4fa6c5 P 4b7d59dcbbf84f1bb2b2049660a3d342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:49.246709 22017 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f45f49951c264158be7f17b17dc18bf7"
dest_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342"
mode: GRACEFUL
new_leader_uuid: "3b7f4efcc13f42f4ab96addec306cee4"
 from {username='slave'} at 127.0.0.1:59948
I20260709 12:08:49.247310 22017 raft_consensus.cc:606] T f45f49951c264158be7f17b17dc18bf7 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 1 LEADER]: Received request to transfer leadership to TS 3b7f4efcc13f42f4ab96addec306cee4
I20260709 12:08:49.249078 22181 consensus_queue.cc:1048] T e190f1787d334b69a152e6d9ed4fa6c5 P 4b7d59dcbbf84f1bb2b2049660a3d342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:49.256892 22192 raft_consensus.cc:993] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4: : Instructing follower 2df5a1658ec74fa2a6e1b737cd0dac7c to start an election
I20260709 12:08:49.256803 22191 consensus_queue.cc:1048] T 733e3d7ad96747ee94d57562d0fe9143 P 3b7f4efcc13f42f4ab96addec306cee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:49.257351 22192 raft_consensus.cc:1081] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4 [term 1 LEADER]: Signalling peer 2df5a1658ec74fa2a6e1b737cd0dac7c to start an election
I20260709 12:08:49.258937 21940 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "29408da1bbbe45658dd4f5d47cf5f343"
dest_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c"
 from {username='slave'} at 127.0.0.1:47946
I20260709 12:08:49.259624 21940 raft_consensus.cc:493] T 29408da1bbbe45658dd4f5d47cf5f343 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:49.260058 21940 raft_consensus.cc:3060] T 29408da1bbbe45658dd4f5d47cf5f343 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.265421 22191 raft_consensus.cc:993] T 733e3d7ad96747ee94d57562d0fe9143 P 3b7f4efcc13f42f4ab96addec306cee4: : Instructing follower 4b7d59dcbbf84f1bb2b2049660a3d342 to start an election
I20260709 12:08:49.266016 22190 raft_consensus.cc:1081] T 733e3d7ad96747ee94d57562d0fe9143 P 3b7f4efcc13f42f4ab96addec306cee4 [term 1 LEADER]: Signalling peer 4b7d59dcbbf84f1bb2b2049660a3d342 to start an election
I20260709 12:08:49.268127 22018 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "733e3d7ad96747ee94d57562d0fe9143"
dest_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342"
 from {username='slave'} at 127.0.0.1:59926
I20260709 12:08:49.268651 22018 raft_consensus.cc:493] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:49.268955 22018 raft_consensus.cc:3060] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.272836 22191 consensus_queue.cc:1048] T 733e3d7ad96747ee94d57562d0fe9143 P 3b7f4efcc13f42f4ab96addec306cee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:49.272962 22181 consensus_queue.cc:1048] T 1c592155a37544428a176145caf18cf9 P 4b7d59dcbbf84f1bb2b2049660a3d342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:49.276654 22018 raft_consensus.cc:515] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:49.280067 22092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "733e3d7ad96747ee94d57562d0fe9143" candidate_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3b7f4efcc13f42f4ab96addec306cee4"
I20260709 12:08:49.280761 22092 raft_consensus.cc:3055] T 733e3d7ad96747ee94d57562d0fe9143 P 3b7f4efcc13f42f4ab96addec306cee4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:49.281160 22092 raft_consensus.cc:740] T 733e3d7ad96747ee94d57562d0fe9143 P 3b7f4efcc13f42f4ab96addec306cee4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3b7f4efcc13f42f4ab96addec306cee4, State: Running, Role: LEADER
I20260709 12:08:49.282339 22092 consensus_queue.cc:260] T 733e3d7ad96747ee94d57562d0fe9143 P 3b7f4efcc13f42f4ab96addec306cee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:49.283577 22092 raft_consensus.cc:3060] T 733e3d7ad96747ee94d57562d0fe9143 P 3b7f4efcc13f42f4ab96addec306cee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.284897 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "733e3d7ad96747ee94d57562d0fe9143" candidate_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c"
I20260709 12:08:49.286803 22181 consensus_queue.cc:1048] T 1c592155a37544428a176145caf18cf9 P 4b7d59dcbbf84f1bb2b2049660a3d342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:08:49.289430 22190 consensus_queue.cc:1175] T 733e3d7ad96747ee94d57562d0fe9143 P 3b7f4efcc13f42f4ab96addec306cee4 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 12:08:49.290685 22018 leader_election.cc:290] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342 [CANDIDATE]: Term 2 election: Requested vote from peers 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129:44261), 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131:44695)
I20260709 12:08:49.295428 21940 raft_consensus.cc:515] T 29408da1bbbe45658dd4f5d47cf5f343 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:49.297312 22092 raft_consensus.cc:2468] T 733e3d7ad96747ee94d57562d0fe9143 P 3b7f4efcc13f42f4ab96addec306cee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7d59dcbbf84f1bb2b2049660a3d342 in term 2.
I20260709 12:08:49.298959 21981 leader_election.cc:304] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b7f4efcc13f42f4ab96addec306cee4, 4b7d59dcbbf84f1bb2b2049660a3d342; no voters: 2df5a1658ec74fa2a6e1b737cd0dac7c
I20260709 12:08:49.299858 22181 raft_consensus.cc:2804] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:49.300338 22181 raft_consensus.cc:697] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 2 LEADER]: Becoming Leader. State: Replica: 4b7d59dcbbf84f1bb2b2049660a3d342, State: Running, Role: LEADER
I20260709 12:08:49.301136 22181 consensus_queue.cc:237] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:49.303285 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29408da1bbbe45658dd4f5d47cf5f343" candidate_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342"
I20260709 12:08:49.304800 21940 leader_election.cc:290] T 29408da1bbbe45658dd4f5d47cf5f343 P 2df5a1658ec74fa2a6e1b737cd0dac7c [CANDIDATE]: Term 2 election: Requested vote from peers 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130:40715), 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131:44695)
I20260709 12:08:49.306252 22092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29408da1bbbe45658dd4f5d47cf5f343" candidate_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3b7f4efcc13f42f4ab96addec306cee4"
I20260709 12:08:49.306857 22092 raft_consensus.cc:3055] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:49.307206 22092 raft_consensus.cc:740] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3b7f4efcc13f42f4ab96addec306cee4, State: Running, Role: LEADER
I20260709 12:08:49.308199 22092 consensus_queue.cc:260] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:49.309736 22092 raft_consensus.cc:3060] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.313943 21837 catalog_manager.cc:5697] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342 reported cstate change: term changed from 1 to 2, leader changed from 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131) to 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130). New cstate: current_term: 2 leader_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:49.316190 22092 raft_consensus.cc:2468] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df5a1658ec74fa2a6e1b737cd0dac7c in term 2.
I20260709 12:08:49.317348 21906 leader_election.cc:304] T 29408da1bbbe45658dd4f5d47cf5f343 P 2df5a1658ec74fa2a6e1b737cd0dac7c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2df5a1658ec74fa2a6e1b737cd0dac7c, 3b7f4efcc13f42f4ab96addec306cee4; no voters: 
I20260709 12:08:49.318161 22140 raft_consensus.cc:2804] T 29408da1bbbe45658dd4f5d47cf5f343 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:49.318617 22140 raft_consensus.cc:697] T 29408da1bbbe45658dd4f5d47cf5f343 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 2 LEADER]: Becoming Leader. State: Replica: 2df5a1658ec74fa2a6e1b737cd0dac7c, State: Running, Role: LEADER
I20260709 12:08:49.303989 22018 raft_consensus.cc:3060] T 29408da1bbbe45658dd4f5d47cf5f343 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.319437 22140 consensus_queue.cc:237] T 29408da1bbbe45658dd4f5d47cf5f343 P 2df5a1658ec74fa2a6e1b737cd0dac7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:49.332688 22018 raft_consensus.cc:2468] T 29408da1bbbe45658dd4f5d47cf5f343 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df5a1658ec74fa2a6e1b737cd0dac7c in term 2.
I20260709 12:08:49.343884 22181 consensus_queue.cc:1048] T f45f49951c264158be7f17b17dc18bf7 P 4b7d59dcbbf84f1bb2b2049660a3d342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:49.343878 21840 catalog_manager.cc:5697] T 29408da1bbbe45658dd4f5d47cf5f343 P 2df5a1658ec74fa2a6e1b737cd0dac7c reported cstate change: term changed from 1 to 2, leader changed from 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131) to 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129). New cstate: current_term: 2 leader_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:49.350656 22182 raft_consensus.cc:993] T f45f49951c264158be7f17b17dc18bf7 P 4b7d59dcbbf84f1bb2b2049660a3d342: : Instructing follower 3b7f4efcc13f42f4ab96addec306cee4 to start an election
I20260709 12:08:49.351169 22180 raft_consensus.cc:1081] T f45f49951c264158be7f17b17dc18bf7 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 1 LEADER]: Signalling peer 3b7f4efcc13f42f4ab96addec306cee4 to start an election
I20260709 12:08:49.355509 22092 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f45f49951c264158be7f17b17dc18bf7"
dest_uuid: "3b7f4efcc13f42f4ab96addec306cee4"
 from {username='slave'} at 127.0.0.1:56324
I20260709 12:08:49.356609 22092 raft_consensus.cc:493] T f45f49951c264158be7f17b17dc18bf7 P 3b7f4efcc13f42f4ab96addec306cee4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:49.356977 22092 raft_consensus.cc:3060] T f45f49951c264158be7f17b17dc18bf7 P 3b7f4efcc13f42f4ab96addec306cee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.358566 22180 consensus_queue.cc:1048] T f45f49951c264158be7f17b17dc18bf7 P 4b7d59dcbbf84f1bb2b2049660a3d342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:49.363787 22092 raft_consensus.cc:515] T f45f49951c264158be7f17b17dc18bf7 P 3b7f4efcc13f42f4ab96addec306cee4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:49.368710 22092 leader_election.cc:290] T f45f49951c264158be7f17b17dc18bf7 P 3b7f4efcc13f42f4ab96addec306cee4 [CANDIDATE]: Term 2 election: Requested vote from peers 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129:44261), 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130:40715)
I20260709 12:08:49.368778 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f45f49951c264158be7f17b17dc18bf7" candidate_uuid: "3b7f4efcc13f42f4ab96addec306cee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c"
I20260709 12:08:49.368899 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f45f49951c264158be7f17b17dc18bf7" candidate_uuid: "3b7f4efcc13f42f4ab96addec306cee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342"
I20260709 12:08:49.369488 21943 raft_consensus.cc:3060] T f45f49951c264158be7f17b17dc18bf7 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.369539 22018 raft_consensus.cc:3055] T f45f49951c264158be7f17b17dc18bf7 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:49.369974 22018 raft_consensus.cc:740] T f45f49951c264158be7f17b17dc18bf7 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b7d59dcbbf84f1bb2b2049660a3d342, State: Running, Role: LEADER
I20260709 12:08:49.370662 22018 consensus_queue.cc:260] T f45f49951c264158be7f17b17dc18bf7 P 4b7d59dcbbf84f1bb2b2049660a3d342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:49.371836 22018 raft_consensus.cc:3060] T f45f49951c264158be7f17b17dc18bf7 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.376317 22018 raft_consensus.cc:2468] T f45f49951c264158be7f17b17dc18bf7 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b7f4efcc13f42f4ab96addec306cee4 in term 2.
I20260709 12:08:49.377508 22055 leader_election.cc:304] T f45f49951c264158be7f17b17dc18bf7 P 3b7f4efcc13f42f4ab96addec306cee4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b7f4efcc13f42f4ab96addec306cee4, 4b7d59dcbbf84f1bb2b2049660a3d342; no voters: 
I20260709 12:08:49.378328 22190 raft_consensus.cc:2804] T f45f49951c264158be7f17b17dc18bf7 P 3b7f4efcc13f42f4ab96addec306cee4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:49.378857 22190 raft_consensus.cc:697] T f45f49951c264158be7f17b17dc18bf7 P 3b7f4efcc13f42f4ab96addec306cee4 [term 2 LEADER]: Becoming Leader. State: Replica: 3b7f4efcc13f42f4ab96addec306cee4, State: Running, Role: LEADER
I20260709 12:08:49.379755 22190 consensus_queue.cc:237] T f45f49951c264158be7f17b17dc18bf7 P 3b7f4efcc13f42f4ab96addec306cee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:49.380820 21943 raft_consensus.cc:2468] T f45f49951c264158be7f17b17dc18bf7 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b7f4efcc13f42f4ab96addec306cee4 in term 2.
I20260709 12:08:49.387537 21841 catalog_manager.cc:5697] T f45f49951c264158be7f17b17dc18bf7 P 3b7f4efcc13f42f4ab96addec306cee4 reported cstate change: term changed from 1 to 2, leader changed from 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130) to 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131). New cstate: current_term: 2 leader_uuid: "3b7f4efcc13f42f4ab96addec306cee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:49.436538 22191 raft_consensus.cc:993] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4: : Instructing follower 2df5a1658ec74fa2a6e1b737cd0dac7c to start an election
I20260709 12:08:49.437019 22190 raft_consensus.cc:1081] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [term 1 LEADER]: Signalling peer 2df5a1658ec74fa2a6e1b737cd0dac7c to start an election
I20260709 12:08:49.438517 21943 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa5860143f19403b948282a6b7cd0009"
dest_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c"
 from {username='slave'} at 127.0.0.1:47946
I20260709 12:08:49.438930 21943 raft_consensus.cc:493] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:49.439275 21943 raft_consensus.cc:3060] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.443842 21943 raft_consensus.cc:515] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:49.445448 21943 leader_election.cc:290] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c [CANDIDATE]: Term 2 election: Requested vote from peers 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130:40715), 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131:44695)
I20260709 12:08:49.446384 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5860143f19403b948282a6b7cd0009" candidate_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342"
I20260709 12:08:49.446758 22092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5860143f19403b948282a6b7cd0009" candidate_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3b7f4efcc13f42f4ab96addec306cee4"
I20260709 12:08:49.446849 22018 raft_consensus.cc:3060] T fa5860143f19403b948282a6b7cd0009 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.447364 22092 raft_consensus.cc:3055] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:49.447707 22092 raft_consensus.cc:740] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3b7f4efcc13f42f4ab96addec306cee4, State: Running, Role: LEADER
I20260709 12:08:49.448352 22092 consensus_queue.cc:260] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:49.450310 22092 raft_consensus.cc:3060] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.452121 22018 raft_consensus.cc:2468] T fa5860143f19403b948282a6b7cd0009 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df5a1658ec74fa2a6e1b737cd0dac7c in term 2.
I20260709 12:08:49.453200 21906 leader_election.cc:304] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2df5a1658ec74fa2a6e1b737cd0dac7c, 4b7d59dcbbf84f1bb2b2049660a3d342; no voters: 
I20260709 12:08:49.454182 22140 raft_consensus.cc:2804] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:49.454692 22140 raft_consensus.cc:697] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 2 LEADER]: Becoming Leader. State: Replica: 2df5a1658ec74fa2a6e1b737cd0dac7c, State: Running, Role: LEADER
I20260709 12:08:49.455430 22140 consensus_queue.cc:237] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:49.456301 22092 raft_consensus.cc:2468] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df5a1658ec74fa2a6e1b737cd0dac7c in term 2.
I20260709 12:08:49.461751 21841 catalog_manager.cc:5697] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c reported cstate change: term changed from 1 to 2, leader changed from 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131) to 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129). New cstate: current_term: 2 leader_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:49.500212 22140 consensus_queue.cc:1048] T 7a3260ab991547578698448eec0c9a1e P 2df5a1658ec74fa2a6e1b737cd0dac7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:49.512316 22140 consensus_queue.cc:1048] T 7a3260ab991547578698448eec0c9a1e P 2df5a1658ec74fa2a6e1b737cd0dac7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:49.569456 22140 consensus_queue.cc:1048] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:49.576248 22206 raft_consensus.cc:993] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c: : Instructing follower 4b7d59dcbbf84f1bb2b2049660a3d342 to start an election
I20260709 12:08:49.576699 22165 raft_consensus.cc:1081] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 1 LEADER]: Signalling peer 4b7d59dcbbf84f1bb2b2049660a3d342 to start an election
I20260709 12:08:49.579846 22018 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a1aa66b1382a4e29b37da4673524a913"
dest_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342"
 from {username='slave'} at 127.0.0.1:59938
I20260709 12:08:49.580369 22018 raft_consensus.cc:493] T a1aa66b1382a4e29b37da4673524a913 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:49.580734 22018 raft_consensus.cc:3060] T a1aa66b1382a4e29b37da4673524a913 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.581842 22140 consensus_queue.cc:1048] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:49.587091 22018 raft_consensus.cc:515] T a1aa66b1382a4e29b37da4673524a913 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:49.590934 22018 leader_election.cc:290] T a1aa66b1382a4e29b37da4673524a913 P 4b7d59dcbbf84f1bb2b2049660a3d342 [CANDIDATE]: Term 2 election: Requested vote from peers 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129:44261), 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131:44695)
I20260709 12:08:49.591699 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1aa66b1382a4e29b37da4673524a913" candidate_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c"
I20260709 12:08:49.592296 21943 raft_consensus.cc:3055] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:49.592618 21943 raft_consensus.cc:740] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2df5a1658ec74fa2a6e1b737cd0dac7c, State: Running, Role: LEADER
I20260709 12:08:49.593359 21943 consensus_queue.cc:260] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:49.594491 21943 raft_consensus.cc:3060] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.595257 22092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1aa66b1382a4e29b37da4673524a913" candidate_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3b7f4efcc13f42f4ab96addec306cee4"
I20260709 12:08:49.595871 22092 raft_consensus.cc:3060] T a1aa66b1382a4e29b37da4673524a913 P 3b7f4efcc13f42f4ab96addec306cee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.601899 22181 raft_consensus.cc:993] T 5b9c4b6520ef4335bed3196d7377bff3 P 4b7d59dcbbf84f1bb2b2049660a3d342: : Instructing follower 2df5a1658ec74fa2a6e1b737cd0dac7c to start an election
I20260709 12:08:49.602345 22181 raft_consensus.cc:1081] T 5b9c4b6520ef4335bed3196d7377bff3 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 1 LEADER]: Signalling peer 2df5a1658ec74fa2a6e1b737cd0dac7c to start an election
I20260709 12:08:49.604215 21940 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b9c4b6520ef4335bed3196d7377bff3"
dest_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c"
 from {username='slave'} at 127.0.0.1:47960
I20260709 12:08:49.604667 21940 raft_consensus.cc:493] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:49.604974 21940 raft_consensus.cc:3060] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.607362 22092 raft_consensus.cc:2468] T a1aa66b1382a4e29b37da4673524a913 P 3b7f4efcc13f42f4ab96addec306cee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7d59dcbbf84f1bb2b2049660a3d342 in term 2.
I20260709 12:08:49.608417 21981 leader_election.cc:304] T a1aa66b1382a4e29b37da4673524a913 P 4b7d59dcbbf84f1bb2b2049660a3d342 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b7f4efcc13f42f4ab96addec306cee4, 4b7d59dcbbf84f1bb2b2049660a3d342; no voters: 
I20260709 12:08:49.609143 22180 raft_consensus.cc:2804] T a1aa66b1382a4e29b37da4673524a913 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:49.609614 22180 raft_consensus.cc:697] T a1aa66b1382a4e29b37da4673524a913 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 2 LEADER]: Becoming Leader. State: Replica: 4b7d59dcbbf84f1bb2b2049660a3d342, State: Running, Role: LEADER
I20260709 12:08:49.609869 21943 raft_consensus.cc:2468] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7d59dcbbf84f1bb2b2049660a3d342 in term 2.
I20260709 12:08:49.610146 21940 raft_consensus.cc:515] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:49.610515 22180 consensus_queue.cc:237] T a1aa66b1382a4e29b37da4673524a913 P 4b7d59dcbbf84f1bb2b2049660a3d342 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:49.612250 21940 leader_election.cc:290] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c [CANDIDATE]: Term 2 election: Requested vote from peers 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130:40715), 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131:44695)
I20260709 12:08:49.613142 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b9c4b6520ef4335bed3196d7377bff3" candidate_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342"
I20260709 12:08:49.613693 22018 raft_consensus.cc:3055] T 5b9c4b6520ef4335bed3196d7377bff3 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:49.614022 22018 raft_consensus.cc:740] T 5b9c4b6520ef4335bed3196d7377bff3 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b7d59dcbbf84f1bb2b2049660a3d342, State: Running, Role: LEADER
I20260709 12:08:49.614715 22018 consensus_queue.cc:260] T 5b9c4b6520ef4335bed3196d7377bff3 P 4b7d59dcbbf84f1bb2b2049660a3d342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:49.615182 22092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b9c4b6520ef4335bed3196d7377bff3" candidate_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3b7f4efcc13f42f4ab96addec306cee4"
I20260709 12:08:49.615732 22092 raft_consensus.cc:3060] T 5b9c4b6520ef4335bed3196d7377bff3 P 3b7f4efcc13f42f4ab96addec306cee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.615859 22018 raft_consensus.cc:3060] T 5b9c4b6520ef4335bed3196d7377bff3 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.617735 21841 catalog_manager.cc:5697] T a1aa66b1382a4e29b37da4673524a913 P 4b7d59dcbbf84f1bb2b2049660a3d342 reported cstate change: term changed from 1 to 2, leader changed from 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129) to 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130). New cstate: current_term: 2 leader_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:49.622356 22092 raft_consensus.cc:2468] T 5b9c4b6520ef4335bed3196d7377bff3 P 3b7f4efcc13f42f4ab96addec306cee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df5a1658ec74fa2a6e1b737cd0dac7c in term 2.
I20260709 12:08:49.622356 22018 raft_consensus.cc:2468] T 5b9c4b6520ef4335bed3196d7377bff3 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df5a1658ec74fa2a6e1b737cd0dac7c in term 2.
I20260709 12:08:49.623667 21906 leader_election.cc:304] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2df5a1658ec74fa2a6e1b737cd0dac7c, 3b7f4efcc13f42f4ab96addec306cee4; no voters: 
I20260709 12:08:49.624361 22140 raft_consensus.cc:2804] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:49.624878 22140 raft_consensus.cc:697] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 2 LEADER]: Becoming Leader. State: Replica: 2df5a1658ec74fa2a6e1b737cd0dac7c, State: Running, Role: LEADER
I20260709 12:08:49.625712 22140 consensus_queue.cc:237] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:49.632239 21841 catalog_manager.cc:5697] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c reported cstate change: term changed from 1 to 2, leader changed from 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130) to 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129). New cstate: current_term: 2 leader_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:49.720228 21940 raft_consensus.cc:3060] T 733e3d7ad96747ee94d57562d0fe9143 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.724851 21940 raft_consensus.cc:1275] T 733e3d7ad96747ee94d57562d0fe9143 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 2 FOLLOWER]: Refusing update from remote peer 4b7d59dcbbf84f1bb2b2049660a3d342: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.725996 22180 consensus_queue.cc:1048] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.733609 22092 raft_consensus.cc:1275] T 733e3d7ad96747ee94d57562d0fe9143 P 3b7f4efcc13f42f4ab96addec306cee4 [term 2 FOLLOWER]: Refusing update from remote peer 4b7d59dcbbf84f1bb2b2049660a3d342: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.734826 22182 consensus_queue.cc:1048] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.768308 22018 raft_consensus.cc:1275] T f45f49951c264158be7f17b17dc18bf7 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 2 FOLLOWER]: Refusing update from remote peer 3b7f4efcc13f42f4ab96addec306cee4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.769624 22190 consensus_queue.cc:1048] T f45f49951c264158be7f17b17dc18bf7 P 3b7f4efcc13f42f4ab96addec306cee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.777114 21940 raft_consensus.cc:1275] T f45f49951c264158be7f17b17dc18bf7 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 2 FOLLOWER]: Refusing update from remote peer 3b7f4efcc13f42f4ab96addec306cee4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.778568 22190 consensus_queue.cc:1048] T f45f49951c264158be7f17b17dc18bf7 P 3b7f4efcc13f42f4ab96addec306cee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.869341 22018 raft_consensus.cc:1275] T 29408da1bbbe45658dd4f5d47cf5f343 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 2 FOLLOWER]: Refusing update from remote peer 2df5a1658ec74fa2a6e1b737cd0dac7c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.870718 22140 consensus_queue.cc:1048] T 29408da1bbbe45658dd4f5d47cf5f343 P 2df5a1658ec74fa2a6e1b737cd0dac7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.878911 22092 raft_consensus.cc:1275] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4 [term 2 FOLLOWER]: Refusing update from remote peer 2df5a1658ec74fa2a6e1b737cd0dac7c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.881034 22165 consensus_queue.cc:1048] T 29408da1bbbe45658dd4f5d47cf5f343 P 2df5a1658ec74fa2a6e1b737cd0dac7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:50.013093 22092 raft_consensus.cc:1275] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [term 2 FOLLOWER]: Refusing update from remote peer 2df5a1658ec74fa2a6e1b737cd0dac7c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:50.014318 22165 consensus_queue.cc:1048] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:50.021893 22018 raft_consensus.cc:1275] T fa5860143f19403b948282a6b7cd0009 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 2 FOLLOWER]: Refusing update from remote peer 2df5a1658ec74fa2a6e1b737cd0dac7c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:50.023682 22165 consensus_queue.cc:1048] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:50.024296 22092 raft_consensus.cc:1275] T a1aa66b1382a4e29b37da4673524a913 P 3b7f4efcc13f42f4ab96addec306cee4 [term 2 FOLLOWER]: Refusing update from remote peer 4b7d59dcbbf84f1bb2b2049660a3d342: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:50.027503 22182 consensus_queue.cc:1048] T a1aa66b1382a4e29b37da4673524a913 P 4b7d59dcbbf84f1bb2b2049660a3d342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:50.036405 21940 raft_consensus.cc:1275] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 2 FOLLOWER]: Refusing update from remote peer 4b7d59dcbbf84f1bb2b2049660a3d342: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:50.037945 22181 consensus_queue.cc:1048] T a1aa66b1382a4e29b37da4673524a913 P 4b7d59dcbbf84f1bb2b2049660a3d342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:50.075160 22092 raft_consensus.cc:1275] T 5b9c4b6520ef4335bed3196d7377bff3 P 3b7f4efcc13f42f4ab96addec306cee4 [term 2 FOLLOWER]: Refusing update from remote peer 2df5a1658ec74fa2a6e1b737cd0dac7c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:50.076541 22165 consensus_queue.cc:1048] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:50.084785 22018 raft_consensus.cc:1275] T 5b9c4b6520ef4335bed3196d7377bff3 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 2 FOLLOWER]: Refusing update from remote peer 2df5a1658ec74fa2a6e1b737cd0dac7c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:50.086676 22140 consensus_queue.cc:1048] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:52.277489 21266 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:08:52.278082 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:52.293200 21940 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b9c4b6520ef4335bed3196d7377bff3"
dest_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c"
mode: GRACEFUL
new_leader_uuid: "3b7f4efcc13f42f4ab96addec306cee4"
 from {username='slave'} at 127.0.0.1:47984
I20260709 12:08:52.293704 21940 raft_consensus.cc:606] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 2 LEADER]: Received request to transfer leadership to TS 3b7f4efcc13f42f4ab96addec306cee4
I20260709 12:08:52.296260 21940 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa5860143f19403b948282a6b7cd0009"
dest_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c"
mode: GRACEFUL
new_leader_uuid: "3b7f4efcc13f42f4ab96addec306cee4"
 from {username='slave'} at 127.0.0.1:47984
I20260709 12:08:52.296864 21940 raft_consensus.cc:606] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 2 LEADER]: Received request to transfer leadership to TS 3b7f4efcc13f42f4ab96addec306cee4
I20260709 12:08:52.298197 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:08:52.298734 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:52.555490 22206 raft_consensus.cc:993] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c: : Instructing follower 3b7f4efcc13f42f4ab96addec306cee4 to start an election
I20260709 12:08:52.555984 22231 raft_consensus.cc:1081] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 2 LEADER]: Signalling peer 3b7f4efcc13f42f4ab96addec306cee4 to start an election
I20260709 12:08:52.557636 22091 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b9c4b6520ef4335bed3196d7377bff3"
dest_uuid: "3b7f4efcc13f42f4ab96addec306cee4"
 from {username='slave'} at 127.0.0.1:56336
I20260709 12:08:52.558130 22091 raft_consensus.cc:493] T 5b9c4b6520ef4335bed3196d7377bff3 P 3b7f4efcc13f42f4ab96addec306cee4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:52.558451 22091 raft_consensus.cc:3060] T 5b9c4b6520ef4335bed3196d7377bff3 P 3b7f4efcc13f42f4ab96addec306cee4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:52.563162 22091 raft_consensus.cc:515] T 5b9c4b6520ef4335bed3196d7377bff3 P 3b7f4efcc13f42f4ab96addec306cee4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:52.564703 22091 leader_election.cc:290] T 5b9c4b6520ef4335bed3196d7377bff3 P 3b7f4efcc13f42f4ab96addec306cee4 [CANDIDATE]: Term 3 election: Requested vote from peers 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129:44261), 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130:40715)
I20260709 12:08:52.565588 21940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b9c4b6520ef4335bed3196d7377bff3" candidate_uuid: "3b7f4efcc13f42f4ab96addec306cee4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c"
I20260709 12:08:52.565775 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b9c4b6520ef4335bed3196d7377bff3" candidate_uuid: "3b7f4efcc13f42f4ab96addec306cee4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342"
I20260709 12:08:52.566203 21940 raft_consensus.cc:3055] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:52.566337 22018 raft_consensus.cc:3060] T 5b9c4b6520ef4335bed3196d7377bff3 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:52.566577 21940 raft_consensus.cc:740] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2df5a1658ec74fa2a6e1b737cd0dac7c, State: Running, Role: LEADER
I20260709 12:08:52.567453 21940 consensus_queue.cc:260] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:52.568645 21940 raft_consensus.cc:3060] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:52.570499 22018 raft_consensus.cc:2468] T 5b9c4b6520ef4335bed3196d7377bff3 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b7f4efcc13f42f4ab96addec306cee4 in term 3.
I20260709 12:08:52.571488 22055 leader_election.cc:304] T 5b9c4b6520ef4335bed3196d7377bff3 P 3b7f4efcc13f42f4ab96addec306cee4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b7f4efcc13f42f4ab96addec306cee4, 4b7d59dcbbf84f1bb2b2049660a3d342; no voters: 
I20260709 12:08:52.572186 22228 raft_consensus.cc:2804] T 5b9c4b6520ef4335bed3196d7377bff3 P 3b7f4efcc13f42f4ab96addec306cee4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:52.573263 22228 raft_consensus.cc:697] T 5b9c4b6520ef4335bed3196d7377bff3 P 3b7f4efcc13f42f4ab96addec306cee4 [term 3 LEADER]: Becoming Leader. State: Replica: 3b7f4efcc13f42f4ab96addec306cee4, State: Running, Role: LEADER
I20260709 12:08:52.573285 21940 raft_consensus.cc:2468] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b7f4efcc13f42f4ab96addec306cee4 in term 3.
I20260709 12:08:52.574172 22228 consensus_queue.cc:237] T 5b9c4b6520ef4335bed3196d7377bff3 P 3b7f4efcc13f42f4ab96addec306cee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:52.581060 21841 catalog_manager.cc:5697] T 5b9c4b6520ef4335bed3196d7377bff3 P 3b7f4efcc13f42f4ab96addec306cee4 reported cstate change: term changed from 2 to 3, leader changed from 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129) to 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131). New cstate: current_term: 3 leader_uuid: "3b7f4efcc13f42f4ab96addec306cee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:52.591522 22231 raft_consensus.cc:993] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c: : Instructing follower 3b7f4efcc13f42f4ab96addec306cee4 to start an election
I20260709 12:08:52.591990 22206 raft_consensus.cc:1081] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 2 LEADER]: Signalling peer 3b7f4efcc13f42f4ab96addec306cee4 to start an election
I20260709 12:08:52.593427 22091 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa5860143f19403b948282a6b7cd0009"
dest_uuid: "3b7f4efcc13f42f4ab96addec306cee4"
 from {username='slave'} at 127.0.0.1:56336
I20260709 12:08:52.593829 22091 raft_consensus.cc:493] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:52.594075 22091 raft_consensus.cc:3060] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:52.598848 22091 raft_consensus.cc:515] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:52.600577 22091 leader_election.cc:290] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [CANDIDATE]: Term 3 election: Requested vote from peers 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129:44261), 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130:40715)
I20260709 12:08:52.601294 21940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5860143f19403b948282a6b7cd0009" candidate_uuid: "3b7f4efcc13f42f4ab96addec306cee4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c"
I20260709 12:08:52.601627 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5860143f19403b948282a6b7cd0009" candidate_uuid: "3b7f4efcc13f42f4ab96addec306cee4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342"
I20260709 12:08:52.601848 21940 raft_consensus.cc:3055] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:52.602147 22018 raft_consensus.cc:3060] T fa5860143f19403b948282a6b7cd0009 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:52.602202 21940 raft_consensus.cc:740] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2df5a1658ec74fa2a6e1b737cd0dac7c, State: Running, Role: LEADER
I20260709 12:08:52.603094 21940 consensus_queue.cc:260] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:52.603981 21940 raft_consensus.cc:3060] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:52.606199 22018 raft_consensus.cc:2468] T fa5860143f19403b948282a6b7cd0009 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b7f4efcc13f42f4ab96addec306cee4 in term 3.
I20260709 12:08:52.607180 22055 leader_election.cc:304] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b7f4efcc13f42f4ab96addec306cee4, 4b7d59dcbbf84f1bb2b2049660a3d342; no voters: 
I20260709 12:08:52.608000 22228 raft_consensus.cc:2804] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:52.608384 22228 raft_consensus.cc:697] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [term 3 LEADER]: Becoming Leader. State: Replica: 3b7f4efcc13f42f4ab96addec306cee4, State: Running, Role: LEADER
I20260709 12:08:52.608940 21940 raft_consensus.cc:2468] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b7f4efcc13f42f4ab96addec306cee4 in term 3.
I20260709 12:08:52.609093 22228 consensus_queue.cc:237] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:08:52.615408 21841 catalog_manager.cc:5697] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 reported cstate change: term changed from 2 to 3, leader changed from 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129) to 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131). New cstate: current_term: 3 leader_uuid: "3b7f4efcc13f42f4ab96addec306cee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:53.025771 22018 raft_consensus.cc:1275] T fa5860143f19403b948282a6b7cd0009 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 3 FOLLOWER]: Refusing update from remote peer 3b7f4efcc13f42f4ab96addec306cee4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:53.026937 22228 consensus_queue.cc:1048] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:53.035933 21940 raft_consensus.cc:1275] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 3 FOLLOWER]: Refusing update from remote peer 3b7f4efcc13f42f4ab96addec306cee4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:53.037612 22232 consensus_queue.cc:1048] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:53.130380 22018 raft_consensus.cc:1275] T 5b9c4b6520ef4335bed3196d7377bff3 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 3 FOLLOWER]: Refusing update from remote peer 3b7f4efcc13f42f4ab96addec306cee4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:53.131560 22232 consensus_queue.cc:1048] T 5b9c4b6520ef4335bed3196d7377bff3 P 3b7f4efcc13f42f4ab96addec306cee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:53.140468 21940 raft_consensus.cc:1275] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 3 FOLLOWER]: Refusing update from remote peer 3b7f4efcc13f42f4ab96addec306cee4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:53.141835 22228 consensus_queue.cc:1048] T 5b9c4b6520ef4335bed3196d7377bff3 P 3b7f4efcc13f42f4ab96addec306cee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:53.299865 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:53.305406 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:53.305826 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:54.306810 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:54.312294 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:54.312695 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:55.313802 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:55.319869 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:55.320312 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:56.321446 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:56.327231 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:56.327696 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:57.328707 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:57.334640 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:57.335150 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:58.336146 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:58.342080 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:58.342505 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:59.378466 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:59.383621 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:59.384028 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:08:59.635178 21964 debug-util.cc:398] Leaking SignalData structure 0x7b08001c4cc0 after lost signal to thread 21269
W20260709 12:08:59.636173 21964 debug-util.cc:398] Leaking SignalData structure 0x7b08001900a0 after lost signal to thread 21875
W20260709 12:08:59.637182 21964 debug-util.cc:398] Leaking SignalData structure 0x7b08001fc200 after lost signal to thread 21967
W20260709 12:08:59.637907 21964 debug-util.cc:398] Leaking SignalData structure 0x7b080014ab00 after lost signal to thread 22042
W20260709 12:08:59.638588 21964 debug-util.cc:398] Leaking SignalData structure 0x7b080011a280 after lost signal to thread 22116
I20260709 12:09:00.384948 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:00.390627 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:00.391090 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:01.392091 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:01.397327 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:01.397818 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:02.428804 21266 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:09:02.435786 22091 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa5860143f19403b948282a6b7cd0009"
dest_uuid: "3b7f4efcc13f42f4ab96addec306cee4"
mode: GRACEFUL
new_leader_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c"
 from {username='slave'} at 127.0.0.1:56342
I20260709 12:09:02.436460 22091 raft_consensus.cc:606] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [term 3 LEADER]: Received request to transfer leadership to TS 2df5a1658ec74fa2a6e1b737cd0dac7c
I20260709 12:09:02.446612 22091 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b9c4b6520ef4335bed3196d7377bff3"
dest_uuid: "3b7f4efcc13f42f4ab96addec306cee4"
mode: GRACEFUL
new_leader_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c"
 from {username='slave'} at 127.0.0.1:56342
I20260709 12:09:02.447129 22091 raft_consensus.cc:606] T 5b9c4b6520ef4335bed3196d7377bff3 P 3b7f4efcc13f42f4ab96addec306cee4 [term 3 LEADER]: Received request to transfer leadership to TS 2df5a1658ec74fa2a6e1b737cd0dac7c
I20260709 12:09:02.451591 22018 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1aa66b1382a4e29b37da4673524a913"
dest_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342"
mode: GRACEFUL
new_leader_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c"
 from {username='slave'} at 127.0.0.1:59948
I20260709 12:09:02.452050 22018 raft_consensus.cc:606] T a1aa66b1382a4e29b37da4673524a913 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 2 LEADER]: Received request to transfer leadership to TS 2df5a1658ec74fa2a6e1b737cd0dac7c
I20260709 12:09:02.456627 22018 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "733e3d7ad96747ee94d57562d0fe9143"
dest_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342"
mode: GRACEFUL
new_leader_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c"
 from {username='slave'} at 127.0.0.1:59948
I20260709 12:09:02.457080 22018 raft_consensus.cc:606] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 2 LEADER]: Received request to transfer leadership to TS 2df5a1658ec74fa2a6e1b737cd0dac7c
I20260709 12:09:02.461520 22018 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e190f1787d334b69a152e6d9ed4fa6c5"
dest_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342"
mode: GRACEFUL
new_leader_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c"
 from {username='slave'} at 127.0.0.1:59948
I20260709 12:09:02.461947 22018 raft_consensus.cc:606] T e190f1787d334b69a152e6d9ed4fa6c5 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 1 LEADER]: Received request to transfer leadership to TS 2df5a1658ec74fa2a6e1b737cd0dac7c
I20260709 12:09:02.511458 22259 raft_consensus.cc:993] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4: : Instructing follower 2df5a1658ec74fa2a6e1b737cd0dac7c to start an election
I20260709 12:09:02.512105 22262 raft_consensus.cc:1081] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [term 3 LEADER]: Signalling peer 2df5a1658ec74fa2a6e1b737cd0dac7c to start an election
I20260709 12:09:02.513783 21943 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa5860143f19403b948282a6b7cd0009"
dest_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c"
 from {username='slave'} at 127.0.0.1:47946
I20260709 12:09:02.514219 21943 raft_consensus.cc:493] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:02.514477 21943 raft_consensus.cc:3060] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:02.519742 21943 raft_consensus.cc:515] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:09:02.521139 21943 leader_election.cc:290] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c [CANDIDATE]: Term 4 election: Requested vote from peers 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130:40715), 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131:44695)
I20260709 12:09:02.522075 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5860143f19403b948282a6b7cd0009" candidate_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342"
I20260709 12:09:02.522207 22091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5860143f19403b948282a6b7cd0009" candidate_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3b7f4efcc13f42f4ab96addec306cee4"
I20260709 12:09:02.522751 22018 raft_consensus.cc:3060] T fa5860143f19403b948282a6b7cd0009 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:02.522782 22091 raft_consensus.cc:3055] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:02.523185 22091 raft_consensus.cc:740] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3b7f4efcc13f42f4ab96addec306cee4, State: Running, Role: LEADER
I20260709 12:09:02.523823 22091 consensus_queue.cc:260] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:09:02.524678 22091 raft_consensus.cc:3060] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:02.527184 22018 raft_consensus.cc:2468] T fa5860143f19403b948282a6b7cd0009 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df5a1658ec74fa2a6e1b737cd0dac7c in term 4.
I20260709 12:09:02.528514 21906 leader_election.cc:304] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2df5a1658ec74fa2a6e1b737cd0dac7c, 4b7d59dcbbf84f1bb2b2049660a3d342; no voters: 
I20260709 12:09:02.529372 22258 raft_consensus.cc:2804] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:02.529650 22091 raft_consensus.cc:2468] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df5a1658ec74fa2a6e1b737cd0dac7c in term 4.
I20260709 12:09:02.530485 22258 raft_consensus.cc:697] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 4 LEADER]: Becoming Leader. State: Replica: 2df5a1658ec74fa2a6e1b737cd0dac7c, State: Running, Role: LEADER
I20260709 12:09:02.531539 22258 consensus_queue.cc:237] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:09:02.541819 21840 catalog_manager.cc:5697] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c reported cstate change: term changed from 3 to 4, leader changed from 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131) to 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129). New cstate: current_term: 4 leader_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:02.571736 22259 raft_consensus.cc:993] T 5b9c4b6520ef4335bed3196d7377bff3 P 3b7f4efcc13f42f4ab96addec306cee4: : Instructing follower 2df5a1658ec74fa2a6e1b737cd0dac7c to start an election
I20260709 12:09:02.572196 22262 raft_consensus.cc:1081] T 5b9c4b6520ef4335bed3196d7377bff3 P 3b7f4efcc13f42f4ab96addec306cee4 [term 3 LEADER]: Signalling peer 2df5a1658ec74fa2a6e1b737cd0dac7c to start an election
I20260709 12:09:02.573769 21943 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b9c4b6520ef4335bed3196d7377bff3"
dest_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c"
 from {username='slave'} at 127.0.0.1:47946
I20260709 12:09:02.574275 21943 raft_consensus.cc:493] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:02.574615 21943 raft_consensus.cc:3060] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:02.579269 21943 raft_consensus.cc:515] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:09:02.580506 21943 leader_election.cc:290] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c [CANDIDATE]: Term 4 election: Requested vote from peers 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130:40715), 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131:44695)
I20260709 12:09:02.581301 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b9c4b6520ef4335bed3196d7377bff3" candidate_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342"
I20260709 12:09:02.581620 22091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b9c4b6520ef4335bed3196d7377bff3" candidate_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3b7f4efcc13f42f4ab96addec306cee4"
I20260709 12:09:02.581838 22018 raft_consensus.cc:3060] T 5b9c4b6520ef4335bed3196d7377bff3 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:02.582108 22091 raft_consensus.cc:3055] T 5b9c4b6520ef4335bed3196d7377bff3 P 3b7f4efcc13f42f4ab96addec306cee4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:02.582391 22091 raft_consensus.cc:740] T 5b9c4b6520ef4335bed3196d7377bff3 P 3b7f4efcc13f42f4ab96addec306cee4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3b7f4efcc13f42f4ab96addec306cee4, State: Running, Role: LEADER
I20260709 12:09:02.583156 22091 consensus_queue.cc:260] T 5b9c4b6520ef4335bed3196d7377bff3 P 3b7f4efcc13f42f4ab96addec306cee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:09:02.584221 22091 raft_consensus.cc:3060] T 5b9c4b6520ef4335bed3196d7377bff3 P 3b7f4efcc13f42f4ab96addec306cee4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:02.587790 22018 raft_consensus.cc:2468] T 5b9c4b6520ef4335bed3196d7377bff3 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df5a1658ec74fa2a6e1b737cd0dac7c in term 4.
I20260709 12:09:02.588706 21906 leader_election.cc:304] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2df5a1658ec74fa2a6e1b737cd0dac7c, 4b7d59dcbbf84f1bb2b2049660a3d342; no voters: 
I20260709 12:09:02.589314 22258 raft_consensus.cc:2804] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:02.589707 22258 raft_consensus.cc:697] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 4 LEADER]: Becoming Leader. State: Replica: 2df5a1658ec74fa2a6e1b737cd0dac7c, State: Running, Role: LEADER
I20260709 12:09:02.589816 22091 raft_consensus.cc:2468] T 5b9c4b6520ef4335bed3196d7377bff3 P 3b7f4efcc13f42f4ab96addec306cee4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df5a1658ec74fa2a6e1b737cd0dac7c in term 4.
I20260709 12:09:02.590655 22258 consensus_queue.cc:237] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:09:02.597481 21840 catalog_manager.cc:5697] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c reported cstate change: term changed from 3 to 4, leader changed from 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131) to 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129). New cstate: current_term: 4 leader_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:02.717913 22261 raft_consensus.cc:993] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342: : Instructing follower 2df5a1658ec74fa2a6e1b737cd0dac7c to start an election
I20260709 12:09:02.718734 22260 raft_consensus.cc:1081] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 2 LEADER]: Signalling peer 2df5a1658ec74fa2a6e1b737cd0dac7c to start an election
I20260709 12:09:02.720391 21943 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "733e3d7ad96747ee94d57562d0fe9143"
dest_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c"
 from {username='slave'} at 127.0.0.1:47960
I20260709 12:09:02.720911 21943 raft_consensus.cc:493] T 733e3d7ad96747ee94d57562d0fe9143 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:02.721195 21943 raft_consensus.cc:3060] T 733e3d7ad96747ee94d57562d0fe9143 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:02.725865 21943 raft_consensus.cc:515] T 733e3d7ad96747ee94d57562d0fe9143 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:09:02.727475 21943 leader_election.cc:290] T 733e3d7ad96747ee94d57562d0fe9143 P 2df5a1658ec74fa2a6e1b737cd0dac7c [CANDIDATE]: Term 3 election: Requested vote from peers 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130:40715), 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131:44695)
I20260709 12:09:02.728363 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "733e3d7ad96747ee94d57562d0fe9143" candidate_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342"
I20260709 12:09:02.728585 22091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "733e3d7ad96747ee94d57562d0fe9143" candidate_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3b7f4efcc13f42f4ab96addec306cee4"
I20260709 12:09:02.728927 22018 raft_consensus.cc:3055] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:02.729041 22091 raft_consensus.cc:3060] T 733e3d7ad96747ee94d57562d0fe9143 P 3b7f4efcc13f42f4ab96addec306cee4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:02.729267 22018 raft_consensus.cc:740] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4b7d59dcbbf84f1bb2b2049660a3d342, State: Running, Role: LEADER
I20260709 12:09:02.730047 22018 consensus_queue.cc:260] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:09:02.731215 22018 raft_consensus.cc:3060] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:02.735173 22091 raft_consensus.cc:2468] T 733e3d7ad96747ee94d57562d0fe9143 P 3b7f4efcc13f42f4ab96addec306cee4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df5a1658ec74fa2a6e1b737cd0dac7c in term 3.
I20260709 12:09:02.736259 21906 leader_election.cc:304] T 733e3d7ad96747ee94d57562d0fe9143 P 2df5a1658ec74fa2a6e1b737cd0dac7c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2df5a1658ec74fa2a6e1b737cd0dac7c, 3b7f4efcc13f42f4ab96addec306cee4; no voters: 
I20260709 12:09:02.736999 22258 raft_consensus.cc:2804] T 733e3d7ad96747ee94d57562d0fe9143 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:02.737115 22018 raft_consensus.cc:2468] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df5a1658ec74fa2a6e1b737cd0dac7c in term 3.
I20260709 12:09:02.737470 22258 raft_consensus.cc:697] T 733e3d7ad96747ee94d57562d0fe9143 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 3 LEADER]: Becoming Leader. State: Replica: 2df5a1658ec74fa2a6e1b737cd0dac7c, State: Running, Role: LEADER
I20260709 12:09:02.738373 22258 consensus_queue.cc:237] T 733e3d7ad96747ee94d57562d0fe9143 P 2df5a1658ec74fa2a6e1b737cd0dac7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:09:02.745275 21840 catalog_manager.cc:5697] T 733e3d7ad96747ee94d57562d0fe9143 P 2df5a1658ec74fa2a6e1b737cd0dac7c reported cstate change: term changed from 2 to 3, leader changed from 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130) to 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129). New cstate: current_term: 3 leader_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:02.748629 22261 raft_consensus.cc:993] T e190f1787d334b69a152e6d9ed4fa6c5 P 4b7d59dcbbf84f1bb2b2049660a3d342: : Instructing follower 2df5a1658ec74fa2a6e1b737cd0dac7c to start an election
I20260709 12:09:02.749085 22260 raft_consensus.cc:1081] T e190f1787d334b69a152e6d9ed4fa6c5 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 1 LEADER]: Signalling peer 2df5a1658ec74fa2a6e1b737cd0dac7c to start an election
I20260709 12:09:02.750555 21943 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e190f1787d334b69a152e6d9ed4fa6c5"
dest_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c"
 from {username='slave'} at 127.0.0.1:47960
I20260709 12:09:02.751063 21943 raft_consensus.cc:493] T e190f1787d334b69a152e6d9ed4fa6c5 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:02.751423 21943 raft_consensus.cc:3060] T e190f1787d334b69a152e6d9ed4fa6c5 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:02.756546 21943 raft_consensus.cc:515] T e190f1787d334b69a152e6d9ed4fa6c5 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:09:02.758148 21943 leader_election.cc:290] T e190f1787d334b69a152e6d9ed4fa6c5 P 2df5a1658ec74fa2a6e1b737cd0dac7c [CANDIDATE]: Term 2 election: Requested vote from peers 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130:40715), 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131:44695)
I20260709 12:09:02.758764 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e190f1787d334b69a152e6d9ed4fa6c5" candidate_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342"
I20260709 12:09:02.759091 22091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e190f1787d334b69a152e6d9ed4fa6c5" candidate_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3b7f4efcc13f42f4ab96addec306cee4"
I20260709 12:09:02.759424 22018 raft_consensus.cc:3055] T e190f1787d334b69a152e6d9ed4fa6c5 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:02.759672 22091 raft_consensus.cc:3060] T e190f1787d334b69a152e6d9ed4fa6c5 P 3b7f4efcc13f42f4ab96addec306cee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:02.759732 22018 raft_consensus.cc:740] T e190f1787d334b69a152e6d9ed4fa6c5 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b7d59dcbbf84f1bb2b2049660a3d342, State: Running, Role: LEADER
I20260709 12:09:02.760568 22018 consensus_queue.cc:260] T e190f1787d334b69a152e6d9ed4fa6c5 P 4b7d59dcbbf84f1bb2b2049660a3d342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:09:02.761469 22018 raft_consensus.cc:3060] T e190f1787d334b69a152e6d9ed4fa6c5 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:02.764397 22091 raft_consensus.cc:2468] T e190f1787d334b69a152e6d9ed4fa6c5 P 3b7f4efcc13f42f4ab96addec306cee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df5a1658ec74fa2a6e1b737cd0dac7c in term 2.
I20260709 12:09:02.765337 21906 leader_election.cc:304] T e190f1787d334b69a152e6d9ed4fa6c5 P 2df5a1658ec74fa2a6e1b737cd0dac7c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2df5a1658ec74fa2a6e1b737cd0dac7c, 3b7f4efcc13f42f4ab96addec306cee4; no voters: 
I20260709 12:09:02.765780 22018 raft_consensus.cc:2468] T e190f1787d334b69a152e6d9ed4fa6c5 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df5a1658ec74fa2a6e1b737cd0dac7c in term 2.
I20260709 12:09:02.766037 22258 raft_consensus.cc:2804] T e190f1787d334b69a152e6d9ed4fa6c5 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:02.766646 22258 raft_consensus.cc:697] T e190f1787d334b69a152e6d9ed4fa6c5 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 2 LEADER]: Becoming Leader. State: Replica: 2df5a1658ec74fa2a6e1b737cd0dac7c, State: Running, Role: LEADER
I20260709 12:09:02.767441 22258 consensus_queue.cc:237] T e190f1787d334b69a152e6d9ed4fa6c5 P 2df5a1658ec74fa2a6e1b737cd0dac7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:09:02.774340 21840 catalog_manager.cc:5697] T e190f1787d334b69a152e6d9ed4fa6c5 P 2df5a1658ec74fa2a6e1b737cd0dac7c reported cstate change: term changed from 1 to 2, leader changed from 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130) to 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129). New cstate: current_term: 2 leader_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:02.783349 22261 raft_consensus.cc:993] T a1aa66b1382a4e29b37da4673524a913 P 4b7d59dcbbf84f1bb2b2049660a3d342: : Instructing follower 2df5a1658ec74fa2a6e1b737cd0dac7c to start an election
I20260709 12:09:02.783777 22260 raft_consensus.cc:1081] T a1aa66b1382a4e29b37da4673524a913 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 2 LEADER]: Signalling peer 2df5a1658ec74fa2a6e1b737cd0dac7c to start an election
I20260709 12:09:02.785228 21943 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a1aa66b1382a4e29b37da4673524a913"
dest_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c"
 from {username='slave'} at 127.0.0.1:47960
I20260709 12:09:02.785614 21943 raft_consensus.cc:493] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:02.785847 21943 raft_consensus.cc:3060] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:02.789958 21943 raft_consensus.cc:515] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:09:02.791433 21943 leader_election.cc:290] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c [CANDIDATE]: Term 3 election: Requested vote from peers 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130:40715), 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131:44695)
I20260709 12:09:02.792207 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1aa66b1382a4e29b37da4673524a913" candidate_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342"
I20260709 12:09:02.792481 22091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1aa66b1382a4e29b37da4673524a913" candidate_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3b7f4efcc13f42f4ab96addec306cee4"
I20260709 12:09:02.792675 22018 raft_consensus.cc:3055] T a1aa66b1382a4e29b37da4673524a913 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:02.792972 22018 raft_consensus.cc:740] T a1aa66b1382a4e29b37da4673524a913 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4b7d59dcbbf84f1bb2b2049660a3d342, State: Running, Role: LEADER
I20260709 12:09:02.792989 22091 raft_consensus.cc:3060] T a1aa66b1382a4e29b37da4673524a913 P 3b7f4efcc13f42f4ab96addec306cee4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:02.793704 22018 consensus_queue.cc:260] T a1aa66b1382a4e29b37da4673524a913 P 4b7d59dcbbf84f1bb2b2049660a3d342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:09:02.794565 22018 raft_consensus.cc:3060] T a1aa66b1382a4e29b37da4673524a913 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:02.797364 22091 raft_consensus.cc:2468] T a1aa66b1382a4e29b37da4673524a913 P 3b7f4efcc13f42f4ab96addec306cee4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df5a1658ec74fa2a6e1b737cd0dac7c in term 3.
I20260709 12:09:02.798346 21906 leader_election.cc:304] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2df5a1658ec74fa2a6e1b737cd0dac7c, 3b7f4efcc13f42f4ab96addec306cee4; no voters: 
I20260709 12:09:02.799003 22258 raft_consensus.cc:2804] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:02.798969 22018 raft_consensus.cc:2468] T a1aa66b1382a4e29b37da4673524a913 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df5a1658ec74fa2a6e1b737cd0dac7c in term 3.
I20260709 12:09:02.799628 22258 raft_consensus.cc:697] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 3 LEADER]: Becoming Leader. State: Replica: 2df5a1658ec74fa2a6e1b737cd0dac7c, State: Running, Role: LEADER
I20260709 12:09:02.800644 22258 consensus_queue.cc:237] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:09:02.806845 21840 catalog_manager.cc:5697] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c reported cstate change: term changed from 2 to 3, leader changed from 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130) to 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129). New cstate: current_term: 3 leader_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:03.100991 22091 raft_consensus.cc:1275] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [term 4 FOLLOWER]: Refusing update from remote peer 2df5a1658ec74fa2a6e1b737cd0dac7c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:03.102231 22258 consensus_queue.cc:1048] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:03.106089 22017 raft_consensus.cc:1275] T fa5860143f19403b948282a6b7cd0009 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 4 FOLLOWER]: Refusing update from remote peer 2df5a1658ec74fa2a6e1b737cd0dac7c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:03.107507 22258 consensus_queue.cc:1048] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:03.150326 22091 raft_consensus.cc:1275] T 733e3d7ad96747ee94d57562d0fe9143 P 3b7f4efcc13f42f4ab96addec306cee4 [term 3 FOLLOWER]: Refusing update from remote peer 2df5a1658ec74fa2a6e1b737cd0dac7c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:03.151536 22274 consensus_queue.cc:1048] T 733e3d7ad96747ee94d57562d0fe9143 P 2df5a1658ec74fa2a6e1b737cd0dac7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:03.161515 22017 raft_consensus.cc:1275] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 3 FOLLOWER]: Refusing update from remote peer 2df5a1658ec74fa2a6e1b737cd0dac7c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:03.163427 22277 consensus_queue.cc:1048] T 733e3d7ad96747ee94d57562d0fe9143 P 2df5a1658ec74fa2a6e1b737cd0dac7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:03.171617 22017 raft_consensus.cc:1275] T 5b9c4b6520ef4335bed3196d7377bff3 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 4 FOLLOWER]: Refusing update from remote peer 2df5a1658ec74fa2a6e1b737cd0dac7c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:03.173177 22277 consensus_queue.cc:1048] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:03.181778 22091 raft_consensus.cc:1275] T 5b9c4b6520ef4335bed3196d7377bff3 P 3b7f4efcc13f42f4ab96addec306cee4 [term 4 FOLLOWER]: Refusing update from remote peer 2df5a1658ec74fa2a6e1b737cd0dac7c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:03.183310 22263 consensus_queue.cc:1048] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:03.243893 22091 raft_consensus.cc:1275] T a1aa66b1382a4e29b37da4673524a913 P 3b7f4efcc13f42f4ab96addec306cee4 [term 3 FOLLOWER]: Refusing update from remote peer 2df5a1658ec74fa2a6e1b737cd0dac7c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:03.245085 22274 consensus_queue.cc:1048] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:03.254017 22017 raft_consensus.cc:1275] T a1aa66b1382a4e29b37da4673524a913 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 3 FOLLOWER]: Refusing update from remote peer 2df5a1658ec74fa2a6e1b737cd0dac7c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:03.256078 22258 consensus_queue.cc:1048] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:03.299202 22091 raft_consensus.cc:1275] T e190f1787d334b69a152e6d9ed4fa6c5 P 3b7f4efcc13f42f4ab96addec306cee4 [term 2 FOLLOWER]: Refusing update from remote peer 2df5a1658ec74fa2a6e1b737cd0dac7c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:03.300351 22258 consensus_queue.cc:1048] T e190f1787d334b69a152e6d9ed4fa6c5 P 2df5a1658ec74fa2a6e1b737cd0dac7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:03.310139 22017 raft_consensus.cc:1275] T e190f1787d334b69a152e6d9ed4fa6c5 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 2 FOLLOWER]: Refusing update from remote peer 2df5a1658ec74fa2a6e1b737cd0dac7c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:03.312716 22277 consensus_queue.cc:1048] T e190f1787d334b69a152e6d9ed4fa6c5 P 2df5a1658ec74fa2a6e1b737cd0dac7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:05.499729 21266 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:09:05.500594 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:05.509434 21943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "29408da1bbbe45658dd4f5d47cf5f343"
dest_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c"
mode: GRACEFUL
new_leader_uuid: "3b7f4efcc13f42f4ab96addec306cee4"
 from {username='slave'} at 127.0.0.1:47984
I20260709 12:09:05.510135 21943 raft_consensus.cc:606] T 29408da1bbbe45658dd4f5d47cf5f343 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 2 LEADER]: Received request to transfer leadership to TS 3b7f4efcc13f42f4ab96addec306cee4
I20260709 12:09:05.513087 21943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "733e3d7ad96747ee94d57562d0fe9143"
dest_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c"
mode: GRACEFUL
new_leader_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342"
 from {username='slave'} at 127.0.0.1:47984
I20260709 12:09:05.513525 21943 raft_consensus.cc:606] T 733e3d7ad96747ee94d57562d0fe9143 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 3 LEADER]: Received request to transfer leadership to TS 4b7d59dcbbf84f1bb2b2049660a3d342
I20260709 12:09:05.516072 21943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a3260ab991547578698448eec0c9a1e"
dest_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c"
mode: GRACEFUL
new_leader_uuid: "3b7f4efcc13f42f4ab96addec306cee4"
 from {username='slave'} at 127.0.0.1:47984
I20260709 12:09:05.516726 21943 raft_consensus.cc:606] T 7a3260ab991547578698448eec0c9a1e P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 1 LEADER]: Received request to transfer leadership to TS 3b7f4efcc13f42f4ab96addec306cee4
I20260709 12:09:05.519536 21943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa5860143f19403b948282a6b7cd0009"
dest_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c"
mode: GRACEFUL
new_leader_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342"
 from {username='slave'} at 127.0.0.1:47984
I20260709 12:09:05.520015 21943 raft_consensus.cc:606] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 4 LEADER]: Received request to transfer leadership to TS 4b7d59dcbbf84f1bb2b2049660a3d342
I20260709 12:09:05.521126 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:09:05.521714 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:05.626012 22263 raft_consensus.cc:993] T 29408da1bbbe45658dd4f5d47cf5f343 P 2df5a1658ec74fa2a6e1b737cd0dac7c: : Instructing follower 3b7f4efcc13f42f4ab96addec306cee4 to start an election
I20260709 12:09:05.626603 22292 raft_consensus.cc:1081] T 29408da1bbbe45658dd4f5d47cf5f343 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 2 LEADER]: Signalling peer 3b7f4efcc13f42f4ab96addec306cee4 to start an election
I20260709 12:09:05.628209 22091 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "29408da1bbbe45658dd4f5d47cf5f343"
dest_uuid: "3b7f4efcc13f42f4ab96addec306cee4"
 from {username='slave'} at 127.0.0.1:56336
I20260709 12:09:05.628716 22091 raft_consensus.cc:493] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:05.629071 22091 raft_consensus.cc:3060] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:05.636111 22091 raft_consensus.cc:515] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:09:05.638454 22091 leader_election.cc:290] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4 [CANDIDATE]: Term 3 election: Requested vote from peers 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130:40715), 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129:44261)
I20260709 12:09:05.639657 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29408da1bbbe45658dd4f5d47cf5f343" candidate_uuid: "3b7f4efcc13f42f4ab96addec306cee4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c"
I20260709 12:09:05.639606 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29408da1bbbe45658dd4f5d47cf5f343" candidate_uuid: "3b7f4efcc13f42f4ab96addec306cee4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342"
I20260709 12:09:05.640468 21943 raft_consensus.cc:3055] T 29408da1bbbe45658dd4f5d47cf5f343 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:05.640496 22017 raft_consensus.cc:3060] T 29408da1bbbe45658dd4f5d47cf5f343 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:05.640753 21943 raft_consensus.cc:740] T 29408da1bbbe45658dd4f5d47cf5f343 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2df5a1658ec74fa2a6e1b737cd0dac7c, State: Running, Role: LEADER
I20260709 12:09:05.641512 21943 consensus_queue.cc:260] T 29408da1bbbe45658dd4f5d47cf5f343 P 2df5a1658ec74fa2a6e1b737cd0dac7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:09:05.642413 21943 raft_consensus.cc:3060] T 29408da1bbbe45658dd4f5d47cf5f343 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:05.646129 22017 raft_consensus.cc:2468] T 29408da1bbbe45658dd4f5d47cf5f343 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b7f4efcc13f42f4ab96addec306cee4 in term 3.
I20260709 12:09:05.646888 21943 raft_consensus.cc:2468] T 29408da1bbbe45658dd4f5d47cf5f343 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b7f4efcc13f42f4ab96addec306cee4 in term 3.
I20260709 12:09:05.647447 22055 leader_election.cc:304] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b7f4efcc13f42f4ab96addec306cee4, 4b7d59dcbbf84f1bb2b2049660a3d342; no voters: 
I20260709 12:09:05.648314 22293 raft_consensus.cc:2804] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:05.649245 22293 raft_consensus.cc:697] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4 [term 3 LEADER]: Becoming Leader. State: Replica: 3b7f4efcc13f42f4ab96addec306cee4, State: Running, Role: LEADER
I20260709 12:09:05.650049 22293 consensus_queue.cc:237] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:09:05.657524 21840 catalog_manager.cc:5697] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4 reported cstate change: term changed from 2 to 3, leader changed from 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129) to 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131). New cstate: current_term: 3 leader_uuid: "3b7f4efcc13f42f4ab96addec306cee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:05.665298 22263 raft_consensus.cc:993] T 7a3260ab991547578698448eec0c9a1e P 2df5a1658ec74fa2a6e1b737cd0dac7c: : Instructing follower 3b7f4efcc13f42f4ab96addec306cee4 to start an election
I20260709 12:09:05.665812 22292 raft_consensus.cc:1081] T 7a3260ab991547578698448eec0c9a1e P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 1 LEADER]: Signalling peer 3b7f4efcc13f42f4ab96addec306cee4 to start an election
I20260709 12:09:05.667435 22091 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a3260ab991547578698448eec0c9a1e"
dest_uuid: "3b7f4efcc13f42f4ab96addec306cee4"
 from {username='slave'} at 127.0.0.1:56336
I20260709 12:09:05.667919 22091 raft_consensus.cc:493] T 7a3260ab991547578698448eec0c9a1e P 3b7f4efcc13f42f4ab96addec306cee4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:05.668263 22091 raft_consensus.cc:3060] T 7a3260ab991547578698448eec0c9a1e P 3b7f4efcc13f42f4ab96addec306cee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:05.673847 22091 raft_consensus.cc:515] T 7a3260ab991547578698448eec0c9a1e P 3b7f4efcc13f42f4ab96addec306cee4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:09:05.675262 22091 leader_election.cc:290] T 7a3260ab991547578698448eec0c9a1e P 3b7f4efcc13f42f4ab96addec306cee4 [CANDIDATE]: Term 2 election: Requested vote from peers 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129:44261), 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130:40715)
I20260709 12:09:05.676103 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3260ab991547578698448eec0c9a1e" candidate_uuid: "3b7f4efcc13f42f4ab96addec306cee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c"
I20260709 12:09:05.676290 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a3260ab991547578698448eec0c9a1e" candidate_uuid: "3b7f4efcc13f42f4ab96addec306cee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342"
I20260709 12:09:05.676676 21943 raft_consensus.cc:3055] T 7a3260ab991547578698448eec0c9a1e P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:05.676816 22017 raft_consensus.cc:3060] T 7a3260ab991547578698448eec0c9a1e P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:05.676986 21943 raft_consensus.cc:740] T 7a3260ab991547578698448eec0c9a1e P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2df5a1658ec74fa2a6e1b737cd0dac7c, State: Running, Role: LEADER
I20260709 12:09:05.677762 21943 consensus_queue.cc:260] T 7a3260ab991547578698448eec0c9a1e P 2df5a1658ec74fa2a6e1b737cd0dac7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:09:05.678603 21943 raft_consensus.cc:3060] T 7a3260ab991547578698448eec0c9a1e P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:05.682091 22017 raft_consensus.cc:2468] T 7a3260ab991547578698448eec0c9a1e P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b7f4efcc13f42f4ab96addec306cee4 in term 2.
I20260709 12:09:05.683101 22055 leader_election.cc:304] T 7a3260ab991547578698448eec0c9a1e P 3b7f4efcc13f42f4ab96addec306cee4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b7f4efcc13f42f4ab96addec306cee4, 4b7d59dcbbf84f1bb2b2049660a3d342; no voters: 
I20260709 12:09:05.683895 22293 raft_consensus.cc:2804] T 7a3260ab991547578698448eec0c9a1e P 3b7f4efcc13f42f4ab96addec306cee4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:05.684000 21943 raft_consensus.cc:2468] T 7a3260ab991547578698448eec0c9a1e P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b7f4efcc13f42f4ab96addec306cee4 in term 2.
I20260709 12:09:05.684324 22293 raft_consensus.cc:697] T 7a3260ab991547578698448eec0c9a1e P 3b7f4efcc13f42f4ab96addec306cee4 [term 2 LEADER]: Becoming Leader. State: Replica: 3b7f4efcc13f42f4ab96addec306cee4, State: Running, Role: LEADER
I20260709 12:09:05.685302 22293 consensus_queue.cc:237] T 7a3260ab991547578698448eec0c9a1e P 3b7f4efcc13f42f4ab96addec306cee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:09:05.691902 21840 catalog_manager.cc:5697] T 7a3260ab991547578698448eec0c9a1e P 3b7f4efcc13f42f4ab96addec306cee4 reported cstate change: term changed from 1 to 2, leader changed from 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129) to 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131). New cstate: current_term: 2 leader_uuid: "3b7f4efcc13f42f4ab96addec306cee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:05.887486 22263 raft_consensus.cc:993] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c: : Instructing follower 4b7d59dcbbf84f1bb2b2049660a3d342 to start an election
I20260709 12:09:05.887928 22292 raft_consensus.cc:1081] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 4 LEADER]: Signalling peer 4b7d59dcbbf84f1bb2b2049660a3d342 to start an election
I20260709 12:09:05.889209 22017 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa5860143f19403b948282a6b7cd0009"
dest_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342"
 from {username='slave'} at 127.0.0.1:59938
I20260709 12:09:05.889605 22017 raft_consensus.cc:493] T fa5860143f19403b948282a6b7cd0009 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:05.889833 22017 raft_consensus.cc:3060] T fa5860143f19403b948282a6b7cd0009 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:05.894237 22017 raft_consensus.cc:515] T fa5860143f19403b948282a6b7cd0009 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:09:05.896320 22017 leader_election.cc:290] T fa5860143f19403b948282a6b7cd0009 P 4b7d59dcbbf84f1bb2b2049660a3d342 [CANDIDATE]: Term 5 election: Requested vote from peers 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129:44261), 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131:44695)
I20260709 12:09:05.897020 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5860143f19403b948282a6b7cd0009" candidate_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c"
I20260709 12:09:05.897377 22091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5860143f19403b948282a6b7cd0009" candidate_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "3b7f4efcc13f42f4ab96addec306cee4"
I20260709 12:09:05.897617 21943 raft_consensus.cc:3055] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:09:05.897872 22091 raft_consensus.cc:3060] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:05.897910 21943 raft_consensus.cc:740] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2df5a1658ec74fa2a6e1b737cd0dac7c, State: Running, Role: LEADER
I20260709 12:09:05.898794 21943 consensus_queue.cc:260] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:09:05.899995 21943 raft_consensus.cc:3060] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:05.903777 22091 raft_consensus.cc:2468] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7d59dcbbf84f1bb2b2049660a3d342 in term 5.
I20260709 12:09:05.904757 21943 raft_consensus.cc:2468] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7d59dcbbf84f1bb2b2049660a3d342 in term 5.
I20260709 12:09:05.904901 21981 leader_election.cc:304] T fa5860143f19403b948282a6b7cd0009 P 4b7d59dcbbf84f1bb2b2049660a3d342 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b7f4efcc13f42f4ab96addec306cee4, 4b7d59dcbbf84f1bb2b2049660a3d342; no voters: 
I20260709 12:09:05.905651 22288 raft_consensus.cc:2804] T fa5860143f19403b948282a6b7cd0009 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:09:05.906716 22288 raft_consensus.cc:697] T fa5860143f19403b948282a6b7cd0009 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 5 LEADER]: Becoming Leader. State: Replica: 4b7d59dcbbf84f1bb2b2049660a3d342, State: Running, Role: LEADER
I20260709 12:09:05.907567 22288 consensus_queue.cc:237] T fa5860143f19403b948282a6b7cd0009 P 4b7d59dcbbf84f1bb2b2049660a3d342 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:09:05.914662 21840 catalog_manager.cc:5697] T fa5860143f19403b948282a6b7cd0009 P 4b7d59dcbbf84f1bb2b2049660a3d342 reported cstate change: term changed from 4 to 5, leader changed from 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129) to 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130). New cstate: current_term: 5 leader_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:05.994531 22263 raft_consensus.cc:993] T 733e3d7ad96747ee94d57562d0fe9143 P 2df5a1658ec74fa2a6e1b737cd0dac7c: : Instructing follower 4b7d59dcbbf84f1bb2b2049660a3d342 to start an election
I20260709 12:09:05.995046 22292 raft_consensus.cc:1081] T 733e3d7ad96747ee94d57562d0fe9143 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 3 LEADER]: Signalling peer 4b7d59dcbbf84f1bb2b2049660a3d342 to start an election
I20260709 12:09:05.996452 22017 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "733e3d7ad96747ee94d57562d0fe9143"
dest_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342"
 from {username='slave'} at 127.0.0.1:59938
I20260709 12:09:05.996927 22017 raft_consensus.cc:493] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:05.997237 22017 raft_consensus.cc:3060] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:06.002034 22017 raft_consensus.cc:515] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:09:06.003530 22017 leader_election.cc:290] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342 [CANDIDATE]: Term 4 election: Requested vote from peers 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129:44261), 3b7f4efcc13f42f4ab96addec306cee4 (127.20.196.131:44695)
I20260709 12:09:06.004315 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "733e3d7ad96747ee94d57562d0fe9143" candidate_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c"
I20260709 12:09:06.004468 22091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "733e3d7ad96747ee94d57562d0fe9143" candidate_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3b7f4efcc13f42f4ab96addec306cee4"
I20260709 12:09:06.004848 21943 raft_consensus.cc:3055] T 733e3d7ad96747ee94d57562d0fe9143 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:06.004896 22091 raft_consensus.cc:3060] T 733e3d7ad96747ee94d57562d0fe9143 P 3b7f4efcc13f42f4ab96addec306cee4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:06.005255 21943 raft_consensus.cc:740] T 733e3d7ad96747ee94d57562d0fe9143 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2df5a1658ec74fa2a6e1b737cd0dac7c, State: Running, Role: LEADER
I20260709 12:09:06.006011 21943 consensus_queue.cc:260] T 733e3d7ad96747ee94d57562d0fe9143 P 2df5a1658ec74fa2a6e1b737cd0dac7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:09:06.007226 21943 raft_consensus.cc:3060] T 733e3d7ad96747ee94d57562d0fe9143 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:06.011466 22091 raft_consensus.cc:2468] T 733e3d7ad96747ee94d57562d0fe9143 P 3b7f4efcc13f42f4ab96addec306cee4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7d59dcbbf84f1bb2b2049660a3d342 in term 4.
I20260709 12:09:06.012567 21981 leader_election.cc:304] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b7f4efcc13f42f4ab96addec306cee4, 4b7d59dcbbf84f1bb2b2049660a3d342; no voters: 
I20260709 12:09:06.013236 22288 raft_consensus.cc:2804] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:06.013486 21943 raft_consensus.cc:2468] T 733e3d7ad96747ee94d57562d0fe9143 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7d59dcbbf84f1bb2b2049660a3d342 in term 4.
I20260709 12:09:06.013741 22288 raft_consensus.cc:697] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 4 LEADER]: Becoming Leader. State: Replica: 4b7d59dcbbf84f1bb2b2049660a3d342, State: Running, Role: LEADER
I20260709 12:09:06.014704 22288 consensus_queue.cc:237] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } }
I20260709 12:09:06.021785 21840 catalog_manager.cc:5697] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342 reported cstate change: term changed from 3 to 4, leader changed from 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129) to 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130). New cstate: current_term: 4 leader_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:06.030319 21943 raft_consensus.cc:1275] T 29408da1bbbe45658dd4f5d47cf5f343 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 3 FOLLOWER]: Refusing update from remote peer 3b7f4efcc13f42f4ab96addec306cee4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:06.031371 22293 consensus_queue.cc:1048] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:06.040717 22017 raft_consensus.cc:1275] T 29408da1bbbe45658dd4f5d47cf5f343 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 3 FOLLOWER]: Refusing update from remote peer 3b7f4efcc13f42f4ab96addec306cee4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:06.043284 22293 consensus_queue.cc:1048] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:06.098191 22017 raft_consensus.cc:1275] T 7a3260ab991547578698448eec0c9a1e P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 2 FOLLOWER]: Refusing update from remote peer 3b7f4efcc13f42f4ab96addec306cee4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:06.099282 22293 consensus_queue.cc:1048] T 7a3260ab991547578698448eec0c9a1e P 3b7f4efcc13f42f4ab96addec306cee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b7d59dcbbf84f1bb2b2049660a3d342" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:06.108484 21943 raft_consensus.cc:1275] T 7a3260ab991547578698448eec0c9a1e P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 2 FOLLOWER]: Refusing update from remote peer 3b7f4efcc13f42f4ab96addec306cee4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:06.110118 22293 consensus_queue.cc:1048] T 7a3260ab991547578698448eec0c9a1e P 3b7f4efcc13f42f4ab96addec306cee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:06.373657 22091 raft_consensus.cc:1275] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [term 5 FOLLOWER]: Refusing update from remote peer 4b7d59dcbbf84f1bb2b2049660a3d342: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:09:06.374796 22288 consensus_queue.cc:1048] T fa5860143f19403b948282a6b7cd0009 P 4b7d59dcbbf84f1bb2b2049660a3d342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:06.381944 21943 raft_consensus.cc:1275] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 5 FOLLOWER]: Refusing update from remote peer 4b7d59dcbbf84f1bb2b2049660a3d342: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:09:06.383649 22301 consensus_queue.cc:1048] T fa5860143f19403b948282a6b7cd0009 P 4b7d59dcbbf84f1bb2b2049660a3d342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:06.476266 21943 raft_consensus.cc:1275] T 733e3d7ad96747ee94d57562d0fe9143 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 4 FOLLOWER]: Refusing update from remote peer 4b7d59dcbbf84f1bb2b2049660a3d342: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:06.477485 22301 consensus_queue.cc:1048] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df5a1658ec74fa2a6e1b737cd0dac7c" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 44261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:06.487453 22091 raft_consensus.cc:1275] T 733e3d7ad96747ee94d57562d0fe9143 P 3b7f4efcc13f42f4ab96addec306cee4 [term 4 FOLLOWER]: Refusing update from remote peer 4b7d59dcbbf84f1bb2b2049660a3d342: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:06.488873 22314 consensus_queue.cc:1048] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7f4efcc13f42f4ab96addec306cee4" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 44695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:06.522904 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:06.528810 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:06.529222 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:07.530130 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:07.535636 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:07.536084 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:08.536957 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:08.542397 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:08.542832 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:09.543869 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:09.549800 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:09.550210 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:10.551091 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:10.556849 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:10.557224 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:11.558096 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:11.563486 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:11.563977 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:12.564978 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:12.570472 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:12.570951 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:13.571935 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:13.577358 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:13.577854 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:14.578884 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:14.585402 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:14.585846 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:15.616508 21266 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:09:15.617117 21266 tablet_server.cc:179] TabletServer@127.20.196.129:0 shutting down...
I20260709 12:09:15.648850 21266 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:09:15.649605 21266 tablet_replica.cc:333] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c: stopping tablet replica
I20260709 12:09:15.650242 21266 raft_consensus.cc:2243] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.651221 21266 raft_consensus.cc:2272] T a1aa66b1382a4e29b37da4673524a913 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.653128 21266 tablet_replica.cc:333] T e190f1787d334b69a152e6d9ed4fa6c5 P 2df5a1658ec74fa2a6e1b737cd0dac7c: stopping tablet replica
I20260709 12:09:15.653676 21266 raft_consensus.cc:2243] T e190f1787d334b69a152e6d9ed4fa6c5 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.654469 21266 raft_consensus.cc:2272] T e190f1787d334b69a152e6d9ed4fa6c5 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.656291 21266 tablet_replica.cc:333] T 29408da1bbbe45658dd4f5d47cf5f343 P 2df5a1658ec74fa2a6e1b737cd0dac7c: stopping tablet replica
I20260709 12:09:15.656860 21266 raft_consensus.cc:2243] T 29408da1bbbe45658dd4f5d47cf5f343 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.657284 21266 raft_consensus.cc:2272] T 29408da1bbbe45658dd4f5d47cf5f343 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.659088 21266 tablet_replica.cc:333] T 7a3260ab991547578698448eec0c9a1e P 2df5a1658ec74fa2a6e1b737cd0dac7c: stopping tablet replica
I20260709 12:09:15.659586 21266 raft_consensus.cc:2243] T 7a3260ab991547578698448eec0c9a1e P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.660027 21266 raft_consensus.cc:2272] T 7a3260ab991547578698448eec0c9a1e P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.661700 21266 tablet_replica.cc:333] T f45f49951c264158be7f17b17dc18bf7 P 2df5a1658ec74fa2a6e1b737cd0dac7c: stopping tablet replica
I20260709 12:09:15.662179 21266 raft_consensus.cc:2243] T f45f49951c264158be7f17b17dc18bf7 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.662581 21266 raft_consensus.cc:2272] T f45f49951c264158be7f17b17dc18bf7 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.664361 21266 tablet_replica.cc:333] T 733e3d7ad96747ee94d57562d0fe9143 P 2df5a1658ec74fa2a6e1b737cd0dac7c: stopping tablet replica
I20260709 12:09:15.664870 21266 raft_consensus.cc:2243] T 733e3d7ad96747ee94d57562d0fe9143 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.665292 21266 raft_consensus.cc:2272] T 733e3d7ad96747ee94d57562d0fe9143 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.666915 21266 tablet_replica.cc:333] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c: stopping tablet replica
I20260709 12:09:15.667477 21266 raft_consensus.cc:2243] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.668218 21266 raft_consensus.cc:2272] T 5b9c4b6520ef4335bed3196d7377bff3 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.669771 21266 tablet_replica.cc:333] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 2df5a1658ec74fa2a6e1b737cd0dac7c: stopping tablet replica
I20260709 12:09:15.670230 21266 raft_consensus.cc:2243] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.670970 21266 raft_consensus.cc:2272] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.672725 21266 tablet_replica.cc:333] T 1c592155a37544428a176145caf18cf9 P 2df5a1658ec74fa2a6e1b737cd0dac7c: stopping tablet replica
I20260709 12:09:15.673195 21266 raft_consensus.cc:2243] T 1c592155a37544428a176145caf18cf9 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.673602 21266 raft_consensus.cc:2272] T 1c592155a37544428a176145caf18cf9 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.675300 21266 tablet_replica.cc:333] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c: stopping tablet replica
I20260709 12:09:15.675724 21266 raft_consensus.cc:2243] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.676141 21266 raft_consensus.cc:2272] T fa5860143f19403b948282a6b7cd0009 P 2df5a1658ec74fa2a6e1b737cd0dac7c [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:09:15.704180 22058 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.196.129:44261: connect: Connection refused (error 111) [suppressed 2 similar messages]
W20260709 12:09:15.707693 22058 consensus_peers.cc:597] T f45f49951c264158be7f17b17dc18bf7 P 3b7f4efcc13f42f4ab96addec306cee4 -> Peer 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129:44261): Couldn't send request to peer 2df5a1658ec74fa2a6e1b737cd0dac7c. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:44261: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:15.713862 21266 tablet_server.cc:196] TabletServer@127.20.196.129:0 shutdown complete.
I20260709 12:09:15.734689 21266 tablet_server.cc:179] TabletServer@127.20.196.130:0 shutting down...
W20260709 12:09:15.740893 22055 consensus_peers.cc:597] T 7a3260ab991547578698448eec0c9a1e P 3b7f4efcc13f42f4ab96addec306cee4 -> Peer 4b7d59dcbbf84f1bb2b2049660a3d342 (127.20.196.130:40715): Couldn't send request to peer 4b7d59dcbbf84f1bb2b2049660a3d342. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:15.760874 21266 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:09:15.761662 21266 tablet_replica.cc:333] T a1aa66b1382a4e29b37da4673524a913 P 4b7d59dcbbf84f1bb2b2049660a3d342: stopping tablet replica
I20260709 12:09:15.762382 21266 raft_consensus.cc:2243] T a1aa66b1382a4e29b37da4673524a913 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.762835 21266 raft_consensus.cc:2272] T a1aa66b1382a4e29b37da4673524a913 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.764668 21266 tablet_replica.cc:333] T 1c592155a37544428a176145caf18cf9 P 4b7d59dcbbf84f1bb2b2049660a3d342: stopping tablet replica
I20260709 12:09:15.765115 21266 raft_consensus.cc:2243] T 1c592155a37544428a176145caf18cf9 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.765834 21266 raft_consensus.cc:2272] T 1c592155a37544428a176145caf18cf9 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.767520 21266 tablet_replica.cc:333] T fa5860143f19403b948282a6b7cd0009 P 4b7d59dcbbf84f1bb2b2049660a3d342: stopping tablet replica
I20260709 12:09:15.768074 21266 raft_consensus.cc:2243] T fa5860143f19403b948282a6b7cd0009 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.768806 21266 raft_consensus.cc:2272] T fa5860143f19403b948282a6b7cd0009 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.770422 21266 tablet_replica.cc:333] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342: stopping tablet replica
I20260709 12:09:15.770915 21266 raft_consensus.cc:2243] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.771726 21266 raft_consensus.cc:2272] T 733e3d7ad96747ee94d57562d0fe9143 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.773406 21266 tablet_replica.cc:333] T f45f49951c264158be7f17b17dc18bf7 P 4b7d59dcbbf84f1bb2b2049660a3d342: stopping tablet replica
I20260709 12:09:15.773903 21266 raft_consensus.cc:2243] T f45f49951c264158be7f17b17dc18bf7 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.774353 21266 raft_consensus.cc:2272] T f45f49951c264158be7f17b17dc18bf7 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.775995 21266 tablet_replica.cc:333] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 4b7d59dcbbf84f1bb2b2049660a3d342: stopping tablet replica
I20260709 12:09:15.776479 21266 raft_consensus.cc:2243] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.776865 21266 raft_consensus.cc:2272] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.778676 21266 tablet_replica.cc:333] T 5b9c4b6520ef4335bed3196d7377bff3 P 4b7d59dcbbf84f1bb2b2049660a3d342: stopping tablet replica
I20260709 12:09:15.779304 21266 raft_consensus.cc:2243] T 5b9c4b6520ef4335bed3196d7377bff3 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.779804 21266 raft_consensus.cc:2272] T 5b9c4b6520ef4335bed3196d7377bff3 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.781533 21266 tablet_replica.cc:333] T e190f1787d334b69a152e6d9ed4fa6c5 P 4b7d59dcbbf84f1bb2b2049660a3d342: stopping tablet replica
I20260709 12:09:15.782045 21266 raft_consensus.cc:2243] T e190f1787d334b69a152e6d9ed4fa6c5 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.782558 21266 raft_consensus.cc:2272] T e190f1787d334b69a152e6d9ed4fa6c5 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.784904 21266 tablet_replica.cc:333] T 7a3260ab991547578698448eec0c9a1e P 4b7d59dcbbf84f1bb2b2049660a3d342: stopping tablet replica
I20260709 12:09:15.785405 21266 raft_consensus.cc:2243] T 7a3260ab991547578698448eec0c9a1e P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.785909 21266 raft_consensus.cc:2272] T 7a3260ab991547578698448eec0c9a1e P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.788168 21266 tablet_replica.cc:333] T 29408da1bbbe45658dd4f5d47cf5f343 P 4b7d59dcbbf84f1bb2b2049660a3d342: stopping tablet replica
W20260709 12:09:15.788100 22058 consensus_peers.cc:597] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4 -> Peer 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129:44261): Couldn't send request to peer 2df5a1658ec74fa2a6e1b737cd0dac7c. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:44261: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:15.788789 21266 raft_consensus.cc:2243] T 29408da1bbbe45658dd4f5d47cf5f343 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.789281 21266 raft_consensus.cc:2272] T 29408da1bbbe45658dd4f5d47cf5f343 P 4b7d59dcbbf84f1bb2b2049660a3d342 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.819728 21266 tablet_server.cc:196] TabletServer@127.20.196.130:0 shutdown complete.
W20260709 12:09:15.841442 22058 consensus_peers.cc:597] T 7a3260ab991547578698448eec0c9a1e P 3b7f4efcc13f42f4ab96addec306cee4 -> Peer 2df5a1658ec74fa2a6e1b737cd0dac7c (127.20.196.129:44261): Couldn't send request to peer 2df5a1658ec74fa2a6e1b737cd0dac7c. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:44261: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:15.842229 21266 tablet_server.cc:179] TabletServer@127.20.196.131:0 shutting down...
I20260709 12:09:15.869246 21266 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:09:15.869956 21266 tablet_replica.cc:333] T 733e3d7ad96747ee94d57562d0fe9143 P 3b7f4efcc13f42f4ab96addec306cee4: stopping tablet replica
I20260709 12:09:15.870621 21266 raft_consensus.cc:2243] T 733e3d7ad96747ee94d57562d0fe9143 P 3b7f4efcc13f42f4ab96addec306cee4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.871273 21266 raft_consensus.cc:2272] T 733e3d7ad96747ee94d57562d0fe9143 P 3b7f4efcc13f42f4ab96addec306cee4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.873241 21266 tablet_replica.cc:333] T f45f49951c264158be7f17b17dc18bf7 P 3b7f4efcc13f42f4ab96addec306cee4: stopping tablet replica
I20260709 12:09:15.873807 21266 raft_consensus.cc:2243] T f45f49951c264158be7f17b17dc18bf7 P 3b7f4efcc13f42f4ab96addec306cee4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.874614 21266 raft_consensus.cc:2272] T f45f49951c264158be7f17b17dc18bf7 P 3b7f4efcc13f42f4ab96addec306cee4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.876425 21266 tablet_replica.cc:333] T 5b9c4b6520ef4335bed3196d7377bff3 P 3b7f4efcc13f42f4ab96addec306cee4: stopping tablet replica
I20260709 12:09:15.876971 21266 raft_consensus.cc:2243] T 5b9c4b6520ef4335bed3196d7377bff3 P 3b7f4efcc13f42f4ab96addec306cee4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.877429 21266 raft_consensus.cc:2272] T 5b9c4b6520ef4335bed3196d7377bff3 P 3b7f4efcc13f42f4ab96addec306cee4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.879249 21266 tablet_replica.cc:333] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 3b7f4efcc13f42f4ab96addec306cee4: stopping tablet replica
I20260709 12:09:15.879743 21266 raft_consensus.cc:2243] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 3b7f4efcc13f42f4ab96addec306cee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.880158 21266 raft_consensus.cc:2272] T 5d8234dd8acb4a8ebc63dc36e6f73c31 P 3b7f4efcc13f42f4ab96addec306cee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.881897 21266 tablet_replica.cc:333] T 7a3260ab991547578698448eec0c9a1e P 3b7f4efcc13f42f4ab96addec306cee4: stopping tablet replica
I20260709 12:09:15.882409 21266 raft_consensus.cc:2243] T 7a3260ab991547578698448eec0c9a1e P 3b7f4efcc13f42f4ab96addec306cee4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.883261 21266 raft_consensus.cc:2272] T 7a3260ab991547578698448eec0c9a1e P 3b7f4efcc13f42f4ab96addec306cee4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.885059 21266 tablet_replica.cc:333] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4: stopping tablet replica
I20260709 12:09:15.885627 21266 raft_consensus.cc:2243] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.886556 21266 raft_consensus.cc:2272] T 29408da1bbbe45658dd4f5d47cf5f343 P 3b7f4efcc13f42f4ab96addec306cee4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.888260 21266 tablet_replica.cc:333] T e190f1787d334b69a152e6d9ed4fa6c5 P 3b7f4efcc13f42f4ab96addec306cee4: stopping tablet replica
I20260709 12:09:15.888738 21266 raft_consensus.cc:2243] T e190f1787d334b69a152e6d9ed4fa6c5 P 3b7f4efcc13f42f4ab96addec306cee4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.889146 21266 raft_consensus.cc:2272] T e190f1787d334b69a152e6d9ed4fa6c5 P 3b7f4efcc13f42f4ab96addec306cee4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.890673 21266 tablet_replica.cc:333] T a1aa66b1382a4e29b37da4673524a913 P 3b7f4efcc13f42f4ab96addec306cee4: stopping tablet replica
I20260709 12:09:15.891150 21266 raft_consensus.cc:2243] T a1aa66b1382a4e29b37da4673524a913 P 3b7f4efcc13f42f4ab96addec306cee4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.891575 21266 raft_consensus.cc:2272] T a1aa66b1382a4e29b37da4673524a913 P 3b7f4efcc13f42f4ab96addec306cee4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.893209 21266 tablet_replica.cc:333] T 1c592155a37544428a176145caf18cf9 P 3b7f4efcc13f42f4ab96addec306cee4: stopping tablet replica
I20260709 12:09:15.893659 21266 raft_consensus.cc:2243] T 1c592155a37544428a176145caf18cf9 P 3b7f4efcc13f42f4ab96addec306cee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.894165 21266 raft_consensus.cc:2272] T 1c592155a37544428a176145caf18cf9 P 3b7f4efcc13f42f4ab96addec306cee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.895956 21266 tablet_replica.cc:333] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4: stopping tablet replica
I20260709 12:09:15.896426 21266 raft_consensus.cc:2243] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.896906 21266 raft_consensus.cc:2272] T fa5860143f19403b948282a6b7cd0009 P 3b7f4efcc13f42f4ab96addec306cee4 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.926900 21266 tablet_server.cc:196] TabletServer@127.20.196.131:0 shutdown complete.
I20260709 12:09:15.947325 21266 master.cc:562] Master@127.20.196.190:40929 shutting down...
I20260709 12:09:15.968451 21266 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b951ffce9822474a9bbe184dc18e5ebb [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.969049 21266 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b951ffce9822474a9bbe184dc18e5ebb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.969555 21266 tablet_replica.cc:333] T 00000000000000000000000000000000 P b951ffce9822474a9bbe184dc18e5ebb: stopping tablet replica
I20260709 12:09:15.988701 21266 master.cc:584] Master@127.20.196.190:40929 shutdown complete.
2df5a1658ec74fa2a6e1b737cd0dac7c  5
3b7f4efcc13f42f4ab96addec306cee4  1
4b7d59dcbbf84f1bb2b2049660a3d342  4
2df5a1658ec74fa2a6e1b737cd0dac7c  3
3b7f4efcc13f42f4ab96addec306cee4  3
4b7d59dcbbf84f1bb2b2049660a3d342  4
2df5a1658ec74fa2a6e1b737cd0dac7c  8
3b7f4efcc13f42f4ab96addec306cee4  1
4b7d59dcbbf84f1bb2b2049660a3d342  1
2df5a1658ec74fa2a6e1b737cd0dac7c  4
3b7f4efcc13f42f4ab96addec306cee4  3
4b7d59dcbbf84f1bb2b2049660a3d342  3
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (28656 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:09:16.031169 21266 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.196.190:44877
I20260709 12:09:16.032356 21266 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:16.038215 22330 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:16.038460 22331 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:16.039907 22333 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:16.040984 21266 server_base.cc:1061] running on GCE node
I20260709 12:09:16.041853 21266 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:16.042033 21266 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:16.042227 21266 hybrid_clock.cc:648] HybridClock initialized: now 1783598956042195 us; error 0 us; skew 500 ppm
I20260709 12:09:16.042797 21266 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:16.045406 21266 webserver.cc:533] Webserver started at http://127.20.196.190:44583/ using document root <none> and password file <none>
I20260709 12:09:16.045922 21266 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:16.046132 21266 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:16.046414 21266 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:16.047644 21266 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/master-0-root/instance:
uuid: "136fd3da76544029a815aef59e698e17"
format_stamp: "Formatted at 2026-07-09 12:09:16 on dist-test-slave-h6sg"
I20260709 12:09:16.052107 21266 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:09:16.055548 22338 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:16.056412 21266 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.002s
I20260709 12:09:16.056653 21266 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/master-0-root
uuid: "136fd3da76544029a815aef59e698e17"
format_stamp: "Formatted at 2026-07-09 12:09:16 on dist-test-slave-h6sg"
I20260709 12:09:16.056879 21266 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:16.068710 21266 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:16.069904 21266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:16.109612 21266 rpc_server.cc:307] RPC server started. Bound to: 127.20.196.190:44877
I20260709 12:09:16.109709 22389 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.196.190:44877 every 8 connection(s)
I20260709 12:09:16.113747 22390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.123543 22390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 136fd3da76544029a815aef59e698e17: Bootstrap starting.
I20260709 12:09:16.128260 22390 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 136fd3da76544029a815aef59e698e17: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.132687 22390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 136fd3da76544029a815aef59e698e17: No bootstrap required, opened a new log
I20260709 12:09:16.134903 22390 raft_consensus.cc:359] T 00000000000000000000000000000000 P 136fd3da76544029a815aef59e698e17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "136fd3da76544029a815aef59e698e17" member_type: VOTER }
I20260709 12:09:16.135426 22390 raft_consensus.cc:385] T 00000000000000000000000000000000 P 136fd3da76544029a815aef59e698e17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.135699 22390 raft_consensus.cc:740] T 00000000000000000000000000000000 P 136fd3da76544029a815aef59e698e17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 136fd3da76544029a815aef59e698e17, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.136389 22390 consensus_queue.cc:260] T 00000000000000000000000000000000 P 136fd3da76544029a815aef59e698e17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "136fd3da76544029a815aef59e698e17" member_type: VOTER }
I20260709 12:09:16.136855 22390 raft_consensus.cc:399] T 00000000000000000000000000000000 P 136fd3da76544029a815aef59e698e17 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:09:16.137108 22390 raft_consensus.cc:493] T 00000000000000000000000000000000 P 136fd3da76544029a815aef59e698e17 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:09:16.137391 22390 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 136fd3da76544029a815aef59e698e17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.141865 22390 raft_consensus.cc:515] T 00000000000000000000000000000000 P 136fd3da76544029a815aef59e698e17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "136fd3da76544029a815aef59e698e17" member_type: VOTER }
I20260709 12:09:16.142442 22390 leader_election.cc:304] T 00000000000000000000000000000000 P 136fd3da76544029a815aef59e698e17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 136fd3da76544029a815aef59e698e17; no voters: 
I20260709 12:09:16.143792 22390 leader_election.cc:290] T 00000000000000000000000000000000 P 136fd3da76544029a815aef59e698e17 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:09:16.144200 22393 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 136fd3da76544029a815aef59e698e17 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:16.145640 22393 raft_consensus.cc:697] T 00000000000000000000000000000000 P 136fd3da76544029a815aef59e698e17 [term 1 LEADER]: Becoming Leader. State: Replica: 136fd3da76544029a815aef59e698e17, State: Running, Role: LEADER
I20260709 12:09:16.146400 22393 consensus_queue.cc:237] T 00000000000000000000000000000000 P 136fd3da76544029a815aef59e698e17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "136fd3da76544029a815aef59e698e17" member_type: VOTER }
I20260709 12:09:16.146641 22390 sys_catalog.cc:565] T 00000000000000000000000000000000 P 136fd3da76544029a815aef59e698e17 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:09:16.151288 22394 sys_catalog.cc:455] T 00000000000000000000000000000000 P 136fd3da76544029a815aef59e698e17 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "136fd3da76544029a815aef59e698e17" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "136fd3da76544029a815aef59e698e17" member_type: VOTER } }
I20260709 12:09:16.152103 22394 sys_catalog.cc:458] T 00000000000000000000000000000000 P 136fd3da76544029a815aef59e698e17 [sys.catalog]: This master's current role is: LEADER
I20260709 12:09:16.151893 22395 sys_catalog.cc:455] T 00000000000000000000000000000000 P 136fd3da76544029a815aef59e698e17 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 136fd3da76544029a815aef59e698e17. Latest consensus state: current_term: 1 leader_uuid: "136fd3da76544029a815aef59e698e17" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "136fd3da76544029a815aef59e698e17" member_type: VOTER } }
I20260709 12:09:16.152719 22395 sys_catalog.cc:458] T 00000000000000000000000000000000 P 136fd3da76544029a815aef59e698e17 [sys.catalog]: This master's current role is: LEADER
I20260709 12:09:16.157383 22401 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:09:16.162616 22401 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:09:16.163779 21266 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:09:16.171380 22401 catalog_manager.cc:1383] Generated new cluster ID: e2f1af380bdc4c809776b4aaaf59581c
I20260709 12:09:16.171661 22401 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:09:16.192824 22401 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:09:16.194250 22401 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:09:16.207918 22401 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 136fd3da76544029a815aef59e698e17: Generated new TSK 0
I20260709 12:09:16.208654 22401 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:09:16.230540 21266 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:16.236665 22411 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:16.237804 22412 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:16.239516 21266 server_base.cc:1061] running on GCE node
W20260709 12:09:16.239862 22414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:16.240738 21266 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:16.240958 21266 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:16.241129 21266 hybrid_clock.cc:648] HybridClock initialized: now 1783598956241111 us; error 0 us; skew 500 ppm
I20260709 12:09:16.241658 21266 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:16.244055 21266 webserver.cc:533] Webserver started at http://127.20.196.129:44509/ using document root <none> and password file <none>
I20260709 12:09:16.244535 21266 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:16.244761 21266 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:16.245029 21266 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:16.246057 21266 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-0-root/instance:
uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
format_stamp: "Formatted at 2026-07-09 12:09:16 on dist-test-slave-h6sg"
I20260709 12:09:16.250478 21266 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:09:16.253648 22419 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:16.254514 21266 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:09:16.254911 21266 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-0-root
uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
format_stamp: "Formatted at 2026-07-09 12:09:16 on dist-test-slave-h6sg"
I20260709 12:09:16.255276 21266 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:16.292245 21266 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:16.293439 21266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:16.294950 21266 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:16.297225 21266 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:16.297446 21266 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:16.297706 21266 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:16.297897 21266 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:16.338969 21266 rpc_server.cc:307] RPC server started. Bound to: 127.20.196.129:42317
I20260709 12:09:16.339176 22481 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.196.129:42317 every 8 connection(s)
I20260709 12:09:16.343993 21266 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:16.350504 22486 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:16.352361 22487 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:16.355319 22489 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:16.355540 21266 server_base.cc:1061] running on GCE node
I20260709 12:09:16.356395 21266 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:16.356618 21266 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:16.356760 21266 hybrid_clock.cc:648] HybridClock initialized: now 1783598956356747 us; error 0 us; skew 500 ppm
I20260709 12:09:16.357324 21266 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:16.360052 21266 webserver.cc:533] Webserver started at http://127.20.196.130:44231/ using document root <none> and password file <none>
I20260709 12:09:16.360664 21266 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:16.360898 21266 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:16.361214 21266 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:16.362706 22482 heartbeater.cc:344] Connected to a master server at 127.20.196.190:44877
I20260709 12:09:16.362704 21266 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-1-root/instance:
uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
format_stamp: "Formatted at 2026-07-09 12:09:16 on dist-test-slave-h6sg"
I20260709 12:09:16.363229 22482 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:16.364203 22482 heartbeater.cc:507] Master 127.20.196.190:44877 requested a full tablet report, sending...
I20260709 12:09:16.366509 22355 ts_manager.cc:194] Registered new tserver with Master: c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317)
I20260709 12:09:16.368399 21266 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:09:16.368710 22355 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55962
I20260709 12:09:16.372429 22494 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:16.373214 21266 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 12:09:16.373525 21266 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-1-root
uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
format_stamp: "Formatted at 2026-07-09 12:09:16 on dist-test-slave-h6sg"
I20260709 12:09:16.373797 21266 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:16.392526 21266 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:16.393744 21266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:16.395349 21266 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:16.397861 21266 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:16.398048 21266 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:16.398361 21266 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:16.398505 21266 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:16.442482 21266 rpc_server.cc:307] RPC server started. Bound to: 127.20.196.130:42733
I20260709 12:09:16.442574 22556 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.196.130:42733 every 8 connection(s)
I20260709 12:09:16.447517 21266 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:16.456395 22561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:16.457340 22560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:16.458775 22563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:16.459643 21266 server_base.cc:1061] running on GCE node
I20260709 12:09:16.460553 21266 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:16.460813 21266 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:16.461068 21266 hybrid_clock.cc:648] HybridClock initialized: now 1783598956461048 us; error 0 us; skew 500 ppm
I20260709 12:09:16.461745 21266 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:16.462205 22557 heartbeater.cc:344] Connected to a master server at 127.20.196.190:44877
I20260709 12:09:16.462584 22557 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:16.463815 22557 heartbeater.cc:507] Master 127.20.196.190:44877 requested a full tablet report, sending...
I20260709 12:09:16.464397 21266 webserver.cc:533] Webserver started at http://127.20.196.131:33965/ using document root <none> and password file <none>
I20260709 12:09:16.465016 21266 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:16.465345 21266 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:16.465727 21266 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:16.466317 22355 ts_manager.cc:194] Registered new tserver with Master: 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:16.467265 21266 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-2-root/instance:
uuid: "6c6fa11e8ee34711b3551f0c670442bc"
format_stamp: "Formatted at 2026-07-09 12:09:16 on dist-test-slave-h6sg"
I20260709 12:09:16.468081 22355 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55978
I20260709 12:09:16.472295 21266 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:09:16.476329 22568 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:16.477263 21266 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:09:16.477595 21266 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-2-root
uuid: "6c6fa11e8ee34711b3551f0c670442bc"
format_stamp: "Formatted at 2026-07-09 12:09:16 on dist-test-slave-h6sg"
I20260709 12:09:16.477903 21266 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:16.491961 21266 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:16.493248 21266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:16.494820 21266 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:16.497108 21266 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:16.497349 21266 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:16.497603 21266 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:16.497784 21266 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:16.541929 21266 rpc_server.cc:307] RPC server started. Bound to: 127.20.196.131:37785
I20260709 12:09:16.542052 22630 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.196.131:37785 every 8 connection(s)
I20260709 12:09:16.556406 22631 heartbeater.cc:344] Connected to a master server at 127.20.196.190:44877
I20260709 12:09:16.556824 22631 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:16.557626 22631 heartbeater.cc:507] Master 127.20.196.190:44877 requested a full tablet report, sending...
I20260709 12:09:16.559652 22355 ts_manager.cc:194] Registered new tserver with Master: 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:16.560288 21266 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015183882s
I20260709 12:09:16.561023 22355 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55980
I20260709 12:09:16.586246 22355 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55984:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:09:16.592308 22355 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:09:16.798874 22595 tablet_service.cc:1511] Processing CreateTablet for tablet 13854b1cf45740e680c203d064295c78 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:09:16.799600 22593 tablet_service.cc:1511] Processing CreateTablet for tablet 05f9fdee21394d6e97e0554e30632be7 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:09:16.800480 22595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13854b1cf45740e680c203d064295c78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.801828 22596 tablet_service.cc:1511] Processing CreateTablet for tablet b196b03fbcb045da91c663d6595b2775 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:09:16.803102 22596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b196b03fbcb045da91c663d6595b2775. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.804183 22594 tablet_service.cc:1511] Processing CreateTablet for tablet 30b3fe7a04b74137b559ad33a85cddff (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:09:16.805763 22594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30b3fe7a04b74137b559ad33a85cddff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.808192 22593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05f9fdee21394d6e97e0554e30632be7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.808306 22447 tablet_service.cc:1511] Processing CreateTablet for tablet b196b03fbcb045da91c663d6595b2775 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:09:16.808562 22592 tablet_service.cc:1511] Processing CreateTablet for tablet f00721a4978a43d1af483d9f52de30bc (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:09:16.809643 22447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b196b03fbcb045da91c663d6595b2775. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.809886 22592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f00721a4978a43d1af483d9f52de30bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.812196 22446 tablet_service.cc:1511] Processing CreateTablet for tablet 13854b1cf45740e680c203d064295c78 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:09:16.812397 22591 tablet_service.cc:1511] Processing CreateTablet for tablet 9286627b6c59411d908ec035984616ac (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:09:16.813458 22446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13854b1cf45740e680c203d064295c78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.814361 22591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9286627b6c59411d908ec035984616ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.815702 22445 tablet_service.cc:1511] Processing CreateTablet for tablet 30b3fe7a04b74137b559ad33a85cddff (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:09:16.817322 22445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30b3fe7a04b74137b559ad33a85cddff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.819600 22444 tablet_service.cc:1511] Processing CreateTablet for tablet 05f9fdee21394d6e97e0554e30632be7 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:09:16.821278 22444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05f9fdee21394d6e97e0554e30632be7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.823764 22443 tablet_service.cc:1511] Processing CreateTablet for tablet f00721a4978a43d1af483d9f52de30bc (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:09:16.825395 22443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f00721a4978a43d1af483d9f52de30bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.827837 22442 tablet_service.cc:1511] Processing CreateTablet for tablet 9286627b6c59411d908ec035984616ac (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:09:16.829527 22442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9286627b6c59411d908ec035984616ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.831955 22441 tablet_service.cc:1511] Processing CreateTablet for tablet ee8d73c903fd41f7b207be9ca1cada33 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:09:16.833598 22441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee8d73c903fd41f7b207be9ca1cada33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.838145 22522 tablet_service.cc:1511] Processing CreateTablet for tablet b196b03fbcb045da91c663d6595b2775 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:09:16.839515 22522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b196b03fbcb045da91c663d6595b2775. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.839713 22517 tablet_service.cc:1511] Processing CreateTablet for tablet 9286627b6c59411d908ec035984616ac (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:09:16.840978 22517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9286627b6c59411d908ec035984616ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.844224 22521 tablet_service.cc:1511] Processing CreateTablet for tablet 13854b1cf45740e680c203d064295c78 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:09:16.845566 22521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13854b1cf45740e680c203d064295c78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.846139 22516 tablet_service.cc:1511] Processing CreateTablet for tablet ee8d73c903fd41f7b207be9ca1cada33 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:09:16.847486 22516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee8d73c903fd41f7b207be9ca1cada33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.848157 22520 tablet_service.cc:1511] Processing CreateTablet for tablet 30b3fe7a04b74137b559ad33a85cddff (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:09:16.849406 22520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30b3fe7a04b74137b559ad33a85cddff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.852138 22519 tablet_service.cc:1511] Processing CreateTablet for tablet 05f9fdee21394d6e97e0554e30632be7 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:09:16.853437 22519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05f9fdee21394d6e97e0554e30632be7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.856122 22518 tablet_service.cc:1511] Processing CreateTablet for tablet f00721a4978a43d1af483d9f52de30bc (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:09:16.857391 22518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f00721a4978a43d1af483d9f52de30bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.896768 22646 tablet_bootstrap.cc:492] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:16.907558 22646 tablet_bootstrap.cc:654] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.937688 22647 tablet_bootstrap.cc:492] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:16.947117 22596 tablet_service.cc:1511] Processing CreateTablet for tablet ee8d73c903fd41f7b207be9ca1cada33 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:09:16.948506 22596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee8d73c903fd41f7b207be9ca1cada33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.950831 22440 tablet_service.cc:1511] Processing CreateTablet for tablet 08a2fbce096642eb849b1a143f8e7bb9 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:09:16.952170 22440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08a2fbce096642eb849b1a143f8e7bb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.968766 22516 tablet_service.cc:1511] Processing CreateTablet for tablet 08a2fbce096642eb849b1a143f8e7bb9 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:09:16.970515 22516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08a2fbce096642eb849b1a143f8e7bb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.974032 22515 tablet_service.cc:1511] Processing CreateTablet for tablet cf7e3d0e753849fcb1514dc105ababfd (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:09:16.979140 22515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf7e3d0e753849fcb1514dc105ababfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.983934 22440 tablet_service.cc:1511] Processing CreateTablet for tablet cf7e3d0e753849fcb1514dc105ababfd (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:09:16.985389 22440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf7e3d0e753849fcb1514dc105ababfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.988222 22444 tablet_service.cc:1511] Processing CreateTablet for tablet 272afea078f74bf19baefd3c1300644d (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:09:16.989921 22444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 272afea078f74bf19baefd3c1300644d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.995863 22647 tablet_bootstrap.cc:654] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.997661 22593 tablet_service.cc:1511] Processing CreateTablet for tablet 08a2fbce096642eb849b1a143f8e7bb9 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:09:16.998900 22593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08a2fbce096642eb849b1a143f8e7bb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.999105 22592 tablet_service.cc:1511] Processing CreateTablet for tablet cf7e3d0e753849fcb1514dc105ababfd (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:09:17.000248 22592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf7e3d0e753849fcb1514dc105ababfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.004654 22646 tablet_bootstrap.cc:492] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:17.011337 22646 ts_tablet_manager.cc:1403] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.115s	user 0.014s	sys 0.000s
I20260709 12:09:17.014240 22646 raft_consensus.cc:359] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.015004 22646 raft_consensus.cc:385] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.015586 22646 raft_consensus.cc:740] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.019430 22646 consensus_queue.cc:260] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.016897 22648 tablet_bootstrap.cc:492] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:17.032974 22648 tablet_bootstrap.cc:654] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.034174 22516 tablet_service.cc:1511] Processing CreateTablet for tablet 272afea078f74bf19baefd3c1300644d (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:09:17.035558 22516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 272afea078f74bf19baefd3c1300644d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.037325 22445 tablet_service.cc:1511] Processing CreateTablet for tablet bf783936508640219af47375c444da09 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:09:17.038581 22445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf783936508640219af47375c444da09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.034174 22592 tablet_service.cc:1511] Processing CreateTablet for tablet 272afea078f74bf19baefd3c1300644d (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:09:17.044778 22592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 272afea078f74bf19baefd3c1300644d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.047957 22647 tablet_bootstrap.cc:492] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:17.048615 22647 ts_tablet_manager.cc:1403] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.111s	user 0.010s	sys 0.002s
I20260709 12:09:17.051587 22647 raft_consensus.cc:359] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.052318 22647 raft_consensus.cc:385] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.052670 22647 raft_consensus.cc:740] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.053572 22647 consensus_queue.cc:260] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.062898 22516 tablet_service.cc:1511] Processing CreateTablet for tablet bf783936508640219af47375c444da09 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:09:17.064353 22516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf783936508640219af47375c444da09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.068678 22557 heartbeater.cc:499] Master 127.20.196.190:44877 was elected leader, sending a full tablet report...
I20260709 12:09:17.071596 22444 tablet_service.cc:1511] Processing CreateTablet for tablet 19a99176cd014d618ba1793fbb19aeab (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:09:17.072907 22444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19a99176cd014d618ba1793fbb19aeab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.081832 22647 ts_tablet_manager.cc:1434] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.033s	user 0.003s	sys 0.008s
I20260709 12:09:17.083105 22647 tablet_bootstrap.cc:492] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:17.092446 22631 heartbeater.cc:499] Master 127.20.196.190:44877 was elected leader, sending a full tablet report...
I20260709 12:09:17.093940 22648 tablet_bootstrap.cc:492] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:17.094400 22648 ts_tablet_manager.cc:1403] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.078s	user 0.014s	sys 0.020s
I20260709 12:09:17.097404 22648 raft_consensus.cc:359] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.098143 22648 raft_consensus.cc:385] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.098452 22648 raft_consensus.cc:740] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.099193 22648 consensus_queue.cc:260] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.099676 22593 tablet_service.cc:1511] Processing CreateTablet for tablet bf783936508640219af47375c444da09 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:09:17.100952 22593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf783936508640219af47375c444da09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.101352 22482 heartbeater.cc:499] Master 127.20.196.190:44877 was elected leader, sending a full tablet report...
I20260709 12:09:17.101869 22648 ts_tablet_manager.cc:1434] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:09:17.102818 22648 tablet_bootstrap.cc:492] T 13854b1cf45740e680c203d064295c78 P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:17.106101 22518 tablet_service.cc:1511] Processing CreateTablet for tablet 19a99176cd014d618ba1793fbb19aeab (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:09:17.109283 22646 ts_tablet_manager.cc:1434] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.098s	user 0.015s	sys 0.022s
I20260709 12:09:17.110343 22648 tablet_bootstrap.cc:654] T 13854b1cf45740e680c203d064295c78 P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.110563 22646 tablet_bootstrap.cc:492] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:17.112257 22518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19a99176cd014d618ba1793fbb19aeab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.118085 22646 tablet_bootstrap.cc:654] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.121693 22647 tablet_bootstrap.cc:654] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.135530 22647 tablet_bootstrap.cc:492] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:17.135902 22592 tablet_service.cc:1511] Processing CreateTablet for tablet 19a99176cd014d618ba1793fbb19aeab (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:09:17.136808 22647 ts_tablet_manager.cc:1403] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.054s	user 0.010s	sys 0.005s
I20260709 12:09:17.137781 22592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19a99176cd014d618ba1793fbb19aeab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.141006 22647 raft_consensus.cc:359] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.149300 22517 tablet_service.cc:1511] Processing CreateTablet for tablet a2337c1c696448c287a9a1885624d3d0 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:09:17.149778 22648 tablet_bootstrap.cc:492] T 13854b1cf45740e680c203d064295c78 P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:17.150679 22648 ts_tablet_manager.cc:1403] T 13854b1cf45740e680c203d064295c78 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.048s	user 0.024s	sys 0.007s
I20260709 12:09:17.151083 22596 tablet_service.cc:1511] Processing CreateTablet for tablet a2337c1c696448c287a9a1885624d3d0 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:09:17.152454 22596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2337c1c696448c287a9a1885624d3d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.153501 22648 raft_consensus.cc:359] T 13854b1cf45740e680c203d064295c78 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.153741 22440 tablet_service.cc:1511] Processing CreateTablet for tablet b955a164159b49b9bf083e35e340e323 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:09:17.154213 22648 raft_consensus.cc:385] T 13854b1cf45740e680c203d064295c78 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.154580 22648 raft_consensus.cc:740] T 13854b1cf45740e680c203d064295c78 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.155027 22440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b955a164159b49b9bf083e35e340e323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.154776 22515 tablet_service.cc:1511] Processing CreateTablet for tablet b955a164159b49b9bf083e35e340e323 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:09:17.155395 22648 consensus_queue.cc:260] T 13854b1cf45740e680c203d064295c78 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.151067 22445 tablet_service.cc:1511] Processing CreateTablet for tablet a2337c1c696448c287a9a1885624d3d0 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:09:17.162703 22648 ts_tablet_manager.cc:1434] T 13854b1cf45740e680c203d064295c78 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:09:17.163166 22445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2337c1c696448c287a9a1885624d3d0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:17.159217 22403 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:17.163702 22648 tablet_bootstrap.cc:492] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:17.172657 22515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b955a164159b49b9bf083e35e340e323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.173281 22517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2337c1c696448c287a9a1885624d3d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.171376 22647 raft_consensus.cc:385] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.177980 22648 tablet_bootstrap.cc:654] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.183104 22592 tablet_service.cc:1511] Processing CreateTablet for tablet b955a164159b49b9bf083e35e340e323 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:09:17.178148 22647 raft_consensus.cc:740] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.184684 22592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b955a164159b49b9bf083e35e340e323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.184813 22647 consensus_queue.cc:260] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.190290 22647 ts_tablet_manager.cc:1434] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.001s
I20260709 12:09:17.192310 22647 tablet_bootstrap.cc:492] T 05f9fdee21394d6e97e0554e30632be7 P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:17.193042 22654 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.195168 22646 tablet_bootstrap.cc:492] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:17.195701 22646 ts_tablet_manager.cc:1403] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.085s	user 0.026s	sys 0.012s
I20260709 12:09:17.195266 22654 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.201128 22647 tablet_bootstrap.cc:654] T 05f9fdee21394d6e97e0554e30632be7 P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.202261 22646 raft_consensus.cc:359] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.203033 22646 raft_consensus.cc:385] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.203322 22646 raft_consensus.cc:740] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.204037 22646 consensus_queue.cc:260] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.206087 22646 ts_tablet_manager.cc:1434] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 12:09:17.206956 22646 tablet_bootstrap.cc:492] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:17.207141 22654 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:17.211602 22651 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.212069 22651 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.212604 22646 tablet_bootstrap.cc:654] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.214748 22651 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:17.229851 22654 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.230651 22654 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.233351 22654 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:17.239566 22515 tablet_service.cc:1511] Processing CreateTablet for tablet b205f960deef48f8bc84127a8b47faf4 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:09:17.242007 22515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b205f960deef48f8bc84127a8b47faf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.246132 22445 tablet_service.cc:1511] Processing CreateTablet for tablet b205f960deef48f8bc84127a8b47faf4 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:09:17.246404 22440 tablet_service.cc:1511] Processing CreateTablet for tablet 88417720c1014406ad04d7fb6b8f7ab4 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:09:17.247776 22445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b205f960deef48f8bc84127a8b47faf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.248780 22592 tablet_service.cc:1511] Processing CreateTablet for tablet b205f960deef48f8bc84127a8b47faf4 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:09:17.249992 22592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b205f960deef48f8bc84127a8b47faf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.251498 22440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88417720c1014406ad04d7fb6b8f7ab4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.281751 22517 tablet_service.cc:1511] Processing CreateTablet for tablet 88417720c1014406ad04d7fb6b8f7ab4 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:09:17.283195 22517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88417720c1014406ad04d7fb6b8f7ab4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.285392 22444 tablet_service.cc:1511] Processing CreateTablet for tablet 9b31ce17d24644c19dbf9469c435d149 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:09:17.286638 22444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b31ce17d24644c19dbf9469c435d149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.289248 22596 tablet_service.cc:1511] Processing CreateTablet for tablet 88417720c1014406ad04d7fb6b8f7ab4 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:09:17.290493 22596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88417720c1014406ad04d7fb6b8f7ab4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.291934 22516 tablet_service.cc:1511] Processing CreateTablet for tablet 9b31ce17d24644c19dbf9469c435d149 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:09:17.293159 22516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b31ce17d24644c19dbf9469c435d149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.309571 22648 tablet_bootstrap.cc:492] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:17.310117 22648 ts_tablet_manager.cc:1403] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.147s	user 0.024s	sys 0.022s
I20260709 12:09:17.313072 22648 raft_consensus.cc:359] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.313630 22648 raft_consensus.cc:385] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.313898 22648 raft_consensus.cc:740] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.314599 22648 consensus_queue.cc:260] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.316614 22648 ts_tablet_manager.cc:1434] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:09:17.317498 22648 tablet_bootstrap.cc:492] T 08a2fbce096642eb849b1a143f8e7bb9 P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:17.322614 22647 tablet_bootstrap.cc:492] T 05f9fdee21394d6e97e0554e30632be7 P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:17.323189 22647 ts_tablet_manager.cc:1403] T 05f9fdee21394d6e97e0554e30632be7 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.131s	user 0.024s	sys 0.020s
I20260709 12:09:17.326006 22647 raft_consensus.cc:359] T 05f9fdee21394d6e97e0554e30632be7 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.326761 22647 raft_consensus.cc:385] T 05f9fdee21394d6e97e0554e30632be7 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.327144 22647 raft_consensus.cc:740] T 05f9fdee21394d6e97e0554e30632be7 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.328053 22647 consensus_queue.cc:260] T 05f9fdee21394d6e97e0554e30632be7 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.331164 22648 tablet_bootstrap.cc:654] T 08a2fbce096642eb849b1a143f8e7bb9 P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.335124 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:17.335933 22532 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 0.
I20260709 12:09:17.337342 22570 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:09:17.338295 22651 raft_consensus.cc:2804] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.338649 22651 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.338959 22651 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.339929 22647 ts_tablet_manager.cc:1434] T 05f9fdee21394d6e97e0554e30632be7 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:09:17.346306 22651 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.349114 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:17.349767 22531 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 0.
I20260709 12:09:17.350641 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:17.350711 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:17.351393 22530 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.351501 22532 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 0.
I20260709 12:09:17.354048 22647 tablet_bootstrap.cc:492] T b196b03fbcb045da91c663d6595b2775 P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:17.355623 22421 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:17.356659 22421 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:17.357563 22654 raft_consensus.cc:2804] T 13854b1cf45740e680c203d064295c78 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.357928 22654 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.358256 22654 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.360903 22593 tablet_service.cc:1511] Processing CreateTablet for tablet 9b31ce17d24644c19dbf9469c435d149 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:09:17.362172 22593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b31ce17d24644c19dbf9469c435d149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.364372 22517 tablet_service.cc:1511] Processing CreateTablet for tablet 40384260c96247e0ac31ade25baddaff (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:09:17.365638 22517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40384260c96247e0ac31ade25baddaff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.368407 22647 tablet_bootstrap.cc:654] T b196b03fbcb045da91c663d6595b2775 P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.371461 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:17.375522 22605 raft_consensus.cc:2393] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 1: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:09:17.375329 22530 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 1.
I20260709 12:09:17.365621 22654 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.375833 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:17.372212 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:17.376610 22457 raft_consensus.cc:2393] T 13854b1cf45740e680c203d064295c78 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 1: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:09:17.376647 22570 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:09:17.377557 22654 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:17.378105 22654 raft_consensus.cc:2804] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.378427 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:09:17.378965 22422 leader_election.cc:343] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.379415 22457 raft_consensus.cc:2393] T 13854b1cf45740e680c203d064295c78 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 1: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:09:17.379845 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:17.381083 22518 tablet_service.cc:1511] Processing CreateTablet for tablet 4c23033521664ca6a0c00a6f0f552308 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:09:17.378423 22654 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.381943 22606 raft_consensus.cc:2393] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 1: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:09:17.382126 22654 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.382464 22518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c23033521664ca6a0c00a6f0f552308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.386332 22646 tablet_bootstrap.cc:492] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:17.386965 22646 ts_tablet_manager.cc:1403] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.180s	user 0.016s	sys 0.064s
I20260709 12:09:17.389925 22648 tablet_bootstrap.cc:492] T 08a2fbce096642eb849b1a143f8e7bb9 P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:17.390443 22648 ts_tablet_manager.cc:1403] T 08a2fbce096642eb849b1a143f8e7bb9 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.073s	user 0.008s	sys 0.002s
I20260709 12:09:17.391347 22651 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:17.391927 22651 raft_consensus.cc:2804] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.392365 22651 raft_consensus.cc:697] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:09:17.393157 22651 consensus_queue.cc:237] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.395015 22444 tablet_service.cc:1511] Processing CreateTablet for tablet 40384260c96247e0ac31ade25baddaff (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:09:17.396257 22444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40384260c96247e0ac31ade25baddaff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.400280 22592 tablet_service.cc:1511] Processing CreateTablet for tablet 4c23033521664ca6a0c00a6f0f552308 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:09:17.393529 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:17.401646 22592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c23033521664ca6a0c00a6f0f552308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.403168 22440 tablet_service.cc:1511] Processing CreateTablet for tablet 4c23033521664ca6a0c00a6f0f552308 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:09:17.404399 22440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c23033521664ca6a0c00a6f0f552308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.405575 22648 raft_consensus.cc:359] T 08a2fbce096642eb849b1a143f8e7bb9 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.405840 22646 raft_consensus.cc:359] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.406366 22648 raft_consensus.cc:385] T 08a2fbce096642eb849b1a143f8e7bb9 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.406910 22596 tablet_service.cc:1511] Processing CreateTablet for tablet 40384260c96247e0ac31ade25baddaff (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:09:17.406708 22530 raft_consensus.cc:2393] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 1: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:09:17.407543 22648 raft_consensus.cc:740] T 08a2fbce096642eb849b1a143f8e7bb9 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.407516 22646 raft_consensus.cc:385] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.409214 22646 raft_consensus.cc:740] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.409765 22648 consensus_queue.cc:260] T 08a2fbce096642eb849b1a143f8e7bb9 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.410081 22646 consensus_queue.cc:260] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.410526 22421 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:09:17.412387 22646 ts_tablet_manager.cc:1434] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 12:09:17.413518 22596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40384260c96247e0ac31ade25baddaff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.415525 22591 tablet_service.cc:1511] Processing CreateTablet for tablet 1143406a95dd472688b2fe621abd815f (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:09:17.418280 22648 ts_tablet_manager.cc:1434] T 08a2fbce096642eb849b1a143f8e7bb9 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.004s
I20260709 12:09:17.418708 22591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1143406a95dd472688b2fe621abd815f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.419906 22516 tablet_service.cc:1511] Processing CreateTablet for tablet 1143406a95dd472688b2fe621abd815f (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:09:17.421129 22516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1143406a95dd472688b2fe621abd815f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.422127 22667 raft_consensus.cc:2749] T 13854b1cf45740e680c203d064295c78 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.415639 22654 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.427340 22646 tablet_bootstrap.cc:492] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:17.430271 22647 tablet_bootstrap.cc:492] T b196b03fbcb045da91c663d6595b2775 P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:17.430748 22647 ts_tablet_manager.cc:1403] T b196b03fbcb045da91c663d6595b2775 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.077s	user 0.004s	sys 0.006s
I20260709 12:09:17.437191 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:09:17.439144 22422 leader_election.cc:343] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.439158 22648 tablet_bootstrap.cc:492] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:17.445868 22518 tablet_service.cc:1511] Processing CreateTablet for tablet effbc980be0840c9891d7e7b22d3c3ef (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:09:17.447196 22518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet effbc980be0840c9891d7e7b22d3c3ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.447101 22654 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:17.450822 22647 raft_consensus.cc:359] T b196b03fbcb045da91c663d6595b2775 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } }
W20260709 12:09:17.455580 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 45161.3us
I20260709 12:09:17.455319 22647 raft_consensus.cc:385] T b196b03fbcb045da91c663d6595b2775 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.458035 22445 tablet_service.cc:1511] Processing CreateTablet for tablet effbc980be0840c9891d7e7b22d3c3ef (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:09:17.458418 22444 tablet_service.cc:1511] Processing CreateTablet for tablet 1143406a95dd472688b2fe621abd815f (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:09:17.458688 22647 raft_consensus.cc:740] T b196b03fbcb045da91c663d6595b2775 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.464792 22647 consensus_queue.cc:260] T b196b03fbcb045da91c663d6595b2775 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } }
I20260709 12:09:17.464722 22355 catalog_manager.cc:5697] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 1 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:17.465457 22440 tablet_service.cc:1511] Processing CreateTablet for tablet 8c3000c4a87f46b69b5da41dc1115486 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:09:17.459317 22445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet effbc980be0840c9891d7e7b22d3c3ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.460234 22447 tablet_service.cc:1511] Processing CreateTablet for tablet 538826f1cb47443eb083fb9360e7b1fb (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:09:17.466794 22515 tablet_service.cc:1511] Processing CreateTablet for tablet 8c3000c4a87f46b69b5da41dc1115486 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:09:17.460480 22517 tablet_service.cc:1511] Processing CreateTablet for tablet 538826f1cb47443eb083fb9360e7b1fb (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:09:17.453225 22648 tablet_bootstrap.cc:654] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.461808 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:17.461767 22593 tablet_service.cc:1511] Processing CreateTablet for tablet 538826f1cb47443eb083fb9360e7b1fb (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:09:17.469446 22515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c3000c4a87f46b69b5da41dc1115486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.469674 22530 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.470208 22593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 538826f1cb47443eb083fb9360e7b1fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.463284 22646 tablet_bootstrap.cc:654] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.467886 22447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 538826f1cb47443eb083fb9360e7b1fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.476743 22594 tablet_service.cc:1511] Processing CreateTablet for tablet 8c3000c4a87f46b69b5da41dc1115486 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:09:17.477600 22517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 538826f1cb47443eb083fb9360e7b1fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.478089 22594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c3000c4a87f46b69b5da41dc1115486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.474768 22520 tablet_service.cc:1511] Processing CreateTablet for tablet aeff0fdef6b04a46975756455aba1a98 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:09:17.479717 22520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aeff0fdef6b04a46975756455aba1a98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.486619 22595 tablet_service.cc:1511] Processing CreateTablet for tablet aeff0fdef6b04a46975756455aba1a98 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:09:17.488061 22595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aeff0fdef6b04a46975756455aba1a98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.492331 22443 tablet_service.cc:1511] Processing CreateTablet for tablet aeff0fdef6b04a46975756455aba1a98 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:09:17.494199 22671 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.494757 22671 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.497092 22671 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:17.503588 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:09:17.507095 22422 leader_election.cc:343] T 08a2fbce096642eb849b1a143f8e7bb9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.498791 22591 tablet_service.cc:1511] Processing CreateTablet for tablet effbc980be0840c9891d7e7b22d3c3ef (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:09:17.509177 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:17.509389 22522 tablet_service.cc:1511] Processing CreateTablet for tablet f007f8ed533640a9a25704c288c49f3c (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:09:17.510634 22522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f007f8ed533640a9a25704c288c49f3c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:17.510924 22421 leader_election.cc:343] T 08a2fbce096642eb849b1a143f8e7bb9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.511505 22421 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:09:17.513227 22671 raft_consensus.cc:2749] T 08a2fbce096642eb849b1a143f8e7bb9 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.514000 22442 tablet_service.cc:1511] Processing CreateTablet for tablet f007f8ed533640a9a25704c288c49f3c (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:09:17.523070 22440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c3000c4a87f46b69b5da41dc1115486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.523785 22442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f007f8ed533640a9a25704c288c49f3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.524053 22530 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 1.
I20260709 12:09:17.527959 22441 tablet_service.cc:1511] Processing CreateTablet for tablet 00284432759445f6a017e6ddb9ec1689 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:09:17.529853 22647 ts_tablet_manager.cc:1434] T b196b03fbcb045da91c663d6595b2775 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.099s	user 0.007s	sys 0.000s
I20260709 12:09:17.529675 22421 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:09:17.531032 22671 raft_consensus.cc:2804] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.531142 22647 tablet_bootstrap.cc:492] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:17.531231 22443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aeff0fdef6b04a46975756455aba1a98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.531517 22671 raft_consensus.cc:697] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:09:17.532370 22671 consensus_queue.cc:237] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.534277 22441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00284432759445f6a017e6ddb9ec1689. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.542673 22444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1143406a95dd472688b2fe621abd815f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.546322 22646 tablet_bootstrap.cc:492] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:17.523066 22592 tablet_service.cc:1511] Processing CreateTablet for tablet f007f8ed533640a9a25704c288c49f3c (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:09:17.541359 22591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet effbc980be0840c9891d7e7b22d3c3ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.551047 22646 ts_tablet_manager.cc:1403] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.132s	user 0.011s	sys 0.003s
I20260709 12:09:17.558401 22596 tablet_service.cc:1511] Processing CreateTablet for tablet 00284432759445f6a017e6ddb9ec1689 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:09:17.558868 22518 tablet_service.cc:1511] Processing CreateTablet for tablet 00284432759445f6a017e6ddb9ec1689 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:09:17.561224 22518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00284432759445f6a017e6ddb9ec1689. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.562261 22651 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.562888 22651 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.568262 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:09:17.570293 22569 leader_election.cc:343] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.571487 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:09:17.573494 22570 leader_election.cc:343] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.574072 22570 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:17.575358 22668 raft_consensus.cc:2749] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.575556 22592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f007f8ed533640a9a25704c288c49f3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.576503 22651 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:17.578964 22596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00284432759445f6a017e6ddb9ec1689. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.583231 22646 raft_consensus.cc:359] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.584671 22646 raft_consensus.cc:385] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.585006 22646 raft_consensus.cc:740] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.585839 22646 consensus_queue.cc:260] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.590296 22647 tablet_bootstrap.cc:654] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.596374 22668 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.597477 22668 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.600943 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:09:17.602393 22570 leader_election.cc:343] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.601812 22353 catalog_manager.cc:5697] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 0 to 1, leader changed from <none> to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:17.604461 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:09:17.605846 22569 leader_election.cc:343] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.606268 22569 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:17.601848 22668 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:17.607075 22651 raft_consensus.cc:2749] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.608716 22646 ts_tablet_manager.cc:1434] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.000s
I20260709 12:09:17.609614 22646 tablet_bootstrap.cc:492] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:17.611910 22447 tablet_service.cc:1511] Processing CreateTablet for tablet 67b097456aac41edb06c5a4efd504ca1 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:09:17.613458 22447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67b097456aac41edb06c5a4efd504ca1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.619186 22653 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.619647 22653 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } }
I20260709 12:09:17.621884 22520 tablet_service.cc:1511] Processing CreateTablet for tablet 67b097456aac41edb06c5a4efd504ca1 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:09:17.630347 22442 tablet_service.cc:1511] Processing CreateTablet for tablet 1ba02be77861491da7dbcfee1161e46c (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:09:17.632109 22442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ba02be77861491da7dbcfee1161e46c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.638276 22520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67b097456aac41edb06c5a4efd504ca1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.634270 22653 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317)
I20260709 12:09:17.648197 22591 tablet_service.cc:1511] Processing CreateTablet for tablet 1ba02be77861491da7dbcfee1161e46c (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:09:17.650020 22591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ba02be77861491da7dbcfee1161e46c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.656108 22592 tablet_service.cc:1511] Processing CreateTablet for tablet 67b097456aac41edb06c5a4efd504ca1 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:09:17.657898 22592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67b097456aac41edb06c5a4efd504ca1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.671908 22441 tablet_service.cc:1511] Processing CreateTablet for tablet 5b50f0bec71f4924aa1781b9818f1d73 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:09:17.673275 22441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b50f0bec71f4924aa1781b9818f1d73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.689051 22592 tablet_service.cc:1511] Processing CreateTablet for tablet 5b50f0bec71f4924aa1781b9818f1d73 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:09:17.696081 22592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b50f0bec71f4924aa1781b9818f1d73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.692924 22447 tablet_service.cc:1511] Processing CreateTablet for tablet 1b2392d4861b4d40b63dcdab54e716de (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:09:17.697418 22447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b2392d4861b4d40b63dcdab54e716de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.702422 22518 tablet_service.cc:1511] Processing CreateTablet for tablet 1ba02be77861491da7dbcfee1161e46c (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:09:17.703709 22518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ba02be77861491da7dbcfee1161e46c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.689750 22648 tablet_bootstrap.cc:492] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:17.704689 22648 ts_tablet_manager.cc:1403] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.278s	user 0.013s	sys 0.002s
I20260709 12:09:17.712333 22646 tablet_bootstrap.cc:654] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.712392 22522 tablet_service.cc:1511] Processing CreateTablet for tablet 5b50f0bec71f4924aa1781b9818f1d73 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:09:17.713757 22522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b50f0bec71f4924aa1781b9818f1d73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.715222 22648 raft_consensus.cc:359] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.720353 22596 tablet_service.cc:1511] Processing CreateTablet for tablet 1b2392d4861b4d40b63dcdab54e716de (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:09:17.736963 22596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b2392d4861b4d40b63dcdab54e716de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.741750 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:17.742624 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:09:17.743415 22497 leader_election.cc:343] T b196b03fbcb045da91c663d6595b2775 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.743240 22520 tablet_service.cc:1511] Processing CreateTablet for tablet 1b2392d4861b4d40b63dcdab54e716de (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:09:17.742825 22647 tablet_bootstrap.cc:492] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:17.744271 22647 ts_tablet_manager.cc:1403] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.213s	user 0.027s	sys 0.011s
I20260709 12:09:17.744505 22520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b2392d4861b4d40b63dcdab54e716de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.744437 22671 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.744990 22671 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.747184 22671 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:17.747661 22647 raft_consensus.cc:359] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:09:17.744071 22495 leader_election.cc:343] T b196b03fbcb045da91c663d6595b2775 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.748481 22647 raft_consensus.cc:385] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.748870 22495 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:17.749730 22653 raft_consensus.cc:2749] T b196b03fbcb045da91c663d6595b2775 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.749022 22647 raft_consensus.cc:740] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.750851 22647 consensus_queue.cc:260] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.751766 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:17.752382 22530 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 0.
I20260709 12:09:17.752254 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:17.753718 22421 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:09:17.755142 22422 leader_election.cc:343] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.757115 22648 raft_consensus.cc:385] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.757508 22648 raft_consensus.cc:740] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.758486 22647 ts_tablet_manager.cc:1434] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:09:17.759548 22647 tablet_bootstrap.cc:492] T 9286627b6c59411d908ec035984616ac P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:17.760145 22442 tablet_service.cc:1511] Processing CreateTablet for tablet 3aebfd8b04a4461ab6bc979eee23a2bc (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:09:17.762068 22671 raft_consensus.cc:2804] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.762441 22671 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.762775 22671 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.763281 22648 consensus_queue.cc:260] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.770399 22522 tablet_service.cc:1511] Processing CreateTablet for tablet 3aebfd8b04a4461ab6bc979eee23a2bc (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:09:17.772850 22522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3aebfd8b04a4461ab6bc979eee23a2bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.773671 22646 tablet_bootstrap.cc:492] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:17.771826 22442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3aebfd8b04a4461ab6bc979eee23a2bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.774147 22646 ts_tablet_manager.cc:1403] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.165s	user 0.010s	sys 0.010s
I20260709 12:09:17.770576 22671 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.776651 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:17.777269 22530 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.777060 22646 raft_consensus.cc:359] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.777784 22646 raft_consensus.cc:385] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.778086 22646 raft_consensus.cc:740] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.777994 22591 tablet_service.cc:1511] Processing CreateTablet for tablet 3aebfd8b04a4461ab6bc979eee23a2bc (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:09:17.779376 22591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3aebfd8b04a4461ab6bc979eee23a2bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.779016 22646 consensus_queue.cc:260] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.782218 22647 tablet_bootstrap.cc:654] T 9286627b6c59411d908ec035984616ac P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.784168 22530 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 1.
I20260709 12:09:17.784515 22646 ts_tablet_manager.cc:1434] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:09:17.787839 22646 tablet_bootstrap.cc:492] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:17.793998 22646 tablet_bootstrap.cc:654] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.794478 22647 tablet_bootstrap.cc:492] T 9286627b6c59411d908ec035984616ac P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:17.795025 22647 ts_tablet_manager.cc:1403] T 9286627b6c59411d908ec035984616ac P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.001s
I20260709 12:09:17.795869 22421 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:17.797433 22654 raft_consensus.cc:2804] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.797879 22654 raft_consensus.cc:697] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:09:17.798650 22654 consensus_queue.cc:237] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.798753 22647 raft_consensus.cc:359] T 9286627b6c59411d908ec035984616ac P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.799540 22647 raft_consensus.cc:385] T 9286627b6c59411d908ec035984616ac P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.799839 22647 raft_consensus.cc:740] T 9286627b6c59411d908ec035984616ac P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.800555 22647 consensus_queue.cc:260] T 9286627b6c59411d908ec035984616ac P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.795884 22671 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:17.805431 22647 ts_tablet_manager.cc:1434] T 9286627b6c59411d908ec035984616ac P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.004s
I20260709 12:09:17.806507 22647 tablet_bootstrap.cc:492] T cf7e3d0e753849fcb1514dc105ababfd P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:17.809584 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:17.810218 22606 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.810309 22447 tablet_service.cc:1511] Processing CreateTablet for tablet 8efee6d07e5841fdb6b0d7ed673b49cb (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:09:17.811638 22447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8efee6d07e5841fdb6b0d7ed673b49cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.817495 22606 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 1.
I20260709 12:09:17.818725 22648 ts_tablet_manager.cc:1434] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.110s	user 0.009s	sys 0.000s
I20260709 12:09:17.819773 22648 tablet_bootstrap.cc:492] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:17.829962 22522 tablet_service.cc:1511] Processing CreateTablet for tablet 8efee6d07e5841fdb6b0d7ed673b49cb (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:09:17.831238 22522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8efee6d07e5841fdb6b0d7ed673b49cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.831226 22592 tablet_service.cc:1511] Processing CreateTablet for tablet 8efee6d07e5841fdb6b0d7ed673b49cb (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:09:17.832249 22647 tablet_bootstrap.cc:654] T cf7e3d0e753849fcb1514dc105ababfd P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.832465 22592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8efee6d07e5841fdb6b0d7ed673b49cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.837358 22646 tablet_bootstrap.cc:492] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:17.837882 22646 ts_tablet_manager.cc:1403] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.050s	user 0.019s	sys 0.007s
I20260709 12:09:17.840910 22646 raft_consensus.cc:359] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } }
I20260709 12:09:17.841665 22646 raft_consensus.cc:385] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.842011 22646 raft_consensus.cc:740] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.843796 22442 tablet_service.cc:1511] Processing CreateTablet for tablet 174e3ddf6ee147d9b066ce86d1318882 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:09:17.842777 22646 consensus_queue.cc:260] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } }
I20260709 12:09:17.845600 22648 tablet_bootstrap.cc:654] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.846607 22646 ts_tablet_manager.cc:1434] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:09:17.847682 22646 tablet_bootstrap.cc:492] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:17.849951 22522 tablet_service.cc:1511] Processing CreateTablet for tablet 174e3ddf6ee147d9b066ce86d1318882 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:09:17.851997 22441 tablet_service.cc:1511] Processing CreateTablet for tablet 871e4d35e385425cb2fe5d84b8d4fd45 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:09:17.853233 22522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 174e3ddf6ee147d9b066ce86d1318882. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.853554 22646 tablet_bootstrap.cc:654] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.855149 22442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 174e3ddf6ee147d9b066ce86d1318882. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.855149 22668 consensus_queue.cc:1048] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:17.858158 22441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 871e4d35e385425cb2fe5d84b8d4fd45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.858251 22354 catalog_manager.cc:5697] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 0 to 1, leader changed from <none> to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:17.863088 22668 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.863668 22668 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.866532 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:09:17.869491 22569 leader_election.cc:343] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.870056 22668 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:17.871078 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:09:17.878222 22570 leader_election.cc:343] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.878333 22520 tablet_service.cc:1511] Processing CreateTablet for tablet 871e4d35e385425cb2fe5d84b8d4fd45 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:09:17.878707 22570 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:17.879653 22520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 871e4d35e385425cb2fe5d84b8d4fd45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.880220 22668 raft_consensus.cc:2749] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.893121 22647 tablet_bootstrap.cc:492] T cf7e3d0e753849fcb1514dc105ababfd P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:17.893594 22647 ts_tablet_manager.cc:1403] T cf7e3d0e753849fcb1514dc105ababfd P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.087s	user 0.011s	sys 0.002s
I20260709 12:09:17.893491 22653 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.894075 22653 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.896166 22646 tablet_bootstrap.cc:492] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:17.896632 22646 ts_tablet_manager.cc:1403] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.049s	user 0.026s	sys 0.011s
I20260709 12:09:17.896391 22596 tablet_service.cc:1511] Processing CreateTablet for tablet 871e4d35e385425cb2fe5d84b8d4fd45 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:09:17.898078 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:17.898710 22456 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 0.
I20260709 12:09:17.898742 22647 raft_consensus.cc:359] T cf7e3d0e753849fcb1514dc105ababfd P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.896180 22653 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:17.900528 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:17.901196 22606 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 0.
I20260709 12:09:17.902369 22497 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:09:17.902655 22447 tablet_service.cc:1511] Processing CreateTablet for tablet 4e5929206e89419f978fa0283f6bb931 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:09:17.903690 22653 raft_consensus.cc:2804] T 9286627b6c59411d908ec035984616ac P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.903916 22447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e5929206e89419f978fa0283f6bb931. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.904053 22653 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.904399 22653 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.899510 22646 raft_consensus.cc:359] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.910463 22646 raft_consensus.cc:385] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.910808 22646 raft_consensus.cc:740] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.911391 22596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 871e4d35e385425cb2fe5d84b8d4fd45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.911700 22646 consensus_queue.cc:260] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.912041 22653 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:17.914122 22646 ts_tablet_manager.cc:1434] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:09:17.917503 22646 tablet_bootstrap.cc:492] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:17.914742 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:17.919126 22594 tablet_service.cc:1511] Processing CreateTablet for tablet 4e5929206e89419f978fa0283f6bb931 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:09:17.919783 22456 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.920333 22594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e5929206e89419f978fa0283f6bb931. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.922600 22646 tablet_bootstrap.cc:654] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.923669 22653 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:17.924662 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:17.925570 22606 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.892693 22591 tablet_service.cc:1511] Processing CreateTablet for tablet 174e3ddf6ee147d9b066ce86d1318882 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:09:17.927755 22591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 174e3ddf6ee147d9b066ce86d1318882. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.939646 22520 tablet_service.cc:1511] Processing CreateTablet for tablet 4e5929206e89419f978fa0283f6bb931 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:09:17.941247 22520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e5929206e89419f978fa0283f6bb931. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.951478 22651 consensus_queue.cc:1048] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:17.993033 22648 tablet_bootstrap.cc:492] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:17.993541 22648 ts_tablet_manager.cc:1403] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.174s	user 0.009s	sys 0.002s
I20260709 12:09:17.993932 22456 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:09:17.995190 22495 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:17.996099 22653 raft_consensus.cc:2804] T 9286627b6c59411d908ec035984616ac P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.899523 22647 raft_consensus.cc:385] T cf7e3d0e753849fcb1514dc105ababfd P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.997498 22647 raft_consensus.cc:740] T cf7e3d0e753849fcb1514dc105ababfd P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.998467 22647 consensus_queue.cc:260] T cf7e3d0e753849fcb1514dc105ababfd P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.004630 22646 tablet_bootstrap.cc:492] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:18.005412 22646 ts_tablet_manager.cc:1403] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.088s	user 0.020s	sys 0.047s
I20260709 12:09:18.008911 22647 ts_tablet_manager.cc:1434] T cf7e3d0e753849fcb1514dc105ababfd P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.115s	user 0.008s	sys 0.000s
I20260709 12:09:18.021049 22647 tablet_bootstrap.cc:492] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:18.023387 22653 raft_consensus.cc:697] T 9286627b6c59411d908ec035984616ac P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:18.024336 22653 consensus_queue.cc:237] T 9286627b6c59411d908ec035984616ac P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.008738 22646 raft_consensus.cc:359] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.009622 22441 tablet_service.cc:1511] Processing CreateTablet for tablet b36f3a080ce7465b8491197cc6189444 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:09:18.026361 22441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b36f3a080ce7465b8491197cc6189444. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.026496 22442 tablet_service.cc:1511] Processing CreateTablet for tablet 82e7db06c6ff4d96853c60f0f42c09a8 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:09:18.027709 22442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82e7db06c6ff4d96853c60f0f42c09a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.002561 22606 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:09:18.010689 22648 raft_consensus.cc:359] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.013360 22522 tablet_service.cc:1511] Processing CreateTablet for tablet b36f3a080ce7465b8491197cc6189444 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:09:18.016606 22591 tablet_service.cc:1511] Processing CreateTablet for tablet b36f3a080ce7465b8491197cc6189444 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:09:18.032199 22591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b36f3a080ce7465b8491197cc6189444. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.035079 22646 raft_consensus.cc:385] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.035380 22646 raft_consensus.cc:740] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.035530 22522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b36f3a080ce7465b8491197cc6189444. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.036075 22646 consensus_queue.cc:260] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.038072 22646 ts_tablet_manager.cc:1434] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.032s	user 0.004s	sys 0.000s
I20260709 12:09:18.039537 22520 tablet_service.cc:1511] Processing CreateTablet for tablet 82e7db06c6ff4d96853c60f0f42c09a8 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:09:18.040299 22648 raft_consensus.cc:385] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.040668 22648 raft_consensus.cc:740] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.045784 22654 consensus_queue.cc:1048] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.045836 22353 catalog_manager.cc:5697] T 9286627b6c59411d908ec035984616ac P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:18.047555 22440 tablet_service.cc:1511] Processing CreateTablet for tablet ea8ebc1d824844e688d0bd61c3fd2258 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:09:18.048959 22440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea8ebc1d824844e688d0bd61c3fd2258. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.052973 22646 tablet_bootstrap.cc:492] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:18.059206 22518 tablet_service.cc:1511] Processing CreateTablet for tablet ea8ebc1d824844e688d0bd61c3fd2258 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:09:18.043735 22647 tablet_bootstrap.cc:654] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.039537 22594 tablet_service.cc:1511] Processing CreateTablet for tablet 82e7db06c6ff4d96853c60f0f42c09a8 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:09:18.045624 22648 consensus_queue.cc:260] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.040838 22520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82e7db06c6ff4d96853c60f0f42c09a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.067342 22518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea8ebc1d824844e688d0bd61c3fd2258. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.070446 22606 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.073586 22668 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.073917 22646 tablet_bootstrap.cc:654] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.074138 22668 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.075456 22648 ts_tablet_manager.cc:1434] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.082s	user 0.008s	sys 0.001s
I20260709 12:09:18.076313 22668 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:18.076501 22594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82e7db06c6ff4d96853c60f0f42c09a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.078641 22694 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.080201 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:18.080116 22694 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.082720 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:18.083130 22694 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:18.083451 22532 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 0.
I20260709 12:09:18.084693 22647 tablet_bootstrap.cc:492] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
W20260709 12:09:18.084761 22569 leader_election.cc:343] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.085196 22647 ts_tablet_manager.cc:1403] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.064s	user 0.011s	sys 0.000s
I20260709 12:09:18.085834 22570 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:18.087157 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:09:18.088567 22495 leader_election.cc:343] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.089674 22668 raft_consensus.cc:2804] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.089813 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:18.090073 22668 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.090426 22668 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.090436 22605 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 0.
I20260709 12:09:18.092964 22647 raft_consensus.cc:359] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.093664 22647 raft_consensus.cc:385] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.094014 22647 raft_consensus.cc:740] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.095865 22497 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:18.096941 22653 raft_consensus.cc:2804] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.097286 22653 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.097807 22668 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.094709 22647 consensus_queue.cc:260] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.098846 22596 tablet_service.cc:1511] Processing CreateTablet for tablet ea8ebc1d824844e688d0bd61c3fd2258 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:09:18.099630 22694 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.100018 22596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea8ebc1d824844e688d0bd61c3fd2258. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.100914 22647 ts_tablet_manager.cc:1434] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:09:18.101835 22647 tablet_bootstrap.cc:492] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:18.100098 22694 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.100914 22648 tablet_bootstrap.cc:492] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:18.107493 22647 tablet_bootstrap.cc:654] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.109161 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:18.110917 22457 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 0.
I20260709 12:09:18.112175 22495 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:18.113121 22695 raft_consensus.cc:2804] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.113241 22668 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:18.113513 22695 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.097762 22653 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.113901 22695 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.118157 22442 tablet_service.cc:1511] Processing CreateTablet for tablet 7c5dc015a7ef4e1daba3ed653d8ce7f9 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:09:18.119449 22442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c5dc015a7ef4e1daba3ed653d8ce7f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.120064 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:18.120636 22532 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.123248 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:09:18.124630 22569 leader_election.cc:343] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.130025 22522 tablet_service.cc:1511] Processing CreateTablet for tablet 7c5dc015a7ef4e1daba3ed653d8ce7f9 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:09:18.131722 22654 consensus_queue.cc:1048] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.134738 22695 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.136128 22694 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:18.138222 22648 tablet_bootstrap.cc:654] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.139012 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:18.139317 22532 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 1.
I20260709 12:09:18.139617 22605 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 0.
I20260709 12:09:18.140628 22570 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:18.141563 22668 raft_consensus.cc:2804] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.142041 22668 raft_consensus.cc:697] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:09:18.143002 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:18.143276 22522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c5dc015a7ef4e1daba3ed653d8ce7f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.142880 22668 consensus_queue.cc:237] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.143556 22457 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.143590 22695 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:18.146268 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:18.146935 22605 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.149225 22646 tablet_bootstrap.cc:492] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:18.149688 22646 ts_tablet_manager.cc:1403] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.097s	user 0.013s	sys 0.000s
I20260709 12:09:18.150923 22647 tablet_bootstrap.cc:492] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:18.151414 22647 ts_tablet_manager.cc:1403] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.000s
I20260709 12:09:18.162809 22596 tablet_service.cc:1511] Processing CreateTablet for tablet 10ed4486435d4f82978c5cb544504999 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:09:18.164669 22596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10ed4486435d4f82978c5cb544504999. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.166373 22518 tablet_service.cc:1511] Processing CreateTablet for tablet 10ed4486435d4f82978c5cb544504999 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:09:18.166915 22457 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
W20260709 12:09:18.167395 22403 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:18.167750 22518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10ed4486435d4f82978c5cb544504999. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.168232 22495 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:18.169265 22695 raft_consensus.cc:2804] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.169723 22695 raft_consensus.cc:697] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:18.170586 22695 consensus_queue.cc:237] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.177982 22605 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:09:18.161223 22653 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.185950 22646 raft_consensus.cc:359] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.186640 22646 raft_consensus.cc:385] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.186908 22646 raft_consensus.cc:740] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.190287 22646 consensus_queue.cc:260] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.195354 22447 tablet_service.cc:1511] Processing CreateTablet for tablet cfdc6a19d6fc4ae7b122bc59c5d22aa0 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:09:18.199481 22447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfdc6a19d6fc4ae7b122bc59c5d22aa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.202234 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:18.203744 22594 tablet_service.cc:1511] Processing CreateTablet for tablet 7c5dc015a7ef4e1daba3ed653d8ce7f9 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:09:18.204528 22440 tablet_service.cc:1511] Processing CreateTablet for tablet 10ed4486435d4f82978c5cb544504999 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:09:18.205217 22594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c5dc015a7ef4e1daba3ed653d8ce7f9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:18.203780 22495 leader_election.cc:343] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.207129 22440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10ed4486435d4f82978c5cb544504999. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.207995 22647 raft_consensus.cc:359] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.208698 22647 raft_consensus.cc:385] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.208942 22647 raft_consensus.cc:740] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.209566 22647 consensus_queue.cc:260] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.209951 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:18.210675 22646 ts_tablet_manager.cc:1434] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.061s	user 0.011s	sys 0.000s
I20260709 12:09:18.210613 22605 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.211472 22647 ts_tablet_manager.cc:1434] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.000s
I20260709 12:09:18.211709 22646 tablet_bootstrap.cc:492] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:18.212306 22647 tablet_bootstrap.cc:492] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:18.215289 22653 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:18.222028 22646 tablet_bootstrap.cc:654] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.223145 22667 consensus_queue.cc:1048] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.236622 22605 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:09:18.246578 22647 tablet_bootstrap.cc:654] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.247063 22596 tablet_service.cc:1511] Processing CreateTablet for tablet cfdc6a19d6fc4ae7b122bc59c5d22aa0 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:09:18.248482 22596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfdc6a19d6fc4ae7b122bc59c5d22aa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.250293 22522 tablet_service.cc:1511] Processing CreateTablet for tablet cfdc6a19d6fc4ae7b122bc59c5d22aa0 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:09:18.251863 22497 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:18.251868 22522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfdc6a19d6fc4ae7b122bc59c5d22aa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.255784 22648 tablet_bootstrap.cc:492] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:18.256240 22648 ts_tablet_manager.cc:1403] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.156s	user 0.006s	sys 0.010s
I20260709 12:09:18.258111 22440 tablet_service.cc:1511] Processing CreateTablet for tablet 19773e9e6aec446eb719d3d53d49812b (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:09:18.259248 22440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19773e9e6aec446eb719d3d53d49812b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.259141 22653 raft_consensus.cc:2804] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.260267 22653 raft_consensus.cc:697] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:18.261070 22653 consensus_queue.cc:237] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.264199 22518 tablet_service.cc:1511] Processing CreateTablet for tablet 19773e9e6aec446eb719d3d53d49812b (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:09:18.265278 22518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19773e9e6aec446eb719d3d53d49812b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.265661 22591 tablet_service.cc:1511] Processing CreateTablet for tablet 19773e9e6aec446eb719d3d53d49812b (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:09:18.267163 22591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19773e9e6aec446eb719d3d53d49812b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.267154 22651 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.268432 22651 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } }
I20260709 12:09:18.270377 22651 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317)
I20260709 12:09:18.258893 22648 raft_consensus.cc:359] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } }
I20260709 12:09:18.271648 22648 raft_consensus.cc:385] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.271555 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:18.272249 22648 raft_consensus.cc:740] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.272099 22442 tablet_service.cc:1511] Processing CreateTablet for tablet 041a72bc20f246bdb6e7cc6423d67e62 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:09:18.273327 22442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 041a72bc20f246bdb6e7cc6423d67e62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.272995 22648 consensus_queue.cc:260] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } }
I20260709 12:09:18.273622 22592 tablet_service.cc:1511] Processing CreateTablet for tablet 5cd56edb2a504be8a2de859108bea8e2 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:09:18.273881 22457 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 0.
I20260709 12:09:18.274710 22592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cd56edb2a504be8a2de859108bea8e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.272118 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:18.275619 22532 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 0.
I20260709 12:09:18.276870 22570 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:09:18.277662 22651 raft_consensus.cc:2804] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.277978 22651 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.278280 22651 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.280488 22648 ts_tablet_manager.cc:1434] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:09:18.281459 22648 tablet_bootstrap.cc:492] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:18.282737 22520 tablet_service.cc:1511] Processing CreateTablet for tablet 5cd56edb2a504be8a2de859108bea8e2 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:09:18.283962 22520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cd56edb2a504be8a2de859108bea8e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.292218 22447 tablet_service.cc:1511] Processing CreateTablet for tablet 5cd56edb2a504be8a2de859108bea8e2 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:09:18.308166 22447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cd56edb2a504be8a2de859108bea8e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.308882 22648 tablet_bootstrap.cc:654] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:18.310111 22632 tablet.cc:2406] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:09:18.310322 22353 catalog_manager.cc:5697] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 1 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:18.316959 22646 tablet_bootstrap.cc:492] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:18.338318 22646 ts_tablet_manager.cc:1403] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.127s	user 0.019s	sys 0.000s
I20260709 12:09:18.341295 22646 raft_consensus.cc:359] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.342096 22646 raft_consensus.cc:385] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.342389 22646 raft_consensus.cc:740] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.344966 22444 tablet_service.cc:1511] Processing CreateTablet for tablet 62319c9e82134e7daf8a46f78c124bff (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:09:18.346412 22444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62319c9e82134e7daf8a46f78c124bff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.346849 22596 tablet_service.cc:1511] Processing CreateTablet for tablet d7a58204e5354d61a3b5db01e879dce9 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:09:18.347057 22520 tablet_service.cc:1511] Processing CreateTablet for tablet 897c484d3dec40a296e097e6b8d26d39 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:09:18.348085 22596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7a58204e5354d61a3b5db01e879dce9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.348371 22520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 897c484d3dec40a296e097e6b8d26d39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.348491 22443 tablet_service.cc:1511] Processing CreateTablet for tablet bb7fd922979743428612619e8de33af1 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:09:18.349721 22443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb7fd922979743428612619e8de33af1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.353648 22518 tablet_service.cc:1511] Processing CreateTablet for tablet 62319c9e82134e7daf8a46f78c124bff (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:09:18.354745 22518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62319c9e82134e7daf8a46f78c124bff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.358482 22445 tablet_service.cc:1511] Processing CreateTablet for tablet 60b63fe1f8174bdab922fc97591f1860 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:09:18.359822 22445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60b63fe1f8174bdab922fc97591f1860. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.360929 22515 tablet_service.cc:1511] Processing CreateTablet for tablet 60b63fe1f8174bdab922fc97591f1860 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:09:18.362093 22515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60b63fe1f8174bdab922fc97591f1860. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.360935 22593 tablet_service.cc:1511] Processing CreateTablet for tablet 897c484d3dec40a296e097e6b8d26d39 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:09:18.364284 22593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 897c484d3dec40a296e097e6b8d26d39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.364001 22446 tablet_service.cc:1511] Processing CreateTablet for tablet 746b2a18bc684213bde228ac6cc37ef6 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:09:18.365216 22446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 746b2a18bc684213bde228ac6cc37ef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.365020 22595 tablet_service.cc:1511] Processing CreateTablet for tablet 62319c9e82134e7daf8a46f78c124bff (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:09:18.366233 22595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62319c9e82134e7daf8a46f78c124bff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.359890 22517 tablet_service.cc:1511] Processing CreateTablet for tablet bb7fd922979743428612619e8de33af1 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:09:18.368324 22517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb7fd922979743428612619e8de33af1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.368100 22439 tablet_service.cc:1511] Processing CreateTablet for tablet 0da3e85670e74df8af94383289960785 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:09:18.317075 22651 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } }
I20260709 12:09:18.319324 22667 consensus_queue.cc:1048] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.321041 22648 tablet_bootstrap.cc:492] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:18.370164 22439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0da3e85670e74df8af94383289960785. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.370232 22648 ts_tablet_manager.cc:1403] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.089s	user 0.009s	sys 0.003s
I20260709 12:09:18.371109 22522 tablet_service.cc:1511] Processing CreateTablet for tablet d7a58204e5354d61a3b5db01e879dce9 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:09:18.372251 22522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7a58204e5354d61a3b5db01e879dce9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.325984 22516 tablet_service.cc:1511] Processing CreateTablet for tablet 041a72bc20f246bdb6e7cc6423d67e62 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:09:18.373198 22516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 041a72bc20f246bdb6e7cc6423d67e62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.373464 22438 tablet_service.cc:1511] Processing CreateTablet for tablet 9d328826e9a04a61be5bfb46dcfa77ab (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:09:18.374634 22438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d328826e9a04a61be5bfb46dcfa77ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.376459 22590 tablet_service.cc:1511] Processing CreateTablet for tablet bb7fd922979743428612619e8de33af1 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:09:18.377774 22590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb7fd922979743428612619e8de33af1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.380191 22589 tablet_service.cc:1511] Processing CreateTablet for tablet 60b63fe1f8174bdab922fc97591f1860 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:09:18.381465 22589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60b63fe1f8174bdab922fc97591f1860. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.384093 22588 tablet_service.cc:1511] Processing CreateTablet for tablet 746b2a18bc684213bde228ac6cc37ef6 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:09:18.385325 22588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 746b2a18bc684213bde228ac6cc37ef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.388157 22587 tablet_service.cc:1511] Processing CreateTablet for tablet 0da3e85670e74df8af94383289960785 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:09:18.389748 22587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0da3e85670e74df8af94383289960785. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.336418 22647 tablet_bootstrap.cc:492] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:18.329108 22441 tablet_service.cc:1511] Processing CreateTablet for tablet d7a58204e5354d61a3b5db01e879dce9 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:09:18.390765 22647 ts_tablet_manager.cc:1403] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.179s	user 0.015s	sys 0.004s
I20260709 12:09:18.396236 22648 raft_consensus.cc:359] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.397156 22648 raft_consensus.cc:385] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.397512 22648 raft_consensus.cc:740] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.397012 22646 consensus_queue.cc:260] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.398147 22648 consensus_queue.cc:260] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.401054 22648 ts_tablet_manager.cc:1434] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.030s	user 0.002s	sys 0.004s
I20260709 12:09:18.401952 22648 tablet_bootstrap.cc:492] T 272afea078f74bf19baefd3c1300644d P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:18.403949 22521 tablet_service.cc:1511] Processing CreateTablet for tablet 746b2a18bc684213bde228ac6cc37ef6 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:09:18.404258 22519 tablet_service.cc:1511] Processing CreateTablet for tablet 0da3e85670e74df8af94383289960785 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:09:18.405296 22521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 746b2a18bc684213bde228ac6cc37ef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.405747 22513 tablet_service.cc:1511] Processing CreateTablet for tablet 263d51d0b43744d899e37466045af890 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:09:18.403903 22514 tablet_service.cc:1511] Processing CreateTablet for tablet 9d328826e9a04a61be5bfb46dcfa77ab (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:09:18.407730 22441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7a58204e5354d61a3b5db01e879dce9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.407606 22647 raft_consensus.cc:359] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.408317 22647 raft_consensus.cc:385] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.408627 22647 raft_consensus.cc:740] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.410199 22647 consensus_queue.cc:260] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.412016 22513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 263d51d0b43744d899e37466045af890. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.412866 22647 ts_tablet_manager.cc:1434] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.002s
I20260709 12:09:18.413746 22647 tablet_bootstrap.cc:492] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:18.415947 22442 tablet_service.cc:1511] Processing CreateTablet for tablet 897c484d3dec40a296e097e6b8d26d39 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:09:18.417451 22442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 897c484d3dec40a296e097e6b8d26d39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.420058 22594 tablet_service.cc:1511] Processing CreateTablet for tablet 041a72bc20f246bdb6e7cc6423d67e62 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:09:18.421284 22594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 041a72bc20f246bdb6e7cc6423d67e62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.423206 22514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d328826e9a04a61be5bfb46dcfa77ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.429554 22695 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.430049 22695 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.431043 22519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0da3e85670e74df8af94383289960785. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.432245 22695 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:18.433929 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:09:18.435523 22495 leader_election.cc:343] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.438476 22440 tablet_service.cc:1511] Processing CreateTablet for tablet 263d51d0b43744d899e37466045af890 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:09:18.441286 22515 tablet_service.cc:1511] Processing CreateTablet for tablet b41723f4983d46d0bf385fae671d9a04 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:09:18.443415 22440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 263d51d0b43744d899e37466045af890. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.444310 22515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b41723f4983d46d0bf385fae671d9a04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.444144 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:18.444885 22606 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 0.
I20260709 12:09:18.446201 22497 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:18.447271 22695 raft_consensus.cc:2804] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.447615 22695 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.448199 22695 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.469321 22653 consensus_queue.cc:1048] T 9286627b6c59411d908ec035984616ac P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.473178 22695 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.474232 22647 tablet_bootstrap.cc:654] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.474500 22648 tablet_bootstrap.cc:654] T 272afea078f74bf19baefd3c1300644d P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.475986 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:09:18.477244 22495 leader_election.cc:343] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.489809 22518 tablet_service.cc:1511] Processing CreateTablet for tablet 254fb9df2b39405996039a40091b4875 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:09:18.490073 22592 tablet_service.cc:1511] Processing CreateTablet for tablet 263d51d0b43744d899e37466045af890 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:09:18.492395 22595 tablet_service.cc:1511] Processing CreateTablet for tablet 254fb9df2b39405996039a40091b4875 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:09:18.495427 22591 tablet_service.cc:1511] Processing CreateTablet for tablet 9d328826e9a04a61be5bfb46dcfa77ab (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:09:18.491161 22518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 254fb9df2b39405996039a40091b4875. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.491161 22592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 263d51d0b43744d899e37466045af890. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.519039 22596 tablet_service.cc:1511] Processing CreateTablet for tablet b41723f4983d46d0bf385fae671d9a04 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:09:18.520874 22447 tablet_service.cc:1511] Processing CreateTablet for tablet 254fb9df2b39405996039a40091b4875 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:09:18.522199 22651 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317)
I20260709 12:09:18.523887 22595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 254fb9df2b39405996039a40091b4875. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.526273 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:18.526858 22530 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.536551 22520 tablet_service.cc:1511] Processing CreateTablet for tablet ee3ba2f54b0343bea5e3a5364c372a89 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:09:18.541657 22596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b41723f4983d46d0bf385fae671d9a04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.544775 22591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d328826e9a04a61be5bfb46dcfa77ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.546643 22646 ts_tablet_manager.cc:1434] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.208s	user 0.014s	sys 0.007s
I20260709 12:09:18.549049 22447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 254fb9df2b39405996039a40091b4875. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.551769 22646 tablet_bootstrap.cc:492] T 19a99176cd014d618ba1793fbb19aeab P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:18.531967 22654 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.562109 22442 tablet_service.cc:1511] Processing CreateTablet for tablet b41723f4983d46d0bf385fae671d9a04 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:09:18.560426 22653 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.569000 22654 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.569489 22653 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.571673 22653 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:18.572396 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:18.572983 22606 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.573551 22442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b41723f4983d46d0bf385fae671d9a04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.573470 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:18.574141 22603 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 0.
I20260709 12:09:18.576020 22520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee3ba2f54b0343bea5e3a5364c372a89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.588652 22646 tablet_bootstrap.cc:654] T 19a99176cd014d618ba1793fbb19aeab P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.572989 22354 catalog_manager.cc:5697] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:18.596345 22530 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 1.
I20260709 12:09:18.572422 22443 tablet_service.cc:1511] Processing CreateTablet for tablet ee3ba2f54b0343bea5e3a5364c372a89 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
W20260709 12:09:18.597913 22340 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 78613.2us
I20260709 12:09:18.597548 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:18.555864 22695 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:18.599304 22456 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.598836 22443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee3ba2f54b0343bea5e3a5364c372a89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.605710 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:18.606348 22455 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 0.
I20260709 12:09:18.609918 22456 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 1.
I20260709 12:09:18.611387 22569 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:18.612427 22713 raft_consensus.cc:2804] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.612914 22713 raft_consensus.cc:697] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:09:18.613752 22713 consensus_queue.cc:237] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } }
I20260709 12:09:18.646852 22596 tablet_service.cc:1511] Processing CreateTablet for tablet ee3ba2f54b0343bea5e3a5364c372a89 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:09:18.648092 22596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee3ba2f54b0343bea5e3a5364c372a89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.669803 22442 tablet_service.cc:1511] Processing CreateTablet for tablet 6445cf83e0b646428e39f19d21ca6c44 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:09:18.669803 22447 tablet_service.cc:1511] Processing CreateTablet for tablet 6334366811764682b0a491c130c68eed (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:09:18.671231 22447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6334366811764682b0a491c130c68eed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.673080 22654 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:18.638514 22497 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:09:18.674849 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:09:18.675531 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 46110.4us
I20260709 12:09:18.676563 22653 raft_consensus.cc:2804] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.676904 22653 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.677227 22653 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.677312 22647 tablet_bootstrap.cc:492] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:18.677805 22647 ts_tablet_manager.cc:1403] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.264s	user 0.016s	sys 0.013s
I20260709 12:09:18.681154 22694 consensus_queue.cc:1048] T 9286627b6c59411d908ec035984616ac P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.684912 22520 tablet_service.cc:1511] Processing CreateTablet for tablet 6334366811764682b0a491c130c68eed (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:09:18.686072 22520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6334366811764682b0a491c130c68eed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.686167 22442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6445cf83e0b646428e39f19d21ca6c44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.687244 22517 tablet_service.cc:1511] Processing CreateTablet for tablet 6445cf83e0b646428e39f19d21ca6c44 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:09:18.687718 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:18.675729 22604 raft_consensus.cc:2393] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 1: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:09:18.691576 22592 tablet_service.cc:1511] Processing CreateTablet for tablet 6445cf83e0b646428e39f19d21ca6c44 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:09:18.692730 22592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6445cf83e0b646428e39f19d21ca6c44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.696141 22668 consensus_queue.cc:1048] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.700512 22606 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:09:18.703079 22497 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:18.703850 22694 raft_consensus.cc:2804] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.704267 22694 raft_consensus.cc:697] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:18.705039 22694 consensus_queue.cc:237] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.709900 22647 raft_consensus.cc:359] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.710602 22647 raft_consensus.cc:385] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.710855 22647 raft_consensus.cc:740] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.711481 22647 consensus_queue.cc:260] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:09:18.713483 22569 consensus_peers.cc:597] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:18.714444 22440 tablet_service.cc:1511] Processing CreateTablet for tablet 74d6480c61e542d583f6f89899989553 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:09:18.715768 22440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74d6480c61e542d583f6f89899989553. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.722854 22421 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:09:18.691834 22653 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.713496 22647 ts_tablet_manager.cc:1434] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 12:09:18.724727 22647 tablet_bootstrap.cc:492] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:18.725636 22667 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.726598 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:18.727196 22605 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.727826 22591 tablet_service.cc:1511] Processing CreateTablet for tablet 6334366811764682b0a491c130c68eed (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:09:18.729020 22591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6334366811764682b0a491c130c68eed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.731686 22354 catalog_manager.cc:5697] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:18.733530 22605 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:09:18.733913 22596 tablet_service.cc:1511] Processing CreateTablet for tablet 74d6480c61e542d583f6f89899989553 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:09:18.734791 22497 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:09:18.735041 22596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74d6480c61e542d583f6f89899989553. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.748886 22648 tablet_bootstrap.cc:492] T 272afea078f74bf19baefd3c1300644d P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:18.749395 22648 ts_tablet_manager.cc:1403] T 272afea078f74bf19baefd3c1300644d P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.348s	user 0.020s	sys 0.006s
I20260709 12:09:18.758165 22646 tablet_bootstrap.cc:492] T 19a99176cd014d618ba1793fbb19aeab P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:18.758674 22646 ts_tablet_manager.cc:1403] T 19a99176cd014d618ba1793fbb19aeab P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.207s	user 0.019s	sys 0.020s
I20260709 12:09:18.774770 22720 consensus_queue.cc:1048] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:18.744746 22653 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:18.775727 22517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6445cf83e0b646428e39f19d21ca6c44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.782960 22646 raft_consensus.cc:359] T 19a99176cd014d618ba1793fbb19aeab P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.788239 22646 raft_consensus.cc:385] T 19a99176cd014d618ba1793fbb19aeab P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.788637 22646 raft_consensus.cc:740] T 19a99176cd014d618ba1793fbb19aeab P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.789489 22646 consensus_queue.cc:260] T 19a99176cd014d618ba1793fbb19aeab P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.800942 22695 raft_consensus.cc:2804] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.803086 22646 ts_tablet_manager.cc:1434] T 19a99176cd014d618ba1793fbb19aeab P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.000s
W20260709 12:09:18.799791 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 64811.3us
I20260709 12:09:18.813136 22647 tablet_bootstrap.cc:654] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.813443 22646 tablet_bootstrap.cc:492] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:18.805939 22695 raft_consensus.cc:697] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:18.818768 22695 consensus_queue.cc:237] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.820248 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:18.820837 22457 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:18.803893 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 67191.7us
I20260709 12:09:18.833541 22520 tablet_service.cc:1511] Processing CreateTablet for tablet 74d6480c61e542d583f6f89899989553 (DEFAULT_TABLE table=test-workload [id=1e73b97ba677488c8829a696096f4885]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:09:18.834831 22520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74d6480c61e542d583f6f89899989553. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.829124 22667 raft_consensus.cc:2749] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.850097 22355 catalog_manager.cc:5697] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 1 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:18.860932 22722 consensus_queue.cc:1048] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:18.861558 22648 raft_consensus.cc:359] T 272afea078f74bf19baefd3c1300644d P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.862197 22648 raft_consensus.cc:385] T 272afea078f74bf19baefd3c1300644d P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.862443 22648 raft_consensus.cc:740] T 272afea078f74bf19baefd3c1300644d P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.871184 22695 consensus_queue.cc:1048] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.872380 22457 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:09:18.873505 22646 tablet_bootstrap.cc:654] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.874797 22648 consensus_queue.cc:260] T 272afea078f74bf19baefd3c1300644d P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.880880 22695 consensus_queue.cc:1048] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:18.891297 22648 ts_tablet_manager.cc:1434] T 272afea078f74bf19baefd3c1300644d P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.142s	user 0.010s	sys 0.000s
I20260709 12:09:18.892225 22648 tablet_bootstrap.cc:492] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:18.899895 22647 tablet_bootstrap.cc:492] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:18.900575 22647 ts_tablet_manager.cc:1403] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.176s	user 0.023s	sys 0.003s
I20260709 12:09:18.904129 22647 raft_consensus.cc:359] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.905088 22647 raft_consensus.cc:385] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.905503 22647 raft_consensus.cc:740] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.906387 22647 consensus_queue.cc:260] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.909253 22647 ts_tablet_manager.cc:1434] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:09:18.909446 22667 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.910420 22647 tablet_bootstrap.cc:492] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:18.910838 22667 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.915721 22667 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:18.917582 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:18.915470 22353 catalog_manager.cc:5697] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:18.918771 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:18.920192 22605 raft_consensus.cc:2393] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 1: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:09:18.922787 22422 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:09:18.922838 22353 catalog_manager.cc:5697] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:18.927175 22667 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.929817 22648 tablet_bootstrap.cc:654] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.935182 22667 raft_consensus.cc:2749] T 272afea078f74bf19baefd3c1300644d P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.942227 22646 tablet_bootstrap.cc:492] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:18.942611 22646 ts_tablet_manager.cc:1403] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.129s	user 0.024s	sys 0.004s
I20260709 12:09:18.945257 22646 raft_consensus.cc:359] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.945698 22647 tablet_bootstrap.cc:654] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.945916 22646 raft_consensus.cc:385] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.946218 22646 raft_consensus.cc:740] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.946969 22646 consensus_queue.cc:260] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.955438 22646 ts_tablet_manager.cc:1434] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:09:18.956386 22646 tablet_bootstrap.cc:492] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:18.967840 22646 tablet_bootstrap.cc:654] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.968349 22648 tablet_bootstrap.cc:492] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:18.968778 22648 ts_tablet_manager.cc:1403] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.077s	user 0.009s	sys 0.009s
I20260709 12:09:18.971132 22648 raft_consensus.cc:359] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.971928 22648 raft_consensus.cc:385] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.972237 22648 raft_consensus.cc:740] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.972378 22647 tablet_bootstrap.cc:492] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:18.972831 22647 ts_tablet_manager.cc:1403] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.063s	user 0.011s	sys 0.009s
I20260709 12:09:18.973095 22648 consensus_queue.cc:260] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.975695 22648 ts_tablet_manager.cc:1434] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:09:18.975466 22647 raft_consensus.cc:359] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.976128 22647 raft_consensus.cc:385] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.976399 22647 raft_consensus.cc:740] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.976660 22648 tablet_bootstrap.cc:492] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:18.977165 22647 consensus_queue.cc:260] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.978214 22646 tablet_bootstrap.cc:492] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:18.978739 22646 ts_tablet_manager.cc:1403] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.001s
I20260709 12:09:18.979852 22647 ts_tablet_manager.cc:1434] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:09:18.980778 22647 tablet_bootstrap.cc:492] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:18.981921 22646 raft_consensus.cc:359] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.982683 22646 raft_consensus.cc:385] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.983050 22646 raft_consensus.cc:740] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.983446 22648 tablet_bootstrap.cc:654] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.983922 22646 consensus_queue.cc:260] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.986564 22646 ts_tablet_manager.cc:1434] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:09:18.987903 22646 tablet_bootstrap.cc:492] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:18.992700 22647 tablet_bootstrap.cc:654] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.995641 22648 tablet_bootstrap.cc:492] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:18.996106 22648 ts_tablet_manager.cc:1403] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
I20260709 12:09:18.997241 22646 tablet_bootstrap.cc:654] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.999001 22648 raft_consensus.cc:359] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:18.999733 22648 raft_consensus.cc:385] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.000061 22648 raft_consensus.cc:740] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.001225 22648 consensus_queue.cc:260] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.004325 22647 tablet_bootstrap.cc:492] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:19.004771 22647 ts_tablet_manager.cc:1403] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.006s
I20260709 12:09:19.008443 22648 ts_tablet_manager.cc:1434] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:09:19.009763 22648 tablet_bootstrap.cc:492] T bf783936508640219af47375c444da09 P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:19.011893 22647 raft_consensus.cc:359] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.012576 22647 raft_consensus.cc:385] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.012866 22647 raft_consensus.cc:740] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.013686 22647 consensus_queue.cc:260] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.015580 22646 tablet_bootstrap.cc:492] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:19.015938 22647 ts_tablet_manager.cc:1434] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:09:19.016047 22646 ts_tablet_manager.cc:1403] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.028s	user 0.022s	sys 0.002s
I20260709 12:09:19.017680 22647 tablet_bootstrap.cc:492] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:19.018049 22648 tablet_bootstrap.cc:654] T bf783936508640219af47375c444da09 P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.018615 22646 raft_consensus.cc:359] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.019338 22646 raft_consensus.cc:385] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.019598 22646 raft_consensus.cc:740] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.020357 22646 consensus_queue.cc:260] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.024075 22647 tablet_bootstrap.cc:654] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.037668 22711 consensus_queue.cc:1048] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.046208 22646 ts_tablet_manager.cc:1434] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:09:19.048544 22647 tablet_bootstrap.cc:492] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:19.049010 22647 ts_tablet_manager.cc:1403] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.016s
I20260709 12:09:19.051363 22646 tablet_bootstrap.cc:492] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:19.060534 22646 tablet_bootstrap.cc:654] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.068099 22647 raft_consensus.cc:359] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.068830 22647 raft_consensus.cc:385] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.069118 22647 raft_consensus.cc:740] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.069856 22668 consensus_queue.cc:1048] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.069892 22647 consensus_queue.cc:260] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.073351 22647 ts_tablet_manager.cc:1434] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.002s
I20260709 12:09:19.075029 22648 tablet_bootstrap.cc:492] T bf783936508640219af47375c444da09 P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:19.075533 22648 ts_tablet_manager.cc:1403] T bf783936508640219af47375c444da09 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.066s	user 0.019s	sys 0.038s
I20260709 12:09:19.078480 22648 raft_consensus.cc:359] T bf783936508640219af47375c444da09 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.079155 22648 raft_consensus.cc:385] T bf783936508640219af47375c444da09 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.079424 22648 raft_consensus.cc:740] T bf783936508640219af47375c444da09 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.080286 22646 tablet_bootstrap.cc:492] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:19.080268 22648 consensus_queue.cc:260] T bf783936508640219af47375c444da09 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.080807 22646 ts_tablet_manager.cc:1403] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.006s
I20260709 12:09:19.082366 22648 ts_tablet_manager.cc:1434] T bf783936508640219af47375c444da09 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:09:19.083433 22648 tablet_bootstrap.cc:492] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:19.083911 22646 raft_consensus.cc:359] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.084558 22646 raft_consensus.cc:385] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.084816 22646 raft_consensus.cc:740] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.085556 22646 consensus_queue.cc:260] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.089381 22647 tablet_bootstrap.cc:492] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:19.090147 22648 tablet_bootstrap.cc:654] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.091651 22646 ts_tablet_manager.cc:1434] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:09:19.092535 22646 tablet_bootstrap.cc:492] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:19.104512 22646 tablet_bootstrap.cc:654] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.112160 22647 tablet_bootstrap.cc:654] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.112444 22719 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.112984 22648 tablet_bootstrap.cc:492] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:19.113492 22648 ts_tablet_manager.cc:1403] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.016s
I20260709 12:09:19.116067 22648 raft_consensus.cc:359] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.116652 22646 tablet_bootstrap.cc:492] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:19.116837 22647 tablet_bootstrap.cc:492] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:19.116707 22648 raft_consensus.cc:385] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.117148 22646 ts_tablet_manager.cc:1403] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.003s
I20260709 12:09:19.117326 22648 raft_consensus.cc:740] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.117501 22647 ts_tablet_manager.cc:1403] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.000s
I20260709 12:09:19.112934 22719 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.118116 22648 consensus_queue.cc:260] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.119731 22646 raft_consensus.cc:359] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.120353 22646 raft_consensus.cc:385] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.120075 22647 raft_consensus.cc:359] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.120631 22646 raft_consensus.cc:740] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.120849 22647 raft_consensus.cc:385] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.121023 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:19.121240 22647 raft_consensus.cc:740] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.121281 22646 consensus_queue.cc:260] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.122116 22647 consensus_queue.cc:260] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.122959 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:19.123463 22646 ts_tablet_manager.cc:1434] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:09:19.123584 22457 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 0.
I20260709 12:09:19.124255 22647 ts_tablet_manager.cc:1434] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:09:19.125155 22647 tablet_bootstrap.cc:492] T 40384260c96247e0ac31ade25baddaff P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:19.125738 22648 ts_tablet_manager.cc:1434] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:09:19.124323 22646 tablet_bootstrap.cc:492] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:19.127945 22648 tablet_bootstrap.cc:492] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:19.127842 22495 leader_election.cc:304] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:19.128861 22694 raft_consensus.cc:2804] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.129256 22694 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.129640 22694 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.132859 22603 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 0.
I20260709 12:09:19.133564 22719 leader_election.cc:290] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:19.133704 22646 tablet_bootstrap.cc:654] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.136866 22647 tablet_bootstrap.cc:654] T 40384260c96247e0ac31ade25baddaff P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.137929 22648 tablet_bootstrap.cc:654] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.142887 22694 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.146353 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:19.146937 22668 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.147030 22457 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.148051 22668 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.149711 22667 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.150161 22667 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.151511 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:19.151543 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:19.152189 22667 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:19.152236 22531 raft_consensus.cc:2468] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 0.
W20260709 12:09:19.153373 22569 leader_election.cc:343] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.155004 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:19.157505 22570 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:19.158420 22651 raft_consensus.cc:2804] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.158800 22651 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.159168 22651 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.159775 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:19.160252 22694 leader_election.cc:290] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:19.161271 22648 tablet_bootstrap.cc:492] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:19.161164 22457 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:09:19.160317 22603 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.162660 22495 leader_election.cc:304] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:19.163676 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:19.164338 22455 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.165130 22421 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:09:19.166229 22668 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:19.169158 22603 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:09:19.169674 22651 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.171114 22648 ts_tablet_manager.cc:1403] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.008s
I20260709 12:09:19.172150 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:19.173193 22719 raft_consensus.cc:2804] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.173628 22651 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:19.173705 22719 raft_consensus.cc:697] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:19.173789 22648 raft_consensus.cc:359] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.174602 22648 raft_consensus.cc:385] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.177387 22648 raft_consensus.cc:740] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.177314 22722 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.178349 22648 consensus_queue.cc:260] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.179251 22722 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.181035 22648 ts_tablet_manager.cc:1434] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:09:19.181257 22722 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:09:19.183019 22569 leader_election.cc:343] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.183344 22648 tablet_bootstrap.cc:492] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:19.174654 22719 consensus_queue.cc:237] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.173130 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:19.186839 22671 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.187238 22531 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.187345 22671 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.189441 22671 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:19.192041 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:19.192566 22648 tablet_bootstrap.cc:654] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.192656 22532 raft_consensus.cc:2468] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 0.
I20260709 12:09:19.193873 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:19.194449 22606 raft_consensus.cc:2468] T 19a99176cd014d618ba1793fbb19aeab P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 0.
I20260709 12:09:19.195696 22422 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:19.198280 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:09:19.199838 22495 leader_election.cc:343] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.202888 22651 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.203392 22651 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.204727 22648 tablet_bootstrap.cc:492] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:19.204806 22671 raft_consensus.cc:2804] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.205226 22648 ts_tablet_manager.cc:1403] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.004s
I20260709 12:09:19.205253 22671 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.205773 22671 raft_consensus.cc:3060] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.206840 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:19.207434 22532 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 0.
I20260709 12:09:19.208222 22648 raft_consensus.cc:359] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.208861 22648 raft_consensus.cc:385] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.208812 22570 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:09:19.209715 22668 raft_consensus.cc:2804] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.210090 22668 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.209240 22648 raft_consensus.cc:740] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.210453 22668 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.210966 22648 consensus_queue.cc:260] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.213160 22648 ts_tablet_manager.cc:1434] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:19.214043 22648 tablet_bootstrap.cc:492] T b205f960deef48f8bc84127a8b47faf4 P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:19.215593 22646 tablet_bootstrap.cc:492] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:19.216261 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:19.217998 22646 ts_tablet_manager.cc:1403] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.094s	user 0.007s	sys 0.012s
I20260709 12:09:19.205355 22651 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:19.219231 22668 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.219913 22531 raft_consensus.cc:2468] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 1.
I20260709 12:09:19.220125 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:19.224609 22456 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 0.
I20260709 12:09:19.224746 22570 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:19.225907 22651 raft_consensus.cc:2804] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.226364 22651 raft_consensus.cc:697] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:09:19.226433 22719 consensus_queue.cc:1048] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.227272 22651 consensus_queue.cc:237] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.219985 22671 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.234853 22668 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:19.239907 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:19.241441 22454 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.241662 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:19.242220 22531 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.242587 22648 tablet_bootstrap.cc:654] T b205f960deef48f8bc84127a8b47faf4 P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.223527 22603 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 0.
W20260709 12:09:19.250020 22403 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:19.256894 22647 tablet_bootstrap.cc:492] T 40384260c96247e0ac31ade25baddaff P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:19.257483 22647 ts_tablet_manager.cc:1403] T 40384260c96247e0ac31ade25baddaff P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.132s	user 0.017s	sys 0.031s
I20260709 12:09:19.245966 22351 catalog_manager.cc:5697] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:19.261049 22497 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:19.261978 22667 raft_consensus.cc:2749] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.262836 22531 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 1.
I20260709 12:09:19.263253 22647 raft_consensus.cc:359] T 40384260c96247e0ac31ade25baddaff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.263569 22719 raft_consensus.cc:2804] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.263914 22647 raft_consensus.cc:385] T 40384260c96247e0ac31ade25baddaff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.264179 22719 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.264281 22647 raft_consensus.cc:740] T 40384260c96247e0ac31ade25baddaff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.264487 22570 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:09:19.265601 22651 raft_consensus.cc:2804] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.265808 22647 consensus_queue.cc:260] T 40384260c96247e0ac31ade25baddaff P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.269014 22722 consensus_queue.cc:1048] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.264624 22719 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.269585 22454 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 1.
I20260709 12:09:19.272403 22651 raft_consensus.cc:697] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:09:19.271036 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:19.278836 22647 ts_tablet_manager.cc:1434] T 40384260c96247e0ac31ade25baddaff P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.003s
I20260709 12:09:19.273226 22531 raft_consensus.cc:3060] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.284209 22354 catalog_manager.cc:5697] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 1 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:19.286631 22647 tablet_bootstrap.cc:492] T 9b31ce17d24644c19dbf9469c435d149 P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:19.288233 22671 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:19.289273 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:19.289775 22531 raft_consensus.cc:2468] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 1.
I20260709 12:09:19.289649 22646 raft_consensus.cc:359] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.292447 22646 raft_consensus.cc:385] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.292745 22646 raft_consensus.cc:740] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.293452 22646 consensus_queue.cc:260] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.286108 22651 consensus_queue.cc:237] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.294714 22647 tablet_bootstrap.cc:654] T 9b31ce17d24644c19dbf9469c435d149 P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.294955 22603 raft_consensus.cc:3060] T 19a99176cd014d618ba1793fbb19aeab P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.296468 22421 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:19.295612 22719 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.298635 22671 raft_consensus.cc:2804] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.300808 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:19.301679 22719 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:19.295833 22646 ts_tablet_manager.cc:1434] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.075s	user 0.001s	sys 0.005s
I20260709 12:09:19.304554 22646 tablet_bootstrap.cc:492] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:19.303684 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:19.303395 22671 raft_consensus.cc:697] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:09:19.318082 22605 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:19.318974 22495 leader_election.cc:343] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.343420 22671 consensus_queue.cc:237] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.352615 22603 raft_consensus.cc:2468] T 19a99176cd014d618ba1793fbb19aeab P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 1.
I20260709 12:09:19.356012 22605 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:09:19.360991 22667 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.361631 22667 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.364221 22667 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:19.367348 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:19.368160 22531 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 0.
I20260709 12:09:19.369874 22421 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:19.371024 22667 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.371647 22667 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.372182 22667 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.377435 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:19.378342 22605 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 0.
I20260709 12:09:19.387537 22497 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:19.388746 22719 raft_consensus.cc:2804] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.389211 22648 tablet_bootstrap.cc:492] T b205f960deef48f8bc84127a8b47faf4 P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:19.389647 22648 ts_tablet_manager.cc:1403] T b205f960deef48f8bc84127a8b47faf4 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.176s	user 0.009s	sys 0.014s
I20260709 12:09:19.394281 22648 raft_consensus.cc:359] T b205f960deef48f8bc84127a8b47faf4 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.395179 22648 raft_consensus.cc:385] T b205f960deef48f8bc84127a8b47faf4 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.395521 22648 raft_consensus.cc:740] T b205f960deef48f8bc84127a8b47faf4 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.396340 22648 consensus_queue.cc:260] T b205f960deef48f8bc84127a8b47faf4 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.389400 22719 raft_consensus.cc:697] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:19.399441 22648 ts_tablet_manager.cc:1434] T b205f960deef48f8bc84127a8b47faf4 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:09:19.400604 22648 tablet_bootstrap.cc:492] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:19.420287 22646 tablet_bootstrap.cc:654] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.414320 22722 consensus_queue.cc:1048] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:09:19.422827 22694 consensus_queue.cc:1048] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.424542 22648 tablet_bootstrap.cc:654] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.408174 22719 consensus_queue.cc:237] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.426695 22759 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.431243 22759 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.435904 22667 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.440889 22667 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:19.445499 22759 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:19.445607 22647 tablet_bootstrap.cc:492] T 9b31ce17d24644c19dbf9469c435d149 P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:19.446188 22647 ts_tablet_manager.cc:1403] T 9b31ce17d24644c19dbf9469c435d149 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.160s	user 0.026s	sys 0.019s
I20260709 12:09:19.446748 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:19.448809 22647 raft_consensus.cc:359] T 9b31ce17d24644c19dbf9469c435d149 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.449445 22647 raft_consensus.cc:385] T 9b31ce17d24644c19dbf9469c435d149 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.449916 22647 raft_consensus.cc:740] T 9b31ce17d24644c19dbf9469c435d149 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.450697 22647 consensus_queue.cc:260] T 9b31ce17d24644c19dbf9469c435d149 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.447307 22531 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.450860 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:19.455520 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:19.455190 22354 catalog_manager.cc:5697] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 1 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:19.456048 22604 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.457453 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:19.462198 22647 ts_tablet_manager.cc:1434] T 9b31ce17d24644c19dbf9469c435d149 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
W20260709 12:09:19.464570 22497 leader_election.cc:343] T 40384260c96247e0ac31ade25baddaff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.464905 22667 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.465389 22667 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:09:19.466176 22495 leader_election.cc:343] T 40384260c96247e0ac31ade25baddaff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.471845 22495 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:19.479362 22763 raft_consensus.cc:2749] T 40384260c96247e0ac31ade25baddaff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.487694 22667 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:19.488400 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:19.488936 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:19.492563 22532 raft_consensus.cc:2393] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 1: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:09:19.488909 22531 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 1.
I20260709 12:09:19.489944 22604 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 1.
I20260709 12:09:19.495513 22351 catalog_manager.cc:5697] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 0 to 1, leader changed from <none> to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:19.504565 22422 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:09:19.509927 22422 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:19.510288 22671 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.511433 22654 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.511879 22654 raft_consensus.cc:697] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:09:19.512070 22646 tablet_bootstrap.cc:492] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:19.512492 22646 ts_tablet_manager.cc:1403] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.208s	user 0.012s	sys 0.001s
I20260709 12:09:19.512627 22647 tablet_bootstrap.cc:492] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:19.522339 22646 raft_consensus.cc:359] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.522854 22646 raft_consensus.cc:385] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.523129 22646 raft_consensus.cc:740] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.523803 22646 consensus_queue.cc:260] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.512703 22654 consensus_queue.cc:237] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.538470 22648 tablet_bootstrap.cc:492] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:19.538807 22646 ts_tablet_manager.cc:1434] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:09:19.541750 22646 tablet_bootstrap.cc:492] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:19.544831 22648 ts_tablet_manager.cc:1403] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.144s	user 0.026s	sys 0.018s
I20260709 12:09:19.549124 22671 raft_consensus.cc:2749] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.550074 22646 tablet_bootstrap.cc:654] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.553056 22647 tablet_bootstrap.cc:654] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.554435 22651 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.554229 22353 catalog_manager.cc:5697] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:19.556203 22651 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.558280 22651 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:19.560424 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:19.560524 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:09:19.561717 22569 leader_election.cc:343] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:19.562522 22570 leader_election.cc:343] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.555158 22648 raft_consensus.cc:359] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.563107 22570 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:19.563596 22648 raft_consensus.cc:385] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.564325 22648 raft_consensus.cc:740] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.564622 22651 raft_consensus.cc:2749] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.564919 22648 consensus_queue.cc:260] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.566629 22648 ts_tablet_manager.cc:1434] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.000s
I20260709 12:09:19.567490 22648 tablet_bootstrap.cc:492] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:19.573207 22647 tablet_bootstrap.cc:492] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:19.573632 22647 ts_tablet_manager.cc:1403] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.061s	user 0.009s	sys 0.001s
I20260709 12:09:19.574199 22351 catalog_manager.cc:5697] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 0 to 1, leader changed from <none> to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:19.576326 22647 raft_consensus.cc:359] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.577016 22647 raft_consensus.cc:385] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.577284 22647 raft_consensus.cc:740] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.577890 22647 consensus_queue.cc:260] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.578370 22646 tablet_bootstrap.cc:492] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:19.578785 22646 ts_tablet_manager.cc:1403] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.037s	user 0.019s	sys 0.014s
I20260709 12:09:19.582103 22648 tablet_bootstrap.cc:654] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.581800 22646 raft_consensus.cc:359] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.582451 22646 raft_consensus.cc:385] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.582717 22646 raft_consensus.cc:740] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.583577 22646 consensus_queue.cc:260] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.584707 22647 ts_tablet_manager.cc:1434] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:09:19.585464 22647 tablet_bootstrap.cc:492] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:19.585812 22646 ts_tablet_manager.cc:1434] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:19.586644 22646 tablet_bootstrap.cc:492] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:19.591048 22647 tablet_bootstrap.cc:654] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.591367 22651 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.592044 22646 tablet_bootstrap.cc:654] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.591817 22651 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.594589 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:19.595402 22648 tablet_bootstrap.cc:492] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:19.595432 22456 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 0.
I20260709 12:09:19.595948 22648 ts_tablet_manager.cc:1403] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.000s
I20260709 12:09:19.596093 22719 consensus_queue.cc:1048] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.597133 22569 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:19.598237 22713 raft_consensus.cc:2804] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.598703 22713 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.598548 22648 raft_consensus.cc:359] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.599288 22648 raft_consensus.cc:385] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.599659 22648 raft_consensus.cc:740] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.599185 22713 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.600289 22648 consensus_queue.cc:260] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.602591 22648 ts_tablet_manager.cc:1434] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:09:19.602706 22646 tablet_bootstrap.cc:492] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:19.603171 22646 ts_tablet_manager.cc:1403] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.003s
I20260709 12:09:19.603454 22648 tablet_bootstrap.cc:492] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:19.605669 22646 raft_consensus.cc:359] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.606276 22646 raft_consensus.cc:385] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.606518 22646 raft_consensus.cc:740] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.607259 22646 consensus_queue.cc:260] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.609254 22646 ts_tablet_manager.cc:1434] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:09:19.609797 22648 tablet_bootstrap.cc:654] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.610707 22646 tablet_bootstrap.cc:492] T aeff0fdef6b04a46975756455aba1a98 P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:19.611069 22713 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.613618 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:19.614199 22455 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.623907 22646 tablet_bootstrap.cc:654] T aeff0fdef6b04a46975756455aba1a98 P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.627159 22651 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:19.627190 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:19.628223 22531 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.628991 22646 tablet_bootstrap.cc:492] T aeff0fdef6b04a46975756455aba1a98 P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:19.629419 22646 ts_tablet_manager.cc:1403] T aeff0fdef6b04a46975756455aba1a98 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.001s
I20260709 12:09:19.631713 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:19.631943 22646 raft_consensus.cc:359] T aeff0fdef6b04a46975756455aba1a98 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.632541 22646 raft_consensus.cc:385] T aeff0fdef6b04a46975756455aba1a98 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.632810 22646 raft_consensus.cc:740] T aeff0fdef6b04a46975756455aba1a98 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.633567 22646 consensus_queue.cc:260] T aeff0fdef6b04a46975756455aba1a98 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.635802 22646 ts_tablet_manager.cc:1434] T aeff0fdef6b04a46975756455aba1a98 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:09:19.636647 22646 tablet_bootstrap.cc:492] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:19.637255 22531 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 1.
I20260709 12:09:19.638300 22570 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:09:19.639107 22651 raft_consensus.cc:2804] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.639750 22651 raft_consensus.cc:697] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:09:19.640574 22651 consensus_queue.cc:237] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.651911 22646 tablet_bootstrap.cc:654] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.622776 22455 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 1.
I20260709 12:09:19.655606 22713 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:19.658448 22646 tablet_bootstrap.cc:492] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:19.659098 22646 ts_tablet_manager.cc:1403] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.000s
I20260709 12:09:19.658295 22353 catalog_manager.cc:5697] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 1 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:19.662894 22671 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.716502 22671 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.717715 22646 raft_consensus.cc:359] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.718271 22646 raft_consensus.cc:385] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.718545 22646 raft_consensus.cc:740] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.718720 22671 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:19.718622 22648 tablet_bootstrap.cc:492] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:19.719578 22648 ts_tablet_manager.cc:1403] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.116s	user 0.015s	sys 0.038s
I20260709 12:09:19.719309 22646 consensus_queue.cc:260] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.720745 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:19.721439 22646 ts_tablet_manager.cc:1434] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:09:19.721612 22713 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.722314 22646 tablet_bootstrap.cc:492] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:19.722112 22713 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.722800 22719 consensus_queue.cc:1048] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.722925 22648 raft_consensus.cc:359] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.723660 22648 raft_consensus.cc:385] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.723960 22648 raft_consensus.cc:740] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.724742 22713 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:19.728117 22646 tablet_bootstrap.cc:654] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.725440 22648 consensus_queue.cc:260] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.730705 22713 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.731207 22713 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.732546 22648 ts_tablet_manager.cc:1434] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 12:09:19.736267 22648 tablet_bootstrap.cc:492] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:19.737958 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:19.738790 22532 raft_consensus.cc:2468] T 40384260c96247e0ac31ade25baddaff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 0.
I20260709 12:09:19.740674 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:19.742475 22648 tablet_bootstrap.cc:654] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.742537 22713 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:19.742755 22570 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
W20260709 12:09:19.744174 22570 leader_election.cc:343] T aeff0fdef6b04a46975756455aba1a98 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.748521 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:19.749347 22605 raft_consensus.cc:2393] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 1: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:09:19.750340 22713 raft_consensus.cc:2804] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.750747 22713 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.751187 22713 raft_consensus.cc:3060] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.750623 22422 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:09:19.753021 22671 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.753814 22651 consensus_queue.cc:1048] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.757601 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:19.758260 22455 raft_consensus.cc:2468] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 0.
I20260709 12:09:19.758380 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:09:19.762773 22569 leader_election.cc:343] T aeff0fdef6b04a46975756455aba1a98 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.763484 22569 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:19.764679 22651 raft_consensus.cc:2749] T aeff0fdef6b04a46975756455aba1a98 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.766866 22651 consensus_queue.cc:1048] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.768126 22647 tablet_bootstrap.cc:492] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:19.768621 22647 ts_tablet_manager.cc:1403] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.183s	user 0.030s	sys 0.029s
I20260709 12:09:19.773713 22647 raft_consensus.cc:359] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.776680 22647 raft_consensus.cc:385] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.777151 22647 raft_consensus.cc:740] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.778203 22647 consensus_queue.cc:260] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.781014 22648 tablet_bootstrap.cc:492] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:19.781591 22648 ts_tablet_manager.cc:1403] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.046s	user 0.006s	sys 0.005s
I20260709 12:09:19.776162 22764 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.787240 22764 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.789896 22764 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:19.790637 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:19.791270 22454 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 0.
I20260709 12:09:19.792716 22495 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:19.793519 22764 raft_consensus.cc:2804] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.795351 22764 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.795881 22764 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.797436 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:19.798367 22605 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 0.
I20260709 12:09:19.794832 22647 ts_tablet_manager.cc:1434] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.004s
I20260709 12:09:19.806450 22647 tablet_bootstrap.cc:492] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:19.816606 22671 raft_consensus.cc:2749] T b205f960deef48f8bc84127a8b47faf4 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.824255 22648 raft_consensus.cc:359] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.825229 22648 raft_consensus.cc:385] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.825608 22648 raft_consensus.cc:740] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.826524 22648 consensus_queue.cc:260] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.831079 22668 consensus_queue.cc:1048] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.831540 22646 tablet_bootstrap.cc:492] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:19.831947 22646 ts_tablet_manager.cc:1403] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.110s	user 0.038s	sys 0.030s
I20260709 12:09:19.840953 22647 tablet_bootstrap.cc:654] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.841394 22763 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.846310 22763 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.841940 22648 ts_tablet_manager.cc:1434] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.000s
I20260709 12:09:19.849017 22763 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:19.850936 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:19.811545 22713 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.853294 22648 tablet_bootstrap.cc:492] T 538826f1cb47443eb083fb9360e7b1fb P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:19.853056 22646 raft_consensus.cc:359] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.853785 22646 raft_consensus.cc:385] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.854113 22646 raft_consensus.cc:740] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.852233 22454 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 0.
I20260709 12:09:19.854549 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:19.854835 22646 consensus_queue.cc:260] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.856655 22495 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:19.857098 22646 ts_tablet_manager.cc:1434] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:09:19.859078 22646 tablet_bootstrap.cc:492] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
W20260709 12:09:19.861904 22497 leader_election.cc:343] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.862895 22763 raft_consensus.cc:2804] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.863328 22763 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.863684 22763 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.872506 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:19.873160 22455 raft_consensus.cc:3060] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.874558 22668 consensus_queue.cc:1048] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.868867 22713 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:19.879623 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:19.882571 22532 raft_consensus.cc:3060] T 40384260c96247e0ac31ade25baddaff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.895815 22654 consensus_queue.cc:1048] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.897086 22764 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.899574 22695 consensus_queue.cc:1048] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.901808 22763 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.903565 22532 raft_consensus.cc:2468] T 40384260c96247e0ac31ade25baddaff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 1.
I20260709 12:09:19.904181 22455 raft_consensus.cc:2468] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 1.
I20260709 12:09:19.904619 22764 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:19.905222 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:19.908725 22457 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.915216 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:19.909667 22763 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:19.917552 22455 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.918067 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:19.924130 22648 tablet_bootstrap.cc:654] T 538826f1cb47443eb083fb9360e7b1fb P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.906399 22570 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:09:19.935078 22646 tablet_bootstrap.cc:654] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.938367 22713 raft_consensus.cc:2804] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.939638 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:09:19.949277 22497 leader_election.cc:343] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:19.960440 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 50789.6us
I20260709 12:09:19.961042 22647 tablet_bootstrap.cc:492] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:19.961512 22647 ts_tablet_manager.cc:1403] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.155s	user 0.011s	sys 0.018s
I20260709 12:09:19.951737 22713 raft_consensus.cc:697] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:09:19.963135 22713 consensus_queue.cc:237] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:19.965320 22654 consensus_queue.cc:1048] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.966959 22455 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:09:19.953416 22604 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.991204 22648 tablet_bootstrap.cc:492] T 538826f1cb47443eb083fb9360e7b1fb P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:19.991848 22648 ts_tablet_manager.cc:1403] T 538826f1cb47443eb083fb9360e7b1fb P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.139s	user 0.022s	sys 0.006s
I20260709 12:09:19.999574 22647 raft_consensus.cc:359] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.000275 22647 raft_consensus.cc:385] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.000576 22647 raft_consensus.cc:740] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.002760 22647 consensus_queue.cc:260] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.006093 22647 ts_tablet_manager.cc:1434] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 12:09:20.008419 22647 tablet_bootstrap.cc:492] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:20.006943 22604 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:09:20.028653 22497 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:09:20.029600 22763 raft_consensus.cc:2804] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.030061 22763 raft_consensus.cc:697] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:20.030953 22648 raft_consensus.cc:359] T 538826f1cb47443eb083fb9360e7b1fb P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.030871 22763 consensus_queue.cc:237] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.031572 22648 raft_consensus.cc:385] T 538826f1cb47443eb083fb9360e7b1fb P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.031845 22648 raft_consensus.cc:740] T 538826f1cb47443eb083fb9360e7b1fb P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.007645 22495 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:09:20.032548 22648 consensus_queue.cc:260] T 538826f1cb47443eb083fb9360e7b1fb P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.034052 22695 raft_consensus.cc:2804] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.034511 22695 raft_consensus.cc:697] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:20.034925 22648 ts_tablet_manager.cc:1434] T 538826f1cb47443eb083fb9360e7b1fb P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.000s
I20260709 12:09:20.036562 22648 tablet_bootstrap.cc:492] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:20.035322 22695 consensus_queue.cc:237] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.007536 22457 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:09:20.048206 22651 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.048940 22651 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.049714 22671 consensus_queue.cc:1048] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.054167 22647 tablet_bootstrap.cc:654] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.054461 22646 tablet_bootstrap.cc:492] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:20.054929 22646 ts_tablet_manager.cc:1403] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.196s	user 0.027s	sys 0.020s
I20260709 12:09:20.046867 22353 catalog_manager.cc:5697] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 1 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:20.055518 22719 consensus_queue.cc:1048] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.060880 22651 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:20.060721 22646 raft_consensus.cc:359] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.062561 22646 raft_consensus.cc:385] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.062862 22646 raft_consensus.cc:740] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.063575 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:09:20.065330 22569 leader_election.cc:343] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.080750 22646 consensus_queue.cc:260] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.081462 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:20.082091 22531 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 0.
I20260709 12:09:20.082917 22646 ts_tablet_manager.cc:1434] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.004s
I20260709 12:09:20.083880 22646 tablet_bootstrap.cc:492] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:20.086891 22648 tablet_bootstrap.cc:654] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.088855 22570 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:20.090306 22792 raft_consensus.cc:2804] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.090782 22792 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.091488 22792 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.098253 22646 tablet_bootstrap.cc:654] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.105439 22654 consensus_queue.cc:1048] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.107533 22646 tablet_bootstrap.cc:492] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:20.107977 22646 ts_tablet_manager.cc:1403] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.024s	user 0.006s	sys 0.004s
I20260709 12:09:20.110402 22646 raft_consensus.cc:359] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.111083 22646 raft_consensus.cc:385] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.111347 22646 raft_consensus.cc:740] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.117139 22646 consensus_queue.cc:260] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.120162 22794 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.120601 22794 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.122563 22794 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:20.124207 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:20.124485 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:20.124224 22646 ts_tablet_manager.cc:1434] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:09:20.125105 22457 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 0.
I20260709 12:09:20.125679 22646 tablet_bootstrap.cc:492] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:20.126258 22569 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:09:20.126935 22570 leader_election.cc:343] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.127082 22794 consensus_queue.cc:1048] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.128111 22651 raft_consensus.cc:2804] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.128669 22651 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.129182 22651 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.133903 22646 tablet_bootstrap.cc:654] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.135808 22647 tablet_bootstrap.cc:492] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:20.136727 22647 ts_tablet_manager.cc:1403] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.129s	user 0.030s	sys 0.009s
I20260709 12:09:20.138866 22794 consensus_queue.cc:1048] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:20.150240 22792 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.154654 22648 tablet_bootstrap.cc:492] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:20.151868 22647 raft_consensus.cc:359] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.156991 22647 raft_consensus.cc:385] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.158968 22647 raft_consensus.cc:740] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.159436 22646 tablet_bootstrap.cc:492] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:20.159888 22646 ts_tablet_manager.cc:1403] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.034s	user 0.003s	sys 0.007s
I20260709 12:09:20.159770 22647 consensus_queue.cc:260] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.163013 22648 ts_tablet_manager.cc:1403] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.127s	user 0.015s	sys 0.019s
I20260709 12:09:20.165910 22646 raft_consensus.cc:359] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.168336 22647 ts_tablet_manager.cc:1434] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 12:09:20.177354 22646 raft_consensus.cc:385] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.178180 22646 raft_consensus.cc:740] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.178278 22647 tablet_bootstrap.cc:492] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:20.178884 22646 consensus_queue.cc:260] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.181025 22646 ts_tablet_manager.cc:1434] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.004s
I20260709 12:09:20.181733 22646 tablet_bootstrap.cc:492] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:20.187983 22646 tablet_bootstrap.cc:654] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.190598 22794 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.191105 22794 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.192950 22794 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:20.192687 22354 catalog_manager.cc:5697] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:20.193760 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:20.194845 22455 raft_consensus.cc:2393] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 1: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:09:20.194445 22354 catalog_manager.cc:5697] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:20.166281 22648 raft_consensus.cc:359] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.199204 22648 raft_consensus.cc:385] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.199502 22648 raft_consensus.cc:740] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.201148 22648 consensus_queue.cc:260] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.202531 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:20.204386 22570 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:20.205129 22794 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.204991 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:20.168401 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:20.207749 22648 ts_tablet_manager.cc:1434] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.044s	user 0.011s	sys 0.000s
I20260709 12:09:20.212568 22648 tablet_bootstrap.cc:492] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:20.214021 22530 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.172195 22792 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:09:20.224071 22569 leader_election.cc:343] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.166378 22651 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.234800 22647 tablet_bootstrap.cc:654] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.234586 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:20.235291 22457 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.237212 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:20.235373 22651 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:20.240530 22794 raft_consensus.cc:2749] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:20.242729 22570 leader_election.cc:343] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.245611 22457 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 1.
I20260709 12:09:20.246821 22569 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:09:20.247363 22530 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 1.
I20260709 12:09:20.248840 22794 raft_consensus.cc:2804] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.249050 22570 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:20.249351 22794 raft_consensus.cc:697] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:09:20.250288 22651 raft_consensus.cc:2804] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.250166 22794 consensus_queue.cc:237] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.256656 22646 tablet_bootstrap.cc:492] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:20.257187 22646 ts_tablet_manager.cc:1403] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.076s	user 0.016s	sys 0.016s
I20260709 12:09:20.250924 22651 raft_consensus.cc:697] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:09:20.259879 22651 consensus_queue.cc:237] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.260960 22646 raft_consensus.cc:359] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.261610 22646 raft_consensus.cc:385] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.261873 22646 raft_consensus.cc:740] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.267447 22646 consensus_queue.cc:260] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.264199 22668 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.269539 22668 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.273191 22668 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:20.273974 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:20.271497 22646 ts_tablet_manager.cc:1434] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.005s
I20260709 12:09:20.274844 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:20.275766 22646 tablet_bootstrap.cc:492] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
W20260709 12:09:20.275599 22569 leader_election.cc:343] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:20.276185 22570 leader_election.cc:343] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.277464 22648 tablet_bootstrap.cc:654] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.276594 22570 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:20.280553 22651 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.284360 22647 tablet_bootstrap.cc:492] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:20.284824 22647 ts_tablet_manager.cc:1403] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.107s	user 0.013s	sys 0.013s
I20260709 12:09:20.292272 22353 catalog_manager.cc:5697] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 1 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:20.296101 22646 tablet_bootstrap.cc:654] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.299922 22647 raft_consensus.cc:359] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.300580 22647 raft_consensus.cc:385] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.300853 22647 raft_consensus.cc:740] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.301497 22647 consensus_queue.cc:260] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.303479 22647 ts_tablet_manager.cc:1434] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.004s
W20260709 12:09:20.303740 22403 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:20.306304 22646 tablet_bootstrap.cc:492] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:20.306712 22646 ts_tablet_manager.cc:1403] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.031s	user 0.006s	sys 0.009s
I20260709 12:09:20.307705 22647 tablet_bootstrap.cc:492] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:20.309188 22646 raft_consensus.cc:359] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.309815 22646 raft_consensus.cc:385] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.310068 22646 raft_consensus.cc:740] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.310745 22646 consensus_queue.cc:260] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.312834 22646 ts_tablet_manager.cc:1434] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:09:20.313597 22646 tablet_bootstrap.cc:492] T 5b50f0bec71f4924aa1781b9818f1d73 P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:20.314106 22647 tablet_bootstrap.cc:654] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.315795 22354 catalog_manager.cc:5697] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 1 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:20.320411 22646 tablet_bootstrap.cc:654] T 5b50f0bec71f4924aa1781b9818f1d73 P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.321820 22648 tablet_bootstrap.cc:492] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:20.322278 22648 ts_tablet_manager.cc:1403] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.110s	user 0.012s	sys 0.011s
I20260709 12:09:20.325444 22648 raft_consensus.cc:359] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.326318 22648 raft_consensus.cc:385] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.326639 22648 raft_consensus.cc:740] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.327554 22648 consensus_queue.cc:260] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.329479 22648 ts_tablet_manager.cc:1434] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:09:20.330298 22648 tablet_bootstrap.cc:492] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:20.333771 22646 tablet_bootstrap.cc:492] T 5b50f0bec71f4924aa1781b9818f1d73 P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:20.334225 22646 ts_tablet_manager.cc:1403] T 5b50f0bec71f4924aa1781b9818f1d73 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.008s
I20260709 12:09:20.335234 22647 tablet_bootstrap.cc:492] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:20.335657 22647 ts_tablet_manager.cc:1403] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.004s
I20260709 12:09:20.336732 22646 raft_consensus.cc:359] T 5b50f0bec71f4924aa1781b9818f1d73 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.337354 22646 raft_consensus.cc:385] T 5b50f0bec71f4924aa1781b9818f1d73 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.337594 22646 raft_consensus.cc:740] T 5b50f0bec71f4924aa1781b9818f1d73 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.338220 22646 consensus_queue.cc:260] T 5b50f0bec71f4924aa1781b9818f1d73 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.338130 22647 raft_consensus.cc:359] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.340346 22647 raft_consensus.cc:385] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.340240 22646 ts_tablet_manager.cc:1434] T 5b50f0bec71f4924aa1781b9818f1d73 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:09:20.340605 22647 raft_consensus.cc:740] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.341600 22646 tablet_bootstrap.cc:492] T 3aebfd8b04a4461ab6bc979eee23a2bc P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:20.341281 22647 consensus_queue.cc:260] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.343250 22647 ts_tablet_manager.cc:1434] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:09:20.345873 22648 tablet_bootstrap.cc:654] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.348374 22646 tablet_bootstrap.cc:654] T 3aebfd8b04a4461ab6bc979eee23a2bc P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.350832 22647 tablet_bootstrap.cc:492] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:20.356276 22695 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.358781 22647 tablet_bootstrap.cc:654] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.356925 22695 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.360447 22646 tablet_bootstrap.cc:492] T 3aebfd8b04a4461ab6bc979eee23a2bc P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:20.360891 22646 ts_tablet_manager.cc:1403] T 3aebfd8b04a4461ab6bc979eee23a2bc P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 12:09:20.364970 22646 raft_consensus.cc:359] T 3aebfd8b04a4461ab6bc979eee23a2bc P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.366843 22646 raft_consensus.cc:385] T 3aebfd8b04a4461ab6bc979eee23a2bc P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.367218 22646 raft_consensus.cc:740] T 3aebfd8b04a4461ab6bc979eee23a2bc P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.368067 22646 consensus_queue.cc:260] T 3aebfd8b04a4461ab6bc979eee23a2bc P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.371119 22646 ts_tablet_manager.cc:1434] T 3aebfd8b04a4461ab6bc979eee23a2bc P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:09:20.372251 22646 tablet_bootstrap.cc:492] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:20.372625 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:20.375689 22695 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:20.376679 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:20.377476 22647 tablet_bootstrap.cc:492] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:20.377678 22457 raft_consensus.cc:2393] T 538826f1cb47443eb083fb9360e7b1fb P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 1: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:09:20.377929 22647 ts_tablet_manager.cc:1403] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.015s
I20260709 12:09:20.378930 22646 tablet_bootstrap.cc:654] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.379670 22495 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:20.380611 22647 raft_consensus.cc:359] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.381269 22647 raft_consensus.cc:385] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.381628 22647 raft_consensus.cc:740] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.382746 22647 consensus_queue.cc:260] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.383978 22763 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.393205 22763 raft_consensus.cc:2749] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.395080 22647 ts_tablet_manager.cc:1434] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:09:20.396291 22647 tablet_bootstrap.cc:492] T f007f8ed533640a9a25704c288c49f3c P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:20.403228 22667 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.403895 22667 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.435562 22695 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.436311 22695 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.438997 22695 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:20.440040 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:09:20.441920 22495 leader_election.cc:343] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.445699 22648 tablet_bootstrap.cc:492] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:20.446223 22648 ts_tablet_manager.cc:1403] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.116s	user 0.050s	sys 0.049s
I20260709 12:09:20.446611 22646 tablet_bootstrap.cc:492] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:20.447065 22646 ts_tablet_manager.cc:1403] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.075s	user 0.032s	sys 0.041s
I20260709 12:09:20.446374 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:20.450789 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:20.451165 22605 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 0.
I20260709 12:09:20.448850 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:20.451570 22604 raft_consensus.cc:2468] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 0.
I20260709 12:09:20.449769 22667 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:20.452699 22422 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:09:20.453565 22421 leader_election.cc:343] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.454941 22667 raft_consensus.cc:2804] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.455660 22497 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:20.455943 22667 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.455508 22648 raft_consensus.cc:359] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.456517 22648 raft_consensus.cc:385] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.456629 22763 raft_consensus.cc:2804] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.456861 22648 raft_consensus.cc:740] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.457140 22763 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.457510 22763 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.458375 22647 tablet_bootstrap.cc:654] T f007f8ed533640a9a25704c288c49f3c P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.458112 22648 consensus_queue.cc:260] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.455485 22646 raft_consensus.cc:359] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.459705 22646 raft_consensus.cc:385] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.460636 22648 ts_tablet_manager.cc:1434] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:09:20.460377 22646 raft_consensus.cc:740] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.462414 22648 tablet_bootstrap.cc:492] T 00284432759445f6a017e6ddb9ec1689 P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:20.461405 22646 consensus_queue.cc:260] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.465540 22646 ts_tablet_manager.cc:1434] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.004s
I20260709 12:09:20.465332 22794 consensus_queue.cc:1048] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.470973 22648 tablet_bootstrap.cc:654] T 00284432759445f6a017e6ddb9ec1689 P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.475240 22646 tablet_bootstrap.cc:492] T 8efee6d07e5841fdb6b0d7ed673b49cb P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:20.481233 22646 tablet_bootstrap.cc:654] T 8efee6d07e5841fdb6b0d7ed673b49cb P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.487901 22648 tablet_bootstrap.cc:492] T 00284432759445f6a017e6ddb9ec1689 P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:20.488339 22648 ts_tablet_manager.cc:1403] T 00284432759445f6a017e6ddb9ec1689 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.000s
I20260709 12:09:20.490798 22648 raft_consensus.cc:359] T 00284432759445f6a017e6ddb9ec1689 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.491452 22648 raft_consensus.cc:385] T 00284432759445f6a017e6ddb9ec1689 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.491748 22648 raft_consensus.cc:740] T 00284432759445f6a017e6ddb9ec1689 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.492365 22648 consensus_queue.cc:260] T 00284432759445f6a017e6ddb9ec1689 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.493046 22646 tablet_bootstrap.cc:492] T 8efee6d07e5841fdb6b0d7ed673b49cb P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:20.493510 22646 ts_tablet_manager.cc:1403] T 8efee6d07e5841fdb6b0d7ed673b49cb P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.004s
I20260709 12:09:20.494037 22648 ts_tablet_manager.cc:1434] T 00284432759445f6a017e6ddb9ec1689 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:09:20.494922 22648 tablet_bootstrap.cc:492] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:20.496037 22646 raft_consensus.cc:359] T 8efee6d07e5841fdb6b0d7ed673b49cb P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.496680 22646 raft_consensus.cc:385] T 8efee6d07e5841fdb6b0d7ed673b49cb P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.496933 22646 raft_consensus.cc:740] T 8efee6d07e5841fdb6b0d7ed673b49cb P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.497592 22646 consensus_queue.cc:260] T 8efee6d07e5841fdb6b0d7ed673b49cb P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.499931 22646 ts_tablet_manager.cc:1434] T 8efee6d07e5841fdb6b0d7ed673b49cb P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.003s
I20260709 12:09:20.500735 22646 tablet_bootstrap.cc:492] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:20.500852 22647 tablet_bootstrap.cc:492] T f007f8ed533640a9a25704c288c49f3c P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:20.501024 22648 tablet_bootstrap.cc:654] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.501312 22647 ts_tablet_manager.cc:1403] T f007f8ed533640a9a25704c288c49f3c P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.105s	user 0.017s	sys 0.013s
I20260709 12:09:20.501091 22668 consensus_queue.cc:1048] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.505004 22647 raft_consensus.cc:359] T f007f8ed533640a9a25704c288c49f3c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.505949 22647 raft_consensus.cc:385] T f007f8ed533640a9a25704c288c49f3c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.506369 22647 raft_consensus.cc:740] T f007f8ed533640a9a25704c288c49f3c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.507061 22646 tablet_bootstrap.cc:654] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.507436 22794 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.507472 22647 consensus_queue.cc:260] T f007f8ed533640a9a25704c288c49f3c P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.508078 22794 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.510462 22647 ts_tablet_manager.cc:1434] T f007f8ed533640a9a25704c288c49f3c P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:09:20.512398 22794 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:20.512964 22648 tablet_bootstrap.cc:492] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:20.513407 22648 ts_tablet_manager.cc:1403] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.007s
I20260709 12:09:20.513762 22647 tablet_bootstrap.cc:492] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:20.515972 22648 raft_consensus.cc:359] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.516615 22648 raft_consensus.cc:385] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.516881 22648 raft_consensus.cc:740] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.519269 22648 consensus_queue.cc:260] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.520056 22647 tablet_bootstrap.cc:654] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.520290 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:20.520910 22530 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 0.
I20260709 12:09:20.521296 22648 ts_tablet_manager.cc:1434] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:09:20.522107 22648 tablet_bootstrap.cc:492] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:20.522329 22570 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:09:20.527093 22667 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.527148 22668 raft_consensus.cc:2804] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.527714 22668 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.528045 22668 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.530457 22648 tablet_bootstrap.cc:654] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.531757 22646 tablet_bootstrap.cc:492] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:20.532213 22646 ts_tablet_manager.cc:1403] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.002s
I20260709 12:09:20.539331 22671 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.539966 22671 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.568675 22763 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.592058 22651 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.662570 22646 raft_consensus.cc:359] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.665926 22646 raft_consensus.cc:385] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.666293 22646 raft_consensus.cc:740] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.608750 22695 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.668442 22695 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.669580 22830 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.670578 22695 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:20.678098 22646 consensus_queue.cc:260] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.570014 22654 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.689033 22654 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.591843 22671 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:20.691735 22671 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.692202 22792 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.692157 22671 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.692757 22792 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.694247 22671 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:20.695449 22792 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:20.695756 22654 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:20.696794 22647 tablet_bootstrap.cc:492] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:20.697458 22647 ts_tablet_manager.cc:1403] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.184s	user 0.032s	sys 0.052s
I20260709 12:09:20.588914 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:20.695689 22668 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.670315 22830 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.570739 22759 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.569823 22719 consensus_queue.cc:1048] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.119s
I20260709 12:09:20.719519 22646 ts_tablet_manager.cc:1434] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.187s	user 0.024s	sys 0.021s
I20260709 12:09:20.734951 22646 tablet_bootstrap.cc:492] T 4e5929206e89419f978fa0283f6bb931 P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:20.717549 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:20.570571 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:20.743553 22648 tablet_bootstrap.cc:492] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:20.743970 22648 ts_tablet_manager.cc:1403] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.222s	user 0.018s	sys 0.015s
I20260709 12:09:20.674402 22651 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.753929 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:20.757426 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:20.750495 22794 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.758364 22794 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.735162 22759 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.747298 22604 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 0.
I20260709 12:09:20.749002 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:20.748687 22453 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 0.
I20260709 12:09:20.770207 22763 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:20.770066 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:09:20.771667 22421 leader_election.cc:343] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.761654 22603 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 0.
I20260709 12:09:20.774999 22647 raft_consensus.cc:359] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.779327 22647 raft_consensus.cc:385] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.779726 22647 raft_consensus.cc:740] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
W20260709 12:09:20.784297 22570 leader_election.cc:343] T 5b50f0bec71f4924aa1781b9818f1d73 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.785809 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:20.786073 22668 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:20.786424 22601 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.769240 22605 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 0.
I20260709 12:09:20.785023 22422 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:09:20.791015 22422 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:20.792847 22647 consensus_queue.cc:260] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.795272 22648 raft_consensus.cc:359] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.796751 22648 raft_consensus.cc:385] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.796998 22648 raft_consensus.cc:740] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.800563 22829 raft_consensus.cc:2804] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.797571 22654 raft_consensus.cc:2804] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:09:20.801651 22827 log.cc:927] Time spent T 40384260c96247e0ac31ade25baddaff P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:09:20.793506 22651 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:20.801981 22654 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.802537 22654 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.801647 22829 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.804955 22829 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.805047 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:20.805737 22528 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 0.
I20260709 12:09:20.806048 22667 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.804088 22719 consensus_queue.cc:1048] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:09:20.791720 22830 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:20.808418 22647 ts_tablet_manager.cc:1434] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.111s	user 0.008s	sys 0.004s
I20260709 12:09:20.810245 22648 consensus_queue.cc:260] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.811225 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:20.811986 22605 raft_consensus.cc:2393] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 1: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:09:20.812037 22759 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:20.811219 22422 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:20.813172 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:20.815223 22530 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 0.
I20260709 12:09:20.821355 22647 tablet_bootstrap.cc:492] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:20.823163 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:20.831892 22648 ts_tablet_manager.cc:1434] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.088s	user 0.003s	sys 0.005s
I20260709 12:09:20.826231 22671 raft_consensus.cc:2804] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.834331 22648 tablet_bootstrap.cc:492] T 8c3000c4a87f46b69b5da41dc1115486 P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:20.833987 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:20.835228 22671 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.843766 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:20.844075 22671 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.847628 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:20.848219 22606 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.849454 22667 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:20.850696 22654 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.855165 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:20.857075 22604 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.859633 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:20.860105 22455 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.858054 22794 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:20.860688 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:20.844717 22530 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 0.
I20260709 12:09:20.854629 22654 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:20.880240 22794 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.880841 22794 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.881446 22719 consensus_queue.cc:1048] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.891412 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:20.897082 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:20.898233 22451 raft_consensus.cc:2393] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 1: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:09:20.876392 22829 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.904927 22457 raft_consensus.cc:2393] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 1: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:09:20.905236 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:20.908257 22646 tablet_bootstrap.cc:654] T 4e5929206e89419f978fa0283f6bb931 P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.913113 22601 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:09:20.913303 22455 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 1.
I20260709 12:09:20.895466 22794 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:20.918426 22497 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:09:20.919239 22719 raft_consensus.cc:2804] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.919678 22719 raft_consensus.cc:697] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:20.920521 22671 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.920429 22719 consensus_queue.cc:237] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.926076 22495 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:20.927150 22695 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.927887 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:20.928949 22454 raft_consensus.cc:2393] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 1: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:09:20.913308 22604 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 1.
I20260709 12:09:20.934294 22671 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:20.950700 22794 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:20.933020 22569 consensus_peers.cc:597] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:20.922556 22606 raft_consensus.cc:2468] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 1.
I20260709 12:09:20.962652 22647 tablet_bootstrap.cc:654] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.963057 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:20.959444 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:20.965724 22530 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.964782 22763 consensus_queue.cc:1048] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:09:20.968462 22455 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.972926 22422 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:20.975574 22654 raft_consensus.cc:2804] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.965811 22794 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.977905 22648 tablet_bootstrap.cc:654] T 8c3000c4a87f46b69b5da41dc1115486 P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.976183 22654 raft_consensus.cc:697] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:09:20.978252 22794 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:20.963442 22695 raft_consensus.cc:2749] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.982195 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:20.984234 22654 consensus_queue.cc:237] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:20.984635 22495 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:20.989518 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:20.989936 22695 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:20.986552 22569 leader_election.cc:343] T 3aebfd8b04a4461ab6bc979eee23a2bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.001478 22646 tablet_bootstrap.cc:492] T 4e5929206e89419f978fa0283f6bb931 P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:21.001922 22646 ts_tablet_manager.cc:1403] T 4e5929206e89419f978fa0283f6bb931 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.268s	user 0.019s	sys 0.004s
I20260709 12:09:20.990829 22530 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 1.
I20260709 12:09:20.990742 22422 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:21.006973 22671 raft_consensus.cc:2804] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.007478 22671 raft_consensus.cc:697] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:09:21.008324 22671 consensus_queue.cc:237] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.008764 22421 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:09:21.009478 22570 leader_election.cc:343] T 3aebfd8b04a4461ab6bc979eee23a2bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.009955 22570 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:21.010473 22667 raft_consensus.cc:2764] T 00284432759445f6a017e6ddb9ec1689 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:09:21.012316 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:21.014321 22668 raft_consensus.cc:2749] T 3aebfd8b04a4461ab6bc979eee23a2bc P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.017139 22713 consensus_queue.cc:1048] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:09:21.019297 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:21.019858 22603 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.021556 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:21.022128 22532 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:21.022639 22569 leader_election.cc:343] T 8efee6d07e5841fdb6b0d7ed673b49cb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.023340 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:21.020920 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:21.023737 22569 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:21.015743 22829 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:21.030617 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:21.017627 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:21.022732 22668 consensus_queue.cc:1048] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:09:21.040884 22602 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:21.038818 22570 leader_election.cc:343] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.063956 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:09:21.059149 22570 leader_election.cc:343] T 8efee6d07e5841fdb6b0d7ed673b49cb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:21.072990 22421 leader_election.cc:343] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.053828 22569 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:21.076588 22646 raft_consensus.cc:359] T 4e5929206e89419f978fa0283f6bb931 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.078552 22646 raft_consensus.cc:385] T 4e5929206e89419f978fa0283f6bb931 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.078962 22646 raft_consensus.cc:740] T 4e5929206e89419f978fa0283f6bb931 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.084136 22695 raft_consensus.cc:2749] T f007f8ed533640a9a25704c288c49f3c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.085950 22603 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 1.
I20260709 12:09:21.087404 22532 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 1.
I20260709 12:09:21.087734 22792 raft_consensus.cc:2749] T 5b50f0bec71f4924aa1781b9818f1d73 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.089370 22455 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:09:21.090602 22646 consensus_queue.cc:260] T 4e5929206e89419f978fa0283f6bb931 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.077483 22570 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:21.095978 22422 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:09:21.097960 22829 raft_consensus.cc:2804] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.098026 22421 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:21.098490 22829 raft_consensus.cc:697] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:09:21.099020 22671 raft_consensus.cc:2804] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.099304 22713 raft_consensus.cc:2804] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.099474 22671 raft_consensus.cc:697] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:09:21.099858 22713 raft_consensus.cc:697] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:09:21.099390 22829 consensus_queue.cc:237] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.100447 22671 consensus_queue.cc:237] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.100710 22713 consensus_queue.cc:237] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.115228 22792 raft_consensus.cc:2749] T 8efee6d07e5841fdb6b0d7ed673b49cb P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:21.103523 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 54635.1us
W20260709 12:09:21.121152 22569 leader_election.cc:343] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.121630 22569 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:21.122443 22651 raft_consensus.cc:2749] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.124090 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:21.121924 22646 ts_tablet_manager.cc:1434] T 4e5929206e89419f978fa0283f6bb931 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.120s	user 0.003s	sys 0.005s
I20260709 12:09:21.127352 22646 tablet_bootstrap.cc:492] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:21.078027 22528 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 1.
I20260709 12:09:21.130797 22648 tablet_bootstrap.cc:492] T 8c3000c4a87f46b69b5da41dc1115486 P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:21.238272 22647 tablet_bootstrap.cc:492] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:21.118808 22602 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 1.
I20260709 12:09:21.239298 22648 ts_tablet_manager.cc:1403] T 8c3000c4a87f46b69b5da41dc1115486 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.407s	user 0.018s	sys 0.004s
I20260709 12:09:21.239357 22647 ts_tablet_manager.cc:1403] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.418s	user 0.006s	sys 0.034s
W20260709 12:09:21.231228 22844 log.cc:927] Time spent T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:09:21.244954 22648 raft_consensus.cc:359] T 8c3000c4a87f46b69b5da41dc1115486 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.245488 22648 raft_consensus.cc:385] T 8c3000c4a87f46b69b5da41dc1115486 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.248677 22646 tablet_bootstrap.cc:654] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.245704 22648 raft_consensus.cc:740] T 8c3000c4a87f46b69b5da41dc1115486 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.251848 22647 raft_consensus.cc:359] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.252552 22647 raft_consensus.cc:385] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.252839 22647 raft_consensus.cc:740] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
W20260709 12:09:21.133579 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 76637.7us
I20260709 12:09:21.253523 22647 consensus_queue.cc:260] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.254772 22648 consensus_queue.cc:260] T 8c3000c4a87f46b69b5da41dc1115486 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.231031 22352 catalog_manager.cc:5697] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:21.257205 22648 ts_tablet_manager.cc:1434] T 8c3000c4a87f46b69b5da41dc1115486 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.000s
I20260709 12:09:21.258383 22648 tablet_bootstrap.cc:492] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:21.255412 22530 raft_consensus.cc:2468] T f007f8ed533640a9a25704c288c49f3c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 1.
W20260709 12:09:21.261302 22569 leader_election.cc:343] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.266937 22647 ts_tablet_manager.cc:1434] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.003s
I20260709 12:09:21.268111 22647 tablet_bootstrap.cc:492] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
W20260709 12:09:21.275310 22845 log.cc:927] Time spent T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.062s	user 0.005s	sys 0.007s
W20260709 12:09:21.275341 22570 leader_election.cc:343] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.273182 22351 catalog_manager.cc:5697] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 1 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:21.275877 22570 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:21.281955 22651 raft_consensus.cc:2749] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.282662 22646 tablet_bootstrap.cc:492] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:21.283653 22646 ts_tablet_manager.cc:1403] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.156s	user 0.008s	sys 0.005s
I20260709 12:09:21.284703 22651 consensus_queue.cc:1048] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.286527 22647 tablet_bootstrap.cc:654] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.289474 22648 tablet_bootstrap.cc:654] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.294422 22668 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.295035 22668 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.290202 22646 raft_consensus.cc:359] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.295943 22646 raft_consensus.cc:385] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.296303 22646 raft_consensus.cc:740] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.298188 22646 consensus_queue.cc:260] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.301214 22646 ts_tablet_manager.cc:1434] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:09:21.304781 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:21.304862 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:21.312191 22646 tablet_bootstrap.cc:492] T b36f3a080ce7465b8491197cc6189444 P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:21.297299 22668 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:09:21.319379 22569 leader_election.cc:343] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.324594 22648 tablet_bootstrap.cc:492] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:21.328157 22648 ts_tablet_manager.cc:1403] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.070s	user 0.009s	sys 0.008s
I20260709 12:09:21.330849 22648 raft_consensus.cc:359] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.326864 22647 tablet_bootstrap.cc:492] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:21.333782 22647 ts_tablet_manager.cc:1403] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.066s	user 0.009s	sys 0.008s
I20260709 12:09:21.337226 22647 raft_consensus.cc:359] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.338011 22647 raft_consensus.cc:385] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.338357 22647 raft_consensus.cc:740] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.339103 22648 raft_consensus.cc:385] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.339636 22647 consensus_queue.cc:260] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.332742 22646 tablet_bootstrap.cc:654] T b36f3a080ce7465b8491197cc6189444 P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.342170 22647 ts_tablet_manager.cc:1434] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:09:21.342456 22648 raft_consensus.cc:740] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.343324 22647 tablet_bootstrap.cc:492] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:21.343288 22648 consensus_queue.cc:260] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.344899 22353 catalog_manager.cc:5697] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 0 to 1, leader changed from <none> to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:21.346066 22648 ts_tablet_manager.cc:1434] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 12:09:21.348127 22648 tablet_bootstrap.cc:492] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
W20260709 12:09:21.350201 22570 leader_election.cc:343] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.350564 22647 tablet_bootstrap.cc:654] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.350697 22570 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:21.352767 22646 tablet_bootstrap.cc:492] T b36f3a080ce7465b8491197cc6189444 P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:21.353386 22646 ts_tablet_manager.cc:1403] T b36f3a080ce7465b8491197cc6189444 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.041s	user 0.008s	sys 0.004s
I20260709 12:09:21.353500 22353 catalog_manager.cc:5697] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 0 to 1, leader changed from <none> to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:21.355357 22353 catalog_manager.cc:5697] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 0 to 1, leader changed from <none> to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:21.361238 22647 tablet_bootstrap.cc:492] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:21.361544 22651 raft_consensus.cc:2749] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.361734 22647 ts_tablet_manager.cc:1403] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.000s
I20260709 12:09:21.362888 22646 raft_consensus.cc:359] T b36f3a080ce7465b8491197cc6189444 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.363744 22646 raft_consensus.cc:385] T b36f3a080ce7465b8491197cc6189444 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.365103 22647 raft_consensus.cc:359] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.365988 22647 raft_consensus.cc:385] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.365953 22646 raft_consensus.cc:740] T b36f3a080ce7465b8491197cc6189444 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.366380 22647 raft_consensus.cc:740] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.356750 22353 catalog_manager.cc:5697] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 0 to 1, leader changed from <none> to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:21.366946 22646 consensus_queue.cc:260] T b36f3a080ce7465b8491197cc6189444 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.367071 22647 consensus_queue.cc:260] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.365612 22648 tablet_bootstrap.cc:654] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.370422 22647 ts_tablet_manager.cc:1434] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:09:21.371423 22647 tablet_bootstrap.cc:492] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:21.373694 22646 ts_tablet_manager.cc:1434] T b36f3a080ce7465b8491197cc6189444 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.002s
I20260709 12:09:21.380155 22646 tablet_bootstrap.cc:492] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
W20260709 12:09:21.386112 22403 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:21.377548 22647 tablet_bootstrap.cc:654] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.390321 22646 tablet_bootstrap.cc:654] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.390424 22648 tablet_bootstrap.cc:492] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:21.391359 22648 ts_tablet_manager.cc:1403] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.043s	user 0.008s	sys 0.005s
I20260709 12:09:21.397464 22648 raft_consensus.cc:359] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.398270 22648 raft_consensus.cc:385] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.398613 22648 raft_consensus.cc:740] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.399453 22648 consensus_queue.cc:260] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.401961 22648 ts_tablet_manager.cc:1434] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:09:21.402936 22648 tablet_bootstrap.cc:492] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:21.409355 22648 tablet_bootstrap.cc:654] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.421375 22648 tablet_bootstrap.cc:492] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:21.421917 22648 ts_tablet_manager.cc:1403] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 12:09:21.426256 22648 raft_consensus.cc:359] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.427291 22648 raft_consensus.cc:385] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.427651 22648 raft_consensus.cc:740] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.428488 22648 consensus_queue.cc:260] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.430121 22695 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.430640 22695 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.431051 22648 ts_tablet_manager.cc:1434] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:09:21.432124 22648 tablet_bootstrap.cc:492] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:21.432785 22695 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:21.435416 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:21.436043 22602 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 0.
I20260709 12:09:21.436812 22671 consensus_queue.cc:1048] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.438663 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:21.439272 22455 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 0.
I20260709 12:09:21.440966 22497 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:09:21.442543 22837 raft_consensus.cc:2804] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.443967 22837 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.444397 22837 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.457856 22648 tablet_bootstrap.cc:654] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.458602 22668 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.459303 22668 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.461979 22668 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:21.470093 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:09:21.472990 22570 leader_election.cc:343] T 4e5929206e89419f978fa0283f6bb931 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.474639 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:09:21.476513 22569 leader_election.cc:343] T 4e5929206e89419f978fa0283f6bb931 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.477073 22569 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:21.478312 22713 raft_consensus.cc:2749] T 4e5929206e89419f978fa0283f6bb931 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.482383 22646 tablet_bootstrap.cc:492] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:21.482803 22646 ts_tablet_manager.cc:1403] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.103s	user 0.014s	sys 0.053s
I20260709 12:09:21.483335 22647 tablet_bootstrap.cc:492] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:21.483803 22647 ts_tablet_manager.cc:1403] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.113s	user 0.057s	sys 0.038s
I20260709 12:09:21.486310 22646 raft_consensus.cc:359] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.487020 22646 raft_consensus.cc:385] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.487282 22646 raft_consensus.cc:740] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.487314 22647 raft_consensus.cc:359] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.487993 22646 consensus_queue.cc:260] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.489991 22646 ts_tablet_manager.cc:1434] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.001s
I20260709 12:09:21.490823 22646 tablet_bootstrap.cc:492] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:21.487987 22647 raft_consensus.cc:385] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.491600 22647 raft_consensus.cc:740] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.492229 22647 consensus_queue.cc:260] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.496351 22646 tablet_bootstrap.cc:654] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.497766 22837 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.500829 22837 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:21.500569 22759 consensus_queue.cc:1048] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:21.502403 22647 ts_tablet_manager.cc:1434] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 12:09:21.503654 22647 tablet_bootstrap.cc:492] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:21.506364 22671 consensus_queue.cc:1048] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.506898 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:21.507521 22455 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.511536 22713 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.512084 22713 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.514343 22713 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:21.516786 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:21.517961 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:21.518841 22671 consensus_queue.cc:1048] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:09:21.519299 22569 leader_election.cc:343] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.519572 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:21.520231 22601 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.521906 22668 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.523929 22668 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:09:21.524923 22570 leader_election.cc:343] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.525347 22570 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:21.539719 22648 tablet_bootstrap.cc:492] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:21.540414 22648 ts_tablet_manager.cc:1403] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.109s	user 0.020s	sys 0.006s
I20260709 12:09:21.539853 22651 raft_consensus.cc:2749] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.526216 22719 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.548913 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:21.552709 22601 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:09:21.552932 22529 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.556392 22719 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.558485 22719 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:21.561007 22647 tablet_bootstrap.cc:654] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.562716 22497 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
W20260709 12:09:21.563005 22569 leader_election.cc:343] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.563333 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:21.564050 22604 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 0.
I20260709 12:09:21.565120 22668 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:21.566030 22648 raft_consensus.cc:359] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.566661 22648 raft_consensus.cc:385] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.566751 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:21.564065 22759 raft_consensus.cc:2804] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.566920 22648 raft_consensus.cc:740] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.569819 22648 consensus_queue.cc:260] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.567996 22759 raft_consensus.cc:697] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:21.572288 22759 consensus_queue.cc:237] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:09:21.572304 22570 leader_election.cc:343] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.576761 22570 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:21.577988 22668 raft_consensus.cc:2749] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.578884 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:21.579635 22454 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 0.
I20260709 12:09:21.582399 22648 ts_tablet_manager.cc:1434] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 12:09:21.584170 22455 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:09:21.583384 22497 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:09:21.588595 22719 raft_consensus.cc:2804] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.588995 22719 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.589349 22719 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.583436 22648 tablet_bootstrap.cc:492] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:21.607946 22646 tablet_bootstrap.cc:492] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:21.608394 22646 ts_tablet_manager.cc:1403] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.118s	user 0.023s	sys 0.025s
I20260709 12:09:21.599923 22719 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.609203 22829 consensus_queue.cc:1048] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:09:21.616739 22695 consensus_queue.cc:1048] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:09:21.610098 22455 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.635895 22647 tablet_bootstrap.cc:492] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:21.636360 22647 ts_tablet_manager.cc:1403] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.133s	user 0.015s	sys 0.000s
I20260709 12:09:21.639336 22830 consensus_queue.cc:1048] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.643654 22646 raft_consensus.cc:359] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.644328 22646 raft_consensus.cc:385] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.644511 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:21.644654 22646 raft_consensus.cc:740] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.645112 22454 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.645558 22646 consensus_queue.cc:260] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.647716 22646 ts_tablet_manager.cc:1434] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.001s
I20260709 12:09:21.648689 22646 tablet_bootstrap.cc:492] T 10ed4486435d4f82978c5cb544504999 P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:21.633127 22719 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:21.654349 22454 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:09:21.655110 22647 raft_consensus.cc:359] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.656917 22495 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:21.657222 22647 raft_consensus.cc:385] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.657541 22647 raft_consensus.cc:740] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.657780 22837 raft_consensus.cc:2804] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.658277 22837 raft_consensus.cc:697] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:21.659205 22837 consensus_queue.cc:237] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.658203 22647 consensus_queue.cc:260] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.662130 22647 ts_tablet_manager.cc:1434] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.001s
I20260709 12:09:21.663076 22647 tablet_bootstrap.cc:492] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:21.663296 22829 consensus_queue.cc:1048] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:21.666317 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:21.666874 22602 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.667838 22668 consensus_queue.cc:1048] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.674464 22830 consensus_queue.cc:1048] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.676291 22602 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:09:21.676671 22763 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.677094 22763 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.681891 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:21.682659 22453 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 0.
I20260709 12:09:21.684893 22495 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:21.686693 22763 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:21.687252 22763 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.687615 22763 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.688030 22763 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.692222 22829 consensus_queue.cc:1048] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.692584 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:21.694351 22602 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 0.
I20260709 12:09:21.701959 22646 tablet_bootstrap.cc:654] T 10ed4486435d4f82978c5cb544504999 P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.713610 22647 tablet_bootstrap.cc:654] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.718549 22829 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.721032 22648 tablet_bootstrap.cc:654] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.722594 22829 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.733248 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:21.722337 22759 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.735661 22759 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.738421 22532 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 0.
I20260709 12:09:21.739703 22668 consensus_queue.cc:1048] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.737072 22763 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.745021 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:21.745143 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:21.745913 22602 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 0.
I20260709 12:09:21.743692 22421 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:21.744401 22759 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:21.747032 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:21.747578 22497 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:09:21.747623 22454 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.748592 22759 raft_consensus.cc:2804] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.748672 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:21.745638 22453 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 0.
I20260709 12:09:21.749055 22759 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.760731 22759 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.755152 22602 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.756026 22830 raft_consensus.cc:2804] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.751549 22763 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:21.789958 22454 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:09:21.795135 22830 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.795606 22830 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.795542 22495 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:21.800822 22719 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.796057 22759 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.804878 22668 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.819181 22648 tablet_bootstrap.cc:492] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:21.810437 22719 raft_consensus.cc:697] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:21.822841 22648 ts_tablet_manager.cc:1403] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.240s	user 0.018s	sys 0.009s
I20260709 12:09:21.810670 22829 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:21.811633 22602 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:09:21.835951 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:21.836727 22605 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 0.
I20260709 12:09:21.811564 22668 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.825663 22719 consensus_queue.cc:237] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:09:21.850493 22882 log.cc:927] Time spent T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:09:21.851403 22830 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.858788 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:21.862522 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:09:21.863109 22570 leader_election.cc:343] T b36f3a080ce7465b8491197cc6189444 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:21.866554 22569 leader_election.cc:343] T b36f3a080ce7465b8491197cc6189444 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.867022 22569 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:21.868109 22792 raft_consensus.cc:2749] T b36f3a080ce7465b8491197cc6189444 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.868312 22759 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:21.869448 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:21.870067 22603 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.870599 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:21.871374 22452 raft_consensus.cc:2393] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 1: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:09:21.872036 22830 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:21.861004 22668 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:21.879007 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:21.879819 22529 raft_consensus.cc:2393] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 1: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:09:21.879117 22671 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:09:21.881997 22671 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.883778 22648 raft_consensus.cc:359] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.884608 22648 raft_consensus.cc:385] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.884938 22648 raft_consensus.cc:740] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.892763 22647 tablet_bootstrap.cc:492] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:21.893913 22647 ts_tablet_manager.cc:1403] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.231s	user 0.015s	sys 0.008s
I20260709 12:09:21.895787 22648 consensus_queue.cc:260] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.883394 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:21.900899 22648 ts_tablet_manager.cc:1434] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.076s	user 0.006s	sys 0.001s
I20260709 12:09:21.901558 22648 tablet_bootstrap.cc:492] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:21.906222 22671 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:21.908773 22646 tablet_bootstrap.cc:492] T 10ed4486435d4f82978c5cb544504999 P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:21.909106 22646 ts_tablet_manager.cc:1403] T 10ed4486435d4f82978c5cb544504999 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.261s	user 0.006s	sys 0.022s
I20260709 12:09:21.910418 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:21.914178 22646 raft_consensus.cc:359] T 10ed4486435d4f82978c5cb544504999 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.917111 22646 raft_consensus.cc:385] T 10ed4486435d4f82978c5cb544504999 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.917346 22646 raft_consensus.cc:740] T 10ed4486435d4f82978c5cb544504999 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.915350 22647 raft_consensus.cc:359] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.917891 22647 raft_consensus.cc:385] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.918123 22647 raft_consensus.cc:740] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.925237 22647 consensus_queue.cc:260] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.924536 22422 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:09:21.932801 22671 raft_consensus.cc:2749] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.929301 22603 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:09:21.934823 22497 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:21.937544 22646 consensus_queue.cc:260] T 10ed4486435d4f82978c5cb544504999 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.938494 22879 raft_consensus.cc:2804] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.939090 22879 raft_consensus.cc:697] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:21.941175 22879 consensus_queue.cc:237] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.942149 22648 tablet_bootstrap.cc:654] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.945102 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:21.945761 22646 ts_tablet_manager.cc:1434] T 10ed4486435d4f82978c5cb544504999 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.036s	user 0.004s	sys 0.002s
I20260709 12:09:21.946851 22646 tablet_bootstrap.cc:492] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:21.947252 22422 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:09:21.947832 22647 ts_tablet_manager.cc:1434] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.054s	user 0.001s	sys 0.005s
I20260709 12:09:21.948035 22671 raft_consensus.cc:2749] T 8c3000c4a87f46b69b5da41dc1115486 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:21.950519 22647 tablet_bootstrap.cc:492] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:21.956436 22646 tablet_bootstrap.cc:654] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.965567 22354 catalog_manager.cc:5697] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:21.967432 22354 catalog_manager.cc:5697] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:21.973460 22647 tablet_bootstrap.cc:654] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.973766 22648 tablet_bootstrap.cc:492] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:21.974278 22648 ts_tablet_manager.cc:1403] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.073s	user 0.007s	sys 0.016s
I20260709 12:09:21.974237 22354 catalog_manager.cc:5697] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:21.978744 22648 raft_consensus.cc:359] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.979455 22648 raft_consensus.cc:385] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.979768 22648 raft_consensus.cc:740] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.981825 22646 tablet_bootstrap.cc:492] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:21.982784 22646 ts_tablet_manager.cc:1403] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.004s
I20260709 12:09:21.982993 22648 consensus_queue.cc:260] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.985047 22648 ts_tablet_manager.cc:1434] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 12:09:21.985339 22646 raft_consensus.cc:359] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.985977 22648 tablet_bootstrap.cc:492] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:21.986023 22646 raft_consensus.cc:385] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.986464 22646 raft_consensus.cc:740] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.987208 22646 consensus_queue.cc:260] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.989310 22646 ts_tablet_manager.cc:1434] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 12:09:21.991864 22646 tablet_bootstrap.cc:492] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:21.992559 22648 tablet_bootstrap.cc:654] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.993788 22647 tablet_bootstrap.cc:492] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:21.994545 22647 ts_tablet_manager.cc:1403] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.000s
I20260709 12:09:21.997968 22646 tablet_bootstrap.cc:654] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.997386 22647 raft_consensus.cc:359] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:21.998565 22647 raft_consensus.cc:385] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.998939 22647 raft_consensus.cc:740] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.999782 22647 consensus_queue.cc:260] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.002813 22647 ts_tablet_manager.cc:1434] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:09:22.003785 22648 tablet_bootstrap.cc:492] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:22.004305 22648 ts_tablet_manager.cc:1403] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.003s
I20260709 12:09:22.006798 22648 raft_consensus.cc:359] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.007575 22648 raft_consensus.cc:385] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.007885 22648 raft_consensus.cc:740] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.008508 22648 consensus_queue.cc:260] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.009346 22647 tablet_bootstrap.cc:492] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:22.010566 22648 ts_tablet_manager.cc:1434] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:09:22.011452 22648 tablet_bootstrap.cc:492] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:22.015915 22671 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.016388 22671 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.017045 22648 tablet_bootstrap.cc:654] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.019721 22647 tablet_bootstrap.cc:654] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.019825 22719 consensus_queue.cc:1048] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:09:22.026739 22671 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:22.028424 22354 catalog_manager.cc:5697] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:22.030948 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:22.033574 22529 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 0.
I20260709 12:09:22.036623 22421 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:22.038491 22667 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.039362 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:22.039969 22603 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 0.
I20260709 12:09:22.038841 22667 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.041143 22667 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.056857 22667 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.059875 22646 tablet_bootstrap.cc:492] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:22.060464 22646 ts_tablet_manager.cc:1403] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.069s	user 0.016s	sys 0.046s
I20260709 12:09:22.061149 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:22.061730 22529 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.068148 22647 tablet_bootstrap.cc:492] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:22.067982 22646 raft_consensus.cc:359] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.068599 22647 ts_tablet_manager.cc:1403] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.059s	user 0.015s	sys 0.003s
I20260709 12:09:22.068632 22646 raft_consensus.cc:385] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.068975 22646 raft_consensus.cc:740] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.069635 22646 consensus_queue.cc:260] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.071157 22647 raft_consensus.cc:359] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.071672 22646 ts_tablet_manager.cc:1434] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:09:22.071833 22647 raft_consensus.cc:385] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.072093 22647 raft_consensus.cc:740] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.072635 22646 tablet_bootstrap.cc:492] T 62319c9e82134e7daf8a46f78c124bff P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:22.075342 22648 tablet_bootstrap.cc:492] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:22.075798 22648 ts_tablet_manager.cc:1403] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.065s	user 0.015s	sys 0.001s
I20260709 12:09:22.075811 22763 consensus_queue.cc:1048] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:22.077796 22647 consensus_queue.cc:260] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.079207 22792 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.079651 22792 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.080117 22647 ts_tablet_manager.cc:1434] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:09:22.081017 22647 tablet_bootstrap.cc:492] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:22.081981 22792 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:22.079658 22646 tablet_bootstrap.cc:654] T 62319c9e82134e7daf8a46f78c124bff P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.082849 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:09:22.089289 22570 leader_election.cc:343] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.090132 22529 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 1.
I20260709 12:09:22.083600 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:09:22.094197 22569 leader_election.cc:343] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.094622 22569 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:22.093146 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:22.095361 22603 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.082955 22648 raft_consensus.cc:359] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.096242 22792 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.106878 22648 raft_consensus.cc:385] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.107440 22671 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.107895 22671 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.110857 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:22.111474 22602 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 0.
I20260709 12:09:22.112668 22422 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:22.113417 22830 raft_consensus.cc:2804] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.107219 22648 raft_consensus.cc:740] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.113863 22830 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.114487 22648 consensus_queue.cc:260] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.100087 22421 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:22.113488 22671 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:22.116403 22830 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.116820 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:22.117429 22527 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 0.
I20260709 12:09:22.117884 22719 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.118377 22719 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.097074 22647 tablet_bootstrap.cc:654] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.115897 22671 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.123386 22671 raft_consensus.cc:697] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:09:22.124339 22671 consensus_queue.cc:237] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.125334 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:22.125922 22454 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 0.
I20260709 12:09:22.120425 22648 ts_tablet_manager.cc:1434] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 12:09:22.127138 22495 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:22.127921 22763 raft_consensus.cc:2804] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.128278 22763 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.128613 22763 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.129483 22646 tablet_bootstrap.cc:492] T 62319c9e82134e7daf8a46f78c124bff P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:22.129611 22719 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:22.129961 22646 ts_tablet_manager.cc:1403] T 62319c9e82134e7daf8a46f78c124bff P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.058s	user 0.015s	sys 0.010s
I20260709 12:09:22.131305 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:22.136754 22602 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 0.
I20260709 12:09:22.138576 22648 tablet_bootstrap.cc:492] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:22.139046 22646 raft_consensus.cc:359] T 62319c9e82134e7daf8a46f78c124bff P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.091025 22667 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:22.139734 22646 raft_consensus.cc:385] T 62319c9e82134e7daf8a46f78c124bff P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.140067 22646 raft_consensus.cc:740] T 62319c9e82134e7daf8a46f78c124bff P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.140905 22646 consensus_queue.cc:260] T 62319c9e82134e7daf8a46f78c124bff P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.136040 22763 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.143868 22646 ts_tablet_manager.cc:1434] T 62319c9e82134e7daf8a46f78c124bff P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:09:22.167450 22654 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.188901 22654 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.189514 22646 tablet_bootstrap.cc:492] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:22.190542 22648 tablet_bootstrap.cc:654] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.191890 22654 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:22.155946 22603 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 1.
I20260709 12:09:22.164427 22830 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.203807 22830 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:22.204888 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:22.206317 22719 consensus_queue.cc:1048] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.212397 22646 tablet_bootstrap.cc:654] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.212754 22603 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.177142 22763 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:22.207463 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:22.145341 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:22.209434 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:22.217628 22455 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.218060 22530 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:22.218267 22421 leader_election.cc:343] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.226132 22603 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:09:22.231899 22530 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 1.
I20260709 12:09:22.232293 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:22.235689 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:22.236258 22601 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.237077 22646 tablet_bootstrap.cc:492] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:22.237506 22646 ts_tablet_manager.cc:1403] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.004s
I20260709 12:09:22.244589 22421 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:22.244841 22646 raft_consensus.cc:359] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.245560 22646 raft_consensus.cc:385] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.245529 22654 raft_consensus.cc:2804] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.246026 22646 raft_consensus.cc:740] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.246423 22654 raft_consensus.cc:697] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:09:22.246847 22646 consensus_queue.cc:260] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.247283 22654 consensus_queue.cc:237] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.251837 22668 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.252288 22668 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.255904 22668 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:22.256253 22646 ts_tablet_manager.cc:1434] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.002s
I20260709 12:09:22.257200 22646 tablet_bootstrap.cc:492] T 897c484d3dec40a296e097e6b8d26d39 P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:22.257700 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:09:22.259086 22569 leader_election.cc:343] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.239204 22602 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 0.
I20260709 12:09:22.250120 22497 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:09:22.264842 22879 raft_consensus.cc:2804] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.265334 22879 raft_consensus.cc:697] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:22.266217 22879 consensus_queue.cc:237] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.266801 22422 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:09:22.267942 22671 raft_consensus.cc:2804] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.268282 22671 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.268620 22671 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.270035 22647 tablet_bootstrap.cc:492] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:22.270645 22647 ts_tablet_manager.cc:1403] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.190s	user 0.016s	sys 0.050s
I20260709 12:09:22.271724 22601 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 1.
I20260709 12:09:22.276553 22647 raft_consensus.cc:359] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.277263 22647 raft_consensus.cc:385] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.277508 22647 raft_consensus.cc:740] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.278510 22647 consensus_queue.cc:260] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.283799 22646 tablet_bootstrap.cc:654] T 897c484d3dec40a296e097e6b8d26d39 P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.286672 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:22.291925 22763 consensus_queue.cc:1048] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:09:22.294637 22570 leader_election.cc:343] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.294584 22671 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.295212 22570 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:22.296702 22668 raft_consensus.cc:2749] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.296753 22671 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:22.294277 22647 ts_tablet_manager.cc:1434] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 12:09:22.302417 22647 tablet_bootstrap.cc:492] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:22.305341 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:22.306077 22529 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.302045 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:22.306875 22603 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.311128 22455 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:09:22.313301 22354 catalog_manager.cc:5697] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:22.326268 22646 tablet_bootstrap.cc:492] T 897c484d3dec40a296e097e6b8d26d39 P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:22.327948 22646 ts_tablet_manager.cc:1403] T 897c484d3dec40a296e097e6b8d26d39 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.071s	user 0.010s	sys 0.007s
I20260709 12:09:22.337670 22713 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.338171 22713 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.340134 22713 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:22.347174 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:22.348048 22529 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 1.
I20260709 12:09:22.350795 22648 tablet_bootstrap.cc:492] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:22.351346 22648 ts_tablet_manager.cc:1403] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.213s	user 0.011s	sys 0.025s
I20260709 12:09:22.352082 22668 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.352906 22668 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.353173 22421 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:22.355111 22830 raft_consensus.cc:2804] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.354713 22648 raft_consensus.cc:359] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.355625 22830 raft_consensus.cc:697] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:09:22.346040 22603 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 1.
I20260709 12:09:22.357216 22830 consensus_queue.cc:237] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:09:22.359081 22569 leader_election.cc:343] T 10ed4486435d4f82978c5cb544504999 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.360033 22351 catalog_manager.cc:5697] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 0 to 1, leader changed from <none> to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:22.361436 22879 consensus_queue.cc:1048] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.355355 22668 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:22.363458 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:09:22.365521 22570 leader_election.cc:343] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.355634 22648 raft_consensus.cc:385] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.367730 22648 raft_consensus.cc:740] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.368191 22647 tablet_bootstrap.cc:654] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.370512 22648 consensus_queue.cc:260] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.373754 22648 ts_tablet_manager.cc:1434] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 12:09:22.374397 22646 raft_consensus.cc:359] T 897c484d3dec40a296e097e6b8d26d39 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.375075 22648 tablet_bootstrap.cc:492] T ea8ebc1d824844e688d0bd61c3fd2258 P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:22.377101 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:22.373443 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:09:22.379328 22569 leader_election.cc:343] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:22.379887 22570 leader_election.cc:343] T 10ed4486435d4f82978c5cb544504999 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.379796 22569 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:22.380378 22570 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:22.380988 22668 raft_consensus.cc:2749] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.381114 22792 raft_consensus.cc:2749] T 10ed4486435d4f82978c5cb544504999 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.382449 22647 tablet_bootstrap.cc:492] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:22.382901 22647 ts_tablet_manager.cc:1403] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.083s	user 0.007s	sys 0.004s
I20260709 12:09:22.375082 22646 raft_consensus.cc:385] T 897c484d3dec40a296e097e6b8d26d39 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.383807 22646 raft_consensus.cc:740] T 897c484d3dec40a296e097e6b8d26d39 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.384440 22646 consensus_queue.cc:260] T 897c484d3dec40a296e097e6b8d26d39 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.385653 22647 raft_consensus.cc:359] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.386282 22647 raft_consensus.cc:385] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.386567 22647 raft_consensus.cc:740] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.387634 22647 consensus_queue.cc:260] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.389529 22647 ts_tablet_manager.cc:1434] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:09:22.390375 22647 tablet_bootstrap.cc:492] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:22.393486 22879 consensus_queue.cc:1048] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.386418 22646 ts_tablet_manager.cc:1434] T 897c484d3dec40a296e097e6b8d26d39 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.058s	user 0.004s	sys 0.000s
I20260709 12:09:22.399886 22646 tablet_bootstrap.cc:492] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:22.400488 22647 tablet_bootstrap.cc:654] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.405553 22646 tablet_bootstrap.cc:654] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.412011 22648 tablet_bootstrap.cc:654] T ea8ebc1d824844e688d0bd61c3fd2258 P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.421834 22879 consensus_queue.cc:1048] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.439064 22646 tablet_bootstrap.cc:492] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:22.439567 22646 ts_tablet_manager.cc:1403] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.000s
I20260709 12:09:22.441605 22879 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.442107 22879 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.445442 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:09:22.447521 22495 leader_election.cc:343] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.442379 22646 raft_consensus.cc:359] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.449302 22646 raft_consensus.cc:385] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.449621 22646 raft_consensus.cc:740] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.449501 22351 catalog_manager.cc:5697] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 0 to 1, leader changed from <none> to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:22.450346 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:22.451442 22601 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 0.
I20260709 12:09:22.452983 22497 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:22.453816 22837 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.453253 22351 catalog_manager.cc:5697] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 0 to 1, leader changed from <none> to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:22.454165 22837 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.454540 22837 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.454474 22763 consensus_queue.cc:1048] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:22.450376 22646 consensus_queue.cc:260] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.460248 22646 ts_tablet_manager.cc:1434] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.002s
I20260709 12:09:22.460546 22879 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:22.461201 22646 tablet_bootstrap.cc:492] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:22.477397 22792 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.477890 22792 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:09:22.485692 22919 log.cc:927] Time spent T 8efee6d07e5841fdb6b0d7ed673b49cb P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:09:22.475248 22837 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.512125 22668 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:22.521486 22403 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:22.522192 22648 tablet_bootstrap.cc:492] T ea8ebc1d824844e688d0bd61c3fd2258 P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:22.522761 22648 ts_tablet_manager.cc:1403] T ea8ebc1d824844e688d0bd61c3fd2258 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.148s	user 0.017s	sys 0.024s
I20260709 12:09:22.523198 22668 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.526091 22668 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:22.526327 22648 raft_consensus.cc:359] T ea8ebc1d824844e688d0bd61c3fd2258 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.527278 22648 raft_consensus.cc:385] T ea8ebc1d824844e688d0bd61c3fd2258 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.527493 22648 raft_consensus.cc:740] T ea8ebc1d824844e688d0bd61c3fd2258 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.529150 22792 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:22.530154 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:22.531606 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:09:22.535616 22570 leader_election.cc:343] T 62319c9e82134e7daf8a46f78c124bff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:22.536581 22570 leader_election.cc:343] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.539578 22837 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:22.542389 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:09:22.545938 22569 leader_election.cc:343] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.548544 22647 tablet_bootstrap.cc:492] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:22.548990 22647 ts_tablet_manager.cc:1403] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.159s	user 0.018s	sys 0.038s
I20260709 12:09:22.546607 22569 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:22.551365 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:22.552289 22713 raft_consensus.cc:2749] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.555419 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:22.556061 22601 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.556734 22648 consensus_queue.cc:260] T ea8ebc1d824844e688d0bd61c3fd2258 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.555388 22646 tablet_bootstrap.cc:654] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:22.565013 22569 leader_election.cc:343] T 62319c9e82134e7daf8a46f78c124bff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.565526 22569 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:22.566958 22713 raft_consensus.cc:2749] T 62319c9e82134e7daf8a46f78c124bff P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:22.615912 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 50942.7us
I20260709 12:09:22.621534 22648 ts_tablet_manager.cc:1434] T ea8ebc1d824844e688d0bd61c3fd2258 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.098s	user 0.002s	sys 0.006s
I20260709 12:09:22.626103 22830 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.626591 22830 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.628019 22648 tablet_bootstrap.cc:492] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:22.617270 22713 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.633952 22830 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:22.632683 22713 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.639142 22713 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:22.639415 22601 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:09:22.635954 22647 raft_consensus.cc:359] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.641387 22647 raft_consensus.cc:385] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.641665 22647 raft_consensus.cc:740] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.620633 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:22.642347 22647 consensus_queue.cc:260] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.646773 22647 ts_tablet_manager.cc:1434] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.098s	user 0.008s	sys 0.006s
I20260709 12:09:22.645414 22452 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.650097 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:22.653559 22497 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:09:22.659092 22667 consensus_queue.cc:1048] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:09:22.659888 22570 leader_election.cc:343] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.660598 22763 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.661130 22763 raft_consensus.cc:697] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:22.662060 22763 consensus_queue.cc:237] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.657860 22647 tablet_bootstrap.cc:492] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:22.665552 22648 tablet_bootstrap.cc:654] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.655413 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:22.658470 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:22.667342 22602 raft_consensus.cc:2393] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 1: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:09:22.671245 22713 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.671757 22713 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.674003 22646 tablet_bootstrap.cc:492] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:22.674542 22646 ts_tablet_manager.cc:1403] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.214s	user 0.014s	sys 0.009s
I20260709 12:09:22.679608 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:22.681443 22713 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:22.686626 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:22.687634 22422 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:09:22.687758 22671 consensus_queue.cc:1048] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:09:22.690140 22570 leader_election.cc:343] T 897c484d3dec40a296e097e6b8d26d39 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.695279 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:22.698537 22452 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:09:22.699071 22671 raft_consensus.cc:2749] T ea8ebc1d824844e688d0bd61c3fd2258 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:22.702729 22569 leader_election.cc:343] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.703230 22569 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:22.703995 22713 raft_consensus.cc:2749] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:22.705258 22569 leader_election.cc:343] T 897c484d3dec40a296e097e6b8d26d39 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.705689 22569 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:22.708479 22713 raft_consensus.cc:2749] T 897c484d3dec40a296e097e6b8d26d39 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.710554 22646 raft_consensus.cc:359] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.711277 22646 raft_consensus.cc:385] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.711565 22646 raft_consensus.cc:740] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.712306 22646 consensus_queue.cc:260] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.719746 22646 ts_tablet_manager.cc:1434] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 12:09:22.721042 22646 tablet_bootstrap.cc:492] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:22.734138 22647 tablet_bootstrap.cc:654] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.743060 22646 tablet_bootstrap.cc:654] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.754884 22354 catalog_manager.cc:5697] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:22.765265 22830 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.766072 22830 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.770053 22647 tablet_bootstrap.cc:492] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:22.770545 22647 ts_tablet_manager.cc:1403] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.113s	user 0.013s	sys 0.005s
I20260709 12:09:22.771016 22830 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:22.782883 22647 raft_consensus.cc:359] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.783815 22763 consensus_queue.cc:1048] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.797596 22830 consensus_queue.cc:1048] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.801285 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:22.783816 22647 raft_consensus.cc:385] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.803205 22647 raft_consensus.cc:740] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.804098 22647 consensus_queue.cc:260] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.811813 22830 consensus_queue.cc:1048] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:22.817605 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:22.818274 22601 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 0.
I20260709 12:09:22.819271 22422 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:22.821120 22667 raft_consensus.cc:2804] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.821524 22667 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.821889 22667 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.826063 22830 consensus_queue.cc:1048] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:22.802235 22529 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 0.
I20260709 12:09:22.849905 22647 ts_tablet_manager.cc:1434] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.079s	user 0.007s	sys 0.000s
I20260709 12:09:22.850768 22646 tablet_bootstrap.cc:492] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:22.852089 22646 ts_tablet_manager.cc:1403] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.131s	user 0.013s	sys 0.012s
I20260709 12:09:22.855041 22646 raft_consensus.cc:359] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.855780 22646 raft_consensus.cc:385] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.856066 22646 raft_consensus.cc:740] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.856760 22646 consensus_queue.cc:260] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.851218 22647 tablet_bootstrap.cc:492] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:22.859933 22646 ts_tablet_manager.cc:1434] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:09:22.860729 22646 tablet_bootstrap.cc:492] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:22.876791 22648 tablet_bootstrap.cc:492] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:22.877277 22648 ts_tablet_manager.cc:1403] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.255s	user 0.013s	sys 0.026s
I20260709 12:09:22.879822 22646 tablet_bootstrap.cc:654] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.883157 22648 raft_consensus.cc:359] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.884264 22648 raft_consensus.cc:385] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.884809 22648 raft_consensus.cc:740] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.887331 22648 consensus_queue.cc:260] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.888526 22837 consensus_queue.cc:1048] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.890636 22648 ts_tablet_manager.cc:1434] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 12:09:22.891992 22648 tablet_bootstrap.cc:492] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:22.900344 22647 tablet_bootstrap.cc:654] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.893337 22667 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.902726 22667 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:22.904162 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:22.905721 22530 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.907337 22648 tablet_bootstrap.cc:654] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.908833 22671 consensus_queue.cc:1048] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:09:22.916503 22530 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 1.
I20260709 12:09:22.912148 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:22.918251 22605 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.919648 22647 tablet_bootstrap.cc:492] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:22.920032 22421 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:22.920068 22647 ts_tablet_manager.cc:1403] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.069s	user 0.012s	sys 0.000s
I20260709 12:09:22.922477 22668 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.922941 22668 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.923838 22667 raft_consensus.cc:2804] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.924504 22667 raft_consensus.cc:697] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:09:22.924969 22668 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:22.925513 22667 consensus_queue.cc:237] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.926474 22648 tablet_bootstrap.cc:492] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:22.926918 22648 ts_tablet_manager.cc:1403] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.035s	user 0.003s	sys 0.006s
I20260709 12:09:22.927506 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:09:22.928730 22570 leader_election.cc:343] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.935330 22648 raft_consensus.cc:359] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.935966 22648 raft_consensus.cc:385] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.936234 22648 raft_consensus.cc:740] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.926561 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:22.936858 22648 consensus_queue.cc:260] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:09:22.937548 22569 leader_election.cc:343] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.923753 22647 raft_consensus.cc:359] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.938375 22647 raft_consensus.cc:385] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.938158 22569 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:22.938652 22647 raft_consensus.cc:740] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.943521 22668 raft_consensus.cc:2749] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.944491 22648 ts_tablet_manager.cc:1434] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:09:22.945302 22648 tablet_bootstrap.cc:492] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:22.951267 22647 consensus_queue.cc:260] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:22.954880 22647 ts_tablet_manager.cc:1434] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.000s
I20260709 12:09:22.963171 22605 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 1.
I20260709 12:09:23.002555 22353 catalog_manager.cc:5697] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 0 to 1, leader changed from <none> to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.008217 22647 tablet_bootstrap.cc:492] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:23.013284 22648 tablet_bootstrap.cc:654] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.024080 22646 tablet_bootstrap.cc:492] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:23.024566 22646 ts_tablet_manager.cc:1403] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.164s	user 0.025s	sys 0.024s
I20260709 12:09:23.030421 22879 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.032897 22879 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.035125 22879 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:23.037189 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:23.037875 22603 raft_consensus.cc:2468] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 0.
I20260709 12:09:23.035737 22646 raft_consensus.cc:359] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.038755 22646 raft_consensus.cc:385] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.039182 22646 raft_consensus.cc:740] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.039855 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:23.040475 22455 raft_consensus.cc:2468] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 0.
I20260709 12:09:23.039966 22646 consensus_queue.cc:260] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.041415 22495 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:23.042289 22719 raft_consensus.cc:2804] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.042616 22646 ts_tablet_manager.cc:1434] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 12:09:23.042752 22719 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.043370 22719 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.046175 22648 tablet_bootstrap.cc:492] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:23.046625 22648 ts_tablet_manager.cc:1403] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.101s	user 0.009s	sys 0.014s
I20260709 12:09:23.047912 22879 consensus_queue.cc:1048] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.049232 22646 tablet_bootstrap.cc:492] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:23.056919 22719 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.061954 22719 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:23.063190 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:23.063542 22647 tablet_bootstrap.cc:654] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.063648 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:23.063848 22452 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.064215 22603 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.061216 22648 raft_consensus.cc:359] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.064884 22648 raft_consensus.cc:385] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.066058 22713 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.067411 22713 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.077862 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:23.079165 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:09:23.081071 22569 leader_election.cc:343] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:23.081856 22570 leader_election.cc:343] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.065186 22648 raft_consensus.cc:740] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.082680 22570 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:23.083143 22648 consensus_queue.cc:260] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.083670 22792 raft_consensus.cc:2749] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.077864 22713 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:23.086488 22648 ts_tablet_manager.cc:1434] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 12:09:23.090057 22646 tablet_bootstrap.cc:654] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.093202 22648 tablet_bootstrap.cc:492] T 041a72bc20f246bdb6e7cc6423d67e62 P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:23.099092 22603 raft_consensus.cc:2468] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:09:23.100613 22497 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:09:23.102195 22719 raft_consensus.cc:2804] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.103972 22648 tablet_bootstrap.cc:654] T 041a72bc20f246bdb6e7cc6423d67e62 P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.102784 22719 raft_consensus.cc:697] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:23.099684 22452 raft_consensus.cc:2468] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:09:23.118176 22719 consensus_queue.cc:237] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.122931 22646 tablet_bootstrap.cc:492] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:23.123523 22646 ts_tablet_manager.cc:1403] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.074s	user 0.010s	sys 0.008s
I20260709 12:09:23.125245 22837 consensus_queue.cc:1048] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.127146 22648 tablet_bootstrap.cc:492] T 041a72bc20f246bdb6e7cc6423d67e62 P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:23.126768 22646 raft_consensus.cc:359] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.127547 22646 raft_consensus.cc:385] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.127929 22646 raft_consensus.cc:740] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.128738 22646 consensus_queue.cc:260] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.127604 22648 ts_tablet_manager.cc:1403] T 041a72bc20f246bdb6e7cc6423d67e62 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.000s
I20260709 12:09:23.133765 22648 raft_consensus.cc:359] T 041a72bc20f246bdb6e7cc6423d67e62 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.134603 22648 raft_consensus.cc:385] T 041a72bc20f246bdb6e7cc6423d67e62 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.138028 22648 raft_consensus.cc:740] T 041a72bc20f246bdb6e7cc6423d67e62 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.138898 22648 consensus_queue.cc:260] T 041a72bc20f246bdb6e7cc6423d67e62 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.141233 22648 ts_tablet_manager.cc:1434] T 041a72bc20f246bdb6e7cc6423d67e62 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:09:23.137639 22646 ts_tablet_manager.cc:1434] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.002s
I20260709 12:09:23.144847 22646 tablet_bootstrap.cc:492] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:23.150856 22648 tablet_bootstrap.cc:492] T 19773e9e6aec446eb719d3d53d49812b P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:23.151244 22353 catalog_manager.cc:5697] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.158028 22648 tablet_bootstrap.cc:654] T 19773e9e6aec446eb719d3d53d49812b P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.163914 22646 tablet_bootstrap.cc:654] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.179345 22647 tablet_bootstrap.cc:492] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:23.179841 22647 ts_tablet_manager.cc:1403] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.172s	user 0.054s	sys 0.027s
I20260709 12:09:23.183008 22647 raft_consensus.cc:359] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.183811 22647 raft_consensus.cc:385] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.184152 22647 raft_consensus.cc:740] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.185046 22647 consensus_queue.cc:260] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.197247 22647 ts_tablet_manager.cc:1434] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:09:23.208493 22647 tablet_bootstrap.cc:492] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:23.219695 22646 tablet_bootstrap.cc:492] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:23.219970 22647 tablet_bootstrap.cc:654] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.223786 22648 tablet_bootstrap.cc:492] T 19773e9e6aec446eb719d3d53d49812b P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:23.224282 22648 ts_tablet_manager.cc:1403] T 19773e9e6aec446eb719d3d53d49812b P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.074s	user 0.009s	sys 0.024s
I20260709 12:09:23.228349 22648 raft_consensus.cc:359] T 19773e9e6aec446eb719d3d53d49812b P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.230129 22648 raft_consensus.cc:385] T 19773e9e6aec446eb719d3d53d49812b P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.230417 22713 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.230930 22713 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.220182 22646 ts_tablet_manager.cc:1403] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.076s	user 0.026s	sys 0.007s
I20260709 12:09:23.230424 22648 raft_consensus.cc:740] T 19773e9e6aec446eb719d3d53d49812b P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.232306 22648 consensus_queue.cc:260] T 19773e9e6aec446eb719d3d53d49812b P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.233875 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:23.233987 22646 raft_consensus.cc:359] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.234663 22646 raft_consensus.cc:385] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.234957 22646 raft_consensus.cc:740] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.235714 22646 consensus_queue.cc:260] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.236032 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:09:23.237238 22569 leader_election.cc:343] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.237326 22646 ts_tablet_manager.cc:1434] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
W20260709 12:09:23.237947 22570 leader_election.cc:343] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.238237 22570 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:23.239101 22646 tablet_bootstrap.cc:492] T ee3ba2f54b0343bea5e3a5364c372a89 P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:23.239120 22792 raft_consensus.cc:2749] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.240096 22713 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:23.242170 22647 tablet_bootstrap.cc:492] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:23.242677 22647 ts_tablet_manager.cc:1403] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.006s
I20260709 12:09:23.249006 22646 tablet_bootstrap.cc:654] T ee3ba2f54b0343bea5e3a5364c372a89 P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.250499 22647 raft_consensus.cc:359] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.251343 22647 raft_consensus.cc:385] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.251696 22647 raft_consensus.cc:740] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.252442 22647 consensus_queue.cc:260] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.255188 22830 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.255348 22647 ts_tablet_manager.cc:1434] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.002s
I20260709 12:09:23.255740 22830 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.257277 22647 tablet_bootstrap.cc:492] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:23.257896 22830 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:23.259486 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:23.260088 22601 raft_consensus.cc:2468] T 10ed4486435d4f82978c5cb544504999 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 0.
I20260709 12:09:23.261389 22422 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:23.262121 22830 raft_consensus.cc:2804] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.262532 22830 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.262910 22830 raft_consensus.cc:3060] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.264786 22647 tablet_bootstrap.cc:654] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.265362 22713 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.265972 22713 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.268561 22713 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:23.271101 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:23.272648 22837 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.272959 22648 ts_tablet_manager.cc:1434] T 19773e9e6aec446eb719d3d53d49812b P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.048s	user 0.000s	sys 0.006s
I20260709 12:09:23.273108 22837 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.274636 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:23.274824 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:23.275125 22837 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:23.275308 22532 raft_consensus.cc:2468] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 0.
W20260709 12:09:23.276213 22569 leader_election.cc:343] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:23.277344 22570 leader_election.cc:343] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.277750 22570 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:23.279651 22792 raft_consensus.cc:2749] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.284019 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:23.284650 22601 raft_consensus.cc:2468] T 10ed4486435d4f82978c5cb544504999 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 0.
I20260709 12:09:23.285816 22497 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:09:23.286743 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:23.287102 22719 raft_consensus.cc:2804] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.287465 22719 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.287783 22719 raft_consensus.cc:3060] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.294649 22719 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.298489 22648 tablet_bootstrap.cc:492] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:23.299476 22830 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.300793 22452 raft_consensus.cc:2393] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 1: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:09:23.302634 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:23.302964 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:23.303498 22532 raft_consensus.cc:2393] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 1: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:09:23.303683 22455 raft_consensus.cc:2393] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 1: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:09:23.303987 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:23.304695 22601 raft_consensus.cc:3060] T 10ed4486435d4f82978c5cb544504999 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.305615 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:23.306964 22497 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:23.308084 22837 raft_consensus.cc:2749] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.311434 22719 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:23.313686 22648 tablet_bootstrap.cc:654] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.313891 22646 tablet_bootstrap.cc:492] T ee3ba2f54b0343bea5e3a5364c372a89 P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:23.314411 22646 ts_tablet_manager.cc:1403] T ee3ba2f54b0343bea5e3a5364c372a89 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.076s	user 0.017s	sys 0.010s
I20260709 12:09:23.315160 22830 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:23.317083 22646 raft_consensus.cc:359] T ee3ba2f54b0343bea5e3a5364c372a89 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.317998 22646 raft_consensus.cc:385] T ee3ba2f54b0343bea5e3a5364c372a89 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.318352 22646 raft_consensus.cc:740] T ee3ba2f54b0343bea5e3a5364c372a89 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.318289 22601 raft_consensus.cc:2468] T 10ed4486435d4f82978c5cb544504999 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 1.
I20260709 12:09:23.320168 22422 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:09:23.321632 22830 raft_consensus.cc:2804] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.322554 22647 tablet_bootstrap.cc:492] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:23.323033 22830 raft_consensus.cc:697] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:09:23.323052 22646 consensus_queue.cc:260] T ee3ba2f54b0343bea5e3a5364c372a89 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.323024 22647 ts_tablet_manager.cc:1403] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.066s	user 0.015s	sys 0.000s
I20260709 12:09:23.325943 22646 ts_tablet_manager.cc:1434] T ee3ba2f54b0343bea5e3a5364c372a89 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 12:09:23.326326 22648 tablet_bootstrap.cc:492] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:23.327280 22646 tablet_bootstrap.cc:492] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:23.326836 22648 ts_tablet_manager.cc:1403] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.002s
I20260709 12:09:23.327744 22647 raft_consensus.cc:359] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.324535 22830 consensus_queue.cc:237] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.328351 22647 raft_consensus.cc:385] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.329640 22647 raft_consensus.cc:740] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.330030 22648 raft_consensus.cc:359] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.332824 22648 raft_consensus.cc:385] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.333166 22648 raft_consensus.cc:740] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.333923 22648 consensus_queue.cc:260] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.332831 22647 consensus_queue.cc:260] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.335767 22646 tablet_bootstrap.cc:654] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.336126 22648 ts_tablet_manager.cc:1434] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:09:23.337713 22648 tablet_bootstrap.cc:492] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:23.344926 22647 ts_tablet_manager.cc:1434] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:09:23.346334 22647 tablet_bootstrap.cc:492] T 60b63fe1f8174bdab922fc97591f1860 P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:23.355088 22647 tablet_bootstrap.cc:654] T 60b63fe1f8174bdab922fc97591f1860 P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.356691 22667 consensus_queue.cc:1048] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.359437 22719 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.360110 22792 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.359925 22719 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.360607 22792 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.361891 22719 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:23.363833 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:23.364617 22603 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 0.
I20260709 12:09:23.366128 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:23.366701 22497 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:09:23.367213 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:23.366798 22454 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 0.
I20260709 12:09:23.367632 22837 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.367285 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:23.368201 22837 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.362852 22792 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:23.368656 22837 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:23.369773 22569 leader_election.cc:343] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.346277 22351 catalog_manager.cc:5697] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 0 to 1, leader changed from <none> to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:23.371659 22570 leader_election.cc:343] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.372236 22570 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:23.373853 22713 raft_consensus.cc:2749] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.378228 22648 tablet_bootstrap.cc:654] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.385905 22837 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.395327 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:23.395964 22452 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.397261 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:23.398025 22603 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.398181 22667 consensus_queue.cc:1048] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.409654 22837 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:23.413805 22603 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:09:23.415414 22497 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:09:23.416430 22719 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.417292 22719 raft_consensus.cc:697] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:23.418363 22719 consensus_queue.cc:237] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.420548 22647 tablet_bootstrap.cc:492] T 60b63fe1f8174bdab922fc97591f1860 P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:23.422787 22647 ts_tablet_manager.cc:1403] T 60b63fe1f8174bdab922fc97591f1860 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.077s	user 0.032s	sys 0.035s
I20260709 12:09:23.427901 22647 raft_consensus.cc:359] T 60b63fe1f8174bdab922fc97591f1860 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.429257 22647 raft_consensus.cc:385] T 60b63fe1f8174bdab922fc97591f1860 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.429623 22647 raft_consensus.cc:740] T 60b63fe1f8174bdab922fc97591f1860 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.430472 22647 consensus_queue.cc:260] T 60b63fe1f8174bdab922fc97591f1860 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.433368 22647 ts_tablet_manager.cc:1434] T 60b63fe1f8174bdab922fc97591f1860 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:09:23.433581 22792 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.434471 22452 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:09:23.434206 22792 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.434579 22647 tablet_bootstrap.cc:492] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:23.437151 22792 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:23.437361 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:09:23.439201 22569 leader_election.cc:343] T ee3ba2f54b0343bea5e3a5364c372a89 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.442431 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:09:23.444027 22570 leader_election.cc:343] T ee3ba2f54b0343bea5e3a5364c372a89 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.444485 22570 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:23.445824 22792 raft_consensus.cc:2749] T ee3ba2f54b0343bea5e3a5364c372a89 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.447281 22647 tablet_bootstrap.cc:654] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:23.480497 22960 log.cc:927] Time spent T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:09:23.466583 22351 catalog_manager.cc:5697] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.495127 22646 tablet_bootstrap.cc:492] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:23.495755 22646 ts_tablet_manager.cc:1403] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.169s	user 0.052s	sys 0.048s
I20260709 12:09:23.497112 22648 tablet_bootstrap.cc:492] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:23.497629 22648 ts_tablet_manager.cc:1403] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.160s	user 0.010s	sys 0.006s
I20260709 12:09:23.498363 22646 raft_consensus.cc:359] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.499050 22646 raft_consensus.cc:385] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.499416 22646 raft_consensus.cc:740] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.500265 22646 consensus_queue.cc:260] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.502424 22646 ts_tablet_manager.cc:1434] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:09:23.503283 22646 tablet_bootstrap.cc:492] T 6445cf83e0b646428e39f19d21ca6c44 P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:23.509783 22837 consensus_queue.cc:1048] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.510401 22646 tablet_bootstrap.cc:654] T 6445cf83e0b646428e39f19d21ca6c44 P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.513011 22964 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:23.520807 22961 log.cc:927] Time spent T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.053s	user 0.003s	sys 0.000s
I20260709 12:09:23.525962 22965 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.513891 22964 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.527236 22648 raft_consensus.cc:359] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.528326 22648 raft_consensus.cc:385] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.528671 22648 raft_consensus.cc:740] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.529357 22648 consensus_queue.cc:260] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.530143 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:09:23.531687 22421 leader_election.cc:343] T 041a72bc20f246bdb6e7cc6423d67e62 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.526551 22965 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.536414 22647 tablet_bootstrap.cc:492] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:23.536913 22647 ts_tablet_manager.cc:1403] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.103s	user 0.036s	sys 0.024s
I20260709 12:09:23.537391 22965 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:23.538085 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:23.538722 22530 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 0.
I20260709 12:09:23.539077 22964 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:23.539846 22647 raft_consensus.cc:359] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.540349 22421 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:23.540740 22647 raft_consensus.cc:385] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.541131 22647 raft_consensus.cc:740] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.542686 22968 raft_consensus.cc:2804] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.543195 22968 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.543582 22968 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.545135 22648 ts_tablet_manager.cc:1434] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.047s	user 0.011s	sys 0.001s
I20260709 12:09:23.546134 22648 tablet_bootstrap.cc:492] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:23.552575 22648 tablet_bootstrap.cc:654] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.555275 22837 consensus_queue.cc:1048] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.567273 22647 consensus_queue.cc:260] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.592401 22647 ts_tablet_manager.cc:1434] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.002s
I20260709 12:09:23.593384 22647 tablet_bootstrap.cc:492] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
W20260709 12:09:23.591351 22958 log.cc:927] Time spent T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.163s	user 0.000s	sys 0.006s
I20260709 12:09:23.602516 22646 tablet_bootstrap.cc:492] T 6445cf83e0b646428e39f19d21ca6c44 P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:23.603170 22646 ts_tablet_manager.cc:1403] T 6445cf83e0b646428e39f19d21ca6c44 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.100s	user 0.028s	sys 0.022s
I20260709 12:09:23.594477 22837 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.619745 22646 raft_consensus.cc:359] T 6445cf83e0b646428e39f19d21ca6c44 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.621289 22646 raft_consensus.cc:385] T 6445cf83e0b646428e39f19d21ca6c44 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.621611 22646 raft_consensus.cc:740] T 6445cf83e0b646428e39f19d21ca6c44 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.622303 22646 consensus_queue.cc:260] T 6445cf83e0b646428e39f19d21ca6c44 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.622674 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:23.623374 22602 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 0.
I20260709 12:09:23.623901 22646 ts_tablet_manager.cc:1434] T 6445cf83e0b646428e39f19d21ca6c44 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:09:23.624785 22646 tablet_bootstrap.cc:492] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
W20260709 12:09:23.631632 22403 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:23.624195 22968 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.619405 22837 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.670149 22648 tablet_bootstrap.cc:492] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:23.670804 22648 ts_tablet_manager.cc:1403] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.125s	user 0.010s	sys 0.012s
I20260709 12:09:23.689164 22647 tablet_bootstrap.cc:654] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.692073 22966 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.692564 22966 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.699352 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:23.701337 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:23.702013 22452 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 0.
I20260709 12:09:23.704105 22495 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:23.708979 22763 raft_consensus.cc:2804] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.709360 22763 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.710124 22763 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.726657 22966 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:23.752525 22668 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.753063 22668 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.756331 22668 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:23.723150 22837 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:23.757553 22968 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:23.770640 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:23.770949 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:23.771533 22605 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 0.
I20260709 12:09:23.772850 22763 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.774148 22530 raft_consensus.cc:2393] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 1: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:09:23.775588 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:23.776147 22529 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.778805 22647 tablet_bootstrap.cc:492] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:23.779255 22647 ts_tablet_manager.cc:1403] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.186s	user 0.010s	sys 0.022s
I20260709 12:09:23.780567 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:23.783704 22648 raft_consensus.cc:359] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.784329 22648 raft_consensus.cc:385] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.784590 22648 raft_consensus.cc:740] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.785152 22648 consensus_queue.cc:260] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.785426 22647 raft_consensus.cc:359] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.786242 22647 raft_consensus.cc:385] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.786540 22647 raft_consensus.cc:740] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.787314 22647 consensus_queue.cc:260] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.789551 22647 ts_tablet_manager.cc:1434] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.010s	user 0.000s	sys 0.006s
I20260709 12:09:23.792809 22647 tablet_bootstrap.cc:492] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
W20260709 12:09:23.794324 22422 leader_election.cc:343] T 041a72bc20f246bdb6e7cc6423d67e62 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.794833 22422 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:09:23.795536 22965 raft_consensus.cc:2749] T 041a72bc20f246bdb6e7cc6423d67e62 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.800843 22647 tablet_bootstrap.cc:654] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.801931 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:23.807418 22648 ts_tablet_manager.cc:1434] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.131s	user 0.019s	sys 0.012s
I20260709 12:09:23.808346 22648 tablet_bootstrap.cc:492] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:23.809760 22963 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.810228 22963 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.811762 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:23.812321 22605 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.810220 22763 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:23.812813 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:23.814932 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:23.815510 22601 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:23.790166 22569 leader_election.cc:343] T 6445cf83e0b646428e39f19d21ca6c44 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.812279 22963 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:09:23.817482 22570 leader_election.cc:343] T 6445cf83e0b646428e39f19d21ca6c44 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.789830 22529 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 1.
I20260709 12:09:23.820134 22570 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:23.821260 22668 raft_consensus.cc:2749] T 6445cf83e0b646428e39f19d21ca6c44 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.828636 22605 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:09:23.831188 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:23.831858 22646 tablet_bootstrap.cc:654] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.832978 22602 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 0.
I20260709 12:09:23.835733 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:23.835848 22497 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:09:23.836417 22454 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.838052 22974 raft_consensus.cc:2804] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.838608 22974 raft_consensus.cc:697] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:23.839437 22974 consensus_queue.cc:237] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.841455 22648 tablet_bootstrap.cc:654] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.849498 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:23.850095 22530 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 0.
I20260709 12:09:23.853420 22454 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:09:23.855242 22422 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:09:23.855497 22601 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 1.
I20260709 12:09:23.855865 22647 tablet_bootstrap.cc:492] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:23.857838 22647 ts_tablet_manager.cc:1403] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.065s	user 0.014s	sys 0.001s
I20260709 12:09:23.859658 22719 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.860112 22719 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.862442 22719 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:23.863041 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:09:23.864194 22495 leader_election.cc:343] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.865147 22646 tablet_bootstrap.cc:492] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:23.865589 22646 ts_tablet_manager.cc:1403] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.241s	user 0.020s	sys 0.003s
I20260709 12:09:23.865912 22973 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.866395 22973 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.868278 22967 raft_consensus.cc:2749] T 19773e9e6aec446eb719d3d53d49812b P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.871991 22973 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:23.845072 22963 consensus_queue.cc:1048] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 12:09:23.873713 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:23.874454 22647 raft_consensus.cc:359] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.876053 22647 raft_consensus.cc:385] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.867141 22421 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:23.876338 22647 raft_consensus.cc:740] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.877543 22963 raft_consensus.cc:2804] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.877780 22421 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:23.878016 22963 raft_consensus.cc:697] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:09:23.879259 22968 raft_consensus.cc:2804] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.879628 22968 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.876920 22647 consensus_queue.cc:260] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.879462 22351 catalog_manager.cc:5697] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:23.880800 22570 leader_election.cc:343] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.882848 22968 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.878799 22963 consensus_queue.cc:237] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.892062 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:23.892697 22605 raft_consensus.cc:2468] T 62319c9e82134e7daf8a46f78c124bff P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 0.
I20260709 12:09:23.894225 22497 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:23.901851 22647 ts_tablet_manager.cc:1434] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.044s	user 0.002s	sys 0.003s
I20260709 12:09:23.902741 22647 tablet_bootstrap.cc:492] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:23.903851 22646 raft_consensus.cc:359] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.904507 22646 raft_consensus.cc:385] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.904743 22646 raft_consensus.cc:740] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.905457 22763 raft_consensus.cc:2804] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.905583 22646 consensus_queue.cc:260] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.906136 22763 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.905280 22974 consensus_queue.cc:1048] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:09:23.908450 22646 ts_tablet_manager.cc:1434] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 12:09:23.966849 22646 tablet_bootstrap.cc:492] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:23.906754 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:23.908054 22759 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.971578 22759 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.973541 22646 tablet_bootstrap.cc:654] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.973628 22759 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:23.906610 22763 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:23.978840 22569 leader_election.cc:343] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.979270 22569 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:23.979633 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:23.979909 22792 raft_consensus.cc:2749] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.982456 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:23.941222 22968 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:23.986045 22968 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:09:23.986084 22495 leader_election.cc:343] T 60b63fe1f8174bdab922fc97591f1860 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:23.988040 22497 leader_election.cc:343] T 60b63fe1f8174bdab922fc97591f1860 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.988576 22497 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:23.992704 22984 raft_consensus.cc:2749] T 60b63fe1f8174bdab922fc97591f1860 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.987365 22837 consensus_queue.cc:1048] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:09:24.007361 22963 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.011019 22963 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.013568 22351 catalog_manager.cc:5697] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 0 to 1, leader changed from <none> to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.018064 22964 consensus_queue.cc:1048] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:09:24.020622 22648 tablet_bootstrap.cc:492] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:24.021119 22648 ts_tablet_manager.cc:1403] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.213s	user 0.013s	sys 0.006s
I20260709 12:09:24.021559 22647 tablet_bootstrap.cc:654] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.015343 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:24.026861 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:24.027415 22602 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.028561 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:09:24.033577 22421 leader_election.cc:343] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.033438 22529 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.054153 22646 tablet_bootstrap.cc:492] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:24.054636 22646 ts_tablet_manager.cc:1403] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.088s	user 0.010s	sys 0.021s
I20260709 12:09:24.057917 22963 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:24.062790 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:24.064929 22763 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:09:24.067579 22422 leader_election.cc:343] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.067792 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:24.075969 22422 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:09:24.077772 22495 leader_election.cc:343] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.073086 22646 raft_consensus.cc:359] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.078317 22646 raft_consensus.cc:385] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.078622 22646 raft_consensus.cc:740] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.073478 22648 raft_consensus.cc:359] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.068189 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:24.079636 22648 raft_consensus.cc:385] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.079893 22605 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.079962 22648 raft_consensus.cc:740] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.066948 22763 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:24.079656 22965 raft_consensus.cc:2749] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.085840 22648 consensus_queue.cc:260] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.092705 22646 consensus_queue.cc:260] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.095738 22973 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.096354 22646 ts_tablet_manager.cc:1434] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.001s
I20260709 12:09:24.096215 22973 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.097206 22646 tablet_bootstrap.cc:492] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:24.098188 22973 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:24.094945 22648 ts_tablet_manager.cc:1434] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.074s	user 0.002s	sys 0.005s
I20260709 12:09:24.101902 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:09:24.103466 22569 leader_election.cc:343] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.103804 22602 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 1.
I20260709 12:09:24.105067 22605 raft_consensus.cc:2468] T 62319c9e82134e7daf8a46f78c124bff P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:09:24.104997 22422 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:24.106035 22965 raft_consensus.cc:2804] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.106590 22965 raft_consensus.cc:697] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:09:24.107595 22965 consensus_queue.cc:237] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.124141 22648 tablet_bootstrap.cc:492] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:24.132685 22647 tablet_bootstrap.cc:492] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:24.111691 22529 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 1.
I20260709 12:09:24.168467 22647 ts_tablet_manager.cc:1403] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.266s	user 0.024s	sys 0.005s
I20260709 12:09:24.183447 22497 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:24.184953 22646 tablet_bootstrap.cc:654] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.186661 22763 raft_consensus.cc:2804] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.194720 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:24.197834 22647 raft_consensus.cc:359] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.199321 22647 raft_consensus.cc:385] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.199571 22647 raft_consensus.cc:740] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.197674 22792 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:24.201982 22991 log.cc:927] Time spent T 10ed4486435d4f82978c5cb544504999 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:09:24.206048 22763 raft_consensus.cc:697] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:24.200546 22792 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.208933 22647 consensus_queue.cc:260] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.213341 22763 consensus_queue.cc:237] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.220419 22647 ts_tablet_manager.cc:1434] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.052s	user 0.001s	sys 0.005s
I20260709 12:09:24.221390 22647 tablet_bootstrap.cc:492] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:24.222493 22792 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:24.224067 22648 tablet_bootstrap.cc:654] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.205433 22532 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 0.
I20260709 12:09:24.227768 22570 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:24.229488 22973 raft_consensus.cc:2804] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.229854 22973 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.229703 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:24.230253 22973 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.243742 22353 catalog_manager.cc:5697] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.227126 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:09:24.248931 22570 leader_election.cc:343] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:24.251835 22569 leader_election.cc:343] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.252242 22569 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:24.253444 22792 raft_consensus.cc:2749] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.260759 22973 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.264086 22973 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:24.265594 22648 tablet_bootstrap.cc:492] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:24.266258 22646 tablet_bootstrap.cc:492] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:24.266846 22648 ts_tablet_manager.cc:1403] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.143s	user 0.023s	sys 0.010s
I20260709 12:09:24.267127 22646 ts_tablet_manager.cc:1403] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.170s	user 0.015s	sys 0.004s
I20260709 12:09:24.268927 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:24.268966 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:24.269719 22532 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:24.270718 22569 leader_election.cc:343] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.272456 22646 raft_consensus.cc:359] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.273942 22646 raft_consensus.cc:385] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.274345 22647 tablet_bootstrap.cc:654] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.273265 22648 raft_consensus.cc:359] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.274818 22648 raft_consensus.cc:385] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.275163 22648 raft_consensus.cc:740] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.275916 22648 consensus_queue.cc:260] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.268913 22354 catalog_manager.cc:5697] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 0 to 1, leader changed from <none> to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.274294 22646 raft_consensus.cc:740] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.278443 22646 consensus_queue.cc:260] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.278775 22532 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 1.
I20260709 12:09:24.280615 22646 ts_tablet_manager.cc:1434] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:09:24.280663 22570 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:24.281534 22648 ts_tablet_manager.cc:1434] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:09:24.282624 22792 raft_consensus.cc:2804] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.283159 22792 raft_consensus.cc:697] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:09:24.283711 22646 tablet_bootstrap.cc:492] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:24.283939 22792 consensus_queue.cc:237] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.282763 22648 tablet_bootstrap.cc:492] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:24.291417 22648 tablet_bootstrap.cc:654] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.298096 22646 tablet_bootstrap.cc:654] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.305629 22646 tablet_bootstrap.cc:492] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:24.306099 22646 ts_tablet_manager.cc:1403] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.001s
I20260709 12:09:24.306785 22648 tablet_bootstrap.cc:492] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:24.307284 22648 ts_tablet_manager.cc:1403] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.001s
I20260709 12:09:24.308871 22646 raft_consensus.cc:359] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.309544 22646 raft_consensus.cc:385] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.309804 22646 raft_consensus.cc:740] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.309939 22647 tablet_bootstrap.cc:492] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:24.309805 22648 raft_consensus.cc:359] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.310487 22647 ts_tablet_manager.cc:1403] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.089s	user 0.013s	sys 0.008s
I20260709 12:09:24.310616 22648 raft_consensus.cc:385] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.311065 22648 raft_consensus.cc:740] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.310598 22646 consensus_queue.cc:260] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.311683 22648 consensus_queue.cc:260] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.313633 22646 ts_tablet_manager.cc:1434] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:09:24.313732 22647 raft_consensus.cc:359] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.314397 22647 raft_consensus.cc:385] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.314495 22646 tablet_bootstrap.cc:492] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:24.314682 22647 raft_consensus.cc:740] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.315961 22647 consensus_queue.cc:260] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.316354 22353 catalog_manager.cc:5697] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 1 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:24.321250 22648 ts_tablet_manager.cc:1434] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.003s
I20260709 12:09:24.322187 22648 tablet_bootstrap.cc:492] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:24.324420 22646 tablet_bootstrap.cc:654] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.328018 22648 tablet_bootstrap.cc:654] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.332336 22647 ts_tablet_manager.cc:1434] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.003s
I20260709 12:09:24.335595 22646 tablet_bootstrap.cc:492] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:24.335774 22647 tablet_bootstrap.cc:492] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:24.338894 22648 tablet_bootstrap.cc:492] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:24.339339 22648 ts_tablet_manager.cc:1403] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.017s	user 0.016s	sys 0.000s
I20260709 12:09:24.341835 22648 raft_consensus.cc:359] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.342480 22648 raft_consensus.cc:385] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.342751 22648 raft_consensus.cc:740] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.343453 22648 consensus_queue.cc:260] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.336068 22646 ts_tablet_manager.cc:1403] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.004s
I20260709 12:09:24.344756 22647 tablet_bootstrap.cc:654] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.346421 22646 raft_consensus.cc:359] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.347074 22646 raft_consensus.cc:385] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.347347 22646 raft_consensus.cc:740] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.348079 22646 consensus_queue.cc:260] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.351181 22646 ts_tablet_manager.cc:1434] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:24.352396 22965 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.352855 22965 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.354030 22668 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.354441 22668 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.354815 22965 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:24.356236 22668 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:24.358151 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:24.358485 22648 ts_tablet_manager.cc:1434] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:09:24.359602 22648 tablet_bootstrap.cc:492] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
W20260709 12:09:24.359555 22570 leader_election.cc:343] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.358469 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:24.359825 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:24.360565 22604 raft_consensus.cc:2393] T 62319c9e82134e7daf8a46f78c124bff P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 1: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:09:24.363430 22830 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.363919 22830 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.364318 22422 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:09:24.365468 22963 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.365839 22830 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:24.366848 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:24.367468 22604 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 0.
I20260709 12:09:24.367522 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:24.368093 22455 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 0.
I20260709 12:09:24.368667 22422 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:24.369447 22830 raft_consensus.cc:2804] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.369645 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:24.369814 22830 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.370110 22648 tablet_bootstrap.cc:654] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.370147 22830 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.371927 22974 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.372395 22963 raft_consensus.cc:2749] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.372397 22974 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.375497 22974 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:09:24.376703 22421 leader_election.cc:343] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.376760 22830 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.379204 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:09:24.380431 22421 leader_election.cc:343] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.381495 22646 tablet_bootstrap.cc:492] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc: Bootstrap starting.
I20260709 12:09:24.383019 22763 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.383476 22763 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.385303 22763 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:24.386771 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:24.387331 22603 raft_consensus.cc:2468] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 0.
I20260709 12:09:24.387687 22569 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:09:24.388706 22792 raft_consensus.cc:2804] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.388826 22646 tablet_bootstrap.cc:654] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.389124 22792 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.389447 22497 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:09:24.389887 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:24.389488 22792 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.390938 22984 raft_consensus.cc:2804] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.391325 22984 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.391966 22965 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.393332 22965 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.395418 22965 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:24.395991 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:24.395785 22968 consensus_queue.cc:1048] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.396710 22532 raft_consensus.cc:2393] T 60b63fe1f8174bdab922fc97591f1860 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 1: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:09:24.391628 22984 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.403999 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:24.405289 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:24.405871 22604 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 0.
I20260709 12:09:24.406185 22647 tablet_bootstrap.cc:492] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:24.406793 22647 ts_tablet_manager.cc:1403] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.071s	user 0.012s	sys 0.008s
I20260709 12:09:24.407264 22497 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:09:24.408238 22837 raft_consensus.cc:2804] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.408597 22837 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.408916 22837 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.409336 22422 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:09:24.410565 22968 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.410197 22647 raft_consensus.cc:359] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.411171 22647 raft_consensus.cc:385] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.411531 22647 raft_consensus.cc:740] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.412322 22647 consensus_queue.cc:260] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.402915 22792 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.415890 22792 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:24.417392 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:24.417622 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:09:24.418186 22495 leader_election.cc:343] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:24.418710 22570 leader_election.cc:343] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.420116 22647 ts_tablet_manager.cc:1434] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:09:24.421000 22968 raft_consensus.cc:2749] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.421010 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:24.422353 22453 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.430761 22453 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 1.
I20260709 12:09:24.431747 22569 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
W20260709 12:09:24.432094 22495 leader_election.cc:343] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.430357 22837 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.435621 22837 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:24.436637 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:24.438213 22605 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.440723 22648 tablet_bootstrap.cc:492] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:24.441179 22648 ts_tablet_manager.cc:1403] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.082s	user 0.031s	sys 0.038s
I20260709 12:09:24.443813 22792 raft_consensus.cc:2804] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.443755 22648 raft_consensus.cc:359] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.444358 22792 raft_consensus.cc:697] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:09:24.444481 22648 raft_consensus.cc:385] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.444841 22648 raft_consensus.cc:740] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.445456 22648 consensus_queue.cc:260] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.446391 22963 consensus_queue.cc:1048] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.453958 22648 ts_tablet_manager.cc:1434] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.000s
I20260709 12:09:24.445242 22792 consensus_queue.cc:237] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.455001 22648 tablet_bootstrap.cc:492] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:24.455776 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:24.456359 22604 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.463747 22648 tablet_bootstrap.cc:654] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.466406 22837 consensus_queue.cc:1048] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.467732 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:09:24.485472 22495 leader_election.cc:343] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.437193 22984 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.486757 22985 consensus_queue.cc:1048] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.431831 22830 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:24.433230 22647 tablet_bootstrap.cc:492] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:24.489395 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:24.489980 22602 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.496356 22647 tablet_bootstrap.cc:654] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.499524 22605 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:09:24.500864 22497 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:24.501870 22974 raft_consensus.cc:2804] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.503031 22974 raft_consensus.cc:697] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:24.503837 22974 consensus_queue.cc:237] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.507175 22648 tablet_bootstrap.cc:492] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:24.507716 22648 ts_tablet_manager.cc:1403] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.053s	user 0.008s	sys 0.023s
I20260709 12:09:24.509634 22647 tablet_bootstrap.cc:492] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:24.510073 22647 ts_tablet_manager.cc:1403] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.077s	user 0.009s	sys 0.005s
I20260709 12:09:24.509953 22602 raft_consensus.cc:2468] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:09:24.510537 22648 raft_consensus.cc:359] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.511066 22497 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:09:24.511829 22985 raft_consensus.cc:2804] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.512280 22985 raft_consensus.cc:697] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:24.511404 22648 raft_consensus.cc:385] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.513482 22648 raft_consensus.cc:740] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.513140 22985 consensus_queue.cc:237] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.514394 22648 consensus_queue.cc:260] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.513509 22604 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 1.
I20260709 12:09:24.515848 22647 raft_consensus.cc:359] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.516510 22422 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:09:24.517766 22830 raft_consensus.cc:2804] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.518275 22830 raft_consensus.cc:697] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:09:24.519089 22830 consensus_queue.cc:237] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.516505 22647 raft_consensus.cc:385] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.522893 22648 ts_tablet_manager.cc:1434] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:09:24.536705 22648 tablet_bootstrap.cc:492] T d7a58204e5354d61a3b5db01e879dce9 P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:24.541494 22967 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.524513 22647 raft_consensus.cc:740] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.531783 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:24.541975 22967 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.528903 22984 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:24.544216 22967 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:24.543799 22647 consensus_queue.cc:260] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.546446 22647 ts_tablet_manager.cc:1434] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.002s
I20260709 12:09:24.547441 22647 tablet_bootstrap.cc:492] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:24.548744 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:24.549414 22604 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 0.
I20260709 12:09:24.550237 22648 tablet_bootstrap.cc:654] T d7a58204e5354d61a3b5db01e879dce9 P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.555428 22422 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:24.555747 22646 tablet_bootstrap.cc:492] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc: No bootstrap required, opened a new log
I20260709 12:09:24.556159 22646 ts_tablet_manager.cc:1403] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent bootstrapping tablet: real 0.175s	user 0.012s	sys 0.000s
I20260709 12:09:24.556505 22654 raft_consensus.cc:2804] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.578507 22654 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.578881 22654 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.586092 22654 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.565197 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:24.587122 22529 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 0.
I20260709 12:09:24.590708 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:24.591418 22604 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.594610 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:24.595443 22529 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.594868 22353 catalog_manager.cc:5697] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 1 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:24.600900 22648 tablet_bootstrap.cc:492] T d7a58204e5354d61a3b5db01e879dce9 P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:24.601409 22648 ts_tablet_manager.cc:1403] T d7a58204e5354d61a3b5db01e879dce9 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.065s	user 0.030s	sys 0.024s
I20260709 12:09:24.602267 22529 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 1.
I20260709 12:09:24.604223 22648 raft_consensus.cc:359] T d7a58204e5354d61a3b5db01e879dce9 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.604941 22648 raft_consensus.cc:385] T d7a58204e5354d61a3b5db01e879dce9 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.605261 22648 raft_consensus.cc:740] T d7a58204e5354d61a3b5db01e879dce9 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.605571 22421 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:24.605904 22648 consensus_queue.cc:260] T d7a58204e5354d61a3b5db01e879dce9 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.575716 22647 tablet_bootstrap.cc:654] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.563169 22964 consensus_queue.cc:1048] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.608842 22654 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:09:24.573931 22495 leader_election.cc:343] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.606323 22967 raft_consensus.cc:2804] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.614385 22648 ts_tablet_manager.cc:1434] T d7a58204e5354d61a3b5db01e879dce9 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.002s
I20260709 12:09:24.616966 22648 tablet_bootstrap.cc:492] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:24.611516 22967 raft_consensus.cc:697] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:09:24.625555 22967 consensus_queue.cc:237] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.606106 22646 raft_consensus.cc:359] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.626799 22646 raft_consensus.cc:385] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.627184 22646 raft_consensus.cc:740] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.628054 22646 consensus_queue.cc:260] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.610817 22354 catalog_manager.cc:5697] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 0 to 1, leader changed from <none> to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.630792 22646 ts_tablet_manager.cc:1434] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
I20260709 12:09:24.614251 22604 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 1.
I20260709 12:09:24.626377 22648 tablet_bootstrap.cc:654] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.657838 22830 consensus_queue.cc:1048] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.667884 22792 consensus_queue.cc:1048] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.673662 22353 catalog_manager.cc:5697] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.675256 22837 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.676088 22837 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.678292 22985 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:24.678686 22403 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:24.678798 22985 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.684934 22985 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:09:24.690513 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 102082us
I20260709 12:09:24.695297 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:24.695803 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:24.695909 22603 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 0.
I20260709 12:09:24.696425 22602 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 0.
I20260709 12:09:24.700094 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:24.700682 22456 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 0.
I20260709 12:09:24.677965 22837 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:24.706454 22647 tablet_bootstrap.cc:492] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:24.706668 22497 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:09:24.706899 22647 ts_tablet_manager.cc:1403] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.160s	user 0.014s	sys 0.046s
I20260709 12:09:24.708402 22976 raft_consensus.cc:2804] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.708763 22976 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.709077 22976 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.709576 22647 raft_consensus.cc:359] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.710245 22647 raft_consensus.cc:385] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.710500 22647 raft_consensus.cc:740] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.711159 22647 consensus_queue.cc:260] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.713286 22647 ts_tablet_manager.cc:1434] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:09:24.714221 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:24.714777 22647 tablet_bootstrap.cc:492] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:24.714896 22452 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 0.
I20260709 12:09:24.715514 22792 consensus_queue.cc:1048] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.716325 22495 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:24.718799 22648 tablet_bootstrap.cc:492] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:24.719321 22648 ts_tablet_manager.cc:1403] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.103s	user 0.021s	sys 0.021s
I20260709 12:09:24.719805 22985 raft_consensus.cc:2804] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.719365 22353 catalog_manager.cc:5697] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.720216 22985 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.725101 22985 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.716521 22976 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.721905 22648 raft_consensus.cc:359] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.734530 22648 raft_consensus.cc:385] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.734848 22648 raft_consensus.cc:740] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.735525 22648 consensus_queue.cc:260] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.736537 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:24.737090 22456 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.739564 22967 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.740013 22967 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.742276 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:24.742584 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:24.721828 22647 tablet_bootstrap.cc:654] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.743131 22605 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 0.
W20260709 12:09:24.743744 22421 leader_election.cc:343] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.744241 22422 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:09:24.745007 22830 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.745362 22830 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.745682 22830 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.746524 22648 ts_tablet_manager.cc:1434] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:09:24.747442 22648 tablet_bootstrap.cc:492] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:24.749852 22967 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:24.727332 22837 consensus_queue.cc:1048] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.732046 22985 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.752306 22985 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:24.755270 22985 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.752496 22830 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.749794 22456 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:09:24.756547 22985 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.759184 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:24.758680 22352 catalog_manager.cc:5697] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 0 to 1, leader changed from <none> to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:24.760802 22421 leader_election.cc:343] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.762828 22495 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:24.763538 22974 raft_consensus.cc:2804] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.763988 22974 raft_consensus.cc:697] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:24.766130 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:24.766695 22601 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.768265 22792 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.768730 22792 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.772482 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:24.773066 22529 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 0.
I20260709 12:09:24.773494 22974 consensus_queue.cc:237] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.774809 22570 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:09:24.775413 22763 consensus_queue.cc:1048] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.778600 22601 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 1.
I20260709 12:09:24.775664 22713 raft_consensus.cc:2804] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.779546 22713 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.779904 22713 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.775642 22792 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:24.783496 22647 tablet_bootstrap.cc:492] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:24.783922 22647 ts_tablet_manager.cc:1403] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.069s	user 0.006s	sys 0.005s
I20260709 12:09:24.785342 22985 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:24.787525 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:24.788141 22456 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.779120 22830 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:24.795463 22976 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:24.796878 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:24.797484 22602 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.797192 22422 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:09:24.798960 22830 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.799996 22830 raft_consensus.cc:697] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:09:24.801254 22830 consensus_queue.cc:237] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.802946 22792 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.809240 22792 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.811195 22792 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:24.786872 22647 raft_consensus.cc:359] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.811725 22647 raft_consensus.cc:385] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.812043 22647 raft_consensus.cc:740] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.812222 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:24.812819 22647 consensus_queue.cc:260] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:09:24.813517 22570 leader_election.cc:343] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.799017 22648 tablet_bootstrap.cc:654] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.795089 22713 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.806309 22602 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:09:24.817018 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:24.817564 22528 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.802712 22456 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:09:24.818815 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:24.819700 22453 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 0.
I20260709 12:09:24.822012 22647 ts_tablet_manager.cc:1434] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 12:09:24.824363 22647 tablet_bootstrap.cc:492] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:24.824494 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:24.825266 22713 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:24.828670 22528 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 1.
I20260709 12:09:24.830560 22570 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:09:24.831652 22713 raft_consensus.cc:2804] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.832489 22713 raft_consensus.cc:697] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:09:24.833526 22713 consensus_queue.cc:237] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.854485 22497 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:09:24.854923 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:24.855733 22604 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.856149 22985 raft_consensus.cc:2804] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.856945 22985 raft_consensus.cc:697] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:24.857837 22985 consensus_queue.cc:237] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:24.923316 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:24.925755 22453 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 0.
I20260709 12:09:24.927883 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:24.928831 22455 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.932019 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:09:24.948570 23028 log.cc:927] Time spent T 62319c9e82134e7daf8a46f78c124bff P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 12:09:24.950138 22569 leader_election.cc:343] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.961033 22647 tablet_bootstrap.cc:654] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.971463 22455 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 1.
I20260709 12:09:24.971587 22495 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:09:24.974205 22837 raft_consensus.cc:2764] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:09:24.950874 22569 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:24.976497 22792 raft_consensus.cc:2749] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.987742 22837 consensus_queue.cc:1048] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.964684 22604 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:09:24.999876 22648 tablet_bootstrap.cc:492] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:25.007205 22713 consensus_queue.cc:1048] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:09:25.012250 22648 ts_tablet_manager.cc:1403] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.265s	user 0.014s	sys 0.012s
W20260709 12:09:25.022749 22495 consensus_peers.cc:597] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:09:25.023518 22495 consensus_peers.cc:597] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:25.040292 22353 catalog_manager.cc:5697] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:25.043701 22570 consensus_peers.cc:597] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:25.043246 22353 catalog_manager.cc:5697] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:25.045979 22647 tablet_bootstrap.cc:492] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:25.038112 22648 raft_consensus.cc:359] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:25.046829 22648 raft_consensus.cc:385] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.047142 22648 raft_consensus.cc:740] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.047866 22648 consensus_queue.cc:260] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:25.051262 22647 ts_tablet_manager.cc:1403] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.227s	user 0.014s	sys 0.012s
I20260709 12:09:25.052058 22648 ts_tablet_manager.cc:1434] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.039s	user 0.010s	sys 0.000s
I20260709 12:09:25.053550 22648 tablet_bootstrap.cc:492] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:25.058773 22647 raft_consensus.cc:359] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:25.060832 22647 raft_consensus.cc:385] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.061152 22647 raft_consensus.cc:740] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.061946 22647 consensus_queue.cc:260] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:25.065663 22647 ts_tablet_manager.cc:1434] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:09:25.067060 22647 tablet_bootstrap.cc:492] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:25.068217 22648 tablet_bootstrap.cc:654] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.077978 22351 catalog_manager.cc:5697] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 1 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:25.082269 22647 tablet_bootstrap.cc:654] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.093111 22529 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.094688 22830 consensus_queue.cc:1048] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:25.099045 22352 catalog_manager.cc:5697] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 0 to 1, leader changed from <none> to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:25.102278 22830 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.103667 22830 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:25.106582 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:25.107295 22528 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 0.
I20260709 12:09:25.108979 22421 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:25.110232 22654 raft_consensus.cc:2804] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:25.110575 22654 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:25.110883 22654 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.117365 22830 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:25.128170 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:25.129024 22601 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 0.
I20260709 12:09:25.145931 22968 consensus_queue.cc:1048] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:09:25.157274 22974 consensus_queue.cc:1048] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:25.157449 22965 consensus_queue.cc:1048] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:25.170130 22648 tablet_bootstrap.cc:492] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:25.170616 22648 ts_tablet_manager.cc:1403] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.117s	user 0.018s	sys 0.011s
I20260709 12:09:25.176307 22654 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:25.179275 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:25.179945 22527 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.180312 22654 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:25.182708 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:25.183813 22604 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.178156 22648 raft_consensus.cc:359] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:25.187626 22648 raft_consensus.cc:385] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.187992 22648 raft_consensus.cc:740] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.187096 22837 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.190790 22837 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:25.202971 22648 consensus_queue.cc:260] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:25.206180 22830 consensus_queue.cc:1048] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:25.213593 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:25.215867 22837 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:25.216501 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:25.218344 22527 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 1.
I20260709 12:09:25.221428 22497 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:25.222370 22985 raft_consensus.cc:2749] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:25.224053 22647 tablet_bootstrap.cc:492] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:25.224525 22647 ts_tablet_manager.cc:1403] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.158s	user 0.016s	sys 0.004s
I20260709 12:09:25.228247 22604 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 1.
I20260709 12:09:25.230357 22422 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:25.228936 22647 raft_consensus.cc:359] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:25.232863 22647 raft_consensus.cc:385] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.236421 22647 raft_consensus.cc:740] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.241503 22964 raft_consensus.cc:2804] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:25.240962 22647 consensus_queue.cc:260] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:25.243994 22648 ts_tablet_manager.cc:1434] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.073s	user 0.004s	sys 0.004s
I20260709 12:09:25.260872 22647 ts_tablet_manager.cc:1434] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 12:09:25.270623 22647 tablet_bootstrap.cc:492] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:25.276216 22648 tablet_bootstrap.cc:492] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
W20260709 12:09:25.293009 22421 consensus_peers.cc:597] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:25.294893 22964 raft_consensus.cc:697] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:09:25.298377 22648 tablet_bootstrap.cc:654] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.299378 22713 consensus_queue.cc:1048] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:25.304605 22647 tablet_bootstrap.cc:654] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.304771 22759 consensus_queue.cc:1048] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:25.295967 22964 consensus_queue.cc:237] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:25.307961 22830 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.308372 22830 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:25.316877 22830 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:25.317838 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:25.322301 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:25.339326 22422 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:09:25.341465 23043 raft_consensus.cc:2749] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:25.342080 23043 consensus_queue.cc:1048] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:25.346551 23008 consensus_queue.cc:1048] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:25.347406 22974 consensus_queue.cc:1048] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:25.371869 22353 catalog_manager.cc:5697] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 0 to 1, leader changed from <none> to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:25.377720 22647 tablet_bootstrap.cc:492] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:25.378265 22647 ts_tablet_manager.cc:1403] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.108s	user 0.016s	sys 0.000s
I20260709 12:09:25.388198 22985 consensus_queue.cc:1048] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:25.389688 22647 raft_consensus.cc:359] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:25.390354 22647 raft_consensus.cc:385] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.390621 22647 raft_consensus.cc:740] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.395416 22648 tablet_bootstrap.cc:492] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:25.395864 22837 consensus_queue.cc:1048] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:25.395902 22648 ts_tablet_manager.cc:1403] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.120s	user 0.018s	sys 0.005s
I20260709 12:09:25.409296 22647 consensus_queue.cc:260] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:25.423487 22974 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.423990 22974 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:25.439980 22974 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:25.441303 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:25.444672 22648 raft_consensus.cc:359] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:25.444682 22647 ts_tablet_manager.cc:1434] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.000s
I20260709 12:09:25.445410 22648 raft_consensus.cc:385] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.445734 22648 raft_consensus.cc:740] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.446293 22647 tablet_bootstrap.cc:492] T 6334366811764682b0a491c130c68eed P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:25.446376 22648 consensus_queue.cc:260] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:25.450229 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:25.450541 22648 ts_tablet_manager.cc:1434] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.054s	user 0.005s	sys 0.001s
I20260709 12:09:25.451833 22497 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:25.453935 22837 raft_consensus.cc:2749] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:25.463105 22648 tablet_bootstrap.cc:492] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:25.465529 22647 tablet_bootstrap.cc:654] T 6334366811764682b0a491c130c68eed P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.474349 22648 tablet_bootstrap.cc:654] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.485576 22648 tablet_bootstrap.cc:492] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:25.485970 22648 ts_tablet_manager.cc:1403] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.031s	user 0.005s	sys 0.005s
I20260709 12:09:25.488287 22648 raft_consensus.cc:359] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:25.488925 22452 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.488958 22648 raft_consensus.cc:385] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.490000 22648 raft_consensus.cc:740] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.490829 22648 consensus_queue.cc:260] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:25.491551 22647 tablet_bootstrap.cc:492] T 6334366811764682b0a491c130c68eed P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:25.492020 22647 ts_tablet_manager.cc:1403] T 6334366811764682b0a491c130c68eed P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.002s
I20260709 12:09:25.493193 22648 ts_tablet_manager.cc:1434] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:09:25.494225 22648 tablet_bootstrap.cc:492] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f: Bootstrap starting.
I20260709 12:09:25.494760 22647 raft_consensus.cc:359] T 6334366811764682b0a491c130c68eed P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:25.495460 22647 raft_consensus.cc:385] T 6334366811764682b0a491c130c68eed P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.495718 22647 raft_consensus.cc:740] T 6334366811764682b0a491c130c68eed P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.496407 22647 consensus_queue.cc:260] T 6334366811764682b0a491c130c68eed P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:25.498684 22647 ts_tablet_manager.cc:1434] T 6334366811764682b0a491c130c68eed P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.003s
I20260709 12:09:25.499815 22647 tablet_bootstrap.cc:492] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:25.501026 22648 tablet_bootstrap.cc:654] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.505781 22647 tablet_bootstrap.cc:654] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.518007 22647 tablet_bootstrap.cc:492] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:25.518362 22647 ts_tablet_manager.cc:1403] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.003s
I20260709 12:09:25.521198 22648 tablet_bootstrap.cc:492] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f: No bootstrap required, opened a new log
I20260709 12:09:25.520962 22647 raft_consensus.cc:359] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:25.521575 22647 raft_consensus.cc:385] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.521625 22648 ts_tablet_manager.cc:1403] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.000s
I20260709 12:09:25.521929 22647 raft_consensus.cc:740] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.522658 22647 consensus_queue.cc:260] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:25.524698 22647 ts_tablet_manager.cc:1434] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:09:25.529778 22647 tablet_bootstrap.cc:492] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881: Bootstrap starting.
I20260709 12:09:25.534540 22648 raft_consensus.cc:359] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:25.535250 22648 raft_consensus.cc:385] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.535499 22648 raft_consensus.cc:740] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.536197 22648 consensus_queue.cc:260] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:25.538256 22648 ts_tablet_manager.cc:1434] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.002s
I20260709 12:09:25.542938 22647 tablet_bootstrap.cc:654] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.547919 22647 tablet_bootstrap.cc:492] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881: No bootstrap required, opened a new log
I20260709 12:09:25.548427 22647 ts_tablet_manager.cc:1403] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.004s
I20260709 12:09:25.556037 22647 raft_consensus.cc:359] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:25.556769 22647 raft_consensus.cc:385] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.557017 22647 raft_consensus.cc:740] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.557612 22647 consensus_queue.cc:260] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:25.559259 22647 ts_tablet_manager.cc:1434] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:09:25.609782 22654 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.610139 22654 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:25.611652 22654 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:25.612331 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:25.612641 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:25.612828 22529 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 0.
I20260709 12:09:25.613366 22603 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 0.
I20260709 12:09:25.613974 22421 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:25.614670 22654 raft_consensus.cc:2804] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:25.615031 22654 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:25.615293 22654 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.619304 22654 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:25.620705 22654 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:25.621275 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:25.621563 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:25.621800 22529 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.622067 22603 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.626308 22529 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 1.
I20260709 12:09:25.626796 22603 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 1.
I20260709 12:09:25.627249 22421 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:25.628448 22654 raft_consensus.cc:2804] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:25.629073 22654 raft_consensus.cc:697] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:09:25.629693 22654 consensus_queue.cc:237] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:25.639060 22351 catalog_manager.cc:5697] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 0 to 1, leader changed from <none> to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:25.649334 22968 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.649832 22968 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:25.651664 22968 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:25.652242 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:25.652897 22527 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 0.
I20260709 12:09:25.653137 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:25.653788 22601 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 0.
I20260709 12:09:25.653913 22421 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:25.655226 22968 raft_consensus.cc:2804] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:25.655517 22968 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:25.655900 22968 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.656955 22527 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.664294 22968 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:25.667455 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:25.667680 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:25.667991 22529 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.668212 22601 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.671145 22968 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:25.673942 22529 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 1.
I20260709 12:09:25.674322 22601 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 1.
I20260709 12:09:25.674970 22421 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:25.676105 22968 raft_consensus.cc:2804] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:25.676565 22968 raft_consensus.cc:697] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:09:25.677259 22968 consensus_queue.cc:237] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:25.695331 22351 catalog_manager.cc:5697] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 0 to 1, leader changed from <none> to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:25.725054 22403 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:25.749837 22759 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.750311 22759 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:25.752113 22759 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:25.752633 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:25.752977 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:25.753273 22452 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 0.
I20260709 12:09:25.753621 22603 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 0.
I20260709 12:09:25.754335 22495 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:25.755033 22759 raft_consensus.cc:2804] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:25.755342 22759 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:25.755563 22759 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.760466 22759 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:25.762053 22759 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:25.762928 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:25.763118 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:25.763705 22603 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.764740 22452 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.768847 22529 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.769722 22603 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:09:25.770946 22497 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:09:25.771966 22759 raft_consensus.cc:2804] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:25.772486 22759 raft_consensus.cc:697] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:25.773408 22759 consensus_queue.cc:237] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:25.775267 22452 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:09:25.789371 22351 catalog_manager.cc:5697] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:25.817603 22654 consensus_queue.cc:1048] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:25.834666 22968 consensus_queue.cc:1048] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:25.981163 22964 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.981643 22964 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:25.983445 22964 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:25.984871 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:25.985740 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:25.986963 22422 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:09:25.987625 22968 raft_consensus.cc:2749] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:26.019465 22452 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.119357 22968 consensus_queue.cc:1048] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:26.132297 22654 consensus_queue.cc:1048] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:26.198278 22763 consensus_queue.cc:1048] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:26.205273 22654 consensus_queue.cc:1048] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:26.210786 22759 consensus_queue.cc:1048] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:26.236012 22968 consensus_queue.cc:1048] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:26.957870 21266 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:26.989306 23079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:26.989358 23078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:26.989509 23081 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:26.991232 21266 server_base.cc:1061] running on GCE node
I20260709 12:09:26.992722 21266 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:26.992956 21266 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:26.993166 21266 hybrid_clock.cc:648] HybridClock initialized: now 1783598966993148 us; error 0 us; skew 500 ppm
I20260709 12:09:26.993806 21266 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:26.997613 21266 webserver.cc:533] Webserver started at http://127.20.196.132:41073/ using document root <none> and password file <none>
I20260709 12:09:26.998201 21266 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:26.998449 21266 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:26.998831 21266 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:27.000248 21266 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-3-root/instance:
uuid: "8701cd5186a949538d8efafb5f987270"
format_stamp: "Formatted at 2026-07-09 12:09:26 on dist-test-slave-h6sg"
I20260709 12:09:27.005544 21266 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.005s
I20260709 12:09:27.009183 23086 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:27.010663 21266 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:09:27.011124 21266 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-3-root
uuid: "8701cd5186a949538d8efafb5f987270"
format_stamp: "Formatted at 2026-07-09 12:09:26 on dist-test-slave-h6sg"
I20260709 12:09:27.011417 21266 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:27.031045 21266 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:27.032361 21266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:27.033587 21266 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:27.036413 21266 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:27.036589 21266 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:27.036887 21266 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:27.037077 21266 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:27.112898 21266 rpc_server.cc:307] RPC server started. Bound to: 127.20.196.132:44353
I20260709 12:09:27.113206 23149 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.196.132:44353 every 8 connection(s)
I20260709 12:09:27.119683 21266 auto_leader_rebalancer-test.cc:439] add a tserver: 8701cd5186a949538d8efafb5f987270
I20260709 12:09:27.132788 23150 heartbeater.cc:344] Connected to a master server at 127.20.196.190:44877
I20260709 12:09:27.133168 23150 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:27.133793 23150 heartbeater.cc:507] Master 127.20.196.190:44877 requested a full tablet report, sending...
I20260709 12:09:27.135660 22352 ts_manager.cc:194] Registered new tserver with Master: 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:09:27.137260 22352 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48412
I20260709 12:09:27.846110 22457 consensus_queue.cc:237] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:27.853788 22603 raft_consensus.cc:1275] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:27.855104 22654 consensus_queue.cc:1048] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:27.855801 22529 raft_consensus.cc:1275] T 05f9fdee21394d6e97e0554e30632be7 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:27.857388 23043 consensus_queue.cc:1048] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:27.868244 22421 consensus_peers.cc:597] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 05f9fdee21394d6e97e0554e30632be7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:27.868127 22603 raft_consensus.cc:2955] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:27.867221 22654 raft_consensus.cc:2955] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:27.874114 22529 raft_consensus.cc:2955] T 05f9fdee21394d6e97e0554e30632be7 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:27.896198 22352 catalog_manager.cc:5697] T 05f9fdee21394d6e97e0554e30632be7 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:27.965881 22601 consensus_queue.cc:237] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:27.983969 22457 raft_consensus.cc:1275] T 13854b1cf45740e680c203d064295c78 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:27.985791 23163 consensus_queue.cc:1048] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:27.986692 22527 raft_consensus.cc:1275] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:27.991146 23163 consensus_queue.cc:1048] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:28.001109 23172 raft_consensus.cc:2955] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:28.004154 22527 raft_consensus.cc:2955] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
W20260709 12:09:28.014662 22570 consensus_peers.cc:597] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 13854b1cf45740e680c203d064295c78. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:28.025844 22351 catalog_manager.cc:5697] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New cstate: current_term: 1 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:28.026279 22452 consensus_queue.cc:237] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:28.026895 22457 raft_consensus.cc:2955] T 13854b1cf45740e680c203d064295c78 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:28.039743 22601 raft_consensus.cc:1275] T 6445cf83e0b646428e39f19d21ca6c44 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:28.041214 23165 consensus_queue.cc:1048] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:28.043548 22421 consensus_peers.cc:597] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6445cf83e0b646428e39f19d21ca6c44. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:28.045585 22527 raft_consensus.cc:1275] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:28.047750 23165 consensus_queue.cc:1048] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:28.063033 23043 raft_consensus.cc:2955] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:28.064728 22527 raft_consensus.cc:2955] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:28.067545 22601 raft_consensus.cc:2955] T 6445cf83e0b646428e39f19d21ca6c44 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:28.080022 22602 consensus_queue.cc:237] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:28.080675 22351 catalog_manager.cc:5697] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:28.089977 22457 raft_consensus.cc:1275] T 00284432759445f6a017e6ddb9ec1689 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:28.091135 23172 consensus_queue.cc:1048] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:28.091375 22527 raft_consensus.cc:1275] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:28.095242 22570 consensus_peers.cc:597] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 00284432759445f6a017e6ddb9ec1689. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:28.096051 23172 consensus_queue.cc:1048] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:28.106594 23164 raft_consensus.cc:2955] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:28.123001 22457 raft_consensus.cc:2955] T 00284432759445f6a017e6ddb9ec1689 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:28.126230 22527 raft_consensus.cc:2955] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:28.137777 22352 catalog_manager.cc:5697] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New cstate: current_term: 1 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:28.139487 23150 heartbeater.cc:499] Master 127.20.196.190:44877 was elected leader, sending a full tablet report...
I20260709 12:09:28.372601 23184 ts_tablet_manager.cc:933] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317)
I20260709 12:09:28.378449 23184 tablet_copy_client.cc:323] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270: tablet copy: Beginning tablet copy session from remote peer at address 127.20.196.129:42317
I20260709 12:09:28.420905 22467 tablet_copy_service.cc:140] P c863116d91c14d1ca50d6e8a46a37a8f: Received BeginTabletCopySession request for tablet 05f9fdee21394d6e97e0554e30632be7 from peer 8701cd5186a949538d8efafb5f987270 ({username='slave'} at 127.0.0.1:34452)
I20260709 12:09:28.421418 22467 tablet_copy_service.cc:161] P c863116d91c14d1ca50d6e8a46a37a8f: Beginning new tablet copy session on tablet 05f9fdee21394d6e97e0554e30632be7 from peer 8701cd5186a949538d8efafb5f987270 at {username='slave'} at 127.0.0.1:34452: session id = 8701cd5186a949538d8efafb5f987270-05f9fdee21394d6e97e0554e30632be7
I20260709 12:09:28.427838 22467 tablet_copy_source_session.cc:215] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:28.431396 23184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05f9fdee21394d6e97e0554e30632be7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:28.447181 23184 tablet_copy_client.cc:806] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:28.447940 23184 tablet_copy_client.cc:670] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:28.454159 23184 tablet_copy_client.cc:538] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:28.464367 23184 tablet_bootstrap.cc:492] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270: Bootstrap starting.
I20260709 12:09:28.497184 23184 tablet_bootstrap.cc:492] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:28.497985 23184 tablet_bootstrap.cc:492] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270: Bootstrap complete.
I20260709 12:09:28.498515 23184 ts_tablet_manager.cc:1403] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.017s
I20260709 12:09:28.500695 23184 raft_consensus.cc:359] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:28.501279 23184 raft_consensus.cc:740] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Initialized, Role: LEARNER
I20260709 12:09:28.501791 23184 consensus_queue.cc:260] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:28.504122 23184 ts_tablet_manager.cc:1434] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.005s
I20260709 12:09:28.505897 22467 tablet_copy_service.cc:342] P c863116d91c14d1ca50d6e8a46a37a8f: Request end of tablet copy session 8701cd5186a949538d8efafb5f987270-05f9fdee21394d6e97e0554e30632be7 received from {username='slave'} at 127.0.0.1:34452
I20260709 12:09:28.506389 22467 tablet_copy_service.cc:434] P c863116d91c14d1ca50d6e8a46a37a8f: ending tablet copy session 8701cd5186a949538d8efafb5f987270-05f9fdee21394d6e97e0554e30632be7 on tablet 05f9fdee21394d6e97e0554e30632be7 with peer 8701cd5186a949538d8efafb5f987270
I20260709 12:09:28.549185 23184 ts_tablet_manager.cc:933] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:28.550925 23184 tablet_copy_client.cc:323] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270: tablet copy: Beginning tablet copy session from remote peer at address 127.20.196.131:37785
I20260709 12:09:28.561787 22616 tablet_copy_service.cc:140] P 6c6fa11e8ee34711b3551f0c670442bc: Received BeginTabletCopySession request for tablet 13854b1cf45740e680c203d064295c78 from peer 8701cd5186a949538d8efafb5f987270 ({username='slave'} at 127.0.0.1:43070)
I20260709 12:09:28.562275 22616 tablet_copy_service.cc:161] P 6c6fa11e8ee34711b3551f0c670442bc: Beginning new tablet copy session on tablet 13854b1cf45740e680c203d064295c78 from peer 8701cd5186a949538d8efafb5f987270 at {username='slave'} at 127.0.0.1:43070: session id = 8701cd5186a949538d8efafb5f987270-13854b1cf45740e680c203d064295c78
I20260709 12:09:28.567248 22616 tablet_copy_source_session.cc:215] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:28.569706 23184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13854b1cf45740e680c203d064295c78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:28.578996 23193 ts_tablet_manager.cc:933] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:28.585984 23184 tablet_copy_client.cc:806] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:28.586623 23184 tablet_copy_client.cc:670] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:28.588513 23193 tablet_copy_client.cc:323] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270: tablet copy: Beginning tablet copy session from remote peer at address 127.20.196.131:37785
I20260709 12:09:28.590680 22615 tablet_copy_service.cc:140] P 6c6fa11e8ee34711b3551f0c670442bc: Received BeginTabletCopySession request for tablet 00284432759445f6a017e6ddb9ec1689 from peer 8701cd5186a949538d8efafb5f987270 ({username='slave'} at 127.0.0.1:43070)
I20260709 12:09:28.591266 22615 tablet_copy_service.cc:161] P 6c6fa11e8ee34711b3551f0c670442bc: Beginning new tablet copy session on tablet 00284432759445f6a017e6ddb9ec1689 from peer 8701cd5186a949538d8efafb5f987270 at {username='slave'} at 127.0.0.1:43070: session id = 8701cd5186a949538d8efafb5f987270-00284432759445f6a017e6ddb9ec1689
I20260709 12:09:28.591768 23184 tablet_copy_client.cc:538] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:28.598570 22615 tablet_copy_source_session.cc:215] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:28.600309 23184 tablet_bootstrap.cc:492] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270: Bootstrap starting.
I20260709 12:09:28.601554 23193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00284432759445f6a017e6ddb9ec1689. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:28.615865 23193 tablet_copy_client.cc:806] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:28.616438 23193 tablet_copy_client.cc:670] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:28.622232 23193 tablet_copy_client.cc:538] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:28.625948 23184 tablet_bootstrap.cc:492] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:28.626873 23184 tablet_bootstrap.cc:492] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270: Bootstrap complete.
I20260709 12:09:28.627580 23184 ts_tablet_manager.cc:1403] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.017s
I20260709 12:09:28.630746 23184 raft_consensus.cc:359] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:28.631634 23184 raft_consensus.cc:740] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Initialized, Role: LEARNER
I20260709 12:09:28.632328 23184 consensus_queue.cc:260] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:28.633729 23193 tablet_bootstrap.cc:492] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270: Bootstrap starting.
I20260709 12:09:28.636364 23184 ts_tablet_manager.cc:1434] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.005s
I20260709 12:09:28.638118 22615 tablet_copy_service.cc:342] P 6c6fa11e8ee34711b3551f0c670442bc: Request end of tablet copy session 8701cd5186a949538d8efafb5f987270-13854b1cf45740e680c203d064295c78 received from {username='slave'} at 127.0.0.1:43070
I20260709 12:09:28.638656 22615 tablet_copy_service.cc:434] P 6c6fa11e8ee34711b3551f0c670442bc: ending tablet copy session 8701cd5186a949538d8efafb5f987270-13854b1cf45740e680c203d064295c78 on tablet 13854b1cf45740e680c203d064295c78 with peer 8701cd5186a949538d8efafb5f987270
I20260709 12:09:28.639971 23196 ts_tablet_manager.cc:933] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317)
I20260709 12:09:28.658116 23196 tablet_copy_client.cc:323] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270: tablet copy: Beginning tablet copy session from remote peer at address 127.20.196.129:42317
I20260709 12:09:28.660665 22467 tablet_copy_service.cc:140] P c863116d91c14d1ca50d6e8a46a37a8f: Received BeginTabletCopySession request for tablet 6445cf83e0b646428e39f19d21ca6c44 from peer 8701cd5186a949538d8efafb5f987270 ({username='slave'} at 127.0.0.1:34452)
I20260709 12:09:28.661168 22467 tablet_copy_service.cc:161] P c863116d91c14d1ca50d6e8a46a37a8f: Beginning new tablet copy session on tablet 6445cf83e0b646428e39f19d21ca6c44 from peer 8701cd5186a949538d8efafb5f987270 at {username='slave'} at 127.0.0.1:34452: session id = 8701cd5186a949538d8efafb5f987270-6445cf83e0b646428e39f19d21ca6c44
I20260709 12:09:28.674645 22467 tablet_copy_source_session.cc:215] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:28.678905 23196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6445cf83e0b646428e39f19d21ca6c44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:28.694639 23196 tablet_copy_client.cc:806] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:28.695273 23196 tablet_copy_client.cc:670] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:28.696722 23193 tablet_bootstrap.cc:492] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:28.698724 23196 tablet_copy_client.cc:538] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:28.700053 23193 tablet_bootstrap.cc:492] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270: Bootstrap complete.
I20260709 12:09:28.700778 23193 ts_tablet_manager.cc:1403] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270: Time spent bootstrapping tablet: real 0.067s	user 0.020s	sys 0.009s
I20260709 12:09:28.704829 23193 raft_consensus.cc:359] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:28.708451 23193 raft_consensus.cc:740] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Initialized, Role: LEARNER
I20260709 12:09:28.709084 23193 consensus_queue.cc:260] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:28.711297 23193 ts_tablet_manager.cc:1434] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:09:28.711337 23196 tablet_bootstrap.cc:492] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270: Bootstrap starting.
I20260709 12:09:28.713006 22615 tablet_copy_service.cc:342] P 6c6fa11e8ee34711b3551f0c670442bc: Request end of tablet copy session 8701cd5186a949538d8efafb5f987270-00284432759445f6a017e6ddb9ec1689 received from {username='slave'} at 127.0.0.1:43070
I20260709 12:09:28.713399 22615 tablet_copy_service.cc:434] P 6c6fa11e8ee34711b3551f0c670442bc: ending tablet copy session 8701cd5186a949538d8efafb5f987270-00284432759445f6a017e6ddb9ec1689 on tablet 00284432759445f6a017e6ddb9ec1689 with peer 8701cd5186a949538d8efafb5f987270
I20260709 12:09:28.748955 23196 tablet_bootstrap.cc:492] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:28.749861 23196 tablet_bootstrap.cc:492] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270: Bootstrap complete.
I20260709 12:09:28.750526 23196 ts_tablet_manager.cc:1403] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270: Time spent bootstrapping tablet: real 0.039s	user 0.017s	sys 0.016s
I20260709 12:09:28.753365 23196 raft_consensus.cc:359] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:28.754197 23196 raft_consensus.cc:740] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Initialized, Role: LEARNER
I20260709 12:09:28.754861 23196 consensus_queue.cc:260] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:28.757150 23196 ts_tablet_manager.cc:1434] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:09:28.758771 22467 tablet_copy_service.cc:342] P c863116d91c14d1ca50d6e8a46a37a8f: Request end of tablet copy session 8701cd5186a949538d8efafb5f987270-6445cf83e0b646428e39f19d21ca6c44 received from {username='slave'} at 127.0.0.1:34452
I20260709 12:09:28.759218 22467 tablet_copy_service.cc:434] P c863116d91c14d1ca50d6e8a46a37a8f: ending tablet copy session 8701cd5186a949538d8efafb5f987270-6445cf83e0b646428e39f19d21ca6c44 on tablet 6445cf83e0b646428e39f19d21ca6c44 with peer 8701cd5186a949538d8efafb5f987270
I20260709 12:09:28.942476 23125 raft_consensus.cc:1217] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:29.052148 23125 raft_consensus.cc:1217] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:29.113322 23125 raft_consensus.cc:1217] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:29.202224 23125 raft_consensus.cc:1217] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:29.514770 23203 raft_consensus.cc:1064] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
I20260709 12:09:29.517213 23203 consensus_queue.cc:237] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:29.523746 23164 raft_consensus.cc:1064] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
I20260709 12:09:29.526224 23164 consensus_queue.cc:237] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:29.532039 23125 raft_consensus.cc:1275] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:29.534052 22602 raft_consensus.cc:1275] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:29.536350 23162 consensus_queue.cc:1048] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:29.537901 23165 consensus_queue.cc:1048] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:29.538552 22452 raft_consensus.cc:1275] T 13854b1cf45740e680c203d064295c78 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:29.539119 23125 raft_consensus.cc:1275] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:29.544564 22527 raft_consensus.cc:1275] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:29.547060 22527 raft_consensus.cc:1275] T 05f9fdee21394d6e97e0554e30632be7 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:29.548709 23202 consensus_queue.cc:1048] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:29.550554 23202 consensus_queue.cc:1048] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:29.553118 23198 consensus_queue.cc:1048] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:29.565557 23203 consensus_queue.cc:1048] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:29.590286 23198 raft_consensus.cc:2955] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:29.591972 22527 raft_consensus.cc:2955] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:29.594448 23203 raft_consensus.cc:2955] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:29.608652 22527 raft_consensus.cc:2955] T 05f9fdee21394d6e97e0554e30632be7 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:29.610136 22351 catalog_manager.cc:5697] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:29.614368 22452 raft_consensus.cc:2955] T 13854b1cf45740e680c203d064295c78 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:29.615173 23124 raft_consensus.cc:2955] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:29.629310 22352 catalog_manager.cc:5697] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:29.644052 23124 raft_consensus.cc:2955] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:29.659953 22601 raft_consensus.cc:2955] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:29.692143 23201 raft_consensus.cc:1064] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
I20260709 12:09:29.695067 23201 consensus_queue.cc:237] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:29.710505 22602 raft_consensus.cc:1275] T 6445cf83e0b646428e39f19d21ca6c44 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:29.711719 23124 raft_consensus.cc:1275] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:29.715679 23165 consensus_queue.cc:1048] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:29.717213 23162 consensus_queue.cc:1048] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:29.725430 22527 raft_consensus.cc:1275] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:29.731817 23203 consensus_queue.cc:1048] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:29.750690 23198 raft_consensus.cc:1064] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
I20260709 12:09:29.755954 23198 consensus_queue.cc:237] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:29.771277 23124 raft_consensus.cc:1275] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:29.770229 23203 raft_consensus.cc:2955] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:29.776388 22527 raft_consensus.cc:1275] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:29.777866 23198 consensus_queue.cc:1048] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:29.777935 22527 raft_consensus.cc:2955] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:29.781423 22602 raft_consensus.cc:2955] T 6445cf83e0b646428e39f19d21ca6c44 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:29.789463 23202 consensus_queue.cc:1048] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:29.791170 22452 raft_consensus.cc:1275] T 00284432759445f6a017e6ddb9ec1689 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:29.793078 23202 consensus_queue.cc:1048] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:29.809437 23202 raft_consensus.cc:2955] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:29.813716 23125 raft_consensus.cc:2955] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:29.825762 23124 raft_consensus.cc:2955] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:29.827167 22602 consensus_queue.cc:237] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:29.830086 22452 raft_consensus.cc:2955] T 00284432759445f6a017e6ddb9ec1689 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:29.841441 23123 raft_consensus.cc:1275] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:29.842903 23164 consensus_queue.cc:1048] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:29.843847 22527 raft_consensus.cc:1275] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:29.848711 23198 consensus_queue.cc:1048] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:29.869565 22351 catalog_manager.cc:5697] T 6445cf83e0b646428e39f19d21ca6c44 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:29.861374 23202 raft_consensus.cc:2955] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:29.888782 22532 raft_consensus.cc:2955] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:29.898132 23124 raft_consensus.cc:2955] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:29.899767 22352 catalog_manager.cc:5697] T 00284432759445f6a017e6ddb9ec1689 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:29.913090 22529 raft_consensus.cc:2955] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:29.923272 22452 consensus_queue.cc:237] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:29.928902 22603 raft_consensus.cc:1275] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:29.930718 23165 consensus_queue.cc:1048] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:09:29.937533 22601 consensus_queue.cc:237] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:29.938181 22341 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 13854b1cf45740e680c203d064295c78 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:29.939289 23124 raft_consensus.cc:1275] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:29.940303 23203 raft_consensus.cc:2955] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:29.941443 23162 consensus_queue.cc:1048] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:29.947538 22603 raft_consensus.cc:2955] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:29.945989 23125 raft_consensus.cc:2955] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:29.965150 22339 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 05f9fdee21394d6e97e0554e30632be7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:29.966321 23124 raft_consensus.cc:1275] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:29.966763 22351 catalog_manager.cc:5697] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: config changed from index 3 to 4, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New cstate: current_term: 1 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:29.967931 23202 consensus_queue.cc:1048] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:29.975296 22452 consensus_queue.cc:237] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:29.978228 22442 tablet_service.cc:1558] Processing DeleteTablet for tablet 13854b1cf45740e680c203d064295c78 with delete_type TABLET_DATA_TOMBSTONED (TS c863116d91c14d1ca50d6e8a46a37a8f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51832
I20260709 12:09:29.980381 23123 raft_consensus.cc:1275] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:29.980489 22527 raft_consensus.cc:1275] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:29.983029 23165 consensus_queue.cc:1048] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:29.984850 23226 consensus_queue.cc:1048] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:29.994728 23201 raft_consensus.cc:2955] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:29.997669 22354 catalog_manager.cc:5697] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: config changed from index 3 to 4, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:30.003010 23123 raft_consensus.cc:2955] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:30.013516 22517 tablet_service.cc:1558] Processing DeleteTablet for tablet 05f9fdee21394d6e97e0554e30632be7 with delete_type TABLET_DATA_TOMBSTONED (TS 1676e7af5e4a47cb86ee7db83e3d4881 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56928
I20260709 12:09:30.016263 23229 tablet_replica.cc:333] T 13854b1cf45740e680c203d064295c78 P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:09:30.021371 23229 raft_consensus.cc:2243] T 13854b1cf45740e680c203d064295c78 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:30.022440 23229 raft_consensus.cc:2272] T 13854b1cf45740e680c203d064295c78 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:30.023666 22339 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6445cf83e0b646428e39f19d21ca6c44 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:30.025662 23202 raft_consensus.cc:2955] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:30.028946 23229 ts_tablet_manager.cc:1916] T 13854b1cf45740e680c203d064295c78 P c863116d91c14d1ca50d6e8a46a37a8f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:30.033002 23125 raft_consensus.cc:2955] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:30.038154 23230 tablet_replica.cc:333] T 05f9fdee21394d6e97e0554e30632be7 P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:09:30.039170 23230 raft_consensus.cc:2243] T 05f9fdee21394d6e97e0554e30632be7 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:30.052843 23230 raft_consensus.cc:2272] T 05f9fdee21394d6e97e0554e30632be7 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:30.061686 23230 ts_tablet_manager.cc:1916] T 05f9fdee21394d6e97e0554e30632be7 P 1676e7af5e4a47cb86ee7db83e3d4881: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:30.068408 23229 ts_tablet_manager.cc:1929] T 13854b1cf45740e680c203d064295c78 P c863116d91c14d1ca50d6e8a46a37a8f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:30.070163 22529 raft_consensus.cc:2955] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:30.081681 22354 catalog_manager.cc:5697] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 reported cstate change: config changed from index 3 to 4, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:30.084071 22354 catalog_manager.cc:5697] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 reported cstate change: config changed from index 3 to 4, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New cstate: current_term: 1 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:30.086041 23230 ts_tablet_manager.cc:1929] T 05f9fdee21394d6e97e0554e30632be7 P 1676e7af5e4a47cb86ee7db83e3d4881: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:30.086547 23230 log.cc:1199] T 05f9fdee21394d6e97e0554e30632be7 P 1676e7af5e4a47cb86ee7db83e3d4881: Deleting WAL directory at /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-1-root/wals/05f9fdee21394d6e97e0554e30632be7
I20260709 12:09:30.089931 22340 catalog_manager.cc:5028] TS 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): tablet 05f9fdee21394d6e97e0554e30632be7 (table test-workload [id=1e73b97ba677488c8829a696096f4885]) successfully deleted
I20260709 12:09:30.099187 23229 log.cc:1199] T 13854b1cf45740e680c203d064295c78 P c863116d91c14d1ca50d6e8a46a37a8f: Deleting WAL directory at /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-0-root/wals/13854b1cf45740e680c203d064295c78
I20260709 12:09:30.103746 22341 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 00284432759445f6a017e6ddb9ec1689 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:30.107059 22594 tablet_service.cc:1558] Processing DeleteTablet for tablet 6445cf83e0b646428e39f19d21ca6c44 with delete_type TABLET_DATA_TOMBSTONED (TS 6c6fa11e8ee34711b3551f0c670442bc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45546
I20260709 12:09:30.108049 22339 catalog_manager.cc:5028] TS c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): tablet 13854b1cf45740e680c203d064295c78 (table test-workload [id=1e73b97ba677488c8829a696096f4885]) successfully deleted
I20260709 12:09:30.109489 22529 raft_consensus.cc:1275] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:30.111017 22442 tablet_service.cc:1558] Processing DeleteTablet for tablet 00284432759445f6a017e6ddb9ec1689 with delete_type TABLET_DATA_TOMBSTONED (TS c863116d91c14d1ca50d6e8a46a37a8f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51832
I20260709 12:09:30.112536 23229 tablet_replica.cc:333] T 00284432759445f6a017e6ddb9ec1689 P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:09:30.114511 23201 consensus_queue.cc:1048] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:30.117759 23234 tablet_replica.cc:333] T 6445cf83e0b646428e39f19d21ca6c44 P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:09:30.120410 23234 raft_consensus.cc:2243] T 6445cf83e0b646428e39f19d21ca6c44 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:30.121089 23234 raft_consensus.cc:2272] T 6445cf83e0b646428e39f19d21ca6c44 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:30.127506 23234 ts_tablet_manager.cc:1916] T 6445cf83e0b646428e39f19d21ca6c44 P 6c6fa11e8ee34711b3551f0c670442bc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:30.129544 22529 raft_consensus.cc:2955] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:30.145931 23234 ts_tablet_manager.cc:1929] T 6445cf83e0b646428e39f19d21ca6c44 P 6c6fa11e8ee34711b3551f0c670442bc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:30.146399 23234 log.cc:1199] T 6445cf83e0b646428e39f19d21ca6c44 P 6c6fa11e8ee34711b3551f0c670442bc: Deleting WAL directory at /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-2-root/wals/6445cf83e0b646428e39f19d21ca6c44
I20260709 12:09:30.147936 22341 catalog_manager.cc:5028] TS 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): tablet 6445cf83e0b646428e39f19d21ca6c44 (table test-workload [id=1e73b97ba677488c8829a696096f4885]) successfully deleted
I20260709 12:09:30.150794 23229 raft_consensus.cc:2243] T 00284432759445f6a017e6ddb9ec1689 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:30.151571 23229 raft_consensus.cc:2272] T 00284432759445f6a017e6ddb9ec1689 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:30.155028 23229 ts_tablet_manager.cc:1916] T 00284432759445f6a017e6ddb9ec1689 P c863116d91c14d1ca50d6e8a46a37a8f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:30.167258 23229 ts_tablet_manager.cc:1929] T 00284432759445f6a017e6ddb9ec1689 P c863116d91c14d1ca50d6e8a46a37a8f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:30.167593 23229 log.cc:1199] T 00284432759445f6a017e6ddb9ec1689 P c863116d91c14d1ca50d6e8a46a37a8f: Deleting WAL directory at /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-0-root/wals/00284432759445f6a017e6ddb9ec1689
I20260709 12:09:30.169020 22339 catalog_manager.cc:5028] TS c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): tablet 00284432759445f6a017e6ddb9ec1689 (table test-workload [id=1e73b97ba677488c8829a696096f4885]) successfully deleted
I20260709 12:09:31.181548 22457 consensus_queue.cc:237] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:31.187582 22602 raft_consensus.cc:1275] T ee3ba2f54b0343bea5e3a5364c372a89 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:31.187722 22529 raft_consensus.cc:1275] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:31.188150 22421 consensus_peers.cc:597] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ee3ba2f54b0343bea5e3a5364c372a89. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:31.189018 23201 consensus_queue.cc:1048] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:31.189873 23236 consensus_queue.cc:1048] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:31.197034 23165 raft_consensus.cc:2955] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:31.207149 22529 raft_consensus.cc:2955] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:31.222769 22352 catalog_manager.cc:5697] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:31.230055 23202 consensus_queue.cc:1175] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 12:09:31.231359 22602 consensus_queue.cc:237] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
W20260709 12:09:31.242930 22570 consensus_peers.cc:597] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9b31ce17d24644c19dbf9469c435d149. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:31.243216 22603 raft_consensus.cc:2955] T ee3ba2f54b0343bea5e3a5364c372a89 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:31.244400 22529 raft_consensus.cc:1275] T 9b31ce17d24644c19dbf9469c435d149 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:31.244400 22452 raft_consensus.cc:1275] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:31.246542 23226 consensus_queue.cc:1048] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:31.247354 23202 consensus_queue.cc:1048] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:31.271772 23202 raft_consensus.cc:2955] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:31.274189 22529 raft_consensus.cc:2955] T 9b31ce17d24644c19dbf9469c435d149 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:31.280012 22452 raft_consensus.cc:2955] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:31.292091 22352 catalog_manager.cc:5697] T 9b31ce17d24644c19dbf9469c435d149 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New cstate: current_term: 1 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:31.291873 22452 consensus_queue.cc:237] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
W20260709 12:09:31.302711 22421 consensus_peers.cc:597] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f007f8ed533640a9a25704c288c49f3c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:31.302868 22603 raft_consensus.cc:1275] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:31.304152 22529 raft_consensus.cc:1275] T f007f8ed533640a9a25704c288c49f3c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:31.308135 23239 consensus_queue.cc:1048] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:31.309203 23201 consensus_queue.cc:1048] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:31.319404 23236 raft_consensus.cc:2955] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:31.322225 22602 raft_consensus.cc:2955] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:31.327338 22529 raft_consensus.cc:2955] T f007f8ed533640a9a25704c288c49f3c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:31.345815 22353 catalog_manager.cc:5697] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:31.371755 22529 consensus_queue.cc:237] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:31.378949 22602 raft_consensus.cc:1275] T 62319c9e82134e7daf8a46f78c124bff P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:31.380453 23170 consensus_queue.cc:1048] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:31.380990 22452 raft_consensus.cc:1275] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:31.387115 23170 consensus_queue.cc:1048] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:31.407498 23096 raft_consensus.cc:2955] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
W20260709 12:09:31.420135 22496 consensus_peers.cc:597] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 62319c9e82134e7daf8a46f78c124bff. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:31.419471 22603 raft_consensus.cc:2955] T 62319c9e82134e7daf8a46f78c124bff P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:31.444342 22452 raft_consensus.cc:2955] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:31.455675 22354 catalog_manager.cc:5697] T 62319c9e82134e7daf8a46f78c124bff P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:31.628278 23263 ts_tablet_manager.cc:933] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:31.630203 23263 tablet_copy_client.cc:323] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270: tablet copy: Beginning tablet copy session from remote peer at address 127.20.196.131:37785
I20260709 12:09:31.631850 22615 tablet_copy_service.cc:140] P 6c6fa11e8ee34711b3551f0c670442bc: Received BeginTabletCopySession request for tablet 9b31ce17d24644c19dbf9469c435d149 from peer 8701cd5186a949538d8efafb5f987270 ({username='slave'} at 127.0.0.1:43070)
I20260709 12:09:31.632481 22615 tablet_copy_service.cc:161] P 6c6fa11e8ee34711b3551f0c670442bc: Beginning new tablet copy session on tablet 9b31ce17d24644c19dbf9469c435d149 from peer 8701cd5186a949538d8efafb5f987270 at {username='slave'} at 127.0.0.1:43070: session id = 8701cd5186a949538d8efafb5f987270-9b31ce17d24644c19dbf9469c435d149
I20260709 12:09:31.639427 22615 tablet_copy_source_session.cc:215] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:31.642318 23263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b31ce17d24644c19dbf9469c435d149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:31.656064 23263 tablet_copy_client.cc:806] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:31.656654 23263 tablet_copy_client.cc:670] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:31.662457 23263 tablet_copy_client.cc:538] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:31.672614 23263 tablet_bootstrap.cc:492] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270: Bootstrap starting.
I20260709 12:09:31.693442 23263 tablet_bootstrap.cc:492] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:31.694368 23263 tablet_bootstrap.cc:492] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270: Bootstrap complete.
I20260709 12:09:31.695070 23263 ts_tablet_manager.cc:1403] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270: Time spent bootstrapping tablet: real 0.023s	user 0.022s	sys 0.001s
I20260709 12:09:31.697912 23263 raft_consensus.cc:359] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:31.698767 23263 raft_consensus.cc:740] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Initialized, Role: LEARNER
I20260709 12:09:31.699462 23263 consensus_queue.cc:260] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:31.703514 23263 ts_tablet_manager.cc:1434] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:09:31.705468 22615 tablet_copy_service.cc:342] P 6c6fa11e8ee34711b3551f0c670442bc: Request end of tablet copy session 8701cd5186a949538d8efafb5f987270-9b31ce17d24644c19dbf9469c435d149 received from {username='slave'} at 127.0.0.1:43070
I20260709 12:09:31.705888 22615 tablet_copy_service.cc:434] P 6c6fa11e8ee34711b3551f0c670442bc: ending tablet copy session 8701cd5186a949538d8efafb5f987270-9b31ce17d24644c19dbf9469c435d149 on tablet 9b31ce17d24644c19dbf9469c435d149 with peer 8701cd5186a949538d8efafb5f987270
I20260709 12:09:31.724076 23263 ts_tablet_manager.cc:933] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317)
I20260709 12:09:31.725647 23263 tablet_copy_client.cc:323] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270: tablet copy: Beginning tablet copy session from remote peer at address 127.20.196.129:42317
I20260709 12:09:31.727450 22467 tablet_copy_service.cc:140] P c863116d91c14d1ca50d6e8a46a37a8f: Received BeginTabletCopySession request for tablet ee3ba2f54b0343bea5e3a5364c372a89 from peer 8701cd5186a949538d8efafb5f987270 ({username='slave'} at 127.0.0.1:34452)
I20260709 12:09:31.727980 22467 tablet_copy_service.cc:161] P c863116d91c14d1ca50d6e8a46a37a8f: Beginning new tablet copy session on tablet ee3ba2f54b0343bea5e3a5364c372a89 from peer 8701cd5186a949538d8efafb5f987270 at {username='slave'} at 127.0.0.1:34452: session id = 8701cd5186a949538d8efafb5f987270-ee3ba2f54b0343bea5e3a5364c372a89
I20260709 12:09:31.734102 22467 tablet_copy_source_session.cc:215] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:31.736999 23263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee3ba2f54b0343bea5e3a5364c372a89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:31.748580 23263 tablet_copy_client.cc:806] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:31.749374 23263 tablet_copy_client.cc:670] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:31.754252 23263 tablet_copy_client.cc:538] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:31.769115 23263 tablet_bootstrap.cc:492] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270: Bootstrap starting.
I20260709 12:09:31.796636 23268 ts_tablet_manager.cc:933] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317)
I20260709 12:09:31.818028 23268 tablet_copy_client.cc:323] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270: tablet copy: Beginning tablet copy session from remote peer at address 127.20.196.129:42317
I20260709 12:09:31.819835 22467 tablet_copy_service.cc:140] P c863116d91c14d1ca50d6e8a46a37a8f: Received BeginTabletCopySession request for tablet f007f8ed533640a9a25704c288c49f3c from peer 8701cd5186a949538d8efafb5f987270 ({username='slave'} at 127.0.0.1:34452)
I20260709 12:09:31.820360 22467 tablet_copy_service.cc:161] P c863116d91c14d1ca50d6e8a46a37a8f: Beginning new tablet copy session on tablet f007f8ed533640a9a25704c288c49f3c from peer 8701cd5186a949538d8efafb5f987270 at {username='slave'} at 127.0.0.1:34452: session id = 8701cd5186a949538d8efafb5f987270-f007f8ed533640a9a25704c288c49f3c
I20260709 12:09:31.826050 23263 tablet_bootstrap.cc:492] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:31.827069 23263 tablet_bootstrap.cc:492] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270: Bootstrap complete.
I20260709 12:09:31.827703 23263 ts_tablet_manager.cc:1403] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270: Time spent bootstrapping tablet: real 0.059s	user 0.028s	sys 0.000s
I20260709 12:09:31.827798 22467 tablet_copy_source_session.cc:215] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:31.830551 23268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f007f8ed533640a9a25704c288c49f3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:31.830824 23263 raft_consensus.cc:359] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:31.831709 23263 raft_consensus.cc:740] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Initialized, Role: LEARNER
I20260709 12:09:31.832336 23263 consensus_queue.cc:260] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:31.834647 23263 ts_tablet_manager.cc:1434] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:09:31.839280 22467 tablet_copy_service.cc:342] P c863116d91c14d1ca50d6e8a46a37a8f: Request end of tablet copy session 8701cd5186a949538d8efafb5f987270-ee3ba2f54b0343bea5e3a5364c372a89 received from {username='slave'} at 127.0.0.1:34452
I20260709 12:09:31.839792 22467 tablet_copy_service.cc:434] P c863116d91c14d1ca50d6e8a46a37a8f: ending tablet copy session 8701cd5186a949538d8efafb5f987270-ee3ba2f54b0343bea5e3a5364c372a89 on tablet ee3ba2f54b0343bea5e3a5364c372a89 with peer 8701cd5186a949538d8efafb5f987270
I20260709 12:09:31.848675 23268 tablet_copy_client.cc:806] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:31.849484 23268 tablet_copy_client.cc:670] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:31.851143 23263 ts_tablet_manager.cc:933] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:31.853849 23268 tablet_copy_client.cc:538] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:31.855682 23263 tablet_copy_client.cc:323] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270: tablet copy: Beginning tablet copy session from remote peer at address 127.20.196.130:42733
I20260709 12:09:31.863142 23268 tablet_bootstrap.cc:492] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270: Bootstrap starting.
I20260709 12:09:31.883901 23268 tablet_bootstrap.cc:492] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:31.884817 23268 tablet_bootstrap.cc:492] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270: Bootstrap complete.
I20260709 12:09:31.885808 23268 ts_tablet_manager.cc:1403] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270: Time spent bootstrapping tablet: real 0.023s	user 0.020s	sys 0.003s
I20260709 12:09:31.887904 22542 tablet_copy_service.cc:140] P 1676e7af5e4a47cb86ee7db83e3d4881: Received BeginTabletCopySession request for tablet 62319c9e82134e7daf8a46f78c124bff from peer 8701cd5186a949538d8efafb5f987270 ({username='slave'} at 127.0.0.1:38310)
I20260709 12:09:31.888504 22542 tablet_copy_service.cc:161] P 1676e7af5e4a47cb86ee7db83e3d4881: Beginning new tablet copy session on tablet 62319c9e82134e7daf8a46f78c124bff from peer 8701cd5186a949538d8efafb5f987270 at {username='slave'} at 127.0.0.1:38310: session id = 8701cd5186a949538d8efafb5f987270-62319c9e82134e7daf8a46f78c124bff
I20260709 12:09:31.888741 23268 raft_consensus.cc:359] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:31.889595 23268 raft_consensus.cc:740] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Initialized, Role: LEARNER
I20260709 12:09:31.890513 23268 consensus_queue.cc:260] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:31.893321 23268 ts_tablet_manager.cc:1434] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.002s
I20260709 12:09:31.894953 22467 tablet_copy_service.cc:342] P c863116d91c14d1ca50d6e8a46a37a8f: Request end of tablet copy session 8701cd5186a949538d8efafb5f987270-f007f8ed533640a9a25704c288c49f3c received from {username='slave'} at 127.0.0.1:34452
I20260709 12:09:31.895355 22467 tablet_copy_service.cc:434] P c863116d91c14d1ca50d6e8a46a37a8f: ending tablet copy session 8701cd5186a949538d8efafb5f987270-f007f8ed533640a9a25704c288c49f3c on tablet f007f8ed533640a9a25704c288c49f3c with peer 8701cd5186a949538d8efafb5f987270
I20260709 12:09:31.896216 22542 tablet_copy_source_session.cc:215] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:31.899662 23263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62319c9e82134e7daf8a46f78c124bff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:31.914378 23263 tablet_copy_client.cc:806] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:31.914893 23263 tablet_copy_client.cc:670] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:31.918907 23263 tablet_copy_client.cc:538] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:31.926065 23263 tablet_bootstrap.cc:492] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270: Bootstrap starting.
I20260709 12:09:31.946368 23263 tablet_bootstrap.cc:492] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:31.948226 23263 tablet_bootstrap.cc:492] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270: Bootstrap complete.
I20260709 12:09:31.948980 23263 ts_tablet_manager.cc:1403] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.004s
I20260709 12:09:31.951756 23263 raft_consensus.cc:359] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:31.952641 23263 raft_consensus.cc:740] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Initialized, Role: LEARNER
I20260709 12:09:31.953550 23263 consensus_queue.cc:260] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:31.956295 23263 ts_tablet_manager.cc:1434] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:31.958019 22542 tablet_copy_service.cc:342] P 1676e7af5e4a47cb86ee7db83e3d4881: Request end of tablet copy session 8701cd5186a949538d8efafb5f987270-62319c9e82134e7daf8a46f78c124bff received from {username='slave'} at 127.0.0.1:38310
I20260709 12:09:31.958488 22542 tablet_copy_service.cc:434] P 1676e7af5e4a47cb86ee7db83e3d4881: ending tablet copy session 8701cd5186a949538d8efafb5f987270-62319c9e82134e7daf8a46f78c124bff on tablet 62319c9e82134e7daf8a46f78c124bff with peer 8701cd5186a949538d8efafb5f987270
I20260709 12:09:32.136511 23125 raft_consensus.cc:1217] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:32.155633 23125 raft_consensus.cc:1217] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:32.176262 23125 raft_consensus.cc:1217] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:32.375352 23125 raft_consensus.cc:1217] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:32.627951 23276 raft_consensus.cc:1064] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
I20260709 12:09:32.630012 23276 consensus_queue.cc:237] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:32.642598 23125 raft_consensus.cc:1275] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:32.645268 22455 raft_consensus.cc:1275] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:32.645109 23202 consensus_queue.cc:1048] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:32.650108 23202 consensus_queue.cc:1048] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:32.651113 22532 raft_consensus.cc:1275] T 9b31ce17d24644c19dbf9469c435d149 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:32.652688 23226 consensus_queue.cc:1048] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:32.663585 23226 raft_consensus.cc:2955] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:32.667201 22532 raft_consensus.cc:2955] T 9b31ce17d24644c19dbf9469c435d149 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:32.671602 22455 raft_consensus.cc:2955] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:32.685194 22354 catalog_manager.cc:5697] T 9b31ce17d24644c19dbf9469c435d149 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:32.690376 23125 raft_consensus.cc:2955] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:32.720503 23236 raft_consensus.cc:1064] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
I20260709 12:09:32.722337 22602 consensus_queue.cc:237] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:32.722892 23236 consensus_queue.cc:237] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:32.728775 23125 raft_consensus.cc:1275] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:32.730195 23226 consensus_queue.cc:1048] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:32.736308 22455 raft_consensus.cc:1275] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:32.737454 23226 consensus_queue.cc:1048] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:32.737140 23202 raft_consensus.cc:2955] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:32.740736 23123 raft_consensus.cc:2955] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:32.747207 22341 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9b31ce17d24644c19dbf9469c435d149 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:32.750370 22455 raft_consensus.cc:2955] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:32.755643 22352 catalog_manager.cc:5697] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: config changed from index 3 to 4, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New cstate: current_term: 1 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:32.772377 23239 raft_consensus.cc:1064] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
I20260709 12:09:32.774703 23239 consensus_queue.cc:237] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:32.778023 22517 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b31ce17d24644c19dbf9469c435d149 with delete_type TABLET_DATA_TOMBSTONED (TS 1676e7af5e4a47cb86ee7db83e3d4881 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56928
I20260709 12:09:32.785403 23123 raft_consensus.cc:1275] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:32.785946 23288 tablet_replica.cc:333] T 9b31ce17d24644c19dbf9469c435d149 P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:09:32.786953 23288 raft_consensus.cc:2243] T 9b31ce17d24644c19dbf9469c435d149 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:32.790238 23288 raft_consensus.cc:2272] T 9b31ce17d24644c19dbf9469c435d149 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:32.794896 22527 raft_consensus.cc:1275] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:32.790562 22602 raft_consensus.cc:1275] T ee3ba2f54b0343bea5e3a5364c372a89 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:32.797204 23287 consensus_queue.cc:1048] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:32.801112 23285 consensus_queue.cc:1048] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:32.805954 23291 consensus_queue.cc:1048] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:32.808024 23288 ts_tablet_manager.cc:1916] T 9b31ce17d24644c19dbf9469c435d149 P 1676e7af5e4a47cb86ee7db83e3d4881: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:32.810794 23123 raft_consensus.cc:1275] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:32.812143 22601 raft_consensus.cc:1275] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:32.812798 22527 raft_consensus.cc:1275] T f007f8ed533640a9a25704c288c49f3c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:32.818399 23290 consensus_queue.cc:1048] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:32.819437 23287 consensus_queue.cc:1048] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:32.822916 23285 consensus_queue.cc:1048] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:32.875290 23285 raft_consensus.cc:2955] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:32.878098 23292 raft_consensus.cc:2955] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:32.892912 23288 ts_tablet_manager.cc:1929] T 9b31ce17d24644c19dbf9469c435d149 P 1676e7af5e4a47cb86ee7db83e3d4881: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:32.893357 23288 log.cc:1199] T 9b31ce17d24644c19dbf9469c435d149 P 1676e7af5e4a47cb86ee7db83e3d4881: Deleting WAL directory at /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-1-root/wals/9b31ce17d24644c19dbf9469c435d149
I20260709 12:09:32.893739 22352 catalog_manager.cc:5697] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:32.895578 22602 raft_consensus.cc:2955] T ee3ba2f54b0343bea5e3a5364c372a89 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:32.899732 22340 catalog_manager.cc:5028] TS 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): tablet 9b31ce17d24644c19dbf9469c435d149 (table test-workload [id=1e73b97ba677488c8829a696096f4885]) successfully deleted
I20260709 12:09:32.903385 23123 raft_consensus.cc:2955] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:32.909705 22529 raft_consensus.cc:2955] T f007f8ed533640a9a25704c288c49f3c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:32.923926 22532 raft_consensus.cc:2955] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:32.923972 23125 raft_consensus.cc:2955] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:32.935746 22603 raft_consensus.cc:2955] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:32.938207 22352 catalog_manager.cc:5697] T f007f8ed533640a9a25704c288c49f3c P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:32.963016 22452 consensus_queue.cc:237] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:32.966353 23170 raft_consensus.cc:1064] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
I20260709 12:09:32.968611 23170 consensus_queue.cc:237] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:32.962895 22457 consensus_queue.cc:237] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:32.976024 23123 raft_consensus.cc:1275] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:32.979907 23292 consensus_queue.cc:1048] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:32.978921 22602 raft_consensus.cc:1275] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:32.984920 23292 consensus_queue.cc:1048] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:32.990085 22532 raft_consensus.cc:1275] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:32.990774 23125 raft_consensus.cc:1275] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:32.992473 23290 raft_consensus.cc:2955] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:32.993875 23236 consensus_queue.cc:1048] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:32.995976 23236 consensus_queue.cc:1048] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:33.001739 23125 raft_consensus.cc:2955] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:33.007618 23285 raft_consensus.cc:2955] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:33.011574 22527 raft_consensus.cc:2955] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:33.018003 22352 catalog_manager.cc:5697] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 reported cstate change: config changed from index 3 to 4, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:33.029506 22603 raft_consensus.cc:2955] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:33.032186 22339 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ee3ba2f54b0343bea5e3a5364c372a89 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:33.036085 22517 tablet_service.cc:1558] Processing DeleteTablet for tablet f007f8ed533640a9a25704c288c49f3c with delete_type TABLET_DATA_TOMBSTONED (TS 1676e7af5e4a47cb86ee7db83e3d4881 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56928
I20260709 12:09:33.037400 22353 catalog_manager.cc:5697] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: config changed from index 3 to 4, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:33.047361 23123 raft_consensus.cc:1275] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:33.047868 22604 raft_consensus.cc:1275] T 62319c9e82134e7daf8a46f78c124bff P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:33.038901 23288 tablet_replica.cc:333] T f007f8ed533640a9a25704c288c49f3c P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:09:33.049264 23288 raft_consensus.cc:2243] T f007f8ed533640a9a25704c288c49f3c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:33.049341 22457 raft_consensus.cc:1275] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:33.049950 23288 raft_consensus.cc:2272] T f007f8ed533640a9a25704c288c49f3c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:33.049621 23261 consensus_queue.cc:1048] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:33.054160 23260 consensus_queue.cc:1048] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:33.061448 23288 ts_tablet_manager.cc:1916] T f007f8ed533640a9a25704c288c49f3c P 1676e7af5e4a47cb86ee7db83e3d4881: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:33.063933 23170 consensus_queue.cc:1048] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:33.079993 22594 tablet_service.cc:1558] Processing DeleteTablet for tablet ee3ba2f54b0343bea5e3a5364c372a89 with delete_type TABLET_DATA_TOMBSTONED (TS 6c6fa11e8ee34711b3551f0c670442bc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45546
I20260709 12:09:33.038137 23125 raft_consensus.cc:2955] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:33.041958 22339 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f007f8ed533640a9a25704c288c49f3c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:33.120848 23300 raft_consensus.cc:2955] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:33.122316 23125 raft_consensus.cc:2955] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:33.124279 23288 ts_tablet_manager.cc:1929] T f007f8ed533640a9a25704c288c49f3c P 1676e7af5e4a47cb86ee7db83e3d4881: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:33.124744 23288 log.cc:1199] T f007f8ed533640a9a25704c288c49f3c P 1676e7af5e4a47cb86ee7db83e3d4881: Deleting WAL directory at /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-1-root/wals/f007f8ed533640a9a25704c288c49f3c
I20260709 12:09:33.126371 22340 catalog_manager.cc:5028] TS 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): tablet f007f8ed533640a9a25704c288c49f3c (table test-workload [id=1e73b97ba677488c8829a696096f4885]) successfully deleted
I20260709 12:09:33.128119 23303 tablet_replica.cc:333] T ee3ba2f54b0343bea5e3a5364c372a89 P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:09:33.136729 22603 raft_consensus.cc:2955] T 62319c9e82134e7daf8a46f78c124bff P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:33.143781 22351 catalog_manager.cc:5697] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 reported cstate change: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:33.144373 22452 raft_consensus.cc:2955] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:33.165614 23303 raft_consensus.cc:2243] T ee3ba2f54b0343bea5e3a5364c372a89 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:33.168143 23303 raft_consensus.cc:2272] T ee3ba2f54b0343bea5e3a5364c372a89 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:33.170950 23303 ts_tablet_manager.cc:1916] T ee3ba2f54b0343bea5e3a5364c372a89 P 6c6fa11e8ee34711b3551f0c670442bc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:33.199172 23303 ts_tablet_manager.cc:1929] T ee3ba2f54b0343bea5e3a5364c372a89 P 6c6fa11e8ee34711b3551f0c670442bc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:33.199580 23303 log.cc:1199] T ee3ba2f54b0343bea5e3a5364c372a89 P 6c6fa11e8ee34711b3551f0c670442bc: Deleting WAL directory at /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-2-root/wals/ee3ba2f54b0343bea5e3a5364c372a89
I20260709 12:09:33.201234 22341 catalog_manager.cc:5028] TS 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): tablet ee3ba2f54b0343bea5e3a5364c372a89 (table test-workload [id=1e73b97ba677488c8829a696096f4885]) successfully deleted
I20260709 12:09:33.207020 22532 consensus_queue.cc:237] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:33.211647 23125 raft_consensus.cc:1275] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:33.211642 22452 raft_consensus.cc:1275] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:33.212879 23300 consensus_queue.cc:1048] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:33.213778 23170 consensus_queue.cc:1048] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:33.219877 23170 raft_consensus.cc:2955] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:33.231974 22340 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 62319c9e82134e7daf8a46f78c124bff with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:33.237932 23125 raft_consensus.cc:2955] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:33.237677 22452 raft_consensus.cc:2955] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:33.257308 22353 catalog_manager.cc:5697] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 reported cstate change: config changed from index 3 to 4, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:33.271584 22594 tablet_service.cc:1558] Processing DeleteTablet for tablet 62319c9e82134e7daf8a46f78c124bff with delete_type TABLET_DATA_TOMBSTONED (TS 6c6fa11e8ee34711b3551f0c670442bc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45546
I20260709 12:09:33.274960 23303 tablet_replica.cc:333] T 62319c9e82134e7daf8a46f78c124bff P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:09:33.276214 23303 raft_consensus.cc:2243] T 62319c9e82134e7daf8a46f78c124bff P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:33.276952 23303 raft_consensus.cc:2272] T 62319c9e82134e7daf8a46f78c124bff P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:33.282295 23303 ts_tablet_manager.cc:1916] T 62319c9e82134e7daf8a46f78c124bff P 6c6fa11e8ee34711b3551f0c670442bc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:33.298626 23303 ts_tablet_manager.cc:1929] T 62319c9e82134e7daf8a46f78c124bff P 6c6fa11e8ee34711b3551f0c670442bc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:33.299034 23303 log.cc:1199] T 62319c9e82134e7daf8a46f78c124bff P 6c6fa11e8ee34711b3551f0c670442bc: Deleting WAL directory at /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-2-root/wals/62319c9e82134e7daf8a46f78c124bff
I20260709 12:09:33.300892 22341 catalog_manager.cc:5028] TS 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): tablet 62319c9e82134e7daf8a46f78c124bff (table test-workload [id=1e73b97ba677488c8829a696096f4885]) successfully deleted
I20260709 12:09:34.344441 22604 consensus_queue.cc:237] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:34.351281 22457 raft_consensus.cc:1275] T 041a72bc20f246bdb6e7cc6423d67e62 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:34.352057 22532 raft_consensus.cc:1275] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:34.354105 23276 consensus_queue.cc:1048] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:34.356138 22570 consensus_peers.cc:597] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 041a72bc20f246bdb6e7cc6423d67e62. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:34.357041 23276 consensus_queue.cc:1048] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:34.362497 23226 raft_consensus.cc:2955] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:34.364319 22457 raft_consensus.cc:2955] T 041a72bc20f246bdb6e7cc6423d67e62 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:34.365936 22532 raft_consensus.cc:2955] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:34.377523 22527 consensus_queue.cc:237] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:34.386610 22353 catalog_manager.cc:5697] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New cstate: current_term: 1 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:34.396958 22603 raft_consensus.cc:1275] T 4e5929206e89419f978fa0283f6bb931 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:34.397709 22496 consensus_peers.cc:597] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4e5929206e89419f978fa0283f6bb931. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:34.398481 23261 consensus_queue.cc:1048] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:34.400921 22457 raft_consensus.cc:1275] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:34.407945 23261 consensus_queue.cc:1048] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:34.429807 23305 raft_consensus.cc:2955] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:34.431649 22457 raft_consensus.cc:2955] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:34.433434 22603 raft_consensus.cc:2955] T 4e5929206e89419f978fa0283f6bb931 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:34.452767 22351 catalog_manager.cc:5697] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:34.454411 22603 consensus_queue.cc:237] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
W20260709 12:09:34.466485 22570 consensus_peers.cc:597] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 40384260c96247e0ac31ade25baddaff. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:34.467926 22457 raft_consensus.cc:1275] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:34.469695 23310 consensus_queue.cc:1048] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:34.470917 22532 raft_consensus.cc:1275] T 40384260c96247e0ac31ade25baddaff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:34.473096 23276 consensus_queue.cc:1048] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:34.479158 23310 raft_consensus.cc:2955] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:34.480726 22457 raft_consensus.cc:2955] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:34.499493 22527 raft_consensus.cc:2955] T 40384260c96247e0ac31ade25baddaff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:34.513285 22527 consensus_queue.cc:237] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:34.516947 22353 catalog_manager.cc:5697] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New cstate: current_term: 1 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
W20260709 12:09:34.525074 22496 consensus_peers.cc:597] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d7a58204e5354d61a3b5db01e879dce9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:34.525168 22452 raft_consensus.cc:1275] T d7a58204e5354d61a3b5db01e879dce9 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:34.523301 22604 raft_consensus.cc:1275] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:34.528842 23170 consensus_queue.cc:1048] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:34.530365 23170 consensus_queue.cc:1048] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:34.547821 23170 raft_consensus.cc:2955] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:34.549458 22603 raft_consensus.cc:2955] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:34.552316 22452 raft_consensus.cc:2955] T d7a58204e5354d61a3b5db01e879dce9 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:34.568179 22354 catalog_manager.cc:5697] T d7a58204e5354d61a3b5db01e879dce9 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:34.787312 23325 ts_tablet_manager.cc:933] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:34.813573 23325 tablet_copy_client.cc:323] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270: tablet copy: Beginning tablet copy session from remote peer at address 127.20.196.131:37785
I20260709 12:09:34.815258 22615 tablet_copy_service.cc:140] P 6c6fa11e8ee34711b3551f0c670442bc: Received BeginTabletCopySession request for tablet 041a72bc20f246bdb6e7cc6423d67e62 from peer 8701cd5186a949538d8efafb5f987270 ({username='slave'} at 127.0.0.1:43070)
I20260709 12:09:34.816012 22615 tablet_copy_service.cc:161] P 6c6fa11e8ee34711b3551f0c670442bc: Beginning new tablet copy session on tablet 041a72bc20f246bdb6e7cc6423d67e62 from peer 8701cd5186a949538d8efafb5f987270 at {username='slave'} at 127.0.0.1:43070: session id = 8701cd5186a949538d8efafb5f987270-041a72bc20f246bdb6e7cc6423d67e62
I20260709 12:09:34.821491 22615 tablet_copy_source_session.cc:215] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:34.824610 23325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 041a72bc20f246bdb6e7cc6423d67e62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:34.836483 23325 tablet_copy_client.cc:806] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:34.836987 23325 tablet_copy_client.cc:670] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:34.840206 23325 tablet_copy_client.cc:538] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:34.846163 23325 tablet_bootstrap.cc:492] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270: Bootstrap starting.
I20260709 12:09:34.868220 23325 tablet_bootstrap.cc:492] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:34.869028 23325 tablet_bootstrap.cc:492] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270: Bootstrap complete.
I20260709 12:09:34.869578 23325 ts_tablet_manager.cc:1403] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.009s
I20260709 12:09:34.871758 23325 raft_consensus.cc:359] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:34.872426 23325 raft_consensus.cc:740] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Initialized, Role: LEARNER
I20260709 12:09:34.872956 23325 consensus_queue.cc:260] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:34.875878 23325 ts_tablet_manager.cc:1434] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:09:34.878566 22615 tablet_copy_service.cc:342] P 6c6fa11e8ee34711b3551f0c670442bc: Request end of tablet copy session 8701cd5186a949538d8efafb5f987270-041a72bc20f246bdb6e7cc6423d67e62 received from {username='slave'} at 127.0.0.1:43070
I20260709 12:09:34.879014 22615 tablet_copy_service.cc:434] P 6c6fa11e8ee34711b3551f0c670442bc: ending tablet copy session 8701cd5186a949538d8efafb5f987270-041a72bc20f246bdb6e7cc6423d67e62 on tablet 041a72bc20f246bdb6e7cc6423d67e62 with peer 8701cd5186a949538d8efafb5f987270
I20260709 12:09:34.956475 23325 ts_tablet_manager.cc:933] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:34.962818 23325 tablet_copy_client.cc:323] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270: tablet copy: Beginning tablet copy session from remote peer at address 127.20.196.130:42733
I20260709 12:09:34.964648 22542 tablet_copy_service.cc:140] P 1676e7af5e4a47cb86ee7db83e3d4881: Received BeginTabletCopySession request for tablet 4e5929206e89419f978fa0283f6bb931 from peer 8701cd5186a949538d8efafb5f987270 ({username='slave'} at 127.0.0.1:38310)
I20260709 12:09:34.965157 22542 tablet_copy_service.cc:161] P 1676e7af5e4a47cb86ee7db83e3d4881: Beginning new tablet copy session on tablet 4e5929206e89419f978fa0283f6bb931 from peer 8701cd5186a949538d8efafb5f987270 at {username='slave'} at 127.0.0.1:38310: session id = 8701cd5186a949538d8efafb5f987270-4e5929206e89419f978fa0283f6bb931
I20260709 12:09:34.972368 22542 tablet_copy_source_session.cc:215] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:34.975379 23325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e5929206e89419f978fa0283f6bb931. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:34.991890 23325 tablet_copy_client.cc:806] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:34.992429 23325 tablet_copy_client.cc:670] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:34.996531 23325 tablet_copy_client.cc:538] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:35.010027 23325 tablet_bootstrap.cc:492] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270: Bootstrap starting.
I20260709 12:09:35.010131 23331 ts_tablet_manager.cc:933] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:35.015739 23331 tablet_copy_client.cc:323] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270: tablet copy: Beginning tablet copy session from remote peer at address 127.20.196.130:42733
I20260709 12:09:35.121531 22542 tablet_copy_service.cc:140] P 1676e7af5e4a47cb86ee7db83e3d4881: Received BeginTabletCopySession request for tablet d7a58204e5354d61a3b5db01e879dce9 from peer 8701cd5186a949538d8efafb5f987270 ({username='slave'} at 127.0.0.1:38310)
I20260709 12:09:35.122799 22542 tablet_copy_service.cc:161] P 1676e7af5e4a47cb86ee7db83e3d4881: Beginning new tablet copy session on tablet d7a58204e5354d61a3b5db01e879dce9 from peer 8701cd5186a949538d8efafb5f987270 at {username='slave'} at 127.0.0.1:38310: session id = 8701cd5186a949538d8efafb5f987270-d7a58204e5354d61a3b5db01e879dce9
I20260709 12:09:35.160609 22542 tablet_copy_source_session.cc:215] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:35.166224 23331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7a58204e5354d61a3b5db01e879dce9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:35.172909 23338 ts_tablet_manager.cc:933] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:09:35.162741 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 56461.6us
I20260709 12:09:35.206259 23338 tablet_copy_client.cc:323] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270: tablet copy: Beginning tablet copy session from remote peer at address 127.20.196.131:37785
I20260709 12:09:35.208559 22615 tablet_copy_service.cc:140] P 6c6fa11e8ee34711b3551f0c670442bc: Received BeginTabletCopySession request for tablet 40384260c96247e0ac31ade25baddaff from peer 8701cd5186a949538d8efafb5f987270 ({username='slave'} at 127.0.0.1:43070)
I20260709 12:09:35.209247 22615 tablet_copy_service.cc:161] P 6c6fa11e8ee34711b3551f0c670442bc: Beginning new tablet copy session on tablet 40384260c96247e0ac31ade25baddaff from peer 8701cd5186a949538d8efafb5f987270 at {username='slave'} at 127.0.0.1:43070: session id = 8701cd5186a949538d8efafb5f987270-40384260c96247e0ac31ade25baddaff
I20260709 12:09:35.211860 23325 tablet_bootstrap.cc:492] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:35.213112 23325 tablet_bootstrap.cc:492] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270: Bootstrap complete.
I20260709 12:09:35.216403 23325 ts_tablet_manager.cc:1403] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270: Time spent bootstrapping tablet: real 0.207s	user 0.044s	sys 0.015s
I20260709 12:09:35.215358 23331 tablet_copy_client.cc:806] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:35.218642 23331 tablet_copy_client.cc:670] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:35.225585 23331 tablet_copy_client.cc:538] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:35.241541 23331 tablet_bootstrap.cc:492] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270: Bootstrap starting.
I20260709 12:09:35.253012 22615 tablet_copy_source_session.cc:215] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:35.258313 23338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40384260c96247e0ac31ade25baddaff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:35.287031 23325 raft_consensus.cc:359] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:35.296622 23325 raft_consensus.cc:740] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Initialized, Role: LEARNER
I20260709 12:09:35.297406 23325 consensus_queue.cc:260] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:35.305178 23325 ts_tablet_manager.cc:1434] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270: Time spent starting tablet: real 0.088s	user 0.006s	sys 0.004s
I20260709 12:09:35.310369 22542 tablet_copy_service.cc:342] P 1676e7af5e4a47cb86ee7db83e3d4881: Request end of tablet copy session 8701cd5186a949538d8efafb5f987270-4e5929206e89419f978fa0283f6bb931 received from {username='slave'} at 127.0.0.1:38310
I20260709 12:09:35.310894 22542 tablet_copy_service.cc:434] P 1676e7af5e4a47cb86ee7db83e3d4881: ending tablet copy session 8701cd5186a949538d8efafb5f987270-4e5929206e89419f978fa0283f6bb931 on tablet 4e5929206e89419f978fa0283f6bb931 with peer 8701cd5186a949538d8efafb5f987270
I20260709 12:09:35.331147 23338 tablet_copy_client.cc:806] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:35.331779 23338 tablet_copy_client.cc:670] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:35.338749 23338 tablet_copy_client.cc:538] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:35.358328 23338 tablet_bootstrap.cc:492] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270: Bootstrap starting.
I20260709 12:09:35.365677 23331 tablet_bootstrap.cc:492] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:35.366668 23331 tablet_bootstrap.cc:492] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270: Bootstrap complete.
I20260709 12:09:35.367350 23331 ts_tablet_manager.cc:1403] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270: Time spent bootstrapping tablet: real 0.126s	user 0.025s	sys 0.017s
I20260709 12:09:35.370496 23331 raft_consensus.cc:359] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:35.371390 23331 raft_consensus.cc:740] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Initialized, Role: LEARNER
I20260709 12:09:35.372315 23331 consensus_queue.cc:260] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:35.379794 23125 raft_consensus.cc:1217] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:35.382481 23338 tablet_bootstrap.cc:492] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:35.383502 23338 tablet_bootstrap.cc:492] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270: Bootstrap complete.
I20260709 12:09:35.384215 23338 ts_tablet_manager.cc:1403] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.010s
I20260709 12:09:35.398180 23338 raft_consensus.cc:359] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:35.399951 23338 raft_consensus.cc:740] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Initialized, Role: LEARNER
I20260709 12:09:35.401077 23338 consensus_queue.cc:260] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:35.403841 23331 ts_tablet_manager.cc:1434] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 12:09:35.404422 23338 ts_tablet_manager.cc:1434] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.003s
I20260709 12:09:35.405818 22542 tablet_copy_service.cc:342] P 1676e7af5e4a47cb86ee7db83e3d4881: Request end of tablet copy session 8701cd5186a949538d8efafb5f987270-d7a58204e5354d61a3b5db01e879dce9 received from {username='slave'} at 127.0.0.1:38310
I20260709 12:09:35.406358 22542 tablet_copy_service.cc:434] P 1676e7af5e4a47cb86ee7db83e3d4881: ending tablet copy session 8701cd5186a949538d8efafb5f987270-d7a58204e5354d61a3b5db01e879dce9 on tablet d7a58204e5354d61a3b5db01e879dce9 with peer 8701cd5186a949538d8efafb5f987270
I20260709 12:09:35.408437 22615 tablet_copy_service.cc:342] P 6c6fa11e8ee34711b3551f0c670442bc: Request end of tablet copy session 8701cd5186a949538d8efafb5f987270-40384260c96247e0ac31ade25baddaff received from {username='slave'} at 127.0.0.1:43070
I20260709 12:09:35.408989 22615 tablet_copy_service.cc:434] P 6c6fa11e8ee34711b3551f0c670442bc: ending tablet copy session 8701cd5186a949538d8efafb5f987270-40384260c96247e0ac31ade25baddaff on tablet 40384260c96247e0ac31ade25baddaff with peer 8701cd5186a949538d8efafb5f987270
I20260709 12:09:35.483321 23125 raft_consensus.cc:1217] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:35.503345 23125 raft_consensus.cc:1217] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:35.692219 23125 raft_consensus.cc:1217] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:35.805115 23337 raft_consensus.cc:1064] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
I20260709 12:09:35.807901 23337 consensus_queue.cc:237] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:35.815371 23125 raft_consensus.cc:1275] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:35.818023 22457 raft_consensus.cc:1275] T 041a72bc20f246bdb6e7cc6423d67e62 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:35.820832 23276 consensus_queue.cc:1048] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:35.823966 23336 consensus_queue.cc:1048] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:35.854189 22528 raft_consensus.cc:1275] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:35.860483 23310 consensus_queue.cc:1048] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:35.869016 23336 raft_consensus.cc:2955] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:35.870388 22457 raft_consensus.cc:2955] T 041a72bc20f246bdb6e7cc6423d67e62 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:35.887883 23125 raft_consensus.cc:2955] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:35.890703 22351 catalog_manager.cc:5697] T 041a72bc20f246bdb6e7cc6423d67e62 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:35.907327 22528 raft_consensus.cc:2955] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:35.947378 22604 consensus_queue.cc:237] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:35.955924 23125 raft_consensus.cc:1275] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:35.957837 22527 raft_consensus.cc:1275] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:35.958580 23337 consensus_queue.cc:1048] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:35.959610 23310 consensus_queue.cc:1048] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:35.965801 23336 raft_consensus.cc:2955] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:35.967516 23125 raft_consensus.cc:2955] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:35.967679 22527 raft_consensus.cc:2955] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:35.976984 22341 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 041a72bc20f246bdb6e7cc6423d67e62 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:35.985460 22352 catalog_manager.cc:5697] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: config changed from index 3 to 4, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New cstate: current_term: 1 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:35.995379 23342 raft_consensus.cc:1064] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
I20260709 12:09:35.997946 23342 consensus_queue.cc:237] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:36.001480 22442 tablet_service.cc:1558] Processing DeleteTablet for tablet 041a72bc20f246bdb6e7cc6423d67e62 with delete_type TABLET_DATA_TOMBSTONED (TS c863116d91c14d1ca50d6e8a46a37a8f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51832
I20260709 12:09:36.015147 22604 raft_consensus.cc:1275] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:36.016513 23125 raft_consensus.cc:1275] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:36.016987 23354 tablet_replica.cc:333] T 041a72bc20f246bdb6e7cc6423d67e62 P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:09:36.017984 22454 raft_consensus.cc:1275] T d7a58204e5354d61a3b5db01e879dce9 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:36.018265 23354 raft_consensus.cc:2243] T 041a72bc20f246bdb6e7cc6423d67e62 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:36.019158 23354 raft_consensus.cc:2272] T 041a72bc20f246bdb6e7cc6423d67e62 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:36.019066 23305 consensus_queue.cc:1048] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:36.021507 23342 consensus_queue.cc:1048] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:36.022884 23354 ts_tablet_manager.cc:1916] T 041a72bc20f246bdb6e7cc6423d67e62 P c863116d91c14d1ca50d6e8a46a37a8f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:36.025206 23261 consensus_queue.cc:1048] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:36.039077 23261 raft_consensus.cc:1064] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
I20260709 12:09:36.042912 23354 ts_tablet_manager.cc:1929] T 041a72bc20f246bdb6e7cc6423d67e62 P c863116d91c14d1ca50d6e8a46a37a8f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:36.043780 23354 log.cc:1199] T 041a72bc20f246bdb6e7cc6423d67e62 P c863116d91c14d1ca50d6e8a46a37a8f: Deleting WAL directory at /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-0-root/wals/041a72bc20f246bdb6e7cc6423d67e62
I20260709 12:09:36.043514 23261 consensus_queue.cc:237] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:36.045949 22339 catalog_manager.cc:5028] TS c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): tablet 041a72bc20f246bdb6e7cc6423d67e62 (table test-workload [id=1e73b97ba677488c8829a696096f4885]) successfully deleted
I20260709 12:09:36.058121 23305 raft_consensus.cc:2955] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:36.058879 22454 raft_consensus.cc:2955] T d7a58204e5354d61a3b5db01e879dce9 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:36.092339 22352 catalog_manager.cc:5697] T d7a58204e5354d61a3b5db01e879dce9 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:36.097860 23125 raft_consensus.cc:1275] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:36.101274 22602 raft_consensus.cc:2955] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:36.104648 23363 consensus_queue.cc:1048] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:36.113557 23123 raft_consensus.cc:2955] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:36.125087 22454 raft_consensus.cc:1275] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:36.128227 23363 consensus_queue.cc:1048] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:36.134835 22603 raft_consensus.cc:1275] T 4e5929206e89419f978fa0283f6bb931 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:36.137451 23305 consensus_queue.cc:1048] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:36.149155 22528 consensus_queue.cc:237] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:36.165450 23123 raft_consensus.cc:1275] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:36.170073 22602 raft_consensus.cc:1275] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:36.172106 23363 consensus_queue.cc:1048] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:36.175496 23305 raft_consensus.cc:2955] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:36.177225 22454 raft_consensus.cc:2955] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:36.179364 23362 consensus_queue.cc:1048] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:36.191080 23361 raft_consensus.cc:2955] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:36.198114 23125 raft_consensus.cc:2955] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:36.203564 22340 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d7a58204e5354d61a3b5db01e879dce9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:36.212626 22602 raft_consensus.cc:2955] T 4e5929206e89419f978fa0283f6bb931 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:36.214519 22354 catalog_manager.cc:5697] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: config changed from index 3 to 4, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:36.214383 23123 raft_consensus.cc:2955] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:36.221642 22604 raft_consensus.cc:2955] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:36.241971 22442 tablet_service.cc:1558] Processing DeleteTablet for tablet d7a58204e5354d61a3b5db01e879dce9 with delete_type TABLET_DATA_TOMBSTONED (TS c863116d91c14d1ca50d6e8a46a37a8f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51832
I20260709 12:09:36.241858 22352 catalog_manager.cc:5697] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:36.242919 23354 tablet_replica.cc:333] T d7a58204e5354d61a3b5db01e879dce9 P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:09:36.244024 23354 raft_consensus.cc:2243] T d7a58204e5354d61a3b5db01e879dce9 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:36.244685 23354 raft_consensus.cc:2272] T d7a58204e5354d61a3b5db01e879dce9 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:36.250734 23276 raft_consensus.cc:1064] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
I20260709 12:09:36.255597 23276 consensus_queue.cc:237] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:36.257041 23354 ts_tablet_manager.cc:1916] T d7a58204e5354d61a3b5db01e879dce9 P c863116d91c14d1ca50d6e8a46a37a8f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:36.270932 23354 ts_tablet_manager.cc:1929] T d7a58204e5354d61a3b5db01e879dce9 P c863116d91c14d1ca50d6e8a46a37a8f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:36.271387 23354 log.cc:1199] T d7a58204e5354d61a3b5db01e879dce9 P c863116d91c14d1ca50d6e8a46a37a8f: Deleting WAL directory at /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-0-root/wals/d7a58204e5354d61a3b5db01e879dce9
I20260709 12:09:36.276136 22528 consensus_queue.cc:237] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:36.282861 23123 raft_consensus.cc:1275] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:36.284544 23337 consensus_queue.cc:1048] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:36.285281 22339 catalog_manager.cc:5028] TS c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): tablet d7a58204e5354d61a3b5db01e879dce9 (table test-workload [id=1e73b97ba677488c8829a696096f4885]) successfully deleted
I20260709 12:09:36.287778 22455 raft_consensus.cc:1275] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:36.287930 23123 raft_consensus.cc:1275] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:36.289935 23362 consensus_queue.cc:1048] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:36.291553 22455 raft_consensus.cc:1275] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:36.292696 22527 raft_consensus.cc:1275] T 40384260c96247e0ac31ade25baddaff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:36.292534 23363 consensus_queue.cc:1048] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:36.295486 23337 consensus_queue.cc:1048] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:36.297560 23337 consensus_queue.cc:1048] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:36.314345 23261 raft_consensus.cc:2955] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:36.320351 23125 raft_consensus.cc:2955] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:36.332084 22340 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4e5929206e89419f978fa0283f6bb931 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:36.331483 22457 raft_consensus.cc:2955] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:36.333827 23337 raft_consensus.cc:2955] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:36.340204 22353 catalog_manager.cc:5697] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: config changed from index 3 to 4, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:36.348140 23123 raft_consensus.cc:2955] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:36.352057 22594 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e5929206e89419f978fa0283f6bb931 with delete_type TABLET_DATA_TOMBSTONED (TS 6c6fa11e8ee34711b3551f0c670442bc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45546
I20260709 12:09:36.370357 22457 raft_consensus.cc:2955] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:36.375741 22352 catalog_manager.cc:5697] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:36.380622 22527 raft_consensus.cc:2955] T 40384260c96247e0ac31ade25baddaff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:36.420964 23371 tablet_replica.cc:333] T 4e5929206e89419f978fa0283f6bb931 P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:09:36.423482 23371 raft_consensus.cc:2243] T 4e5929206e89419f978fa0283f6bb931 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:36.424331 23371 raft_consensus.cc:2272] T 4e5929206e89419f978fa0283f6bb931 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:36.426293 22604 consensus_queue.cc:237] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:36.428261 23371 ts_tablet_manager.cc:1916] T 4e5929206e89419f978fa0283f6bb931 P 6c6fa11e8ee34711b3551f0c670442bc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:36.432029 22457 raft_consensus.cc:1275] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:36.432473 23123 raft_consensus.cc:1275] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:36.433385 23276 consensus_queue.cc:1048] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:36.434265 23310 consensus_queue.cc:1048] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:36.441855 23310 raft_consensus.cc:2955] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:36.444890 22455 raft_consensus.cc:2955] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:36.444456 23123 raft_consensus.cc:2955] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:36.462845 22353 catalog_manager.cc:5697] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 reported cstate change: config changed from index 3 to 4, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New cstate: current_term: 1 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:36.472858 22341 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 40384260c96247e0ac31ade25baddaff with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:36.480916 22517 tablet_service.cc:1558] Processing DeleteTablet for tablet 40384260c96247e0ac31ade25baddaff with delete_type TABLET_DATA_TOMBSTONED (TS 1676e7af5e4a47cb86ee7db83e3d4881 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56928
I20260709 12:09:36.491578 23371 ts_tablet_manager.cc:1929] T 4e5929206e89419f978fa0283f6bb931 P 6c6fa11e8ee34711b3551f0c670442bc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:36.493628 23371 log.cc:1199] T 4e5929206e89419f978fa0283f6bb931 P 6c6fa11e8ee34711b3551f0c670442bc: Deleting WAL directory at /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-2-root/wals/4e5929206e89419f978fa0283f6bb931
I20260709 12:09:36.495615 22341 catalog_manager.cc:5028] TS 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): tablet 4e5929206e89419f978fa0283f6bb931 (table test-workload [id=1e73b97ba677488c8829a696096f4885]) successfully deleted
I20260709 12:09:36.506108 23372 tablet_replica.cc:333] T 40384260c96247e0ac31ade25baddaff P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:09:36.507043 23372 raft_consensus.cc:2243] T 40384260c96247e0ac31ade25baddaff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:36.507787 23372 raft_consensus.cc:2272] T 40384260c96247e0ac31ade25baddaff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:36.510385 23372 ts_tablet_manager.cc:1916] T 40384260c96247e0ac31ade25baddaff P 1676e7af5e4a47cb86ee7db83e3d4881: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:36.524276 23372 ts_tablet_manager.cc:1929] T 40384260c96247e0ac31ade25baddaff P 1676e7af5e4a47cb86ee7db83e3d4881: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:36.524626 23372 log.cc:1199] T 40384260c96247e0ac31ade25baddaff P 1676e7af5e4a47cb86ee7db83e3d4881: Deleting WAL directory at /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-1-root/wals/40384260c96247e0ac31ade25baddaff
I20260709 12:09:36.525974 22340 catalog_manager.cc:5028] TS 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): tablet 40384260c96247e0ac31ade25baddaff (table test-workload [id=1e73b97ba677488c8829a696096f4885]) successfully deleted
I20260709 12:09:37.559758 22604 consensus_queue.cc:237] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
W20260709 12:09:37.566318 22570 consensus_peers.cc:597] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cf7e3d0e753849fcb1514dc105ababfd. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:37.566789 22528 raft_consensus.cc:1275] T cf7e3d0e753849fcb1514dc105ababfd P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:37.567065 22455 raft_consensus.cc:1275] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:37.568033 23276 consensus_queue.cc:1048] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:37.568818 23310 consensus_queue.cc:1048] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:37.595973 23310 raft_consensus.cc:2955] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:37.598048 22457 raft_consensus.cc:2955] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:37.604614 22528 raft_consensus.cc:2955] T cf7e3d0e753849fcb1514dc105ababfd P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:37.612300 22457 consensus_queue.cc:237] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:37.613524 22353 catalog_manager.cc:5697] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New cstate: current_term: 1 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:37.628129 22604 raft_consensus.cc:1275] T b36f3a080ce7465b8491197cc6189444 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:37.628187 22421 consensus_peers.cc:597] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b36f3a080ce7465b8491197cc6189444. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:37.629973 22528 raft_consensus.cc:1275] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:37.629741 23307 consensus_queue.cc:1048] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:37.631242 23373 consensus_queue.cc:1048] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:37.643080 23307 raft_consensus.cc:2955] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:37.646942 22528 raft_consensus.cc:2955] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:37.648424 22604 raft_consensus.cc:2955] T b36f3a080ce7465b8491197cc6189444 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:37.668272 22529 consensus_queue.cc:237] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:37.670831 22354 catalog_manager.cc:5697] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:37.674741 22604 raft_consensus.cc:1275] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:37.675499 22496 consensus_peers.cc:597] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 272afea078f74bf19baefd3c1300644d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:37.678608 22457 raft_consensus.cc:1275] T 272afea078f74bf19baefd3c1300644d P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:37.680331 23375 consensus_queue.cc:1048] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:37.683014 23261 consensus_queue.cc:1048] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:37.703379 23261 raft_consensus.cc:2955] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:37.704960 22604 raft_consensus.cc:2955] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:37.708959 22455 raft_consensus.cc:2955] T 272afea078f74bf19baefd3c1300644d P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:37.719295 22604 consensus_queue.cc:237] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:37.723542 22352 catalog_manager.cc:5697] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:37.735183 22570 consensus_peers.cc:597] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b196b03fbcb045da91c663d6595b2775. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:37.736114 22457 raft_consensus.cc:1275] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:37.737283 22528 raft_consensus.cc:1275] T b196b03fbcb045da91c663d6595b2775 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:37.737545 23374 consensus_queue.cc:1048] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:37.741874 23374 consensus_queue.cc:1048] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:37.751107 23310 raft_consensus.cc:2955] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:37.752760 22455 raft_consensus.cc:2955] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:37.760308 22528 raft_consensus.cc:2955] T b196b03fbcb045da91c663d6595b2775 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:37.784600 22353 catalog_manager.cc:5697] T b196b03fbcb045da91c663d6595b2775 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New cstate: current_term: 1 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:37.966146 23394 ts_tablet_manager.cc:933] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:37.970217 23394 tablet_copy_client.cc:323] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270: tablet copy: Beginning tablet copy session from remote peer at address 127.20.196.131:37785
I20260709 12:09:37.971912 22615 tablet_copy_service.cc:140] P 6c6fa11e8ee34711b3551f0c670442bc: Received BeginTabletCopySession request for tablet cf7e3d0e753849fcb1514dc105ababfd from peer 8701cd5186a949538d8efafb5f987270 ({username='slave'} at 127.0.0.1:43070)
I20260709 12:09:37.972460 22615 tablet_copy_service.cc:161] P 6c6fa11e8ee34711b3551f0c670442bc: Beginning new tablet copy session on tablet cf7e3d0e753849fcb1514dc105ababfd from peer 8701cd5186a949538d8efafb5f987270 at {username='slave'} at 127.0.0.1:43070: session id = 8701cd5186a949538d8efafb5f987270-cf7e3d0e753849fcb1514dc105ababfd
I20260709 12:09:37.978519 22615 tablet_copy_source_session.cc:215] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:37.981102 23394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf7e3d0e753849fcb1514dc105ababfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:37.995508 23394 tablet_copy_client.cc:806] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:37.996050 23394 tablet_copy_client.cc:670] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:37.999441 23394 tablet_copy_client.cc:538] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:38.006713 23394 tablet_bootstrap.cc:492] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270: Bootstrap starting.
I20260709 12:09:38.024768 23394 tablet_bootstrap.cc:492] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:38.025664 23394 tablet_bootstrap.cc:492] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270: Bootstrap complete.
I20260709 12:09:38.026448 23394 ts_tablet_manager.cc:1403] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.006s
I20260709 12:09:38.029726 23394 raft_consensus.cc:359] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:38.030946 23394 raft_consensus.cc:740] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Initialized, Role: LEARNER
I20260709 12:09:38.031672 23394 consensus_queue.cc:260] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:38.038111 23394 ts_tablet_manager.cc:1434] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.003s
I20260709 12:09:38.040253 22615 tablet_copy_service.cc:342] P 6c6fa11e8ee34711b3551f0c670442bc: Request end of tablet copy session 8701cd5186a949538d8efafb5f987270-cf7e3d0e753849fcb1514dc105ababfd received from {username='slave'} at 127.0.0.1:43070
I20260709 12:09:38.040669 22615 tablet_copy_service.cc:434] P 6c6fa11e8ee34711b3551f0c670442bc: ending tablet copy session 8701cd5186a949538d8efafb5f987270-cf7e3d0e753849fcb1514dc105ababfd on tablet cf7e3d0e753849fcb1514dc105ababfd with peer 8701cd5186a949538d8efafb5f987270
I20260709 12:09:38.078323 23394 ts_tablet_manager.cc:933] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317)
I20260709 12:09:38.080039 23394 tablet_copy_client.cc:323] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270: tablet copy: Beginning tablet copy session from remote peer at address 127.20.196.129:42317
I20260709 12:09:38.082087 22467 tablet_copy_service.cc:140] P c863116d91c14d1ca50d6e8a46a37a8f: Received BeginTabletCopySession request for tablet b36f3a080ce7465b8491197cc6189444 from peer 8701cd5186a949538d8efafb5f987270 ({username='slave'} at 127.0.0.1:34452)
I20260709 12:09:38.082602 22467 tablet_copy_service.cc:161] P c863116d91c14d1ca50d6e8a46a37a8f: Beginning new tablet copy session on tablet b36f3a080ce7465b8491197cc6189444 from peer 8701cd5186a949538d8efafb5f987270 at {username='slave'} at 127.0.0.1:34452: session id = 8701cd5186a949538d8efafb5f987270-b36f3a080ce7465b8491197cc6189444
I20260709 12:09:38.090130 22467 tablet_copy_source_session.cc:215] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:38.093879 23394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b36f3a080ce7465b8491197cc6189444. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:38.109673 23394 tablet_copy_client.cc:806] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:38.110332 23394 tablet_copy_client.cc:670] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:38.113574 23394 tablet_copy_client.cc:538] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:38.123780 23394 tablet_bootstrap.cc:492] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270: Bootstrap starting.
I20260709 12:09:38.129295 23399 ts_tablet_manager.cc:933] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:38.132967 23399 tablet_copy_client.cc:323] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270: tablet copy: Beginning tablet copy session from remote peer at address 127.20.196.130:42733
I20260709 12:09:38.134593 22542 tablet_copy_service.cc:140] P 1676e7af5e4a47cb86ee7db83e3d4881: Received BeginTabletCopySession request for tablet 272afea078f74bf19baefd3c1300644d from peer 8701cd5186a949538d8efafb5f987270 ({username='slave'} at 127.0.0.1:38310)
I20260709 12:09:38.135154 22542 tablet_copy_service.cc:161] P 1676e7af5e4a47cb86ee7db83e3d4881: Beginning new tablet copy session on tablet 272afea078f74bf19baefd3c1300644d from peer 8701cd5186a949538d8efafb5f987270 at {username='slave'} at 127.0.0.1:38310: session id = 8701cd5186a949538d8efafb5f987270-272afea078f74bf19baefd3c1300644d
I20260709 12:09:38.143112 22542 tablet_copy_source_session.cc:215] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:38.146742 23399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 272afea078f74bf19baefd3c1300644d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:38.147297 23394 tablet_bootstrap.cc:492] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:38.148162 23394 tablet_bootstrap.cc:492] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270: Bootstrap complete.
I20260709 12:09:38.148828 23394 ts_tablet_manager.cc:1403] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.007s
I20260709 12:09:38.151796 23394 raft_consensus.cc:359] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:38.152611 23394 raft_consensus.cc:740] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Initialized, Role: LEARNER
I20260709 12:09:38.153255 23394 consensus_queue.cc:260] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:38.155742 23394 ts_tablet_manager.cc:1434] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:38.157943 22467 tablet_copy_service.cc:342] P c863116d91c14d1ca50d6e8a46a37a8f: Request end of tablet copy session 8701cd5186a949538d8efafb5f987270-b36f3a080ce7465b8491197cc6189444 received from {username='slave'} at 127.0.0.1:34452
I20260709 12:09:38.158370 22467 tablet_copy_service.cc:434] P c863116d91c14d1ca50d6e8a46a37a8f: ending tablet copy session 8701cd5186a949538d8efafb5f987270-b36f3a080ce7465b8491197cc6189444 on tablet b36f3a080ce7465b8491197cc6189444 with peer 8701cd5186a949538d8efafb5f987270
I20260709 12:09:38.164892 23399 tablet_copy_client.cc:806] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:38.165480 23399 tablet_copy_client.cc:670] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:38.169610 23399 tablet_copy_client.cc:538] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:38.177692 23399 tablet_bootstrap.cc:492] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270: Bootstrap starting.
I20260709 12:09:38.191443 23394 ts_tablet_manager.cc:933] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:38.193377 23394 tablet_copy_client.cc:323] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270: tablet copy: Beginning tablet copy session from remote peer at address 127.20.196.131:37785
I20260709 12:09:38.194905 22615 tablet_copy_service.cc:140] P 6c6fa11e8ee34711b3551f0c670442bc: Received BeginTabletCopySession request for tablet b196b03fbcb045da91c663d6595b2775 from peer 8701cd5186a949538d8efafb5f987270 ({username='slave'} at 127.0.0.1:43070)
I20260709 12:09:38.195425 22615 tablet_copy_service.cc:161] P 6c6fa11e8ee34711b3551f0c670442bc: Beginning new tablet copy session on tablet b196b03fbcb045da91c663d6595b2775 from peer 8701cd5186a949538d8efafb5f987270 at {username='slave'} at 127.0.0.1:43070: session id = 8701cd5186a949538d8efafb5f987270-b196b03fbcb045da91c663d6595b2775
I20260709 12:09:38.198410 23399 tablet_bootstrap.cc:492] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:38.199854 23399 tablet_bootstrap.cc:492] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270: Bootstrap complete.
I20260709 12:09:38.200493 23399 ts_tablet_manager.cc:1403] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270: Time spent bootstrapping tablet: real 0.023s	user 0.019s	sys 0.004s
I20260709 12:09:38.202052 22615 tablet_copy_source_session.cc:215] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:38.203387 23399 raft_consensus.cc:359] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:38.204226 23399 raft_consensus.cc:740] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Initialized, Role: LEARNER
I20260709 12:09:38.204700 23394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b196b03fbcb045da91c663d6595b2775. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:38.205005 23399 consensus_queue.cc:260] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:38.210796 23399 ts_tablet_manager.cc:1434] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:09:38.214282 22542 tablet_copy_service.cc:342] P 1676e7af5e4a47cb86ee7db83e3d4881: Request end of tablet copy session 8701cd5186a949538d8efafb5f987270-272afea078f74bf19baefd3c1300644d received from {username='slave'} at 127.0.0.1:38310
I20260709 12:09:38.214709 22542 tablet_copy_service.cc:434] P 1676e7af5e4a47cb86ee7db83e3d4881: ending tablet copy session 8701cd5186a949538d8efafb5f987270-272afea078f74bf19baefd3c1300644d on tablet 272afea078f74bf19baefd3c1300644d with peer 8701cd5186a949538d8efafb5f987270
I20260709 12:09:38.220188 23394 tablet_copy_client.cc:806] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:38.220778 23394 tablet_copy_client.cc:670] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:38.226783 23394 tablet_copy_client.cc:538] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:38.232677 23394 tablet_bootstrap.cc:492] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270: Bootstrap starting.
I20260709 12:09:38.247398 23394 tablet_bootstrap.cc:492] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:38.248162 23394 tablet_bootstrap.cc:492] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270: Bootstrap complete.
I20260709 12:09:38.248704 23394 ts_tablet_manager.cc:1403] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.001s
I20260709 12:09:38.250634 23394 raft_consensus.cc:359] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:38.251250 23394 raft_consensus.cc:740] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Initialized, Role: LEARNER
I20260709 12:09:38.251825 23394 consensus_queue.cc:260] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:38.253713 23394 ts_tablet_manager.cc:1434] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:09:38.260231 22615 tablet_copy_service.cc:342] P 6c6fa11e8ee34711b3551f0c670442bc: Request end of tablet copy session 8701cd5186a949538d8efafb5f987270-b196b03fbcb045da91c663d6595b2775 received from {username='slave'} at 127.0.0.1:43070
I20260709 12:09:38.260665 22615 tablet_copy_service.cc:434] P 6c6fa11e8ee34711b3551f0c670442bc: ending tablet copy session 8701cd5186a949538d8efafb5f987270-b196b03fbcb045da91c663d6595b2775 on tablet b196b03fbcb045da91c663d6595b2775 with peer 8701cd5186a949538d8efafb5f987270
I20260709 12:09:38.466315 23123 raft_consensus.cc:1217] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:38.527595 23124 raft_consensus.cc:1217] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:38.534638 23124 raft_consensus.cc:1217] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:38.590247 23124 raft_consensus.cc:1217] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:38.871661 23373 raft_consensus.cc:1064] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
I20260709 12:09:38.874181 23373 consensus_queue.cc:237] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:38.881270 22602 raft_consensus.cc:1275] T b36f3a080ce7465b8491197cc6189444 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:38.882879 22529 raft_consensus.cc:1275] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:38.883920 23124 raft_consensus.cc:1275] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:38.882715 23373 consensus_queue.cc:1048] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:09:38.891647 23307 consensus_queue.cc:1048] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:38.893262 23405 consensus_queue.cc:1048] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:38.917603 23405 raft_consensus.cc:2955] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:38.924755 23124 raft_consensus.cc:2955] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:38.928581 22529 raft_consensus.cc:2955] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:38.933528 22604 raft_consensus.cc:2955] T b36f3a080ce7465b8491197cc6189444 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:38.942514 22352 catalog_manager.cc:5697] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 reported cstate change: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:38.983733 22455 consensus_queue.cc:237] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:38.989871 23407 raft_consensus.cc:1064] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
I20260709 12:09:38.993597 23407 consensus_queue.cc:237] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:39.000106 22529 raft_consensus.cc:1275] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:39.001102 23124 raft_consensus.cc:1275] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:39.001506 23373 consensus_queue.cc:1048] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:39.002560 23405 consensus_queue.cc:1048] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:39.010362 23406 raft_consensus.cc:2955] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:39.011603 23123 raft_consensus.cc:2955] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:39.022370 22529 raft_consensus.cc:2955] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:39.031810 23374 raft_consensus.cc:1064] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
I20260709 12:09:39.035921 22339 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b36f3a080ce7465b8491197cc6189444 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:39.042748 22351 catalog_manager.cc:5697] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 reported cstate change: config changed from index 3 to 4, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:39.034526 23374 consensus_queue.cc:237] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:39.058830 22594 tablet_service.cc:1558] Processing DeleteTablet for tablet b36f3a080ce7465b8491197cc6189444 with delete_type TABLET_DATA_TOMBSTONED (TS 6c6fa11e8ee34711b3551f0c670442bc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45546
I20260709 12:09:39.061115 23123 raft_consensus.cc:1275] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:39.062484 23261 consensus_queue.cc:1048] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:39.066841 23124 raft_consensus.cc:1275] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:39.069049 22457 raft_consensus.cc:1275] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:39.069798 22455 raft_consensus.cc:1275] T 272afea078f74bf19baefd3c1300644d P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:39.061120 23421 tablet_replica.cc:333] T b36f3a080ce7465b8491197cc6189444 P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:09:39.070727 22528 raft_consensus.cc:1275] T cf7e3d0e753849fcb1514dc105ababfd P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:39.071274 23421 raft_consensus.cc:2243] T b36f3a080ce7465b8491197cc6189444 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:39.071957 23421 raft_consensus.cc:2272] T b36f3a080ce7465b8491197cc6189444 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:39.074844 23408 consensus_queue.cc:1048] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:39.075788 23421 ts_tablet_manager.cc:1916] T b36f3a080ce7465b8491197cc6189444 P 6c6fa11e8ee34711b3551f0c670442bc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:39.077960 23419 consensus_queue.cc:1048] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:39.069041 22604 raft_consensus.cc:1275] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:39.080583 23374 consensus_queue.cc:1048] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:39.083992 23407 consensus_queue.cc:1048] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:39.092701 23408 raft_consensus.cc:1064] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
I20260709 12:09:39.110217 23408 consensus_queue.cc:237] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:39.112879 23310 consensus_queue.cc:1048] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:39.172531 23261 raft_consensus.cc:2955] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:39.189164 22602 raft_consensus.cc:2955] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:39.191875 23123 raft_consensus.cc:2955] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:39.212570 23125 raft_consensus.cc:1275] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:39.214267 23374 consensus_queue.cc:1048] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:39.218124 22528 raft_consensus.cc:1275] T b196b03fbcb045da91c663d6595b2775 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:39.215464 22351 catalog_manager.cc:5697] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:39.233963 23310 consensus_queue.cc:1048] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:39.236768 22454 raft_consensus.cc:2955] T 272afea078f74bf19baefd3c1300644d P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:39.243152 22457 raft_consensus.cc:1275] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:39.247187 23310 consensus_queue.cc:1048] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:39.246858 22451 raft_consensus.cc:2955] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:39.241062 23408 raft_consensus.cc:2955] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:39.251187 23421 ts_tablet_manager.cc:1929] T b36f3a080ce7465b8491197cc6189444 P 6c6fa11e8ee34711b3551f0c670442bc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:39.255270 23421 log.cc:1199] T b36f3a080ce7465b8491197cc6189444 P 6c6fa11e8ee34711b3551f0c670442bc: Deleting WAL directory at /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-2-root/wals/b36f3a080ce7465b8491197cc6189444
I20260709 12:09:39.258265 22341 catalog_manager.cc:5028] TS 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): tablet b36f3a080ce7465b8491197cc6189444 (table test-workload [id=1e73b97ba677488c8829a696096f4885]) successfully deleted
W20260709 12:09:39.258349 23428 log.cc:927] Time spent T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:09:39.263556 23124 raft_consensus.cc:2955] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:39.269080 22527 consensus_queue.cc:237] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:39.276242 23125 raft_consensus.cc:1275] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:39.276250 22527 raft_consensus.cc:2955] T cf7e3d0e753849fcb1514dc105ababfd P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:39.280265 22602 raft_consensus.cc:1275] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:39.280848 23375 consensus_queue.cc:1048] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:39.283986 23261 consensus_queue.cc:1048] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:39.287632 22354 catalog_manager.cc:5697] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:39.300727 23407 raft_consensus.cc:2955] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:39.302923 22603 consensus_queue.cc:237] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:39.309157 23310 raft_consensus.cc:2955] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:39.344754 23125 raft_consensus.cc:1275] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:39.346267 23374 consensus_queue.cc:1048] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:39.349858 22603 raft_consensus.cc:2955] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:39.352505 22457 raft_consensus.cc:1275] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:39.354853 23374 consensus_queue.cc:1048] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:39.357442 22457 raft_consensus.cc:2955] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:39.365761 22340 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 272afea078f74bf19baefd3c1300644d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:39.371747 23310 raft_consensus.cc:2955] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:39.375895 23125 raft_consensus.cc:2955] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:39.377750 22451 raft_consensus.cc:2955] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:39.378188 22354 catalog_manager.cc:5697] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:39.380080 22527 raft_consensus.cc:2955] T b196b03fbcb045da91c663d6595b2775 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:39.396474 23122 raft_consensus.cc:2955] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:39.381251 23124 raft_consensus.cc:2955] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:39.385851 22352 catalog_manager.cc:5697] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: config changed from index 3 to 4, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:39.418071 22341 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cf7e3d0e753849fcb1514dc105ababfd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:39.426241 22442 tablet_service.cc:1558] Processing DeleteTablet for tablet 272afea078f74bf19baefd3c1300644d with delete_type TABLET_DATA_TOMBSTONED (TS c863116d91c14d1ca50d6e8a46a37a8f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51832
I20260709 12:09:39.431653 22602 consensus_queue.cc:237] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:39.434149 22351 catalog_manager.cc:5697] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 reported cstate change: config changed from index 3 to 4, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New cstate: current_term: 1 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:39.436400 23436 tablet_replica.cc:333] T 272afea078f74bf19baefd3c1300644d P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:09:39.437484 23436 raft_consensus.cc:2243] T 272afea078f74bf19baefd3c1300644d P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:39.439980 22457 raft_consensus.cc:1275] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:39.459479 23436 raft_consensus.cc:2272] T 272afea078f74bf19baefd3c1300644d P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:39.441475 23124 raft_consensus.cc:1275] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:39.460932 23310 consensus_queue.cc:1048] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:39.461779 23374 consensus_queue.cc:1048] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:39.462885 23436 ts_tablet_manager.cc:1916] T 272afea078f74bf19baefd3c1300644d P c863116d91c14d1ca50d6e8a46a37a8f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:39.483210 22517 tablet_service.cc:1558] Processing DeleteTablet for tablet cf7e3d0e753849fcb1514dc105ababfd with delete_type TABLET_DATA_TOMBSTONED (TS 1676e7af5e4a47cb86ee7db83e3d4881 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56928
I20260709 12:09:39.489705 23430 raft_consensus.cc:2955] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:39.503566 23436 ts_tablet_manager.cc:1929] T 272afea078f74bf19baefd3c1300644d P c863116d91c14d1ca50d6e8a46a37a8f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:39.504101 23436 log.cc:1199] T 272afea078f74bf19baefd3c1300644d P c863116d91c14d1ca50d6e8a46a37a8f: Deleting WAL directory at /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-0-root/wals/272afea078f74bf19baefd3c1300644d
I20260709 12:09:39.505941 22339 catalog_manager.cc:5028] TS c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): tablet 272afea078f74bf19baefd3c1300644d (table test-workload [id=1e73b97ba677488c8829a696096f4885]) successfully deleted
I20260709 12:09:39.505553 23124 raft_consensus.cc:2955] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:39.509197 22451 raft_consensus.cc:2955] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:39.512006 23437 tablet_replica.cc:333] T cf7e3d0e753849fcb1514dc105ababfd P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:09:39.513310 23437 raft_consensus.cc:2243] T cf7e3d0e753849fcb1514dc105ababfd P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:39.514117 23437 raft_consensus.cc:2272] T cf7e3d0e753849fcb1514dc105ababfd P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:39.518273 23437 ts_tablet_manager.cc:1916] T cf7e3d0e753849fcb1514dc105ababfd P 1676e7af5e4a47cb86ee7db83e3d4881: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:39.523379 22351 catalog_manager.cc:5697] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 reported cstate change: config changed from index 3 to 4, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New cstate: current_term: 1 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:39.545174 22517 tablet_service.cc:1558] Processing DeleteTablet for tablet b196b03fbcb045da91c663d6595b2775 with delete_type TABLET_DATA_TOMBSTONED (TS 1676e7af5e4a47cb86ee7db83e3d4881 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56928
I20260709 12:09:39.548163 22341 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b196b03fbcb045da91c663d6595b2775 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:39.552255 23437 ts_tablet_manager.cc:1929] T cf7e3d0e753849fcb1514dc105ababfd P 1676e7af5e4a47cb86ee7db83e3d4881: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:39.552785 23437 log.cc:1199] T cf7e3d0e753849fcb1514dc105ababfd P 1676e7af5e4a47cb86ee7db83e3d4881: Deleting WAL directory at /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-1-root/wals/cf7e3d0e753849fcb1514dc105ababfd
I20260709 12:09:39.554553 23437 tablet_replica.cc:333] T b196b03fbcb045da91c663d6595b2775 P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:09:39.554596 22340 catalog_manager.cc:5028] TS 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): tablet cf7e3d0e753849fcb1514dc105ababfd (table test-workload [id=1e73b97ba677488c8829a696096f4885]) successfully deleted
I20260709 12:09:39.555660 23437 raft_consensus.cc:2243] T b196b03fbcb045da91c663d6595b2775 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:39.556334 23437 raft_consensus.cc:2272] T b196b03fbcb045da91c663d6595b2775 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:39.559489 23437 ts_tablet_manager.cc:1916] T b196b03fbcb045da91c663d6595b2775 P 1676e7af5e4a47cb86ee7db83e3d4881: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:39.574215 23437 ts_tablet_manager.cc:1929] T b196b03fbcb045da91c663d6595b2775 P 1676e7af5e4a47cb86ee7db83e3d4881: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:39.574594 23437 log.cc:1199] T b196b03fbcb045da91c663d6595b2775 P 1676e7af5e4a47cb86ee7db83e3d4881: Deleting WAL directory at /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-1-root/wals/b196b03fbcb045da91c663d6595b2775
I20260709 12:09:39.576378 22340 catalog_manager.cc:5028] TS 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): tablet b196b03fbcb045da91c663d6595b2775 (table test-workload [id=1e73b97ba677488c8829a696096f4885]) successfully deleted
I20260709 12:09:40.612270 22527 consensus_queue.cc:237] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:40.617717 22602 raft_consensus.cc:1275] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:40.617826 22496 consensus_peers.cc:597] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bf783936508640219af47375c444da09. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:40.618026 22451 raft_consensus.cc:1275] T bf783936508640219af47375c444da09 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:40.619604 23407 consensus_queue.cc:1048] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:40.620402 23440 consensus_queue.cc:1048] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:40.630003 23435 raft_consensus.cc:2955] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:40.631814 22451 raft_consensus.cc:2955] T bf783936508640219af47375c444da09 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:40.632066 22602 raft_consensus.cc:2955] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:40.648427 22457 consensus_queue.cc:237] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:40.654284 22351 catalog_manager.cc:5697] T bf783936508640219af47375c444da09 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
W20260709 12:09:40.655789 22421 consensus_peers.cc:597] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 897c484d3dec40a296e097e6b8d26d39. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:40.657351 22602 raft_consensus.cc:1275] T 897c484d3dec40a296e097e6b8d26d39 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:40.658675 22527 raft_consensus.cc:1275] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:40.658566 23410 consensus_queue.cc:1048] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:40.660929 23410 consensus_queue.cc:1048] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:40.673636 23439 raft_consensus.cc:2955] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:40.676944 22602 raft_consensus.cc:2955] T 897c484d3dec40a296e097e6b8d26d39 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:40.687130 22527 raft_consensus.cc:2955] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:40.700747 22529 consensus_queue.cc:237] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:40.698005 22354 catalog_manager.cc:5697] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:40.707945 22496 consensus_peers.cc:597] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b205f960deef48f8bc84127a8b47faf4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:40.709108 22457 raft_consensus.cc:1275] T b205f960deef48f8bc84127a8b47faf4 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:40.710886 23407 consensus_queue.cc:1048] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:40.709120 22602 raft_consensus.cc:1275] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:40.716378 23440 consensus_queue.cc:1048] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:40.722697 23435 raft_consensus.cc:2955] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:40.725704 22457 raft_consensus.cc:2955] T b205f960deef48f8bc84127a8b47faf4 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:40.733532 22602 raft_consensus.cc:2955] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:40.737310 22451 consensus_queue.cc:237] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:40.748155 22354 catalog_manager.cc:5697] T b205f960deef48f8bc84127a8b47faf4 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
W20260709 12:09:40.752976 22421 consensus_peers.cc:597] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 10ed4486435d4f82978c5cb544504999. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:40.753031 22604 raft_consensus.cc:1275] T 10ed4486435d4f82978c5cb544504999 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:40.758126 23410 consensus_queue.cc:1048] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:40.760035 22529 raft_consensus.cc:1275] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:40.761267 23410 consensus_queue.cc:1048] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:40.768193 23406 raft_consensus.cc:2955] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:40.770365 22602 raft_consensus.cc:2955] T 10ed4486435d4f82978c5cb544504999 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:40.772200 22529 raft_consensus.cc:2955] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:40.799011 22352 catalog_manager.cc:5697] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:41.171257 23459 ts_tablet_manager.cc:933] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:41.173134 23459 tablet_copy_client.cc:323] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270: tablet copy: Beginning tablet copy session from remote peer at address 127.20.196.130:42733
I20260709 12:09:41.174674 22542 tablet_copy_service.cc:140] P 1676e7af5e4a47cb86ee7db83e3d4881: Received BeginTabletCopySession request for tablet b205f960deef48f8bc84127a8b47faf4 from peer 8701cd5186a949538d8efafb5f987270 ({username='slave'} at 127.0.0.1:38310)
I20260709 12:09:41.175240 22542 tablet_copy_service.cc:161] P 1676e7af5e4a47cb86ee7db83e3d4881: Beginning new tablet copy session on tablet b205f960deef48f8bc84127a8b47faf4 from peer 8701cd5186a949538d8efafb5f987270 at {username='slave'} at 127.0.0.1:38310: session id = 8701cd5186a949538d8efafb5f987270-b205f960deef48f8bc84127a8b47faf4
I20260709 12:09:41.182473 22542 tablet_copy_source_session.cc:215] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:41.185463 23459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b205f960deef48f8bc84127a8b47faf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:41.201335 23459 tablet_copy_client.cc:806] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:41.201994 23459 tablet_copy_client.cc:670] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:41.205778 23459 tablet_copy_client.cc:538] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:41.213869 23459 tablet_bootstrap.cc:492] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270: Bootstrap starting.
I20260709 12:09:41.248535 23463 ts_tablet_manager.cc:933] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317)
I20260709 12:09:41.255743 23461 ts_tablet_manager.cc:933] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:41.256206 23459 tablet_bootstrap.cc:492] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:41.257181 23459 tablet_bootstrap.cc:492] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270: Bootstrap complete.
I20260709 12:09:41.258062 23459 ts_tablet_manager.cc:1403] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.026s
I20260709 12:09:41.261181 23459 raft_consensus.cc:359] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:41.262182 23459 raft_consensus.cc:740] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Initialized, Role: LEARNER
I20260709 12:09:41.263789 23461 tablet_copy_client.cc:323] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270: tablet copy: Beginning tablet copy session from remote peer at address 127.20.196.130:42733
I20260709 12:09:41.263111 23459 consensus_queue.cc:260] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:41.270334 22542 tablet_copy_service.cc:140] P 1676e7af5e4a47cb86ee7db83e3d4881: Received BeginTabletCopySession request for tablet bf783936508640219af47375c444da09 from peer 8701cd5186a949538d8efafb5f987270 ({username='slave'} at 127.0.0.1:38310)
I20260709 12:09:41.270965 22542 tablet_copy_service.cc:161] P 1676e7af5e4a47cb86ee7db83e3d4881: Beginning new tablet copy session on tablet bf783936508640219af47375c444da09 from peer 8701cd5186a949538d8efafb5f987270 at {username='slave'} at 127.0.0.1:38310: session id = 8701cd5186a949538d8efafb5f987270-bf783936508640219af47375c444da09
I20260709 12:09:41.271070 23463 tablet_copy_client.cc:323] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270: tablet copy: Beginning tablet copy session from remote peer at address 127.20.196.129:42317
I20260709 12:09:41.272660 22467 tablet_copy_service.cc:140] P c863116d91c14d1ca50d6e8a46a37a8f: Received BeginTabletCopySession request for tablet 897c484d3dec40a296e097e6b8d26d39 from peer 8701cd5186a949538d8efafb5f987270 ({username='slave'} at 127.0.0.1:34452)
I20260709 12:09:41.273161 22467 tablet_copy_service.cc:161] P c863116d91c14d1ca50d6e8a46a37a8f: Beginning new tablet copy session on tablet 897c484d3dec40a296e097e6b8d26d39 from peer 8701cd5186a949538d8efafb5f987270 at {username='slave'} at 127.0.0.1:34452: session id = 8701cd5186a949538d8efafb5f987270-897c484d3dec40a296e097e6b8d26d39
I20260709 12:09:41.278581 22542 tablet_copy_source_session.cc:215] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:41.281666 23461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf783936508640219af47375c444da09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:41.303584 22467 tablet_copy_source_session.cc:215] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:41.307850 23459 ts_tablet_manager.cc:1434] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270: Time spent starting tablet: real 0.049s	user 0.024s	sys 0.020s
I20260709 12:09:41.310420 22542 tablet_copy_service.cc:342] P 1676e7af5e4a47cb86ee7db83e3d4881: Request end of tablet copy session 8701cd5186a949538d8efafb5f987270-b205f960deef48f8bc84127a8b47faf4 received from {username='slave'} at 127.0.0.1:38310
I20260709 12:09:41.310904 22542 tablet_copy_service.cc:434] P 1676e7af5e4a47cb86ee7db83e3d4881: ending tablet copy session 8701cd5186a949538d8efafb5f987270-b205f960deef48f8bc84127a8b47faf4 on tablet b205f960deef48f8bc84127a8b47faf4 with peer 8701cd5186a949538d8efafb5f987270
I20260709 12:09:41.312871 23461 tablet_copy_client.cc:806] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:41.312994 23463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 897c484d3dec40a296e097e6b8d26d39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:41.313584 23461 tablet_copy_client.cc:670] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:41.322506 23461 tablet_copy_client.cc:538] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:41.330282 23463 tablet_copy_client.cc:806] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:41.330965 23463 tablet_copy_client.cc:670] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:41.334333 23459 ts_tablet_manager.cc:933] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317)
I20260709 12:09:41.343025 23463 tablet_copy_client.cc:538] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:41.350714 23461 tablet_bootstrap.cc:492] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270: Bootstrap starting.
I20260709 12:09:41.377974 23463 tablet_bootstrap.cc:492] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270: Bootstrap starting.
I20260709 12:09:41.379369 23459 tablet_copy_client.cc:323] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270: tablet copy: Beginning tablet copy session from remote peer at address 127.20.196.129:42317
I20260709 12:09:41.382303 22467 tablet_copy_service.cc:140] P c863116d91c14d1ca50d6e8a46a37a8f: Received BeginTabletCopySession request for tablet 10ed4486435d4f82978c5cb544504999 from peer 8701cd5186a949538d8efafb5f987270 ({username='slave'} at 127.0.0.1:34452)
I20260709 12:09:41.382840 22467 tablet_copy_service.cc:161] P c863116d91c14d1ca50d6e8a46a37a8f: Beginning new tablet copy session on tablet 10ed4486435d4f82978c5cb544504999 from peer 8701cd5186a949538d8efafb5f987270 at {username='slave'} at 127.0.0.1:34452: session id = 8701cd5186a949538d8efafb5f987270-10ed4486435d4f82978c5cb544504999
I20260709 12:09:41.382860 23461 tablet_bootstrap.cc:492] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:41.383955 23461 tablet_bootstrap.cc:492] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270: Bootstrap complete.
I20260709 12:09:41.384606 23461 ts_tablet_manager.cc:1403] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.010s
I20260709 12:09:41.387590 23461 raft_consensus.cc:359] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:41.388520 23461 raft_consensus.cc:740] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Initialized, Role: LEARNER
I20260709 12:09:41.389233 23461 consensus_queue.cc:260] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:41.392050 23461 ts_tablet_manager.cc:1434] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:09:41.395704 22542 tablet_copy_service.cc:342] P 1676e7af5e4a47cb86ee7db83e3d4881: Request end of tablet copy session 8701cd5186a949538d8efafb5f987270-bf783936508640219af47375c444da09 received from {username='slave'} at 127.0.0.1:38310
I20260709 12:09:41.396119 22542 tablet_copy_service.cc:434] P 1676e7af5e4a47cb86ee7db83e3d4881: ending tablet copy session 8701cd5186a949538d8efafb5f987270-bf783936508640219af47375c444da09 on tablet bf783936508640219af47375c444da09 with peer 8701cd5186a949538d8efafb5f987270
I20260709 12:09:41.396193 22467 tablet_copy_source_session.cc:215] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:41.401070 23459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10ed4486435d4f82978c5cb544504999. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:41.419293 23459 tablet_copy_client.cc:806] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:41.419927 23459 tablet_copy_client.cc:670] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:41.422626 23463 tablet_bootstrap.cc:492] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:41.423480 23459 tablet_copy_client.cc:538] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:41.423600 23463 tablet_bootstrap.cc:492] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270: Bootstrap complete.
I20260709 12:09:41.424548 23463 ts_tablet_manager.cc:1403] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.010s
I20260709 12:09:41.427557 23463 raft_consensus.cc:359] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:41.428320 23463 raft_consensus.cc:740] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Initialized, Role: LEARNER
I20260709 12:09:41.428906 23463 consensus_queue.cc:260] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:41.430933 23463 ts_tablet_manager.cc:1434] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.000s
I20260709 12:09:41.434530 23459 tablet_bootstrap.cc:492] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270: Bootstrap starting.
I20260709 12:09:41.439688 22467 tablet_copy_service.cc:342] P c863116d91c14d1ca50d6e8a46a37a8f: Request end of tablet copy session 8701cd5186a949538d8efafb5f987270-897c484d3dec40a296e097e6b8d26d39 received from {username='slave'} at 127.0.0.1:34452
I20260709 12:09:41.440142 22467 tablet_copy_service.cc:434] P c863116d91c14d1ca50d6e8a46a37a8f: ending tablet copy session 8701cd5186a949538d8efafb5f987270-897c484d3dec40a296e097e6b8d26d39 on tablet 897c484d3dec40a296e097e6b8d26d39 with peer 8701cd5186a949538d8efafb5f987270
I20260709 12:09:41.461901 23459 tablet_bootstrap.cc:492] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:41.462764 23459 tablet_bootstrap.cc:492] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270: Bootstrap complete.
I20260709 12:09:41.463442 23459 ts_tablet_manager.cc:1403] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270: Time spent bootstrapping tablet: real 0.029s	user 0.021s	sys 0.002s
I20260709 12:09:41.466007 23459 raft_consensus.cc:359] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:41.466639 23459 raft_consensus.cc:740] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Initialized, Role: LEARNER
I20260709 12:09:41.467308 23459 consensus_queue.cc:260] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:41.470093 23459 ts_tablet_manager.cc:1434] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:09:41.472041 22467 tablet_copy_service.cc:342] P c863116d91c14d1ca50d6e8a46a37a8f: Request end of tablet copy session 8701cd5186a949538d8efafb5f987270-10ed4486435d4f82978c5cb544504999 received from {username='slave'} at 127.0.0.1:34452
I20260709 12:09:41.472445 22467 tablet_copy_service.cc:434] P c863116d91c14d1ca50d6e8a46a37a8f: ending tablet copy session 8701cd5186a949538d8efafb5f987270-10ed4486435d4f82978c5cb544504999 on tablet 10ed4486435d4f82978c5cb544504999 with peer 8701cd5186a949538d8efafb5f987270
I20260709 12:09:41.629034 23125 raft_consensus.cc:1217] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:41.712680 23125 raft_consensus.cc:1217] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:41.799523 23125 raft_consensus.cc:1217] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:41.833220 23125 raft_consensus.cc:1217] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:42.063884 23406 raft_consensus.cc:1064] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
I20260709 12:09:42.066169 23406 consensus_queue.cc:237] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:42.073310 22602 raft_consensus.cc:1275] T 897c484d3dec40a296e097e6b8d26d39 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.073444 23124 raft_consensus.cc:1275] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.075186 23457 consensus_queue.cc:1048] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:42.076360 23439 consensus_queue.cc:1048] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:42.087213 22527 raft_consensus.cc:1275] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.089640 23473 consensus_queue.cc:1048] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:42.099495 23457 raft_consensus.cc:2955] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:42.102154 23124 raft_consensus.cc:2955] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:42.117519 22604 raft_consensus.cc:2955] T 897c484d3dec40a296e097e6b8d26d39 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:42.136744 22351 catalog_manager.cc:5697] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:42.147594 22527 raft_consensus.cc:2955] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:42.213409 22457 consensus_queue.cc:237] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:42.228678 23124 raft_consensus.cc:1275] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:42.232906 22529 raft_consensus.cc:1275] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:42.234122 23439 raft_consensus.cc:1064] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
I20260709 12:09:42.232744 23457 consensus_queue.cc:1048] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:42.236572 23439 consensus_queue.cc:237] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:42.241309 23473 consensus_queue.cc:1048] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:42.246091 23406 raft_consensus.cc:2955] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:42.248570 23124 raft_consensus.cc:2955] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:42.265362 22527 raft_consensus.cc:2955] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:42.273972 23407 raft_consensus.cc:1064] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
I20260709 12:09:42.279188 23125 raft_consensus.cc:1275] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.279188 22604 raft_consensus.cc:1275] T 10ed4486435d4f82978c5cb544504999 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.281737 23473 consensus_queue.cc:1048] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:42.281819 23407 consensus_queue.cc:237] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:42.282379 22527 raft_consensus.cc:1275] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.283783 23457 consensus_queue.cc:1048] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:42.285439 23457 consensus_queue.cc:1048] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:42.292107 22354 catalog_manager.cc:5697] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: config changed from index 3 to 4, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:42.308813 22594 tablet_service.cc:1558] Processing DeleteTablet for tablet 897c484d3dec40a296e097e6b8d26d39 with delete_type TABLET_DATA_TOMBSTONED (TS 6c6fa11e8ee34711b3551f0c670442bc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45546
I20260709 12:09:42.322278 23457 raft_consensus.cc:2955] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:42.332021 23125 raft_consensus.cc:2955] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:42.341161 23486 tablet_replica.cc:333] T 897c484d3dec40a296e097e6b8d26d39 P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:09:42.343916 23486 raft_consensus.cc:2243] T 897c484d3dec40a296e097e6b8d26d39 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:42.350811 22604 raft_consensus.cc:2955] T 10ed4486435d4f82978c5cb544504999 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:42.359548 22352 catalog_manager.cc:5697] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:42.369935 23486 raft_consensus.cc:2272] T 897c484d3dec40a296e097e6b8d26d39 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:42.370785 22339 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 897c484d3dec40a296e097e6b8d26d39 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:42.384407 23486 ts_tablet_manager.cc:1916] T 897c484d3dec40a296e097e6b8d26d39 P 6c6fa11e8ee34711b3551f0c670442bc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:42.410063 23435 raft_consensus.cc:1064] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
I20260709 12:09:42.409803 22527 raft_consensus.cc:2955] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:42.412845 23435 consensus_queue.cc:237] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:42.427134 22454 consensus_queue.cc:237] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:42.427627 23125 raft_consensus.cc:1275] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:09:42.428875 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 74826.2us
I20260709 12:09:42.429037 23489 consensus_queue.cc:1048] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:42.434366 23125 raft_consensus.cc:1275] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:42.438918 22529 raft_consensus.cc:1275] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:42.442955 23406 consensus_queue.cc:1048] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:42.444862 23406 consensus_queue.cc:1048] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:42.450012 22603 raft_consensus.cc:1275] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.452282 22457 raft_consensus.cc:1275] T bf783936508640219af47375c444da09 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.452665 22451 raft_consensus.cc:1275] T b205f960deef48f8bc84127a8b47faf4 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.455933 23435 consensus_queue.cc:1048] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:42.456344 22602 raft_consensus.cc:1275] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.457013 23487 consensus_queue.cc:1048] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:42.456437 23439 raft_consensus.cc:2955] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:42.463567 23489 consensus_queue.cc:1048] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:42.465700 23489 consensus_queue.cc:1048] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:42.466480 23123 raft_consensus.cc:2955] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:42.467923 23486 ts_tablet_manager.cc:1929] T 897c484d3dec40a296e097e6b8d26d39 P 6c6fa11e8ee34711b3551f0c670442bc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:42.468294 23486 log.cc:1199] T 897c484d3dec40a296e097e6b8d26d39 P 6c6fa11e8ee34711b3551f0c670442bc: Deleting WAL directory at /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-2-root/wals/897c484d3dec40a296e097e6b8d26d39
I20260709 12:09:42.467698 22527 raft_consensus.cc:2955] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:42.469726 22341 catalog_manager.cc:5028] TS 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): tablet 897c484d3dec40a296e097e6b8d26d39 (table test-workload [id=1e73b97ba677488c8829a696096f4885]) successfully deleted
I20260709 12:09:42.471840 23125 raft_consensus.cc:1275] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.473201 23491 consensus_queue.cc:1048] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:42.495524 22339 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 10ed4486435d4f82978c5cb544504999 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:42.507252 23487 raft_consensus.cc:2955] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:42.509249 23407 raft_consensus.cc:2955] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:42.514775 22457 raft_consensus.cc:2955] T bf783936508640219af47375c444da09 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:42.520439 22455 raft_consensus.cc:2955] T b205f960deef48f8bc84127a8b47faf4 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:42.532805 22603 raft_consensus.cc:2955] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:42.548175 23125 raft_consensus.cc:2955] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:42.568225 22601 raft_consensus.cc:2955] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:42.575318 23123 raft_consensus.cc:2955] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:42.581490 22354 catalog_manager.cc:5697] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 reported cstate change: config changed from index 3 to 4, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:42.587082 22353 catalog_manager.cc:5697] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:42.594727 22594 tablet_service.cc:1558] Processing DeleteTablet for tablet 10ed4486435d4f82978c5cb544504999 with delete_type TABLET_DATA_TOMBSTONED (TS 6c6fa11e8ee34711b3551f0c670442bc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45546
I20260709 12:09:42.596496 23486 tablet_replica.cc:333] T 10ed4486435d4f82978c5cb544504999 P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:09:42.597493 23486 raft_consensus.cc:2243] T 10ed4486435d4f82978c5cb544504999 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:42.598204 23486 raft_consensus.cc:2272] T 10ed4486435d4f82978c5cb544504999 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:42.605911 23486 ts_tablet_manager.cc:1916] T 10ed4486435d4f82978c5cb544504999 P 6c6fa11e8ee34711b3551f0c670442bc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:42.608007 22351 catalog_manager.cc:5697] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 reported cstate change: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:42.623924 23486 ts_tablet_manager.cc:1929] T 10ed4486435d4f82978c5cb544504999 P 6c6fa11e8ee34711b3551f0c670442bc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:42.624470 23486 log.cc:1199] T 10ed4486435d4f82978c5cb544504999 P 6c6fa11e8ee34711b3551f0c670442bc: Deleting WAL directory at /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-2-root/wals/10ed4486435d4f82978c5cb544504999
I20260709 12:09:42.626314 22341 catalog_manager.cc:5028] TS 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): tablet 10ed4486435d4f82978c5cb544504999 (table test-workload [id=1e73b97ba677488c8829a696096f4885]) successfully deleted
I20260709 12:09:42.634574 22527 consensus_queue.cc:237] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:42.634783 22529 consensus_queue.cc:237] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:42.639997 22601 raft_consensus.cc:1275] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:42.640385 22604 raft_consensus.cc:1275] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:42.641960 23491 consensus_queue.cc:1048] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:42.642853 23407 consensus_queue.cc:1048] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:42.643153 23125 raft_consensus.cc:1275] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:42.653921 23407 consensus_queue.cc:1048] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:42.655690 23123 raft_consensus.cc:1275] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:42.658234 23488 raft_consensus.cc:2955] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:42.663681 23435 consensus_queue.cc:1048] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:42.667840 22604 raft_consensus.cc:2955] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:42.676862 23487 raft_consensus.cc:2955] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:42.678118 23125 raft_consensus.cc:2955] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:42.682156 22601 raft_consensus.cc:2955] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:42.703322 22340 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bf783936508640219af47375c444da09 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:42.706409 23123 raft_consensus.cc:2955] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:42.708252 22354 catalog_manager.cc:5697] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: config changed from index 3 to 4, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:42.723686 22340 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b205f960deef48f8bc84127a8b47faf4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:42.746129 22442 tablet_service.cc:1558] Processing DeleteTablet for tablet bf783936508640219af47375c444da09 with delete_type TABLET_DATA_TOMBSTONED (TS c863116d91c14d1ca50d6e8a46a37a8f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51832
I20260709 12:09:42.753536 22354 catalog_manager.cc:5697] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: config changed from index 3 to 4, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:42.755265 23501 tablet_replica.cc:333] T bf783936508640219af47375c444da09 P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:09:42.756315 23501 raft_consensus.cc:2243] T bf783936508640219af47375c444da09 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:42.757069 23501 raft_consensus.cc:2272] T bf783936508640219af47375c444da09 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:42.761498 23501 ts_tablet_manager.cc:1916] T bf783936508640219af47375c444da09 P c863116d91c14d1ca50d6e8a46a37a8f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:42.779420 22442 tablet_service.cc:1558] Processing DeleteTablet for tablet b205f960deef48f8bc84127a8b47faf4 with delete_type TABLET_DATA_TOMBSTONED (TS c863116d91c14d1ca50d6e8a46a37a8f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51832
I20260709 12:09:42.781245 23501 ts_tablet_manager.cc:1929] T bf783936508640219af47375c444da09 P c863116d91c14d1ca50d6e8a46a37a8f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:42.781626 23501 log.cc:1199] T bf783936508640219af47375c444da09 P c863116d91c14d1ca50d6e8a46a37a8f: Deleting WAL directory at /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-0-root/wals/bf783936508640219af47375c444da09
I20260709 12:09:42.783138 22339 catalog_manager.cc:5028] TS c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): tablet bf783936508640219af47375c444da09 (table test-workload [id=1e73b97ba677488c8829a696096f4885]) successfully deleted
I20260709 12:09:42.783274 23501 tablet_replica.cc:333] T b205f960deef48f8bc84127a8b47faf4 P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:09:42.784106 23501 raft_consensus.cc:2243] T b205f960deef48f8bc84127a8b47faf4 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:42.784693 23501 raft_consensus.cc:2272] T b205f960deef48f8bc84127a8b47faf4 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:42.787425 23501 ts_tablet_manager.cc:1916] T b205f960deef48f8bc84127a8b47faf4 P c863116d91c14d1ca50d6e8a46a37a8f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:42.797951 23501 ts_tablet_manager.cc:1929] T b205f960deef48f8bc84127a8b47faf4 P c863116d91c14d1ca50d6e8a46a37a8f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:42.798291 23501 log.cc:1199] T b205f960deef48f8bc84127a8b47faf4 P c863116d91c14d1ca50d6e8a46a37a8f: Deleting WAL directory at /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-0-root/wals/b205f960deef48f8bc84127a8b47faf4
I20260709 12:09:42.799542 22339 catalog_manager.cc:5028] TS c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): tablet b205f960deef48f8bc84127a8b47faf4 (table test-workload [id=1e73b97ba677488c8829a696096f4885]) successfully deleted
I20260709 12:09:44.634711 23511 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:09:44.635514 23511 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:44.638351 23511 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:44.639454 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:44.645170 23515 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:09:44.645730 23515 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:44.649864 23515 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:44.651603 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:44.654405 22605 consensus_queue.cc:237] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
W20260709 12:09:44.669852 22570 consensus_peers.cc:597] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 60b63fe1f8174bdab922fc97591f1860. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:44.669898 22452 raft_consensus.cc:1275] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:44.671249 23508 consensus_queue.cc:1048] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:44.682245 23508 raft_consensus.cc:2955] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:44.683938 22527 raft_consensus.cc:1275] T 60b63fe1f8174bdab922fc97591f1860 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:44.688442 22452 raft_consensus.cc:2955] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:44.699831 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:44.701609 23509 consensus_queue.cc:1048] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:44.704902 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:44.710384 23088 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:09:44.711879 23511 raft_consensus.cc:2749] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:44.713335 22351 catalog_manager.cc:5697] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New cstate: current_term: 1 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:44.720932 22495 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:44.721856 23513 raft_consensus.cc:2749] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:44.725785 22527 raft_consensus.cc:2955] T 60b63fe1f8174bdab922fc97591f1860 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:44.726204 22456 consensus_queue.cc:237] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
W20260709 12:09:44.734767 22421 consensus_peers.cc:597] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cfdc6a19d6fc4ae7b122bc59c5d22aa0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:44.736291 22604 raft_consensus.cc:1275] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:44.737033 22531 raft_consensus.cc:1275] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:44.737389 23512 consensus_queue.cc:1048] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:44.739141 23512 consensus_queue.cc:1048] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:44.767379 23512 raft_consensus.cc:2955] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:44.769134 22531 raft_consensus.cc:2955] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:44.776827 22604 raft_consensus.cc:2955] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:44.781533 22605 consensus_queue.cc:237] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:44.783068 22351 catalog_manager.cc:5697] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:44.789824 22570 consensus_peers.cc:597] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 538826f1cb47443eb083fb9360e7b1fb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:44.790782 22531 raft_consensus.cc:1275] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:44.791313 22456 raft_consensus.cc:1275] T 538826f1cb47443eb083fb9360e7b1fb P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:44.792243 23508 consensus_queue.cc:1048] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:44.793030 23509 consensus_queue.cc:1048] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:44.804286 23508 raft_consensus.cc:2955] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:44.806049 22531 raft_consensus.cc:2955] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:44.808794 22456 raft_consensus.cc:2955] T 538826f1cb47443eb083fb9360e7b1fb P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:44.827301 22531 consensus_queue.cc:237] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:44.825733 22354 catalog_manager.cc:5697] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New cstate: current_term: 1 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:44.837497 22496 consensus_peers.cc:597] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3aebfd8b04a4461ab6bc979eee23a2bc. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:44.838416 22605 raft_consensus.cc:1275] T 3aebfd8b04a4461ab6bc979eee23a2bc P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:44.840205 23513 consensus_queue.cc:1048] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:44.842581 22456 raft_consensus.cc:1275] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:44.844480 23514 consensus_queue.cc:1048] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:44.850461 23435 raft_consensus.cc:2955] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:44.853411 22605 raft_consensus.cc:2955] T 3aebfd8b04a4461ab6bc979eee23a2bc P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:44.869973 22354 catalog_manager.cc:5697] T 3aebfd8b04a4461ab6bc979eee23a2bc P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:44.871765 22456 raft_consensus.cc:2955] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:45.270224 23536 ts_tablet_manager.cc:933] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:45.273661 23536 tablet_copy_client.cc:323] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270: tablet copy: Beginning tablet copy session from remote peer at address 127.20.196.131:37785
I20260709 12:09:45.276248 22615 tablet_copy_service.cc:140] P 6c6fa11e8ee34711b3551f0c670442bc: Received BeginTabletCopySession request for tablet 60b63fe1f8174bdab922fc97591f1860 from peer 8701cd5186a949538d8efafb5f987270 ({username='slave'} at 127.0.0.1:43070)
I20260709 12:09:45.277030 22615 tablet_copy_service.cc:161] P 6c6fa11e8ee34711b3551f0c670442bc: Beginning new tablet copy session on tablet 60b63fe1f8174bdab922fc97591f1860 from peer 8701cd5186a949538d8efafb5f987270 at {username='slave'} at 127.0.0.1:43070: session id = 8701cd5186a949538d8efafb5f987270-60b63fe1f8174bdab922fc97591f1860
I20260709 12:09:45.288255 22615 tablet_copy_source_session.cc:215] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:45.292312 23536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60b63fe1f8174bdab922fc97591f1860. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:45.305007 23536 tablet_copy_client.cc:806] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:45.305614 23536 tablet_copy_client.cc:670] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:45.309551 23539 ts_tablet_manager.cc:933] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317)
I20260709 12:09:45.309813 23536 tablet_copy_client.cc:538] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:45.311625 23539 tablet_copy_client.cc:323] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270: tablet copy: Beginning tablet copy session from remote peer at address 127.20.196.129:42317
I20260709 12:09:45.313441 22467 tablet_copy_service.cc:140] P c863116d91c14d1ca50d6e8a46a37a8f: Received BeginTabletCopySession request for tablet cfdc6a19d6fc4ae7b122bc59c5d22aa0 from peer 8701cd5186a949538d8efafb5f987270 ({username='slave'} at 127.0.0.1:34452)
I20260709 12:09:45.313964 22467 tablet_copy_service.cc:161] P c863116d91c14d1ca50d6e8a46a37a8f: Beginning new tablet copy session on tablet cfdc6a19d6fc4ae7b122bc59c5d22aa0 from peer 8701cd5186a949538d8efafb5f987270 at {username='slave'} at 127.0.0.1:34452: session id = 8701cd5186a949538d8efafb5f987270-cfdc6a19d6fc4ae7b122bc59c5d22aa0
I20260709 12:09:45.319638 23536 tablet_bootstrap.cc:492] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270: Bootstrap starting.
I20260709 12:09:45.324268 22467 tablet_copy_source_session.cc:215] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:45.335186 23539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfdc6a19d6fc4ae7b122bc59c5d22aa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:45.350276 23536 tablet_bootstrap.cc:492] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:45.351275 23536 tablet_bootstrap.cc:492] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270: Bootstrap complete.
I20260709 12:09:45.351951 23536 ts_tablet_manager.cc:1403] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270: Time spent bootstrapping tablet: real 0.033s	user 0.021s	sys 0.005s
I20260709 12:09:45.352625 23539 tablet_copy_client.cc:806] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:45.353283 23539 tablet_copy_client.cc:670] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:45.355929 23536 raft_consensus.cc:359] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:45.357797 23539 tablet_copy_client.cc:538] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:45.357277 23536 raft_consensus.cc:740] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Initialized, Role: LEARNER
I20260709 12:09:45.358672 23536 consensus_queue.cc:260] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:45.369966 23539 tablet_bootstrap.cc:492] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270: Bootstrap starting.
I20260709 12:09:45.377373 23542 ts_tablet_manager.cc:933] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:45.418745 23536 ts_tablet_manager.cc:1434] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270: Time spent starting tablet: real 0.065s	user 0.013s	sys 0.000s
I20260709 12:09:45.424134 22615 tablet_copy_service.cc:342] P 6c6fa11e8ee34711b3551f0c670442bc: Request end of tablet copy session 8701cd5186a949538d8efafb5f987270-60b63fe1f8174bdab922fc97591f1860 received from {username='slave'} at 127.0.0.1:43070
I20260709 12:09:45.424687 22615 tablet_copy_service.cc:434] P 6c6fa11e8ee34711b3551f0c670442bc: ending tablet copy session 8701cd5186a949538d8efafb5f987270-60b63fe1f8174bdab922fc97591f1860 on tablet 60b63fe1f8174bdab922fc97591f1860 with peer 8701cd5186a949538d8efafb5f987270
I20260709 12:09:45.432204 23545 ts_tablet_manager.cc:933] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:45.441056 23542 tablet_copy_client.cc:323] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270: tablet copy: Beginning tablet copy session from remote peer at address 127.20.196.130:42733
I20260709 12:09:45.443820 22542 tablet_copy_service.cc:140] P 1676e7af5e4a47cb86ee7db83e3d4881: Received BeginTabletCopySession request for tablet 3aebfd8b04a4461ab6bc979eee23a2bc from peer 8701cd5186a949538d8efafb5f987270 ({username='slave'} at 127.0.0.1:38310)
I20260709 12:09:45.444429 22542 tablet_copy_service.cc:161] P 1676e7af5e4a47cb86ee7db83e3d4881: Beginning new tablet copy session on tablet 3aebfd8b04a4461ab6bc979eee23a2bc from peer 8701cd5186a949538d8efafb5f987270 at {username='slave'} at 127.0.0.1:38310: session id = 8701cd5186a949538d8efafb5f987270-3aebfd8b04a4461ab6bc979eee23a2bc
I20260709 12:09:45.445133 23545 tablet_copy_client.cc:323] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270: tablet copy: Beginning tablet copy session from remote peer at address 127.20.196.131:37785
I20260709 12:09:45.451311 22615 tablet_copy_service.cc:140] P 6c6fa11e8ee34711b3551f0c670442bc: Received BeginTabletCopySession request for tablet 538826f1cb47443eb083fb9360e7b1fb from peer 8701cd5186a949538d8efafb5f987270 ({username='slave'} at 127.0.0.1:43070)
I20260709 12:09:45.451844 22615 tablet_copy_service.cc:161] P 6c6fa11e8ee34711b3551f0c670442bc: Beginning new tablet copy session on tablet 538826f1cb47443eb083fb9360e7b1fb from peer 8701cd5186a949538d8efafb5f987270 at {username='slave'} at 127.0.0.1:43070: session id = 8701cd5186a949538d8efafb5f987270-538826f1cb47443eb083fb9360e7b1fb
I20260709 12:09:45.466144 22542 tablet_copy_source_session.cc:215] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:45.467875 22615 tablet_copy_source_session.cc:215] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:45.473193 23542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3aebfd8b04a4461ab6bc979eee23a2bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:45.483057 23545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 538826f1cb47443eb083fb9360e7b1fb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:45.499869 22627 debug-util.cc:398] Leaking SignalData structure 0x7b08001e3aa0 after lost signal to thread 21269
W20260709 12:09:45.502202 22627 debug-util.cc:398] Leaking SignalData structure 0x7b08000b9e40 after lost signal to thread 22389
W20260709 12:09:45.504031 22627 debug-util.cc:398] Leaking SignalData structure 0x7b08002f7160 after lost signal to thread 22481
W20260709 12:09:45.505329 22627 debug-util.cc:398] Leaking SignalData structure 0x7b08002b7300 after lost signal to thread 22556
W20260709 12:09:45.506713 22627 debug-util.cc:398] Leaking SignalData structure 0x7b08002bb480 after lost signal to thread 22630
I20260709 12:09:45.509765 23542 tablet_copy_client.cc:806] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:45.510383 23542 tablet_copy_client.cc:670] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:45.521991 23542 tablet_copy_client.cc:538] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:45.542964 23539 tablet_bootstrap.cc:492] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:45.547506 23539 tablet_bootstrap.cc:492] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270: Bootstrap complete.
I20260709 12:09:45.548348 23539 ts_tablet_manager.cc:1403] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270: Time spent bootstrapping tablet: real 0.179s	user 0.023s	sys 0.030s
W20260709 12:09:45.548605 22627 debug-util.cc:398] Leaking SignalData structure 0x7b08002f2420 after lost signal to thread 23149
I20260709 12:09:45.550884 23539 raft_consensus.cc:359] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:45.551543 23542 tablet_bootstrap.cc:492] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270: Bootstrap starting.
I20260709 12:09:45.551751 23539 raft_consensus.cc:740] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Initialized, Role: LEARNER
I20260709 12:09:45.552451 23539 consensus_queue.cc:260] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:45.566044 23539 ts_tablet_manager.cc:1434] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270: Time spent starting tablet: real 0.017s	user 0.000s	sys 0.005s
I20260709 12:09:45.567694 22467 tablet_copy_service.cc:342] P c863116d91c14d1ca50d6e8a46a37a8f: Request end of tablet copy session 8701cd5186a949538d8efafb5f987270-cfdc6a19d6fc4ae7b122bc59c5d22aa0 received from {username='slave'} at 127.0.0.1:34452
I20260709 12:09:45.568109 22467 tablet_copy_service.cc:434] P c863116d91c14d1ca50d6e8a46a37a8f: ending tablet copy session 8701cd5186a949538d8efafb5f987270-cfdc6a19d6fc4ae7b122bc59c5d22aa0 on tablet cfdc6a19d6fc4ae7b122bc59c5d22aa0 with peer 8701cd5186a949538d8efafb5f987270
I20260709 12:09:45.578259 23545 tablet_copy_client.cc:806] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:45.581568 23545 tablet_copy_client.cc:670] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:45.585471 23545 tablet_copy_client.cc:538] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:45.610913 23545 tablet_bootstrap.cc:492] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270: Bootstrap starting.
I20260709 12:09:45.642593 23125 raft_consensus.cc:1217] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:45.725659 23545 tablet_bootstrap.cc:492] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:45.735870 23545 tablet_bootstrap.cc:492] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270: Bootstrap complete.
I20260709 12:09:45.736649 23545 ts_tablet_manager.cc:1403] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270: Time spent bootstrapping tablet: real 0.126s	user 0.022s	sys 0.006s
I20260709 12:09:45.740200 23545 raft_consensus.cc:359] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:45.741252 23545 raft_consensus.cc:740] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Initialized, Role: LEARNER
I20260709 12:09:45.742688 23542 tablet_bootstrap.cc:492] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:45.741983 23545 consensus_queue.cc:260] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:45.743721 23542 tablet_bootstrap.cc:492] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270: Bootstrap complete.
I20260709 12:09:45.744437 23542 ts_tablet_manager.cc:1403] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270: Time spent bootstrapping tablet: real 0.193s	user 0.072s	sys 0.090s
I20260709 12:09:45.747594 23542 raft_consensus.cc:359] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:45.748406 23542 raft_consensus.cc:740] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Initialized, Role: LEARNER
I20260709 12:09:45.751047 23545 ts_tablet_manager.cc:1434] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:09:45.751729 23542 consensus_queue.cc:260] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:45.753314 22615 tablet_copy_service.cc:342] P 6c6fa11e8ee34711b3551f0c670442bc: Request end of tablet copy session 8701cd5186a949538d8efafb5f987270-538826f1cb47443eb083fb9360e7b1fb received from {username='slave'} at 127.0.0.1:43070
I20260709 12:09:45.753885 22615 tablet_copy_service.cc:434] P 6c6fa11e8ee34711b3551f0c670442bc: ending tablet copy session 8701cd5186a949538d8efafb5f987270-538826f1cb47443eb083fb9360e7b1fb on tablet 538826f1cb47443eb083fb9360e7b1fb with peer 8701cd5186a949538d8efafb5f987270
I20260709 12:09:45.754680 23542 ts_tablet_manager.cc:1434] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:09:45.759292 22542 tablet_copy_service.cc:342] P 1676e7af5e4a47cb86ee7db83e3d4881: Request end of tablet copy session 8701cd5186a949538d8efafb5f987270-3aebfd8b04a4461ab6bc979eee23a2bc received from {username='slave'} at 127.0.0.1:38310
I20260709 12:09:45.759711 22542 tablet_copy_service.cc:434] P 1676e7af5e4a47cb86ee7db83e3d4881: ending tablet copy session 8701cd5186a949538d8efafb5f987270-3aebfd8b04a4461ab6bc979eee23a2bc on tablet 3aebfd8b04a4461ab6bc979eee23a2bc with peer 8701cd5186a949538d8efafb5f987270
I20260709 12:09:45.773646 23122 raft_consensus.cc:1217] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:45.854028 23122 raft_consensus.cc:1217] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:45.962610 23122 raft_consensus.cc:1217] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:46.230680 23438 raft_consensus.cc:1064] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
I20260709 12:09:46.233970 23438 consensus_queue.cc:237] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:46.245378 23507 raft_consensus.cc:1064] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
I20260709 12:09:46.252108 23507 consensus_queue.cc:237] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:46.257129 22452 raft_consensus.cc:1275] T 538826f1cb47443eb083fb9360e7b1fb P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:46.261022 22527 raft_consensus.cc:1275] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:46.267413 23508 consensus_queue.cc:1048] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:46.262473 23122 raft_consensus.cc:1275] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:46.283350 23508 consensus_queue.cc:1048] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:46.285737 23552 consensus_queue.cc:1048] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:46.290627 22452 raft_consensus.cc:1275] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:46.292352 23508 consensus_queue.cc:1048] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:46.293535 22527 raft_consensus.cc:1275] T 60b63fe1f8174bdab922fc97591f1860 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:46.295289 23122 raft_consensus.cc:1275] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:46.295878 23438 consensus_queue.cc:1048] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:46.299434 23438 consensus_queue.cc:1048] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:46.311340 23507 raft_consensus.cc:2955] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:46.318774 22531 raft_consensus.cc:2955] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:46.314810 23123 raft_consensus.cc:2955] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:46.331151 22451 raft_consensus.cc:2955] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:46.333088 22531 raft_consensus.cc:2955] T 60b63fe1f8174bdab922fc97591f1860 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:46.329170 23438 raft_consensus.cc:2955] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:46.385238 23505 raft_consensus.cc:1064] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
I20260709 12:09:46.387990 23505 consensus_queue.cc:237] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:46.345412 22351 catalog_manager.cc:5697] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:46.402158 23513 raft_consensus.cc:1064] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
W20260709 12:09:46.403223 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 56832.7us
I20260709 12:09:46.402698 22451 raft_consensus.cc:2955] T 538826f1cb47443eb083fb9360e7b1fb P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:46.404846 23513 consensus_queue.cc:237] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:46.416962 23123 raft_consensus.cc:2955] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:46.425398 22353 catalog_manager.cc:5697] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:46.432996 22604 raft_consensus.cc:1275] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:46.433923 23122 raft_consensus.cc:1275] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:46.434597 23505 consensus_queue.cc:1048] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:46.438823 23505 consensus_queue.cc:1048] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:46.437080 22527 raft_consensus.cc:1275] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:46.455843 23510 consensus_queue.cc:1048] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:46.461532 22602 raft_consensus.cc:1275] T 3aebfd8b04a4461ab6bc979eee23a2bc P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:46.463658 22452 raft_consensus.cc:1275] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:46.464483 23122 raft_consensus.cc:1275] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:46.466289 23488 consensus_queue.cc:1048] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:46.470374 23535 consensus_queue.cc:1048] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:46.493331 23513 consensus_queue.cc:1048] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:46.505862 23510 raft_consensus.cc:2955] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:46.508287 22527 raft_consensus.cc:2955] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:46.521487 23561 raft_consensus.cc:2955] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:46.542083 23122 raft_consensus.cc:2955] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:46.567212 22601 raft_consensus.cc:2955] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:46.576221 23125 raft_consensus.cc:2955] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:46.579582 22452 raft_consensus.cc:2955] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:46.595419 22604 raft_consensus.cc:2955] T 3aebfd8b04a4461ab6bc979eee23a2bc P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:46.653342 22352 catalog_manager.cc:5697] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 reported cstate change: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:46.655632 22352 catalog_manager.cc:5697] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 reported cstate change: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:46.667034 22601 consensus_queue.cc:237] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:46.685606 22531 consensus_queue.cc:237] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:46.687160 23122 raft_consensus.cc:1275] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:46.688778 23552 consensus_queue.cc:1048] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:46.696677 23552 raft_consensus.cc:2955] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:46.699553 22527 raft_consensus.cc:1275] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:46.701254 23507 consensus_queue.cc:1048] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:46.705240 22527 raft_consensus.cc:2955] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:46.708098 22452 raft_consensus.cc:1275] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:46.708455 23125 raft_consensus.cc:2955] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:46.710783 23123 raft_consensus.cc:1275] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:46.716913 22341 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 538826f1cb47443eb083fb9360e7b1fb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:46.716264 23488 consensus_queue.cc:1048] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:09:46.720145 23561 consensus_queue.cc:1048] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:46.730690 23435 raft_consensus.cc:2955] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:46.734526 22602 consensus_queue.cc:237] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:46.739137 22352 catalog_manager.cc:5697] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 reported cstate change: config changed from index 3 to 4, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New cstate: current_term: 1 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:46.749776 23120 raft_consensus.cc:1275] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:46.749625 23123 raft_consensus.cc:2955] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:46.744565 22452 raft_consensus.cc:2955] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
W20260709 12:09:46.751255 22341 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 538826f1cb47443eb083fb9360e7b1fb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 4
I20260709 12:09:46.754125 22454 raft_consensus.cc:1275] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:46.755761 23507 consensus_queue.cc:1048] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:46.757639 23438 consensus_queue.cc:1048] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:46.765123 23508 raft_consensus.cc:2955] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:46.766662 23122 raft_consensus.cc:2955] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:46.767233 22451 raft_consensus.cc:2955] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:46.772028 22442 tablet_service.cc:1558] Processing DeleteTablet for tablet 538826f1cb47443eb083fb9360e7b1fb with delete_type TABLET_DATA_TOMBSTONED (TS c863116d91c14d1ca50d6e8a46a37a8f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51832
I20260709 12:09:46.777451 22354 catalog_manager.cc:5697] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 reported cstate change: config changed from index 3 to 4, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:46.785487 22340 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3aebfd8b04a4461ab6bc979eee23a2bc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:46.788165 22594 tablet_service.cc:1558] Processing DeleteTablet for tablet 3aebfd8b04a4461ab6bc979eee23a2bc with delete_type TABLET_DATA_TOMBSTONED (TS 6c6fa11e8ee34711b3551f0c670442bc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45546
I20260709 12:09:46.801324 22352 catalog_manager.cc:5697] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 reported cstate change: config changed from index 3 to 4, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New cstate: current_term: 1 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:46.811739 22341 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 60b63fe1f8174bdab922fc97591f1860 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:46.812775 22517 tablet_service.cc:1558] Processing DeleteTablet for tablet 60b63fe1f8174bdab922fc97591f1860 with delete_type TABLET_DATA_TOMBSTONED (TS 1676e7af5e4a47cb86ee7db83e3d4881 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56928
I20260709 12:09:46.832334 23576 tablet_replica.cc:333] T 538826f1cb47443eb083fb9360e7b1fb P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:09:46.833501 22451 consensus_queue.cc:237] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:46.834213 23578 tablet_replica.cc:333] T 60b63fe1f8174bdab922fc97591f1860 P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:09:46.835470 23578 raft_consensus.cc:2243] T 60b63fe1f8174bdab922fc97591f1860 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:46.837102 23577 tablet_replica.cc:333] T 3aebfd8b04a4461ab6bc979eee23a2bc P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:09:46.837301 23578 raft_consensus.cc:2272] T 60b63fe1f8174bdab922fc97591f1860 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:46.838269 23577 raft_consensus.cc:2243] T 3aebfd8b04a4461ab6bc979eee23a2bc P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:46.839422 23122 raft_consensus.cc:1275] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:46.842468 23577 raft_consensus.cc:2272] T 3aebfd8b04a4461ab6bc979eee23a2bc P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:46.845701 23576 raft_consensus.cc:2243] T 538826f1cb47443eb083fb9360e7b1fb P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:46.845979 22602 raft_consensus.cc:1275] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:46.846396 23576 raft_consensus.cc:2272] T 538826f1cb47443eb083fb9360e7b1fb P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:46.849058 23578 ts_tablet_manager.cc:1916] T 60b63fe1f8174bdab922fc97591f1860 P 1676e7af5e4a47cb86ee7db83e3d4881: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:46.848845 23573 consensus_queue.cc:1048] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:46.850088 23576 ts_tablet_manager.cc:1916] T 538826f1cb47443eb083fb9360e7b1fb P c863116d91c14d1ca50d6e8a46a37a8f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:46.857650 23512 consensus_queue.cc:1048] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:46.872529 22604 raft_consensus.cc:2955] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:46.873520 23122 raft_consensus.cc:2955] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:46.878708 23577 ts_tablet_manager.cc:1916] T 3aebfd8b04a4461ab6bc979eee23a2bc P 6c6fa11e8ee34711b3551f0c670442bc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:46.898576 22353 catalog_manager.cc:5697] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: config changed from index 3 to 4, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:46.870499 23573 raft_consensus.cc:2955] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:46.923197 23576 ts_tablet_manager.cc:1929] T 538826f1cb47443eb083fb9360e7b1fb P c863116d91c14d1ca50d6e8a46a37a8f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:46.932360 23576 log.cc:1199] T 538826f1cb47443eb083fb9360e7b1fb P c863116d91c14d1ca50d6e8a46a37a8f: Deleting WAL directory at /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-0-root/wals/538826f1cb47443eb083fb9360e7b1fb
I20260709 12:09:46.934854 22517 tablet_service.cc:1558] Processing DeleteTablet for tablet cfdc6a19d6fc4ae7b122bc59c5d22aa0 with delete_type TABLET_DATA_TOMBSTONED (TS 1676e7af5e4a47cb86ee7db83e3d4881 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56928
I20260709 12:09:46.935948 22339 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cfdc6a19d6fc4ae7b122bc59c5d22aa0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:46.931789 23577 ts_tablet_manager.cc:1929] T 3aebfd8b04a4461ab6bc979eee23a2bc P 6c6fa11e8ee34711b3551f0c670442bc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:46.937302 22339 catalog_manager.cc:5028] TS c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): tablet 538826f1cb47443eb083fb9360e7b1fb (table test-workload [id=1e73b97ba677488c8829a696096f4885]) successfully deleted
I20260709 12:09:46.938880 23577 log.cc:1199] T 3aebfd8b04a4461ab6bc979eee23a2bc P 6c6fa11e8ee34711b3551f0c670442bc: Deleting WAL directory at /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-2-root/wals/3aebfd8b04a4461ab6bc979eee23a2bc
I20260709 12:09:46.940881 22341 catalog_manager.cc:5028] TS 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): tablet 3aebfd8b04a4461ab6bc979eee23a2bc (table test-workload [id=1e73b97ba677488c8829a696096f4885]) successfully deleted
I20260709 12:09:46.951421 23578 ts_tablet_manager.cc:1929] T 60b63fe1f8174bdab922fc97591f1860 P 1676e7af5e4a47cb86ee7db83e3d4881: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:46.952142 23578 log.cc:1199] T 60b63fe1f8174bdab922fc97591f1860 P 1676e7af5e4a47cb86ee7db83e3d4881: Deleting WAL directory at /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-1-root/wals/60b63fe1f8174bdab922fc97591f1860
I20260709 12:09:46.954193 22340 catalog_manager.cc:5028] TS 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): tablet 60b63fe1f8174bdab922fc97591f1860 (table test-workload [id=1e73b97ba677488c8829a696096f4885]) successfully deleted
I20260709 12:09:46.954290 23578 tablet_replica.cc:333] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:09:46.955571 23578 raft_consensus.cc:2243] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:46.956298 23578 raft_consensus.cc:2272] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:46.961100 23578 ts_tablet_manager.cc:1916] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 1676e7af5e4a47cb86ee7db83e3d4881: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:46.983767 23578 ts_tablet_manager.cc:1929] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 1676e7af5e4a47cb86ee7db83e3d4881: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:46.985457 23578 log.cc:1199] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 1676e7af5e4a47cb86ee7db83e3d4881: Deleting WAL directory at /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-1-root/wals/cfdc6a19d6fc4ae7b122bc59c5d22aa0
I20260709 12:09:46.987304 22340 catalog_manager.cc:5028] TS 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): tablet cfdc6a19d6fc4ae7b122bc59c5d22aa0 (table test-workload [id=1e73b97ba677488c8829a696096f4885]) successfully deleted
I20260709 12:09:47.320626 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:47.390744 22451 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10ed4486435d4f82978c5cb544504999"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:44568
I20260709 12:09:47.391383 22451 raft_consensus.cc:606] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:09:47.412987 22527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:39980
I20260709 12:09:47.413587 22527 raft_consensus.cc:606] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Received request to transfer leadership to TS 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:09:47.416221 22527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:39980
I20260709 12:09:47.416757 22527 raft_consensus.cc:606] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:09:47.419389 22527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:39980
I20260709 12:09:47.419935 22527 raft_consensus.cc:606] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:09:47.422515 22527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:39980
I20260709 12:09:47.423063 22527 raft_consensus.cc:606] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Received request to transfer leadership to TS 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:09:47.426244 22527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:39980
I20260709 12:09:47.426736 22527 raft_consensus.cc:606] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Received request to transfer leadership to TS 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:09:47.427659 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:09:47.429448 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:47.430491 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:47.541594 23561 raft_consensus.cc:993] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881: : Instructing follower 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:09:47.542183 23561 raft_consensus.cc:1081] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Signalling peer 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:09:47.543790 22602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:45576
I20260709 12:09:47.544428 22602 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:47.544770 22602 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.552503 22602 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:47.554956 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:47.555598 22602 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:47.555704 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:47.556259 22531 raft_consensus.cc:3055] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:47.556519 22531 raft_consensus.cc:740] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:47.557102 22531 consensus_queue.cc:260] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:47.557734 22531 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.555671 22451 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.565747 22531 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:09:47.567790 22570 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:09:47.568606 23552 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:47.569252 23552 raft_consensus.cc:697] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:09:47.570117 23552 consensus_queue.cc:237] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:47.573762 22451 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:09:47.583501 22353 catalog_manager.cc:5697] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 1 to 2, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 2 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:47.618471 23582 raft_consensus.cc:993] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881: : Instructing follower 8701cd5186a949538d8efafb5f987270 to start an election
I20260709 12:09:47.619092 23561 raft_consensus.cc:1081] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Signalling peer 8701cd5186a949538d8efafb5f987270 to start an election
I20260709 12:09:47.620699 23122 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931"
dest_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:57332
I20260709 12:09:47.621145 23122 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:47.621420 23122 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.625737 23122 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:47.627465 23122 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:47.628286 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:47.628803 22451 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.629021 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:47.629591 22531 raft_consensus.cc:3055] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:47.629915 22531 raft_consensus.cc:740] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:47.630676 22531 consensus_queue.cc:260] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:47.631923 22531 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.634728 22451 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 2.
I20260709 12:09:47.636022 23087 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:47.639746 22531 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 2.
I20260709 12:09:47.641287 23587 raft_consensus.cc:2804] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:47.642750 23587 raft_consensus.cc:697] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 2 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:09:47.643774 23587 consensus_queue.cc:237] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:47.657567 22353 catalog_manager.cc:5697] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 1 to 2, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 2 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:47.683763 23582 raft_consensus.cc:993] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881: : Instructing follower 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:09:47.684253 23582 raft_consensus.cc:1081] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Signalling peer 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:09:47.685493 23435 raft_consensus.cc:993] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881: : Instructing follower 8701cd5186a949538d8efafb5f987270 to start an election
I20260709 12:09:47.685997 23565 raft_consensus.cc:1081] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Signalling peer 8701cd5186a949538d8efafb5f987270 to start an election
I20260709 12:09:47.687063 23565 raft_consensus.cc:993] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881: : Instructing follower 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:09:47.687479 23565 raft_consensus.cc:1081] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Signalling peer 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:09:47.688382 23122 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff"
dest_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:57332
I20260709 12:09:47.688963 23122 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:47.689291 23122 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.690958 22602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:45576
I20260709 12:09:47.691512 22602 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:47.691846 22602 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.696699 23122 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:47.699504 23122 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:47.699800 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:47.700371 22451 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.700551 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:47.701085 22527 raft_consensus.cc:3055] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:47.701337 22527 raft_consensus.cc:740] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:47.702018 22527 consensus_queue.cc:260] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:47.703044 22527 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.703364 22605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:45576
I20260709 12:09:47.703872 22605 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:47.704218 22605 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.713253 22527 raft_consensus.cc:2468] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 2.
I20260709 12:09:47.714429 23088 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:09:47.715622 23587 raft_consensus.cc:2804] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:47.716555 23587 raft_consensus.cc:697] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 2 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:09:47.717785 22605 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:47.721773 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:47.722317 22454 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.717458 23587 consensus_queue.cc:237] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:47.726655 22602 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:47.729429 22454 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:09:47.730492 22569 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:47.730836 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:47.731271 23552 raft_consensus.cc:2804] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:47.731521 22456 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.731809 23552 raft_consensus.cc:697] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:09:47.732635 23552 consensus_queue.cc:237] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:47.750021 22456 raft_consensus.cc:2468] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:09:47.751248 22569 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:47.752035 23508 raft_consensus.cc:2804] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:47.753500 22605 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:47.755409 23508 raft_consensus.cc:697] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:09:47.756068 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:47.756171 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:47.756690 22532 raft_consensus.cc:3055] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:47.756388 23508 consensus_queue.cc:237] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:47.757009 22532 raft_consensus.cc:740] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:47.756789 22531 raft_consensus.cc:3055] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:47.757736 22531 raft_consensus.cc:740] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:47.757802 22532 consensus_queue.cc:260] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:47.759075 22532 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.759820 22531 consensus_queue.cc:260] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:47.760826 22531 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.722779 22451 raft_consensus.cc:2468] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 2.
I20260709 12:09:47.762490 22602 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:47.763919 22352 catalog_manager.cc:5697] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 1 to 2, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 2 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:47.765714 22353 catalog_manager.cc:5697] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 1 to 2, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 2 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:47.769598 22532 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:09:47.773787 22531 raft_consensus.cc:2468] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:09:47.793040 23512 raft_consensus.cc:993] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f: : Instructing follower 8701cd5186a949538d8efafb5f987270 to start an election
I20260709 12:09:47.793531 23512 raft_consensus.cc:1081] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Signalling peer 8701cd5186a949538d8efafb5f987270 to start an election
I20260709 12:09:47.796181 23122 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10ed4486435d4f82978c5cb544504999"
dest_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:57318
I20260709 12:09:47.796693 23122 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:47.797063 23122 raft_consensus.cc:3060] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.806661 23122 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:47.808254 23122 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:47.809343 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:47.810048 22456 raft_consensus.cc:3055] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:47.810277 22456 raft_consensus.cc:740] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:09:47.809459 22353 catalog_manager.cc:5697] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 1 to 2, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 2 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:47.810936 22456 consensus_queue.cc:260] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:47.812256 22456 raft_consensus.cc:3060] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.815701 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:47.816262 22531 raft_consensus.cc:3060] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.819583 22456 raft_consensus.cc:2468] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 2.
I20260709 12:09:47.821586 23087 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:47.822381 23587 raft_consensus.cc:2804] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:47.822853 23587 raft_consensus.cc:697] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 2 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:09:47.823717 23587 consensus_queue.cc:237] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:47.825186 22531 raft_consensus.cc:2468] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 2.
I20260709 12:09:47.841068 22352 catalog_manager.cc:5697] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 1 to 2, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 2 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:48.022017 22532 consensus_queue.cc:237] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:48.031463 22605 raft_consensus.cc:1275] T 8efee6d07e5841fdb6b0d7ed673b49cb P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:48.031675 22456 raft_consensus.cc:1275] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:48.033049 23565 consensus_queue.cc:1048] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:48.033049 22496 consensus_peers.cc:597] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8efee6d07e5841fdb6b0d7ed673b49cb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:48.034060 23582 consensus_queue.cc:1048] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:48.044947 23582 raft_consensus.cc:2955] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:48.047268 22605 raft_consensus.cc:2955] T 8efee6d07e5841fdb6b0d7ed673b49cb P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:48.047734 22456 raft_consensus.cc:2955] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:48.068115 22352 catalog_manager.cc:5697] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:48.112622 22532 consensus_queue.cc:237] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:48.116696 22456 raft_consensus.cc:1275] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:48.116962 22531 raft_consensus.cc:1275] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:48.118353 23587 consensus_queue.cc:1048] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:48.118353 23592 consensus_queue.cc:1048] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
W20260709 12:09:48.128808 22496 consensus_peers.cc:597] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 08a2fbce096642eb849b1a143f8e7bb9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:48.130770 22604 raft_consensus.cc:1275] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:48.133324 23435 consensus_queue.cc:1048] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:48.141923 22451 raft_consensus.cc:1275] T 08a2fbce096642eb849b1a143f8e7bb9 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:48.144003 23435 consensus_queue.cc:1048] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:48.165794 23435 raft_consensus.cc:2955] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:48.180431 22531 raft_consensus.cc:1275] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:48.180737 22452 raft_consensus.cc:1275] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:48.182089 22451 raft_consensus.cc:2955] T 08a2fbce096642eb849b1a143f8e7bb9 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:48.185078 23588 consensus_queue.cc:1048] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:48.185772 22605 raft_consensus.cc:2955] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:48.196362 23508 consensus_queue.cc:1048] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:48.201292 22403 auto_rebalancer.cc:629] Failed to schedule move for tablet 1b2392d4861b4d40b63dcdab54e716de: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:09:48.209815 22452 consensus_queue.cc:237] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:48.211035 22353 catalog_manager.cc:5697] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:48.220455 22531 raft_consensus.cc:1275] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:48.221719 23588 consensus_queue.cc:1048] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:48.227945 22457 raft_consensus.cc:1275] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:48.229569 23552 consensus_queue.cc:1048] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:48.237207 22455 raft_consensus.cc:1275] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:48.262138 22532 raft_consensus.cc:1275] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:48.261868 23588 consensus_queue.cc:1048] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
W20260709 12:09:48.281641 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 44060.7us
I20260709 12:09:48.304323 23613 consensus_queue.cc:1048] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:09:48.348289 22421 consensus_peers.cc:597] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6334366811764682b0a491c130c68eed. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:48.367311 22527 raft_consensus.cc:1275] T 6334366811764682b0a491c130c68eed P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:48.374269 23573 consensus_queue.cc:1048] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:48.428346 22457 raft_consensus.cc:1275] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:48.430840 22531 raft_consensus.cc:1275] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:48.432792 22604 raft_consensus.cc:1275] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:48.434500 23512 consensus_queue.cc:1048] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:48.450424 23587 consensus_queue.cc:1048] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:09:48.457404 23587 consensus_queue.cc:1048] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:09:48.461781 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 169643us
I20260709 12:09:48.485718 22455 raft_consensus.cc:1275] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:48.490088 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:48.512123 23573 raft_consensus.cc:2955] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:48.518110 22531 raft_consensus.cc:2955] T 6334366811764682b0a491c130c68eed P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
W20260709 12:09:48.547318 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 104022us
I20260709 12:09:48.572268 22532 raft_consensus.cc:1275] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:48.586380 23552 consensus_queue.cc:1048] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:09:48.644443 23627 ts_tablet_manager.cc:933] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:48.654559 22532 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "254fb9df2b39405996039a40091b4875"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:39980
I20260709 12:09:48.655227 22532 raft_consensus.cc:606] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Received request to transfer leadership to TS 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:09:48.695726 22532 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "272afea078f74bf19baefd3c1300644d"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:39980
I20260709 12:09:48.696491 22532 raft_consensus.cc:606] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:09:48.711230 23508 consensus_queue.cc:1048] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:48.773727 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 86743us
I20260709 12:09:48.870523 23627 tablet_copy_client.cc:323] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270: tablet copy: Beginning tablet copy session from remote peer at address 127.20.196.130:42733
I20260709 12:09:48.873124 23637 ts_tablet_manager.cc:933] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:48.884637 22542 tablet_copy_service.cc:140] P 1676e7af5e4a47cb86ee7db83e3d4881: Received BeginTabletCopySession request for tablet 8efee6d07e5841fdb6b0d7ed673b49cb from peer 8701cd5186a949538d8efafb5f987270 ({username='slave'} at 127.0.0.1:38310)
I20260709 12:09:48.885286 22542 tablet_copy_service.cc:161] P 1676e7af5e4a47cb86ee7db83e3d4881: Beginning new tablet copy session on tablet 8efee6d07e5841fdb6b0d7ed673b49cb from peer 8701cd5186a949538d8efafb5f987270 at {username='slave'} at 127.0.0.1:38310: session id = 8701cd5186a949538d8efafb5f987270-8efee6d07e5841fdb6b0d7ed673b49cb
W20260709 12:09:48.889113 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 65822.1us
I20260709 12:09:48.890800 22604 raft_consensus.cc:2955] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
W20260709 12:09:48.894862 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 49114us
I20260709 12:09:48.995133 22542 tablet_copy_source_session.cc:215] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:49.028805 23627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8efee6d07e5841fdb6b0d7ed673b49cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:49.022837 22352 catalog_manager.cc:5697] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:49.039458 23637 tablet_copy_client.cc:323] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270: tablet copy: Beginning tablet copy session from remote peer at address 127.20.196.130:42733
I20260709 12:09:49.093309 23627 tablet_copy_client.cc:806] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:49.094193 23627 tablet_copy_client.cc:670] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:49.097935 22542 tablet_copy_service.cc:140] P 1676e7af5e4a47cb86ee7db83e3d4881: Received BeginTabletCopySession request for tablet 08a2fbce096642eb849b1a143f8e7bb9 from peer 8701cd5186a949538d8efafb5f987270 ({username='slave'} at 127.0.0.1:38310)
I20260709 12:09:49.098452 22542 tablet_copy_service.cc:161] P 1676e7af5e4a47cb86ee7db83e3d4881: Beginning new tablet copy session on tablet 08a2fbce096642eb849b1a143f8e7bb9 from peer 8701cd5186a949538d8efafb5f987270 at {username='slave'} at 127.0.0.1:38310: session id = 8701cd5186a949538d8efafb5f987270-08a2fbce096642eb849b1a143f8e7bb9
W20260709 12:09:49.120769 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 414313us
I20260709 12:09:49.122400 22542 tablet_copy_source_session.cc:215] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:49.137601 23637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08a2fbce096642eb849b1a143f8e7bb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:49.118552 23627 tablet_copy_client.cc:538] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:49.156662 22528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:39980
I20260709 12:09:49.157274 22528 raft_consensus.cc:606] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:09:49.160714 23582 raft_consensus.cc:993] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881: : Instructing follower 8701cd5186a949538d8efafb5f987270 to start an election
I20260709 12:09:49.165937 23582 raft_consensus.cc:1081] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Signalling peer 8701cd5186a949538d8efafb5f987270 to start an election
I20260709 12:09:49.169261 23642 raft_consensus.cc:993] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881: : Instructing follower 8701cd5186a949538d8efafb5f987270 to start an election
I20260709 12:09:49.169766 23642 raft_consensus.cc:1081] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Signalling peer 8701cd5186a949538d8efafb5f987270 to start an election
I20260709 12:09:49.170857 23122 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc"
dest_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:57332
I20260709 12:09:49.171571 23122 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:49.172010 23122 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.176096 23119 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "272afea078f74bf19baefd3c1300644d"
dest_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:57332
I20260709 12:09:49.178265 23119 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:49.178637 23119 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.184484 23435 raft_consensus.cc:993] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881: : Instructing follower 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:09:49.185107 23435 raft_consensus.cc:1081] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Signalling peer 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:09:49.184517 23122 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:49.193599 23122 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:49.194581 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:49.194926 23627 tablet_bootstrap.cc:492] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270: Bootstrap starting.
I20260709 12:09:49.195199 22528 raft_consensus.cc:3055] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:49.195549 22528 raft_consensus.cc:740] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:49.196233 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:49.196775 22454 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.196270 22528 consensus_queue.cc:260] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:49.197546 22528 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.203109 22454 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 2.
I20260709 12:09:49.204466 23087 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:49.205298 23588 raft_consensus.cc:2804] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:49.205780 23588 raft_consensus.cc:697] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 2 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:09:49.206622 23588 consensus_queue.cc:237] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:49.227782 23648 ts_tablet_manager.cc:933] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317)
I20260709 12:09:49.207116 22528 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 2.
I20260709 12:09:49.233932 22604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "254fb9df2b39405996039a40091b4875"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:45576
I20260709 12:09:49.234486 22604 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:49.234834 22604 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.227558 22351 catalog_manager.cc:5697] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 1 to 2, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 2 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:49.243533 23119 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:49.246007 23119 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:49.248201 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:49.248848 22602 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.248193 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:49.250551 22527 raft_consensus.cc:3055] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:49.250941 22527 raft_consensus.cc:740] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:49.252017 22527 consensus_queue.cc:260] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:49.253468 22527 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.337227 22604 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:49.341180 22602 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 2.
W20260709 12:09:49.351214 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 76671.3us
I20260709 12:09:49.373030 22527 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 2.
I20260709 12:09:49.378183 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:49.378968 22451 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.381484 22604 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:49.367744 23637 tablet_copy_client.cc:806] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:49.401494 22451 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:09:49.403368 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:49.403924 22528 raft_consensus.cc:3055] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:49.404203 22528 raft_consensus.cc:740] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:49.404848 22569 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:49.402555 23637 tablet_copy_client.cc:670] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:49.407593 23508 raft_consensus.cc:2804] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:49.408814 23508 raft_consensus.cc:697] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:09:49.406090 23648 tablet_copy_client.cc:323] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270: tablet copy: Beginning tablet copy session from remote peer at address 127.20.196.129:42317
I20260709 12:09:49.437734 22467 tablet_copy_service.cc:140] P c863116d91c14d1ca50d6e8a46a37a8f: Received BeginTabletCopySession request for tablet 6334366811764682b0a491c130c68eed from peer 8701cd5186a949538d8efafb5f987270 ({username='slave'} at 127.0.0.1:34452)
I20260709 12:09:49.437598 23508 consensus_queue.cc:237] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:49.438357 22467 tablet_copy_service.cc:161] P c863116d91c14d1ca50d6e8a46a37a8f: Beginning new tablet copy session on tablet 6334366811764682b0a491c130c68eed from peer 8701cd5186a949538d8efafb5f987270 at {username='slave'} at 127.0.0.1:34452: session id = 8701cd5186a949538d8efafb5f987270-6334366811764682b0a491c130c68eed
W20260709 12:09:49.438369 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 64321.4us
I20260709 12:09:49.449105 22528 consensus_queue.cc:260] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:49.459080 22528 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.460716 23089 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:09:49.461881 23623 raft_consensus.cc:2804] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:49.462422 23623 raft_consensus.cc:697] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 2 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:09:49.463212 23623 consensus_queue.cc:237] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:49.495638 22528 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:09:49.486761 22467 tablet_copy_source_session.cc:215] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:09:49.506608 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 62349.4us
I20260709 12:09:49.554245 23648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6334366811764682b0a491c130c68eed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:49.558409 23637 tablet_copy_client.cc:538] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:49.562172 22353 catalog_manager.cc:5697] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 1 to 2, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 2 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:49.564482 22605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:09:49.565068 22605 raft_consensus.cc:606] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:09:49.559805 22351 catalog_manager.cc:5697] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 1 to 2, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 2 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:49.572608 22455 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
mode: GRACEFUL
new_leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:44568
I20260709 12:09:49.573167 22455 raft_consensus.cc:606] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Received request to transfer leadership to TS 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:09:49.576229 22527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9286627b6c59411d908ec035984616ac"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:39980
I20260709 12:09:49.576756 22527 raft_consensus.cc:606] T 9286627b6c59411d908ec035984616ac P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Received request to transfer leadership to TS 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:09:49.600152 23648 tablet_copy_client.cc:806] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:49.600890 23648 tablet_copy_client.cc:670] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:49.600884 23627 tablet_bootstrap.cc:492] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:49.602303 23627 tablet_bootstrap.cc:492] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270: Bootstrap complete.
I20260709 12:09:49.603042 23627 ts_tablet_manager.cc:1403] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270: Time spent bootstrapping tablet: real 0.408s	user 0.038s	sys 0.083s
I20260709 12:09:49.603943 23637 tablet_bootstrap.cc:492] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270: Bootstrap starting.
I20260709 12:09:49.608199 22528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:39980
I20260709 12:09:49.608842 22528 raft_consensus.cc:606] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Received request to transfer leadership to TS 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:09:49.606376 23627 raft_consensus.cc:359] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:49.610024 23627 raft_consensus.cc:740] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Initialized, Role: LEARNER
I20260709 12:09:49.610685 23648 tablet_copy_client.cc:538] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:49.611012 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 12:09:49.612732 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:49.613571 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:49.619874 23648 tablet_bootstrap.cc:492] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270: Bootstrap starting.
I20260709 12:09:49.624631 23627 consensus_queue.cc:260] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:49.636031 23627 ts_tablet_manager.cc:1434] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.002s
I20260709 12:09:49.641222 22542 tablet_copy_service.cc:342] P 1676e7af5e4a47cb86ee7db83e3d4881: Request end of tablet copy session 8701cd5186a949538d8efafb5f987270-8efee6d07e5841fdb6b0d7ed673b49cb received from {username='slave'} at 127.0.0.1:38310
I20260709 12:09:49.641656 22542 tablet_copy_service.cc:434] P 1676e7af5e4a47cb86ee7db83e3d4881: ending tablet copy session 8701cd5186a949538d8efafb5f987270-8efee6d07e5841fdb6b0d7ed673b49cb on tablet 8efee6d07e5841fdb6b0d7ed673b49cb with peer 8701cd5186a949538d8efafb5f987270
I20260709 12:09:49.674238 23648 tablet_bootstrap.cc:492] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:49.675230 23648 tablet_bootstrap.cc:492] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270: Bootstrap complete.
I20260709 12:09:49.675897 23648 ts_tablet_manager.cc:1403] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270: Time spent bootstrapping tablet: real 0.056s	user 0.016s	sys 0.014s
I20260709 12:09:49.682847 23646 raft_consensus.cc:993] T 9286627b6c59411d908ec035984616ac P 1676e7af5e4a47cb86ee7db83e3d4881: : Instructing follower 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:09:49.683526 23646 raft_consensus.cc:1081] T 9286627b6c59411d908ec035984616ac P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Signalling peer 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:09:49.685554 22605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9286627b6c59411d908ec035984616ac"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:45576
I20260709 12:09:49.686215 22605 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:49.686664 22605 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.678730 23648 raft_consensus.cc:359] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:49.690106 23648 raft_consensus.cc:740] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Initialized, Role: LEARNER
I20260709 12:09:49.692606 23648 consensus_queue.cc:260] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:49.712459 23648 ts_tablet_manager.cc:1434] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 12:09:49.716126 22467 tablet_copy_service.cc:342] P c863116d91c14d1ca50d6e8a46a37a8f: Request end of tablet copy session 8701cd5186a949538d8efafb5f987270-6334366811764682b0a491c130c68eed received from {username='slave'} at 127.0.0.1:34452
I20260709 12:09:49.716687 22467 tablet_copy_service.cc:434] P c863116d91c14d1ca50d6e8a46a37a8f: ending tablet copy session 8701cd5186a949538d8efafb5f987270-6334366811764682b0a491c130c68eed on tablet 6334366811764682b0a491c130c68eed with peer 8701cd5186a949538d8efafb5f987270
I20260709 12:09:49.734247 23582 raft_consensus.cc:993] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881: : Instructing follower 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:09:49.735023 23646 raft_consensus.cc:1081] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Signalling peer 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:09:49.737387 22602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:45576
I20260709 12:09:49.738078 22602 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:49.738504 22602 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.770776 23122 raft_consensus.cc:1217] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:49.772296 22451 raft_consensus.cc:1275] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:49.773757 23623 consensus_queue.cc:1048] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:49.784973 22528 raft_consensus.cc:1275] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:49.792659 23587 consensus_queue.cc:1048] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:49.798060 23661 raft_consensus.cc:993] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f: : Instructing follower 1676e7af5e4a47cb86ee7db83e3d4881 to start an election
I20260709 12:09:49.799274 22602 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:49.800225 23635 raft_consensus.cc:1081] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Signalling peer 1676e7af5e4a47cb86ee7db83e3d4881 to start an election
I20260709 12:09:49.803490 22528 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:56940
I20260709 12:09:49.804157 22528 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:49.804592 22528 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.811214 23617 raft_consensus.cc:993] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc: : Instructing follower 8701cd5186a949538d8efafb5f987270 to start an election
I20260709 12:09:49.811724 23617 raft_consensus.cc:1081] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Signalling peer 8701cd5186a949538d8efafb5f987270 to start an election
I20260709 12:09:49.813683 23122 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb"
dest_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:57328
I20260709 12:09:49.814182 23122 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:49.814615 23122 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.841053 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:49.841753 22455 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.843529 22602 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:49.713130 22605 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:49.846801 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:49.847648 22457 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.857210 22527 raft_consensus.cc:1275] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:49.858807 22457 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:09:49.859957 23122 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:49.860205 22569 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:49.854633 22455 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:09:49.862174 22605 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:49.863402 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:49.864095 22531 raft_consensus.cc:3055] T 9286627b6c59411d908ec035984616ac P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:49.864445 22531 raft_consensus.cc:740] T 9286627b6c59411d908ec035984616ac P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:49.866796 22531 consensus_queue.cc:260] T 9286627b6c59411d908ec035984616ac P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:49.870893 22528 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:49.869223 22569 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:49.875116 22531 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.876019 23616 raft_consensus.cc:2804] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:49.876552 23620 consensus_queue.cc:1048] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:09:49.876879 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:49.877640 22530 raft_consensus.cc:3055] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:49.877974 22530 raft_consensus.cc:740] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:49.883363 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:49.884317 22455 raft_consensus.cc:3055] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:49.884683 22455 raft_consensus.cc:740] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:09:49.886039 23592 raft_consensus.cc:2804] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:49.882814 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:49.886576 23592 raft_consensus.cc:697] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:09:49.887575 23592 consensus_queue.cc:237] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:49.883330 23616 raft_consensus.cc:697] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:09:49.892184 23122 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:49.892833 23616 consensus_queue.cc:237] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:49.894423 22528 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:49.895179 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:49.895717 22602 raft_consensus.cc:3055] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:49.896016 22602 raft_consensus.cc:740] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:09:49.886677 22605 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.898059 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:49.898710 22532 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.896747 22602 consensus_queue.cc:260] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:49.898039 22455 consensus_queue.cc:260] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:49.903026 22602 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.903394 22531 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:09:49.893939 22530 consensus_queue.cc:260] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:49.907423 22530 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.911293 22605 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:09:49.912681 22455 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.918242 22532 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 2.
I20260709 12:09:49.924108 22602 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 2.
I20260709 12:09:49.925508 23089 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:09:49.926401 22530 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:09:49.926889 23122 raft_consensus.cc:1217] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:49.929425 22497 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:09:49.948282 23663 raft_consensus.cc:2804] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:49.948967 23663 raft_consensus.cc:697] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 2 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:09:49.951568 22605 raft_consensus.cc:1275] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:49.949849 23663 consensus_queue.cc:237] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:49.935400 23561 raft_consensus.cc:2804] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:49.955127 23561 raft_consensus.cc:697] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:49.956040 23561 consensus_queue.cc:237] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:49.970558 22455 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
W20260709 12:09:50.000528 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 66028.2us
I20260709 12:09:50.030844 22527 raft_consensus.cc:1275] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:50.046685 22457 raft_consensus.cc:1275] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:50.051995 23508 consensus_queue.cc:1048] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.033816 23673 consensus_queue.cc:1048] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:09:50.075706 22352 catalog_manager.cc:5697] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 1 to 2, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 2 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:50.069056 23588 consensus_queue.cc:1048] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:09:50.080116 22351 catalog_manager.cc:5697] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 1 to 2, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 2 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:50.081727 22351 catalog_manager.cc:5697] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 1 to 2, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 2 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:50.086025 23637 tablet_bootstrap.cc:492] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:50.087196 23637 tablet_bootstrap.cc:492] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270: Bootstrap complete.
I20260709 12:09:50.087891 23637 ts_tablet_manager.cc:1403] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270: Time spent bootstrapping tablet: real 0.484s	user 0.087s	sys 0.098s
I20260709 12:09:50.131613 23637 raft_consensus.cc:359] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:50.133630 23637 raft_consensus.cc:740] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Initialized, Role: LEARNER
I20260709 12:09:50.134373 23637 consensus_queue.cc:260] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:50.160545 23637 ts_tablet_manager.cc:1434] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270: Time spent starting tablet: real 0.072s	user 0.007s	sys 0.000s
I20260709 12:09:50.165910 22542 tablet_copy_service.cc:342] P 1676e7af5e4a47cb86ee7db83e3d4881: Request end of tablet copy session 8701cd5186a949538d8efafb5f987270-08a2fbce096642eb849b1a143f8e7bb9 received from {username='slave'} at 127.0.0.1:38310
I20260709 12:09:50.166354 22542 tablet_copy_service.cc:434] P 1676e7af5e4a47cb86ee7db83e3d4881: ending tablet copy session 8701cd5186a949538d8efafb5f987270-08a2fbce096642eb849b1a143f8e7bb9 on tablet 08a2fbce096642eb849b1a143f8e7bb9 with peer 8701cd5186a949538d8efafb5f987270
I20260709 12:09:50.256076 23119 raft_consensus.cc:1217] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:50.274833 22455 raft_consensus.cc:1275] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:50.277684 23620 consensus_queue.cc:1048] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:50.301817 22353 catalog_manager.cc:5697] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 1 to 2, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 2 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:50.334029 22457 raft_consensus.cc:1275] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:50.335656 23620 consensus_queue.cc:1048] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.342454 23629 raft_consensus.cc:1064] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
I20260709 12:09:50.346989 23646 raft_consensus.cc:1064] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
I20260709 12:09:50.353224 23646 consensus_queue.cc:237] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:50.367398 23629 consensus_queue.cc:237] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:50.375838 22605 raft_consensus.cc:1275] T 8efee6d07e5841fdb6b0d7ed673b49cb P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:50.377260 23598 consensus_queue.cc:1048] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:50.387928 23119 raft_consensus.cc:1275] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:50.394411 22451 raft_consensus.cc:1275] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:50.403801 23646 consensus_queue.cc:1048] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:50.424644 23119 raft_consensus.cc:1275] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:50.426389 22527 raft_consensus.cc:1275] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:50.426347 23661 consensus_queue.cc:1048] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:50.433470 23616 consensus_queue.cc:1048] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.456725 22605 raft_consensus.cc:1275] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:50.465569 23629 consensus_queue.cc:1048] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:50.473887 22455 raft_consensus.cc:1275] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:50.475483 23646 consensus_queue.cc:1048] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.483574 23646 consensus_queue.cc:1048] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:50.494323 22527 raft_consensus.cc:1275] T 6334366811764682b0a491c130c68eed P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:50.515775 23582 raft_consensus.cc:2955] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:50.533049 22457 raft_consensus.cc:2955] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:50.573478 22605 raft_consensus.cc:1275] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:50.588259 22604 raft_consensus.cc:1275] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:50.581743 22526 raft_consensus.cc:1275] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:50.594669 23623 consensus_queue.cc:1048] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:50.575816 23646 consensus_queue.cc:1048] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:09:50.606166 23623 consensus_queue.cc:1048] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:50.616828 22531 raft_consensus.cc:1275] T 9286627b6c59411d908ec035984616ac P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:50.667143 23620 consensus_queue.cc:1048] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:09:50.666566 23662 consensus_queue.cc:1048] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
W20260709 12:09:50.715050 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 56961.4us
I20260709 12:09:50.715306 22605 raft_consensus.cc:2955] T 8efee6d07e5841fdb6b0d7ed673b49cb P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:50.739187 23631 raft_consensus.cc:2955] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:50.783226 23119 raft_consensus.cc:2955] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:50.830804 22604 raft_consensus.cc:2955] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
W20260709 12:09:50.831831 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 113154us
I20260709 12:09:50.874446 22352 catalog_manager.cc:5697] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:50.908663 22354 catalog_manager.cc:5697] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 reported cstate change: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:50.912572 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:09:50.912743 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 72542.7us
W20260709 12:09:51.032393 23693 log.cc:927] Time spent T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:09:51.104063 23582 raft_consensus.cc:1064] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
W20260709 12:09:51.151113 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 74893.3us
W20260709 12:09:51.218215 23717 log.cc:927] Time spent T 9286627b6c59411d908ec035984616ac P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:09:51.274456 23582 consensus_queue.cc:237] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:51.296485 23119 raft_consensus.cc:2955] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:51.308221 22528 raft_consensus.cc:2955] T 6334366811764682b0a491c130c68eed P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:51.338943 23122 raft_consensus.cc:1275] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:51.340413 22603 raft_consensus.cc:1275] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:51.345867 23646 consensus_queue.cc:1048] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:51.349656 23645 consensus_queue.cc:1048] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
W20260709 12:09:51.370319 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 202664us
I20260709 12:09:51.375244 22455 raft_consensus.cc:1275] T 08a2fbce096642eb849b1a143f8e7bb9 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:51.394889 22455 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
mode: GRACEFUL
new_leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:44568
I20260709 12:09:51.395620 22455 raft_consensus.cc:606] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Received request to transfer leadership to TS 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:09:51.397504 23645 raft_consensus.cc:2955] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:51.396236 23724 consensus_queue.cc:1048] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:09:51.399544 22602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:09:51.400070 22602 raft_consensus.cc:606] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:09:51.394928 22603 raft_consensus.cc:2955] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:51.406643 22601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:09:51.407269 22601 raft_consensus.cc:606] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Received request to transfer leadership to TS 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:09:51.418735 22602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb7fd922979743428612619e8de33af1"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:09:51.421147 22602 raft_consensus.cc:606] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Received request to transfer leadership to TS 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:09:51.425011 22528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:39980
I20260709 12:09:51.425772 22528 raft_consensus.cc:606] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:09:51.427215 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:09:51.429081 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:51.441306 22455 raft_consensus.cc:2955] T 08a2fbce096642eb849b1a143f8e7bb9 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:51.445999 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:51.470041 22457 consensus_queue.cc:237] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:51.476732 22354 catalog_manager.cc:5697] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:51.445129 23119 raft_consensus.cc:2955] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:51.487974 23120 raft_consensus.cc:1275] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:51.489758 23721 consensus_queue.cc:1048] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:51.497768 22526 consensus_queue.cc:237] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:51.498483 22603 raft_consensus.cc:1275] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:51.498728 22528 consensus_queue.cc:237] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:51.500118 23721 consensus_queue.cc:1048] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:51.504455 22605 raft_consensus.cc:1275] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:51.505950 23713 consensus_queue.cc:1048] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:51.511945 23120 raft_consensus.cc:1275] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:51.511866 23700 raft_consensus.cc:2955] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:51.513315 22605 raft_consensus.cc:2955] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:51.520458 23713 raft_consensus.cc:2955] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:51.523133 23598 consensus_queue.cc:1048] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:51.527638 22601 raft_consensus.cc:2955] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:51.530367 22339 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6334366811764682b0a491c130c68eed with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:51.538038 22455 raft_consensus.cc:1275] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:51.543013 23645 consensus_queue.cc:1048] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:51.535317 23120 raft_consensus.cc:2955] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:51.555371 23122 raft_consensus.cc:1275] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:51.560650 23716 raft_consensus.cc:993] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc: : Instructing follower 8701cd5186a949538d8efafb5f987270 to start an election
I20260709 12:09:51.561131 23716 raft_consensus.cc:1081] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Signalling peer 8701cd5186a949538d8efafb5f987270 to start an election
I20260709 12:09:51.563571 22354 catalog_manager.cc:5697] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: config changed from index 3 to 4, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:51.571175 22340 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 08a2fbce096642eb849b1a143f8e7bb9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:51.575997 22351 catalog_manager.cc:5697] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: config changed from index 3 to 4, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:51.576129 23706 raft_consensus.cc:2955] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:51.585675 23119 raft_consensus.cc:2955] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:51.595595 23122 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860"
dest_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:57328
I20260709 12:09:51.596151 23122 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:51.596499 23122 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.597494 22340 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8efee6d07e5841fdb6b0d7ed673b49cb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:51.616941 22442 tablet_service.cc:1558] Processing DeleteTablet for tablet 08a2fbce096642eb849b1a143f8e7bb9 with delete_type TABLET_DATA_TOMBSTONED (TS c863116d91c14d1ca50d6e8a46a37a8f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51832
I20260709 12:09:51.623564 22451 raft_consensus.cc:2955] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:51.632295 22351 catalog_manager.cc:5697] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: config changed from index 3 to 4, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:51.637663 22517 tablet_service.cc:1558] Processing DeleteTablet for tablet 6334366811764682b0a491c130c68eed with delete_type TABLET_DATA_TOMBSTONED (TS 1676e7af5e4a47cb86ee7db83e3d4881 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56928
I20260709 12:09:51.640518 23713 consensus_queue.cc:1048] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:51.646903 23702 raft_consensus.cc:993] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc: : Instructing follower 1676e7af5e4a47cb86ee7db83e3d4881 to start an election
I20260709 12:09:51.646507 23120 raft_consensus.cc:2955] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:51.647684 23617 raft_consensus.cc:1081] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Signalling peer 1676e7af5e4a47cb86ee7db83e3d4881 to start an election
I20260709 12:09:51.650506 22526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:56942
I20260709 12:09:51.651167 22526 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:51.651585 22526 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.655467 22594 tablet_service.cc:1558] Processing DeleteTablet for tablet 8efee6d07e5841fdb6b0d7ed673b49cb with delete_type TABLET_DATA_TOMBSTONED (TS 6c6fa11e8ee34711b3551f0c670442bc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45546
I20260709 12:09:51.602599 23122 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:51.658663 23122 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:51.664664 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:51.665330 22457 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.671489 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:51.672042 22601 raft_consensus.cc:3055] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:51.672331 22601 raft_consensus.cc:740] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:09:51.672964 22457 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 2.
I20260709 12:09:51.673007 22601 consensus_queue.cc:260] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:51.674566 22601 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.692888 22601 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 2.
I20260709 12:09:51.694685 23733 tablet_replica.cc:333] T 8efee6d07e5841fdb6b0d7ed673b49cb P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:09:51.695806 23733 raft_consensus.cc:2243] T 8efee6d07e5841fdb6b0d7ed673b49cb P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:51.696473 23733 raft_consensus.cc:2272] T 8efee6d07e5841fdb6b0d7ed673b49cb P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:51.698714 23087 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:51.715418 23673 raft_consensus.cc:2804] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:51.728554 22526 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:51.722573 23673 raft_consensus.cc:697] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 2 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:09:51.731894 22526 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:51.732483 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:51.733597 22601 raft_consensus.cc:3055] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:51.733924 22601 raft_consensus.cc:740] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:09:51.734699 22601 consensus_queue.cc:260] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:51.731845 23673 consensus_queue.cc:237] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:51.740211 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:51.740780 22451 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.743994 22601 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.748533 22451 raft_consensus.cc:2468] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:09:51.750116 22495 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:51.750784 23706 raft_consensus.cc:2804] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:51.751303 23706 raft_consensus.cc:697] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:51.753346 23731 tablet_replica.cc:333] T 08a2fbce096642eb849b1a143f8e7bb9 P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:09:51.759379 23731 raft_consensus.cc:2243] T 08a2fbce096642eb849b1a143f8e7bb9 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:51.762763 23733 ts_tablet_manager.cc:1916] T 8efee6d07e5841fdb6b0d7ed673b49cb P 6c6fa11e8ee34711b3551f0c670442bc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:51.768759 22601 raft_consensus.cc:2468] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:09:51.774103 23645 raft_consensus.cc:993] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881: : Instructing follower 8701cd5186a949538d8efafb5f987270 to start an election
I20260709 12:09:51.773707 23706 consensus_queue.cc:237] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:51.772012 23731 raft_consensus.cc:2272] T 08a2fbce096642eb849b1a143f8e7bb9 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:51.774601 23645 raft_consensus.cc:1081] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Signalling peer 8701cd5186a949538d8efafb5f987270 to start an election
I20260709 12:09:51.780347 23732 tablet_replica.cc:333] T 6334366811764682b0a491c130c68eed P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:09:51.792245 23731 ts_tablet_manager.cc:1916] T 08a2fbce096642eb849b1a143f8e7bb9 P c863116d91c14d1ca50d6e8a46a37a8f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:51.793187 23661 raft_consensus.cc:993] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f: : Instructing follower 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:09:51.793746 23721 raft_consensus.cc:1081] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Signalling peer 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:09:51.795445 22601 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:45562
I20260709 12:09:51.796185 22601 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:51.796707 22601 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.797856 23616 raft_consensus.cc:993] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc: : Instructing follower 1676e7af5e4a47cb86ee7db83e3d4881 to start an election
I20260709 12:09:51.799273 23122 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9"
dest_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:57332
I20260709 12:09:51.799799 23122 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:51.800138 23122 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.800832 23616 raft_consensus.cc:1081] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Signalling peer 1676e7af5e4a47cb86ee7db83e3d4881 to start an election
I20260709 12:09:51.804746 22601 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:51.807421 22601 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:09:51.806967 22353 catalog_manager.cc:5697] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 1 to 2, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 2 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:51.827114 23122 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:51.837272 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:51.837845 22451 raft_consensus.cc:3055] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:51.838119 22451 raft_consensus.cc:740] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:09:51.839010 23732 raft_consensus.cc:2243] T 6334366811764682b0a491c130c68eed P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:51.840106 23732 raft_consensus.cc:2272] T 6334366811764682b0a491c130c68eed P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:51.844759 23732 ts_tablet_manager.cc:1916] T 6334366811764682b0a491c130c68eed P 1676e7af5e4a47cb86ee7db83e3d4881: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:51.838829 22451 consensus_queue.cc:260] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:09:51.847837 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 60625.1us
I20260709 12:09:51.847963 22451 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.851632 22528 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb7fd922979743428612619e8de33af1"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:56942
I20260709 12:09:51.852170 22528 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:51.852803 22528 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.854264 22451 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:09:51.855557 22569 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:51.859614 23122 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:51.860422 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:09:51.860944 23125 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.867705 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:51.868346 22526 raft_consensus.cc:3055] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:51.868655 22526 raft_consensus.cc:740] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:51.869421 22526 consensus_queue.cc:260] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:51.870656 22526 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.871130 22353 catalog_manager.cc:5697] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 1 to 2, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 2 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:51.866391 23616 raft_consensus.cc:2804] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:51.873834 23616 raft_consensus.cc:697] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:09:51.875474 22528 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:51.875787 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:51.876549 22601 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.879806 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:51.882270 23125 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:09:51.874819 23616 consensus_queue.cc:237] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:51.880268 22451 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.890924 22528 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:51.891449 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:51.892194 22603 raft_consensus.cc:3055] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:51.892541 22603 raft_consensus.cc:740] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:09:51.893299 22603 consensus_queue.cc:260] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:51.894341 22603 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.895655 22451 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:09:51.896759 22495 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:51.897600 23645 raft_consensus.cc:2804] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:51.898077 23645 raft_consensus.cc:697] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:51.898919 23645 consensus_queue.cc:237] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:51.903184 22603 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:09:51.916616 22526 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 2.
I20260709 12:09:51.917966 23088 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:09:51.918839 23623 raft_consensus.cc:2804] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:51.919334 23623 raft_consensus.cc:697] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 2 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:09:51.920301 23623 consensus_queue.cc:237] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:51.924407 22601 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 2.
I20260709 12:09:51.934204 22353 catalog_manager.cc:5697] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 1 to 2, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 2 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:51.940196 23733 ts_tablet_manager.cc:1929] T 8efee6d07e5841fdb6b0d7ed673b49cb P 6c6fa11e8ee34711b3551f0c670442bc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:51.949797 23731 ts_tablet_manager.cc:1929] T 08a2fbce096642eb849b1a143f8e7bb9 P c863116d91c14d1ca50d6e8a46a37a8f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:51.950274 23731 log.cc:1199] T 08a2fbce096642eb849b1a143f8e7bb9 P c863116d91c14d1ca50d6e8a46a37a8f: Deleting WAL directory at /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-0-root/wals/08a2fbce096642eb849b1a143f8e7bb9
I20260709 12:09:51.940652 23733 log.cc:1199] T 8efee6d07e5841fdb6b0d7ed673b49cb P 6c6fa11e8ee34711b3551f0c670442bc: Deleting WAL directory at /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-2-root/wals/8efee6d07e5841fdb6b0d7ed673b49cb
I20260709 12:09:51.959838 22341 catalog_manager.cc:5028] TS 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): tablet 8efee6d07e5841fdb6b0d7ed673b49cb (table test-workload [id=1e73b97ba677488c8829a696096f4885]) successfully deleted
I20260709 12:09:51.961725 23732 ts_tablet_manager.cc:1929] T 6334366811764682b0a491c130c68eed P 1676e7af5e4a47cb86ee7db83e3d4881: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:51.962198 23732 log.cc:1199] T 6334366811764682b0a491c130c68eed P 1676e7af5e4a47cb86ee7db83e3d4881: Deleting WAL directory at /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-1-root/wals/6334366811764682b0a491c130c68eed
I20260709 12:09:51.964324 22339 catalog_manager.cc:5028] TS c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): tablet 08a2fbce096642eb849b1a143f8e7bb9 (table test-workload [id=1e73b97ba677488c8829a696096f4885]) successfully deleted
I20260709 12:09:51.967823 22340 catalog_manager.cc:5028] TS 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): tablet 6334366811764682b0a491c130c68eed (table test-workload [id=1e73b97ba677488c8829a696096f4885]) successfully deleted
I20260709 12:09:51.978684 22353 catalog_manager.cc:5697] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 1 to 2, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 2 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:51.992606 22351 catalog_manager.cc:5697] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 1 to 2, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 2 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:52.244575 22601 raft_consensus.cc:1275] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:52.245941 23713 consensus_queue.cc:1048] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:52.282809 22451 raft_consensus.cc:1275] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:52.284832 23706 consensus_queue.cc:1048] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:52.287161 22603 raft_consensus.cc:1275] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:52.290077 23741 consensus_queue.cc:1048] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:52.318297 23125 raft_consensus.cc:1275] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:52.319754 23616 consensus_queue.cc:1048] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:52.322466 22455 raft_consensus.cc:1275] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:52.327937 22603 raft_consensus.cc:1275] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:52.331027 23741 consensus_queue.cc:1048] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:52.332590 23741 consensus_queue.cc:1048] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:52.365513 22451 raft_consensus.cc:1275] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:52.367156 23617 consensus_queue.cc:1048] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:09:52.384016 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 52925us
I20260709 12:09:52.387705 22526 raft_consensus.cc:1275] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:52.389326 23750 consensus_queue.cc:1048] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:52.451332 22601 raft_consensus.cc:1275] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:52.453390 23645 consensus_queue.cc:1048] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:52.489617 22455 raft_consensus.cc:1275] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:52.491981 23645 consensus_queue.cc:1048] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:52.738451 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:52.756752 22605 consensus_queue.cc:237] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
W20260709 12:09:52.776043 22570 consensus_peers.cc:597] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9286627b6c59411d908ec035984616ac. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:52.786280 22457 raft_consensus.cc:1275] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:52.787616 23735 consensus_queue.cc:1048] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:52.791816 22455 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
mode: GRACEFUL
new_leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:44568
I20260709 12:09:52.792348 22455 raft_consensus.cc:606] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Received request to transfer leadership to TS 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:09:52.795668 22526 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:39980
I20260709 12:09:52.796221 22526 raft_consensus.cc:606] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Received request to transfer leadership to TS 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:09:52.799499 22525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:39980
I20260709 12:09:52.800361 22525 raft_consensus.cc:606] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:09:52.812661 22455 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
mode: GRACEFUL
new_leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:44568
I20260709 12:09:52.813877 22455 raft_consensus.cc:606] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Received request to transfer leadership to TS 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:09:52.828419 22603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:09:52.787818 22528 raft_consensus.cc:1275] T 9286627b6c59411d908ec035984616ac P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:52.829109 22603 raft_consensus.cc:606] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Received request to transfer leadership to TS 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:09:52.830507 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:09:52.835691 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:52.836470 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:52.850167 23735 consensus_queue.cc:1048] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:52.857306 23616 raft_consensus.cc:2955] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:52.858515 22457 raft_consensus.cc:2955] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:52.880712 22528 raft_consensus.cc:2955] T 9286627b6c59411d908ec035984616ac P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:52.898458 23661 raft_consensus.cc:993] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f: : Instructing follower 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:09:52.898943 23661 raft_consensus.cc:1081] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Signalling peer 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:09:52.903466 22603 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:45562
I20260709 12:09:52.903985 22603 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:52.904398 22603 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.903869 22354 catalog_manager.cc:5697] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: config changed from index -1 to 3, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New cstate: current_term: 2 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:52.918581 22603 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:52.920519 22603 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:52.921066 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:52.929232 22457 raft_consensus.cc:3055] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:52.929525 22457 raft_consensus.cc:740] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:09:52.930235 22457 consensus_queue.cc:260] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:52.931216 22457 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.927263 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:52.938185 22526 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.950229 22526 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:09:52.951462 22570 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:09:52.952185 23737 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:52.952626 23737 raft_consensus.cc:697] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:09:52.953480 23737 consensus_queue.cc:237] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:52.963459 22457 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:09:52.966179 23617 raft_consensus.cc:993] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc: : Instructing follower 1676e7af5e4a47cb86ee7db83e3d4881 to start an election
I20260709 12:09:52.966693 23617 raft_consensus.cc:1081] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Signalling peer 1676e7af5e4a47cb86ee7db83e3d4881 to start an election
W20260709 12:09:52.969310 22403 auto_rebalancer.cc:629] Failed to schedule move for tablet effbc980be0840c9891d7e7b22d3c3ef: Remote error: Service unavailable: leader transfer in progress
I20260709 12:09:52.969194 22526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:56942
I20260709 12:09:52.975973 22526 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:52.976495 22526 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:09:52.981792 22403 auto_rebalancer.cc:629] Failed to schedule move for tablet a2337c1c696448c287a9a1885624d3d0: Illegal state: Replica c863116d91c14d1ca50d6e8a46a37a8f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:09:52.987010 22605 consensus_queue.cc:237] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:52.992233 22526 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:52.996371 22526 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:52.998919 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:53.001847 22601 raft_consensus.cc:3055] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:53.002162 22601 raft_consensus.cc:740] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:09:53.002884 22601 consensus_queue.cc:260] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:53.003890 22601 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:52.999449 23706 raft_consensus.cc:993] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881: : Instructing follower 8701cd5186a949538d8efafb5f987270 to start an election
I20260709 12:09:53.007378 23645 raft_consensus.cc:1081] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Signalling peer 8701cd5186a949538d8efafb5f987270 to start an election
I20260709 12:09:53.008074 22528 raft_consensus.cc:1275] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:09:53.009081 22570 consensus_peers.cc:597] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 746b2a18bc684213bde228ac6cc37ef6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:53.009617 23120 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb"
dest_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:57332
I20260709 12:09:53.010174 23120 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:53.010013 23617 consensus_queue.cc:1048] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:53.010583 23120 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.014377 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:53.014935 22455 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:53.021327 22455 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 3.
I20260709 12:09:53.028790 22495 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:53.029596 23706 raft_consensus.cc:2804] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:53.030086 23706 raft_consensus.cc:697] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:53.030898 23706 consensus_queue.cc:237] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:53.040524 22457 raft_consensus.cc:1275] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:53.044530 23735 consensus_queue.cc:1048] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:53.053310 23120 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:53.057013 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:53.057914 22526 raft_consensus.cc:3055] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:53.058223 22526 raft_consensus.cc:740] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:53.059962 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:53.060606 22455 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.066565 22526 consensus_queue.cc:260] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:53.070019 22526 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.070075 22351 catalog_manager.cc:5697] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 2 to 3, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 3 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:53.072002 22353 catalog_manager.cc:5697] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 1 to 2, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 2 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:53.073357 23120 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:53.042424 22601 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 3.
W20260709 12:09:53.096652 23768 log.cc:927] Time spent T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:09:53.099193 22526 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 2.
I20260709 12:09:53.100401 23088 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:09:53.099694 23617 raft_consensus.cc:2955] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:53.101294 23741 raft_consensus.cc:2804] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:53.101819 23741 raft_consensus.cc:697] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 2 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:09:53.102663 23741 consensus_queue.cc:237] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:53.107952 22528 raft_consensus.cc:2955] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:53.113101 22351 catalog_manager.cc:5697] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 1 to 2, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 2 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:53.120739 22455 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 2.
I20260709 12:09:53.133891 22351 catalog_manager.cc:5697] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: config changed from index -1 to 3, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New cstate: current_term: 2 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:53.152877 23721 raft_consensus.cc:993] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f: : Instructing follower 1676e7af5e4a47cb86ee7db83e3d4881 to start an election
I20260709 12:09:53.153373 23721 raft_consensus.cc:1081] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Signalling peer 1676e7af5e4a47cb86ee7db83e3d4881 to start an election
I20260709 12:09:53.155025 22528 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:56940
I20260709 12:09:53.155546 22528 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:53.155864 22528 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.159941 22457 raft_consensus.cc:2955] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:53.180431 23645 raft_consensus.cc:993] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881: : Instructing follower 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:09:53.180994 23645 raft_consensus.cc:1081] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Signalling peer 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:09:53.182672 22605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:45576
I20260709 12:09:53.183252 22605 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:53.183573 22605 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.163034 22528 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:53.187752 22528 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:53.188791 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:53.189391 22601 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.194365 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:53.195060 22457 raft_consensus.cc:3055] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:53.195432 22457 raft_consensus.cc:740] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:09:53.196728 22605 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:53.197674 22457 consensus_queue.cc:260] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:53.199723 22457 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.204134 22605 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:53.205752 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:53.206292 22455 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.208793 22457 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:09:53.212482 22455 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:09:53.214440 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:53.215090 22526 raft_consensus.cc:3055] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:53.215229 22495 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:53.215437 22526 raft_consensus.cc:740] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:53.216313 22526 consensus_queue.cc:260] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:53.219700 22526 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.219961 22601 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:09:53.220682 22603 raft_consensus.cc:1240] T 5b50f0bec71f4924aa1781b9818f1d73 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:53.221446 22569 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:53.223342 23737 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:53.223805 23737 raft_consensus.cc:697] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:09:53.224649 23737 consensus_queue.cc:237] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:53.226935 23706 raft_consensus.cc:2804] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:53.227504 23706 raft_consensus.cc:697] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:53.228296 23706 consensus_queue.cc:237] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:53.247816 22526 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:09:53.273386 22351 catalog_manager.cc:5697] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 1 to 2, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 2 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:53.307780 23774 ts_tablet_manager.cc:933] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:53.324818 22351 catalog_manager.cc:5697] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 1 to 2, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 2 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:53.329986 23774 tablet_copy_client.cc:323] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270: tablet copy: Beginning tablet copy session from remote peer at address 127.20.196.131:37785
I20260709 12:09:53.333022 22615 tablet_copy_service.cc:140] P 6c6fa11e8ee34711b3551f0c670442bc: Received BeginTabletCopySession request for tablet 9286627b6c59411d908ec035984616ac from peer 8701cd5186a949538d8efafb5f987270 ({username='slave'} at 127.0.0.1:43070)
I20260709 12:09:53.333669 22615 tablet_copy_service.cc:161] P 6c6fa11e8ee34711b3551f0c670442bc: Beginning new tablet copy session on tablet 9286627b6c59411d908ec035984616ac from peer 8701cd5186a949538d8efafb5f987270 at {username='slave'} at 127.0.0.1:43070: session id = 8701cd5186a949538d8efafb5f987270-9286627b6c59411d908ec035984616ac
I20260709 12:09:53.342411 22615 tablet_copy_source_session.cc:215] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:53.346659 23774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9286627b6c59411d908ec035984616ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:53.366408 23774 tablet_copy_client.cc:806] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:53.367046 23774 tablet_copy_client.cc:670] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:53.401041 23774 tablet_copy_client.cc:538] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:53.433349 23774 tablet_bootstrap.cc:492] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270: Bootstrap starting.
I20260709 12:09:53.486254 23774 tablet_bootstrap.cc:492] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:53.487255 23774 tablet_bootstrap.cc:492] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270: Bootstrap complete.
I20260709 12:09:53.488000 23774 ts_tablet_manager.cc:1403] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270: Time spent bootstrapping tablet: real 0.055s	user 0.025s	sys 0.018s
I20260709 12:09:53.489943 22455 raft_consensus.cc:1275] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:53.491158 23774 raft_consensus.cc:359] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:53.492218 23774 raft_consensus.cc:740] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Initialized, Role: LEARNER
I20260709 12:09:53.492841 23774 consensus_queue.cc:260] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:53.499626 23623 consensus_queue.cc:1048] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:53.502274 23774 ts_tablet_manager.cc:1434] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 12:09:53.507776 22455 raft_consensus.cc:1275] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:53.509328 23706 consensus_queue.cc:1048] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:53.532886 22601 raft_consensus.cc:1275] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:53.537755 23645 consensus_queue.cc:1048] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:09:53.537755 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 62711.4us
I20260709 12:09:53.553544 22615 tablet_copy_service.cc:342] P 6c6fa11e8ee34711b3551f0c670442bc: Request end of tablet copy session 8701cd5186a949538d8efafb5f987270-9286627b6c59411d908ec035984616ac received from {username='slave'} at 127.0.0.1:43070
I20260709 12:09:53.554119 22615 tablet_copy_service.cc:434] P 6c6fa11e8ee34711b3551f0c670442bc: ending tablet copy session 8701cd5186a949538d8efafb5f987270-9286627b6c59411d908ec035984616ac on tablet 9286627b6c59411d908ec035984616ac with peer 8701cd5186a949538d8efafb5f987270
I20260709 12:09:53.557531 23774 ts_tablet_manager.cc:933] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:09:53.584993 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 87590.3us
I20260709 12:09:53.587366 22457 raft_consensus.cc:1275] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:53.589305 23737 consensus_queue.cc:1048] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:53.604350 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 54979.3us
I20260709 12:09:53.614673 23774 tablet_copy_client.cc:323] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270: tablet copy: Beginning tablet copy session from remote peer at address 127.20.196.131:37785
I20260709 12:09:53.616276 22528 raft_consensus.cc:1275] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:53.617138 22615 tablet_copy_service.cc:140] P 6c6fa11e8ee34711b3551f0c670442bc: Received BeginTabletCopySession request for tablet 746b2a18bc684213bde228ac6cc37ef6 from peer 8701cd5186a949538d8efafb5f987270 ({username='slave'} at 127.0.0.1:43070)
I20260709 12:09:53.617653 22615 tablet_copy_service.cc:161] P 6c6fa11e8ee34711b3551f0c670442bc: Beginning new tablet copy session on tablet 746b2a18bc684213bde228ac6cc37ef6 from peer 8701cd5186a949538d8efafb5f987270 at {username='slave'} at 127.0.0.1:43070: session id = 8701cd5186a949538d8efafb5f987270-746b2a18bc684213bde228ac6cc37ef6
I20260709 12:09:53.621129 23617 consensus_queue.cc:1048] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:53.628909 22615 tablet_copy_source_session.cc:215] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:53.635246 23774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 746b2a18bc684213bde228ac6cc37ef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:53.652149 22528 raft_consensus.cc:1275] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:53.654712 23741 consensus_queue.cc:1048] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:53.674846 22455 raft_consensus.cc:1275] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:53.676812 23737 consensus_queue.cc:1048] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:53.700103 22528 raft_consensus.cc:1275] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:53.706367 23774 tablet_copy_client.cc:806] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:53.715665 23617 consensus_queue.cc:1048] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:53.742476 23774 tablet_copy_client.cc:670] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:53.758529 23774 tablet_copy_client.cc:538] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:53.767974 23774 tablet_bootstrap.cc:492] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270: Bootstrap starting.
I20260709 12:09:53.786381 22603 raft_consensus.cc:1275] T 5b50f0bec71f4924aa1781b9818f1d73 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:53.787923 23713 consensus_queue.cc:1048] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:53.818364 23774 tablet_bootstrap.cc:492] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:53.819319 23774 tablet_bootstrap.cc:492] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270: Bootstrap complete.
I20260709 12:09:53.819985 23774 ts_tablet_manager.cc:1403] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.013s
I20260709 12:09:53.823498 23774 raft_consensus.cc:359] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:53.824318 23774 raft_consensus.cc:740] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Initialized, Role: LEARNER
I20260709 12:09:53.824977 23774 consensus_queue.cc:260] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:53.834492 22455 raft_consensus.cc:1275] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:53.836474 23645 consensus_queue.cc:1048] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:53.855983 23774 ts_tablet_manager.cc:1434] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270: Time spent starting tablet: real 0.036s	user 0.003s	sys 0.005s
I20260709 12:09:53.857667 22615 tablet_copy_service.cc:342] P 6c6fa11e8ee34711b3551f0c670442bc: Request end of tablet copy session 8701cd5186a949538d8efafb5f987270-746b2a18bc684213bde228ac6cc37ef6 received from {username='slave'} at 127.0.0.1:43070
I20260709 12:09:53.858124 22615 tablet_copy_service.cc:434] P 6c6fa11e8ee34711b3551f0c670442bc: ending tablet copy session 8701cd5186a949538d8efafb5f987270-746b2a18bc684213bde228ac6cc37ef6 on tablet 746b2a18bc684213bde228ac6cc37ef6 with peer 8701cd5186a949538d8efafb5f987270
I20260709 12:09:53.886065 23125 raft_consensus.cc:1217] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:09:53.897563 23125 raft_consensus.cc:1217] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:09:53.924657 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:53.984717 22528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
 from {username='slave'} at 127.0.0.1:39980
I20260709 12:09:53.985296 22528 raft_consensus.cc:606] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Received request to transfer leadership to TS c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:53.988989 22455 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
mode: GRACEFUL
new_leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:44568
I20260709 12:09:53.989518 22455 raft_consensus.cc:606] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Received request to transfer leadership to TS 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:09:53.995800 22605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b955a164159b49b9bf083e35e340e323"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:09:53.996321 22605 raft_consensus.cc:606] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Received request to transfer leadership to TS 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:09:53.999123 22601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:09:53.999558 22601 raft_consensus.cc:606] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:09:54.000533 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:09:54.001638 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:54.002213 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:54.043277 23767 raft_consensus.cc:993] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc: : Instructing follower 8701cd5186a949538d8efafb5f987270 to start an election
I20260709 12:09:54.043751 23767 raft_consensus.cc:1081] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Signalling peer 8701cd5186a949538d8efafb5f987270 to start an election
I20260709 12:09:54.045524 23125 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd"
dest_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:57328
I20260709 12:09:54.046038 23125 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:54.046340 23125 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.054214 23125 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:54.056118 23125 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:54.057050 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:54.057615 22601 raft_consensus.cc:3055] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:54.057893 22601 raft_consensus.cc:740] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:09:54.058578 22601 consensus_queue.cc:260] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:54.059744 22601 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.059775 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:54.061625 22457 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.069873 22601 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 2.
I20260709 12:09:54.071422 23089 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:09:54.072214 23778 raft_consensus.cc:2804] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:54.072697 23778 raft_consensus.cc:697] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 2 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:09:54.073539 23778 consensus_queue.cc:237] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:54.081256 22457 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 2.
I20260709 12:09:54.104538 22353 catalog_manager.cc:5697] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 1 to 2, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 2 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:54.118479 23713 raft_consensus.cc:993] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881: : Instructing follower c863116d91c14d1ca50d6e8a46a37a8f to start an election
I20260709 12:09:54.119043 23713 raft_consensus.cc:1081] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Signalling peer c863116d91c14d1ca50d6e8a46a37a8f to start an election
I20260709 12:09:54.120859 22457 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
 from {username='slave'} at 127.0.0.1:51844
I20260709 12:09:54.121388 22457 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:54.121727 22457 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.141287 22457 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:54.143750 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:54.144273 22528 raft_consensus.cc:3055] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:54.144578 22528 raft_consensus.cc:740] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:54.145263 22528 consensus_queue.cc:260] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:54.146929 22528 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.160760 22528 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 2.
I20260709 12:09:54.162279 22457 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 2 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:54.164628 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:54.165057 22421 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:54.167542 23635 raft_consensus.cc:2804] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:54.168025 23635 raft_consensus.cc:697] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:09:54.168948 23635 consensus_queue.cc:237] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:54.165217 22601 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.182328 22601 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 2.
I20260709 12:09:54.190644 22353 catalog_manager.cc:5697] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 1 to 2, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 2 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:54.353747 23735 raft_consensus.cc:1064] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
I20260709 12:09:54.356353 23735 consensus_queue.cc:237] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:54.364738 22457 raft_consensus.cc:1275] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:54.365067 23617 raft_consensus.cc:993] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc: : Instructing follower 1676e7af5e4a47cb86ee7db83e3d4881 to start an election
I20260709 12:09:54.365211 22526 raft_consensus.cc:1275] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:54.365538 23617 raft_consensus.cc:1081] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Signalling peer 1676e7af5e4a47cb86ee7db83e3d4881 to start an election
I20260709 12:09:54.366173 23735 consensus_queue.cc:1048] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:54.368610 23617 consensus_queue.cc:1048] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:54.377967 22526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b955a164159b49b9bf083e35e340e323"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:56942
I20260709 12:09:54.378531 22526 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:54.378887 22526 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.386647 23125 raft_consensus.cc:1275] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 2 LEARNER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:54.388165 23767 consensus_queue.cc:1048] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:54.397500 23635 raft_consensus.cc:993] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f: : Instructing follower 1676e7af5e4a47cb86ee7db83e3d4881 to start an election
I20260709 12:09:54.397917 23635 raft_consensus.cc:1081] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Signalling peer 1676e7af5e4a47cb86ee7db83e3d4881 to start an election
I20260709 12:09:54.400553 22526 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:54.404601 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:54.405218 22451 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.413978 22451 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:09:54.416142 22495 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:54.416913 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:54.417500 22603 raft_consensus.cc:3055] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:54.417788 22603 raft_consensus.cc:740] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:09:54.418402 22527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:56940
I20260709 12:09:54.419018 22527 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:54.419417 22527 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.420301 22603 consensus_queue.cc:260] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:54.421300 22603 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.423475 23645 raft_consensus.cc:2804] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:54.426137 23645 raft_consensus.cc:697] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:54.430702 22527 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:54.434720 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:09:54.435338 23125 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.426952 23645 consensus_queue.cc:237] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:54.435914 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:54.443859 22455 raft_consensus.cc:3055] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:54.444166 22455 raft_consensus.cc:740] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:09:54.444499 22603 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:09:54.446410 22526 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:54.447319 22455 consensus_queue.cc:260] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:54.448613 22455 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.456795 22603 raft_consensus.cc:1275] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:54.458262 23741 consensus_queue.cc:1048] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:54.476562 22455 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:09:54.478214 23767 raft_consensus.cc:1064] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
I20260709 12:09:54.480026 22527 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:09:54.481585 23125 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:09:54.494791 22495 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:09:54.556763 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 62070.4us
I20260709 12:09:54.558053 23645 raft_consensus.cc:2804] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:09:54.612192 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 88231.9us
I20260709 12:09:54.578302 23645 raft_consensus.cc:697] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:54.651278 23645 consensus_queue.cc:237] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:54.652794 23767 consensus_queue.cc:237] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:54.662406 23808 raft_consensus.cc:2955] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:54.664326 22354 catalog_manager.cc:5697] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 1 to 2, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 2 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:54.708030 22353 catalog_manager.cc:5697] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: config changed from index 3 to 4, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:54.730791 22354 catalog_manager.cc:5697] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 1 to 2, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 2 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:54.750692 22456 raft_consensus.cc:1275] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:54.758809 23623 consensus_queue.cc:1048] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:54.758900 23123 raft_consensus.cc:2955] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
W20260709 12:09:54.801391 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 253897us
I20260709 12:09:54.796756 22528 raft_consensus.cc:2955] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:54.813248 22451 raft_consensus.cc:2955] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:54.843698 22525 raft_consensus.cc:1275] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:54.863622 22603 raft_consensus.cc:1275] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:54.884883 23756 consensus_queue.cc:1048] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:54.902295 22451 raft_consensus.cc:1275] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:54.905470 23815 consensus_queue.cc:1048] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:09:54.917518 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 66553.5us
I20260709 12:09:54.925001 23721 consensus_queue.cc:1048] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:54.919644 23123 raft_consensus.cc:1275] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 2 LEARNER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:54.940208 23815 consensus_queue.cc:1048] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:54.942148 22525 raft_consensus.cc:1275] T 9286627b6c59411d908ec035984616ac P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:54.944895 22605 raft_consensus.cc:1275] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:54.948194 22451 raft_consensus.cc:1275] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:54.950152 23706 consensus_queue.cc:1048] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:54.954423 23706 consensus_queue.cc:1048] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:54.964022 23823 consensus_queue.cc:1048] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:09:54.968312 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 46056.3us
I20260709 12:09:54.988890 23767 raft_consensus.cc:2955] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:55.000514 22525 raft_consensus.cc:2955] T 9286627b6c59411d908ec035984616ac P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:55.015846 23119 raft_consensus.cc:2955] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:55.019709 22601 consensus_queue.cc:237] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:55.031700 22451 raft_consensus.cc:2955] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:55.038411 22457 raft_consensus.cc:1275] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:55.040805 23812 consensus_queue.cc:1048] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:55.051695 23808 raft_consensus.cc:2955] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:55.056583 22455 raft_consensus.cc:2955] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:55.066891 22351 catalog_manager.cc:5697] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: config changed from index 3 to 4, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:55.071195 23123 raft_consensus.cc:1275] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:55.078810 23812 consensus_queue.cc:1048] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:09:55.084031 23119 raft_consensus.cc:1275] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:55.085364 23813 consensus_queue.cc:1048] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:55.085098 23123 raft_consensus.cc:2955] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:55.094844 22341 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 746b2a18bc684213bde228ac6cc37ef6 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:55.100170 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:55.112717 22601 consensus_queue.cc:237] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:55.140930 22451 raft_consensus.cc:1275] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:55.142843 23706 consensus_queue.cc:1048] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:55.145587 22457 raft_consensus.cc:1275] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:55.147032 23767 consensus_queue.cc:1048] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:55.148312 23120 raft_consensus.cc:1275] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:55.155185 23815 consensus_queue.cc:1048] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:55.157908 23823 raft_consensus.cc:2955] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:55.158948 22353 catalog_manager.cc:5697] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: config changed from index 4 to 5, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New cstate: current_term: 2 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:55.175115 22451 raft_consensus.cc:2955] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:55.207423 22341 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9286627b6c59411d908ec035984616ac with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:55.232371 23119 raft_consensus.cc:2955] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:55.233847 22517 tablet_service.cc:1558] Processing DeleteTablet for tablet 746b2a18bc684213bde228ac6cc37ef6 with delete_type TABLET_DATA_TOMBSTONED (TS 1676e7af5e4a47cb86ee7db83e3d4881 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:56928
I20260709 12:09:55.251816 23843 tablet_replica.cc:333] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:09:55.252940 23843 raft_consensus.cc:2243] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:55.253772 23843 raft_consensus.cc:2272] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:55.259079 23843 ts_tablet_manager.cc:1916] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:55.275362 23843 ts_tablet_manager.cc:1929] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:09:55.275817 23843 log.cc:1199] T 746b2a18bc684213bde228ac6cc37ef6 P 1676e7af5e4a47cb86ee7db83e3d4881: Deleting WAL directory at /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-1-root/wals/746b2a18bc684213bde228ac6cc37ef6
I20260709 12:09:55.308207 22340 catalog_manager.cc:5028] TS 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): tablet 746b2a18bc684213bde228ac6cc37ef6 (table test-workload [id=1e73b97ba677488c8829a696096f4885]) successfully deleted
I20260709 12:09:55.315865 22352 catalog_manager.cc:5697] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: config changed from index 4 to 5, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New cstate: current_term: 2 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:55.424296 22517 tablet_service.cc:1558] Processing DeleteTablet for tablet 9286627b6c59411d908ec035984616ac with delete_type TABLET_DATA_TOMBSTONED (TS 1676e7af5e4a47cb86ee7db83e3d4881 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:56928
I20260709 12:09:55.426654 23843 tablet_replica.cc:333] T 9286627b6c59411d908ec035984616ac P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:09:55.482676 23843 raft_consensus.cc:2243] T 9286627b6c59411d908ec035984616ac P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:55.484648 23843 raft_consensus.cc:2272] T 9286627b6c59411d908ec035984616ac P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:55.486467 22453 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "263d51d0b43744d899e37466045af890"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
mode: GRACEFUL
new_leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:44568
I20260709 12:09:55.487396 22453 raft_consensus.cc:606] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Received request to transfer leadership to TS 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:09:55.490882 23843 ts_tablet_manager.cc:1916] T 9286627b6c59411d908ec035984616ac P 1676e7af5e4a47cb86ee7db83e3d4881: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:55.496892 22525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b955a164159b49b9bf083e35e340e323"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
 from {username='slave'} at 127.0.0.1:39980
I20260709 12:09:55.497642 22525 raft_consensus.cc:606] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Received request to transfer leadership to TS c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:55.504377 22525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf783936508640219af47375c444da09"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:39980
I20260709 12:09:55.505446 22525 raft_consensus.cc:606] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Received request to transfer leadership to TS 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:09:55.509929 22525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:39980
I20260709 12:09:55.510718 22525 raft_consensus.cc:606] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Received request to transfer leadership to TS 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:09:55.513669 23843 ts_tablet_manager.cc:1929] T 9286627b6c59411d908ec035984616ac P 1676e7af5e4a47cb86ee7db83e3d4881: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:09:55.514281 23843 log.cc:1199] T 9286627b6c59411d908ec035984616ac P 1676e7af5e4a47cb86ee7db83e3d4881: Deleting WAL directory at /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-1-root/wals/9286627b6c59411d908ec035984616ac
I20260709 12:09:55.515156 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:09:55.516603 22340 catalog_manager.cc:5028] TS 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): tablet 9286627b6c59411d908ec035984616ac (table test-workload [id=1e73b97ba677488c8829a696096f4885]) successfully deleted
I20260709 12:09:55.520882 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:55.523017 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:55.609669 23706 raft_consensus.cc:993] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881: : Instructing follower c863116d91c14d1ca50d6e8a46a37a8f to start an election
I20260709 12:09:55.610249 23706 raft_consensus.cc:1081] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Signalling peer c863116d91c14d1ca50d6e8a46a37a8f to start an election
I20260709 12:09:55.614307 22454 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b955a164159b49b9bf083e35e340e323"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
 from {username='slave'} at 127.0.0.1:51844
I20260709 12:09:55.615167 22454 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:55.615764 22454 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:55.626528 22454 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:55.628371 22454 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:55.629374 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:55.629631 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:55.630172 22601 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:55.630290 22525 raft_consensus.cc:3055] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:55.630710 22525 raft_consensus.cc:740] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:55.631534 22525 consensus_queue.cc:260] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:55.632899 22525 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:55.636089 22601 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:09:55.637682 22422 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:55.638952 23833 raft_consensus.cc:2804] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:55.639436 23833 raft_consensus.cc:697] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:09:55.640461 23833 consensus_queue.cc:237] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:55.641211 22525 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:09:55.651989 22351 catalog_manager.cc:5697] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 2 to 3, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 3 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:55.721822 23811 raft_consensus.cc:993] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881: : Instructing follower 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:09:55.722448 23810 raft_consensus.cc:1081] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Signalling peer 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:09:55.723999 22602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:45576
I20260709 12:09:55.724426 22602 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:55.724697 22602 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.729980 22602 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:55.732636 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:55.732805 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:55.733017 22602 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:55.733239 22453 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.733431 22525 raft_consensus.cc:3055] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:55.733881 22525 raft_consensus.cc:740] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:55.734848 22525 consensus_queue.cc:260] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:55.736176 22525 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.739734 22453 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:09:55.741060 22569 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:55.742009 23808 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:55.742458 23808 raft_consensus.cc:697] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:09:55.747581 23808 consensus_queue.cc:237] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:55.749361 22525 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:09:55.765298 22351 catalog_manager.cc:5697] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 1 to 2, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 2 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:55.772962 23833 raft_consensus.cc:993] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f: : Instructing follower 1676e7af5e4a47cb86ee7db83e3d4881 to start an election
I20260709 12:09:55.775249 23721 raft_consensus.cc:1081] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Signalling peer 1676e7af5e4a47cb86ee7db83e3d4881 to start an election
I20260709 12:09:55.777173 22525 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "263d51d0b43744d899e37466045af890"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:56940
I20260709 12:09:55.777779 22525 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:55.778182 22525 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.784111 22525 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:55.786350 22525 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:55.787052 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:55.787482 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:55.787650 22454 raft_consensus.cc:3055] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:55.788031 22601 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.788224 22454 raft_consensus.cc:740] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:09:55.789074 22454 consensus_queue.cc:260] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:55.790239 22454 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.794454 22601 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:09:55.795806 22497 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:09:55.796627 23810 raft_consensus.cc:2804] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:55.797078 23810 raft_consensus.cc:697] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:55.798051 22454 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:09:55.798029 23810 consensus_queue.cc:237] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:55.812420 23706 raft_consensus.cc:993] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881: : Instructing follower 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:09:55.811861 22351 catalog_manager.cc:5697] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 1 to 2, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 2 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:55.813042 23811 raft_consensus.cc:1081] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Signalling peer 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:09:55.814810 22601 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf783936508640219af47375c444da09"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:45576
I20260709 12:09:55.815387 22601 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:55.815847 22601 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.822813 22601 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:55.824539 22601 leader_election.cc:290] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:09:55.825559 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:55.826174 22525 raft_consensus.cc:3055] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:55.826161 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:09:55.826664 22525 raft_consensus.cc:740] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:55.826807 23119 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.827561 22525 consensus_queue.cc:260] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:55.828935 22525 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.834864 23119 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:09:55.836417 22570 leader_election.cc:304] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:09:55.838119 23617 raft_consensus.cc:2804] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:55.838433 22525 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:09:55.838735 23617 raft_consensus.cc:697] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:09:55.840214 23617 consensus_queue.cc:237] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:55.850657 22351 catalog_manager.cc:5697] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 1 to 2, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 2 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:56.058506 22601 raft_consensus.cc:1275] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:56.059926 23833 consensus_queue.cc:1048] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:56.072491 22525 raft_consensus.cc:1275] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:56.074337 23721 consensus_queue.cc:1048] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:56.162225 22453 raft_consensus.cc:1275] T ea8ebc1d824844e688d0bd61c3fd2258 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:56.163340 23808 consensus_queue.cc:1048] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:56.172219 22527 raft_consensus.cc:1275] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:56.177110 23823 consensus_queue.cc:1048] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:56.222244 22453 raft_consensus.cc:1275] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:56.223546 23810 consensus_queue.cc:1048] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:56.235548 22601 raft_consensus.cc:1275] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:56.236923 23810 consensus_queue.cc:1048] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:56.240286 23119 raft_consensus.cc:1275] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:56.242851 23808 consensus_queue.cc:1048] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:56.272176 22525 raft_consensus.cc:1275] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:56.273631 23617 consensus_queue.cc:1048] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:56.509984 22453 consensus_queue.cc:237] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
W20260709 12:09:56.520188 22421 consensus_peers.cc:597] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 19a99176cd014d618ba1793fbb19aeab. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:56.520388 22601 raft_consensus.cc:1275] T 19a99176cd014d618ba1793fbb19aeab P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:56.521730 22527 raft_consensus.cc:1275] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:56.522646 23850 consensus_queue.cc:1048] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:56.523674 23721 consensus_queue.cc:1048] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:56.538619 23851 raft_consensus.cc:2955] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:56.540419 22601 raft_consensus.cc:2955] T 19a99176cd014d618ba1793fbb19aeab P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:56.541340 22527 raft_consensus.cc:2955] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:56.559227 22352 catalog_manager.cc:5697] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:56.560001 22601 consensus_queue.cc:237] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
W20260709 12:09:56.567201 22570 consensus_peers.cc:597] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ea8ebc1d824844e688d0bd61c3fd2258. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:56.569972 22527 raft_consensus.cc:1275] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:56.570719 22453 raft_consensus.cc:1275] T ea8ebc1d824844e688d0bd61c3fd2258 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:56.571483 23617 consensus_queue.cc:1048] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:56.572407 23808 consensus_queue.cc:1048] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:56.581202 23808 raft_consensus.cc:2955] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:56.584638 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:56.595235 22450 raft_consensus.cc:2955] T ea8ebc1d824844e688d0bd61c3fd2258 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:56.600328 22525 raft_consensus.cc:2955] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:56.616093 22351 catalog_manager.cc:5697] T ea8ebc1d824844e688d0bd61c3fd2258 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: config changed from index -1 to 3, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New cstate: current_term: 2 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:56.622701 22450 consensus_queue.cc:237] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
W20260709 12:09:56.642338 22421 consensus_peers.cc:597] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aeff0fdef6b04a46975756455aba1a98. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:56.645272 22601 raft_consensus.cc:1275] T aeff0fdef6b04a46975756455aba1a98 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:56.647835 23850 consensus_queue.cc:1048] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:56.658670 22525 raft_consensus.cc:1275] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:56.660617 23833 consensus_queue.cc:1048] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:56.670742 22605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:09:56.671389 22605 raft_consensus.cc:606] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Received request to transfer leadership to TS 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:09:56.676978 22602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40384260c96247e0ac31ade25baddaff"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:09:56.677511 22602 raft_consensus.cc:606] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Received request to transfer leadership to TS c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:56.682231 22450 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
mode: GRACEFUL
new_leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:44568
I20260709 12:09:56.682844 22450 raft_consensus.cc:606] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 LEADER]: Received request to transfer leadership to TS 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:09:56.685559 22525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
 from {username='slave'} at 127.0.0.1:39980
I20260709 12:09:56.686071 22525 raft_consensus.cc:606] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Received request to transfer leadership to TS c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:56.686154 23851 raft_consensus.cc:2955] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:56.688189 22525 raft_consensus.cc:2955] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:56.690891 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:09:56.692552 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:56.693255 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:56.694134 22602 raft_consensus.cc:2955] T aeff0fdef6b04a46975756455aba1a98 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:56.719237 22602 consensus_queue.cc:237] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:56.720407 22351 catalog_manager.cc:5697] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:56.728382 23823 raft_consensus.cc:993] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc: : Instructing follower c863116d91c14d1ca50d6e8a46a37a8f to start an election
I20260709 12:09:56.729043 23870 raft_consensus.cc:1081] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Signalling peer c863116d91c14d1ca50d6e8a46a37a8f to start an election
I20260709 12:09:56.731683 22450 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40384260c96247e0ac31ade25baddaff"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
 from {username='slave'} at 127.0.0.1:51836
I20260709 12:09:56.732138 23706 raft_consensus.cc:993] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881: : Instructing follower c863116d91c14d1ca50d6e8a46a37a8f to start an election
I20260709 12:09:56.732226 22450 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:56.732669 23706 raft_consensus.cc:1081] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Signalling peer c863116d91c14d1ca50d6e8a46a37a8f to start an election
I20260709 12:09:56.732743 22450 raft_consensus.cc:3060] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.734530 22454 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
 from {username='slave'} at 127.0.0.1:51844
I20260709 12:09:56.735095 22454 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:56.735467 22454 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.745914 22450 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:56.750682 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:56.751240 22605 raft_consensus.cc:3055] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:56.751535 22605 raft_consensus.cc:740] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:09:56.752279 22605 consensus_queue.cc:260] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:56.752993 22454 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:56.753335 22605 raft_consensus.cc:3060] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.755900 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:56.756420 22601 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.757964 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:56.758518 22525 raft_consensus.cc:3055] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:56.758791 22525 raft_consensus.cc:740] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:56.759538 22525 consensus_queue.cc:260] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:56.760497 22525 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.762687 22450 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 2 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:09:56.763368 22601 raft_consensus.cc:2468] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 2.
I20260709 12:09:56.763752 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:09:56.764292 23120 raft_consensus.cc:3060] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.764636 22454 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 2 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:56.764722 22422 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:56.765622 23833 raft_consensus.cc:2804] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:56.766069 23833 raft_consensus.cc:697] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:09:56.766712 22605 raft_consensus.cc:2468] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 2.
I20260709 12:09:56.766940 23833 consensus_queue.cc:237] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:56.769690 22422 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:56.770954 23875 raft_consensus.cc:2804] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:56.771446 23875 raft_consensus.cc:697] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 2 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
W20260709 12:09:56.771749 22570 consensus_peers.cc:597] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c3000c4a87f46b69b5da41dc1115486. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:56.772182 22525 raft_consensus.cc:2468] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 2.
I20260709 12:09:56.772315 23875 consensus_queue.cc:237] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:56.774670 22454 raft_consensus.cc:1275] T 8c3000c4a87f46b69b5da41dc1115486 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:56.775285 22527 raft_consensus.cc:1275] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:56.776038 23120 raft_consensus.cc:2468] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 2.
I20260709 12:09:56.776515 23823 consensus_queue.cc:1048] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:56.777395 23808 consensus_queue.cc:1048] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:56.803964 22355 catalog_manager.cc:5697] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 1 to 2, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 2 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:56.803845 23617 raft_consensus.cc:2955] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:56.805876 22527 raft_consensus.cc:2955] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:56.811686 22454 raft_consensus.cc:2955] T 8c3000c4a87f46b69b5da41dc1115486 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:56.827693 22355 catalog_manager.cc:5697] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 1 to 2, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 2 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:56.843945 22352 catalog_manager.cc:5697] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New cstate: current_term: 1 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:09:56.955569 23617 raft_consensus.cc:993] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc: : Instructing follower 1676e7af5e4a47cb86ee7db83e3d4881 to start an election
I20260709 12:09:56.956053 23808 raft_consensus.cc:1081] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Signalling peer 1676e7af5e4a47cb86ee7db83e3d4881 to start an election
I20260709 12:09:56.957530 22525 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:56942
I20260709 12:09:56.958050 22525 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:56.958387 22525 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:56.965062 22525 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:56.966885 22525 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:56.968020 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:56.968629 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:56.968680 22601 raft_consensus.cc:3055] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:56.969341 22454 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:56.969347 22601 raft_consensus.cc:740] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:09:56.970489 22601 consensus_queue.cc:260] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:56.971676 22601 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:56.976572 22454 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 3.
I20260709 12:09:56.977810 22601 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 3.
I20260709 12:09:56.977878 22495 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:56.978835 23811 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:56.979310 23811 raft_consensus.cc:697] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:56.981503 23811 consensus_queue.cc:237] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:56.983736 23875 raft_consensus.cc:993] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f: : Instructing follower 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:09:56.984239 23875 raft_consensus.cc:1081] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 LEADER]: Signalling peer 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:09:56.986797 22601 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:45562
I20260709 12:09:56.990520 22601 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:56.990924 22601 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:56.997344 22601 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:56.997520 22351 catalog_manager.cc:5697] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 2 to 3, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 3 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:57.000276 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:57.001206 22525 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:57.000728 22601 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:57.002624 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:57.003239 22454 raft_consensus.cc:3055] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:57.003516 22454 raft_consensus.cc:740] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:09:57.004171 22454 consensus_queue.cc:260] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:57.005350 22454 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:57.011947 22454 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:09:57.013170 22525 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:09:57.014003 22569 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:57.014941 23808 raft_consensus.cc:2804] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:57.015463 23808 raft_consensus.cc:697] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:09:57.016352 23808 consensus_queue.cc:237] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:57.017535 23882 ts_tablet_manager.cc:933] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:57.021545 23882 tablet_copy_client.cc:323] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270: tablet copy: Beginning tablet copy session from remote peer at address 127.20.196.131:37785
I20260709 12:09:57.023586 22615 tablet_copy_service.cc:140] P 6c6fa11e8ee34711b3551f0c670442bc: Received BeginTabletCopySession request for tablet ea8ebc1d824844e688d0bd61c3fd2258 from peer 8701cd5186a949538d8efafb5f987270 ({username='slave'} at 127.0.0.1:43070)
I20260709 12:09:57.024122 22615 tablet_copy_service.cc:161] P 6c6fa11e8ee34711b3551f0c670442bc: Beginning new tablet copy session on tablet ea8ebc1d824844e688d0bd61c3fd2258 from peer 8701cd5186a949538d8efafb5f987270 at {username='slave'} at 127.0.0.1:43070: session id = 8701cd5186a949538d8efafb5f987270-ea8ebc1d824844e688d0bd61c3fd2258
I20260709 12:09:57.035921 22615 tablet_copy_source_session.cc:215] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:57.039726 23882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea8ebc1d824844e688d0bd61c3fd2258. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:57.047315 22351 catalog_manager.cc:5697] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 2 to 3, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 3 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:57.071729 23885 ts_tablet_manager.cc:933] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317)
I20260709 12:09:57.072000 23882 tablet_copy_client.cc:806] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:57.072691 23882 tablet_copy_client.cc:670] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:57.075512 23885 tablet_copy_client.cc:323] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270: tablet copy: Beginning tablet copy session from remote peer at address 127.20.196.129:42317
I20260709 12:09:57.077292 23882 tablet_copy_client.cc:538] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:57.077606 22467 tablet_copy_service.cc:140] P c863116d91c14d1ca50d6e8a46a37a8f: Received BeginTabletCopySession request for tablet aeff0fdef6b04a46975756455aba1a98 from peer 8701cd5186a949538d8efafb5f987270 ({username='slave'} at 127.0.0.1:34452)
I20260709 12:09:57.078158 22467 tablet_copy_service.cc:161] P c863116d91c14d1ca50d6e8a46a37a8f: Beginning new tablet copy session on tablet aeff0fdef6b04a46975756455aba1a98 from peer 8701cd5186a949538d8efafb5f987270 at {username='slave'} at 127.0.0.1:34452: session id = 8701cd5186a949538d8efafb5f987270-aeff0fdef6b04a46975756455aba1a98
I20260709 12:09:57.085960 22467 tablet_copy_source_session.cc:215] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:57.087206 23882 tablet_bootstrap.cc:492] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270: Bootstrap starting.
I20260709 12:09:57.090811 23885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aeff0fdef6b04a46975756455aba1a98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:57.108215 23885 tablet_copy_client.cc:806] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:57.108839 23885 tablet_copy_client.cc:670] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:57.112933 23885 tablet_copy_client.cc:538] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:57.117758 23882 tablet_bootstrap.cc:492] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:57.118731 23882 tablet_bootstrap.cc:492] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270: Bootstrap complete.
I20260709 12:09:57.119457 23882 ts_tablet_manager.cc:1403] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270: Time spent bootstrapping tablet: real 0.033s	user 0.023s	sys 0.008s
I20260709 12:09:57.122366 23885 tablet_bootstrap.cc:492] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270: Bootstrap starting.
I20260709 12:09:57.123131 23882 raft_consensus.cc:359] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:57.124377 23882 raft_consensus.cc:740] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Initialized, Role: LEARNER
I20260709 12:09:57.125058 23882 consensus_queue.cc:260] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:57.128352 23882 ts_tablet_manager.cc:1434] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:09:57.130048 22615 tablet_copy_service.cc:342] P 6c6fa11e8ee34711b3551f0c670442bc: Request end of tablet copy session 8701cd5186a949538d8efafb5f987270-ea8ebc1d824844e688d0bd61c3fd2258 received from {username='slave'} at 127.0.0.1:43070
I20260709 12:09:57.130493 22615 tablet_copy_service.cc:434] P 6c6fa11e8ee34711b3551f0c670442bc: ending tablet copy session 8701cd5186a949538d8efafb5f987270-ea8ebc1d824844e688d0bd61c3fd2258 on tablet ea8ebc1d824844e688d0bd61c3fd2258 with peer 8701cd5186a949538d8efafb5f987270
I20260709 12:09:57.142613 23882 ts_tablet_manager.cc:933] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317)
I20260709 12:09:57.159235 22601 raft_consensus.cc:1275] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:57.156617 23882 tablet_copy_client.cc:323] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270: tablet copy: Beginning tablet copy session from remote peer at address 127.20.196.129:42317
I20260709 12:09:57.161259 23120 raft_consensus.cc:1275] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:57.162292 22467 tablet_copy_service.cc:140] P c863116d91c14d1ca50d6e8a46a37a8f: Received BeginTabletCopySession request for tablet 19a99176cd014d618ba1793fbb19aeab from peer 8701cd5186a949538d8efafb5f987270 ({username='slave'} at 127.0.0.1:34452)
I20260709 12:09:57.162587 23885 tablet_bootstrap.cc:492] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:57.162845 22467 tablet_copy_service.cc:161] P c863116d91c14d1ca50d6e8a46a37a8f: Beginning new tablet copy session on tablet 19a99176cd014d618ba1793fbb19aeab from peer 8701cd5186a949538d8efafb5f987270 at {username='slave'} at 127.0.0.1:34452: session id = 8701cd5186a949538d8efafb5f987270-19a99176cd014d618ba1793fbb19aeab
I20260709 12:09:57.162618 23874 consensus_queue.cc:1048] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:57.163743 23885 tablet_bootstrap.cc:492] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270: Bootstrap complete.
I20260709 12:09:57.164430 23885 ts_tablet_manager.cc:1403] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.014s
I20260709 12:09:57.164172 23833 consensus_queue.cc:1048] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:57.171829 23885 raft_consensus.cc:359] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:57.172621 23885 raft_consensus.cc:740] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Initialized, Role: LEARNER
I20260709 12:09:57.173300 23885 consensus_queue.cc:260] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:57.172756 22467 tablet_copy_source_session.cc:215] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:57.175853 23885 ts_tablet_manager.cc:1434] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 12:09:57.178927 23882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19a99176cd014d618ba1793fbb19aeab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:57.194615 22467 tablet_copy_service.cc:342] P c863116d91c14d1ca50d6e8a46a37a8f: Request end of tablet copy session 8701cd5186a949538d8efafb5f987270-aeff0fdef6b04a46975756455aba1a98 received from {username='slave'} at 127.0.0.1:34452
I20260709 12:09:57.195161 22467 tablet_copy_service.cc:434] P c863116d91c14d1ca50d6e8a46a37a8f: ending tablet copy session 8701cd5186a949538d8efafb5f987270-aeff0fdef6b04a46975756455aba1a98 on tablet aeff0fdef6b04a46975756455aba1a98 with peer 8701cd5186a949538d8efafb5f987270
I20260709 12:09:57.223479 23882 tablet_copy_client.cc:806] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:57.224040 23882 tablet_copy_client.cc:670] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:57.232964 23891 ts_tablet_manager.cc:933] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:57.234189 23882 tablet_copy_client.cc:538] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:57.248064 23882 tablet_bootstrap.cc:492] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270: Bootstrap starting.
I20260709 12:09:57.258212 22525 raft_consensus.cc:1275] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:57.260771 23721 consensus_queue.cc:1048] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:57.259456 23891 tablet_copy_client.cc:323] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270: tablet copy: Beginning tablet copy session from remote peer at address 127.20.196.131:37785
I20260709 12:09:57.263439 22615 tablet_copy_service.cc:140] P 6c6fa11e8ee34711b3551f0c670442bc: Received BeginTabletCopySession request for tablet 8c3000c4a87f46b69b5da41dc1115486 from peer 8701cd5186a949538d8efafb5f987270 ({username='slave'} at 127.0.0.1:43070)
I20260709 12:09:57.263933 22615 tablet_copy_service.cc:161] P 6c6fa11e8ee34711b3551f0c670442bc: Beginning new tablet copy session on tablet 8c3000c4a87f46b69b5da41dc1115486 from peer 8701cd5186a949538d8efafb5f987270 at {username='slave'} at 127.0.0.1:43070: session id = 8701cd5186a949538d8efafb5f987270-8c3000c4a87f46b69b5da41dc1115486
I20260709 12:09:57.271836 22615 tablet_copy_source_session.cc:215] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:57.276257 23891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c3000c4a87f46b69b5da41dc1115486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:57.293183 22601 raft_consensus.cc:1275] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:57.294859 23833 consensus_queue.cc:1048] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:57.373118 23891 tablet_copy_client.cc:806] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:57.373680 23891 tablet_copy_client.cc:670] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:57.375983 23882 tablet_bootstrap.cc:492] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:57.376981 23882 tablet_bootstrap.cc:492] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270: Bootstrap complete.
I20260709 12:09:57.377297 23891 tablet_copy_client.cc:538] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:57.377723 23882 ts_tablet_manager.cc:1403] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270: Time spent bootstrapping tablet: real 0.130s	user 0.024s	sys 0.033s
I20260709 12:09:57.380398 23882 raft_consensus.cc:359] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:57.381013 23882 raft_consensus.cc:740] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Initialized, Role: LEARNER
I20260709 12:09:57.381587 23882 consensus_queue.cc:260] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:57.383890 23882 ts_tablet_manager.cc:1434] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 12:09:57.386116 23891 tablet_bootstrap.cc:492] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270: Bootstrap starting.
I20260709 12:09:57.387506 22467 tablet_copy_service.cc:342] P c863116d91c14d1ca50d6e8a46a37a8f: Request end of tablet copy session 8701cd5186a949538d8efafb5f987270-19a99176cd014d618ba1793fbb19aeab received from {username='slave'} at 127.0.0.1:34452
I20260709 12:09:57.387977 22467 tablet_copy_service.cc:434] P c863116d91c14d1ca50d6e8a46a37a8f: ending tablet copy session 8701cd5186a949538d8efafb5f987270-19a99176cd014d618ba1793fbb19aeab on tablet 19a99176cd014d618ba1793fbb19aeab with peer 8701cd5186a949538d8efafb5f987270
I20260709 12:09:57.417464 23891 tablet_bootstrap.cc:492] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:57.418284 23891 tablet_bootstrap.cc:492] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270: Bootstrap complete.
I20260709 12:09:57.418826 23891 ts_tablet_manager.cc:1403] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270: Time spent bootstrapping tablet: real 0.033s	user 0.022s	sys 0.004s
I20260709 12:09:57.420964 23891 raft_consensus.cc:359] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:57.421589 23891 raft_consensus.cc:740] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Initialized, Role: LEARNER
I20260709 12:09:57.422096 23891 consensus_queue.cc:260] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:09:57.424635 23891 ts_tablet_manager.cc:1434] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:09:57.426826 22615 tablet_copy_service.cc:342] P 6c6fa11e8ee34711b3551f0c670442bc: Request end of tablet copy session 8701cd5186a949538d8efafb5f987270-8c3000c4a87f46b69b5da41dc1115486 received from {username='slave'} at 127.0.0.1:43070
I20260709 12:09:57.427287 22615 tablet_copy_service.cc:434] P 6c6fa11e8ee34711b3551f0c670442bc: ending tablet copy session 8701cd5186a949538d8efafb5f987270-8c3000c4a87f46b69b5da41dc1115486 on tablet 8c3000c4a87f46b69b5da41dc1115486 with peer 8701cd5186a949538d8efafb5f987270
I20260709 12:09:57.433157 22605 raft_consensus.cc:1275] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:57.437722 23810 consensus_queue.cc:1048] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:57.448277 22450 raft_consensus.cc:1275] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:57.448558 23119 raft_consensus.cc:1217] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:57.449811 23810 consensus_queue.cc:1048] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:57.497371 22450 raft_consensus.cc:1275] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:57.498636 23870 consensus_queue.cc:1048] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:57.509178 22525 raft_consensus.cc:1275] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:57.510527 23823 consensus_queue.cc:1048] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:57.616456 23119 raft_consensus.cc:1217] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:57.633155 23119 raft_consensus.cc:1217] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:09:57.763808 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:57.788452 23119 raft_consensus.cc:1217] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:57.834081 22602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:09:57.834587 22602 raft_consensus.cc:606] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Received request to transfer leadership to TS c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:57.836936 22525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "263d51d0b43744d899e37466045af890"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:39980
I20260709 12:09:57.837544 22525 raft_consensus.cc:606] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Received request to transfer leadership to TS 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:09:57.840835 22450 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
mode: GRACEFUL
new_leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:44568
I20260709 12:09:57.841430 22450 raft_consensus.cc:606] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Received request to transfer leadership to TS 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:09:57.844812 22450 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
mode: GRACEFUL
new_leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:44568
I20260709 12:09:57.845331 22450 raft_consensus.cc:606] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Received request to transfer leadership to TS 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:09:57.846362 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:09:57.848049 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:57.848794 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:57.895496 23823 raft_consensus.cc:993] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc: : Instructing follower c863116d91c14d1ca50d6e8a46a37a8f to start an election
I20260709 12:09:57.896059 23823 raft_consensus.cc:1081] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Signalling peer c863116d91c14d1ca50d6e8a46a37a8f to start an election
I20260709 12:09:57.899039 22450 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
 from {username='slave'} at 127.0.0.1:51836
I20260709 12:09:57.899565 22450 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:57.899911 22450 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:57.905030 22450 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:57.906720 22450 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:09:57.907866 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:57.908149 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:09:57.908427 22602 raft_consensus.cc:3055] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:57.908641 23119 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:57.908727 22602 raft_consensus.cc:740] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:09:57.909557 22602 consensus_queue.cc:260] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:57.910564 22602 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:57.914929 23119 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:09:57.916115 22421 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:57.917565 23833 raft_consensus.cc:2804] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:57.918035 23833 raft_consensus.cc:697] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:09:57.921900 22602 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:09:57.918831 23833 consensus_queue.cc:237] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:57.938271 22355 catalog_manager.cc:5697] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 2 to 3, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 3 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:58.002189 23906 raft_consensus.cc:993] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881: : Instructing follower 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:09:58.002941 23906 raft_consensus.cc:1081] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Signalling peer 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:09:58.004534 22602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "263d51d0b43744d899e37466045af890"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:45576
I20260709 12:09:58.005072 22602 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:58.005443 22602 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:58.013119 22602 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:58.015000 22602 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:58.017136 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:09:58.017716 22529 raft_consensus.cc:3055] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:58.017979 22529 raft_consensus.cc:740] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:58.018262 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:58.018821 22450 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:58.018641 22529 consensus_queue.cc:260] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:58.021118 22529 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:58.027704 22529 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:09:58.028807 22450 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:09:58.030143 22569 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:09:58.030886 23617 raft_consensus.cc:2804] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:58.031350 23617 raft_consensus.cc:697] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:09:58.032073 23617 consensus_queue.cc:237] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:58.041574 22355 catalog_manager.cc:5697] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 2 to 3, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 3 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:58.073885 23833 raft_consensus.cc:1064] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
I20260709 12:09:58.076066 23833 consensus_queue.cc:237] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:58.085899 23119 raft_consensus.cc:1275] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:58.087726 22602 raft_consensus.cc:1275] T aeff0fdef6b04a46975756455aba1a98 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:58.088647 22529 raft_consensus.cc:1275] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:58.090705 23721 consensus_queue.cc:1048] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:58.096354 23875 consensus_queue.cc:1048] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:58.110034 23875 consensus_queue.cc:1048] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:58.112977 23721 raft_consensus.cc:1064] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
I20260709 12:09:58.115160 23721 consensus_queue.cc:237] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:58.141310 22605 raft_consensus.cc:1275] T 19a99176cd014d618ba1793fbb19aeab P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:58.142936 23721 consensus_queue.cc:1048] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:58.146656 22529 raft_consensus.cc:1275] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:58.148952 23833 raft_consensus.cc:2955] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:58.153311 22602 raft_consensus.cc:2955] T aeff0fdef6b04a46975756455aba1a98 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:58.172912 23721 consensus_queue.cc:1048] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:58.170421 22355 catalog_manager.cc:5697] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:58.178349 23823 raft_consensus.cc:1064] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
I20260709 12:09:58.179247 23119 raft_consensus.cc:2955] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:58.180956 23823 consensus_queue.cc:237] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:58.177313 22525 raft_consensus.cc:2955] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:58.189919 23123 raft_consensus.cc:1275] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:58.200667 23917 consensus_queue.cc:1048] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:58.261921 23721 raft_consensus.cc:993] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f: : Instructing follower 1676e7af5e4a47cb86ee7db83e3d4881 to start an election
I20260709 12:09:58.262405 23721 raft_consensus.cc:1081] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Signalling peer 1676e7af5e4a47cb86ee7db83e3d4881 to start an election
I20260709 12:09:58.273998 22525 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:56940
I20260709 12:09:58.330327 23119 raft_consensus.cc:1275] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 2 LEARNER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:58.327818 22450 consensus_queue.cc:237] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:09:58.333207 23921 log.cc:927] Time spent T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:09:58.333719 23923 log.cc:927] Time spent T 19a99176cd014d618ba1793fbb19aeab P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:09:58.347477 23617 consensus_queue.cc:1048] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:58.330775 22525 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:58.349079 22525 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:58.385483 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 78865.6us
W20260709 12:09:58.387590 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 52236.3us
I20260709 12:09:58.421294 22525 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:58.433655 22450 raft_consensus.cc:1275] T ea8ebc1d824844e688d0bd61c3fd2258 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:58.432778 23941 raft_consensus.cc:2955] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:58.435858 23926 consensus_queue.cc:1048] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:58.440264 22525 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:09:58.446156 23119 raft_consensus.cc:1275] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:58.447528 23120 raft_consensus.cc:2955] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:58.458545 23808 raft_consensus.cc:1064] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
I20260709 12:09:58.461532 23808 consensus_queue.cc:237] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:58.465590 22601 raft_consensus.cc:1275] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:09:58.466665 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:09:58.467331 23119 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.475432 22529 raft_consensus.cc:1275] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:58.477397 23917 consensus_queue.cc:1048] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:09:58.480841 22602 raft_consensus.cc:2955] T 19a99176cd014d618ba1793fbb19aeab P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:58.481689 23917 consensus_queue.cc:1048] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:58.486846 23119 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:09:58.490494 23833 raft_consensus.cc:2955] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
W20260709 12:09:58.478232 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 146353us
I20260709 12:09:58.502187 22496 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:09:58.503376 23907 raft_consensus.cc:2804] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:58.503839 23907 raft_consensus.cc:697] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:58.504679 23907 consensus_queue.cc:237] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:58.506275 22451 raft_consensus.cc:1275] T 8c3000c4a87f46b69b5da41dc1115486 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:58.508190 23617 consensus_queue.cc:1048] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:58.517516 23875 raft_consensus.cc:993] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f: : Instructing follower 1676e7af5e4a47cb86ee7db83e3d4881 to start an election
I20260709 12:09:58.518043 23875 raft_consensus.cc:1081] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Signalling peer 1676e7af5e4a47cb86ee7db83e3d4881 to start an election
I20260709 12:09:58.529954 22355 catalog_manager.cc:5697] T 19a99176cd014d618ba1793fbb19aeab P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:58.547643 23120 raft_consensus.cc:2955] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:58.551914 22525 raft_consensus.cc:1275] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:58.554013 23122 raft_consensus.cc:1275] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:09:58.556097 23952 consensus_queue.cc:1048] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:09:58.564039 22525 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:56940
I20260709 12:09:58.564558 22525 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:58.564891 22525 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.532867 23875 consensus_queue.cc:1048] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:09:58.567154 22339 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet aeff0fdef6b04a46975756455aba1a98 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:58.577154 23617 consensus_queue.cc:1048] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:58.582953 23122 raft_consensus.cc:1275] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:09:58.572911 23946 log.cc:927] Time spent T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
W20260709 12:09:58.628327 23919 log.cc:927] Time spent T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:09:58.640789 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 131171us
I20260709 12:09:58.646505 22525 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:58.653692 22525 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:58.687356 22525 raft_consensus.cc:1275] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:09:58.698170 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 120790us
I20260709 12:09:58.698478 22525 raft_consensus.cc:1240] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:58.711247 22529 raft_consensus.cc:1275] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:58.714709 22527 raft_consensus.cc:2955] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:58.706270 23823 consensus_queue.cc:1048] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
W20260709 12:09:58.721339 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 374763us
I20260709 12:09:58.722651 22453 raft_consensus.cc:1275] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:09:58.734082 23955 log.cc:927] Time spent T 8c3000c4a87f46b69b5da41dc1115486 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 12:09:58.868407 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 162706us
I20260709 12:09:58.895641 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:58.932935 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:09:58.933568 22605 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.945705 22353 catalog_manager.cc:5697] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 1 to 2, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 2 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:58.952382 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 82022.7us
I20260709 12:09:58.952569 22605 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:09:58.955246 23617 consensus_queue.cc:1048] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:58.957980 22354 catalog_manager.cc:5697] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 reported cstate change: config changed from index 3 to 4, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:58.958441 23934 raft_consensus.cc:2955] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
W20260709 12:09:59.041548 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 58944us
I20260709 12:09:59.042258 22497 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:09:59.058315 23125 raft_consensus.cc:2955] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:59.052258 23823 consensus_queue.cc:1048] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:09:59.065827 23960 raft_consensus.cc:2804] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:59.066463 23960 raft_consensus.cc:697] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:09:59.074242 23833 consensus_queue.cc:1059] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:59.098338 23120 raft_consensus.cc:1240] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:59.080818 23833 consensus_queue.cc:1243] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer 1676e7af5e4a47cb86ee7db83e3d4881 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:09:59.137161 23962 consensus_queue.cc:1059] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:59.096558 23960 consensus_queue.cc:237] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:59.167917 22529 raft_consensus.cc:2955] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:59.205919 23961 consensus_queue.cc:1048] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:09:59.235477 23123 raft_consensus.cc:1240] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:59.239732 23721 consensus_queue.cc:1059] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:59.257931 23953 raft_consensus.cc:2955] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:59.275154 23952 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:09:59.275669 23952 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:59.270223 22450 raft_consensus.cc:2955] T ea8ebc1d824844e688d0bd61c3fd2258 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:59.311122 22525 raft_consensus.cc:1240] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:59.268116 23123 raft_consensus.cc:2955] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:59.335928 23958 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:09:59.342207 23119 raft_consensus.cc:1275] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:09:59.335639 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 149154us
I20260709 12:09:59.336553 23958 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:59.327600 22453 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:44568
I20260709 12:09:59.387758 23952 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:59.388268 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:59.381857 22532 raft_consensus.cc:2955] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:59.395310 22456 raft_consensus.cc:2955] T 8c3000c4a87f46b69b5da41dc1115486 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:59.398319 22603 raft_consensus.cc:1240] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:59.398365 23959 raft_consensus.cc:3055] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:59.416585 23962 consensus_queue.cc:1059] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:59.417671 23962 raft_consensus.cc:3055] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:59.418020 23962 raft_consensus.cc:740] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:09:59.406265 22453 raft_consensus.cc:606] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:09:59.405859 23959 raft_consensus.cc:740] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:09:59.425580 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:59.424090 23959 consensus_queue.cc:260] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:59.429143 23958 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:59.430375 23947 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:09:59.430899 23947 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:59.441526 23947 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:59.474161 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:59.475795 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:59.477404 23938 consensus_queue.cc:1048] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:59.481290 23961 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:09:59.481745 22524 raft_consensus.cc:1240] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:59.465441 23959 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.421737 23962 consensus_queue.cc:260] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:59.485852 23958 consensus_queue.cc:1059] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:59.486545 23958 consensus_queue.cc:1243] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Peer 1676e7af5e4a47cb86ee7db83e3d4881 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:09:59.481844 23961 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:59.494442 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:59.495558 23972 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:09:59.498091 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:59.500727 23961 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:09:59.496155 23972 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:59.501219 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:59.508042 22602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:09:59.508574 22602 raft_consensus.cc:606] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Received request to transfer leadership to TS 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:09:59.512653 22422 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:09:59.507246 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:59.519802 23950 raft_consensus.cc:2749] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.523763 22421 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:09:59.507498 23962 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.529578 22422 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:09:59.547801 23721 raft_consensus.cc:2749] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:09:59.527801 23950 raft_consensus.cc:2749] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:59.556545 22451 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b955a164159b49b9bf083e35e340e323"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
mode: GRACEFUL
new_leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:44568
I20260709 12:09:59.557166 22451 raft_consensus.cc:606] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Received request to transfer leadership to TS 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:09:59.558523 23951 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:09:59.567147 22451 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
mode: GRACEFUL
new_leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:44568
I20260709 12:09:59.567819 22451 raft_consensus.cc:606] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Received request to transfer leadership to TS 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:09:59.559091 23951 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:59.578747 23918 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:09:59.579555 23918 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:09:59.590458 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:59.612607 22601 raft_consensus.cc:1275] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:09:59.612666 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 266876us
I20260709 12:09:59.634825 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:59.640339 23947 raft_consensus.cc:993] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f: : Instructing follower 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:09:59.640868 23941 raft_consensus.cc:1081] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Signalling peer 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:09:59.645471 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:09:59.645726 22601 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:45562
I20260709 12:09:59.646533 22601 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:59.647063 22601 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.647243 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:59.627332 23918 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:59.667232 23951 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:59.668478 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:09:59.668776 22601 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:59.671983 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:59.643435 23936 consensus_queue.cc:1048] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:09:59.683655 22601 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:09:59.663275 23967 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:09:59.705884 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:09:59.706409 23123 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.677992 23972 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:09:59.710825 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:09:59.711407 22454 raft_consensus.cc:3055] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:59.711700 22454 raft_consensus.cc:740] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:09:59.715565 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:09:59.711546 22569 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:09:59.722656 23123 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:09:59.724956 22454 consensus_queue.cc:260] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:59.728762 22570 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:09:59.718129 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:59.728860 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:59.738567 22530 raft_consensus.cc:2955] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:09:59.741701 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:09:59.743781 22421 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:09:59.744380 23935 raft_consensus.cc:2804] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:59.751112 22421 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:09:59.755000 22421 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:09:59.728593 23933 raft_consensus.cc:2749] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:59.765730 23721 raft_consensus.cc:2749] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:59.704710 23967 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:09:59.754500 23947 raft_consensus.cc:2749] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.767889 23952 raft_consensus.cc:2749] T 19773e9e6aec446eb719d3d53d49812b P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.767721 23935 raft_consensus.cc:697] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
W20260709 12:09:59.809612 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 341207us
I20260709 12:09:59.956357 22456 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
W20260709 12:09:59.876904 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 129629us
I20260709 12:09:59.971061 23935 consensus_queue.cc:237] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:09:59.987576 23978 log.cc:927] Time spent T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.161s	user 0.002s	sys 0.007s
I20260709 12:10:00.008559 22453 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:10:00.090185 23967 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:00.100164 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:00.090541 23934 raft_consensus.cc:993] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc: : Instructing follower 1676e7af5e4a47cb86ee7db83e3d4881 to start an election
I20260709 12:10:00.105213 23934 raft_consensus.cc:1081] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Signalling peer 1676e7af5e4a47cb86ee7db83e3d4881 to start an election
W20260709 12:10:00.154940 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 368499us
I20260709 12:10:00.178819 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:00.189074 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.206157 22455 raft_consensus.cc:1275] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:00.208081 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:00.208703 22523 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:56942
I20260709 12:10:00.209342 22523 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:00.209772 22523 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.207319 22454 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.226213 22569 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:00.227285 23935 raft_consensus.cc:2749] T aeff0fdef6b04a46975756455aba1a98 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.232573 23987 consensus_queue.cc:1048] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:00.236730 22449 raft_consensus.cc:1275] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:00.240444 22523 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:00.016724 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:00.250494 22354 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48412 (request call id 184) took 1300 ms. Trace:
I20260709 12:10:00.257786 23958 raft_consensus.cc:993] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f: : Instructing follower 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:10:00.260465 23958 raft_consensus.cc:1081] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Signalling peer 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:10:00.261729 22353 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55978 (request call id 281) took 1460 ms. Trace:
I20260709 12:10:00.264853 23972 raft_consensus.cc:993] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f: : Instructing follower 8701cd5186a949538d8efafb5f987270 to start an election
I20260709 12:10:00.262089 22353 rpcz_store.cc:276] 0709 12:09:58.801180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:58.801351 (+   171us) service_pool.cc:224] Handling call
0709 12:10:00.261677 (+1460326us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:09:58.949889 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:09:58.950605 (+   716us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:09:58.950650 (+    45us) write_op.cc:435] Acquired schema lock
0709 12:09:58.950675 (+    25us) tablet.cc:662] Decoding operations
0709 12:09:58.951128 (+   453us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:09:58.951196 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 12:09:58.951237 (+    41us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:09:58.951474 (+   237us) tablet.cc:701] Row locks acquired
0709 12:09:58.951500 (+    26us) write_op.cc:260] PREPARE: finished
0709 12:09:59.114756 (+163256us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b2c000302d8. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc9227a11 00007f9cc9236a0a 00007f9cc9236693 00007f9cc9236631 00007f9cca969902 00007f9cca9696dd 00007f9cce364243 00007f9cce363d58 00007f9cce3689f1 00007f9cce3689a9 00007f9cce368939
0709 12:09:59.114829 (+    73us) write_op.cc:270] Start()
0709 12:09:59.115107 (+   278us) write_op.cc:276] Timestamp: P: 1783598998964319 usec, L: 0
0709 12:09:59.115133 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:09:59.115697 (+   564us) log.cc:844] Serialized 539 byte log entry
0709 12:09:59.602328 (+486631us) op_driver.cc:464] REPLICATION: finished
0709 12:09:59.801903 (+199575us) write_op.cc:301] APPLY: starting
0709 12:09:59.803723 (+  1820us) tablet.cc:1367] starting BulkCheckPresence
0709 12:09:59.836542 (+ 32819us) tablet.cc:1370] finished BulkCheckPresence
0709 12:09:59.841389 (+  4847us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:00.024084 (+182695us) spinlock_profiling.cc:243] Waited 8.98 ms on lock 0x7b5c0028fd0c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0b20331 00007f9cd0b20221 00007f9cd0b1af6c 00007f9cce27b30b 00007f9cce27afd3 00007f9cce379e34 00007f9cce36597c 00007f9cce369d61 00007f9cce369d19 00007f9cce369ca9 00007f9cce369c71
0709 12:10:00.084183 (+ 60099us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:00.084401 (+   218us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:10:00.084475 (+    74us) write_op.cc:312] APPLY: finished
0709 12:10:00.084747 (+   272us) log.cc:844] Serialized 23 byte log entry
0709 12:10:00.084989 (+   242us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:00.085104 (+   115us) write_op.cc:454] Released schema lock
0709 12:10:00.085158 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:00.085512 (+   354us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:00.085537 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":289069,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":172523,"apply.run_cpu_time_us":11841,"apply.run_wall_time_us":286165,"num_ops":1,"prepare.queue_time_us":122,"prepare.run_cpu_time_us":5596,"prepare.run_wall_time_us":181702,"replication_time_us":486852,"spinlock_wait_cycles":49857024,"thread_start_us":114309,"threads_started":1}]]}
I20260709 12:10:00.266449 22523 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:00.267131 23962 raft_consensus.cc:1081] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Signalling peer 8701cd5186a949538d8efafb5f987270 to start an election
I20260709 12:10:00.267894 22355 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55980 (request call id 316) took 1297 ms. Trace:
I20260709 12:10:00.268234 22355 rpcz_store.cc:276] 0709 12:09:58.970899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:58.971292 (+   393us) service_pool.cc:224] Handling call
0709 12:10:00.267835 (+1296543us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6009,"reported_tablets":1}
I20260709 12:10:00.274168 22594 tablet_service.cc:1558] Processing DeleteTablet for tablet aeff0fdef6b04a46975756455aba1a98 with delete_type TABLET_DATA_TOMBSTONED (TS 6c6fa11e8ee34711b3551f0c670442bc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45546
I20260709 12:10:00.276437 22354 rpcz_store.cc:276] 0709 12:09:58.949880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:58.950013 (+   133us) service_pool.cc:224] Handling call
0709 12:10:00.250401 (+1300388us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:09:59.178176 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:09:59.178898 (+   722us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:09:59.178945 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:09:59.178962 (+    17us) tablet.cc:662] Decoding operations
0709 12:09:59.179415 (+   453us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:09:59.179489 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 12:09:59.179528 (+    39us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:09:59.179745 (+   217us) tablet.cc:701] Row locks acquired
0709 12:09:59.179770 (+    25us) write_op.cc:260] PREPARE: finished
0709 12:09:59.179939 (+   169us) write_op.cc:270] Start()
0709 12:09:59.180065 (+   126us) write_op.cc:276] Timestamp: P: 1783598999179883 usec, L: 0
0709 12:09:59.180091 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:09:59.181401 (+  1310us) log.cc:844] Serialized 539 byte log entry
0709 12:09:59.776300 (+594899us) op_driver.cc:464] REPLICATION: finished
0709 12:09:59.983992 (+207692us) write_op.cc:301] APPLY: starting
0709 12:09:59.988344 (+  4352us) tablet.cc:1367] starting BulkCheckPresence
0709 12:09:59.988512 (+   168us) tablet.cc:1370] finished BulkCheckPresence
0709 12:09:59.988696 (+   184us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:09:59.989010 (+   314us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:09:59.989237 (+   227us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:09:59.989310 (+    73us) write_op.cc:312] APPLY: finished
0709 12:09:59.989573 (+   263us) log.cc:844] Serialized 23 byte log entry
0709 12:09:59.989789 (+   216us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:59.989870 (+    81us) write_op.cc:454] Released schema lock
0709 12:09:59.989907 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 12:09:59.990281 (+   374us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:59.990308 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":191278,"apply.run_cpu_time_us":2174,"apply.run_wall_time_us":11736,"num_ops":1,"prepare.queue_time_us":206152,"prepare.run_cpu_time_us":3555,"prepare.run_wall_time_us":4521,"replication_time_us":574635,"thread_start_us":71584,"threads_started":1}]]}
I20260709 12:10:00.285629 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:00.305992 23125 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.291601 23937 consensus_queue.cc:1048] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:00.292330 23121 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39"
dest_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:57318
I20260709 12:10:00.308555 23121 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:00.308945 23121 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.291828 22355 catalog_manager.cc:5697] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 reported cstate change: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:00.293123 22605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b955a164159b49b9bf083e35e340e323"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:45562
I20260709 12:10:00.259318 22454 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:10:00.303498 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:00.317233 22605 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:00.317555 22603 raft_consensus.cc:3055] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:00.317667 22605 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:00.317921 22603 raft_consensus.cc:740] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:00.318753 22603 consensus_queue.cc:260] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:00.320315 22603 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.324297 23121 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:00.343246 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:00.344058 22448 raft_consensus.cc:3055] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:00.344528 22448 raft_consensus.cc:740] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:00.344898 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:00.345623 22523 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.345520 22448 consensus_queue.cc:260] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:00.346769 22448 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.347682 22355 catalog_manager.cc:5697] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 reported cstate change: config changed from index 3 to 4, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:00.354538 22523 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 2.
I20260709 12:10:00.356029 23088 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:00.357209 23980 raft_consensus.cc:2804] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:00.357713 23980 raft_consensus.cc:697] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 2 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:00.358639 23980 consensus_queue.cc:237] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:00.289676 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:00.363924 22456 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.368039 22605 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:00.370577 22603 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:10:00.342635 23121 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:00.370898 23125 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:10:00.377556 22456 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:10:00.378852 22351 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55962 (request call id 294) took 1332 ms. Trace:
I20260709 12:10:00.376724 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:00.380141 22451 raft_consensus.cc:3055] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:00.379245 22351 rpcz_store.cc:276] 0709 12:09:59.045986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:59.046096 (+   110us) service_pool.cc:224] Handling call
0709 12:09:59.074133 (+ 28037us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b54002eff90. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc780a0b2 00007f9cd0783759 00007f9cd071ba76 00007f9cd06ecd58 00007f9cd07eb04e 00007f9ccecac2a4 00007f9ccecac232 00007f9ccecac161 00007f9ccecac0dc
0709 12:09:59.108863 (+ 34730us) spinlock_profiling.cc:243] Waited 4.97 ms on lock 0x7b54002eff90. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809e9c 00007f9cc780a0f6 00007f9cd0783759 00007f9cd071ba76 00007f9cd06ecd58 00007f9cd07eb04e 00007f9ccecac2a4 00007f9ccecac232 00007f9ccecac161 00007f9ccecac0dc
0709 12:10:00.378789 (+1269926us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22176,"reported_tablets":2,"spinlock_wait_cycles":14589056}
I20260709 12:10:00.380422 22451 raft_consensus.cc:740] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:00.381537 22605 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:00.382689 22454 consensus_queue.cc:237] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:00.385994 22495 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:00.391700 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:00.392531 22523 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:00.387488 22451 consensus_queue.cc:260] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:00.396243 22451 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:00.399991 23937 raft_consensus.cc:2804] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:00.400616 23937 raft_consensus.cc:697] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:00.401485 23937 consensus_queue.cc:237] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:00.436896 23125 raft_consensus.cc:1275] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:10:00.438223 22448 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 2.
I20260709 12:10:00.438601 22526 raft_consensus.cc:1275] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:10:00.439478 22354 catalog_manager.cc:5697] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 1 to 2, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 2 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:10:00.442094 22354 catalog_manager.cc:5697] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 1 to 2, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 2 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:00.443804 24009 tablet_replica.cc:333] T aeff0fdef6b04a46975756455aba1a98 P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:10:00.444926 24009 raft_consensus.cc:2243] T aeff0fdef6b04a46975756455aba1a98 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:00.445669 24009 raft_consensus.cc:2272] T aeff0fdef6b04a46975756455aba1a98 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:00.446928 23972 consensus_queue.cc:1048] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:00.454309 22355 catalog_manager.cc:5697] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 1 to 2, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 2 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:00.448864 23972 consensus_queue.cc:1048] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 12:10:00.466027 24009 ts_tablet_manager.cc:1916] T aeff0fdef6b04a46975756455aba1a98 P 6c6fa11e8ee34711b3551f0c670442bc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:00.472846 22523 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
I20260709 12:10:00.474464 22570 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:00.475286 23991 raft_consensus.cc:2804] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:00.475833 23991 raft_consensus.cc:697] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:00.479873 22451 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
I20260709 12:10:00.476675 23991 consensus_queue.cc:237] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:00.509929 23721 raft_consensus.cc:2955] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:00.534992 23122 raft_consensus.cc:1275] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:00.538954 23823 consensus_queue.cc:1048] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:00.540357 22605 consensus_queue.cc:237] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:00.567968 22341 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8c3000c4a87f46b69b5da41dc1115486 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 6c6fa11e8ee34711b3551f0c670442bc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:00.562260 22351 catalog_manager.cc:5697] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 1 to 2, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 2 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:00.833381 24009 ts_tablet_manager.cc:1929] T aeff0fdef6b04a46975756455aba1a98 P 6c6fa11e8ee34711b3551f0c670442bc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:10:00.833894 24009 log.cc:1199] T aeff0fdef6b04a46975756455aba1a98 P 6c6fa11e8ee34711b3551f0c670442bc: Deleting WAL directory at /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-2-root/wals/aeff0fdef6b04a46975756455aba1a98
I20260709 12:10:00.844424 22339 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 19a99176cd014d618ba1793fbb19aeab with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:00.851189 22448 raft_consensus.cc:1275] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:00.865602 23963 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:00.867185 23960 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:00.867110 23963 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:00.867735 23960 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:00.869465 23963 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:00.872232 22523 raft_consensus.cc:1275] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:00.869671 23960 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:00.878563 23125 raft_consensus.cc:2955] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:00.896255 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:00.896582 22602 raft_consensus.cc:1275] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:10:00.901701 22354 catalog_manager.cc:5697] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: config changed from index 3 to 4, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:00.905390 22353 catalog_manager.cc:5697] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 3 to 4, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 4 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:00.910406 22523 raft_consensus.cc:2955] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:00.917102 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:00.920993 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:00.930835 23963 consensus_queue.cc:1048] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:00.932956 23122 raft_consensus.cc:1275] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:00.938381 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:00.947016 22341 catalog_manager.cc:5028] TS 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): tablet aeff0fdef6b04a46975756455aba1a98 (table test-workload [id=1e73b97ba677488c8829a696096f4885]) successfully deleted
I20260709 12:10:00.953305 22526 raft_consensus.cc:1275] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:00.955653 22497 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:00.956888 23963 raft_consensus.cc:2749] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.962425 23929 consensus_queue.cc:1048] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:00.963258 22594 tablet_service.cc:1558] Processing DeleteTablet for tablet 19a99176cd014d618ba1793fbb19aeab with delete_type TABLET_DATA_TOMBSTONED (TS 6c6fa11e8ee34711b3551f0c670442bc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45546
I20260709 12:10:00.964313 24009 tablet_replica.cc:333] T 19a99176cd014d618ba1793fbb19aeab P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:10:00.965489 24009 raft_consensus.cc:2243] T 19a99176cd014d618ba1793fbb19aeab P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:00.970288 24021 consensus_queue.cc:1048] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:00.975801 22495 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:00.976670 24004 raft_consensus.cc:2749] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.982205 24009 raft_consensus.cc:2272] T 19a99176cd014d618ba1793fbb19aeab P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:00.985435 24009 ts_tablet_manager.cc:1916] T 19a99176cd014d618ba1793fbb19aeab P 6c6fa11e8ee34711b3551f0c670442bc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:00.985996 22453 raft_consensus.cc:1275] T 8c3000c4a87f46b69b5da41dc1115486 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:10:00.987273 24020 consensus_queue.cc:1048] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:00.992934 24004 consensus_queue.cc:1048] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:00.996353 22453 raft_consensus.cc:1275] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:01.006505 23929 consensus_queue.cc:1048] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:01.012434 23125 raft_consensus.cc:1275] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:10:01.014483 24004 consensus_queue.cc:1048] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:01.017091 22526 raft_consensus.cc:1275] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:01.030639 24021 consensus_queue.cc:1048] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:01.050380 24021 consensus_queue.cc:1048] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:01.066792 24021 raft_consensus.cc:2955] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:01.109995 22524 consensus_queue.cc:237] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 3, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:01.117846 22605 raft_consensus.cc:1275] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:01.119884 24004 consensus_queue.cc:1048] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:01.122468 23122 raft_consensus.cc:2955] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:01.126820 22448 raft_consensus.cc:1275] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:01.129621 23125 raft_consensus.cc:1275] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:01.131749 22532 raft_consensus.cc:2955] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:01.140944 24024 consensus_queue.cc:1048] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:01.141647 24025 consensus_queue.cc:1048] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:01.149582 23963 raft_consensus.cc:2955] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 3 to 5, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:01.158579 22341 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ea8ebc1d824844e688d0bd61c3fd2258 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:01.159150 22605 raft_consensus.cc:2955] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 3 to 5, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:01.160420 23122 raft_consensus.cc:2955] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 3 to 5, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:01.162230 24009 ts_tablet_manager.cc:1929] T 19a99176cd014d618ba1793fbb19aeab P 6c6fa11e8ee34711b3551f0c670442bc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:10:01.162662 24009 log.cc:1199] T 19a99176cd014d618ba1793fbb19aeab P 6c6fa11e8ee34711b3551f0c670442bc: Deleting WAL directory at /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-2-root/wals/19a99176cd014d618ba1793fbb19aeab
I20260709 12:10:01.164152 22341 catalog_manager.cc:5028] TS 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): tablet 19a99176cd014d618ba1793fbb19aeab (table test-workload [id=1e73b97ba677488c8829a696096f4885]) successfully deleted
I20260709 12:10:01.170709 22353 catalog_manager.cc:5697] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 reported cstate change: config changed from index 4 to 5, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New cstate: current_term: 2 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:01.188120 22442 tablet_service.cc:1558] Processing DeleteTablet for tablet ea8ebc1d824844e688d0bd61c3fd2258 with delete_type TABLET_DATA_TOMBSTONED (TS c863116d91c14d1ca50d6e8a46a37a8f not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:51832
I20260709 12:10:01.194566 22340 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8c3000c4a87f46b69b5da41dc1115486 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 4)
I20260709 12:10:01.209614 22353 catalog_manager.cc:5697] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: config changed from index 3 to 5, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New cstate: current_term: 2 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:01.238433 23875 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:01.238996 23875 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:01.242609 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:01.245239 23875 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:01.248476 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:01.249738 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:01.250754 22446 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c3000c4a87f46b69b5da41dc1115486 with delete_type TABLET_DATA_TOMBSTONED (TS c863116d91c14d1ca50d6e8a46a37a8f not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:51832
I20260709 12:10:01.255577 22421 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:01.257575 23875 raft_consensus.cc:2749] T ea8ebc1d824844e688d0bd61c3fd2258 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:01.263945 24042 tablet_replica.cc:333] T ea8ebc1d824844e688d0bd61c3fd2258 P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:10:01.264951 24042 raft_consensus.cc:2243] T ea8ebc1d824844e688d0bd61c3fd2258 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:01.265808 24042 raft_consensus.cc:2272] T ea8ebc1d824844e688d0bd61c3fd2258 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:01.268693 24042 ts_tablet_manager.cc:1916] T ea8ebc1d824844e688d0bd61c3fd2258 P c863116d91c14d1ca50d6e8a46a37a8f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:01.287248 24042 ts_tablet_manager.cc:1929] T ea8ebc1d824844e688d0bd61c3fd2258 P c863116d91c14d1ca50d6e8a46a37a8f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:10:01.287660 24042 log.cc:1199] T ea8ebc1d824844e688d0bd61c3fd2258 P c863116d91c14d1ca50d6e8a46a37a8f: Deleting WAL directory at /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-0-root/wals/ea8ebc1d824844e688d0bd61c3fd2258
I20260709 12:10:01.289393 22339 catalog_manager.cc:5028] TS c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): tablet ea8ebc1d824844e688d0bd61c3fd2258 (table test-workload [id=1e73b97ba677488c8829a696096f4885]) successfully deleted
I20260709 12:10:01.289496 24042 tablet_replica.cc:333] T 8c3000c4a87f46b69b5da41dc1115486 P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:10:01.290669 24042 raft_consensus.cc:2243] T 8c3000c4a87f46b69b5da41dc1115486 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:01.291500 24042 raft_consensus.cc:2272] T 8c3000c4a87f46b69b5da41dc1115486 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:01.295022 24042 ts_tablet_manager.cc:1916] T 8c3000c4a87f46b69b5da41dc1115486 P c863116d91c14d1ca50d6e8a46a37a8f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:01.312433 24042 ts_tablet_manager.cc:1929] T 8c3000c4a87f46b69b5da41dc1115486 P c863116d91c14d1ca50d6e8a46a37a8f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:10:01.312849 24042 log.cc:1199] T 8c3000c4a87f46b69b5da41dc1115486 P c863116d91c14d1ca50d6e8a46a37a8f: Deleting WAL directory at /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-0-root/wals/8c3000c4a87f46b69b5da41dc1115486
I20260709 12:10:01.314554 22339 catalog_manager.cc:5028] TS c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): tablet 8c3000c4a87f46b69b5da41dc1115486 (table test-workload [id=1e73b97ba677488c8829a696096f4885]) successfully deleted
I20260709 12:10:01.568902 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:01.607431 22532 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
 from {username='slave'} at 127.0.0.1:39980
I20260709 12:10:01.607973 22532 raft_consensus.cc:606] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 LEADER]: Received request to transfer leadership to TS c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:01.610582 22523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
 from {username='slave'} at 127.0.0.1:39980
I20260709 12:10:01.611207 22523 raft_consensus.cc:606] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Received request to transfer leadership to TS c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:01.613806 22605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:10:01.614290 22605 raft_consensus.cc:606] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Received request to transfer leadership to TS c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:01.617252 22523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:39980
I20260709 12:10:01.617834 22523 raft_consensus.cc:606] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:10:01.621224 22605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b955a164159b49b9bf083e35e340e323"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:10:01.621765 22605 raft_consensus.cc:606] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Received request to transfer leadership to TS 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:01.623152 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:01.624459 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:01.625106 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:01.773502 24021 raft_consensus.cc:993] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc: : Instructing follower 1676e7af5e4a47cb86ee7db83e3d4881 to start an election
I20260709 12:10:01.774057 24024 raft_consensus.cc:1081] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Signalling peer 1676e7af5e4a47cb86ee7db83e3d4881 to start an election
I20260709 12:10:01.775520 22523 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b955a164159b49b9bf083e35e340e323"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:56942
I20260709 12:10:01.776055 22523 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:01.776439 22523 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:01.782123 22523 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:01.784602 22523 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:01.786043 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:01.786711 22453 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:01.786616 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:01.787297 22605 raft_consensus.cc:3055] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:01.787667 22605 raft_consensus.cc:740] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:01.788623 22605 consensus_queue.cc:260] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:01.789814 22605 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:01.793875 22453 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 5.
I20260709 12:10:01.795795 22495 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:01.797605 23963 raft_consensus.cc:2804] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:01.798158 23963 raft_consensus.cc:697] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:01.799279 23963 consensus_queue.cc:237] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:01.799942 22605 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 5.
I20260709 12:10:01.812156 22351 catalog_manager.cc:5697] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 4 to 5, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 5 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:01.851692 24004 raft_consensus.cc:993] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881: : Instructing follower c863116d91c14d1ca50d6e8a46a37a8f to start an election
I20260709 12:10:01.852310 23963 raft_consensus.cc:1081] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Signalling peer c863116d91c14d1ca50d6e8a46a37a8f to start an election
I20260709 12:10:01.854039 22453 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
 from {username='slave'} at 127.0.0.1:51844
I20260709 12:10:01.854614 22453 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:01.855099 22453 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.861053 22453 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:01.862501 22453 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:01.863547 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:01.863978 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:01.864233 22523 raft_consensus.cc:3055] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:01.864612 22523 raft_consensus.cc:740] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:01.864682 22605 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.865423 22523 consensus_queue.cc:260] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:01.866623 22523 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.873807 22523 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:10:01.875038 22421 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:01.875864 23918 raft_consensus.cc:2804] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:01.876320 23918 raft_consensus.cc:697] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:01.877137 23918 consensus_queue.cc:237] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:01.880663 22605 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:10:01.881075 24021 raft_consensus.cc:993] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc: : Instructing follower c863116d91c14d1ca50d6e8a46a37a8f to start an election
I20260709 12:10:01.881613 24021 raft_consensus.cc:1081] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Signalling peer c863116d91c14d1ca50d6e8a46a37a8f to start an election
I20260709 12:10:01.883740 22448 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
 from {username='slave'} at 127.0.0.1:51836
I20260709 12:10:01.884464 22448 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:01.884913 22448 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.892205 22448 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:01.893728 22448 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 2 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:01.894687 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:01.894696 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:01.895572 22605 raft_consensus.cc:3055] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:01.895678 23122 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.895936 22605 raft_consensus.cc:740] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:01.896821 22605 consensus_queue.cc:260] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:01.898069 22605 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.902101 23122 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 2.
I20260709 12:10:01.903218 22421 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:01.904255 23875 raft_consensus.cc:2804] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:01.904647 23875 raft_consensus.cc:697] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:01.905320 23875 consensus_queue.cc:237] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:01.905828 22605 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 2.
I20260709 12:10:01.906538 22351 catalog_manager.cc:5697] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 2 to 3, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 3 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:01.924751 22351 catalog_manager.cc:5697] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 1 to 2, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 2 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:02.062116 23963 raft_consensus.cc:993] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881: : Instructing follower c863116d91c14d1ca50d6e8a46a37a8f to start an election
I20260709 12:10:02.062706 24004 raft_consensus.cc:1081] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 LEADER]: Signalling peer c863116d91c14d1ca50d6e8a46a37a8f to start an election
I20260709 12:10:02.064883 22448 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
 from {username='slave'} at 127.0.0.1:51844
I20260709 12:10:02.065528 22448 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:02.065902 22448 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:02.071659 22448 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:02.073282 22448 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:02.074318 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:02.074452 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:02.075217 22526 raft_consensus.cc:3055] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:02.075476 22605 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:02.075505 22526 raft_consensus.cc:740] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:02.076579 22526 consensus_queue.cc:260] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:02.077438 22526 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:02.083117 22526 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 4.
I20260709 12:10:02.083109 22605 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 4.
I20260709 12:10:02.084153 22421 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:02.084879 23875 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:02.085402 23875 raft_consensus.cc:697] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 4 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:02.086078 23875 consensus_queue.cc:237] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:02.095316 22351 catalog_manager.cc:5697] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 3 to 4, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 4 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:02.172111 24004 raft_consensus.cc:993] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881: : Instructing follower 8701cd5186a949538d8efafb5f987270 to start an election
I20260709 12:10:02.172623 24049 raft_consensus.cc:1081] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Signalling peer 8701cd5186a949538d8efafb5f987270 to start an election
I20260709 12:10:02.174803 23122 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4"
dest_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:57332
I20260709 12:10:02.175390 23122 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:02.175693 23122 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:02.180368 23122 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:02.181975 23122 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:02.182637 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:02.182834 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:02.183225 22526 raft_consensus.cc:3055] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:02.183557 22526 raft_consensus.cc:740] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:02.183578 22605 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:02.184198 22526 consensus_queue.cc:260] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:02.185107 22526 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:02.189792 22605 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 2.
I20260709 12:10:02.191044 23089 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:02.191893 23956 raft_consensus.cc:2804] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:02.192365 23956 raft_consensus.cc:697] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 2 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:02.193195 23956 consensus_queue.cc:237] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:02.194775 22526 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 2.
I20260709 12:10:02.205303 22351 catalog_manager.cc:5697] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 1 to 2, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 2 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:02.248356 22603 raft_consensus.cc:1275] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:02.249784 24051 consensus_queue.cc:1048] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:02.274001 22453 raft_consensus.cc:1275] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:02.275504 24051 consensus_queue.cc:1048] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:02.296224 22532 raft_consensus.cc:1275] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:02.298659 23875 consensus_queue.cc:1048] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:02.362286 22603 raft_consensus.cc:1275] T 5b50f0bec71f4924aa1781b9818f1d73 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:02.368140 23875 consensus_queue.cc:1048] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:02.422120 22523 consensus_queue.cc:237] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:10:02.430056 22453 raft_consensus.cc:1275] T 19773e9e6aec446eb719d3d53d49812b P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:10:02.430385 22603 raft_consensus.cc:1275] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:10:02.431694 24049 consensus_queue.cc:1048] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:02.432642 24004 consensus_queue.cc:1048] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:10:02.435933 22496 consensus_peers.cc:597] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 19773e9e6aec446eb719d3d53d49812b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:10:02.440891 24049 raft_consensus.cc:2955] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:10:02.442672 22453 raft_consensus.cc:2955] T 19773e9e6aec446eb719d3d53d49812b P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:10:02.445561 22603 raft_consensus.cc:2955] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:10:02.464002 22453 consensus_queue.cc:237] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:10:02.467016 22351 catalog_manager.cc:5697] T 19773e9e6aec446eb719d3d53d49812b P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:10:02.471725 22523 raft_consensus.cc:1275] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:10:02.473798 22603 raft_consensus.cc:1275] T 5b50f0bec71f4924aa1781b9818f1d73 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:10:02.474388 23122 raft_consensus.cc:1275] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:02.475481 24047 consensus_queue.cc:1048] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:02.476330 23918 consensus_queue.cc:1048] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:10:02.481542 22421 consensus_peers.cc:597] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5b50f0bec71f4924aa1781b9818f1d73. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:10:02.483150 23875 consensus_queue.cc:1048] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:02.484140 23918 raft_consensus.cc:2955] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:10:02.485302 22532 raft_consensus.cc:2955] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:10:02.503718 22605 raft_consensus.cc:2955] T 5b50f0bec71f4924aa1781b9818f1d73 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:10:02.512633 22606 raft_consensus.cc:1275] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:02.514663 22453 consensus_queue.cc:237] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:10:02.518277 22351 catalog_manager.cc:5697] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: config changed from index -1 to 4, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New cstate: current_term: 3 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:02.520833 24065 consensus_queue.cc:1048] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:02.534286 22604 raft_consensus.cc:1275] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:02.539171 23875 consensus_queue.cc:1048] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:10:02.598351 22532 raft_consensus.cc:1275] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:02.600436 24047 consensus_queue.cc:1048] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:02.606189 22602 raft_consensus.cc:1275] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:10:02.607334 22523 raft_consensus.cc:1275] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:10:02.607707 24065 consensus_queue.cc:1048] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:02.610133 24065 consensus_queue.cc:1048] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:10:02.612718 22421 consensus_peers.cc:597] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b41723f4983d46d0bf385fae671d9a04. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:10:02.629256 24063 raft_consensus.cc:2955] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:10:02.631664 22602 raft_consensus.cc:2955] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:10:02.641184 22532 raft_consensus.cc:2955] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:10:02.653398 22353 catalog_manager.cc:5697] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New cstate: current_term: 1 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:10:02.655472 22602 consensus_queue.cc:237] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:10:02.666714 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:02.671366 22532 raft_consensus.cc:1275] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:10:02.672688 24021 consensus_queue.cc:1048] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:02.673497 22453 raft_consensus.cc:1275] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 12:10:02.674365 22570 consensus_peers.cc:597] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4c23033521664ca6a0c00a6f0f552308. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:10:02.676295 24020 consensus_queue.cc:1048] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:02.698730 24020 raft_consensus.cc:2955] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:10:02.700496 22448 raft_consensus.cc:2955] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:10:02.704577 22602 raft_consensus.cc:1275] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:02.706107 23956 consensus_queue.cc:1048] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:02.721498 22532 raft_consensus.cc:2955] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:10:02.721379 22351 catalog_manager.cc:5697] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: config changed from index -1 to 4, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New cstate: current_term: 3 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:02.745064 22523 raft_consensus.cc:1275] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:02.747192 23956 consensus_queue.cc:1048] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:02.766615 22526 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:39980
I20260709 12:10:02.767180 22526 raft_consensus.cc:606] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Received request to transfer leadership to TS 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:02.772151 22451 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
mode: GRACEFUL
new_leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:44568
I20260709 12:10:02.772701 22451 raft_consensus.cc:606] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Received request to transfer leadership to TS 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:02.776355 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:10:02.783458 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:02.784137 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:02.863193 24080 ts_tablet_manager.cc:933] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:02.866446 24080 tablet_copy_client.cc:323] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270: tablet copy: Beginning tablet copy session from remote peer at address 127.20.196.130:42733
I20260709 12:10:02.868350 22542 tablet_copy_service.cc:140] P 1676e7af5e4a47cb86ee7db83e3d4881: Received BeginTabletCopySession request for tablet 19773e9e6aec446eb719d3d53d49812b from peer 8701cd5186a949538d8efafb5f987270 ({username='slave'} at 127.0.0.1:38310)
I20260709 12:10:02.868788 22542 tablet_copy_service.cc:161] P 1676e7af5e4a47cb86ee7db83e3d4881: Beginning new tablet copy session on tablet 19773e9e6aec446eb719d3d53d49812b from peer 8701cd5186a949538d8efafb5f987270 at {username='slave'} at 127.0.0.1:38310: session id = 8701cd5186a949538d8efafb5f987270-19773e9e6aec446eb719d3d53d49812b
I20260709 12:10:02.875932 24082 ts_tablet_manager.cc:933] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317)
I20260709 12:10:02.877442 22542 tablet_copy_source_session.cc:215] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:10:02.878000 24082 tablet_copy_client.cc:323] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270: tablet copy: Beginning tablet copy session from remote peer at address 127.20.196.129:42317
I20260709 12:10:02.879756 22467 tablet_copy_service.cc:140] P c863116d91c14d1ca50d6e8a46a37a8f: Received BeginTabletCopySession request for tablet 5b50f0bec71f4924aa1781b9818f1d73 from peer 8701cd5186a949538d8efafb5f987270 ({username='slave'} at 127.0.0.1:34452)
I20260709 12:10:02.880277 22467 tablet_copy_service.cc:161] P c863116d91c14d1ca50d6e8a46a37a8f: Beginning new tablet copy session on tablet 5b50f0bec71f4924aa1781b9818f1d73 from peer 8701cd5186a949538d8efafb5f987270 at {username='slave'} at 127.0.0.1:34452: session id = 8701cd5186a949538d8efafb5f987270-5b50f0bec71f4924aa1781b9818f1d73
I20260709 12:10:02.881142 24080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19773e9e6aec446eb719d3d53d49812b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:10:02.887809 22467 tablet_copy_source_session.cc:215] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:10:02.896260 24082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b50f0bec71f4924aa1781b9818f1d73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:10:02.902244 24080 tablet_copy_client.cc:806] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 0 data blocks...
I20260709 12:10:02.902835 24080 tablet_copy_client.cc:670] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 1 WAL segments...
I20260709 12:10:02.906886 24080 tablet_copy_client.cc:538] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:10:02.913516 24080 tablet_bootstrap.cc:492] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270: Bootstrap starting.
I20260709 12:10:02.915705 24082 tablet_copy_client.cc:806] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 0 data blocks...
I20260709 12:10:02.916276 24082 tablet_copy_client.cc:670] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 1 WAL segments...
I20260709 12:10:02.920814 24082 tablet_copy_client.cc:538] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:10:02.929703 24082 tablet_bootstrap.cc:492] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270: Bootstrap starting.
I20260709 12:10:02.931753 24080 tablet_bootstrap.cc:492] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:10:02.932474 24080 tablet_bootstrap.cc:492] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270: Bootstrap complete.
I20260709 12:10:02.933135 24080 ts_tablet_manager.cc:1403] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.005s
I20260709 12:10:02.935813 24080 raft_consensus.cc:359] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:10:02.936623 24080 raft_consensus.cc:740] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Initialized, Role: LEARNER
I20260709 12:10:02.937307 24080 consensus_queue.cc:260] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:10:02.950750 24080 ts_tablet_manager.cc:1434] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 12:10:02.953514 22542 tablet_copy_service.cc:342] P 1676e7af5e4a47cb86ee7db83e3d4881: Request end of tablet copy session 8701cd5186a949538d8efafb5f987270-19773e9e6aec446eb719d3d53d49812b received from {username='slave'} at 127.0.0.1:38310
I20260709 12:10:02.953960 22542 tablet_copy_service.cc:434] P 1676e7af5e4a47cb86ee7db83e3d4881: ending tablet copy session 8701cd5186a949538d8efafb5f987270-19773e9e6aec446eb719d3d53d49812b on tablet 19773e9e6aec446eb719d3d53d49812b with peer 8701cd5186a949538d8efafb5f987270
I20260709 12:10:02.965667 24082 tablet_bootstrap.cc:492] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:10:02.966639 24082 tablet_bootstrap.cc:492] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270: Bootstrap complete.
I20260709 12:10:02.967339 24082 ts_tablet_manager.cc:1403] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270: Time spent bootstrapping tablet: real 0.038s	user 0.026s	sys 0.008s
I20260709 12:10:02.970103 24082 raft_consensus.cc:359] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:10:02.970904 24082 raft_consensus.cc:740] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Initialized, Role: LEARNER
I20260709 12:10:02.971535 24082 consensus_queue.cc:260] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:10:02.973884 24082 ts_tablet_manager.cc:1434] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:10:02.977252 22467 tablet_copy_service.cc:342] P c863116d91c14d1ca50d6e8a46a37a8f: Request end of tablet copy session 8701cd5186a949538d8efafb5f987270-5b50f0bec71f4924aa1781b9818f1d73 received from {username='slave'} at 127.0.0.1:34452
I20260709 12:10:02.977670 22467 tablet_copy_service.cc:434] P c863116d91c14d1ca50d6e8a46a37a8f: ending tablet copy session 8701cd5186a949538d8efafb5f987270-5b50f0bec71f4924aa1781b9818f1d73 on tablet 5b50f0bec71f4924aa1781b9818f1d73 with peer 8701cd5186a949538d8efafb5f987270
I20260709 12:10:03.008083 24051 raft_consensus.cc:993] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881: : Instructing follower 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:10:03.008693 24051 raft_consensus.cc:1081] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Signalling peer 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:10:03.010115 22605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:45576
I20260709 12:10:03.010890 22605 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:03.012032 22605 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.016177 24082 ts_tablet_manager.cc:933] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317)
I20260709 12:10:03.018635 22605 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:10:03.022903 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:03.023701 22448 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.051026 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:03.051662 22526 raft_consensus.cc:3055] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:03.051954 22526 raft_consensus.cc:740] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:03.052685 22526 consensus_queue.cc:260] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:10:03.053980 22526 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.065701 22448 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:10:03.067021 22569 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:03.067619 22526 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:10:03.067895 24024 raft_consensus.cc:2804] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:03.068634 24024 raft_consensus.cc:697] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:03.069411 22605 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:03.071239 24082 tablet_copy_client.cc:323] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270: tablet copy: Beginning tablet copy session from remote peer at address 127.20.196.129:42317
I20260709 12:10:03.070132 24024 consensus_queue.cc:237] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:10:03.072975 22467 tablet_copy_service.cc:140] P c863116d91c14d1ca50d6e8a46a37a8f: Received BeginTabletCopySession request for tablet b41723f4983d46d0bf385fae671d9a04 from peer 8701cd5186a949538d8efafb5f987270 ({username='slave'} at 127.0.0.1:34452)
I20260709 12:10:03.073494 22467 tablet_copy_service.cc:161] P c863116d91c14d1ca50d6e8a46a37a8f: Beginning new tablet copy session on tablet b41723f4983d46d0bf385fae671d9a04 from peer 8701cd5186a949538d8efafb5f987270 at {username='slave'} at 127.0.0.1:34452: session id = 8701cd5186a949538d8efafb5f987270-b41723f4983d46d0bf385fae671d9a04
I20260709 12:10:03.081158 22467 tablet_copy_source_session.cc:215] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:10:03.084749 24082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b41723f4983d46d0bf385fae671d9a04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:10:03.095769 22351 catalog_manager.cc:5697] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 1 to 2, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 2 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:03.102577 24082 tablet_copy_client.cc:806] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 0 data blocks...
I20260709 12:10:03.103288 24082 tablet_copy_client.cc:670] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 1 WAL segments...
I20260709 12:10:03.107013 24082 tablet_copy_client.cc:538] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:10:03.117256 24082 tablet_bootstrap.cc:492] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270: Bootstrap starting.
I20260709 12:10:03.140194 24082 tablet_bootstrap.cc:492] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:10:03.141189 24082 tablet_bootstrap.cc:492] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270: Bootstrap complete.
I20260709 12:10:03.141865 24082 ts_tablet_manager.cc:1403] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.011s
I20260709 12:10:03.144896 24082 raft_consensus.cc:359] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:10:03.145743 24082 raft_consensus.cc:740] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Initialized, Role: LEARNER
I20260709 12:10:03.146356 24082 consensus_queue.cc:260] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:10:03.148903 24082 ts_tablet_manager.cc:1434] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:10:03.150825 22467 tablet_copy_service.cc:342] P c863116d91c14d1ca50d6e8a46a37a8f: Request end of tablet copy session 8701cd5186a949538d8efafb5f987270-b41723f4983d46d0bf385fae671d9a04 received from {username='slave'} at 127.0.0.1:34452
I20260709 12:10:03.151258 22467 tablet_copy_service.cc:434] P c863116d91c14d1ca50d6e8a46a37a8f: ending tablet copy session 8701cd5186a949538d8efafb5f987270-b41723f4983d46d0bf385fae671d9a04 on tablet b41723f4983d46d0bf385fae671d9a04 with peer 8701cd5186a949538d8efafb5f987270
I20260709 12:10:03.208369 24063 raft_consensus.cc:993] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f: : Instructing follower 1676e7af5e4a47cb86ee7db83e3d4881 to start an election
I20260709 12:10:03.208804 23875 raft_consensus.cc:1081] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Signalling peer 1676e7af5e4a47cb86ee7db83e3d4881 to start an election
I20260709 12:10:03.210143 22526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:56940
I20260709 12:10:03.210556 22526 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:03.210826 22526 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.215960 22526 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:10:03.217820 22526 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:03.218525 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:03.218688 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:03.219170 22605 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.219133 22448 raft_consensus.cc:3055] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:03.219642 22448 raft_consensus.cc:740] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:03.220374 22448 consensus_queue.cc:260] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:10:03.221901 22448 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.226724 24082 ts_tablet_manager.cc:933] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:03.228897 22448 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:10:03.230314 22495 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:03.231168 24004 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:03.231650 24004 raft_consensus.cc:697] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:03.232496 24004 consensus_queue.cc:237] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:10:03.227618 22605 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:10:03.246512 24082 tablet_copy_client.cc:323] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270: tablet copy: Beginning tablet copy session from remote peer at address 127.20.196.131:37785
I20260709 12:10:03.275652 22353 catalog_manager.cc:5697] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 1 to 2, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 2 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:03.289052 22523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:56928
I20260709 12:10:03.289620 22523 raft_consensus.cc:606] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:10:03.289786 22615 tablet_copy_service.cc:140] P 6c6fa11e8ee34711b3551f0c670442bc: Received BeginTabletCopySession request for tablet 4c23033521664ca6a0c00a6f0f552308 from peer 8701cd5186a949538d8efafb5f987270 ({username='slave'} at 127.0.0.1:43070)
I20260709 12:10:03.290402 22615 tablet_copy_service.cc:161] P 6c6fa11e8ee34711b3551f0c670442bc: Beginning new tablet copy session on tablet 4c23033521664ca6a0c00a6f0f552308 from peer 8701cd5186a949538d8efafb5f987270 at {username='slave'} at 127.0.0.1:43070: session id = 8701cd5186a949538d8efafb5f987270-4c23033521664ca6a0c00a6f0f552308
I20260709 12:10:03.293668 22523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:56928
I20260709 12:10:03.294189 22523 raft_consensus.cc:606] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Received request to transfer leadership
W20260709 12:10:03.295017 22340 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for b41723f4983d46d0bf385fae671d9a04 already in progress [suppressed 3 similar messages]
I20260709 12:10:03.296960 22615 tablet_copy_source_session.cc:215] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:10:03.297626 22523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:56928
I20260709 12:10:03.298100 22523 raft_consensus.cc:606] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:10:03.299817 24082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c23033521664ca6a0c00a6f0f552308. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:10:03.301870 22403 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:10:03.302250 22403 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for b41723f4983d46d0bf385fae671d9a04 already in progress
W20260709 12:10:03.302496 22403 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for b41723f4983d46d0bf385fae671d9a04 already in progress
I20260709 12:10:03.311638 24082 tablet_copy_client.cc:806] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 0 data blocks...
I20260709 12:10:03.312295 24082 tablet_copy_client.cc:670] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 1 WAL segments...
I20260709 12:10:03.315758 24082 tablet_copy_client.cc:538] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:10:03.324352 24082 tablet_bootstrap.cc:492] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270: Bootstrap starting.
I20260709 12:10:03.345180 24082 tablet_bootstrap.cc:492] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:10:03.346168 24082 tablet_bootstrap.cc:492] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270: Bootstrap complete.
I20260709 12:10:03.347020 24082 ts_tablet_manager.cc:1403] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.007s
I20260709 12:10:03.348964 24082 raft_consensus.cc:359] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:10:03.349607 24082 raft_consensus.cc:740] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Initialized, Role: LEARNER
I20260709 12:10:03.350075 24082 consensus_queue.cc:260] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:10:03.351994 24082 ts_tablet_manager.cc:1434] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:10:03.356588 22615 tablet_copy_service.cc:342] P 6c6fa11e8ee34711b3551f0c670442bc: Request end of tablet copy session 8701cd5186a949538d8efafb5f987270-4c23033521664ca6a0c00a6f0f552308 received from {username='slave'} at 127.0.0.1:43070
I20260709 12:10:03.357005 22615 tablet_copy_service.cc:434] P 6c6fa11e8ee34711b3551f0c670442bc: ending tablet copy session 8701cd5186a949538d8efafb5f987270-4c23033521664ca6a0c00a6f0f552308 on tablet 4c23033521664ca6a0c00a6f0f552308 with peer 8701cd5186a949538d8efafb5f987270
I20260709 12:10:03.375335 23125 raft_consensus.cc:1217] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 12:10:03.548813 22448 raft_consensus.cc:1275] T 19773e9e6aec446eb719d3d53d49812b P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:10:03.550129 24089 consensus_queue.cc:1048] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:03.569409 23122 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Advancing to term 2
I20260709 12:10:03.569541 22523 raft_consensus.cc:1275] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:10:03.585187 24021 consensus_queue.cc:1048] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:03.589375 23122 raft_consensus.cc:1275] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 2 LEARNER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:10:03.593565 24024 consensus_queue.cc:1048] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:03.661748 22602 raft_consensus.cc:1275] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:10:03.668161 24004 consensus_queue.cc:1048] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:03.700260 24100 raft_consensus.cc:993] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881: : Instructing follower 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:10:03.708132 24100 raft_consensus.cc:1081] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Signalling peer 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:10:03.710722 22602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:45576
I20260709 12:10:03.711501 22602 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:03.711903 22602 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.712450 24021 raft_consensus.cc:1064] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
I20260709 12:10:03.714957 24021 consensus_queue.cc:237] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:03.718957 23125 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Advancing to term 2
I20260709 12:10:03.725838 23122 raft_consensus.cc:1275] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 2 LEARNER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:10:03.719576 22602 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:10:03.728729 24024 consensus_queue.cc:1048] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:03.730583 23125 raft_consensus.cc:1275] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 2 LEARNER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:10:03.731881 24004 consensus_queue.cc:1048] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:03.732899 22526 raft_consensus.cc:1275] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:10:03.733501 22448 raft_consensus.cc:1275] T 19773e9e6aec446eb719d3d53d49812b P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:10:03.734752 24024 consensus_queue.cc:1048] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:03.736300 24024 consensus_queue.cc:1048] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:03.754179 24100 raft_consensus.cc:1064] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
W20260709 12:10:03.754622 24100 raft_consensus.cc:1068] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881: Unable to promote non-voter 8701cd5186a949538d8efafb5f987270: Service unavailable: leader transfer in progress
I20260709 12:10:03.754351 24021 raft_consensus.cc:2955] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:03.763221 22448 raft_consensus.cc:1275] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:10:03.764811 24101 consensus_queue.cc:1048] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:03.767307 22602 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:03.768255 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:03.768999 22453 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.773080 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:03.773875 22526 raft_consensus.cc:3055] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:03.775447 22526 raft_consensus.cc:740] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:03.776371 22526 consensus_queue.cc:260] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:10:03.779470 22523 raft_consensus.cc:2955] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:03.789328 22453 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:03.781493 22454 raft_consensus.cc:2955] T 19773e9e6aec446eb719d3d53d49812b P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:03.791409 22351 catalog_manager.cc:5697] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: config changed from index 2 to 4, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:03.798501 22448 raft_consensus.cc:1240] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 2. Current term is 3. Ops: [2.3-2.3]
I20260709 12:10:03.784873 23125 raft_consensus.cc:2955] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:03.813930 23122 raft_consensus.cc:1217] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 12:10:03.814908 22569 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:03.815799 24089 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:03.816293 24089 raft_consensus.cc:697] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:03.816450 22526 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.817188 24089 consensus_queue.cc:237] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:10:03.835986 22526 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:03.851193 22602 consensus_queue.cc:237] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:03.856253 23122 raft_consensus.cc:1275] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:03.856271 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:03.861704 24089 consensus_queue.cc:1048] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:03.864781 22526 raft_consensus.cc:1275] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:03.867609 24021 consensus_queue.cc:1048] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:03.877472 22353 catalog_manager.cc:5697] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 2 to 3, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 3 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:03.880086 24089 raft_consensus.cc:2955] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:03.882803 23125 raft_consensus.cc:2955] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:03.888918 22526 raft_consensus.cc:2955] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:03.905457 22341 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 19773e9e6aec446eb719d3d53d49812b with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:03.918682 24047 raft_consensus.cc:1064] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
I20260709 12:10:03.919775 22355 catalog_manager.cc:5697] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 reported cstate change: config changed from index 4 to 5, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New cstate: current_term: 2 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:03.921190 24047 consensus_queue.cc:237] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:03.934217 22442 tablet_service.cc:1558] Processing DeleteTablet for tablet 19773e9e6aec446eb719d3d53d49812b with delete_type TABLET_DATA_TOMBSTONED (TS c863116d91c14d1ca50d6e8a46a37a8f not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:51832
I20260709 12:10:03.955406 24109 tablet_replica.cc:333] T 19773e9e6aec446eb719d3d53d49812b P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:10:03.973970 24109 raft_consensus.cc:2243] T 19773e9e6aec446eb719d3d53d49812b P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:03.975806 24109 raft_consensus.cc:2272] T 19773e9e6aec446eb719d3d53d49812b P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:03.980314 24109 ts_tablet_manager.cc:1916] T 19773e9e6aec446eb719d3d53d49812b P c863116d91c14d1ca50d6e8a46a37a8f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:04.184120 24109 ts_tablet_manager.cc:1929] T 19773e9e6aec446eb719d3d53d49812b P c863116d91c14d1ca50d6e8a46a37a8f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:10:04.184643 24109 log.cc:1199] T 19773e9e6aec446eb719d3d53d49812b P c863116d91c14d1ca50d6e8a46a37a8f: Deleting WAL directory at /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-0-root/wals/19773e9e6aec446eb719d3d53d49812b
I20260709 12:10:04.268329 22339 catalog_manager.cc:5028] TS c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): tablet 19773e9e6aec446eb719d3d53d49812b (table test-workload [id=1e73b97ba677488c8829a696096f4885]) successfully deleted
I20260709 12:10:04.279609 22527 raft_consensus.cc:1275] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:04.281759 23875 consensus_queue.cc:1048] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:04.285459 23124 raft_consensus.cc:1275] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 3 LEARNER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:04.302870 22602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:10:04.303505 22602 raft_consensus.cc:606] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Received request to transfer leadership to TS 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:04.303272 23875 consensus_queue.cc:1048] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:04.313829 22602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:10:04.314395 22602 raft_consensus.cc:606] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Received request to transfer leadership to TS c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:04.316464 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:10:04.318135 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:04.318876 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:04.332418 23122 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 2 LEARNER]: Advancing to term 3
I20260709 12:10:04.334396 22602 raft_consensus.cc:1275] T 5b50f0bec71f4924aa1781b9818f1d73 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:04.348845 24110 consensus_queue.cc:1048] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:04.358258 24021 raft_consensus.cc:993] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc: : Instructing follower c863116d91c14d1ca50d6e8a46a37a8f to start an election
I20260709 12:10:04.412011 24095 raft_consensus.cc:1081] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Signalling peer c863116d91c14d1ca50d6e8a46a37a8f to start an election
I20260709 12:10:04.415417 22525 raft_consensus.cc:1275] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 12:10:04.428009 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 87294.7us
I20260709 12:10:04.444532 24024 raft_consensus.cc:1064] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
I20260709 12:10:04.446825 24024 consensus_queue.cc:237] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:04.446558 24110 raft_consensus.cc:2955] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:04.449481 22454 raft_consensus.cc:1275] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:10:04.417001 23122 raft_consensus.cc:1275] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 3 LEARNER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:10:04.453886 22448 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
 from {username='slave'} at 127.0.0.1:51836
I20260709 12:10:04.454409 22448 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:04.454748 22448 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.464213 24115 consensus_queue.cc:1048] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:04.468652 22448 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:04.472900 22448 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:04.473443 22598 raft_consensus.cc:2955] T 5b50f0bec71f4924aa1781b9818f1d73 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:04.474555 22353 catalog_manager.cc:5697] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: config changed from index 4 to 5, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:04.480604 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:04.481173 22602 raft_consensus.cc:3055] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:04.481444 22602 raft_consensus.cc:740] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:04.482084 22602 consensus_queue.cc:260] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:04.482868 22602 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.483321 22525 raft_consensus.cc:2955] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:04.487918 23117 raft_consensus.cc:2955] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:04.490123 22602 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:10:04.491530 22422 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:04.492375 24047 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:04.492823 24047 raft_consensus.cc:697] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:04.493649 24047 consensus_queue.cc:237] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:04.499307 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 55682.9us
I20260709 12:10:04.505740 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:04.506341 22525 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:04.520488 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:04.524225 22525 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:10:04.541260 24115 consensus_queue.cc:1048] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:10:04.589476 22448 raft_consensus.cc:1275] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:04.591917 24115 consensus_queue.cc:1048] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:10:04.618041 22351 catalog_manager.cc:5697] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 2 to 3, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 3 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:04.622184 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 91822.4us
I20260709 12:10:04.626549 24021 raft_consensus.cc:993] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc: : Instructing follower 1676e7af5e4a47cb86ee7db83e3d4881 to start an election
I20260709 12:10:04.626302 24120 consensus_queue.cc:1048] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:04.631247 22528 raft_consensus.cc:1275] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:04.631656 23122 raft_consensus.cc:1275] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 3 LEARNER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:04.634254 24120 consensus_queue.cc:1048] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:04.640511 22454 consensus_queue.cc:237] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:04.647601 23121 raft_consensus.cc:1275] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:04.648017 22532 raft_consensus.cc:1275] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:04.649044 24110 consensus_queue.cc:1048] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:04.651832 24110 consensus_queue.cc:1048] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:04.656452 24021 raft_consensus.cc:1081] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Signalling peer 1676e7af5e4a47cb86ee7db83e3d4881 to start an election
I20260709 12:10:04.659353 23875 raft_consensus.cc:2955] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:04.669826 22525 raft_consensus.cc:2955] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:04.672478 23122 raft_consensus.cc:2955] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:04.681667 22339 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5b50f0bec71f4924aa1781b9818f1d73 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:04.697288 22354 catalog_manager.cc:5697] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 reported cstate change: config changed from index 5 to 6, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New cstate: current_term: 3 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:04.716378 22594 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b50f0bec71f4924aa1781b9818f1d73 with delete_type TABLET_DATA_TOMBSTONED (TS 6c6fa11e8ee34711b3551f0c670442bc not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:45546
I20260709 12:10:04.722815 24136 tablet_replica.cc:333] T 5b50f0bec71f4924aa1781b9818f1d73 P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:10:04.723914 24136 raft_consensus.cc:2243] T 5b50f0bec71f4924aa1781b9818f1d73 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:04.724586 24136 raft_consensus.cc:2272] T 5b50f0bec71f4924aa1781b9818f1d73 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:04.732048 24136 ts_tablet_manager.cc:1916] T 5b50f0bec71f4924aa1781b9818f1d73 P 6c6fa11e8ee34711b3551f0c670442bc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:10:04.831928 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 148705us
I20260709 12:10:04.858299 24094 consensus_queue.cc:1048] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:04.861264 24115 raft_consensus.cc:1064] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
I20260709 12:10:04.867933 24115 consensus_queue.cc:237] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:04.919396 22448 raft_consensus.cc:1275] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:04.940934 24130 consensus_queue.cc:1048] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:10:04.942615 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 84547us
I20260709 12:10:04.965188 22525 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:56942
I20260709 12:10:04.965870 22525 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:04.966215 22525 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:04.976323 22525 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:04.984414 22524 raft_consensus.cc:1275] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:04.987792 22524 raft_consensus.cc:1240] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:04.995393 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:04.996110 22605 raft_consensus.cc:3055] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:04.996543 22605 raft_consensus.cc:740] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:04.995757 22525 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:05.001842 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:05.002784 23118 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:05.007120 22605 consensus_queue.cc:260] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:05.012564 23117 raft_consensus.cc:1275] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 3 LEARNER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:05.010522 22598 raft_consensus.cc:1275] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:05.016356 22605 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:05.018217 23875 consensus_queue.cc:1048] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:05.022446 24115 consensus_queue.cc:1048] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:05.015329 24094 raft_consensus.cc:2955] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:05.032166 22524 raft_consensus.cc:2955] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:05.038148 23118 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:10:05.039036 22525 raft_consensus.cc:1275] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:05.044003 22453 raft_consensus.cc:2955] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:05.056907 22605 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:10:05.071553 24021 consensus_queue.cc:1048] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:05.086632 22355 catalog_manager.cc:5697] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: config changed from index 4 to 5, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:05.078711 23117 raft_consensus.cc:2955] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:05.088896 24021 raft_consensus.cc:2955] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:05.103442 22525 raft_consensus.cc:2955] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:05.106817 22497 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:05.107975 24101 raft_consensus.cc:2804] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:05.108445 24101 raft_consensus.cc:697] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:05.109308 24101 consensus_queue.cc:237] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:05.121382 22448 raft_consensus.cc:2955] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:05.133867 22605 consensus_queue.cc:237] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:05.137004 23122 raft_consensus.cc:2955] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:05.136590 22354 catalog_manager.cc:5697] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: config changed from index 2 to 5, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:05.144694 22355 catalog_manager.cc:5697] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 1 to 2, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 2 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:05.162081 24136 ts_tablet_manager.cc:1929] T 5b50f0bec71f4924aa1781b9818f1d73 P 6c6fa11e8ee34711b3551f0c670442bc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 12:10:05.162613 24136 log.cc:1199] T 5b50f0bec71f4924aa1781b9818f1d73 P 6c6fa11e8ee34711b3551f0c670442bc: Deleting WAL directory at /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-2-root/wals/5b50f0bec71f4924aa1781b9818f1d73
I20260709 12:10:05.164155 22341 catalog_manager.cc:5028] TS 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): tablet 5b50f0bec71f4924aa1781b9818f1d73 (table test-workload [id=1e73b97ba677488c8829a696096f4885]) successfully deleted
I20260709 12:10:05.181521 24063 consensus_queue.cc:1048] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:05.186661 22598 consensus_queue.cc:237] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:05.207365 23118 raft_consensus.cc:1275] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:05.209056 24094 consensus_queue.cc:1048] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:05.210597 22451 raft_consensus.cc:1275] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:05.212680 24021 consensus_queue.cc:1048] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:10:05.214258 22478 debug-util.cc:398] Leaking SignalData structure 0x7b0800095de0 after lost signal to thread 21269
W20260709 12:10:05.215346 22478 debug-util.cc:398] Leaking SignalData structure 0x7b08001f4340 after lost signal to thread 22389
W20260709 12:10:05.216572 22478 debug-util.cc:398] Leaking SignalData structure 0x7b0800373bc0 after lost signal to thread 22481
W20260709 12:10:05.217664 22478 debug-util.cc:398] Leaking SignalData structure 0x7b0800379340 after lost signal to thread 22556
W20260709 12:10:05.218741 22478 debug-util.cc:398] Leaking SignalData structure 0x7b08002c08c0 after lost signal to thread 22630
W20260709 12:10:05.219901 22478 debug-util.cc:398] Leaking SignalData structure 0x7b0800353e00 after lost signal to thread 23149
I20260709 12:10:05.219935 24089 raft_consensus.cc:2955] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:05.220145 24094 raft_consensus.cc:2955] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:05.226913 23118 raft_consensus.cc:2955] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:05.228849 22451 raft_consensus.cc:1275] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:05.230561 24021 consensus_queue.cc:1048] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:05.231431 22341 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4c23033521664ca6a0c00a6f0f552308 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:05.231825 22453 raft_consensus.cc:2955] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:05.236606 22451 raft_consensus.cc:2955] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:05.260334 23117 raft_consensus.cc:1275] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:05.268850 24021 consensus_queue.cc:1048] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:05.274880 23122 raft_consensus.cc:2955] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:05.277190 22341 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b41723f4983d46d0bf385fae671d9a04 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:05.284497 22354 catalog_manager.cc:5697] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: config changed from index 5 to 6, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New cstate: current_term: 3 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:05.297250 22517 tablet_service.cc:1558] Processing DeleteTablet for tablet 4c23033521664ca6a0c00a6f0f552308 with delete_type TABLET_DATA_TOMBSTONED (TS 1676e7af5e4a47cb86ee7db83e3d4881 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:56928
I20260709 12:10:05.310904 22354 catalog_manager.cc:5697] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: config changed from index 5 to 6, VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) evicted. New cstate: current_term: 3 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:05.317384 24145 tablet_replica.cc:333] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:10:05.320271 24145 raft_consensus.cc:2243] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:05.321167 24145 raft_consensus.cc:2272] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:05.325625 24145 ts_tablet_manager.cc:1916] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:05.345647 24145 ts_tablet_manager.cc:1929] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 12:10:05.346146 24145 log.cc:1199] T 4c23033521664ca6a0c00a6f0f552308 P 1676e7af5e4a47cb86ee7db83e3d4881: Deleting WAL directory at /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-1-root/wals/4c23033521664ca6a0c00a6f0f552308
I20260709 12:10:05.352269 22340 catalog_manager.cc:5028] TS 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): tablet 4c23033521664ca6a0c00a6f0f552308 (table test-workload [id=1e73b97ba677488c8829a696096f4885]) successfully deleted
I20260709 12:10:05.353701 22517 tablet_service.cc:1558] Processing DeleteTablet for tablet b41723f4983d46d0bf385fae671d9a04 with delete_type TABLET_DATA_TOMBSTONED (TS 1676e7af5e4a47cb86ee7db83e3d4881 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:56928
I20260709 12:10:05.354698 24145 tablet_replica.cc:333] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:10:05.355777 24145 raft_consensus.cc:2243] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:05.356593 24145 raft_consensus.cc:2272] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:05.360424 24145 ts_tablet_manager.cc:1916] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:05.379429 24145 ts_tablet_manager.cc:1929] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 12:10:05.379952 24145 log.cc:1199] T b41723f4983d46d0bf385fae671d9a04 P 1676e7af5e4a47cb86ee7db83e3d4881: Deleting WAL directory at /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-1-root/wals/b41723f4983d46d0bf385fae671d9a04
I20260709 12:10:05.383041 22340 catalog_manager.cc:5028] TS 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): tablet b41723f4983d46d0bf385fae671d9a04 (table test-workload [id=1e73b97ba677488c8829a696096f4885]) successfully deleted
W20260709 12:10:05.591957 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 50679.6us
I20260709 12:10:05.644379 23122 raft_consensus.cc:1275] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:10:05.726089 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 60576.2us
I20260709 12:10:05.746774 24149 consensus_queue.cc:1048] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:05.762396 22599 raft_consensus.cc:1275] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:05.764586 24112 consensus_queue.cc:1048] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:05.884301 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:05.936854 22448 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
mode: GRACEFUL
new_leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:44568
I20260709 12:10:05.937681 22448 raft_consensus.cc:606] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Received request to transfer leadership to TS 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:05.940920 22525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:39980
I20260709 12:10:05.941428 22525 raft_consensus.cc:606] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 LEADER]: Received request to transfer leadership to TS 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:05.942865 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:10:05.944167 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:05.944938 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:06.044025 24137 raft_consensus.cc:993] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881: : Instructing follower 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:10:06.044667 24137 raft_consensus.cc:1081] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 LEADER]: Signalling peer 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:10:06.046317 22599 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:45576
I20260709 12:10:06.047008 22599 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:06.047428 22599 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:06.060515 22599 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:06.063889 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:06.064565 22453 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:06.064489 22599 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:06.065196 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:06.065781 22525 raft_consensus.cc:3055] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:06.066157 22525 raft_consensus.cc:740] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:06.067153 22525 consensus_queue.cc:260] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:06.068341 22525 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:06.078336 22453 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
I20260709 12:10:06.081115 22569 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:06.082304 24115 raft_consensus.cc:2804] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:06.082778 24115 raft_consensus.cc:697] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:06.083755 24115 consensus_queue.cc:237] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:06.098341 22525 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
I20260709 12:10:06.115984 22355 catalog_manager.cc:5697] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 3 to 4, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 4 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:06.375192 22524 consensus_queue.cc:237] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:10:06.385102 22603 raft_consensus.cc:1275] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:10:06.385183 22448 raft_consensus.cc:1275] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:10:06.386824 22496 consensus_peers.cc:597] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1ba02be77861491da7dbcfee1161e46c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:10:06.387300 24149 consensus_queue.cc:1048] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:06.388278 24137 consensus_queue.cc:1048] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:06.412576 24112 raft_consensus.cc:2955] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:10:06.414345 22453 raft_consensus.cc:2955] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:10:06.419660 24063 raft_consensus.cc:993] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f: : Instructing follower 1676e7af5e4a47cb86ee7db83e3d4881 to start an election
I20260709 12:10:06.420199 24063 raft_consensus.cc:1081] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Signalling peer 1676e7af5e4a47cb86ee7db83e3d4881 to start an election
I20260709 12:10:06.421550 22603 raft_consensus.cc:2955] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:10:06.424908 22524 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:56940
I20260709 12:10:06.425531 22524 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:06.425922 22524 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:06.441839 22524 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:06.445200 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:06.445811 22451 raft_consensus.cc:3055] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:06.446130 22451 raft_consensus.cc:740] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:06.446435 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:06.449357 22599 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:06.446841 22451 consensus_queue.cc:260] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:06.451953 22451 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:06.451738 22525 consensus_queue.cc:237] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:10:06.453987 22355 catalog_manager.cc:5697] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: config changed from index -1 to 2, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:06.470269 22599 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:10:06.445426 22524 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:06.482779 22497 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:06.488576 24138 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:06.489264 24138 raft_consensus.cc:697] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:06.466084 22451 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:10:06.490514 24138 consensus_queue.cc:237] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:06.511942 22496 consensus_peers.cc:597] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 67b097456aac41edb06c5a4efd504ca1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:10:06.514385 22451 raft_consensus.cc:1275] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:10:06.515511 22603 raft_consensus.cc:1275] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:10:06.518072 24112 consensus_queue.cc:1048] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:06.525243 24137 consensus_queue.cc:1048] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:06.534611 24167 raft_consensus.cc:2955] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:10:06.542856 22599 raft_consensus.cc:2955] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:10:06.554803 22451 raft_consensus.cc:2955] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:10:06.562230 22448 raft_consensus.cc:1275] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:06.564065 24021 consensus_queue.cc:1048] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:10:06.581174 22403 auto_rebalancer.cc:629] Failed to schedule move for tablet 871e4d35e385425cb2fe5d84b8d4fd45: Illegal state: Replica c863116d91c14d1ca50d6e8a46a37a8f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:10:06.590760 22353 catalog_manager.cc:5697] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 1 to 2, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 2 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:06.596973 22603 consensus_queue.cc:237] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:10:06.624194 22525 raft_consensus.cc:1275] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:06.626644 22355 catalog_manager.cc:5697] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: config changed from index -1 to 3, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New cstate: current_term: 2 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:10:06.629247 24115 consensus_queue.cc:1048] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:06.671968 22523 raft_consensus.cc:1275] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:10:06.674620 22448 raft_consensus.cc:1275] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:10:06.676895 24021 consensus_queue.cc:1048] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:10:06.679401 22570 consensus_peers.cc:597] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 263d51d0b43744d899e37466045af890. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:10:06.686721 24021 consensus_queue.cc:1048] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:06.706156 24115 raft_consensus.cc:2955] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:10:06.707813 22525 raft_consensus.cc:2955] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:10:06.729401 22448 raft_consensus.cc:2955] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:10:06.742383 22351 catalog_manager.cc:5697] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: config changed from index -1 to 4, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New cstate: current_term: 3 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:10:06.765635 24180 ts_tablet_manager.cc:933] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:06.774959 24180 tablet_copy_client.cc:323] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270: tablet copy: Beginning tablet copy session from remote peer at address 127.20.196.130:42733
I20260709 12:10:06.777072 22542 tablet_copy_service.cc:140] P 1676e7af5e4a47cb86ee7db83e3d4881: Received BeginTabletCopySession request for tablet 1ba02be77861491da7dbcfee1161e46c from peer 8701cd5186a949538d8efafb5f987270 ({username='slave'} at 127.0.0.1:38310)
I20260709 12:10:06.777619 22542 tablet_copy_service.cc:161] P 1676e7af5e4a47cb86ee7db83e3d4881: Beginning new tablet copy session on tablet 1ba02be77861491da7dbcfee1161e46c from peer 8701cd5186a949538d8efafb5f987270 at {username='slave'} at 127.0.0.1:38310: session id = 8701cd5186a949538d8efafb5f987270-1ba02be77861491da7dbcfee1161e46c
I20260709 12:10:06.786074 22542 tablet_copy_source_session.cc:215] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:10:06.790846 24180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ba02be77861491da7dbcfee1161e46c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:10:06.810406 24180 tablet_copy_client.cc:806] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 0 data blocks...
I20260709 12:10:06.811204 24180 tablet_copy_client.cc:670] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 1 WAL segments...
I20260709 12:10:06.816782 24180 tablet_copy_client.cc:538] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:10:06.826720 24180 tablet_bootstrap.cc:492] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270: Bootstrap starting.
I20260709 12:10:06.871471 24180 tablet_bootstrap.cc:492] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:10:06.877943 24180 tablet_bootstrap.cc:492] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270: Bootstrap complete.
I20260709 12:10:06.878890 24180 ts_tablet_manager.cc:1403] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270: Time spent bootstrapping tablet: real 0.052s	user 0.027s	sys 0.005s
I20260709 12:10:06.883327 24180 raft_consensus.cc:359] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:10:06.884305 24180 raft_consensus.cc:740] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Initialized, Role: LEARNER
I20260709 12:10:06.885093 24180 consensus_queue.cc:260] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:10:06.896123 24180 ts_tablet_manager.cc:1434] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:10:06.911795 22542 tablet_copy_service.cc:342] P 1676e7af5e4a47cb86ee7db83e3d4881: Request end of tablet copy session 8701cd5186a949538d8efafb5f987270-1ba02be77861491da7dbcfee1161e46c received from {username='slave'} at 127.0.0.1:38310
I20260709 12:10:06.915237 22542 tablet_copy_service.cc:434] P 1676e7af5e4a47cb86ee7db83e3d4881: ending tablet copy session 8701cd5186a949538d8efafb5f987270-1ba02be77861491da7dbcfee1161e46c on tablet 1ba02be77861491da7dbcfee1161e46c with peer 8701cd5186a949538d8efafb5f987270
I20260709 12:10:06.981323 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:07.006582 22448 raft_consensus.cc:1275] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:07.013128 24138 consensus_queue.cc:1048] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:07.027302 24180 ts_tablet_manager.cc:933] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:07.053592 24180 tablet_copy_client.cc:323] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270: tablet copy: Beginning tablet copy session from remote peer at address 127.20.196.130:42733
I20260709 12:10:07.054955 22603 raft_consensus.cc:1275] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:07.056692 24138 consensus_queue.cc:1048] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:07.059031 22542 tablet_copy_service.cc:140] P 1676e7af5e4a47cb86ee7db83e3d4881: Received BeginTabletCopySession request for tablet 67b097456aac41edb06c5a4efd504ca1 from peer 8701cd5186a949538d8efafb5f987270 ({username='slave'} at 127.0.0.1:38310)
I20260709 12:10:07.059634 22542 tablet_copy_service.cc:161] P 1676e7af5e4a47cb86ee7db83e3d4881: Beginning new tablet copy session on tablet 67b097456aac41edb06c5a4efd504ca1 from peer 8701cd5186a949538d8efafb5f987270 at {username='slave'} at 127.0.0.1:38310: session id = 8701cd5186a949538d8efafb5f987270-67b097456aac41edb06c5a4efd504ca1
I20260709 12:10:07.130312 22542 tablet_copy_source_session.cc:215] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:10:07.140152 22599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:10:07.140856 22599 raft_consensus.cc:606] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 LEADER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:10:07.143353 24180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67b097456aac41edb06c5a4efd504ca1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:10:07.144661 22525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb7fd922979743428612619e8de33af1"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
 from {username='slave'} at 127.0.0.1:39980
I20260709 12:10:07.145218 22525 raft_consensus.cc:606] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Received request to transfer leadership to TS c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:07.146498 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:10:07.148085 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:07.154148 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:07.163823 24187 ts_tablet_manager.cc:933] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:07.165691 24180 tablet_copy_client.cc:806] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 0 data blocks...
I20260709 12:10:07.166333 24180 tablet_copy_client.cc:670] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 1 WAL segments...
I20260709 12:10:07.170271 24180 tablet_copy_client.cc:538] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:10:07.181248 24187 tablet_copy_client.cc:323] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270: tablet copy: Beginning tablet copy session from remote peer at address 127.20.196.131:37785
I20260709 12:10:07.183240 22615 tablet_copy_service.cc:140] P 6c6fa11e8ee34711b3551f0c670442bc: Received BeginTabletCopySession request for tablet 263d51d0b43744d899e37466045af890 from peer 8701cd5186a949538d8efafb5f987270 ({username='slave'} at 127.0.0.1:43070)
I20260709 12:10:07.183832 22615 tablet_copy_service.cc:161] P 6c6fa11e8ee34711b3551f0c670442bc: Beginning new tablet copy session on tablet 263d51d0b43744d899e37466045af890 from peer 8701cd5186a949538d8efafb5f987270 at {username='slave'} at 127.0.0.1:43070: session id = 8701cd5186a949538d8efafb5f987270-263d51d0b43744d899e37466045af890
I20260709 12:10:07.196326 22615 tablet_copy_source_session.cc:215] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:10:07.197063 24180 tablet_bootstrap.cc:492] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270: Bootstrap starting.
I20260709 12:10:07.199779 24187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 263d51d0b43744d899e37466045af890. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:10:07.237695 24180 tablet_bootstrap.cc:492] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:10:07.251767 24180 tablet_bootstrap.cc:492] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270: Bootstrap complete.
I20260709 12:10:07.252651 24180 ts_tablet_manager.cc:1403] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270: Time spent bootstrapping tablet: real 0.056s	user 0.017s	sys 0.019s
I20260709 12:10:07.256256 24180 raft_consensus.cc:359] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:10:07.261595 24180 raft_consensus.cc:740] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Initialized, Role: LEARNER
I20260709 12:10:07.262459 24180 consensus_queue.cc:260] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:10:07.270522 24180 ts_tablet_manager.cc:1434] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.004s
I20260709 12:10:07.270879 24187 tablet_copy_client.cc:806] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 0 data blocks...
I20260709 12:10:07.271585 24187 tablet_copy_client.cc:670] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 1 WAL segments...
I20260709 12:10:07.272663 22542 tablet_copy_service.cc:342] P 1676e7af5e4a47cb86ee7db83e3d4881: Request end of tablet copy session 8701cd5186a949538d8efafb5f987270-67b097456aac41edb06c5a4efd504ca1 received from {username='slave'} at 127.0.0.1:38310
I20260709 12:10:07.273294 22542 tablet_copy_service.cc:434] P 1676e7af5e4a47cb86ee7db83e3d4881: ending tablet copy session 8701cd5186a949538d8efafb5f987270-67b097456aac41edb06c5a4efd504ca1 on tablet 67b097456aac41edb06c5a4efd504ca1 with peer 8701cd5186a949538d8efafb5f987270
I20260709 12:10:07.278002 24187 tablet_copy_client.cc:538] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:10:07.290308 24187 tablet_bootstrap.cc:492] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270: Bootstrap starting.
I20260709 12:10:07.295207 24120 raft_consensus.cc:993] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc: : Instructing follower 8701cd5186a949538d8efafb5f987270 to start an election
I20260709 12:10:07.295929 24120 raft_consensus.cc:1081] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 LEADER]: Signalling peer 8701cd5186a949538d8efafb5f987270 to start an election
I20260709 12:10:07.312566 23121 raft_consensus.cc:1217] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:10:07.325044 23121 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04"
dest_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:57328
I20260709 12:10:07.325661 23121 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:07.326030 23121 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.344496 23121 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:07.348048 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:07.348605 22448 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.352941 23121 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:07.353536 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:07.354219 22599 raft_consensus.cc:3055] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:07.354717 22599 raft_consensus.cc:740] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:07.355583 22599 consensus_queue.cc:260] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:07.356912 22599 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.370229 24187 tablet_bootstrap.cc:492] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:10:07.373133 24187 tablet_bootstrap.cc:492] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270: Bootstrap complete.
I20260709 12:10:07.374116 24187 ts_tablet_manager.cc:1403] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270: Time spent bootstrapping tablet: real 0.084s	user 0.018s	sys 0.020s
I20260709 12:10:07.378934 24187 raft_consensus.cc:359] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:10:07.379923 24187 raft_consensus.cc:740] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Initialized, Role: LEARNER
I20260709 12:10:07.380782 24187 consensus_queue.cc:260] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:10:07.384254 24187 ts_tablet_manager.cc:1434] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.008s
I20260709 12:10:07.385457 22448 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
I20260709 12:10:07.395613 22599 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
I20260709 12:10:07.397027 23087 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:07.397975 24147 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:07.398442 24147 raft_consensus.cc:697] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 4 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:07.399488 24147 consensus_queue.cc:237] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:07.410740 22615 tablet_copy_service.cc:342] P 6c6fa11e8ee34711b3551f0c670442bc: Request end of tablet copy session 8701cd5186a949538d8efafb5f987270-263d51d0b43744d899e37466045af890 received from {username='slave'} at 127.0.0.1:43070
I20260709 12:10:07.411249 22615 tablet_copy_service.cc:434] P 6c6fa11e8ee34711b3551f0c670442bc: ending tablet copy session 8701cd5186a949538d8efafb5f987270-263d51d0b43744d899e37466045af890 on tablet 263d51d0b43744d899e37466045af890 with peer 8701cd5186a949538d8efafb5f987270
I20260709 12:10:07.425860 22354 catalog_manager.cc:5697] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 3 to 4, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 4 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:07.476663 24149 raft_consensus.cc:993] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881: : Instructing follower c863116d91c14d1ca50d6e8a46a37a8f to start an election
I20260709 12:10:07.477164 24149 raft_consensus.cc:1081] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Signalling peer c863116d91c14d1ca50d6e8a46a37a8f to start an election
I20260709 12:10:07.478910 22448 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb7fd922979743428612619e8de33af1"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
 from {username='slave'} at 127.0.0.1:51844
I20260709 12:10:07.479516 22448 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:07.479972 22448 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.489488 22448 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:07.493088 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:07.493724 22525 raft_consensus.cc:3055] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:07.494578 22525 raft_consensus.cc:740] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:07.495568 22525 consensus_queue.cc:260] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:07.496862 22525 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.502945 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:07.503633 22599 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.507840 22448 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:07.515517 22599 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:10:07.517367 22422 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:07.518817 24110 raft_consensus.cc:2804] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:07.520099 24110 raft_consensus.cc:697] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:07.520982 24110 consensus_queue.cc:237] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:07.542886 22525 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:10:07.556201 22354 catalog_manager.cc:5697] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 2 to 3, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 3 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:07.621840 23121 raft_consensus.cc:1217] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:10:07.702241 24137 raft_consensus.cc:1064] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
I20260709 12:10:07.705092 24137 consensus_queue.cc:237] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:07.739740 23121 raft_consensus.cc:1217] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 12:10:07.773016 22448 raft_consensus.cc:1275] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:10:07.773324 22599 raft_consensus.cc:1275] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:10:07.774749 24167 consensus_queue.cc:1048] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:07.776625 24167 consensus_queue.cc:1048] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:07.777077 23121 raft_consensus.cc:1275] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 1 LEARNER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:10:07.787381 24138 consensus_queue.cc:1048] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:07.822088 24167 raft_consensus.cc:2955] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
W20260709 12:10:08.344951 24199 log.cc:927] Time spent T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.487s	user 0.000s	sys 0.001s
I20260709 12:10:09.122252 24204 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:09.122710 24207 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:09.122871 24204 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:09.123594 24208 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:09.123297 24207 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:09.124125 24208 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:09.125123 24204 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:09.125654 24207 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:09.126173 24208 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:09.127233 23089 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.825s	user 0.000s	sys 0.020s
W20260709 12:10:09.127552 23089 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.825s	user 0.000s	sys 0.020s
I20260709 12:10:09.129817 24204 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:09.130512 24207 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:09.131325 24207 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:09.134332 24203 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:09.134877 24203 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:09.135143 24207 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:09.137019 24203 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:09.137836 24205 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:09.138346 24205 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:09.140372 24205 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:09.141567 24202 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:09.142086 24202 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:09.144260 24202 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:09.144761 24202 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:09.145226 24202 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:09.148434 24205 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:09.149163 24205 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:09.152848 22599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2015) took 1369 ms. Trace:
I20260709 12:10:09.160291 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:10:09.170502 23088 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.866s	user 0.000s	sys 0.014s
W20260709 12:10:09.170924 23088 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.869s	user 0.000s	sys 0.014s
I20260709 12:10:09.177392 24205 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:09.178035 24203 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:09.196557 24203 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:09.153414 22599 rpcz_store.cc:276] 0709 12:10:07.783901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:07.784039 (+   138us) service_pool.cc:224] Handling call
0709 12:10:07.784583 (+   544us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:07.784931 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:07.784959 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:07.785915 (+   956us) log.cc:844] Serialized 572 byte log entry
0709 12:10:07.856373 (+ 70458us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:07.856445 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:07.856575 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:09.152529 (+1295954us) raft_consensus.cc:1685] finished
0709 12:10:09.152562 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:09.152748 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":70059,"threads_started":1,"wal-append.queue_time_us":69514}
I20260709 12:10:09.187626 24202 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:09.188444 24206 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:09.190207 24208 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:09.193039 24207 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:09.130438 24204 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:09.217900 24211 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:09.216320 24208 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:09.212880 24206 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:09.219805 24207 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:09.220504 24217 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:09.223340 22453 raft_consensus.cc:2955] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:09.231946 24203 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:09.232709 24213 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:09.233431 24213 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:09.240785 24206 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:09.241525 24206 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:09.242121 24206 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:09.244630 24207 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:09.245453 24207 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:09.246542 24207 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:09.247295 24208 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:09.248023 24208 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:09.248632 24208 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:09.249198 24207 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:09.224852 24214 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:09.255510 24214 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:09.263803 24208 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:09.265731 24214 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:09.244648 24204 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:09.245627 24217 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:09.268735 24206 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:09.269196 24217 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:09.270892 24217 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:09.271473 24217 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:09.280643 24213 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:09.299477 24217 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:09.227684 24211 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:09.304054 24211 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:09.328750 24210 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:09.329519 24210 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:09.331924 24210 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:09.333546 24204 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:09.336131 24204 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:09.337577 24216 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:09.338300 24204 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:09.338327 24216 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:09.341187 24216 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:09.341696 24216 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:09.342159 24216 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:09.346649 24216 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:09.349442 23087 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.041s	user 0.000s	sys 0.017s
I20260709 12:10:09.346131 24209 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:10:09.355324 23087 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.050s	user 0.000s	sys 0.019s
I20260709 12:10:09.355715 24209 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:09.359993 24147 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:09.360565 24147 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:09.361742 24209 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:09.362313 24203 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:09.363299 24203 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:09.363752 24147 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:09.365343 24203 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:09.371224 24201 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:09.371881 24201 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:09.375571 24201 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317)
I20260709 12:10:09.376856 24208 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:09.377473 24208 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:09.382413 24213 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:09.382893 24213 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:09.384820 24213 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:09.385355 24206 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:09.385857 24206 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:09.388742 24206 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:09.389344 24206 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:09.390101 24206 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:09.392364 24216 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:09.393141 24216 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:09.391812 24208 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:09.393910 24225 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:09.394229 24208 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:09.394491 24225 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:09.395207 24216 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:09.395078 24208 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:10:09.396687 24225 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:09.397338 24213 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:09.398043 24208 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:09.381916 24207 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:09.397893 24213 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:09.398893 24207 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:09.400915 24207 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:09.400836 24213 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:09.402465 24206 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:09.405023 24212 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:09.405741 24212 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:09.408910 24212 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:09.411397 24147 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:09.373243 24217 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:09.412128 24147 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:09.412336 24217 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:09.416842 24217 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:09.417428 24217 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:09.417970 24217 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:09.414767 24147 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:09.420430 24167 consensus_meta.cc:287] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 1.064s	user 0.006s	sys 0.007s
I20260709 12:10:09.421178 24217 leader_election.cc:290] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:09.426584 24209 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.431499 24209 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:09.472777 24223 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:09.483074 24217 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:09.495265 24210 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:09.482882 24212 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:09.479722 24201 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:09.503404 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:09.506506 24212 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:09.510442 24209 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:09.511013 24212 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:09.511430 24221 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:09.511952 24221 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:09.514194 24221 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:09.514266 22451 raft_consensus.cc:1275] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:09.505007 24206 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:09.515789 24206 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:10:09.517220 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:09.517630 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:09.518224 24218 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:09.519644 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:09.520147 22448 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 2.
I20260709 12:10:09.517692 24206 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:09.502063 24204 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:09.521996 24226 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:09.518721 24218 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:09.520265 24201 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:09.522400 24204 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:09.504418 24217 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:09.528219 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:09.504948 24210 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:09.522501 24226 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:09.531487 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:09.531922 22456 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 2.
I20260709 12:10:09.622036 24228 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:09.622952 24228 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:09.632907 24229 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:09.633662 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:09.634356 22453 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 2.
I20260709 12:10:09.502307 24223 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:09.712774 24219 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:09.713632 24219 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:09.719157 24212 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:09.719798 24212 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:09.722361 24212 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:09.813892 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:09.832382 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:09.837649 24226 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:09.837891 24223 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:09.838327 24226 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.839488 24218 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:09.840762 24204 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:09.843245 24230 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.817108 24210 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:09.816556 24212 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:09.633558 24229 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:09.849336 24228 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:09.838807 24226 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:09.843247 24201 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:09.851065 24219 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:09.843801 24230 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:09.852854 24217 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:09.851244 24234 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:09.846529 24212 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:09.854997 24230 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:09.855157 24228 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:09.853641 24234 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:09.856285 24228 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:09.861531 24220 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:09.861614 24234 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:09.855015 24229 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:09.865221 22354 catalog_manager.cc:5697] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:09.863997 24226 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:09.869398 24232 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:09.873222 24202 consensus_queue.cc:1048] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:09.874078 23087 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:09.876268 24233 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:09.876818 24233 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:09.879516 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:09.879839 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:09.882448 23087 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:09.883366 24217 raft_consensus.cc:2804] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:09.883714 24217 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:09.884068 24217 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:09.863994 24212 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:09.869987 24232 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:09.894234 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:09.896472 23122 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:10:09.891430 24230 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:09.872453 24220 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:09.897559 24228 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:09.894243 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:09.900334 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:09.879076 24233 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:09.892004 24201 raft_consensus.cc:2804] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:09.900468 23123 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:10:09.904743 24220 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:09.907496 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:09.902078 24230 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:09.908360 22524 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 2.
I20260709 12:10:09.910331 24230 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:09.911816 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:09.912413 22453 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:10:09.912508 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:09.898895 24167 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:09.919327 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:09.920171 22525 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 1.
I20260709 12:10:09.922434 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:09.923327 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:09.911002 24201 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:09.923072 22455 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
W20260709 12:10:09.948335 23090 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.645s	user 0.030s	sys 0.037s
I20260709 12:10:09.933239 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:10.003974 23090 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.702s	user 0.035s	sys 0.038s
I20260709 12:10:09.924235 24236 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:10.013444 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:10.017091 22523 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 2.
I20260709 12:10:10.017844 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:09.938493 24237 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:09.941975 24230 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:09.981496 24238 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:09.972594 24229 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:09.972368 24234 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:10:09.942277 22386 debug-util.cc:398] Leaking SignalData structure 0x7b0800092020 after lost signal to thread 21269
I20260709 12:10:09.942173 24233 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:10.024923 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:10.024988 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:09.924511 24201 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.025658 24230 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:09.933527 24220 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:10.010456 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:10.022639 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:10.009578 24232 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:09.941027 24228 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:10.033317 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:10.065109 22455 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:10:09.921196 24167 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:10.056365 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:10.032614 22527 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 1.
I20260709 12:10:10.025993 24153 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:09.931914 24217 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:10.085978 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:10.033025 24234 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:10.074693 22386 debug-util.cc:398] Leaking SignalData structure 0x7b0800034b00 after lost signal to thread 22389
I20260709 12:10:10.083375 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:10.028451 24237 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:10.031874 24238 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:10.067785 22524 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 1.
I20260709 12:10:10.057484 24229 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:10.068169 24220 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:10.096415 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:10.064095 24233 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:10.095901 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:10.031433 24236 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:10.074918 24228 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:10.104650 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:10.105121 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:10.106966 24220 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:10.107962 24230 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:10.108124 24167 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:10.110087 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:10.102056 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:10.083642 24153 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:10.114504 22523 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:10:10.115271 22531 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 3.
I20260709 12:10:10.116991 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:10.117594 22530 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
I20260709 12:10:10.118057 24236 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:10.118423 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:10.119081 22524 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:10.119442 24242 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:10.119946 24232 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:10.120440 24232 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:10.120848 24217 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:10.122246 24234 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:10.122424 24232 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:10.100607 24202 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:10.123943 24202 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:10.127157 24202 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:10.119920 24242 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:10.128808 22526 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 1.
I20260709 12:10:10.141587 24242 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:10.144254 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:10.145182 22449 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 1.
I20260709 12:10:10.146428 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:10.147445 22386 debug-util.cc:398] Leaking SignalData structure 0x7b0800373cc0 after lost signal to thread 22481
W20260709 12:10:10.148603 22386 debug-util.cc:398] Leaking SignalData structure 0x7b08002dc0e0 after lost signal to thread 22556
I20260709 12:10:10.149735 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:10.152899 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:10.153184 24238 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:10.154898 24153 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:10.157090 24233 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:10.139766 24247 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:10.160509 24247 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:10.165691 24247 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:10.162617 24217 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:10.167418 24217 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:10.169486 24217 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:10.172163 24201 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:10.174304 24201 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:10.175482 22386 debug-util.cc:398] Leaking SignalData structure 0x7b08000ba840 after lost signal to thread 22630
W20260709 12:10:10.176666 22386 debug-util.cc:398] Leaking SignalData structure 0x7b08003111e0 after lost signal to thread 23149
I20260709 12:10:10.176739 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:10.178442 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:10.179051 22528 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 2.
I20260709 12:10:10.179818 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:10.180748 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:10.177143 22386 debug-util.cc:398] Leaking SignalData structure 0x7b0800116680 after lost signal to thread 24187
I20260709 12:10:10.181244 22528 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 2.
W20260709 12:10:10.183131 22386 debug-util.cc:398] Leaking SignalData structure 0x7b0800307360 after lost signal to thread 24196
W20260709 12:10:10.183432 22386 debug-util.cc:398] Leaking SignalData structure 0x7b08002cb460 after lost signal to thread 24197
I20260709 12:10:10.183282 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:10.183686 22386 debug-util.cc:398] Leaking SignalData structure 0x7b080026be80 after lost signal to thread 24198
I20260709 12:10:10.183557 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:10.183846 22531 raft_consensus.cc:2468] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 2.
W20260709 12:10:10.184074 22386 debug-util.cc:398] Leaking SignalData structure 0x7b080032c9c0 after lost signal to thread 24200
I20260709 12:10:10.184252 22528 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 4.
I20260709 12:10:10.181818 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:10.186304 24228 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:10.181900 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:10.188370 24229 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:10.191263 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:10.193866 22530 raft_consensus.cc:1275] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:10.194083 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:10.194634 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:10.194751 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:10.195887 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:10.195968 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:10.182461 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:10.182616 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:10.199296 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:10.197598 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:10.182273 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:10.207401 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:10.208003 23125 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:10:10.208998 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:10.209547 23123 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:10:10.213891 24230 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:10.214154 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:10.214768 23123 raft_consensus.cc:2468] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:10:10.214658 24230 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:10.206418 23121 raft_consensus.cc:2955] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:10.217589 24230 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:10.219777 24255 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:10.220409 24255 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:10.222438 24255 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:10.196362 24237 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:10.227805 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:10.229192 24235 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:10.229708 24235 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:10.231931 24235 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:10.233320 24255 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:10.233876 24255 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:10.234421 24219 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:10.234962 24219 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:10.235960 24255 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:10.236908 24219 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:10.239567 22570 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:10.244284 22421 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:10.247139 24210 raft_consensus.cc:2804] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:10.247509 24210 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:10.247864 24210 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.249524 24219 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:10.249997 24219 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:10.250371 24219 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:10.251674 22421 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:10.252738 24204 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:10.253178 24204 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:10.253612 24204 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.255154 24235 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:10.255918 24235 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:10.256835 24258 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:10.257362 24258 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:10.258150 24235 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:10.245954 22570 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
W20260709 12:10:10.259380 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 162059us
I20260709 12:10:10.265993 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:10.260006 22496 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:10.270931 22421 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:10.271497 22496 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:10.266814 23124 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:10:10.274523 23087 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:10.272171 22421 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:10.275744 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:10.277071 23122 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 3.
I20260709 12:10:10.281066 23087 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:10.281109 22496 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:10.284904 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:10.285641 23124 raft_consensus.cc:1240] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:10.289081 22496 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:10.291572 22496 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:10.292310 22496 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:10.293458 22496 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:10.294190 22496 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:10.290207 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:10.279825 24218 raft_consensus.cc:2804] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:10.301445 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:10.310562 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:10.304854 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:10.280012 24234 raft_consensus.cc:2804] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:10.311211 22603 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 2.
I20260709 12:10:10.287228 24254 raft_consensus.cc:2804] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:10.285944 24223 raft_consensus.cc:2804] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:10.312083 24167 raft_consensus.cc:2804] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:10.316907 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:10.317553 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:10.287603 24235 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:10.298310 24237 raft_consensus.cc:2749] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.315539 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:10.297906 24212 raft_consensus.cc:2804] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:10.322031 24246 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:10.322307 24215 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:10.309542 24214 raft_consensus.cc:2804] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:10.314630 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:10.325353 23122 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 1.
W20260709 12:10:10.319449 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 223794us
I20260709 12:10:10.301671 24216 raft_consensus.cc:2804] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:10.301802 24229 raft_consensus.cc:2804] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:10.299907 24247 raft_consensus.cc:2804] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:10.285430 24255 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:10.310590 24218 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:10.317281 24226 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:10.340292 23125 raft_consensus.cc:1240] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:10.320063 24223 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:10.312584 24234 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:10.328573 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:10.331985 24258 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:10.328032 24244 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:10.332612 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:10.333333 22602 raft_consensus.cc:1275] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:10.374398 22604 raft_consensus.cc:2468] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 2.
I20260709 12:10:10.330181 24229 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:10.335570 24247 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:10.320269 24167 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:10.327387 22495 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:10.323714 24254 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:10.347154 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:10.359294 24223 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.327548 24214 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:10.329319 24216 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:10:10.377722 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 62293.5us
I20260709 12:10:10.322067 24212 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:10.379999 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:10.380808 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 108671us
I20260709 12:10:10.379761 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:10.340855 24218 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.383590 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:10.384783 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 58682.1us
I20260709 12:10:10.347841 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:10.373364 24234 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:10.322685 24246 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:10.388787 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:10.325019 24235 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:10:10.388861 24243 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:10.389460 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:10.374907 24242 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.394465 22570 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:10.382064 24229 raft_consensus.cc:3060] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:10.384735 24247 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:10.386183 24167 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.358487 24226 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:10.322847 24215 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:10.340516 24255 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:10.390586 24204 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:10.409391 22495 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:10:10.492120 22451 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6334366811764682b0a491c130c68eed"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
mode: GRACEFUL
new_leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:44568
I20260709 12:10:10.493726 22451 raft_consensus.cc:606] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Received request to transfer leadership to TS 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:10.392575 24224 raft_consensus.cc:2804] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:10.492399 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 98015.8us
I20260709 12:10:10.397583 24214 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:10.396301 24216 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:10.387840 24254 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:10.465806 22602 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 3.
I20260709 12:10:10.388746 24248 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:10.433781 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:10.401036 24212 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.431938 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:10.394904 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:10.501307 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 91997.2us
I20260709 12:10:10.458843 24258 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:10.390830 24220 raft_consensus.cc:2804] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:10.504505 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:10.507535 22495 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:10.431469 24253 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:10.393213 24219 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:10.511391 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:10.393388 24244 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:10.500134 24243 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:10.513429 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:10.498636 24242 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:10.487778 24246 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:10.516474 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:10.503814 24224 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:10.516363 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:10.519748 23088 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:10.521670 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:10.514585 22600 raft_consensus.cc:2468] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:10:10.522259 22604 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:10:10.524111 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:10.512697 24233 raft_consensus.cc:2804] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:10.506675 24220 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:10.519683 24219 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:10.528029 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:10.524755 22604 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 3.
I20260709 12:10:10.517130 24243 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.526940 23088 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:10.529489 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:10.537135 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:10.510828 24258 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:10.539841 23088 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:10.539633 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:10.540727 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:10.526834 24246 raft_consensus.cc:2804] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:10.522730 24224 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:10.541517 23088 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:10.542346 23124 raft_consensus.cc:2393] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 3: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:10.531432 24233 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:10.542629 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:10:10.529382 24220 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.545610 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:10.548337 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:10.513137 24234 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:10.579579 24263 log.cc:927] Time spent T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 12:10:10.575325 22605 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:10:10.543552 24202 raft_consensus.cc:2804] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:10.546901 24233 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.542763 24246 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:10.587710 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:10.579743 24264 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:10.588498 24251 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:10.589282 24255 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:10.590447 22451 raft_consensus.cc:2393] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 3: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:10.574224 24201 raft_consensus.cc:2804] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:10.592440 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:10.594817 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:10.585866 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:10.542506 24267 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:10.587591 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:10.587778 24202 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:10.591459 24246 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.593593 24201 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:10.520046 24248 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:10.595798 24251 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:10:10.610642 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 69160.9us
I20260709 12:10:10.595078 24259 raft_consensus.cc:2804] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:10.620908 24256 raft_consensus.cc:2804] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:10.621201 24259 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:10.621369 24256 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:10.621670 24259 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.621253 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:10.621977 24256 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:10.623009 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:10.529446 24253 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:10.607823 24204 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:10.600652 24267 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:10.602736 24202 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.609483 24201 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:10.671412 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:10.699440 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:10.701076 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:10.649071 24235 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:10.698798 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:10.601858 24268 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:10.703845 22604 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 2.
I20260709 12:10:10.624648 24251 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.625955 24226 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:10.691851 24265 consensus_queue.cc:1048] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.165s
I20260709 12:10:10.696370 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:10.711128 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 212327us
I20260709 12:10:10.596881 24264 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:10.715066 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 103186us
I20260709 12:10:10.703439 24258 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:10.704687 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:10.719715 23088 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:10.620136 24224 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:10.722568 24244 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:10.715524 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:10.723520 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:10.727312 22454 raft_consensus.cc:2393] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 5: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:10.710779 24234 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:10.729305 22495 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:10.737978 23088 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:10.728432 24204 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:10.740675 23088 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:10.746541 24216 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:10.719375 24210 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:10.747648 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:10.730829 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:10.741186 22597 raft_consensus.cc:2393] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 5: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:10.737385 24238 raft_consensus.cc:2749] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.784415 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:10.792382 24266 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:10.784224 24270 raft_consensus.cc:2804] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:10.780247 24217 raft_consensus.cc:2804] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:10.705786 24268 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:10.796430 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:10.802139 24260 raft_consensus.cc:2804] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:10.802390 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:10.803188 22606 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 2.
I20260709 12:10:10.806052 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:10.806846 22606 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 1.
I20260709 12:10:10.814445 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:10.784598 24204 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:10.798944 24217 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:10.793049 24266 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:10.819556 24238 raft_consensus.cc:1064] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
I20260709 12:10:10.827806 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:10.830271 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:10.802779 24260 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:10.818357 24217 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:10.830971 23122 raft_consensus.cc:2393] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 3: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:10.801203 24270 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:10.840762 24218 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:10.842761 24218 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:10.844233 24247 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:10.844259 24201 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:10.845541 23125 raft_consensus.cc:1240] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:10.846510 24247 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:10.847232 24201 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:10.847359 24233 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:10.849951 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:10.823288 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:10.852178 24242 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:10.853965 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:10.853304 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:10.834030 24260 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.856036 24253 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:10.835170 24270 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:10.864974 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:10.856390 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:10.866402 24264 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:10.866765 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:10.850476 24224 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:10.870359 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:10.868142 22570 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:10.870549 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:10.873003 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:10.878252 22570 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:10.874559 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:10.875533 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:10.880256 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:10.880365 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:10.880877 22530 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.881594 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:10.882121 24242 raft_consensus.cc:2804] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:10.882465 24242 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:10.882843 24242 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:10.881527 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:10.882665 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:10.890646 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:10.893445 24244 raft_consensus.cc:2749] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.893599 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:10.894734 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:10.870661 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:10.900029 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:10.900487 24229 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:10.901208 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:10.902426 22524 raft_consensus.cc:1240] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:10.902905 24204 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:10.903368 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:10:10.898649 24223 consensus_meta.cc:287] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.508s	user 0.010s	sys 0.000s
I20260709 12:10:10.891517 24216 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:10.912199 22570 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:10.894906 24210 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:10.883525 24253 consensus_queue.cc:1059] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:10:10.914817 24255 raft_consensus.cc:2749] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.914966 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:10.915555 24255 raft_consensus.cc:3055] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:10.915872 24255 raft_consensus.cc:740] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:10.916213 24235 raft_consensus.cc:1064] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
I20260709 12:10:10.916801 24255 consensus_queue.cc:260] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:10.917953 24255 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.907184 24244 consensus_queue.cc:1059] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:10:10.931061 24244 raft_consensus.cc:3055] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:10.931397 24244 raft_consensus.cc:740] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:10.932248 24244 consensus_queue.cc:260] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:10.932502 24212 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:10.933714 22603 raft_consensus.cc:2393] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 4: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
W20260709 12:10:10.933900 22422 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.196.131:37785 timed out after 1.530s (SENT)
I20260709 12:10:10.934655 24212 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:10.934677 24220 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:10.926790 24246 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:10.913724 24223 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:10.926342 24259 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:10.929910 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:10.942549 24244 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.938582 24254 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:11.006908 23123 raft_consensus.cc:1240] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:11.013288 24167 consensus_meta.cc:287] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.507s	user 0.010s	sys 0.000s
I20260709 12:10:11.013797 24167 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:11.019421 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 85551.9us
I20260709 12:10:11.025166 24217 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:11.001958 24220 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:11.011608 24266 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:11.043504 24215 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:10.951850 24235 consensus_queue.cc:237] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:11.033360 24238 consensus_queue.cc:237] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:11.006141 24214 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:11.051302 24202 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:11.053256 24202 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:11.056388 23089 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:11.060940 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:11.062520 24215 raft_consensus.cc:2804] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:11.064767 24215 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:11.065153 24215 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:11.067960 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:11.066231 23089 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:11.072803 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:11.072711 24246 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:11.075603 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:11.072890 24153 consensus_queue.cc:1048] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:10:11.079552 24217 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:11.066299 24243 consensus_meta.cc:287] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.525s	user 0.011s	sys 0.000s
I20260709 12:10:11.080703 23089 leader_election.cc:304] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:11.075258 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:11.071650 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:11.083062 24254 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:11.083541 24223 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:11.084542 23089 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:11.075225 24251 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:11.073874 24214 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:11.080339 24202 raft_consensus.cc:2804] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:11.072726 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:11.061766 24268 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:11.086207 23089 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:11.063100 24270 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:11.074640 24259 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:11.085755 24217 raft_consensus.cc:2749] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:11.086901 24153 raft_consensus.cc:2804] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:11.088735 22570 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:11.091178 24223 raft_consensus.cc:2804] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:11.093878 24223 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:11.094261 24223 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:11.094658 22570 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:11.084586 24256 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:11.086325 24167 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:11.092900 24153 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:11.098058 24153 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:11.095471 24268 raft_consensus.cc:2749] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:11.089017 23089 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:11.073760 24260 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:11.089547 24202 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:11.109551 24217 raft_consensus.cc:2749] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:11.098758 24256 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:11.111435 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:11.113739 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:11.114472 22603 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 1.
I20260709 12:10:11.116675 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:11.119102 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:11.130249 24251 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:11.084180 24243 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:11.133337 23122 raft_consensus.cc:1240] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:11.104537 24255 raft_consensus.cc:2749] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:11.114526 24202 raft_consensus.cc:3060] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:11.142338 22523 raft_consensus.cc:1240] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:11.142861 24270 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:11.148492 22528 raft_consensus.cc:1240] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:11.138757 24223 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:11.158180 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:11.159454 24229 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:11.163808 24243 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:11.165295 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:11.165522 22597 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:10:11.168011 24153 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:11.168264 24223 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:11.168344 24215 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:11.169269 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:11.169466 23116 raft_consensus.cc:1240] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:11.169945 23089 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:11.170087 24153 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:11.155501 24242 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:11.171221 24260 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:11.174006 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:11.174305 24242 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:11.175081 22598 raft_consensus.cc:2393] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 2: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:11.176693 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:11.177064 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:11.177737 22600 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:10:11.172858 24153 raft_consensus.cc:2804] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:11.178521 24153 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:11.179042 24153 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:11.182842 22600 raft_consensus.cc:2955] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:11.191054 24202 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:11.193161 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:11.194077 24202 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:11.195911 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:11.196636 22604 raft_consensus.cc:3060] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:11.197992 23089 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:11.199345 24260 raft_consensus.cc:2749] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:11.231335 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:11.257941 22604 raft_consensus.cc:2468] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 3.
I20260709 12:10:11.259610 23089 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:11.266091 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:11.262821 24251 raft_consensus.cc:2804] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:11.272547 24251 raft_consensus.cc:697] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 3 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:11.273535 24251 consensus_queue.cc:237] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:11.263929 24215 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:11.280210 24153 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:11.283257 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:11.283850 22603 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:11.285802 22421 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.005s	sys 0.008s
W20260709 12:10:11.286126 22421 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.005s	sys 0.008s
I20260709 12:10:11.290428 22603 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 3.
I20260709 12:10:11.291786 23089 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:11.292604 24270 raft_consensus.cc:2804] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:11.293071 24270 raft_consensus.cc:697] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 3 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:11.293890 24270 consensus_queue.cc:237] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:11.308653 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:11.309321 22454 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:11.310530 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:11.311769 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:11.312443 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:11.316490 22454 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 3.
I20260709 12:10:11.318686 22530 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:10:11.319845 22523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1226) took 1019 ms. Trace:
I20260709 12:10:11.320200 22523 rpcz_store.cc:276] 0709 12:10:10.300228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.300403 (+   175us) service_pool.cc:224] Handling call
0709 12:10:10.300653 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:11.142755 (+842102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.319605 (+176850us) spinlock_profiling.cc:243] Waited 841 ms on lock 0x7b5400082ad4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:11.319790 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1935290240}
I20260709 12:10:11.322192 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:11.322902 22449 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:11.330557 22449 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 3.
I20260709 12:10:11.335140 22457 raft_consensus.cc:1240] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:11.337824 24242 consensus_queue.cc:1059] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:11.340498 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:10:11.340898 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:11.341418 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:11.341578 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:11.342614 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:11.343381 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:11.344378 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:11.344671 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:11.345290 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:11.345892 22449 raft_consensus.cc:1240] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:11.347054 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:10:11.347281 24282 log.cc:927] Time spent T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:10:11.347672 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:11.348790 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:11.349428 24153 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317)
I20260709 12:10:11.349947 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:11.351074 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:11.351771 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:11.338941 24242 raft_consensus.cc:3055] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:11.355034 24242 raft_consensus.cc:740] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:11.359001 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:11.355968 24242 consensus_queue.cc:260] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:11.360690 24267 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:11.345140 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:11.374886 22451 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 1.
I20260709 12:10:11.345239 22454 raft_consensus.cc:2468] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 2.
I20260709 12:10:11.361541 24242 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:11.479625 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 59644.9us
I20260709 12:10:11.480805 22497 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:11.482434 22497 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:11.417356 24210 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:10:11.557361 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 75030us
I20260709 12:10:11.558343 22497 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:11.487325 24229 raft_consensus.cc:2749] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:11.712915 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 154653us
I20260709 12:10:11.714814 22497 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:11.787671 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 72956.1us
I20260709 12:10:11.788960 22497 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:11.794049 24243 raft_consensus.cc:2804] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:10:12.339726 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 550829us
I20260709 12:10:12.340811 22497 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:12.408485 24286 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:12.411226 24286 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:12.411798 24286 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:12.410212 23122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 605) took 1543 ms. Trace:
I20260709 12:10:12.415458 23122 rpcz_store.cc:276] 0709 12:10:10.866488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.869300 (+  2812us) service_pool.cc:224] Handling call
0709 12:10:10.869568 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:11.133756 (+264188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:12.409933 (+1276177us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b54000a00d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:12.410125 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":606191488}
W20260709 12:10:12.410575 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 69900.3us
I20260709 12:10:12.419557 22497 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:12.409705 24287 raft_consensus.cc:2749] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:12.424266 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:12.436954 22526 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
W20260709 12:10:12.437501 22526 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56942 (request call id 1241) took 1550 ms (client timeout 1932 ms). Trace:
W20260709 12:10:12.437903 22526 rpcz_store.cc:269] 0709 12:10:10.886745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.908877 (+ 22132us) service_pool.cc:224] Handling call
0709 12:10:12.437417 (+1528540us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:12.435386 22421 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.017s	user 0.071s	sys 0.106s
W20260709 12:10:12.440637 22421 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.022s	user 0.072s	sys 0.106s
W20260709 12:10:12.440961 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 1.0233e+06us
I20260709 12:10:12.441854 24286 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:12.431603 24289 raft_consensus.cc:2804] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:12.459093 24286 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:12.459311 24289 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:12.459931 24289 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:12.473942 23123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 403) took 1963 ms. Trace:
I20260709 12:10:12.478425 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:12.479163 22456 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:12.474742 23123 rpcz_store.cc:276] 0709 12:10:10.507350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.507471 (+   121us) service_pool.cc:224] Handling call
0709 12:10:10.515112 (+  7641us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:11.015451 (+500339us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:12.470748 (+1455297us) spinlock_profiling.cc:243] Waited 492 ms on lock 0x7b54005f2654. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:12.470960 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1130624768}
I20260709 12:10:12.493412 22456 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 2.
I20260709 12:10:12.494084 22456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 343) took 1157 ms. Trace:
I20260709 12:10:12.453197 24293 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:12.494669 22456 rpcz_store.cc:276] 0709 12:10:11.336205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.478101 (+1141896us) service_pool.cc:224] Handling call
0709 12:10:12.494017 (+ 15916us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:12.520020 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 63716.5us
I20260709 12:10:12.521896 22497 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:12.523097 24295 raft_consensus.cc:2804] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:12.523671 24295 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:12.524111 24295 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:12.520905 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 71846.5us
I20260709 12:10:12.510113 24289 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:12.540515 24289 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:12.552026 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:12.556833 22497 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:12.559049 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:12.559204 22606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43070 (request call id 248) took 1743 ms (client timeout 2110 ms). Trace:
I20260709 12:10:12.559688 22454 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:10:12.546337 24233 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:12.543807 24248 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:12.544093 24293 raft_consensus.cc:2749] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:12.549007 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:12.564855 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.556772 22456 raft_consensus.cc:1240] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:12.565259 24295 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:12.557248 24226 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:12.566642 24226 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:12.568738 24226 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:12.569235 24226 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:12.569649 24226 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:12.571923 24226 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:12.562446 24290 raft_consensus.cc:2804] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:12.572410 24290 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:12.572770 24290 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:12.574548 22599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2026) took 2224 ms. Trace:
I20260709 12:10:12.563041 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:12.563280 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:12.574951 22599 rpcz_store.cc:276] 0709 12:10:10.349720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.432517 (+ 82797us) service_pool.cc:224] Handling call
0709 12:10:10.432792 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:10.671024 (+238232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:10.671777 (+   753us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:10.675310 (+  3533us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:10.678359 (+  3049us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:12.574291 (+1895932us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b54002df354. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:12.574340 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:12.574466 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":490872064}
I20260709 12:10:12.562646 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:12.563719 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:12.559643 22606 rpcz_store.cc:269] 0709 12:10:10.816282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.920961 (+104679us) service_pool.cc:224] Handling call
0709 12:10:12.551847 (+1630886us) spinlock_profiling.cc:243] Waited 4.65 ms on lock 0x7b58001b3098. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf8f40a0 00007f9ccf8f3984 00007f9cc8e6e6d4 00007f9cc8e6e662
0709 12:10:12.559121 (+  7274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10689408}
I20260709 12:10:12.567425 24295 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:12.562667 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:12.577348 22454 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 1.
I20260709 12:10:12.558207 22421 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:12.577975 22457 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 1.
I20260709 12:10:12.579632 22451 raft_consensus.cc:1240] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:12.582633 24297 raft_consensus.cc:2749] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:12.582931 22454 raft_consensus.cc:1240] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:12.587231 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:12.587891 22448 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 1.
I20260709 12:10:12.581875 22421 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:12.591499 24297 raft_consensus.cc:2749] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:12.592823 22421 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:12.593955 24290 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:12.594929 24297 raft_consensus.cc:2749] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:11.563038 24210 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:12.601225 22421 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:12.601626 24210 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:12.602208 24290 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:12.602774 24290 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:12.603302 24290 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:11.558584 24167 raft_consensus.cc:2749] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:12.604496 24167 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:12.604993 24167 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:12.607204 22531 raft_consensus.cc:1240] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:12.608176 24167 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:12.608764 24167 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:12.609318 24167 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:12.611902 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:12.612174 24167 leader_election.cc:290] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:12.612939 24297 raft_consensus.cc:2749] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:12.614169 22421 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:12.616226 24290 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:12.616748 24210 raft_consensus.cc:2749] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:12.617854 22421 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:12.619287 24210 raft_consensus.cc:2749] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:12.625125 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:12.625721 22448 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:10:12.627514 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:12.630901 22448 raft_consensus.cc:1240] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:12.632323 22448 raft_consensus.cc:1240] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:12.632560 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:12.633028 22602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43070 (request call id 232) took 2279 ms (client timeout 1879 ms). Trace:
W20260709 12:10:12.633427 22602 rpcz_store.cc:269] 0709 12:10:10.353995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.379544 (+ 25549us) service_pool.cc:224] Handling call
0709 12:10:12.632849 (+2253305us) spinlock_profiling.cc:243] Waited 65.5 ms on lock 0x7b5400448754. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:12.632942 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":150548864}
I20260709 12:10:12.634073 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:12.634611 22452 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 1.
I20260709 12:10:12.634883 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:12.635622 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:12.635974 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:12.637266 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:12.641124 22601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2023) took 2292 ms. Trace:
I20260709 12:10:12.641499 22601 rpcz_store.cc:276] 0709 12:10:10.348852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.358506 (+  9654us) service_pool.cc:224] Handling call
0709 12:10:10.384157 (+ 25651us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:10.505423 (+121266us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:10.505453 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:10.505489 (+    36us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:10.505514 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:12.640772 (+2135258us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b54000eae54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:12.640825 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:12.640957 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":278500224}
I20260709 12:10:12.644321 22604 raft_consensus.cc:1275] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:10:12.647356 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:12.648178 22452 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:10:12.649614 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:12.651576 24298 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:12.651684 24236 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:12.661515 24236 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:12.663650 24236 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:12.652276 24287 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:12.665481 22569 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:12.652334 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:12.653131 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.666267 22452 raft_consensus.cc:2468] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:10:12.653642 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:12.667187 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:12.667503 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:12.668202 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:12.668313 22569 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:12.653131 24295 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:12.668592 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:12.669073 24295 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:12.669571 22452 raft_consensus.cc:1275] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:12.671105 24295 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:12.671592 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.673861 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:12.674425 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:12.654922 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:12.675206 22448 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:12.658195 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:12.658844 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:12.665220 24287 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:10:12.671180 24298 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:12.656603 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:12.679567 24287 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:12.679512 24298 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:12.680415 24248 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:12.680861 24248 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:12.681272 24248 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:12.681502 22453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 341) took 1345 ms. Trace:
I20260709 12:10:12.681874 22453 rpcz_store.cc:276] 0709 12:10:11.335652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.680777 (+1345125us) service_pool.cc:224] Handling call
0709 12:10:12.681059 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:12.681214 (+   155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:12.681238 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:12.681279 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:12.681309 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:12.681359 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:12.681450 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:12.683184 24226 raft_consensus.cc:2804] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:12.683593 24226 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:12.683955 24226 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:12.678865 24237 consensus_queue.cc:1048] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:10:11.953120 24243 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:12.689095 24243 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:12.692173 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:12.692759 24242 consensus_meta.cc:287] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 1.276s	user 0.011s	sys 0.004s
I20260709 12:10:12.693828 22569 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:12.694865 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:12.695511 22453 raft_consensus.cc:1275] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:10:12.698150 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:12.698699 22605 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:12.699357 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:12.699896 22603 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:10:12.702306 22495 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:12.702623 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:12.703110 24167 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:12.704805 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:12.705319 22604 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:12.707219 24242 raft_consensus.cc:2804] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:12.707422 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:12.707675 24242 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:12.707828 22531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1237) took 1829 ms. Trace:
I20260709 12:10:12.708211 22531 rpcz_store.cc:276] 0709 12:10:10.878584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.915909 (+ 37325us) service_pool.cc:224] Handling call
0709 12:10:12.400687 (+1484778us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:12.607656 (+206969us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:12.706294 (+ 98638us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b5400400bd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:12.707639 (+  1345us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b5400400bd0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:12.707757 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3888135808}
I20260709 12:10:12.708724 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:12.717464 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:10:12.656281 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 1.30155e+06us
I20260709 12:10:12.722818 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:12.724939 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:12.726085 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:12.727849 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:12.729092 24167 raft_consensus.cc:2749] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:12.707371 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:12.738076 22354 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55962 (request call id 338) took 3233 ms. Trace:
I20260709 12:10:12.712073 22495 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:12.713815 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:12.739686 22599 raft_consensus.cc:1240] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:12.739711 24229 raft_consensus.cc:2749] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:12.740785 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:10:12.741037 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.740860 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:12.741678 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:12.741850 22599 raft_consensus.cc:2410] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:12.714293 22598 raft_consensus.cc:1240] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:12.715484 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:12.743875 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:12.716223 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:12.716476 22606 raft_consensus.cc:1240] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:12.745035 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:12.745751 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:12.746129 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:12.746923 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:12.747255 22457 raft_consensus.cc:2393] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 3: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:12.748013 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:12.748557 22606 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 2.
I20260709 12:10:12.748886 22351 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55978 (request call id 329) took 2534 ms. Trace:
I20260709 12:10:12.749882 22601 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:12.708098 24242 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:12.738487 22354 rpcz_store.cc:276] 0709 12:10:09.504766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.504907 (+   141us) service_pool.cc:224] Handling call
0709 12:10:12.737996 (+3233089us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:09.886962 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:09.887616 (+   654us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:09.887650 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:10:09.887667 (+    17us) tablet.cc:662] Decoding operations
0709 12:10:09.888001 (+   334us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:09.888075 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:09.888107 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:10:09.888303 (+   196us) tablet.cc:701] Row locks acquired
0709 12:10:09.888321 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:10:09.888458 (+   137us) write_op.cc:270] Start()
0709 12:10:09.888563 (+   105us) write_op.cc:276] Timestamp: P: 1783599009888415 usec, L: 0
0709 12:10:09.888586 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:10:09.889262 (+   676us) log.cc:844] Serialized 603 byte log entry
0709 12:10:10.241963 (+352701us) op_driver.cc:464] REPLICATION: finished
0709 12:10:10.314267 (+ 72304us) write_op.cc:301] APPLY: starting
0709 12:10:10.319958 (+  5691us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:10.326196 (+  6238us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:10.338574 (+ 12378us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:10.379663 (+ 41089us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:10.390190 (+ 10527us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:10:10.395596 (+  5406us) write_op.cc:312] APPLY: finished
0709 12:10:10.403695 (+  8099us) log.cc:844] Serialized 23 byte log entry
0709 12:10:10.403913 (+   218us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:10.404019 (+   106us) write_op.cc:454] Released schema lock
0709 12:10:10.404074 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:10.404515 (+   441us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:10.404538 (+    23us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":40613,"apply.run_cpu_time_us":2271,"apply.run_wall_time_us":91584,"num_ops":1,"prepare.queue_time_us":18624,"prepare.run_cpu_time_us":21957,"prepare.run_wall_time_us":30847,"raft.queue_time_us":132023,"raft.run_cpu_time_us":13925,"raft.run_wall_time_us":45006,"replication_time_us":353208,"spinlock_wait_cycles":364928,"thread_start_us":213664,"threads_started":4,"wal-append.queue_time_us":129483,"wal-append.run_cpu_time_us":9917,"wal-append.run_wall_time_us":1383817}]]}
I20260709 12:10:12.749238 22351 rpcz_store.cc:276] 0709 12:10:10.214309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.214454 (+   145us) service_pool.cc:224] Handling call
0709 12:10:10.277294 (+ 62840us) spinlock_profiling.cc:243] Waited 44.2 ms on lock 0x7b54002eff90. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc780a0b2 00007f9cd0783759 00007f9cd071ba76 00007f9cd06ecd58 00007f9cd07eb04e 00007f9ccecac2a4 00007f9ccecac232 00007f9ccecac161 00007f9ccecac0dc
0709 12:10:10.284618 (+  7324us) spinlock_profiling.cc:243] Waited 6.34 ms on lock 0x7b5400198a54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca898090 00007f9cca936f3a 00007f9cd06ece9c 00007f9cd07eb04e 00007f9ccecac2a4 00007f9ccecac232 00007f9ccecac161 00007f9ccecac0dc 00007f9ccecab392 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:12.748824 (+2464206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1448744,"reported_tablets":3,"spinlock_wait_cycles":116226304}
I20260709 12:10:12.757403 22603 raft_consensus.cc:1240] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:12.758435 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:12.759065 22603 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 2.
I20260709 12:10:12.741010 22495 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:12.764900 22597 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45562 (request call id 1637) took 1981 ms (client timeout 2126 ms). Trace:
W20260709 12:10:12.766003 22597 rpcz_store.cc:269] 0709 12:10:10.783299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.905809 (+122510us) service_pool.cc:224] Handling call
0709 12:10:12.764732 (+1858923us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b54003aded4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:12.764842 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":374881024}
I20260709 12:10:12.766950 24270 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:12.749364 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:12.767776 24270 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:12.770810 24270 leader_election.cc:290] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:12.716858 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:12.771502 22353 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55980 (request call id 370) took 2446 ms. Trace:
I20260709 12:10:12.771982 22353 rpcz_store.cc:276] 0709 12:10:10.324678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.324819 (+   141us) service_pool.cc:224] Handling call
0709 12:10:12.771428 (+2446609us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1446526,"reported_tablets":3}
I20260709 12:10:12.774547 24242 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:12.774914 24291 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:12.776609 24242 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:12.778133 24210 consensus_queue.cc:1059] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:12.780028 24296 raft_consensus.cc:3055] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:12.780390 24296 raft_consensus.cc:740] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:12.781177 24296 consensus_queue.cc:260] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:12.782413 24296 raft_consensus.cc:3060] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:12.784355 24223 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:12.784910 24223 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:12.785267 24294 consensus_queue.cc:1059] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:12.786255 24294 raft_consensus.cc:3055] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:12.786562 24294 raft_consensus.cc:740] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:12.786593 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:12.786933 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:12.787109 24153 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:12.787689 23123 raft_consensus.cc:2393] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 2: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:12.787418 24294 consensus_queue.cc:260] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:12.787626 24153 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:12.788592 24294 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:12.788718 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:12.789304 23116 raft_consensus.cc:3060] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:12.790372 24153 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:12.791299 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:12.791759 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:12.792368 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:12.793031 23122 raft_consensus.cc:2393] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 2: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:12.787935 23124 raft_consensus.cc:1240] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:12.793191 23117 raft_consensus.cc:1275] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 2 LEARNER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:10:12.793682 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:12.794054 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:12.795028 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:12.795318 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:12.796038 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:12.796350 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:12.796686 23124 raft_consensus.cc:2393] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 2: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:12.797348 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:12.797446 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:12.798020 23124 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 1.
I20260709 12:10:12.799317 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:12.799431 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:12.800028 22602 raft_consensus.cc:2393] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 2: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:12.800088 23118 raft_consensus.cc:2393] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 3: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:12.801151 23117 raft_consensus.cc:1240] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:12.801604 23118 raft_consensus.cc:1275] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 3 LEARNER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:12.802359 23117 raft_consensus.cc:1240] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:12.802708 23118 raft_consensus.cc:1240] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:12.787433 23125 raft_consensus.cc:2393] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 4: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:12.804263 22570 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:12.806102 23116 raft_consensus.cc:2468] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:10:12.795361 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:10:12.806519 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 86728.4us
I20260709 12:10:12.806995 23123 raft_consensus.cc:2393] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 3: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:12.807293 23116 raft_consensus.cc:1240] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:12.808312 23118 raft_consensus.cc:1240] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:12.808483 24288 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:12.803095 22355 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48412 (request call id 237) took 1680 ms. Trace:
I20260709 12:10:12.803299 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:12.786931 24223 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:12.794701 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:12.810086 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:12.810336 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:12.798777 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:12.804008 23120 raft_consensus.cc:1240] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:12.811414 23119 raft_consensus.cc:2393] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 3: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:12.809159 22355 rpcz_store.cc:276] 0709 12:10:11.122591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.283394 (+160803us) service_pool.cc:224] Handling call
0709 12:10:12.803007 (+1519613us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1483482,"reported_tablets":2}
I20260709 12:10:12.810786 22527 raft_consensus.cc:1240] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:12.811971 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:12.808998 24288 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:12.812537 22532 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:12.813829 22529 raft_consensus.cc:1275] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:12.814136 24288 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:12.815055 22523 raft_consensus.cc:1240] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:12.815287 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:12.810843 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:12.816151 22526 raft_consensus.cc:2393] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 3: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:12.821218 22532 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:12.807005 23125 raft_consensus.cc:1240] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 3 LEADER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:12.742657 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:12.823722 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:12.848553 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:12.824591 22601 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:10:12.824887 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:12.825089 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:12.825600 22531 raft_consensus.cc:1240] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:12.825547 22605 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 4.
I20260709 12:10:12.826339 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:12.851951 22528 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:12.825929 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:12.859679 24285 consensus_queue.cc:1059] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:12.855973 24266 consensus_queue.cc:1059] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:10:12.860494 22523 raft_consensus.cc:1240] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:12.860872 24266 raft_consensus.cc:3055] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:12.860805 24285 consensus_queue.cc:1059] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:12.861296 24266 raft_consensus.cc:740] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:12.861552 24285 consensus_queue.cc:1243] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer 8701cd5186a949538d8efafb5f987270 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:10:12.862226 24285 raft_consensus.cc:3055] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:12.862382 24210 raft_consensus.cc:3055] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:12.862587 24285 raft_consensus.cc:740] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:12.862847 24210 raft_consensus.cc:740] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:12.856063 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:12.863600 24285 consensus_queue.cc:260] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:12.863811 24210 consensus_queue.cc:260] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:12.863600 22530 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:12.864840 24285 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:12.865003 24210 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:12.835244 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:12.867789 22526 raft_consensus.cc:1240] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:12.869268 22526 raft_consensus.cc:1240] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:12.869879 22531 raft_consensus.cc:1240] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:12.870373 22526 raft_consensus.cc:1240] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:12.870965 22531 raft_consensus.cc:1240] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:12.871532 22599 raft_consensus.cc:2410] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:12.872022 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:12.836349 24226 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:12.876513 24226 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:12.838033 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:12.839648 24243 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:12.877902 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:12.869232 22528 raft_consensus.cc:2468] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:10:12.878640 24243 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:12.879233 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:12.879619 22524 raft_consensus.cc:1240] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:12.841616 22525 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
I20260709 12:10:12.844044 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:12.880551 22597 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 2.
I20260709 12:10:12.881536 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:12.882133 22597 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 2.
I20260709 12:10:12.844736 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:12.883278 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:12.883560 22598 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 2.
I20260709 12:10:12.883944 22600 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 2.
I20260709 12:10:12.884758 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:12.885406 22598 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 1.
W20260709 12:10:12.886279 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.886436 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:12.887215 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:12.888396 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:12.889671 22598 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 1.
I20260709 12:10:12.882928 22355 catalog_manager.cc:5697] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 2 to 3, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 3 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:12.837304 24248 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:12.891676 22603 raft_consensus.cc:2393] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 3: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:12.892012 22529 raft_consensus.cc:1240] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:10:12.891917 22355 catalog_manager.cc:5697] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 2 to 3, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 3 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:10:12.851377 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 47176.8us
I20260709 12:10:12.892838 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:12.895179 24248 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:12.895646 22570 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:12.896087 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:12.896742 22598 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 2.
I20260709 12:10:12.852072 22569 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:12.897643 24242 raft_consensus.cc:2749] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:12.855892 24167 consensus_queue.cc:1059] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:12.856832 24238 consensus_queue.cc:1059] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:12.900740 24238 raft_consensus.cc:3055] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:12.901193 24238 raft_consensus.cc:740] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:12.902153 24238 consensus_queue.cc:260] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:12.903184 24226 consensus_queue.cc:1059] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:12.904572 24226 raft_consensus.cc:2804] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:12.905095 24226 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:12.905586 24229 raft_consensus.cc:3055] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:12.905786 24248 raft_consensus.cc:3055] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:12.906014 24229 raft_consensus.cc:740] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:12.885140 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:12.861580 22523 raft_consensus.cc:1240] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:12.871337 22497 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:12.872093 22496 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:12.837483 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:12.872500 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:12.862244 24266 consensus_queue.cc:260] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:12.840884 24291 raft_consensus.cc:2749] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:12.893543 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:12.912113 22497 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:12.925714 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:12.926227 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:12.926410 22497 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:12.893811 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:12.847517 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:12.897256 22570 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:10:12.855877 24232 raft_consensus.cc:2749] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:12.898408 24242 consensus_queue.cc:1059] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:12.832217 22604 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:10:12.877947 22530 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
W20260709 12:10:12.845592 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 104656us
W20260709 12:10:12.922791 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 50781.2us
W20260709 12:10:13.030232 22553 debug-util.cc:398] Leaking SignalData structure 0x7b0800167640 after lost signal to thread 21269
I20260709 12:10:13.032739 22495 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:13.033275 22553 debug-util.cc:398] Leaking SignalData structure 0x7b0800167d20 after lost signal to thread 22389
I20260709 12:10:13.033126 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:13.033496 22497 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:13.033839 22495 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:13.034296 24290 raft_consensus.cc:2749] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:10:13.034441 22553 debug-util.cc:398] Leaking SignalData structure 0x7b08003c60c0 after lost signal to thread 22481
I20260709 12:10:13.034567 24250 raft_consensus.cc:2804] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:13.034775 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:13.035002 24290 raft_consensus.cc:2749] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:13.035372 24250 raft_consensus.cc:697] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:13.035579 22495 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:13.036309 22606 raft_consensus.cc:2393] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 3: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:13.036799 24250 consensus_queue.cc:237] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:13.037274 24298 raft_consensus.cc:2749] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:10:12.943177 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 279889us
I20260709 12:10:12.906915 24229 consensus_queue.cc:260] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:13.038498 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:12.906388 24248 raft_consensus.cc:740] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:13.039209 22606 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:10:12.960706 24238 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:13.040226 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.041057 23087 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:13.041841 24270 raft_consensus.cc:2749] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:13.041826 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:13.043200 22553 debug-util.cc:398] Leaking SignalData structure 0x7b08003c6900 after lost signal to thread 22556
I20260709 12:10:12.944948 24167 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:12.905613 24226 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:13.044662 24167 raft_consensus.cc:697] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:12.925397 24243 raft_consensus.cc:2749] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:13.043569 24242 raft_consensus.cc:2804] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:13.045780 24242 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:13.045675 24167 consensus_queue.cc:237] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:13.046458 24242 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:13.044857 22553 debug-util.cc:398] Leaking SignalData structure 0x7b08002053c0 after lost signal to thread 22630
W20260709 12:10:13.047739 22553 debug-util.cc:398] Leaking SignalData structure 0x7b080031fbc0 after lost signal to thread 23149
I20260709 12:10:12.941992 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:12.964205 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:13.039888 24248 consensus_queue.cc:260] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:13.002585 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 150583us
I20260709 12:10:12.946956 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:10:13.043447 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 146245us
I20260709 12:10:13.049713 22605 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:13.049909 22569 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:12.926435 22602 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:10:12.963600 22527 raft_consensus.cc:1240] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:12.963600 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 215427us
I20260709 12:10:12.977092 23125 raft_consensus.cc:1240] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:13.043735 23087 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:13.052503 22496 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:13.056660 23087 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:13.057067 22605 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:10:13.058450 22497 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:13.059787 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:12.952415 22600 raft_consensus.cc:2393] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 2: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:12.924747 24288 raft_consensus.cc:2804] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:13.048170 22553 debug-util.cc:398] Leaking SignalData structure 0x7b0800387200 after lost signal to thread 24212
I20260709 12:10:12.982060 23117 raft_consensus.cc:1240] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 3 LEADER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:13.065304 24248 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:13.064604 22495 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:13.066946 22496 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:13.067531 22602 raft_consensus.cc:1240] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:12.944888 24228 raft_consensus.cc:2804] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:13.074277 22602 raft_consensus.cc:1240] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 1. Current term is 2. Ops: []
W20260709 12:10:13.069473 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.072175 24236 raft_consensus.cc:2804] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:13.068240 24270 raft_consensus.cc:2804] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:13.075309 24270 raft_consensus.cc:697] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 3 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:13.075214 24296 consensus_queue.cc:1059] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:13.076040 24296 consensus_queue.cc:1243] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer 8701cd5186a949538d8efafb5f987270 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:10:13.076484 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:13.076333 24270 consensus_queue.cc:237] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:13.065070 23087 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:13.074033 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:12.963536 24266 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:13.080855 24293 raft_consensus.cc:2749] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:13.081292 22601 raft_consensus.cc:1240] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:13.069864 24288 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:13.082027 24288 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.083248 22601 raft_consensus.cc:1240] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:13.076761 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:13.069657 24295 consensus_queue.cc:1048] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:10:13.083907 24236 raft_consensus.cc:697] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:13.079598 24301 raft_consensus.cc:3055] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:13.085686 24301 raft_consensus.cc:740] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:13.083920 22606 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 2.
I20260709 12:10:13.079681 24233 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.087005 24286 consensus_queue.cc:1048] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:13.087224 22597 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:10:13.088339 22597 raft_consensus.cc:1240] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:13.057617 24210 consensus_queue.cc:1059] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:10:13.068337 24287 consensus_queue.cc:1059] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:10:13.093106 22495 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:13.069730 24153 consensus_queue.cc:1059] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
W20260709 12:10:13.071290 22553 debug-util.cc:398] Leaking SignalData structure 0x7b08002182e0 after lost signal to thread 24216
I20260709 12:10:13.062278 24237 raft_consensus.cc:2749] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:13.071396 24232 raft_consensus.cc:2804] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:13.084882 24236 consensus_queue.cc:237] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:13.061926 24223 raft_consensus.cc:2749] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:13.102370 22496 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:13.095376 24306 consensus_queue.cc:1059] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:13.083191 24228 raft_consensus.cc:697] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:13.076488 24296 raft_consensus.cc:3055] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:13.105683 24296 raft_consensus.cc:740] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:13.105414 24228 consensus_queue.cc:237] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:13.093698 24286 consensus_queue.cc:1059] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:10:13.102372 22495 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:13.106959 24296 consensus_queue.cc:260] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:13.086582 24301 consensus_queue.cc:260] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:12.930670 22599 raft_consensus.cc:2468] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 2.
W20260709 12:10:13.104130 22553 debug-util.cc:398] Leaking SignalData structure 0x7b0800300820 after lost signal to thread 24219
I20260709 12:10:13.127012 22495 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:13.091591 24260 raft_consensus.cc:2749] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:13.116726 22603 raft_consensus.cc:1240] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:13.118140 24243 consensus_queue.cc:1059] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
W20260709 12:10:13.149441 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 89887.6us
W20260709 12:10:13.154793 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 52493.4us
I20260709 12:10:13.155602 22496 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:13.155607 22495 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:13.157524 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 95831.6us
I20260709 12:10:13.115417 24294 raft_consensus.cc:3055] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:13.111572 24290 raft_consensus.cc:3055] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:10:13.150390 22553 debug-util.cc:398] Leaking SignalData structure 0x7b080029a760 after lost signal to thread 24225
I20260709 12:10:13.102042 24232 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:13.111846 24293 raft_consensus.cc:2749] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:13.145761 24295 raft_consensus.cc:2749] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:13.171519 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 76154.1us
I20260709 12:10:13.111912 24291 consensus_queue.cc:1059] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 12:10:13.185287 23087 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:10:13.188401 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 138548us
I20260709 12:10:13.144186 24285 consensus_queue.cc:1059] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:10:13.160730 24298 raft_consensus.cc:2804] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:13.190827 23087 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:13.170324 24232 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:13.185043 22553 debug-util.cc:398] Leaking SignalData structure 0x7b0800056940 after lost signal to thread 24244
I20260709 12:10:13.182482 24286 raft_consensus.cc:2749] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:13.182567 24167 raft_consensus.cc:2749] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:13.211174 24221 raft_consensus.cc:2804] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:13.163093 24294 raft_consensus.cc:740] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
W20260709 12:10:13.213460 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.187772 24296 raft_consensus.cc:3060] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.164496 24290 raft_consensus.cc:740] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:13.187417 24301 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:13.234313 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 43839.4us
I20260709 12:10:13.216125 22570 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:13.181445 24236 raft_consensus.cc:2749] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:13.161722 24312 consensus_queue.cc:1059] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:10:13.235045 22422 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
W20260709 12:10:13.223796 22553 debug-util.cc:398] Leaking SignalData structure 0x7b08002f93c0 after lost signal to thread 24245
I20260709 12:10:13.213390 24297 consensus_queue.cc:1059] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:10:13.214602 24291 raft_consensus.cc:3055] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:10:13.283180 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 127657us
I20260709 12:10:13.283967 22496 leader_election.cc:304] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
W20260709 12:10:13.285239 22553 debug-util.cc:398] Leaking SignalData structure 0x7b080031a7a0 after lost signal to thread 24246
W20260709 12:10:13.289228 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 60210.8us
I20260709 12:10:13.291150 22527 raft_consensus.cc:1240] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:13.291919 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:13.291996 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:13.293148 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:13.227177 24221 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:13.226631 24298 raft_consensus.cc:697] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:13.293697 22523 raft_consensus.cc:2376] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3. Re-sending same reply.
I20260709 12:10:13.270493 24229 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.300405 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:13.238951 24308 raft_consensus.cc:2804] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:13.271831 24311 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.302583 24298 consensus_queue.cc:237] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:13.298533 24221 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:13.303200 24309 log.cc:927] Time spent T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:10:13.303650 24233 raft_consensus.cc:2749] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:13.305716 22529 raft_consensus.cc:2376] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3. Re-sending same reply.
W20260709 12:10:13.308600 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.301952 22454 raft_consensus.cc:1275] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:13.297294 24236 raft_consensus.cc:2749] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:13.336498 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:13.337376 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:13.294432 24291 raft_consensus.cc:740] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:13.340186 24291 consensus_queue.cc:260] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:13.239166 24242 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:13.318382 24223 raft_consensus.cc:3055] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:13.336030 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:13.336620 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:13.233144 24288 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:13.334865 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 118817us
W20260709 12:10:13.355407 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 120453us
W20260709 12:10:13.350502 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 194936us
I20260709 12:10:13.351754 24308 raft_consensus.cc:697] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 2 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:13.358331 24223 raft_consensus.cc:740] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:13.401949 24288 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:13.507655 24223 consensus_queue.cc:260] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:13.509193 24223 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.402590 24242 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:13.403112 24321 raft_consensus.cc:2749] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:13.344460 24226 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:13.403463 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:13.396637 24322 raft_consensus.cc:2804] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:13.403795 24325 consensus_queue.cc:1059] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:13.316905 24290 consensus_queue.cc:260] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:13.362155 22452 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 2.
W20260709 12:10:13.435335 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.407017 22422 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:13.438331 22495 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:13.533867 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 126936us
W20260709 12:10:13.534603 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 96410us
I20260709 12:10:13.449980 24250 raft_consensus.cc:3055] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:13.535722 22495 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:13.332520 24311 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:13.536547 22422 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:10:13.522229 22605 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.521631 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:13.520607 24221 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:13.394635 22449 raft_consensus.cc:2376] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 3. Re-sending same reply.
I20260709 12:10:13.332638 24294 consensus_queue.cc:260] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:13.350126 24320 consensus_queue.cc:1059] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.189s
W20260709 12:10:13.520434 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 229985us
I20260709 12:10:13.538384 22604 raft_consensus.cc:2393] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 2: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:13.476342 24316 consensus_queue.cc:1059] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 12:10:13.543244 22422 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:13.531211 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:13.568691 24326 raft_consensus.cc:2749] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:13.569340 24291 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:13.569471 24260 raft_consensus.cc:3055] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:13.569938 24260 raft_consensus.cc:740] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:13.572304 24320 raft_consensus.cc:3055] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:13.572800 24320 raft_consensus.cc:740] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:13.573778 24320 consensus_queue.cc:260] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:13.574880 22353 catalog_manager.cc:5697] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 1 to 2, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 2 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:13.535614 24250 raft_consensus.cc:740] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
W20260709 12:10:13.579356 24304 log.cc:927] Time spent T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.288s	user 0.003s	sys 0.006s
I20260709 12:10:13.580152 24250 consensus_queue.cc:260] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:13.581899 24250 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.523567 24322 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:13.545120 24232 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:13.545785 24292 raft_consensus.cc:2749] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:13.565881 24305 consensus_queue.cc:1059] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:10:13.548775 22455 raft_consensus.cc:1275] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:13.549508 24221 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:13.601713 22602 raft_consensus.cc:1240] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:13.549860 24295 raft_consensus.cc:3055] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:13.536448 24242 consensus_queue.cc:1048] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:10:13.603780 24295 raft_consensus.cc:740] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:13.604750 24295 consensus_queue.cc:260] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:13.606213 24295 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:13.551854 24321 raft_consensus.cc:2804] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:13.606812 24321 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:13.607370 24321 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.553288 22495 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:13.555167 22569 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:13.609478 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 56270.6us
W20260709 12:10:13.609478 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 54379.9us
I20260709 12:10:13.610597 22569 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:13.611347 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:13.537847 24243 raft_consensus.cc:2749] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:13.611701 22569 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:13.613461 22569 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:13.563779 23120 raft_consensus.cc:1240] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 1. Current term is 2. Ops: []
W20260709 12:10:13.614048 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:13.593075 24266 consensus_meta.cc:287] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.511s	user 0.003s	sys 0.006s
I20260709 12:10:13.588435 24285 raft_consensus.cc:2749] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:13.594071 24226 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:13.568686 24290 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.611413 22523 raft_consensus.cc:1240] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:13.613713 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:13.544731 24308 consensus_queue.cc:237] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:13.614943 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:13.589534 22422 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:13.658087 22525 raft_consensus.cc:2393] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 2: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:13.658202 22605 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 3.
I20260709 12:10:13.641415 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:13.639470 24301 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:13.644068 24288 raft_consensus.cc:2749] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:13.644554 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:13.647228 24325 raft_consensus.cc:2749] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:13.665180 22497 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
W20260709 12:10:13.667639 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 78296.1us
I20260709 12:10:13.668390 22422 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:13.670485 22528 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 3.
I20260709 12:10:13.647423 22599 raft_consensus.cc:1240] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:13.647804 22569 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:13.591178 24322 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:13.649935 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:13.655682 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:13.652184 24242 raft_consensus.cc:2749] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:13.659106 22531 raft_consensus.cc:2393] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 4: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:13.659217 24332 raft_consensus.cc:2749] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:13.672465 22422 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:10:13.674388 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:13.674795 22529 raft_consensus.cc:2393] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 2: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:13.674674 22528 raft_consensus.cc:1240] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:13.644454 24311 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:13.697469 22528 raft_consensus.cc:1240] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:13.678396 24232 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:13.680018 24292 raft_consensus.cc:2749] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:13.680610 24266 raft_consensus.cc:2749] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:13.650529 24320 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.689049 24167 raft_consensus.cc:2804] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:13.640981 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:13.686621 22569 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:13.694433 24325 raft_consensus.cc:2749] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:13.642751 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 192406us
I20260709 12:10:13.584457 24260 consensus_queue.cc:260] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:13.708874 22569 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:13.674177 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:13.683898 22532 raft_consensus.cc:2393] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 2: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:13.703190 22605 raft_consensus.cc:1275] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:13.697355 22422 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:13.699465 24285 raft_consensus.cc:2764] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:10:13.696172 22530 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 3.
I20260709 12:10:13.710492 22569 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:13.711992 24242 consensus_queue.cc:1059] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:10:13.714480 22422 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:13.725585 24301 raft_consensus.cc:3055] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:13.726076 24301 raft_consensus.cc:740] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:13.712813 22528 raft_consensus.cc:1240] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:13.728848 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:13.727965 22569 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:13.713408 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.730331 22422 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:13.735342 22524 raft_consensus.cc:2393] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 3: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:13.727062 24301 consensus_queue.cc:260] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:13.735486 24242 raft_consensus.cc:2749] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:13.736210 24301 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.737835 22422 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:13.739650 22422 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:13.736414 24297 raft_consensus.cc:2749] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:13.740868 24329 raft_consensus.cc:2749] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:13.741031 24331 raft_consensus.cc:2749] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:13.707264 24232 raft_consensus.cc:2804] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:13.741825 22422 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:13.741648 24329 raft_consensus.cc:2749] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:13.744573 22570 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:13.711179 24311 raft_consensus.cc:2749] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:13.727823 24266 raft_consensus.cc:2804] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:13.723306 24167 raft_consensus.cc:697] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:13.746096 22422 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:10:13.742432 22569 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:13.748725 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:13.750490 24333 raft_consensus.cc:3055] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:13.757798 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:13.747974 24226 raft_consensus.cc:2749] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:13.767002 24316 raft_consensus.cc:2804] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:13.771888 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:13.773600 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:13.748682 24292 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.776340 22527 raft_consensus.cc:1240] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:13.769744 23125 raft_consensus.cc:2955] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:13.778420 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:13.779232 24334 raft_consensus.cc:2804] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:13.780699 24294 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:13.780375 24322 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:13.748497 24266 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:13.782261 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:13.743858 24312 consensus_queue.cc:1048] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:10:13.800551 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:13.744122 24232 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:13.792236 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:13.801584 22531 raft_consensus.cc:2393] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 3: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:13.775187 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:10:13.793318 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 473733us
I20260709 12:10:13.796361 24339 consensus_queue.cc:1059] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:13.796456 22422 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:13.748862 24325 consensus_queue.cc:1059] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:10:13.793329 24333 raft_consensus.cc:740] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:13.798034 24332 consensus_queue.cc:1059] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:10:13.810725 24333 consensus_queue.cc:260] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:13.796490 24337 consensus_queue.cc:1059] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:10:13.811921 24333 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:13.783946 22606 raft_consensus.cc:1240] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:13.812849 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:13.792671 24285 raft_consensus.cc:2764] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:10:13.803969 22422 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:10:13.808686 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:13.816454 22523 raft_consensus.cc:2393] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 2: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:13.800015 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:13.812374 24337 raft_consensus.cc:3055] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:13.794548 24316 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:13.814033 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:13.788767 22569 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:13.815538 22530 raft_consensus.cc:2393] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 2: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:13.809324 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:13.822432 22528 raft_consensus.cc:2376] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 3. Re-sending same reply.
I20260709 12:10:13.818439 22422 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:10:13.821058 22527 raft_consensus.cc:2393] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 4: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:13.800273 24266 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.824045 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:13.813905 24329 raft_consensus.cc:2749] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:13.808993 24232 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.825568 22528 raft_consensus.cc:2393] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 2: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
W20260709 12:10:13.825904 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:13.825942 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.808450 24334 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:13.821614 24297 raft_consensus.cc:2804] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:13.823469 24316 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:13.824640 24312 consensus_queue.cc:1048] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:10:13.820125 24337 raft_consensus.cc:740] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:13.825016 22598 raft_consensus.cc:1240] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:13.835316 22422 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:13.829133 24285 raft_consensus.cc:3055] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:13.824424 24167 consensus_queue.cc:237] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:13.831342 24339 raft_consensus.cc:2764] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 12:10:13.836128 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 47432.1us
I20260709 12:10:13.834954 24297 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:13.838280 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:13.848260 22528 raft_consensus.cc:2376] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 3. Re-sending same reply.
W20260709 12:10:13.842928 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 47367.1us
I20260709 12:10:13.844169 22422 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:13.848876 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:13.846537 22569 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:13.830538 24334 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.849558 22570 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:13.852053 22603 raft_consensus.cc:1240] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:13.855693 22570 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:10:13.856714 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:13.857542 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:13.858526 22454 raft_consensus.cc:2468] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:13.845121 24226 raft_consensus.cc:2749] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:13.845397 24329 raft_consensus.cc:2804] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:13.842486 24285 raft_consensus.cc:740] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:13.829886 24331 consensus_queue.cc:1059] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:10:13.867736 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:13.863633 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:13.851713 24297 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.867197 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:13.872674 22456 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.868604 22457 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:13.873745 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:13.877455 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:13.878604 22453 raft_consensus.cc:2393] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 3: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:13.880733 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:13.883225 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:13.896030 22529 consensus_queue.cc:237] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:13.865806 24329 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:13.897601 22456 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:13.867566 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:13.900079 22452 raft_consensus.cc:1240] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:13.891185 24332 raft_consensus.cc:2804] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:13.845079 24319 consensus_queue.cc:1059] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 12:10:13.892453 24325 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.886586 24226 raft_consensus.cc:2749] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:13.912031 23088 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:13.902858 24329 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.915828 23088 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:13.899019 24221 consensus_queue.cc:1059] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:10:13.925671 23088 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:13.911192 24322 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:13.910435 24285 consensus_queue.cc:260] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:13.929872 24285 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:13.914940 24332 raft_consensus.cc:697] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 3 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:13.914785 22449 raft_consensus.cc:3055] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:13.935153 23088 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:10:13.937359 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.914512 24307 consensus_queue.cc:1059] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:10:13.942498 23088 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:13.930749 24153 raft_consensus.cc:2749] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:13.931725 24319 consensus_queue.cc:1059] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:10:13.956946 24343 consensus_queue.cc:1059] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 12:10:13.961742 24321 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:13.956743 23088 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:13.976208 24324 raft_consensus.cc:2749] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:13.945922 24306 raft_consensus.cc:2749] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:13.938177 22449 raft_consensus.cc:740] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
W20260709 12:10:13.986660 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.982132 24232 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:13.988401 22457 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
W20260709 12:10:13.987702 24313 log.cc:927] Time spent T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.650s	user 0.006s	sys 0.005s
W20260709 12:10:14.017266 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 161642us
I20260709 12:10:14.018846 22570 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
W20260709 12:10:14.019236 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 62597.2us
I20260709 12:10:14.020207 22570 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:13.997006 22452 raft_consensus.cc:1275] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:14.011493 24248 raft_consensus.cc:3055] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:14.021222 24248 raft_consensus.cc:740] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:14.021799 24153 raft_consensus.cc:2749] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:14.022089 24248 consensus_queue.cc:260] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:14.015928 24306 raft_consensus.cc:2804] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:10:14.015987 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.023913 24306 raft_consensus.cc:697] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 3 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:14.020478 23088 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:14.025077 23088 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:13.998558 24290 consensus_queue.cc:1048] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:10:14.027891 23088 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:14.030138 22598 raft_consensus.cc:1275] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:14.011480 22449 consensus_queue.cc:260] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:14.031152 22449 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:14.031574 22598 raft_consensus.cc:1275] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:14.030172 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:10:14.023285 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 150592us
I20260709 12:10:14.016304 22532 raft_consensus.cc:1240] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 LEADER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:14.024044 24248 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.030172 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:13.925702 24308 raft_consensus.cc:2749] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.037355 22570 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:14.036381 22603 raft_consensus.cc:1240] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:14.001134 24339 raft_consensus.cc:2749] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:14.031272 24340 log.cc:927] Time spent T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:10:14.060144 22452 raft_consensus.cc:1240] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:14.061498 22569 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:14.027153 24153 raft_consensus.cc:2749] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:14.070153 24344 raft_consensus.cc:2749] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.070511 24153 raft_consensus.cc:2749] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.071103 24355 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:14.071663 24355 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:14.074018 24355 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:14.076330 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:14.037386 24301 raft_consensus.cc:2804] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:14.035130 24348 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.026270 24332 consensus_queue.cc:237] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:14.084483 24334 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:14.104243 22495 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:14.024971 24306 consensus_queue.cc:237] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:14.097501 22455 raft_consensus.cc:1240] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:14.043176 24324 raft_consensus.cc:2804] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:14.036890 24167 consensus_queue.cc:1059] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 12:10:14.101332 24337 consensus_queue.cc:260] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:14.116115 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:14.040490 24343 consensus_queue.cc:1059] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 12:10:14.103801 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:14.098750 22597 raft_consensus.cc:1240] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:14.095837 22449 raft_consensus.cc:1275] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:14.112100 24334 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:14.112355 24232 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:14.113588 24292 raft_consensus.cc:2749] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.085812 22526 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 3.
I20260709 12:10:14.102416 24242 raft_consensus.cc:3055] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:14.123881 24242 raft_consensus.cc:740] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:14.119831 24228 consensus_queue.cc:1048] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:10:14.124882 24242 consensus_queue.cc:260] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:14.114625 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:14.126075 24242 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.127038 24260 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.127225 22598 raft_consensus.cc:1275] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:14.128695 22606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2068) took 1277 ms. Trace:
I20260709 12:10:14.129084 22606 rpcz_store.cc:276] 0709 12:10:12.851589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.087261 (+235672us) service_pool.cc:224] Handling call
0709 12:10:13.783787 (+696526us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:13.812734 (+ 28947us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:14.128504 (+315770us) spinlock_profiling.cc:243] Waited 696 ms on lock 0x7b540013ae50. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:14.128637 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1601180032}
I20260709 12:10:14.097738 24355 raft_consensus.cc:2749] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.133487 24321 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:14.085575 24325 raft_consensus.cc:2749] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.107293 24305 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:14.106689 24243 raft_consensus.cc:2749] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.145527 22601 raft_consensus.cc:1275] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:14.108582 24317 consensus_queue.cc:1059] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
W20260709 12:10:14.146701 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 325481us
I20260709 12:10:14.137889 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:14.116613 24324 raft_consensus.cc:697] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 3 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:14.106114 24342 raft_consensus.cc:3055] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:10:14.155274 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 55817.5us
I20260709 12:10:14.098013 24329 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:14.158140 22569 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:14.098752 24316 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:14.162309 22451 raft_consensus.cc:3055] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:14.163671 22451 raft_consensus.cc:740] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:14.167850 22569 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:10:14.168836 22421 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:14.157500 24229 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.172334 22456 raft_consensus.cc:1240] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:14.157045 24301 raft_consensus.cc:697] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:14.174413 22604 raft_consensus.cc:1240] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:14.157387 24305 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:14.175987 22569 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:14.176826 22451 consensus_queue.cc:260] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:14.175077 24312 raft_consensus.cc:2804] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:14.178311 24312 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:14.178650 24312 raft_consensus.cc:3060] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:14.171036 24334 raft_consensus.cc:2749] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:14.180924 24305 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:14.182863 22421 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:14.183874 24305 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:14.184468 24305 raft_consensus.cc:697] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
W20260709 12:10:14.184968 24294 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:10:14.166392 24342 raft_consensus.cc:740] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:14.186487 22421 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:10:14.187451 22569 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:14.159701 24250 consensus_queue.cc:1048] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:10:14.191223 22422 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:14.171945 24321 raft_consensus.cc:2749] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:14.191584 22569 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:14.175398 24337 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:14.195382 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 166212us
I20260709 12:10:14.166729 24290 consensus_queue.cc:1059] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:10:14.185546 24305 consensus_queue.cc:237] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:14.199698 24343 raft_consensus.cc:2804] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:14.200937 22451 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:14.204140 23087 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:14.205463 24351 raft_consensus.cc:2749] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:14.194855 22597 raft_consensus.cc:1240] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:14.196480 24322 raft_consensus.cc:2749] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:14.195842 24355 raft_consensus.cc:2804] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:14.186472 24286 consensus_queue.cc:1059] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:10:14.175706 24229 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:14.195041 24292 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:14.214277 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:14.214908 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:10:14.222270 22421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:14.226758 22421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.234167 24266 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:10:14.236167 24329 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:14.237762 22600 raft_consensus.cc:1240] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:14.237967 24292 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:14.230834 24321 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:14.239948 24292 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:14.239750 24321 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:14.240495 24315 raft_consensus.cc:3055] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:14.240866 24315 raft_consensus.cc:740] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:14.241441 24347 raft_consensus.cc:2804] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:14.241730 24321 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:14.241588 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:14.242007 24347 raft_consensus.cc:697] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:14.242343 22457 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:14.242899 24347 consensus_queue.cc:237] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:14.243045 24301 consensus_queue.cc:237] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:14.230543 24296 raft_consensus.cc:3055] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:14.249658 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:10:14.254185 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 50102.1us
I20260709 12:10:14.248930 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:14.255266 23087 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:14.256704 23087 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:14.257827 22421 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:14.258945 24292 raft_consensus.cc:2749] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.259935 24223 raft_consensus.cc:2749] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.260880 24223 raft_consensus.cc:2804] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:14.261433 24223 raft_consensus.cc:697] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 2 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:14.263882 24323 raft_consensus.cc:2749] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.262594 24223 consensus_queue.cc:237] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:14.208240 24325 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:14.209324 24343 raft_consensus.cc:697] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
W20260709 12:10:14.279430 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 81133.2us
I20260709 12:10:14.281172 22450 raft_consensus.cc:1240] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:14.206391 24334 consensus_queue.cc:1059] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
W20260709 12:10:14.286950 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 54072.6us
I20260709 12:10:14.285761 22453 raft_consensus.cc:1240] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 2. Current term is 3. Ops: [2.4-2.4]
I20260709 12:10:14.289934 22457 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 2.
I20260709 12:10:14.227536 24355 raft_consensus.cc:697] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:14.207890 24270 consensus_queue.cc:1048] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:10:14.253180 24296 raft_consensus.cc:740] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:14.302529 22451 raft_consensus.cc:1275] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:14.303519 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:14.304301 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:14.305006 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:14.181120 24324 consensus_queue.cc:237] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:14.226792 24354 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:14.208477 24350 consensus_queue.cc:1059] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 12:10:14.253388 24329 consensus_queue.cc:1059] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:10:14.340317 24316 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:14.340902 24350 consensus_queue.cc:1243] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer 1676e7af5e4a47cb86ee7db83e3d4881 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:10:14.283664 24325 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:14.345607 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:14.301561 24210 raft_consensus.cc:3055] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:10:14.308463 24320 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 12:10:14.347572 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:14.316944 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:14.341184 24315 consensus_queue.cc:260] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:14.346923 24260 raft_consensus.cc:3055] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:14.343061 24238 raft_consensus.cc:2955] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:14.362419 22455 raft_consensus.cc:1275] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:14.348619 24210 raft_consensus.cc:740] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:14.320703 24354 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:14.371591 22450 raft_consensus.cc:1240] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:14.371958 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:14.372757 22527 raft_consensus.cc:2376] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3. Re-sending same reply.
I20260709 12:10:14.359258 24260 raft_consensus.cc:740] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:14.385730 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:14.385527 24210 consensus_queue.cc:260] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:14.386636 24210 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:14.387571 22528 raft_consensus.cc:1240] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:14.389981 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:14.391531 22524 raft_consensus.cc:1240] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:14.395951 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:14.396970 24356 raft_consensus.cc:3055] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:14.397385 24356 raft_consensus.cc:740] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:14.398097 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:14.400255 24363 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.370043 24348 raft_consensus.cc:2749] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.407423 22569 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:14.402868 24229 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:14.370522 24343 consensus_queue.cc:237] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:14.377194 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:14.379755 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:14.299629 24342 consensus_queue.cc:260] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:14.401636 22421 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:10:14.420197 22529 raft_consensus.cc:2393] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 3: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:14.357753 24296 consensus_queue.cc:260] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:14.406801 22448 raft_consensus.cc:1275] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:14.376377 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:10:14.422703 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 166070us
I20260709 12:10:14.425935 23087 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:14.427225 24306 consensus_queue.cc:1048] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:14.402675 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:14.430526 24306 consensus_queue.cc:1059] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:14.431874 24352 raft_consensus.cc:3055] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:14.432250 24352 raft_consensus.cc:740] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:14.433328 24352 consensus_queue.cc:260] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:14.434444 22421 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:14.435343 22451 raft_consensus.cc:1240] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:14.435622 24306 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:14.436275 24306 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:14.434796 24352 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.436803 24305 consensus_queue.cc:1059] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:14.435708 24347 raft_consensus.cc:2749] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.438336 24306 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:14.438840 22421 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:14.440620 24347 raft_consensus.cc:2749] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.436756 22450 raft_consensus.cc:1275] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:14.442209 22421 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:14.442360 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:14.443365 22421 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:14.444113 24339 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.451216 24347 raft_consensus.cc:2749] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.453086 24339 raft_consensus.cc:2749] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.359478 24355 consensus_queue.cc:237] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:14.419929 22449 raft_consensus.cc:1275] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:14.400758 24363 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:14.484241 24337 raft_consensus.cc:2804] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:14.484588 24221 raft_consensus.cc:2804] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:14.502924 24337 raft_consensus.cc:697] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:14.504020 24354 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:14.504976 24325 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:14.505638 24362 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.504207 24337 consensus_queue.cc:237] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:14.507861 24296 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.484638 24290 consensus_queue.cc:1059] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:10:14.484452 24229 consensus_queue.cc:1048] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:10:14.483346 24250 consensus_queue.cc:1048] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:10:14.510555 24221 raft_consensus.cc:697] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 3 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:14.511973 24221 consensus_queue.cc:237] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:14.513245 24363 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:14.516443 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:14.517117 22600 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:10:14.519008 22422 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:14.519124 24296 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.519833 24296 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:14.523039 24296 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:14.498566 24260 consensus_queue.cc:260] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:14.532223 22524 raft_consensus.cc:1240] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:14.532431 22529 raft_consensus.cc:1240] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:14.532891 24315 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.534655 24295 raft_consensus.cc:3055] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:10:14.528064 24297 consensus_meta.cc:287] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.645s	user 0.004s	sys 0.006s
I20260709 12:10:14.535666 24167 raft_consensus.cc:3055] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:10:14.539868 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.550704 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:14.557705 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.568178 23089 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:14.547140 24295 raft_consensus.cc:740] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:14.549712 24286 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.572151 22605 raft_consensus.cc:1240] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 3 LEADER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:14.548480 24167 raft_consensus.cc:740] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:14.560943 24260 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.619661 24357 raft_consensus.cc:2749] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:14.551170 24297 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:14.628561 23089 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:14.631108 22452 raft_consensus.cc:1240] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:14.587517 24286 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:14.568053 24306 consensus_queue.cc:1048] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 12:10:14.564230 24324 consensus_queue.cc:1059] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
W20260709 12:10:14.800071 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.567842 24352 consensus_queue.cc:1048] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:10:14.569756 24350 consensus_queue.cc:1059] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.106s
I20260709 12:10:14.597642 24301 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:14.808810 22606 raft_consensus.cc:1240] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:14.809325 22601 raft_consensus.cc:1275] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:14.755892 22600 raft_consensus.cc:1275] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:14.812287 22602 raft_consensus.cc:1275] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:14.827638 24242 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.828112 24242 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:14.822252 24297 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:14.822139 24229 consensus_queue.cc:1059] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:14.822809 24291 consensus_queue.cc:1059] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:14.830461 22449 raft_consensus.cc:1275] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:14.823366 24362 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:14.835191 24370 log.cc:927] Time spent T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.306s	user 0.001s	sys 0.000s
I20260709 12:10:14.831202 24362 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:14.810771 24243 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.816239 24153 raft_consensus.cc:2749] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:14.865428 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:14.866170 22530 raft_consensus.cc:2393] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 3: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:14.854801 24232 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.865113 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:14.781931 24295 consensus_queue.cc:260] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:14.868744 22526 raft_consensus.cc:1275] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:14.832783 24270 consensus_queue.cc:1059] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:10:14.845433 24325 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.819010 24323 consensus_queue.cc:1048] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:10:14.895685 22527 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5.
I20260709 12:10:14.898999 22421 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:14.867901 24343 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.811364 24167 consensus_queue.cc:260] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:14.874240 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:14.845829 24243 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:14.867672 24232 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:14.865152 24229 consensus_queue.cc:1059] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:10:14.920099 22598 raft_consensus.cc:1240] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:14.912210 24210 raft_consensus.cc:2804] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:14.909288 24295 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:14.933427 22449 raft_consensus.cc:1275] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:10:14.944217 22449 pending_rounds.cc:85] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f: Aborting all ops after (but not including) 2
I20260709 12:10:14.944984 22449 pending_rounds.cc:107] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:10:14.945303 22449 raft_consensus.cc:2889] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:14.861970 24286 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:14.836750 24301 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:14.899784 24325 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:14.913638 24343 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:14.932569 24243 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:14.964813 24362 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:10:14.980588 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 343965us
I20260709 12:10:14.962235 24210 raft_consensus.cc:697] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 5 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:14.973951 24232 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:14.984818 23119 raft_consensus.cc:1240] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:14.986299 23125 raft_consensus.cc:1275] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:14.978161 24339 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.987787 24328 raft_consensus.cc:3055] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:14.976271 24286 consensus_queue.cc:1048] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:10:14.992429 24328 raft_consensus.cc:740] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:14.996523 24328 consensus_queue.cc:260] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:14.997618 24328 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:14.999907 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.001252 22604 raft_consensus.cc:1275] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:10:15.002178 24325 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:14.999396 24210 consensus_queue.cc:237] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:15.002767 22601 raft_consensus.cc:1240] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:14.872594 24332 raft_consensus.cc:2955] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:15.030577 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:15.033504 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:14.983669 24221 consensus_queue.cc:1048] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 12:10:15.003321 24339 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:15.056748 24301 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:15.067771 24339 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:15.068041 24317 raft_consensus.cc:3055] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:15.068395 24317 raft_consensus.cc:740] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:15.069267 24317 consensus_queue.cc:260] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:15.070340 24317 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:15.055876 24243 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.071537 24243 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:15.072525 22451 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.073661 24243 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:15.070902 22453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 1969) took 1193 ms. Trace:
I20260709 12:10:15.076274 22453 rpcz_store.cc:276] 0709 12:10:13.877547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.886472 (+  8925us) service_pool.cc:224] Handling call
0709 12:10:13.887015 (+   543us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:14.287671 (+400656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.070562 (+782891us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b54003f25d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:15.070820 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":915889024}
I20260709 12:10:15.079890 24356 consensus_queue.cc:260] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:15.081156 24356 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.083755 22451 raft_consensus.cc:1275] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:10:15.072660 24312 consensus_meta.cc:287] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.894s	user 0.008s	sys 0.004s
I20260709 12:10:15.085410 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:15.085193 24312 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:15.087522 24312 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:15.094205 24242 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:15.098387 24315 consensus_meta.cc:287] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.549s	user 0.008s	sys 0.000s
I20260709 12:10:15.098879 24266 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:15.099517 22598 raft_consensus.cc:1275] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:15.099990 22605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43070 (request call id 265) took 1075 ms. Trace:
I20260709 12:10:15.100392 22605 rpcz_store.cc:276] 0709 12:10:14.024402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.024554 (+   152us) service_pool.cc:224] Handling call
0709 12:10:14.024926 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:14.572584 (+547658us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.099783 (+527199us) spinlock_profiling.cc:243] Waited 547 ms on lock 0x7b5400449b54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:15.099937 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1257993984}
I20260709 12:10:15.107416 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:15.108657 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:15.109436 23120 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 2.
I20260709 12:10:15.110110 22355 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48412 (request call id 238) took 2232 ms. Trace:
I20260709 12:10:15.110793 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:14.408141 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:15.116715 23087 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:15.118860 22421 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:15.126214 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:15.128742 23121 raft_consensus.cc:1275] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:15.128499 24331 raft_consensus.cc:2804] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:15.128907 24308 raft_consensus.cc:2749] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:15.135951 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:15.159662 23118 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 4.
I20260709 12:10:15.110580 22355 rpcz_store.cc:276] 0709 12:10:12.877381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.877518 (+   137us) service_pool.cc:224] Handling call
0709 12:10:15.110034 (+2232516us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:12.960184 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:12.961312 (+  1128us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:12.961353 (+    41us) write_op.cc:435] Acquired schema lock
0709 12:10:12.961371 (+    18us) tablet.cc:662] Decoding operations
0709 12:10:12.961787 (+   416us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:12.961860 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:12.961886 (+    26us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:10:12.962191 (+   305us) tablet.cc:701] Row locks acquired
0709 12:10:12.962208 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:10:12.985577 (+ 23369us) spinlock_profiling.cc:243] Waited 4.79 ms on lock 0x7b2c000302d8. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc9227a11 00007f9cc9236a0a 00007f9cc9236693 00007f9cc9236631 00007f9cca969902 00007f9cca9696dd 00007f9cce364243 00007f9cce363d58 00007f9cce3689f1 00007f9cce3689a9 00007f9cce368939
0709 12:10:12.985671 (+    94us) write_op.cc:270] Start()
0709 12:10:12.985939 (+   268us) write_op.cc:276] Timestamp: P: 1783599012967097 usec, L: 0
0709 12:10:12.985973 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 12:10:12.986839 (+   866us) log.cc:844] Serialized 921 byte log entry
0709 12:10:13.742060 (+755221us) op_driver.cc:464] REPLICATION: finished
0709 12:10:13.854258 (+112198us) write_op.cc:301] APPLY: starting
0709 12:10:13.854346 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:13.854466 (+   120us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:13.854489 (+    23us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:13.920582 (+ 66093us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:13.933916 (+ 13334us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:10:13.939721 (+  5805us) write_op.cc:312] APPLY: finished
0709 12:10:13.958534 (+ 18813us) log.cc:844] Serialized 29 byte log entry
0709 12:10:13.986515 (+ 27981us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:13.988197 (+  1682us) write_op.cc:454] Released schema lock
0709 12:10:13.989292 (+  1095us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:14.027947 (+ 38655us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:14.032950 (+  5003us) write_op.cc:454] Released schema lock
0709 12:10:14.339169 (+306219us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b5400198a54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92b32a 00007f9cca8b0f14 00007f9cca8b0ec3 00007f9cca8b0e38 00007f9cca8b0df3 00007f9cca8b00dc 00007f9cca8d9e16 00007f9cca8c1cbb 00007f9cca8ac39d 00007f9cca8afd75
Metrics: {"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":102570,"apply.run_cpu_time_us":3008,"apply.run_wall_time_us":147247,"num_ops":2,"prepare.queue_time_us":58761,"prepare.run_cpu_time_us":19826,"prepare.run_wall_time_us":200532,"raft.queue_time_us":915593,"raft.run_cpu_time_us":16992,"raft.run_wall_time_us":654342,"replication_time_us":721389,"spinlock_wait_cycles":40419584,"thread_start_us":370619,"threads_started":4,"wal-append.queue_time_us":240475,"wal-append.run_cpu_time_us":28709,"wal-append.run_wall_time_us":1746417}]]}
I20260709 12:10:15.162519 24317 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:15.143205 24260 consensus_meta.cc:287] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.515s	user 0.008s	sys 0.002s
I20260709 12:10:15.145267 24331 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:15.164925 24331 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.166433 22421 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:15.167339 23117 raft_consensus.cc:1275] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:15.167783 22457 raft_consensus.cc:1275] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:15.168963 24266 raft_consensus.cc:2804] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:15.169368 24266 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:15.169698 24266 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.170459 24228 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.170920 24228 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:15.173327 24228 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:15.174188 24167 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.175261 24306 raft_consensus.cc:3055] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:15.175628 24306 raft_consensus.cc:740] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:15.176482 24306 consensus_queue.cc:260] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:15.177433 24306 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.140339 24339 consensus_queue.cc:1048] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:10:15.140290 24352 consensus_queue.cc:1048] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:10:15.115546 24223 consensus_queue.cc:1048] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:10:15.102571 24329 consensus_queue.cc:1048] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:10:15.128355 24221 consensus_queue.cc:1048] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:10:15.135156 24328 consensus_queue.cc:1048] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:10:15.140394 24357 consensus_queue.cc:1059] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:10:15.194684 24297 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.182292 24324 consensus_queue.cc:1048] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
W20260709 12:10:15.208039 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:15.208326 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 338016us
W20260709 12:10:15.219030 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:15.233047 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 399437us
I20260709 12:10:15.202477 22570 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:15.183941 24317 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:15.242589 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:15.239547 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 406062us
I20260709 12:10:15.249614 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:15.251075 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:15.251911 22598 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
W20260709 12:10:15.234125 24337 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.023s	sys 0.020s
I20260709 12:10:15.259950 22570 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:15.263912 22601 raft_consensus.cc:1275] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:15.270730 24339 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.271288 24339 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:15.243462 24242 raft_consensus.cc:2749] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:15.198226 24297 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:15.241307 24308 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.241466 24153 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.256562 24343 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:15.257386 24312 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:15.260542 24337 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.024s	sys 0.020s
I20260709 12:10:15.260388 24301 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.284204 24379 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:15.300585 24301 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:15.283545 24362 consensus_queue.cc:1048] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:10:15.317402 24344 raft_consensus.cc:2749] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:15.317389 24317 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:15.317643 24379 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:15.318779 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 58914.7us
I20260709 12:10:15.320137 22570 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:15.321313 24379 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:15.318782 22598 raft_consensus.cc:1240] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:10:15.324815 24301 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:15.330742 22570 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:15.329775 24344 raft_consensus.cc:2749] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:15.328020 24291 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.293905 24308 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:15.329819 24363 raft_consensus.cc:2804] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:15.357259 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:15.358047 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:15.358696 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:15.359344 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:15.361479 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:15.297479 24153 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:15.297943 24312 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:15.331621 24383 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:15.363032 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 325867us
I20260709 12:10:15.390005 23125 raft_consensus.cc:2393] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 2: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:15.339119 24317 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.388515 23121 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:10:15.344113 24167 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.344111 24232 raft_consensus.cc:2749] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:15.373131 24301 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.391435 24385 consensus_queue.cc:1048] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 12:10:15.343168 24266 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:15.392159 24291 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:15.303259 24229 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.396468 24242 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.346623 24382 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
W20260709 12:10:15.406291 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.433117 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:15.434454 22452 raft_consensus.cc:1275] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:15.434779 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:15.439909 22453 raft_consensus.cc:2393] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 2: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:15.440117 22451 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:15.435719 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:15.441033 22454 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:10:15.438061 22606 raft_consensus.cc:1275] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:15.441519 22569 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:15.440752 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:15.418862 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 179203us
I20260709 12:10:15.336928 24331 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:15.442644 22453 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:10:15.443670 22569 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:15.455933 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:15.453075 22527 raft_consensus.cc:1275] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:15.469431 22606 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.471146 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:15.427189 24291 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:15.470669 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:15.427959 24242 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:15.472617 23121 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:10:15.455387 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:15.467226 24355 raft_consensus.cc:2804] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:15.475615 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:15.475916 24355 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:15.476456 24355 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.402741 24392 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.477066 24392 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:15.479141 24392 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:15.479349 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:15.479602 24386 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.480137 24386 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:15.482276 24386 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:15.475155 23120 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:10:15.479761 22532 raft_consensus.cc:1275] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:15.482765 24386 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.491628 24386 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:15.423059 24383 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:15.494249 24386 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:15.423059 24308 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:15.495210 24390 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.495464 24383 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:15.430586 24337 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.420351 22524 raft_consensus.cc:1275] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:15.501853 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:15.489856 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:15.430342 24238 raft_consensus.cc:3055] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:15.483229 24329 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:15.503342 22602 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 3: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:15.503994 22451 raft_consensus.cc:2393] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 3: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:15.468909 24344 raft_consensus.cc:2804] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:15.494751 24386 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:15.425093 24266 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:15.471729 24210 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:15.497026 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.419986 24301 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:15.479346 24400 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.479641 24392 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.495740 24390 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:15.437031 24167 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:15.437471 24317 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:15.427533 24229 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:15.511570 24344 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:15.515738 24242 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:15.504848 24238 raft_consensus.cc:740] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:15.509565 24337 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:15.512669 24329 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:15.466634 24382 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:15.549212 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:15.432472 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:15.554510 24301 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:15.565305 24337 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:15.559242 23089 leader_election.cc:304] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:15.565874 24167 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:15.550556 24242 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.566885 24242 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:15.568979 24242 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:15.512977 24356 consensus_queue.cc:1059] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:10:15.570734 24356 raft_consensus.cc:3055] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:15.512832 24307 consensus_queue.cc:1048] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:10:15.571038 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:15.571710 22600 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.569994 24379 raft_consensus.cc:2749] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:15.575939 22455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 371) took 1142 ms. Trace:
I20260709 12:10:15.579231 22456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 1983) took 1047 ms. Trace:
I20260709 12:10:15.564640 24390 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:15.580762 24296 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:15.580003 22456 rpcz_store.cc:276] 0709 12:10:14.531641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.813583 (+281942us) service_pool.cc:224] Handling call
0709 12:10:14.837352 (+ 23769us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:14.837771 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:14.837798 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:14.842628 (+  4830us) log.cc:844] Serialized 26 byte log entry
0709 12:10:15.330126 (+487498us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:15.330192 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.330276 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:15.554966 (+224690us) raft_consensus.cc:1685] finished
0709 12:10:15.554999 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.579176 (+ 24177us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1584,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":4699,"thread_start_us":448659,"threads_started":1,"wal-append.queue_time_us":641573}
I20260709 12:10:15.581275 24296 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:15.582032 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:15.584000 22456 raft_consensus.cc:1240] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:15.584127 24329 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:15.543344 24344 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.516371 24386 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:15.548714 24297 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:15.542482 24392 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:15.571077 24356 raft_consensus.cc:740] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:15.576561 24270 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.578105 22455 rpcz_store.cc:276] 0709 12:10:14.433954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.501083 (+ 67129us) service_pool.cc:224] Handling call
0709 12:10:14.508109 (+  7026us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:14.508409 (+   300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:14.508435 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:15.107750 (+599315us) spinlock_profiling.cc:243] Waited 7.47 ms on lock 0x7b2c00033c98. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc9227a11 00007f9cc9237372 00007f9cca969a01 00007f9cca92e43a 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2
0709 12:10:15.108120 (+   370us) log.cc:844] Serialized 26 byte log entry
0709 12:10:15.327163 (+219043us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:15.327217 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.327306 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:15.572579 (+245273us) raft_consensus.cc:1685] finished
0709 12:10:15.572597 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.575861 (+  3264us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3562,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"spinlock_wait_cycles":17171200,"thread_start_us":186287,"threads_started":1,"wal-append.queue_time_us":343421}
I20260709 12:10:15.589227 22606 raft_consensus.cc:1275] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:15.576943 24337 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:15.521842 24210 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:15.603564 24308 consensus_queue.cc:1048] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:15.585356 24312 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:15.586169 23117 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:10:15.588274 24382 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:15.622560 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:15.629654 23123 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:15.624547 24356 consensus_queue.cc:260] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:15.626911 24392 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:15.612679 24337 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:15.628772 22354 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55980 (request call id 371) took 2782 ms. Trace:
I20260709 12:10:15.639111 22354 rpcz_store.cc:276] 0709 12:10:12.846763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.846899 (+   136us) service_pool.cc:224] Handling call
0709 12:10:15.628712 (+2781813us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1015540,"reported_tablets":2}
W20260709 12:10:15.634999 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 243577us
I20260709 12:10:15.615871 24296 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:15.550113 24400 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:15.643631 22570 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:15.605623 24270 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:15.635372 24312 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:15.654070 24210 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:15.645413 24385 raft_consensus.cc:2749] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:15.601862 24238 consensus_queue.cc:260] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:15.642117 24331 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:15.646937 22570 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:15.645483 24356 raft_consensus.cc:3060] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.663383 24339 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:15.669096 22570 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:15.670117 22570 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:15.664074 24260 raft_consensus.cc:3055] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:15.675081 24301 raft_consensus.cc:2804] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:15.676832 24260 raft_consensus.cc:740] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:15.677055 24301 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:15.671562 24385 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:15.677480 24301 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.675211 24333 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:15.694705 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:15.698932 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.683832 24381 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:15.675417 24312 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:15.686115 24333 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:15.717442 24270 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:15.723057 24232 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.723477 24386 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:15.723608 24232 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:15.726310 24232 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:15.727706 24397 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.719354 24337 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:15.677690 24355 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:15.701987 24229 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:15.701558 24242 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:15.733127 24242 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:15.735105 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.735280 24242 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:15.684005 24260 consensus_queue.cc:260] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:15.738061 22603 raft_consensus.cc:1240] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:15.741070 24395 log.cc:927] Time spent T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.265s	user 0.004s	sys 0.000s
I20260709 12:10:15.741169 23123 raft_consensus.cc:2955] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:15.752110 24400 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:15.752507 24355 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:15.755687 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:15.729019 24333 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.775910 24355 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.728230 24397 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:15.778692 24320 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.840982 24337 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.845731 24365 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.886544 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:15.887338 22530 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:10:15.889075 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:15.889810 22530 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:10:15.840598 24355 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:15.720141 24381 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:15.903972 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:16.098052 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:16.088158 22495 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.025s	sys 0.015s
W20260709 12:10:16.165259 22495 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.028s	sys 0.015s
W20260709 12:10:16.149472 22421 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.021s	sys 0.016s
W20260709 12:10:16.166448 22421 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.021s	sys 0.017s
I20260709 12:10:16.168161 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:16.168926 23120 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 2.
I20260709 12:10:16.172575 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:16.175624 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:16.176357 23120 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:16.180835 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:15.899214 24308 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.010015 24379 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.186776 24379 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:16.190435 24379 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:16.198545 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:15.904399 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:16.163403 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:16.295890 22606 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 2.
I20260709 12:10:15.882961 24153 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:15.959510 24400 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.075654 22524 raft_consensus.cc:1275] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:10:16.586102 22449 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.997s	user 0.002s	sys 0.019s
W20260709 12:10:16.149782 22448 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.011s	sys 0.026s
W20260709 12:10:16.622331 22449 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.034s	user 0.003s	sys 0.020s
W20260709 12:10:16.149663 22454 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.019s	sys 0.019s
W20260709 12:10:16.623538 22454 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.122s	user 0.020s	sys 0.019s
I20260709 12:10:16.602634 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:16.603469 22453 raft_consensus.cc:1275] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:16.603031 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:16.601598 24429 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.610580 24427 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:10:16.165578 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 712640us
I20260709 12:10:16.634191 22449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 378) took 1137 ms. Trace:
W20260709 12:10:16.101780 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 119964us
W20260709 12:10:16.231103 22497 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.797s	user 0.021s	sys 0.011s
I20260709 12:10:16.626626 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:16.628289 22456 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:10:16.629186 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:16.630472 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:16.629217 22455 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
W20260709 12:10:16.622701 22448 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.183s	user 0.012s	sys 0.026s
W20260709 12:10:16.315603 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.400293 22597 raft_consensus.cc:2410] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:16.752769 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:16.753484 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:16.753866 22525 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:16.755313 22453 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:10:16.756721 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:16.427137 22600 consensus_meta.cc:287] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.855s	user 0.008s	sys 0.004s
I20260709 12:10:16.645279 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:16.649087 22570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.016s	sys 0.014s
I20260709 12:10:16.634752 22449 rpcz_store.cc:276] 0709 12:10:15.497142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.503163 (+  6021us) service_pool.cc:224] Handling call
0709 12:10:15.539894 (+ 36731us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:15.574423 (+ 34529us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.575668 (+  1245us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:15.588223 (+ 12555us) log.cc:844] Serialized 26 byte log entry
0709 12:10:16.623429 (+1035206us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:16.623550 (+   121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:16.623679 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:16.623769 (+    90us) raft_consensus.cc:1685] finished
0709 12:10:16.625235 (+  1466us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:16.634102 (+  8867us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":88641,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":3697,"thread_start_us":1034389,"threads_started":1,"wal-append.queue_time_us":853818}
I20260709 12:10:16.659462 24429 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:16.771652 24429 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:16.775422 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:16.755313 24379 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:16.776533 24428 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:16.776955 22600 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:10:16.777433 24428 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:16.397522 23120 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:10:16.766933 24426 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:16.398722 24153 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:16.425406 23118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 631) took 1156 ms. Trace:
I20260709 12:10:16.779213 24422 consensus_queue.cc:1048] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:10:16.779842 24153 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:16.779894 23118 rpcz_store.cc:276] 0709 12:10:15.268748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.275296 (+  6548us) service_pool.cc:224] Handling call
0709 12:10:15.300739 (+ 25443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:15.338398 (+ 37659us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.343960 (+  5562us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:15.419253 (+ 75293us) log.cc:844] Serialized 26 byte log entry
0709 12:10:15.683353 (+264100us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:15.683402 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.683641 (+   239us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:16.425093 (+741452us) raft_consensus.cc:1685] finished
0709 12:10:16.425122 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:16.425326 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13532,"raft.queue_time_us":20633,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":8143,"thread_start_us":258117,"threads_started":1,"wal-append.queue_time_us":993571}
I20260709 12:10:16.101584 24301 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:16.766935 22570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.018s	sys 0.014s
I20260709 12:10:16.785640 24301 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:16.786547 24301 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:16.412736 24312 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:16.010280 24315 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.800810 24315 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:16.776578 24379 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:16.803642 24379 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:15.940264 24320 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:16.804494 22601 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 2.
I20260709 12:10:16.236299 24332 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.778905 24426 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:16.453075 24333 consensus_meta.cc:287] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.673s	user 0.002s	sys 0.007s
I20260709 12:10:16.807317 24333 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:16.809718 24333 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:15.888242 24337 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:16.758029 24427 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:16.454612 24344 consensus_meta.cc:287] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.855s	user 0.008s	sys 0.003s
I20260709 12:10:16.812597 24344 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:16.813090 24427 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:16.813663 24420 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:16.814117 22602 raft_consensus.cc:1240] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:10:16.439929 24355 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:10:16.426415 24356 consensus_meta.cc:287] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.751s	user 0.009s	sys 0.000s
I20260709 12:10:15.899590 24365 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:16.419775 24385 consensus_meta.cc:287] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.736s	user 0.009s	sys 0.001s
I20260709 12:10:16.234597 24386 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.840554 22353 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55978 (request call id 331) took 3688 ms. Trace:
I20260709 12:10:16.412102 24397 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:16.287434 24398 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.010s	sys 0.014s
W20260709 12:10:16.843968 24398 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.272s	user 0.010s	sys 0.015s
I20260709 12:10:16.399082 24400 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:16.851143 22351 catalog_manager.cc:5697] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 1 to 2, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 2 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:16.853366 24400 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:16.163417 24403 log.cc:927] Time spent T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
I20260709 12:10:16.245306 24413 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.718504 24250 raft_consensus.cc:3055] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:16.856213 24250 raft_consensus.cc:740] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:16.856487 24413 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:16.718676 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:16.459728 23123 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.002s	sys 0.018s
I20260709 12:10:16.723701 24408 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.724573 24416 consensus_queue.cc:1059] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:16.725335 24409 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:16.726279 24411 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.730284 22524 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:16.881045 22605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43070 (request call id 281) took 1619 ms. Trace:
I20260709 12:10:16.730466 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:16.731186 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.732250 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:16.881544 22605 rpcz_store.cc:276] 0709 12:10:15.261320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.261458 (+   138us) service_pool.cc:224] Handling call
0709 12:10:15.261860 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:15.266231 (+  4371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.266275 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:15.275797 (+  9522us) log.cc:844] Serialized 26 byte log entry
0709 12:10:15.652721 (+376924us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:15.652758 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.652837 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:16.880578 (+1227741us) raft_consensus.cc:1685] finished
0709 12:10:16.880628 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:16.880820 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14134,"raft.queue_time_us":5716,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":9063,"thread_start_us":346036,"threads_started":1,"wal-append.queue_time_us":484641}
I20260709 12:10:16.732611 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:16.895510 24363 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:16.896042 22598 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:10:16.748744 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:16.733819 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:16.897588 24295 raft_consensus.cc:3055] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:16.898115 24295 raft_consensus.cc:740] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:16.749783 22454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 381) took 1251 ms. Trace:
I20260709 12:10:16.760869 24419 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:16.751647 24229 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:16.761618 24434 consensus_queue.cc:1059] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:10:16.762408 22450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 370) took 2294 ms. Trace:
W20260709 12:10:16.899961 23123 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.050s	user 0.003s	sys 0.018s
W20260709 12:10:16.716039 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 52190.4us
I20260709 12:10:16.760946 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:16.767727 24410 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.768306 22530 raft_consensus.cc:2393] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 3: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:16.768512 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:10:16.777779 22600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45562 (request call id 1703) took 1954 ms (client timeout 1599 ms). Trace:
I20260709 12:10:16.049461 24226 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.049950 24242 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.187114 24308 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:16.900290 22450 rpcz_store.cc:276] 0709 12:10:14.433332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.444191 (+ 10859us) service_pool.cc:224] Handling call
0709 12:10:14.444794 (+   603us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:14.507719 (+ 62925us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:14.511084 (+  3365us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:15.101801 (+590717us) spinlock_profiling.cc:243] Waited 4.88 ms on lock 0x7b2c00033c98. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc9227a11 00007f9cc9237372 00007f9cca969a01 00007f9cca92e43a 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2
0709 12:10:15.102214 (+   413us) log.cc:844] Serialized 26 byte log entry
0709 12:10:15.328733 (+226519us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:15.328771 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.740759 (+411988us) spinlock_profiling.cc:243] Waited 8.15 ms on lock 0x7b240013b008. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc76c79c4 00007f9cc76c5acb 00007f9cc7880dc9 00007f9cc7880a55 00007f9cc788009d 00007f9cca4b210e 00007f9cca4c988c 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221
0709 12:10:16.726522 (+985763us) spinlock_profiling.cc:243] Waited 62.5 ms on lock 0x7b54003f1bd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:16.726622 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:16.726689 (+    67us) raft_consensus.cc:1685] finished
0709 12:10:16.726708 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:16.727308 (+   600us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"spinlock_wait_cycles":173630208,"thread_start_us":226164,"threads_started":1,"wal-append.queue_time_us":334600,"wal-append.run_cpu_time_us":5578,"wal-append.run_wall_time_us":1279880}
I20260709 12:10:16.789177 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:16.789495 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:16.790057 22453 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:10:16.796293 24428 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:16.797129 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:16.799144 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 70302.2us
I20260709 12:10:16.814395 24420 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:16.816818 22455 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:10:16.837530 24385 raft_consensus.cc:2749] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:16.806255 24332 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:16.839454 24365 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:16.844460 24426 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:16.852442 22526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 418) took 1401 ms. Trace:
I20260709 12:10:16.440999 24425 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.946398 22526 rpcz_store.cc:276] 0709 12:10:15.450830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.450932 (+   102us) service_pool.cc:224] Handling call
0709 12:10:15.451178 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.584951 (+133773us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.584982 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:15.585023 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:15.585053 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:16.851989 (+1266936us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b54004001d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:16.852058 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:16.852241 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":307247872}
I20260709 12:10:16.835619 24429 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.838840 24315 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:16.853775 22351 catalog_manager.cc:5697] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 2 to 3, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 3 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:16.883302 24411 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:16.896157 24363 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:16.763105 22497 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.314s	user 0.022s	sys 0.011s
I20260709 12:10:16.765643 24412 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.900010 24229 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:16.913192 24409 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:16.899482 24419 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:16.945649 22451 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 3: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:16.899153 22454 rpcz_store.cc:276] 0709 12:10:15.498040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.501000 (+  2960us) service_pool.cc:224] Handling call
0709 12:10:15.501377 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:16.631780 (+1130403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:16.631842 (+    62us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:16.632684 (+   842us) log.cc:844] Serialized 26 byte log entry
0709 12:10:16.714770 (+ 82086us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:16.714835 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:16.735744 (+ 20909us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:16.737831 (+  2087us) raft_consensus.cc:1685] finished
0709 12:10:16.737856 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:16.749701 (+ 11845us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":114772,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":14593,"thread_start_us":1203243,"threads_started":2,"wal-append.queue_time_us":74972}
I20260709 12:10:16.927435 24408 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:16.975858 24435 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:16.927979 23116 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:16.840600 24386 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:16.914023 22600 rpcz_store.cc:269] 0709 12:10:14.823461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.824891 (+  1430us) service_pool.cc:224] Handling call
0709 12:10:15.570858 (+745967us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b58001b3098. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf8f40a0 00007f9ccf8f3984 00007f9cc8e6e6d4 00007f9cc8e6e662
0709 12:10:16.777612 (+1206754us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25089920}
I20260709 12:10:16.924190 24301 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:16.927426 24410 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:16.898209 22456 raft_consensus.cc:2955] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:16.968145 24250 consensus_queue.cc:260] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:17.042932 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:16.841042 22353 rpcz_store.cc:276] 0709 12:10:13.152482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.153335 (+   853us) service_pool.cc:224] Handling call
0709 12:10:13.283827 (+130492us) spinlock_profiling.cc:243] Waited 6.54 ms on lock 0x7b5400198a54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca898090 00007f9cca936f3a 00007f9cd06ece9c 00007f9cd07eb04e 00007f9ccecac2a4 00007f9ccecac232 00007f9ccecac161 00007f9ccecac0dc 00007f9ccecab392 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:16.840272 (+3556445us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:13.601090 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:13.602085 (+   995us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:13.602121 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:10:13.602141 (+    20us) tablet.cc:662] Decoding operations
0709 12:10:13.602479 (+   338us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:13.602524 (+    45us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:13.602557 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:10:13.602734 (+   177us) tablet.cc:701] Row locks acquired
0709 12:10:13.602774 (+    40us) write_op.cc:260] PREPARE: finished
0709 12:10:13.602915 (+   141us) write_op.cc:270] Start()
0709 12:10:13.640235 (+ 37320us) write_op.cc:276] Timestamp: P: 1783599013602872 usec, L: 0
0709 12:10:13.648422 (+  8187us) op_driver.cc:348] REPLICATION: starting
0709 12:10:13.701726 (+ 53304us) log.cc:844] Serialized 544 byte log entry
0709 12:10:14.339581 (+637855us) op_driver.cc:464] REPLICATION: finished
0709 12:10:14.349373 (+  9792us) write_op.cc:301] APPLY: starting
0709 12:10:14.997580 (+648207us) spinlock_profiling.cc:243] Waited 1.16 ms on lock 0x7b54001988a8. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0cea9e1 00007f9cd0ce964c 00007f9cce379e10 00007f9cce36597c 00007f9cce369d61 00007f9cce369d19 00007f9cce369ca9 00007f9cce369c71 00007f9cce368e9d 0000000000388634 0000000000388479
0709 12:10:14.997755 (+   175us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:14.997888 (+   133us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:14.997918 (+    30us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:14.998191 (+   273us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:14.998387 (+   196us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:10:14.998455 (+    68us) write_op.cc:312] APPLY: finished
0709 12:10:14.998703 (+   248us) log.cc:844] Serialized 23 byte log entry
0709 12:10:15.335892 (+337189us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:15.344092 (+  8200us) write_op.cc:454] Released schema lock
0709 12:10:15.346520 (+  2428us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:15.489007 (+142487us) spinlock_profiling.cc:243] Waited 5.29 ms on lock 0x7b180020c560. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc7841522 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd 0000000000388634 0000000000388479 00007f9cc782483a
0709 12:10:15.489120 (+   113us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:15.500836 (+ 11716us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":261856,"reported_tablets":1,"spinlock_wait_cycles":15041408,"child_traces":[["op",{"apply.queue_time_us":4673,"apply.run_cpu_time_us":57143,"apply.run_wall_time_us":1043329,"num_ops":1,"prepare.queue_time_us":10645,"prepare.run_cpu_time_us":3362,"prepare.run_wall_time_us":100974,"replication_time_us":691031,"spinlock_wait_cycles":14832384,"thread_start_us":328147,"threads_started":1,"wal-append.queue_time_us":368911,"wal-append.run_cpu_time_us":1135,"wal-append.run_wall_time_us":1103611}]]}
W20260709 12:10:17.527074 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:17.503237 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 353178us
I20260709 12:10:16.986135 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:17.044891 24387 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:16.979485 22599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43070 (request call id 273) took 2943 ms (client timeout 2046 ms). Trace:
I20260709 12:10:17.587393 22606 raft_consensus.cc:1275] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 12:10:17.586912 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.960740 22455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1330) took 1374 ms. Trace:
I20260709 12:10:17.140401 23123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 747) took 1403 ms. Trace:
I20260709 12:10:17.586959 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:17.587796 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:10:17.699020 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 210939us
I20260709 12:10:17.782280 23122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 640) took 1056 ms. Trace:
I20260709 12:10:16.999424 22525 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 4.
I20260709 12:10:17.725581 24250 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:18.031587 24363 consensus_meta.cc:287] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.991s	user 0.008s	sys 0.003s
I20260709 12:10:17.541839 24332 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:10:17.590386 22497 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.010s	sys 0.006s
I20260709 12:10:17.139701 22523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1281) took 1067 ms. Trace:
I20260709 12:10:18.084510 22606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 1715) took 1353 ms. Trace:
W20260709 12:10:18.086584 22497 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.042s	user 0.018s	sys 0.011s
I20260709 12:10:16.998898 24333 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.087704 23121 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.088055 24414 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
W20260709 12:10:18.033422 22498 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.763s	user 0.003s	sys 0.010s
I20260709 12:10:17.588129 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:17.762419 22496 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:18.087929 24333 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:18.109316 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:18.108944 24414 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:18.087018 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 1.0424e+06us
W20260709 12:10:18.083602 22451 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 383) took 2575 ms (client timeout 2126 ms). Trace:
W20260709 12:10:17.713665 24296 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.010s	sys 0.008s
W20260709 12:10:18.111193 22498 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.841s	user 0.003s	sys 0.012s
W20260709 12:10:17.989888 24422 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.198s	user 0.008s	sys 0.004s
W20260709 12:10:18.089041 22526 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56940 (request call id 1708) took 2099 ms (client timeout 2074 ms). Trace:
I20260709 12:10:18.086488 22606 rpcz_store.cc:276] 0709 12:10:16.731301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.882763 (+151462us) service_pool.cc:224] Handling call
0709 12:10:17.586866 (+704103us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.081312 (+494446us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.084435 (+  3123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:17.698460 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:18.107476 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:17.517374 24420 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:18.103487 22525 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56940 (request call id 1707) took 2133 ms (client timeout 1796 ms). Trace:
I20260709 12:10:17.647799 24427 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.628993 24229 leader_election.cc:290] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:17.958374 24344 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:18.123692 24441 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:18.123998 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:17.125873 24297 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:18.171077 23119 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.077755 22597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 1714) took 1346 ms. Trace:
W20260709 12:10:18.126070 22601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45562 (request call id 1709) took 2223 ms (client timeout 1976 ms). Trace:
W20260709 12:10:18.126284 22569 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.000s	user 0.010s	sys 0.003s
W20260709 12:10:18.129966 24296 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.153s	user 0.017s	sys 0.015s
I20260709 12:10:17.587944 24419 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:17.647903 24411 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:17.560348 24413 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:18.078940 23122 rpcz_store.cc:276] 0709 12:10:16.725597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.732928 (+  7331us) service_pool.cc:224] Handling call
0709 12:10:16.733503 (+   575us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:16.734009 (+   506us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:16.734040 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:16.734771 (+   731us) log.cc:844] Serialized 26 byte log entry
0709 12:10:16.865111 (+130340us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:16.865152 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:16.865214 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:17.781866 (+916652us) raft_consensus.cc:1685] finished
0709 12:10:17.781893 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:17.782069 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":113111,"threads_started":1,"wal-append.queue_time_us":825025}
I20260709 12:10:17.661379 24153 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:17.096741 24315 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:18.081524 22455 rpcz_store.cc:276] 0709 12:10:16.586359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.765127 (+178768us) service_pool.cc:224] Handling call
0709 12:10:17.960515 (+1195388us) spinlock_profiling.cc:243] Waited 40.6 ms on lock 0x7b54002a4c54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:17.960639 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93396736}
I20260709 12:10:17.587147 24210 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:17.770110 24301 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:17.133152 24409 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:16.985210 24426 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.137128 24355 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:17.023454 22351 catalog_manager.cc:5697] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 2 to 3, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 3 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:18.084753 22523 rpcz_store.cc:276] 0709 12:10:15.918629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.918756 (+   127us) service_pool.cc:224] Handling call
0709 12:10:16.178750 (+259994us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:16.256337 (+ 77587us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:16.256381 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:16.256939 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 12:10:16.751570 (+494631us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:16.751660 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:16.751785 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:16.979583 (+227798us) raft_consensus.cc:1685] finished
0709 12:10:16.979608 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:16.985603 (+  5995us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":169232,"raft.queue_time_us":77117,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":31152,"thread_start_us":104816,"threads_started":1,"wal-append.queue_time_us":143365,"wal-append.run_cpu_time_us":2969,"wal-append.run_wall_time_us":1204396}
I20260709 12:10:18.152850 23121 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
W20260709 12:10:18.117192 22451 rpcz_store.cc:269] 0709 12:10:15.498558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.511166 (+ 12608us) service_pool.cc:224] Handling call
0709 12:10:16.789204 (+1278038us) spinlock_profiling.cc:243] Waited 3.18 ms on lock 0x7b5800002a98. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf8f40a0 00007f9ccf8f3984 00007f9cc8e6e6d4 00007f9cc8e6e662
0709 12:10:18.074286 (+1285082us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7312128}
W20260709 12:10:18.167662 22525 rpcz_store.cc:269] 0709 12:10:15.945914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.754894 (+808980us) service_pool.cc:224] Handling call
0709 12:10:18.079357 (+1324463us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.083324 23116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57328 (request call id 752) took 1286 ms. Trace:
I20260709 12:10:18.124758 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:17.648259 24397 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:17.694684 24440 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:10:18.129997 22526 rpcz_store.cc:269] 0709 12:10:15.981185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.042554 (+1061369us) service_pool.cc:224] Handling call
0709 12:10:18.080874 (+1038320us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:18.169334 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.170964 22453 raft_consensus.cc:2393] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 3: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:17.488160 24416 consensus_queue.cc:1048] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.645s
I20260709 12:10:18.125507 24290 consensus_queue.cc:1048] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:18.257501 24427 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:18.153579 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 391275us
I20260709 12:10:18.173534 24308 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:17.096231 24412 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:17.043133 24429 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:18.264585 24451 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.151669 23125 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:18.265218 22523 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56940 (request call id 1709) took 2283 ms (client timeout 2196 ms). Trace:
W20260709 12:10:18.254258 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 79080.9us
W20260709 12:10:18.129869 24422 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.348s	user 0.009s	sys 0.006s
W20260709 12:10:18.176128 22569 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.197s	user 0.010s	sys 0.003s
W20260709 12:10:18.269874 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 1.29061e+06us
I20260709 12:10:18.127086 24337 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:17.502669 24425 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:18.120463 24266 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:18.081981 23123 rpcz_store.cc:276] 0709 12:10:15.737271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.740583 (+  3312us) service_pool.cc:224] Handling call
0709 12:10:15.740854 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.741066 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:15.849243 (+108177us) log.cc:844] Serialized 14 byte log entry
0709 12:10:16.983999 (+1134756us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:17.096995 (+112996us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:17.139946 (+ 42951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:17.140063 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:17.140306 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8643,"raft.run_cpu_time_us":398,"raft.run_wall_time_us":174072,"thread_start_us":1050955,"threads_started":1,"wal-append.queue_time_us":586815,"wal-append.run_cpu_time_us":1337,"wal-append.run_wall_time_us":1062036}
W20260709 12:10:18.176031 22601 rpcz_store.cc:269] 0709 12:10:15.903079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.903668 (+   589us) service_pool.cc:224] Handling call
0709 12:10:18.125845 (+2222177us) spinlock_profiling.cc:243] Waited 640 ms on lock 0x7b5400350cd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:18.125993 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1472632064}
I20260709 12:10:18.182696 24311 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:17.709764 24433 consensus_queue.cc:1059] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.462s
W20260709 12:10:18.286476 22422 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.196.131:37785 timed out after 1.599s (SENT) [suppressed 38 similar messages]
I20260709 12:10:18.200997 24342 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.212399 23119 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
I20260709 12:10:18.104674 24363 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:18.151824 22524 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:17.588366 24385 consensus_queue.cc:1048] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.591s
I20260709 12:10:18.208921 23120 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
W20260709 12:10:18.217166 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 70436.8us
I20260709 12:10:17.971886 24295 consensus_queue.cc:260] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:17.591542 24242 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:17.707031 24226 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:18.127276 24387 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:18.154835 24435 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:18.252461 24332 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.221256 24297 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:18.078174 22599 rpcz_store.cc:269] 0709 12:10:14.035966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.109828 (+ 73862us) service_pool.cc:224] Handling call
0709 12:10:14.824660 (+714832us) spinlock_profiling.cc:243] Waited 4.44 ms on lock 0x7b58001b3098. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf8f40a0 00007f9ccf8f3984 00007f9cc8e6e6d4 00007f9cc8e6e662
0709 12:10:16.718237 (+1893577us) spinlock_profiling.cc:243] Waited 7.24 ms on lock 0x7b58001b3098. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809e9c 00007f9cc7809a5b 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf8f40a0 00007f9ccf8f3984 00007f9cc8e6e6d4 00007f9cc8e6e662
0709 12:10:16.979382 (+261145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26851072}
I20260709 12:10:18.256934 24439 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
W20260709 12:10:18.257145 22526 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56940 (request call id 1704) took 2312 ms (client timeout 2245 ms). Trace:
I20260709 12:10:18.259461 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:18.174070 24441 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:18.222100 24229 raft_consensus.cc:2804] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:18.266121 22523 rpcz_store.cc:269] 0709 12:10:15.981562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.264962 (+2283400us) service_pool.cc:211] Skipping call since client already timed out
0709 12:10:18.265130 (+   168us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:10:18.333106 24229 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.271027 24450 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:18.270970 24443 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:18.272145 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:10:18.282855 22570 connection.cc:256] RPC call timeout handler was delayed by -1.125208597999972s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20040000000000002s for a response
W20260709 12:10:18.269515 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 152918us
I20260709 12:10:17.138531 24365 consensus_queue.cc:1048] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 1.039s
I20260709 12:10:18.292335 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:18.299796 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:18.175899 22597 rpcz_store.cc:276] 0709 12:10:16.730919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.754950 (+ 24031us) service_pool.cc:224] Handling call
0709 12:10:16.858240 (+103290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:16.984547 (+126307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:16.985509 (+   962us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:17.050095 (+ 64586us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:17.098020 (+ 47925us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:17.124870 (+ 26850us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.067214 (+942344us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.303059 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:18.265305 24315 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:18.285455 24426 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:18.260223 24411 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:18.226101 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:18.268186 24409 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:18.304596 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:18.308063 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 193679us
I20260709 12:10:18.285681 24301 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
W20260709 12:10:18.322238 22526 rpcz_store.cc:269] 0709 12:10:15.945108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.256860 (+2311752us) service_pool.cc:211] Skipping call since client already timed out
0709 12:10:18.257056 (+   196us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:10:18.225772 23116 rpcz_store.cc:276] 0709 12:10:16.788288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.788640 (+   352us) service_pool.cc:224] Handling call
0709 12:10:18.067632 (+1278992us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.324118 24414 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:18.307691 22495 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:10:18.287003 24210 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:18.327515 24437 log.cc:927] Time spent T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 12:10:18.327209 22569 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:18.328114 24332 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:18.328007 24266 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:18.331326 24386 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:18.331586 24363 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:18.290719 24397 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:18.332156 24333 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:18.453305 24400 raft_consensus.cc:3055] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:18.453912 24400 raft_consensus.cc:740] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
W20260709 12:10:18.454041 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 151774us
I20260709 12:10:18.332135 24429 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:18.283779 24355 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:18.321952 22496 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:18.265205 24451 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:18.302596 22529 raft_consensus.cc:2955] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:18.333600 24229 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.453806 24333 raft_consensus.cc:2749] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:18.304118 22524 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56942 (request call id 1284) took 2361 ms (client timeout 2003 ms). Trace:
I20260709 12:10:18.412575 22525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1288) took 2462 ms. Trace:
I20260709 12:10:18.397184 22523 raft_consensus.cc:1275] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:18.477564 23125 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5.
I20260709 12:10:18.409931 23121 raft_consensus.cc:2468] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 2.
W20260709 12:10:18.361804 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 56286.9us
I20260709 12:10:18.497033 22604 raft_consensus.cc:2393] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 2: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:18.302681 24442 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.288156 24413 consensus_queue.cc:1048] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
W20260709 12:10:18.487828 22570 connection.cc:256] RPC call timeout handler was delayed by -1.0874085979999109s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2046s for a response
I20260709 12:10:18.497486 22606 raft_consensus.cc:2393] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 6: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:18.377658 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:18.500874 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.326680 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:18.422011 24410 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:18.497905 22525 rpcz_store.cc:276] 0709 12:10:15.944248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.322865 (+2378617us) service_pool.cc:224] Handling call
0709 12:10:18.367431 (+ 44566us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.384174 (+ 16743us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.384200 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:18.405553 (+ 21353us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:18.405607 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.405685 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.405808 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.499310 24429 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:18.376904 24226 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:18.380913 24320 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:18.500455 22570 connection.cc:256] RPC call timeout handler was delayed by -1.0874085979999109s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2046s for a response
I20260709 12:10:18.505000 24453 consensus_queue.cc:1048] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
W20260709 12:10:18.508103 22570 connection.cc:256] RPC call timeout handler was delayed by -1.0581260160001875s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1652s for a response
I20260709 12:10:18.503301 22523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 1705) took 2554 ms. Trace:
W20260709 12:10:18.506477 23125 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57318 (request call id 634) took 3072 ms (client timeout 2196 ms). Trace:
I20260709 12:10:18.508319 22569 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:18.508637 22523 rpcz_store.cc:276] 0709 12:10:15.945369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.333347 (+2387978us) service_pool.cc:224] Handling call
0709 12:10:18.333734 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.497677 (+163943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.499609 (+  1932us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:18.508809 23125 rpcz_store.cc:269] 0709 12:10:15.430286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.430670 (+   384us) service_pool.cc:224] Handling call
0709 12:10:18.109007 (+2678337us) spinlock_profiling.cc:243] Waited 2.9 ms on lock 0x7b5800110198. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf8f40a0 00007f9ccf8f3984 00007f9cc8e6e6d4 00007f9cc8e6e662
0709 12:10:18.502551 (+393544us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6664064}
I20260709 12:10:18.509487 24384 raft_consensus.cc:2804] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:18.510471 24384 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.431787 24408 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:18.511464 22570 connection.cc:256] RPC call timeout handler was delayed by -1.0012137819999225s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17880000000000001s for a response
I20260709 12:10:18.510811 24384 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.513458 24242 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:18.509478 22569 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:10:18.513800 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 211950us
I20260709 12:10:18.515743 24451 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:18.307706 24440 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:18.519884 22422 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:18.322371 24311 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:18.497031 22524 rpcz_store.cc:269] 0709 12:10:15.942799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.880108 (+937309us) service_pool.cc:224] Handling call
0709 12:10:18.304024 (+1423916us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.498739 24301 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:18.528308 22569 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:18.529218 24226 raft_consensus.cc:2804] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:18.531451 24386 raft_consensus.cc:2804] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:18.534137 22531 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:18.535494 24226 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:18.539366 24226 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.540895 24427 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:18.537128 24386 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.543376 24412 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:18.543768 22603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43070 (request call id 291) took 2955 ms. Trace:
W20260709 12:10:18.544134 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 259949us
I20260709 12:10:18.545146 24422 raft_consensus.cc:2804] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:18.545570 24422 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.546006 24422 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.543505 24386 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.522810 24242 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.519788 23118 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:10:18.523625 22600 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:10:18.554097 22526 raft_consensus.cc:1275] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:18.544139 22603 rpcz_store.cc:276] 0709 12:10:15.588525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.588667 (+   142us) service_pool.cc:224] Handling call
0709 12:10:15.588920 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.738573 (+149653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.543339 (+2804766us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b5400449654. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:18.543572 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":342395648}
I20260709 12:10:18.559587 22526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 1706) took 2614 ms. Trace:
I20260709 12:10:18.559999 22526 rpcz_store.cc:276] 0709 12:10:15.945650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.494492 (+2548842us) service_pool.cc:224] Handling call
0709 12:10:18.519797 (+ 25305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.557266 (+ 37469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.559524 (+  2258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.561506 22456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1332) took 1974 ms. Trace:
W20260709 12:10:18.557920 22531 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56942 (request call id 1282) took 2610 ms (client timeout 2057 ms). Trace:
I20260709 12:10:18.520138 24429 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:18.499646 24400 consensus_queue.cc:260] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:18.520850 24443 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:18.544145 24425 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:18.534775 24411 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:18.521073 24409 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:18.598562 24266 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:18.584796 23124 raft_consensus.cc:1275] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:10:18.563004 22531 rpcz_store.cc:269] 0709 12:10:15.942108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.942283 (+   175us) service_pool.cc:224] Handling call
0709 12:10:18.377348 (+2435065us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b5800037898. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf8f40a0 00007f9ccf8f3984 00007f9cc8e6e6d4 00007f9cc8e6e662
0709 12:10:18.552038 (+174690us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38798592}
I20260709 12:10:18.551335 22450 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 1.
I20260709 12:10:18.590951 22448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1326) took 3157 ms. Trace:
I20260709 12:10:18.560664 24412 raft_consensus.cc:2804] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:18.600966 24412 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.601692 24412 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.595774 24400 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:18.587177 22602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43070 (request call id 290) took 3014 ms. Trace:
I20260709 12:10:18.599366 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:18.397205 24439 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:18.604590 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 299961us
I20260709 12:10:18.607123 24325 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:18.587371 24435 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:18.605701 22602 rpcz_store.cc:276] 0709 12:10:15.572790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.573277 (+   487us) service_pool.cc:224] Handling call
0709 12:10:15.573633 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:16.814739 (+1241106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.556553 (+1741814us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54003aded4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:18.587105 (+ 30552us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2851561344}
I20260709 12:10:18.612898 23124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 741) took 3250 ms. Trace:
I20260709 12:10:18.598587 24210 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:18.600736 22448 rpcz_store.cc:276] 0709 12:10:15.433515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.434304 (+   789us) service_pool.cc:224] Handling call
0709 12:10:15.434573 (+   269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:16.734715 (+1300142us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:16.734762 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:16.740971 (+  6209us) log.cc:844] Serialized 26 byte log entry
0709 12:10:16.945034 (+204063us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:16.945074 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:16.969800 (+ 24726us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:18.590727 (+1620927us) raft_consensus.cc:1685] finished
0709 12:10:18.590750 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.590885 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4530,"raft.queue_time_us":140986,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":2812,"thread_start_us":1471638,"threads_started":2,"wal-append.queue_time_us":1358282}
W20260709 12:10:18.660145 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 53728.5us
I20260709 12:10:18.653442 23125 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:18.596081 24242 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:18.532698 24450 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:18.692899 22569 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:18.693640 24425 raft_consensus.cc:2804] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:18.694025 24425 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.694348 22569 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:18.694377 24425 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.696008 24453 raft_consensus.cc:2804] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:18.696252 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:18.697080 22455 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:10:18.619455 23124 rpcz_store.cc:276] 0709 12:10:15.355929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.357759 (+  1830us) service_pool.cc:224] Handling call
0709 12:10:18.531231 (+3173472us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b5800110198. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf907fc0 00007f9ccf8f2929 00007f9ccf8f23d2 00007f9cc8e69bd4
0709 12:10:18.531623 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.600005 (+ 68382us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.606463 (+  6458us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3012992}
W20260709 12:10:18.697966 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 105968us
I20260709 12:10:18.696425 24453 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.536299 24442 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:18.658876 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:18.680447 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:18.608991 24301 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:18.718429 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:18.703272 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:18.611873 24325 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.720590 22453 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 1.
I20260709 12:10:18.681378 24440 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:18.721454 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:18.722760 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:18.682121 24443 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:18.720659 23122 raft_consensus.cc:2468] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 4.
I20260709 12:10:18.652097 24435 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:18.701861 24453 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.727255 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:18.727794 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:18.726637 24447 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.731150 24153 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:18.731362 22497 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:18.733494 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:18.702705 24426 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:18.736836 22451 raft_consensus.cc:2468] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:18.718091 24451 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.729519 24315 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:18.742352 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:18.723660 24364 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.738545 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:18.717952 24308 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:10:18.738942 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 46604.8us
I20260709 12:10:18.734745 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:18.700021 24397 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:18.724498 24332 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:18.726241 24325 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:18.743672 24451 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:18.749069 24439 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:18.749513 24405 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.750043 24308 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:18.742096 23119 raft_consensus.cc:2376] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3. Re-sending same reply.
I20260709 12:10:18.760285 22454 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:18.727274 24387 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:18.758896 22422 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:18.758181 22527 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:18.744974 22448 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:10:18.765321 24450 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:18.765935 22527 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56942 (request call id 1279) took 2846 ms (client timeout 1550 ms). Trace:
I20260709 12:10:18.765426 24243 raft_consensus.cc:2749] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:18.765388 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:18.768980 23121 raft_consensus.cc:2376] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5. Re-sending same reply.
W20260709 12:10:18.766400 22527 rpcz_store.cc:269] 0709 12:10:15.917129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.917285 (+   156us) service_pool.cc:224] Handling call
0709 12:10:18.651567 (+2734282us) spinlock_profiling.cc:243] Waited 42.4 ms on lock 0x7b5800037898. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf8f40a0 00007f9ccf8f3984 00007f9cc8e6e6d4 00007f9cc8e6e662
0709 12:10:18.763937 (+112370us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":97488128}
I20260709 12:10:18.770363 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:18.766227 24435 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:18.763252 23124 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 2.
W20260709 12:10:18.780113 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 54022.3us
I20260709 12:10:18.778971 22451 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:18.752900 24409 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:18.754588 24447 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:18.784893 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 53723.3us
I20260709 12:10:18.785769 22497 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:18.761265 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:18.763734 24332 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.789546 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:18.790870 22455 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.793139 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:18.795746 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:18.797113 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:18.797722 23123 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:10:18.793205 24413 raft_consensus.cc:2749] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:18.758363 24153 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:18.799263 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:18.800081 22453 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 1.
I20260709 12:10:18.800525 24442 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:18.800736 24153 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:18.799335 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:18.803733 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:18.804738 22448 raft_consensus.cc:2393] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 4: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:18.774286 24311 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:18.811322 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:18.787096 24440 raft_consensus.cc:2804] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:18.810681 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:18.808768 24332 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:18.814895 23119 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:10:18.816859 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:18.817787 23119 raft_consensus.cc:2410] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:18.780114 23118 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:18.812668 22451 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
I20260709 12:10:18.819959 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:18.782876 24405 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:18.821732 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:18.822175 22603 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 3.
I20260709 12:10:18.822424 24429 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:18.822923 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:18.824021 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:18.823925 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:18.825192 23123 raft_consensus.cc:2393] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 4: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:18.826287 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:18.827332 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:18.828446 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:18.829053 22451 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:10:18.823926 24242 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:18.831465 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 44580.5us
I20260709 12:10:18.832762 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:18.833180 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:18.839071 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:18.839672 22448 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 3.
I20260709 12:10:18.840402 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:18.838090 22422 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:18.843151 24243 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:18.843417 24451 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:18.843832 24243 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:18.818403 24440 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:18.848134 24440 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.845602 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:18.835875 24397 consensus_queue.cc:1048] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:10:18.812870 24384 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:18.819082 24412 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:18.820436 24422 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:18.802012 24364 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:18.993366 24243 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:18.903220 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:18.964319 22455 raft_consensus.cc:2410] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:18.956682 22569 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:18.994634 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:19.002147 23122 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 2.
I20260709 12:10:18.822356 22600 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 3.
I20260709 12:10:18.856302 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:18.898744 24442 raft_consensus.cc:2804] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:18.910387 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:18.875325 23124 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 3.
I20260709 12:10:18.863632 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:18.865410 23119 raft_consensus.cc:2468] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 1.
I20260709 12:10:19.009297 22526 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:18.879607 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 45300.9us
W20260709 12:10:19.004063 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 52496.7us
I20260709 12:10:18.973258 24465 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:18.845055 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:19.000905 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:18.911324 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:19.007684 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:18.863576 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:18.863981 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:19.012148 22569 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:19.022607 24435 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:19.022912 22569 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:19.023196 24343 raft_consensus.cc:2804] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:19.023582 24343 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:19.008963 24442 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.909982 24242 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.007390 24315 raft_consensus.cc:2804] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:19.028294 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:18.909430 24429 consensus_queue.cc:1048] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.108s
I20260709 12:10:18.976629 24229 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:19.040277 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:18.875401 24446 consensus_queue.cc:1048] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.139s
I20260709 12:10:19.026278 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:19.004329 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:19.021481 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:19.012557 23116 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:10:18.909310 24311 consensus_queue.cc:1048] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.115s
I20260709 12:10:19.023959 24348 raft_consensus.cc:2804] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:19.023910 22569 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:19.023934 24343 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:19.045998 22527 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:10:19.046250 24308 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:19.046658 24381 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:19.027958 24315 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.058162 22569 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:19.028241 24442 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.043036 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:19.050760 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:19.039772 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:19.056195 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:19.058430 22531 raft_consensus.cc:2393] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 3: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:19.047173 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:19.024680 24465 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:19.062425 22529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1280) took 3139 ms. Trace:
I20260709 12:10:19.060063 22569 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:19.054442 24348 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.050084 24425 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:19.049628 24242 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:19.203951 22526 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
I20260709 12:10:19.195921 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:19.064440 22448 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 1.
I20260709 12:10:19.202311 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:19.093842 23123 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:19.189028 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:18.600678 24455 consensus_queue.cc:1175] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6c6fa11e8ee34711b3551f0c670442bc" responder_term: 1 status { last_received { term: 1 index: 3 } last_committed_idx: 3 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)" } } last_received_current_leader { term: 1 index: 3 } }
I20260709 12:10:19.214545 22529 rpcz_store.cc:276] 0709 12:10:15.917916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.918045 (+   129us) service_pool.cc:224] Handling call
0709 12:10:18.110093 (+2192048us) spinlock_profiling.cc:243] Waited 41.9 ms on lock 0x7b5800037898. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf907fc0 00007f9ccf8f2929 00007f9ccf8f23d2 00007f9cc8e69bd4
0709 12:10:18.120486 (+ 10393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.167726 (+ 47240us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:18.937608 (+769882us) log.cc:844] Serialized 14 byte log entry
0709 12:10:19.057025 (+119417us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:19.057069 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:19.057115 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:19.057171 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:19.057272 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3017,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":33135,"spinlock_wait_cycles":96384768,"thread_start_us":59850,"threads_started":1,"wal-append.queue_time_us":222479}
I20260709 12:10:19.281140 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:19.277598 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:19.274685 22603 raft_consensus.cc:2393] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 4: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:19.275167 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:19.279170 23125 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
W20260709 12:10:19.280735 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 220705us
I20260709 12:10:19.309700 22526 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:19.275081 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:19.059134 24439 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:19.101475 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:19.195520 24226 consensus_meta.cc:287] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.656s	user 0.010s	sys 0.003s
I20260709 12:10:19.327443 22527 raft_consensus.cc:2376] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4. Re-sending same reply.
I20260709 12:10:19.329893 22569 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:19.335449 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:19.195520 24400 consensus_meta.cc:287] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.589s	user 0.011s	sys 0.000s
W20260709 12:10:19.159224 24468 log.cc:927] Time spent T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.319s	user 0.002s	sys 0.000s
I20260709 12:10:19.063956 24426 raft_consensus.cc:2804] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:19.169121 24469 log.cc:927] Time spent T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 12:10:19.068878 22451 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
W20260709 12:10:19.325987 24453 consensus_meta.cc:287] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.575s	user 0.011s	sys 0.000s
I20260709 12:10:19.203022 24238 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.282343 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:19.189875 24386 consensus_meta.cc:287] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.604s	user 0.009s	sys 0.001s
I20260709 12:10:19.196130 24384 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:19.276341 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:19.337553 24439 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.173146 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:19.186765 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:19.187809 24260 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.204401 24250 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.279762 24422 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:19.198946 24446 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.359869 24453 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:19.389891 24250 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:19.390461 24440 consensus_meta.cc:287] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.542s	user 0.010s	sys 0.001s
I20260709 12:10:19.391062 24465 leader_election.cc:290] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:19.390928 24440 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:19.392351 24453 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:19.190825 24447 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:19.393740 24316 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:19.393893 24440 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:19.199648 24364 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:19.394285 24316 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:19.341003 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:19.394798 24316 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:19.395052 22529 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:19.396152 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:19.396833 22529 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:19.397688 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:19.398322 22529 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:10:19.102319 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:19.360270 23124 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 1.
I20260709 12:10:19.062372 24315 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.323949 24229 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:19.326108 24333 raft_consensus.cc:2804] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:19.337141 24412 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:19.337081 24243 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.366838 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:19.365209 22421 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:19.373365 24442 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:19.411550 24465 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.412145 24465 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:19.413548 24442 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:19.414253 24442 raft_consensus.cc:2749] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:19.414458 24465 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:19.347560 24426 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:19.415130 24426 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.385960 24242 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:19.392361 24250 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:19.417151 22600 raft_consensus.cc:2393] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 3: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:19.418337 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:19.375648 24471 log.cc:927] Time spent T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.211s	user 0.000s	sys 0.000s
I20260709 12:10:19.382622 22448 raft_consensus.cc:1240] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:10:19.420090 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:19.420997 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:19.421627 22602 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 2.
I20260709 12:10:19.421518 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:19.422451 22448 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 3.
I20260709 12:10:19.422724 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:19.424353 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:19.424939 22602 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:10:19.425304 24332 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:19.425731 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:19.428321 24405 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:19.373270 24297 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:19.430253 24153 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:19.430915 24153 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:19.433456 24153 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:19.441530 24447 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.442229 24447 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:19.444834 24447 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:19.342425 24226 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:19.399781 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:19.447631 22449 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 5.
W20260709 12:10:19.448226 23087 connection.cc:256] RPC call timeout handler was delayed by -2.0055854309998722s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2126s for a response
W20260709 12:10:19.448697 23087 connection.cc:256] RPC call timeout handler was delayed by -1.796785430999762s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2358s for a response
I20260709 12:10:19.448982 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:19.405509 24333 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.451510 24333 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.451912 24226 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:19.368291 24439 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.382961 22606 raft_consensus.cc:1240] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:19.386701 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:19.384239 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:19.387133 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 57333.3us
I20260709 12:10:19.385159 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:19.349133 24425 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:19.112123 24325 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:19.385623 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:19.367594 24386 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:19.383837 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:19.463994 22455 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:10:19.390202 24446 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:19.283133 24348 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.402684 22526 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:10:19.450799 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:19.384987 22457 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 377) took 3888 ms. Trace:
W20260709 12:10:19.406911 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.409058 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:19.475648 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:19.472965 22525 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:18.561822 22456 rpcz_store.cc:276] 0709 12:10:16.587512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.897170 (+309658us) service_pool.cc:224] Handling call
0709 12:10:16.897539 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:16.897961 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:18.384398 (+1486437us) log.cc:844] Serialized 14 byte log entry
0709 12:10:18.561257 (+176859us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:18.561298 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:18.561335 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.561381 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.561460 (+    79us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7328,"raft.queue_time_us":13059,"thread_start_us":46398,"threads_started":1}
W20260709 12:10:19.411376 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 46277.7us
I20260709 12:10:19.478291 22421 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:19.479277 22421 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:19.480247 22569 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:19.440048 24441 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:19.460500 22527 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:19.399190 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:19.409246 22603 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.481941 22529 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:19.478850 24425 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.483573 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:19.483983 24412 raft_consensus.cc:2804] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:19.484292 22606 raft_consensus.cc:2393] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 4: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:19.484432 24412 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.484841 24412 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.485184 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:19.486186 22451 raft_consensus.cc:2393] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 5: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:19.487026 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:19.487520 22451 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.484683 22526 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:10:19.488912 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:19.490602 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:19.490854 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:19.491418 22526 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:19.491533 22527 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:19.483732 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:19.492801 22455 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.493212 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:19.493594 22421 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:19.494514 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:19.495641 22531 raft_consensus.cc:2393] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 3: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:19.498081 22601 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 2.
I20260709 12:10:19.499276 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:19.500419 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:19.501262 23119 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:10:19.505271 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:19.505908 22456 raft_consensus.cc:2468] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:19.507297 22602 raft_consensus.cc:2393] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 6: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:19.507405 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:19.508822 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.506537 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:19.510885 22454 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.513170 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:19.513795 23124 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:19.514132 24446 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:19.492875 22524 raft_consensus.cc:2410] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:10:19.515609 22421 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:10:19.516705 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.519375 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:19.519537 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:19.454725 24316 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:19.517076 22526 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 3.
I20260709 12:10:19.473878 22457 rpcz_store.cc:276] 0709 12:10:15.496797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.496930 (+   133us) service_pool.cc:224] Handling call
0709 12:10:18.691614 (+3194684us) spinlock_profiling.cc:243] Waited 4.15 ms on lock 0x7b5800002a98. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf907fc0 00007f9ccf8f2929 00007f9ccf8f23d2 00007f9cc8e69bd4
0709 12:10:18.715504 (+ 23890us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:18.724137 (+  8633us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.724174 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:18.732305 (+  8131us) log.cc:844] Serialized 26 byte log entry
0709 12:10:18.839234 (+106929us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:18.839271 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.839334 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:19.384548 (+545214us) raft_consensus.cc:1685] finished
0709 12:10:19.384576 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:19.384809 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1248,"raft.queue_time_us":6649,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":10974,"spinlock_wait_cycles":11457664,"thread_start_us":106433,"threads_started":1,"wal-append.queue_time_us":106942}
I20260709 12:10:19.500222 24440 raft_consensus.cc:2804] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:19.520695 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:10:19.517750 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 179508us
I20260709 12:10:19.521291 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:19.461615 24343 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:19.522964 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:19.500478 24226 raft_consensus.cc:2804] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:19.514760 24441 raft_consensus.cc:2804] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:19.525676 23122 raft_consensus.cc:2376] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3. Re-sending same reply.
I20260709 12:10:19.528277 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:19.528119 22601 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 4.
I20260709 12:10:19.531451 22529 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:10:19.529899 22421 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:19.530584 22497 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:19.522264 22531 raft_consensus.cc:1275] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:19.530000 22606 raft_consensus.cc:2376] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3. Re-sending same reply.
I20260709 12:10:19.483780 24425 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:19.534194 22569 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:19.536446 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:19.540320 22457 raft_consensus.cc:2393] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 3: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:19.499780 24243 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:19.542181 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:19.543708 22526 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 3.
I20260709 12:10:19.527179 24440 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:19.546898 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:19.547369 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:19.551242 24297 raft_consensus.cc:2804] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:19.553164 24440 raft_consensus.cc:3060] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.553402 24297 raft_consensus.cc:697] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:19.553547 24386 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:19.541692 24447 raft_consensus.cc:2804] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:19.554468 24447 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.554877 24447 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.554564 24297 consensus_queue.cc:237] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:19.557607 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:19.558521 22532 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56942 (request call id 1274) took 3672 ms (client timeout 1534 ms). Trace:
I20260709 12:10:19.534780 24226 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.559185 24226 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:19.558952 22532 rpcz_store.cc:269] 0709 12:10:15.885671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.885801 (+   130us) service_pool.cc:224] Handling call
0709 12:10:19.557267 (+3671466us) spinlock_profiling.cc:243] Waited 60.6 ms on lock 0x7b5800037898. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf8f40a0 00007f9ccf8f3984 00007f9cc8e6e6d4 00007f9cc8e6e662
0709 12:10:19.558439 (+  1172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":139298560}
I20260709 12:10:19.560000 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:19.561059 22527 raft_consensus.cc:2393] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 3: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:19.533602 24441 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
W20260709 12:10:19.575527 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 45064.2us
I20260709 12:10:19.575531 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:19.582324 22451 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
I20260709 12:10:19.577023 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:19.582324 22603 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 4.
W20260709 12:10:19.584379 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 50249.1us
I20260709 12:10:19.552304 24442 raft_consensus.cc:2804] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:19.586352 24442 raft_consensus.cc:697] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:19.587025 24405 raft_consensus.cc:2804] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:19.583954 24441 raft_consensus.cc:3060] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.587466 24442 consensus_queue.cc:237] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:19.597296 23089 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.017s	sys 0.018s
W20260709 12:10:19.597666 23089 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.017s	sys 0.018s
I20260709 12:10:19.601372 22421 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:10:19.598016 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 723115us
I20260709 12:10:19.587473 24405 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.613884 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:19.614809 22603 raft_consensus.cc:2393] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 4: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:19.590638 22524 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:10:19.595381 24411 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:19.616822 24405 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.626175 23087 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:19.622905 24435 raft_consensus.cc:2804] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:19.635214 22530 raft_consensus.cc:2410] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 3 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:10:19.636520 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:19.637096 22455 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
I20260709 12:10:19.645349 24439 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:19.646576 22601 raft_consensus.cc:2393] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 4: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:19.648447 24439 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:19.649380 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:19.649972 22603 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 3.
I20260709 12:10:19.650825 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:19.652009 22497 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:19.653532 23121 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:19.653928 24317 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:19.654316 24446 raft_consensus.cc:2804] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:19.654743 24446 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.703317 22422 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:10:19.651213 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 46495.6us
I20260709 12:10:19.754796 22603 raft_consensus.cc:2393] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 4: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:19.761662 22604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45562 (request call id 1720) took 1495 ms. Trace:
I20260709 12:10:19.762127 22604 rpcz_store.cc:276] 0709 12:10:18.265958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.283684 (+ 17726us) service_pool.cc:224] Handling call
0709 12:10:19.761462 (+1477778us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b5400044054. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:19.761597 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46818176}
I20260709 12:10:19.763758 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:19.636475 24435 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:19.634182 24325 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:10:19.765635 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 62562.5us
I20260709 12:10:19.662323 23089 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:10:19.768383 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 106145us
I20260709 12:10:19.754937 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:19.769511 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:19.769742 22455 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:19.756889 22570 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:19.654846 24316 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:19.772233 22422 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:19.752101 24364 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.663542 24425 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:19.757241 24446 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:19.816814 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 215473us
I20260709 12:10:19.816992 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:19.798498 22570 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:19.817692 22602 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:10:19.771051 24435 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.655831 24243 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:19.783684 22528 raft_consensus.cc:1275] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:19.781311 22422 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:19.788193 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:19.792981 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:19.794179 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:19.812981 22455 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:10:19.832278 22453 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:19.795379 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:19.832554 22606 raft_consensus.cc:2393] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 2: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:19.821012 22454 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:19.779029 23089 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:19.638180 24381 consensus_queue.cc:1059] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.137s
I20260709 12:10:19.661855 24260 consensus_queue.cc:1059] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.120s
I20260709 12:10:19.824915 24331 raft_consensus.cc:2764] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:10:19.785583 24420 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.827160 22570 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:19.827740 24425 raft_consensus.cc:2749] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:19.702687 24226 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:19.771482 24153 raft_consensus.cc:2804] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:19.802152 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:19.833422 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 52187us
I20260709 12:10:19.829236 24412 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:19.842582 22422 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:19.833519 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:19.661262 24440 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:19.819165 24325 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:19.833062 22531 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 3.
I20260709 12:10:19.834656 22528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1278) took 3918 ms. Trace:
I20260709 12:10:19.836687 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:10:19.848270 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 69372.8us
I20260709 12:10:19.848910 23123 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.783775 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:19.841514 22570 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:19.851778 22570 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:19.843806 22497 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:19.851895 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:19.835983 24409 raft_consensus.cc:2804] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:19.834689 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:19.853806 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:19.854475 22602 raft_consensus.cc:2393] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 3: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:19.854386 22422 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:19.842411 22604 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 3.
I20260709 12:10:19.769723 24447 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:19.848325 22528 rpcz_store.cc:276] 0709 12:10:15.916361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.916506 (+   145us) service_pool.cc:224] Handling call
0709 12:10:19.782953 (+3866447us) spinlock_profiling.cc:243] Waited 43.3 ms on lock 0x7b5800037898. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf907fc0 00007f9ccf8f2929 00007f9ccf8f23d2 00007f9cc8e69bd4
0709 12:10:19.783223 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:19.831072 (+ 47849us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:19.834602 (+  3530us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99587968}
I20260709 12:10:19.656961 24315 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:19.819921 24426 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:19.846341 24260 raft_consensus.cc:3055] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:19.853543 24409 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.862160 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:19.866554 22603 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 6.
I20260709 12:10:19.860862 22570 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:19.861639 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:19.859871 22422 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:10:19.847402 24483 raft_consensus.cc:2804] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:19.845997 24153 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:19.840153 24316 consensus_queue.cc:1048] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:10:19.853399 22449 raft_consensus.cc:1240] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:10:19.853278 24425 raft_consensus.cc:2749] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:19.853643 24325 raft_consensus.cc:697] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:19.926101 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:19.861765 24242 raft_consensus.cc:2804] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:19.915593 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:19.886659 24409 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.924978 22598 raft_consensus.cc:2393] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 5: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:19.862037 24478 raft_consensus.cc:2804] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:19.935367 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 74624.1us
I20260709 12:10:19.922709 24483 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.940496 24426 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:19.958469 22452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 380) took 4283 ms. Trace:
I20260709 12:10:19.958892 22452 rpcz_store.cc:276] 0709 12:10:15.497787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.499353 (+  1566us) service_pool.cc:224] Handling call
0709 12:10:15.499712 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:15.632144 (+132432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.632200 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:15.634420 (+  2220us) log.cc:844] Serialized 26 byte log entry
0709 12:10:16.085469 (+451049us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:16.085626 (+   157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:19.764376 (+3678750us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b54002a5154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:19.764451 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:19.764508 (+    57us) raft_consensus.cc:1685] finished
0709 12:10:19.764519 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:19.781031 (+ 16512us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1176,"raft.queue_time_us":24307,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":13018,"spinlock_wait_cycles":303682432,"thread_start_us":450634,"threads_started":1,"wal-append.queue_time_us":799332,"wal-append.run_cpu_time_us":2002,"wal-append.run_wall_time_us":1066385}
I20260709 12:10:19.960484 24343 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:19.940924 22597 raft_consensus.cc:2393] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 3: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:19.863659 24243 raft_consensus.cc:2804] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:19.865739 24260 raft_consensus.cc:740] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:19.859187 24491 raft_consensus.cc:2804] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:19.950954 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:19.941411 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 81622.2us
I20260709 12:10:19.986043 22422 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:19.925110 24331 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:19.953646 22570 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:19.954788 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:19.955549 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:19.955160 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:19.957599 23118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57328 (request call id 758) took 1339 ms. Trace:
I20260709 12:10:19.932945 24153 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.935809 24439 raft_consensus.cc:2804] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:19.990131 22523 raft_consensus.cc:2468] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:19.992269 22523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56942 (request call id 1293) took 1147 ms. Trace:
I20260709 12:10:19.985087 22600 raft_consensus.cc:2393] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 3: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:19.992581 22523 rpcz_store.cc:276] 0709 12:10:18.844694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.376950 (+532256us) service_pool.cc:224] Handling call
0709 12:10:19.955371 (+578421us) spinlock_profiling.cc:243] Waited 9.23 ms on lock 0x7b5800037898. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf8f40a0 00007f9ccf8f3984 00007f9cc8e6e6d4 00007f9cc8e6e662
0709 12:10:19.992214 (+ 36843us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21218048}
I20260709 12:10:19.996477 22602 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 2.
I20260709 12:10:19.955405 24478 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.999398 22422 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
W20260709 12:10:19.999761 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 167760us
I20260709 12:10:20.001572 22570 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:20.002384 22570 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:19.987977 24442 raft_consensus.cc:2804] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:19.977797 24483 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.935101 24242 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:20.004967 24384 raft_consensus.cc:2749] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:19.998811 24325 consensus_queue.cc:237] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:19.988519 24491 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.987829 24243 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:20.007823 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:20.023840 22454 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:20.008143 22570 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:20.013388 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:20.015554 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:19.954640 24348 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:20.003832 24478 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.994660 24430 raft_consensus.cc:2749] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:20.024662 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:20.017910 22453 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:20.025069 22452 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:19.995558 24439 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:20.026696 22570 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:20.024048 22523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
 from {username='slave'} at 127.0.0.1:39980
W20260709 12:10:19.988896 22598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45562 (request call id 1721) took 1719 ms (client timeout 1589 ms). Trace:
I20260709 12:10:20.006633 24316 raft_consensus.cc:2804] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:20.038019 22523 raft_consensus.cc:606] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Received request to transfer leadership to TS c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:20.023149 24242 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:20.012773 24489 raft_consensus.cc:2749] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:10:20.044673 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.059619 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:20.067356 22599 raft_consensus.cc:2393] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 4: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:20.067248 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:20.051295 24316 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:20.068331 24316 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:20.068993 24441 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:20.051874 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 63631.7us
I20260709 12:10:20.072928 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:10:20.022151 24429 raft_consensus.cc:2804] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:20.074187 24429 raft_consensus.cc:697] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:20.025154 24243 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:20.022812 24442 raft_consensus.cc:697] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:20.077566 22452 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:10:20.067365 24384 raft_consensus.cc:2804] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:20.037897 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:19.991334 23118 rpcz_store.cc:276] 0709 12:10:18.618679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.624778 (+  6099us) service_pool.cc:224] Handling call
0709 12:10:19.957418 (+1332640us) spinlock_profiling.cc:243] Waited 47.1 ms on lock 0x7b540069ffd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:19.957539 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":108345728}
I20260709 12:10:20.025708 24491 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:20.033370 24440 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:20.033650 24343 raft_consensus.cc:2804] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:20.087661 22570 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:20.101181 23123 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:10:20.040464 24439 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:20.105654 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:20.104628 22454 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
I20260709 12:10:20.106546 24489 raft_consensus.cc:2804] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:20.107209 24489 raft_consensus.cc:697] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:20.108582 24447 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:20.108273 24489 consensus_queue.cc:237] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:20.110620 24226 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:20.080363 24429 consensus_queue.cc:237] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:20.115460 24412 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:20.100556 24343 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:20.116770 24343 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:20.117053 24295 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:20.121052 22530 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56940 (request call id 1702) took 4176 ms (client timeout 2003 ms). Trace:
I20260709 12:10:20.118849 24316 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:20.121467 22530 rpcz_store.cc:269] 0709 12:10:15.944560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.947505 (+1002945us) service_pool.cc:224] Handling call
0709 12:10:20.120864 (+3173359us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b54003f0cd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:20.120988 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3589519616}
I20260709 12:10:20.122546 23125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57332 (request call id 450) took 1306 ms. Trace:
W20260709 12:10:20.039754 22598 rpcz_store.cc:269] 0709 12:10:18.268306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.288324 (+ 20018us) service_pool.cc:224] Handling call
0709 12:10:19.783559 (+1495235us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b58001b3098. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf8f40a0 00007f9ccf8f3984 00007f9cc8e6e6d4 00007f9cc8e6e662
0709 12:10:19.987384 (+203825us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28892544}
I20260709 12:10:20.122913 23125 rpcz_store.cc:276] 0709 12:10:18.816338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.823795 (+  7457us) service_pool.cc:224] Handling call
0709 12:10:20.122395 (+1298600us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b54006a0ed4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:20.122492 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1044909312}
I20260709 12:10:20.124049 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:20.124459 24316 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:20.124908 22598 raft_consensus.cc:2393] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 5: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:20.126025 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:20.128654 22422 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
W20260709 12:10:20.103257 24333 consensus_meta.cc:287] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.651s	user 0.010s	sys 0.003s
W20260709 12:10:20.142179 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.126865 22598 raft_consensus.cc:2393] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 4: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:20.144520 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:20.092407 24384 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:20.145481 22454 raft_consensus.cc:2468] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
I20260709 12:10:20.146001 22570 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:20.148006 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:20.148406 22452 raft_consensus.cc:1240] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:20.148996 22453 raft_consensus.cc:2393] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 3: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:20.149652 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:20.150668 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:20.160503 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:20.161100 23121 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:20.076018 24405 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:20.165684 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:20.169770 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:20.178930 22569 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:20.146587 24441 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:20.147323 24384 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:20.181432 22569 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:20.204761 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:20.161275 24348 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:20.206519 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:20.167896 24440 raft_consensus.cc:2749] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:20.204027 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:20.206085 23120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57318 (request call id 646) took 1886 ms (client timeout 1700 ms). Trace:
I20260709 12:10:20.167730 24316 raft_consensus.cc:2804] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:20.214195 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:20.212944 22457 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 2.
W20260709 12:10:20.213311 23120 rpcz_store.cc:269] 0709 12:10:18.319539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.181906 (+1862367us) service_pool.cc:211] Skipping call since client already timed out
0709 12:10:20.206015 (+ 24109us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:10:20.153937 24333 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:20.218258 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:20.220373 22569 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:20.204887 24260 consensus_queue.cc:260] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:20.223165 24260 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:20.227363 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:20.221110 24489 raft_consensus.cc:2804] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:20.228036 22598 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:20.228498 24489 raft_consensus.cc:697] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:20.229550 24489 consensus_queue.cc:237] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:20.227366 24495 log.cc:927] Time spent T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 12:10:20.212831 24226 raft_consensus.cc:2804] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:20.232452 23121 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
I20260709 12:10:20.240515 24385 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:20.241107 24385 raft_consensus.cc:697] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:20.241449 24343 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:20.242067 24385 consensus_queue.cc:237] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:20.232910 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:20.244975 22569 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:20.246001 24355 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:20.216358 24316 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:20.257156 22570 leader_election.cc:336] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 1.534s (SENT)
I20260709 12:10:20.260643 22570 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:20.257893 24316 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:20.259757 24420 raft_consensus.cc:2749] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:20.169126 24442 consensus_queue.cc:237] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:20.267994 22569 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:20.265326 24483 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:20.258728 24226 raft_consensus.cc:697] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:20.279721 24405 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:20.278903 24226 consensus_queue.cc:237] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:20.280850 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:20.281175 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:20.284636 23117 raft_consensus.cc:1275] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:20.284932 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:20.285488 23122 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:20.286815 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:20.287832 22523 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:20.270740 24153 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:20.289949 24153 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:20.261049 24435 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:20.291378 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:20.292800 24435 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:20.294468 22570 leader_election.cc:336] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 1.550s (SENT)
I20260709 12:10:20.295892 22570 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:20.296556 24232 raft_consensus.cc:2749] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:20.296861 24478 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:20.297780 24232 raft_consensus.cc:2804] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:20.298257 24232 raft_consensus.cc:697] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:20.247776 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:20.300698 23123 raft_consensus.cc:2393] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 4: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:20.296581 22351 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55962 (request call id 341) took 5371 ms. Trace:
I20260709 12:10:20.305017 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:20.305576 23121 raft_consensus.cc:3060] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:20.309723 22523 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
I20260709 12:10:20.311169 22570 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:20.314249 23121 raft_consensus.cc:2468] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:10:20.314975 22456 raft_consensus.cc:1240] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:20.265836 24348 raft_consensus.cc:2804] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:20.316594 22454 raft_consensus.cc:1240] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:20.318106 23087 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:20.320194 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:20.318912 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 50958.6us
I20260709 12:10:20.323156 22569 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:20.320752 22531 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:20.329144 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:20.332497 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:20.332943 23120 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:20.334245 24232 consensus_queue.cc:237] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:20.336499 24491 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:20.337837 22452 raft_consensus.cc:2393] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 4: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
W20260709 12:10:20.341005 24446 consensus_meta.cc:287] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.505s	user 0.003s	sys 0.005s
I20260709 12:10:20.298961 24478 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:20.300192 22600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45562 (request call id 1734) took 1232 ms. Trace:
I20260709 12:10:20.331288 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:20.345839 22528 raft_consensus.cc:2468] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:20.349663 23087 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:20.350584 22527 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:20.341540 24446 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:20.346200 22421 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:20.353762 22421 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:20.356416 23087 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:20.325053 24405 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:20.371547 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:20.329914 24425 raft_consensus.cc:2804] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:20.374671 23088 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.509s	user 0.022s	sys 0.047s
W20260709 12:10:20.375016 23088 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.510s	user 0.022s	sys 0.047s
I20260709 12:10:20.358939 22569 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:20.358807 23087 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:20.375342 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 1.51017e+06us
I20260709 12:10:20.315749 24409 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:20.366083 24387 raft_consensus.cc:2804] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:20.358319 24348 raft_consensus.cc:697] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:20.365845 24397 raft_consensus.cc:2804] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:20.366406 24451 raft_consensus.cc:2749] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:20.355959 22600 rpcz_store.cc:276] 0709 12:10:19.067334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.419750 (+352416us) service_pool.cc:224] Handling call
0709 12:10:20.300005 (+880255us) spinlock_profiling.cc:243] Waited 509 ms on lock 0x7b540013bd54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:20.300134 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1170121088}
I20260709 12:10:20.380287 22457 raft_consensus.cc:1240] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:20.383319 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:20.384604 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:20.385069 24409 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:20.385349 22600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45576 (request call id 2110) took 1188 ms. Trace:
I20260709 12:10:20.375787 24343 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:20.385823 22600 rpcz_store.cc:276] 0709 12:10:19.197417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.384320 (+1186903us) service_pool.cc:224] Handling call
0709 12:10:20.385293 (+   973us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:20.385562 24384 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:20.387362 24478 raft_consensus.cc:2749] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:20.387669 24348 consensus_queue.cc:237] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:20.388453 24483 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:20.381429 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:20.379112 24355 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:20.389246 22605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 1719) took 2123 ms. Trace:
I20260709 12:10:20.387463 24446 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:20.376325 24425 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:20.388396 22422 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:20.389775 22605 rpcz_store.cc:276] 0709 12:10:18.265673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.283617 (+ 17944us) service_pool.cc:224] Handling call
0709 12:10:18.300025 (+ 16408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.502961 (+202936us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.503036 (+    75us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:18.503119 (+    83us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:18.503161 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:20.389053 (+1885892us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b54000ea954. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:20.389093 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:20.389198 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":460792576}
I20260709 12:10:20.359787 24428 raft_consensus.cc:2804] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:20.369000 24308 raft_consensus.cc:2804] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:20.392889 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:20.396090 22450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1338) took 2278 ms. Trace:
I20260709 12:10:20.360952 24381 consensus_queue.cc:1059] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:10:20.396463 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:20.397930 22450 rpcz_store.cc:276] 0709 12:10:18.117828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.124441 (+  6613us) service_pool.cc:224] Handling call
0709 12:10:20.395942 (+2271501us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b540019fd54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:20.396033 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":748112256}
I20260709 12:10:20.399641 22523 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:20.390487 24425 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:20.400207 24491 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:20.403084 24355 raft_consensus.cc:697] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:20.403179 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:20.403817 23117 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:20.404088 24355 consensus_queue.cc:237] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:20.404892 24364 consensus_meta.cc:287] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.587s	user 0.001s	sys 0.007s
I20260709 12:10:20.397974 23121 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:10:20.410452 22523 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:10:20.414227 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:20.415166 22605 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:20.377581 24405 raft_consensus.cc:697] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:20.358731 24440 consensus_queue.cc:1048] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:10:20.424945 24242 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:20.304015 22351 rpcz_store.cc:276] 0709 12:10:14.925434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.925592 (+   158us) service_pool.cc:224] Handling call
0709 12:10:20.296495 (+5370903us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:18.276612 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:18.277368 (+   756us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:18.277415 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:10:18.277434 (+    19us) tablet.cc:662] Decoding operations
0709 12:10:18.278031 (+   597us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:18.278132 (+   101us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:18.278165 (+    33us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:10:18.278638 (+   473us) tablet.cc:701] Row locks acquired
0709 12:10:18.278686 (+    48us) write_op.cc:260] PREPARE: finished
0709 12:10:18.278863 (+   177us) write_op.cc:270] Start()
0709 12:10:18.282869 (+  4006us) write_op.cc:276] Timestamp: P: 1783599018278795 usec, L: 0
0709 12:10:18.282928 (+    59us) op_driver.cc:348] REPLICATION: starting
0709 12:10:18.409811 (+126883us) log.cc:844] Serialized 1316 byte log entry
0709 12:10:19.281431 (+871620us) op_driver.cc:464] REPLICATION: finished
0709 12:10:19.533860 (+252429us) write_op.cc:301] APPLY: starting
0709 12:10:19.545008 (+ 11148us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:19.558355 (+ 13347us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:19.558479 (+   124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:19.559026 (+   547us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:19.559312 (+   286us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:10:19.559352 (+    40us) write_op.cc:312] APPLY: finished
0709 12:10:19.559562 (+   210us) log.cc:844] Serialized 35 byte log entry
0709 12:10:19.559756 (+   194us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:19.559847 (+    91us) write_op.cc:454] Released schema lock
0709 12:10:19.559903 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:19.560331 (+   428us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:19.560357 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1408026,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":233204,"apply.run_cpu_time_us":2428,"apply.run_wall_time_us":34970,"num_ops":3,"prepare.queue_time_us":11894,"prepare.run_cpu_time_us":46848,"prepare.run_wall_time_us":332701,"raft.queue_time_us":310140,"raft.run_cpu_time_us":44148,"raft.run_wall_time_us":304557,"replication_time_us":998320,"thread_start_us":513998,"threads_started":4,"wal-append.queue_time_us":149303}]]}
I20260709 12:10:20.386874 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:20.427594 24499 log.cc:927] Time spent T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.215s	user 0.003s	sys 0.000s
W20260709 12:10:20.429328 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.398672 24308 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:20.463732 24308 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:20.406090 24397 raft_consensus.cc:697] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:20.467731 24397 consensus_queue.cc:237] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:20.473587 24316 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:20.399140 24387 raft_consensus.cc:697] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
W20260709 12:10:20.436105 22421 leader_election.cc:336] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 1.582s (SENT)
I20260709 12:10:20.425316 24243 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:20.399806 24409 raft_consensus.cc:2749] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:20.434702 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.414757 24428 raft_consensus.cc:697] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
W20260709 12:10:20.519672 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 83599.5us
W20260709 12:10:20.520505 22421 leader_election.cc:336] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 1.590s (SENT)
I20260709 12:10:20.520932 22421 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:20.417574 24333 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:20.454483 24364 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:20.417865 24478 consensus_queue.cc:1048] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.102s
W20260709 12:10:20.527242 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 120260us
I20260709 12:10:20.594305 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:20.594062 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:20.525969 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:20.607622 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:20.610124 22532 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 4
W20260709 12:10:20.611122 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 195663us
I20260709 12:10:20.611343 22523 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:20.612394 22605 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:10:20.613754 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:20.614688 22605 raft_consensus.cc:2393] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 4: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:20.540380 22598 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 3.
I20260709 12:10:20.616323 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:20.617201 22598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45576 (request call id 2098) took 1623 ms. Trace:
I20260709 12:10:20.618481 22523 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
I20260709 12:10:20.618311 22532 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
I20260709 12:10:20.588933 23120 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 4.
I20260709 12:10:20.617691 22598 rpcz_store.cc:276] 0709 12:10:18.993483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.615983 (+1622500us) service_pool.cc:224] Handling call
0709 12:10:20.617130 (+  1147us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:20.623009 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 99487.7us
I20260709 12:10:20.603924 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:20.629715 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:20.629783 22421 leader_election.cc:336] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 1.762s (SENT)
I20260709 12:10:20.630291 22421 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:20.631827 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:20.524386 22600 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:10:20.632530 22605 raft_consensus.cc:2368] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 2. Current term is 3.
W20260709 12:10:20.633617 22421 leader_election.cc:336] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 1.796s (SENT)
I20260709 12:10:20.623253 24483 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.527056 24381 consensus_queue.cc:1048] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.104s
I20260709 12:10:20.649847 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:20.674678 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:20.635407 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:20.675549 22532 raft_consensus.cc:2393] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 3: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:20.675640 22525 raft_consensus.cc:2376] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4. Re-sending same reply.
I20260709 12:10:20.678174 22605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45562 (request call id 1736) took 1294 ms. Trace:
I20260709 12:10:20.678570 22605 rpcz_store.cc:276] 0709 12:10:19.383680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.631570 (+1247890us) service_pool.cc:224] Handling call
0709 12:10:20.678113 (+ 46543us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:20.657452 24384 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:20.657182 24439 consensus_meta.cc:287] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.527s	user 0.010s	sys 0.000s
I20260709 12:10:20.631549 24420 raft_consensus.cc:2749] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:20.636749 24316 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:20.649469 22600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45576 (request call id 2106) took 1453 ms. Trace:
I20260709 12:10:20.603601 24405 consensus_queue.cc:237] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:20.631379 24364 consensus_queue.cc:1059] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:10:20.629458 24387 consensus_queue.cc:237] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:20.708009 24242 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:20.689257 22421 leader_election.cc:336] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 1.708s (SENT)
W20260709 12:10:20.709790 22421 leader_election.cc:336] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 2.003s (SENT)
I20260709 12:10:20.710186 22421 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:20.711297 24243 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:20.711465 24440 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:10:20.725206 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.697702 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:20.635274 24478 consensus_queue.cc:1048] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:10:20.691881 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:20.679250 24483 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:20.740532 22598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45562 (request call id 1744) took 1052 ms. Trace:
I20260709 12:10:20.741029 22598 rpcz_store.cc:276] 0709 12:10:19.688181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.649509 (+961328us) service_pool.cc:224] Handling call
0709 12:10:20.740454 (+ 90945us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:20.741619 24483 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:20.644465 24428 consensus_queue.cc:237] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:20.692130 22600 rpcz_store.cc:276] 0709 12:10:19.195999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.386603 (+1190604us) service_pool.cc:224] Handling call
0709 12:10:20.647211 (+260608us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:20.690507 24439 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:20.749205 24270 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.749838 24270 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:20.754598 22527 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
I20260709 12:10:20.650444 22524 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:10:20.738755 23122 raft_consensus.cc:2468] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 4.
W20260709 12:10:20.727967 24260 consensus_meta.cc:287] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.504s	user 0.009s	sys 0.000s
I20260709 12:10:20.772972 24270 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:10:20.775233 24512 log.cc:927] Time spent T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:10:20.783613 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:20.785389 22530 raft_consensus.cc:2393] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 3: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:20.786393 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:20.787235 22532 raft_consensus.cc:2368] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 3. Current term is 4.
I20260709 12:10:20.779719 24153 raft_consensus.cc:2804] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:20.797691 23088 connection.cc:256] RPC call timeout handler was delayed by -1.2550461830001041s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19910000000000003s for a response
W20260709 12:10:20.804560 22601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45576 (request call id 2099) took 1784 ms (client timeout 2038 ms). Trace:
W20260709 12:10:20.805119 22601 rpcz_store.cc:269] 0709 12:10:19.020509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.576759 (+556250us) service_pool.cc:224] Handling call
0709 12:10:20.804339 (+1227580us) spinlock_profiling.cc:243] Waited 62.8 ms on lock 0x7b5400041d54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:20.804485 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":144398080}
I20260709 12:10:20.809262 23089 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:20.810530 23089 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:20.812716 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:20.813751 22530 raft_consensus.cc:2393] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 3: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:20.819953 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:20.821497 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:20.821659 24260 raft_consensus.cc:2749] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:20.820024 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:20.822649 22450 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:20.823215 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:20.823915 22602 raft_consensus.cc:2393] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 4: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
W20260709 12:10:20.826558 23088 leader_election.cc:336] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 1.806s (SENT)
I20260709 12:10:20.829994 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:20.815945 24439 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:20.814527 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:20.832778 22453 raft_consensus.cc:1240] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 LEADER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:20.836020 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:20.836819 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:20.837242 22602 raft_consensus.cc:2393] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 4: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:20.827490 22597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43070 (request call id 295) took 2039 ms. Trace:
I20260709 12:10:20.830677 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:20.840062 24308 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:20.837375 22530 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:10:20.839780 22531 raft_consensus.cc:1275] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:20.841881 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:20.843212 24517 raft_consensus.cc:2804] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:20.862964 24517 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:20.863539 24517 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:20.867419 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:20.843742 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:20.867967 22456 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:20.845100 22599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45562 (request call id 1729) took 1798 ms (client timeout 1553 ms). Trace:
I20260709 12:10:20.868922 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:20.869302 22599 rpcz_store.cc:269] 0709 12:10:19.046683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.067166 (+ 20483us) service_pool.cc:224] Handling call
0709 12:10:20.844867 (+1777701us) spinlock_profiling.cc:243] Waited 668 ms on lock 0x7b540013c254. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:20.845009 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1535807360}
I20260709 12:10:20.870059 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:20.870606 22523 raft_consensus.cc:2468] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:10:20.847184 23117 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:10:20.847815 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:20.879827 22606 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:20.849031 22603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45576 (request call id 2121) took 1466 ms. Trace:
I20260709 12:10:20.848856 24425 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:20.839636 22597 rpcz_store.cc:276] 0709 12:10:18.788375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.802287 (+ 13912us) service_pool.cc:224] Handling call
0709 12:10:20.813975 (+2011688us) spinlock_profiling.cc:243] Waited 905 ms on lock 0x7b5400350cd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:20.825882 (+ 11907us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2081433344}
I20260709 12:10:20.830857 24412 raft_consensus.cc:2749] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:20.906050 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:20.907065 22529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38310 (request call id 431) took 1343 ms. Trace:
I20260709 12:10:20.907482 22529 rpcz_store.cc:276] 0709 12:10:19.563585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.879397 (+1315812us) service_pool.cc:224] Handling call
0709 12:10:20.906992 (+ 27595us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:20.851478 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:20.908526 22602 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:20.851696 22532 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:10:20.853868 24308 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:20.855134 22600 raft_consensus.cc:2393] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 4: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:20.916720 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:20.855578 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:20.917346 22531 raft_consensus.cc:1813] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Handling vote request from an unknown peer c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:20.856191 22598 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 2.
I20260709 12:10:20.860318 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:20.872246 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:20.856761 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:20.880450 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:20.880505 22603 rpcz_store.cc:276] 0709 12:10:19.382439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.068279 (+685840us) service_pool.cc:224] Handling call
0709 12:10:20.848843 (+780564us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b5400002154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:20.848973 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":234436352}
I20260709 12:10:20.932310 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:20.932924 22530 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 6.
I20260709 12:10:20.933266 22448 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:20.918046 22531 raft_consensus.cc:2410] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 3 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:10:20.896697 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:20.933830 22523 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:10:20.881852 24331 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:20.933965 22525 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 2.
I20260709 12:10:20.987217 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:10:20.938865 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.040150 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:20.979012 24425 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:21.041055 22457 raft_consensus.cc:2410] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:21.042572 22448 raft_consensus.cc:2468] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
I20260709 12:10:20.983863 22604 raft_consensus.cc:1240] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 LEADER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:21.047632 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:20.982368 22421 leader_election.cc:336] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 1.959s (SENT)
I20260709 12:10:21.048731 22523 raft_consensus.cc:2393] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 3: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:20.941787 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:20.994735 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:20.944898 22600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45562 (request call id 1738) took 1558 ms. Trace:
I20260709 12:10:20.935288 23089 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:20.993747 24315 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:20.925902 22456 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
I20260709 12:10:20.945686 22597 raft_consensus.cc:1240] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:20.959036 24308 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.966852 22450 raft_consensus.cc:2468] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
W20260709 12:10:21.029469 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 185121us
I20260709 12:10:21.045946 24355 consensus_queue.cc:1059] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:21.046543 22599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 1723) took 2016 ms. Trace:
I20260709 12:10:21.046705 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:21.046561 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 48158.8us
I20260709 12:10:20.919708 22601 raft_consensus.cc:2393] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 3: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:21.049124 22606 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
I20260709 12:10:21.047263 24331 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.025372 22455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2004) took 1588 ms. Trace:
I20260709 12:10:20.994762 22602 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 4.
I20260709 12:10:21.069525 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:21.070061 22602 raft_consensus.cc:1240] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:21.048854 22421 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:20.935114 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:21.056015 22604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2118) took 1843 ms. Trace:
I20260709 12:10:21.072069 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:21.065286 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:21.068320 22606 raft_consensus.cc:1240] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:10:20.934587 22603 raft_consensus.cc:1240] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 2. Current term is 4. Ops: []
I20260709 12:10:21.063966 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:21.060034 22449 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:21.073016 22529 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 3.
I20260709 12:10:21.073088 22602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2120) took 1708 ms. Trace:
W20260709 12:10:21.073726 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 138541us
I20260709 12:10:21.096598 22525 raft_consensus.cc:2393] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 3: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:21.061412 22598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43070 (request call id 304) took 1128 ms. Trace:
I20260709 12:10:21.071923 22455 rpcz_store.cc:276] 0709 12:10:19.436757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.837516 (+400759us) service_pool.cc:224] Handling call
0709 12:10:19.837840 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:19.848794 (+ 10954us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:19.865649 (+ 16855us) log.cc:844] Serialized 14 byte log entry
0709 12:10:20.853611 (+987962us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b180037c0c0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc7823e07 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc7840c02 00007f9cca4c820b 00007f9cca4cdd23 00007f9cca4ce23a 00007f9cca938a2a
0709 12:10:21.024920 (+171309us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:21.024991 (+    71us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:21.025062 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.025139 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:21.025293 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":674,"prepare.queue_time_us":16608,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":119,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":130,"spinlock_wait_cycles":3729280,"thread_start_us":170947,"threads_started":1,"wal-append.queue_time_us":1146668}
I20260709 12:10:21.096460 22602 rpcz_store.cc:276] 0709 12:10:19.362466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.069619 (+1707153us) service_pool.cc:224] Handling call
0709 12:10:21.069876 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.070488 (+   612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.070689 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:21.071401 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 89053.4us
I20260709 12:10:21.099077 22606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2119) took 1893 ms. Trace:
I20260709 12:10:21.092976 22601 raft_consensus.cc:1240] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 12:10:21.068719 23088 leader_election.cc:336] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 2.126s (SENT)
I20260709 12:10:21.072734 22604 rpcz_store.cc:276] 0709 12:10:19.205179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.983429 (+1778250us) service_pool.cc:224] Handling call
0709 12:10:20.983688 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.048104 (+ 64416us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.048265 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:21.093572 22597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2107) took 1897 ms. Trace:
W20260709 12:10:21.101397 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 145067us
W20260709 12:10:21.128737 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:21.104910 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 759338us
I20260709 12:10:21.128539 22606 rpcz_store.cc:276] 0709 12:10:19.205521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.067743 (+1862222us) service_pool.cc:224] Handling call
0709 12:10:21.068081 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:21.098776 (+ 30695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.098972 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:21.128474 22601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2123) took 1745 ms. Trace:
I20260709 12:10:21.072381 24441 raft_consensus.cc:2749] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:21.070924 24381 raft_consensus.cc:2749] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:21.131407 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:21.135068 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:21.059578 22600 rpcz_store.cc:276] 0709 12:10:19.384263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.749402 (+1365139us) service_pool.cc:224] Handling call
0709 12:10:20.943031 (+193629us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:21.128407 23089 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:21.069370 22599 rpcz_store.cc:276] 0709 12:10:19.030443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.870726 (+1840283us) service_pool.cc:224] Handling call
0709 12:10:20.871115 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:20.871383 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:20.898064 (+ 26681us) log.cc:844] Serialized 14 byte log entry
0709 12:10:21.046165 (+148101us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:21.046219 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:21.046268 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.046336 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:21.046450 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4671,"prepare.queue_time_us":177982,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":3222,"raft.queue_time_us":137594,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"thread_start_us":30936,"threads_started":2,"wal-append.queue_time_us":195353}
I20260709 12:10:21.131789 22601 rpcz_store.cc:276] 0709 12:10:19.383103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.071811 (+1688708us) service_pool.cc:224] Handling call
0709 12:10:21.092664 (+ 20853us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:21.128185 (+ 35521us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.128416 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:21.133721 22497 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:21.138329 22497 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:21.133600 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:21.135509 22523 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 3.
I20260709 12:10:21.131716 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:21.144779 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:21.145311 22523 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 4.
I20260709 12:10:21.146203 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:21.117889 24521 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.146310 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:21.147014 22529 raft_consensus.cc:2393] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 3: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
W20260709 12:10:21.128945 22421 leader_election.cc:336] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 2.074s (SENT)
I20260709 12:10:21.070779 24308 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:21.129776 22597 rpcz_store.cc:276] 0709 12:10:19.196402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.933220 (+1736818us) service_pool.cc:224] Handling call
0709 12:10:20.945466 (+ 12246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.067737 (+122271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.093493 (+ 25756us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:21.337610 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:21.338351 22456 raft_consensus.cc:2393] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 4: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:21.301654 22600 raft_consensus.cc:1240] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:21.306844 22422 leader_election.cc:400] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 2 pre-election: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 2. Current term is 3.
W20260709 12:10:21.293035 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 224338us
I20260709 12:10:21.146096 24243 raft_consensus.cc:2804] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:21.208410 24352 raft_consensus.cc:3055] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:21.144059 24386 raft_consensus.cc:2804] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:21.201907 24477 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.156672 24521 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:21.209313 23123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57328 (request call id 773) took 1103 ms. Trace:
I20260709 12:10:21.352952 23123 rpcz_store.cc:276] 0709 12:10:20.106289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.129245 (+ 22956us) service_pool.cc:224] Handling call
0709 12:10:21.209112 (+1079867us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b5400787dd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:21.209250 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":345417088}
I20260709 12:10:21.200855 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:21.354064 22526 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.248015 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:21.210759 22452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 396) took 1082 ms. Trace:
W20260709 12:10:21.273861 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.354597 22525 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 2.
I20260709 12:10:21.357720 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:21.358891 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:21.360124 23125 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.354771 22452 rpcz_store.cc:276] 0709 12:10:20.128584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.179126 (+ 50542us) service_pool.cc:224] Handling call
0709 12:10:21.210540 (+1031414us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b54004056d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:21.210661 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":304065920}
I20260709 12:10:21.321069 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:21.306844 22569 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:21.192864 24451 raft_consensus.cc:3055] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:21.284696 24513 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:10:21.175122 22570 leader_election.cc:336] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 1.652s (SENT)
W20260709 12:10:21.362730 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 55993.6us
I20260709 12:10:21.151693 22602 raft_consensus.cc:1240] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:21.178467 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:21.157047 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:21.098161 24517 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:21.322341 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:21.312849 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:21.367547 22597 raft_consensus.cc:1240] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:21.367751 22531 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 2.
I20260709 12:10:21.368188 22597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43070 (request call id 308) took 1426 ms. Trace:
I20260709 12:10:21.368589 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:21.368819 24517 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:21.369215 24513 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:21.369714 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:21.370265 22531 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:10:21.371099 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:21.371377 24513 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:21.371865 22531 raft_consensus.cc:2410] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 3 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:10:21.372411 22569 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:21.372562 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:21.146425 24260 raft_consensus.cc:2804] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:21.373808 24533 log.cc:927] Time spent T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:10:21.373932 24260 raft_consensus.cc:697] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 4 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:21.374859 24260 consensus_queue.cc:237] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:21.375392 22605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2116) took 2171 ms. Trace:
I20260709 12:10:21.375738 22605 rpcz_store.cc:276] 0709 12:10:19.204478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.982760 (+1778282us) service_pool.cc:224] Handling call
0709 12:10:20.983106 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:21.041884 (+ 58778us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:21.041914 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:21.042440 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 12:10:21.091521 (+ 49081us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:21.107129 (+ 15608us) log.cc:844] Serialized 14 byte log entry
0709 12:10:21.107380 (+   251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.107478 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:21.375168 (+267690us) raft_consensus.cc:1685] finished
0709 12:10:21.375186 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:21.375306 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58403,"prepare.queue_time_us":15281,"prepare.run_wall_time_us":37,"raft.queue_time_us":59682,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":15650,"spinlock_wait_cycles":4686080,"thread_start_us":48576,"threads_started":1,"wal-append.queue_time_us":142449}
I20260709 12:10:21.101907 22598 rpcz_store.cc:276] 0709 12:10:19.927705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.800570 (+872865us) service_pool.cc:224] Handling call
0709 12:10:21.055861 (+255291us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:21.273123 22604 raft_consensus.cc:1240] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:21.359302 24386 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.379403 22604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43070 (request call id 307) took 1446 ms. Trace:
I20260709 12:10:21.363600 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:21.186115 22497 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:21.362402 24451 raft_consensus.cc:740] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:21.380142 24308 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:21.136193 22524 raft_consensus.cc:2368] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 3. Current term is 4.
I20260709 12:10:21.326973 22421 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:21.380906 24451 consensus_queue.cc:260] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:21.381399 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:21.381981 24451 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.382097 22524 raft_consensus.cc:1813] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Handling vote request from an unknown peer c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:21.382433 24428 raft_consensus.cc:2749] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:21.382486 22524 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:21.328760 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:21.383114 23116 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.335834 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:21.383975 22455 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 5.
I20260709 12:10:21.384637 24521 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:21.385190 24477 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:21.387238 24477 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:21.387992 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:21.388340 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:21.388645 22528 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:10:21.389588 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:21.389801 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:21.390430 22525 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 3.
I20260709 12:10:21.391302 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:21.391799 22525 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.392592 22606 raft_consensus.cc:1240] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:21.393189 22606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43070 (request call id 311) took 1229 ms. Trace:
I20260709 12:10:21.393501 22606 rpcz_store.cc:276] 0709 12:10:20.163577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.392133 (+1228556us) service_pool.cc:224] Handling call
0709 12:10:21.392416 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.392957 (+   541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.393114 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:21.352452 24352 raft_consensus.cc:740] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:21.379936 22604 rpcz_store.cc:276] 0709 12:10:19.932870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.272616 (+1339746us) service_pool.cc:224] Handling call
0709 12:10:21.272936 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.379152 (+106216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.379331 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:21.395627 22524 raft_consensus.cc:2410] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 3 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:10:21.330479 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:10:21.341027 23088 leader_election.cc:336] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 2.187s (SENT)
I20260709 12:10:21.396567 23121 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:21.337227 22457 raft_consensus.cc:1240] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:21.396828 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 55873.6us
I20260709 12:10:21.340107 22422 leader_election.cc:403] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:10:21.397430 23088 leader_election.cc:336] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 2.358s (SENT)
W20260709 12:10:21.363128 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 188033us
W20260709 12:10:21.398145 22570 leader_election.cc:336] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 1.662s (SENT)
I20260709 12:10:21.397833 23088 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:21.360404 22495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.380359 23117 raft_consensus.cc:2393] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 4: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
W20260709 12:10:21.381446 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 252514us
W20260709 12:10:21.409315 22421 leader_election.cc:336] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 2.196s (SENT)
I20260709 12:10:21.394826 22606 raft_consensus.cc:1240] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:10:21.390635 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:21.400844 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:21.406420 23125 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
I20260709 12:10:21.416363 22524 raft_consensus.cc:2468] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 3.
I20260709 12:10:21.408540 22453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 399) took 1202 ms. Trace:
I20260709 12:10:21.366703 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:21.418018 23123 raft_consensus.cc:2368] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 3. Current term is 4.
I20260709 12:10:21.361774 22529 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:10:21.402710 22526 raft_consensus.cc:2468] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
I20260709 12:10:21.410285 22602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2124) took 2026 ms. Trace:
I20260709 12:10:21.417157 22453 rpcz_store.cc:276] 0709 12:10:20.206023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.221447 (+ 15424us) service_pool.cc:224] Handling call
0709 12:10:20.221720 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:20.835886 (+614166us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.408305 (+572419us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b54003f1bd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:21.408472 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1404691840}
W20260709 12:10:21.411535 22421 leader_election.cc:336] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 2.245s (SENT)
I20260709 12:10:21.368534 22597 rpcz_store.cc:276] 0709 12:10:19.941804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.358483 (+1416679us) service_pool.cc:224] Handling call
0709 12:10:21.367370 (+  8887us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.367934 (+   564us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.368112 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:21.436177 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:21.440362 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:21.437578 22525 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5.
I20260709 12:10:21.379426 24386 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:21.436504 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:21.441035 22456 raft_consensus.cc:2393] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 4: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:21.441828 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:21.443041 22526 raft_consensus.cc:2393] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 4: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:21.444012 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:21.444939 22525 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 2.
I20260709 12:10:21.445971 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:21.446866 22525 raft_consensus.cc:2368] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 3. Current term is 4.
I20260709 12:10:21.447770 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:21.438151 22528 raft_consensus.cc:2468] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 2.
I20260709 12:10:21.448583 22525 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.419243 22602 rpcz_store.cc:276] 0709 12:10:19.383364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.137749 (+1754385us) service_pool.cc:224] Handling call
0709 12:10:21.151435 (+ 13686us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.397982 (+246547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.410225 (+ 12243us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:21.419615 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 126404us
I20260709 12:10:21.459707 22422 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:21.379797 24355 raft_consensus.cc:2804] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:21.440225 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:21.470366 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:21.409672 22449 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:21.366792 22600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 1741) took 1679 ms. Trace:
I20260709 12:10:21.471766 22600 rpcz_store.cc:276] 0709 12:10:19.687337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.157645 (+1470308us) service_pool.cc:224] Handling call
0709 12:10:21.273287 (+115642us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.358655 (+ 85368us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.366732 (+  8077us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:21.462597 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:21.463171 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:21.468189 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 70775.2us
I20260709 12:10:21.468240 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:21.473031 22526 raft_consensus.cc:2468] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
W20260709 12:10:21.473196 23088 leader_election.cc:336] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 2.408s (SENT)
I20260709 12:10:21.473346 22529 raft_consensus.cc:2393] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 4: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:21.474030 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:21.474701 22526 raft_consensus.cc:2368] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 3. Current term is 4.
I20260709 12:10:21.474838 22529 raft_consensus.cc:1275] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:21.479928 23088 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:21.483361 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:21.341106 24331 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:21.486047 22454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 398) took 1310 ms. Trace:
I20260709 12:10:21.441754 24412 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:21.491549 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:21.491849 23125 raft_consensus.cc:1275] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:21.484589 22525 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
I20260709 12:10:21.492391 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:21.504360 23123 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.411398 24387 raft_consensus.cc:2804] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:21.497555 23121 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:21.501802 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:21.506242 22606 raft_consensus.cc:2393] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 4: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:21.468909 24428 raft_consensus.cc:2804] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:21.491199 22454 rpcz_store.cc:276] 0709 12:10:20.175466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.216491 (+ 41025us) service_pool.cc:224] Handling call
0709 12:10:20.219884 (+  3393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:20.317772 (+ 97888us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.485823 (+1168051us) spinlock_profiling.cc:243] Waited 96.5 ms on lock 0x7b54002206d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:21.485993 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":222001408}
I20260709 12:10:21.505268 22525 raft_consensus.cc:1240] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
W20260709 12:10:21.506567 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 95046.6us
I20260709 12:10:21.511418 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:21.511708 23088 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:21.512501 22602 raft_consensus.cc:2393] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 4: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:21.512543 23088 leader_election.cc:304] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:21.395884 24352 consensus_queue.cc:260] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:21.514137 24428 raft_consensus.cc:697] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:21.514405 24352 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.518427 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:21.519541 22456 raft_consensus.cc:1240] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:21.520610 22454 raft_consensus.cc:1240] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:21.484939 24243 raft_consensus.cc:697] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:21.521708 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:21.521637 24243 consensus_queue.cc:237] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:21.523138 22531 raft_consensus.cc:1275] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:21.523245 24328 raft_consensus.cc:2749] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:21.524263 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:21.524518 22531 raft_consensus.cc:1275] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:10:21.525942 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 377383us
I20260709 12:10:21.520690 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:21.502462 23089 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:21.462599 24477 raft_consensus.cc:2749] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:21.492333 24355 raft_consensus.cc:697] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:21.502434 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:21.514865 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 116722us
I20260709 12:10:21.515937 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:21.523097 24381 raft_consensus.cc:2804] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:21.530493 24425 raft_consensus.cc:3055] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:21.532032 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:21.535832 22601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 1740) took 1849 ms. Trace:
I20260709 12:10:21.529870 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:21.568908 22525 raft_consensus.cc:2393] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 4: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:21.569875 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:21.571165 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:21.573539 23123 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
I20260709 12:10:21.573611 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:21.574955 22525 raft_consensus.cc:1813] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Handling vote request from an unknown peer c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:21.575706 22525 raft_consensus.cc:2410] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 3 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:10:21.567291 22601 rpcz_store.cc:276] 0709 12:10:19.687003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.147493 (+1460490us) service_pool.cc:224] Handling call
0709 12:10:21.147742 (+   249us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:21.185243 (+ 37501us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:21.185278 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:21.293455 (+108177us) log.cc:844] Serialized 26 byte log entry
0709 12:10:21.400122 (+106667us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:21.400185 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.400290 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:21.535600 (+135310us) raft_consensus.cc:1685] finished
0709 12:10:21.535619 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:21.535764 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":39364,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":110,"thread_start_us":74655,"threads_started":1,"wal-append.queue_time_us":204239}
I20260709 12:10:21.591159 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:21.526369 24537 raft_consensus.cc:2749] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:21.565472 23121 raft_consensus.cc:2410] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:10:21.565825 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:21.593492 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 91107.6us
I20260709 12:10:21.539206 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:21.595371 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:21.606854 22525 raft_consensus.cc:2393] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 6: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:21.566229 24381 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.589457 22600 raft_consensus.cc:2368] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 2. Current term is 3.
I20260709 12:10:21.614516 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:21.566555 22449 raft_consensus.cc:1240] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 2. Current term is 4. Ops: []
I20260709 12:10:21.566457 24425 raft_consensus.cc:740] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:21.577932 24477 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.613479 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:21.625183 22531 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 2.
I20260709 12:10:21.613180 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:21.633697 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:21.639106 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:21.597522 24328 consensus_queue.cc:1059] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:10:21.643647 24328 consensus_queue.cc:1243] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer c863116d91c14d1ca50d6e8a46a37a8f log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 12:10:21.644176 24535 log.cc:927] Time spent T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 12:10:21.644304 24328 raft_consensus.cc:3055] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:21.644826 24328 raft_consensus.cc:740] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:21.667651 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:21.668483 23121 raft_consensus.cc:2393] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 3: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:21.668296 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:21.612884 24465 raft_consensus.cc:2804] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:21.625342 24543 raft_consensus.cc:2804] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:21.673473 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:21.674343 23122 raft_consensus.cc:2410] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:21.675654 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:21.677170 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:21.678089 23120 raft_consensus.cc:2393] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 5: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:21.637420 24381 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.690093 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:21.691092 23124 raft_consensus.cc:2393] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 4: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:21.687736 23119 raft_consensus.cc:1240] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:10:21.697810 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:21.648907 24387 raft_consensus.cc:697] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:21.702560 23122 raft_consensus.cc:1275] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:10:21.703174 22495 connection.cc:256] RPC call timeout handler was delayed by -1.0904498679999506s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1595s for a response
I20260709 12:10:21.674860 24465 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:21.703538 22495 connection.cc:256] RPC call timeout handler was delayed by -1.0661498679999113s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1622s for a response
W20260709 12:10:21.703912 22495 connection.cc:256] RPC call timeout handler was delayed by -1.0499498679998851s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.164s for a response
W20260709 12:10:21.704196 22495 connection.cc:256] RPC call timeout handler was delayed by -1.0238498680000703s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16690000000000002s for a response
I20260709 12:10:21.662150 24542 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:21.710179 22495 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:21.711148 22454 raft_consensus.cc:1275] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:21.707590 22452 raft_consensus.cc:1275] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:21.649283 24270 consensus_queue.cc:1059] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:10:21.674098 24543 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.717916 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:21.638028 24477 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:21.718871 23120 raft_consensus.cc:2393] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 4: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
W20260709 12:10:21.727214 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 149466us
W20260709 12:10:21.728223 22496 connection.cc:256] RPC call timeout handler was delayed by -1.5545875220000198s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1595s for a response
W20260709 12:10:21.728570 22496 connection.cc:256] RPC call timeout handler was delayed by -1.2287875220001752s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1957s for a response
I20260709 12:10:21.703742 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:21.708107 24465 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:21.730830 22496 connection.cc:256] RPC call timeout handler was delayed by -1.1747875220000878s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2017s for a response
W20260709 12:10:21.732060 22496 connection.cc:256] RPC call timeout handler was delayed by -1.1558875220000573s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20379999999999998s for a response
W20260709 12:10:21.732424 22496 connection.cc:256] RPC call timeout handler was delayed by -1.1396875220000311s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2056s for a response
W20260709 12:10:21.732781 22496 connection.cc:256] RPC call timeout handler was delayed by -1.0073875220000446s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2203s for a response
W20260709 12:10:21.733016 22496 connection.cc:256] RPC call timeout handler was delayed by -1.0055875220000416s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22050000000000003s for a response
I20260709 12:10:21.733465 22496 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:21.726825 24243 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.724543 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:21.724053 24543 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:21.672331 24428 consensus_queue.cc:237] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:21.673709 24355 consensus_queue.cc:237] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:21.714234 24547 consensus_queue.cc:1059] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.027s
W20260709 12:10:21.772939 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 62834.2us
I20260709 12:10:21.778766 24387 consensus_queue.cc:237] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:21.779867 24352 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.780220 23118 raft_consensus.cc:1275] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:21.780364 24352 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:21.779434 22570 leader_election.cc:336] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 1.788s (SENT)
I20260709 12:10:21.783430 22570 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:21.789005 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:21.736371 24331 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:21.718798 24542 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:21.782972 24441 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.821234 24441 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:21.822469 24542 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:21.799170 24153 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:21.799705 22570 leader_election.cc:336] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 1.792s (SENT)
W20260709 12:10:21.803494 24539 log.cc:927] Time spent T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:10:21.784487 23117 raft_consensus.cc:2393] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 4: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:21.804356 24544 raft_consensus.cc:2764] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:10:21.806763 24477 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:21.795634 24450 raft_consensus.cc:2749] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:21.807654 24559 consensus_queue.cc:1059] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:21.808315 24352 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:21.765650 24243 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:21.841485 22495 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:10:21.842226 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 110575us
W20260709 12:10:21.842905 22570 leader_election.cc:336] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 1.887s (SENT)
W20260709 12:10:21.846180 22570 leader_election.cc:336] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 2.003s (SENT)
I20260709 12:10:21.848552 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:21.843832 22605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43070 (request call id 309) took 1858 ms. Trace:
I20260709 12:10:21.778757 22598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43070 (request call id 310) took 1782 ms. Trace:
I20260709 12:10:21.849304 22527 raft_consensus.cc:2393] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 6: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:21.790529 24550 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.798832 23118 raft_consensus.cc:1240] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:21.854351 23119 raft_consensus.cc:1275] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:10:21.855706 22570 leader_election.cc:336] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 2.004s (SENT)
W20260709 12:10:21.855276 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 101230us
I20260709 12:10:21.843379 24153 raft_consensus.cc:3060] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.823495 24546 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.857755 22496 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:21.823077 24542 consensus_queue.cc:1059] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:10:21.756011 24465 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:21.846727 24441 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:21.864639 22570 leader_election.cc:336] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 2.046s (SENT)
I20260709 12:10:21.865209 22570 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
W20260709 12:10:21.866238 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 92344.3us
I20260709 12:10:21.867187 22495 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:10:21.880045 22570 leader_election.cc:336] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 2.057s (SENT)
I20260709 12:10:21.883605 22421 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:21.913823 22421 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:21.916019 24545 raft_consensus.cc:2804] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:21.916420 24545 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:21.916782 24545 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:21.917228 23116 consensus_meta.cc:287] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.534s	user 0.007s	sys 0.002s
I20260709 12:10:21.917601 23116 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
I20260709 12:10:21.869943 24546 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:21.881809 24441 consensus_queue.cc:1048] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:10:21.923372 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:21.924059 22530 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 2.
I20260709 12:10:21.924477 22530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56940 (request call id 1724) took 1070 ms. Trace:
I20260709 12:10:21.924755 22530 rpcz_store.cc:276] 0709 12:10:20.854461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.941301 (+ 86840us) service_pool.cc:224] Handling call
0709 12:10:21.923212 (+981911us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b5800037898. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf8f40a0 00007f9ccf8f3984 00007f9cc8e6e6d4 00007f9cc8e6e662
0709 12:10:21.924427 (+  1215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24950016}
I20260709 12:10:21.929335 22600 raft_consensus.cc:1240] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:21.930516 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:21.879907 24387 raft_consensus.cc:2749] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:21.932639 22599 raft_consensus.cc:1240] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:21.935820 23089 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:21.933612 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:21.931764 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:21.944029 24451 consensus_meta.cc:287] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.562s	user 0.010s	sys 0.001s
I20260709 12:10:21.944795 24381 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:21.946084 23123 raft_consensus.cc:2368] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 3. Current term is 4.
I20260709 12:10:21.944799 24260 raft_consensus.cc:2749] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:21.947358 23117 raft_consensus.cc:1275] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:10:21.851285 22598 rpcz_store.cc:276] 0709 12:10:19.996033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.378074 (+1382041us) service_pool.cc:224] Handling call
0709 12:10:21.378370 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.378567 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:21.635648 (+257081us) log.cc:844] Serialized 14 byte log entry
0709 12:10:21.778350 (+142702us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:21.778415 (+    65us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:21.778470 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.778545 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:21.778680 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9350,"prepare.queue_time_us":7843,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":22393,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":118,"thread_start_us":361534,"threads_started":2,"wal-append.queue_time_us":165952}
I20260709 12:10:21.879730 24557 raft_consensus.cc:2749] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:21.893280 24331 consensus_queue.cc:1048] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:10:21.946331 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:21.862836 24550 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:21.955477 22606 raft_consensus.cc:1275] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:21.956475 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:21.959450 24550 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:21.934998 24544 raft_consensus.cc:3055] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:21.960089 24544 raft_consensus.cc:740] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:21.960871 24544 consensus_queue.cc:260] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:21.961652 24386 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:21.962517 23089 leader_election.cc:400] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 2. Current term is 3.
I20260709 12:10:21.962754 22532 raft_consensus.cc:2368] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 6. Current term is 7.
I20260709 12:10:21.962911 23089 leader_election.cc:403] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:21.963733 24544 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.964653 24451 raft_consensus.cc:2749] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 2. Current term is 3.
I20260709 12:10:21.967284 22524 raft_consensus.cc:2393] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 3: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:21.968436 22602 raft_consensus.cc:1275] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:21.969149 24543 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:21.968966 24328 consensus_queue.cc:260] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:21.969995 24243 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:21.970492 24328 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.971535 24543 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:21.972002 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:21.972728 23121 raft_consensus.cc:2393] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 3: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:21.975404 24542 raft_consensus.cc:2764] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 12:10:21.982373 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 66715.1us
I20260709 12:10:21.984572 22421 leader_election.cc:400] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 3. Current term is 4.
I20260709 12:10:21.984858 22421 leader_election.cc:403] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 12:10:21.986963 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 119888us
I20260709 12:10:21.987737 22495 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:21.988878 22603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2100) took 2944 ms. Trace:
I20260709 12:10:21.989355 22603 rpcz_store.cc:276] 0709 12:10:19.049696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.932899 (+1883203us) service_pool.cc:224] Handling call
0709 12:10:20.934346 (+  1447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.097528 (+163182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.988612 (+891084us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b54002df350. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:21.988802 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2543360}
I20260709 12:10:21.976114 24542 raft_consensus.cc:2804] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:21.954845 24412 raft_consensus.cc:2749] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 2. Current term is 3.
I20260709 12:10:21.977114 24546 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:21.913244 24548 raft_consensus.cc:2749] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:21.993441 24552 raft_consensus.cc:2749] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:21.995476 24243 raft_consensus.cc:3055] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:21.995932 24243 raft_consensus.cc:740] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:21.996879 24386 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:21.981689 24381 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:22.005802 22495 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:21.992836 22421 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:10:21.982225 22600 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 3.
I20260709 12:10:21.976395 24331 consensus_queue.cc:1059] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:10:22.011227 22421 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:21.976238 24441 consensus_queue.cc:1059] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
W20260709 12:10:22.019397 24562 log.cc:927] Time spent T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:10:22.013514 24546 raft_consensus.cc:2749] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:22.013741 24548 raft_consensus.cc:2804] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:21.993693 24542 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.027431 22421 leader_election.cc:400] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 3. Current term is 4.
I20260709 12:10:22.026587 22453 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 3.
I20260709 12:10:21.960896 24425 consensus_queue.cc:260] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:21.992268 24564 raft_consensus.cc:2749] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 3. Current term is 4.
W20260709 12:10:22.041956 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 161002us
I20260709 12:10:22.076610 22495 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:22.031831 24412 raft_consensus.cc:2764] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 12:10:22.115753 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 258151us
W20260709 12:10:22.120903 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 44381.2us
I20260709 12:10:22.004168 24543 consensus_queue.cc:1059] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.068s
I20260709 12:10:22.036618 24548 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:22.123726 23089 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:22.037709 24542 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:22.124408 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 277435us
W20260709 12:10:22.122100 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 146269us
I20260709 12:10:22.038626 24558 raft_consensus.cc:2764] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:10:22.122592 22496 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:22.131593 22570 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:22.125886 24311 consensus_queue.cc:1048] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:10:22.141551 22570 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:21.996902 24243 consensus_queue.cc:260] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:22.126739 24425 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.139689 23122 raft_consensus.cc:1275] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:22.116731 24331 consensus_queue.cc:1243] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer 6c6fa11e8ee34711b3551f0c670442bc log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:10:22.125129 24547 raft_consensus.cc:2764] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:10:22.141844 22495 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:22.157266 22529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 1747) took 1096 ms. Trace:
I20260709 12:10:22.164819 22529 rpcz_store.cc:276] 0709 12:10:21.061108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.475593 (+414485us) service_pool.cc:224] Handling call
0709 12:10:21.475909 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:21.701087 (+225178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:21.701116 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:21.728036 (+ 26920us) log.cc:844] Serialized 26 byte log entry
0709 12:10:21.793527 (+ 65491us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:21.793578 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.793664 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:22.157027 (+363363us) raft_consensus.cc:1685] finished
0709 12:10:22.157046 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:22.157199 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":186300,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":27923,"thread_start_us":248470,"threads_started":2,"wal-append.queue_time_us":135024}
W20260709 12:10:22.167898 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 45393.8us
I20260709 12:10:22.168928 22496 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:22.144148 24333 raft_consensus.cc:2749] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.144186 24489 raft_consensus.cc:2764] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:10:22.146627 24543 consensus_queue.cc:1243] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer 6c6fa11e8ee34711b3551f0c670442bc log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:10:22.141124 24521 raft_consensus.cc:2804] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:22.135771 24548 raft_consensus.cc:3060] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:22.147029 22570 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:22.136751 24509 consensus_queue.cc:1048] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
W20260709 12:10:22.186023 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 63160.3us
W20260709 12:10:22.194543 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.161198 24561 raft_consensus.cc:2749] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:22.196455 22496 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:22.196540 22495 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:22.185972 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 49515.2us
I20260709 12:10:22.154072 24552 consensus_queue.cc:1059] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
W20260709 12:10:22.200692 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 62281.2us
I20260709 12:10:22.190893 24521 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.188771 24465 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:22.200414 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 53494.5us
I20260709 12:10:22.204636 22496 leader_election.cc:304] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:22.178726 24331 consensus_queue.cc:1048] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:10:22.214561 22495 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:22.199836 24565 log.cc:927] Time spent T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 12:10:22.198223 24572 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.196764 24571 raft_consensus.cc:2804] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:22.221392 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 184142us
I20260709 12:10:22.196547 24570 raft_consensus.cc:2749] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:22.203197 24311 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.227450 22496 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:22.203671 24547 raft_consensus.cc:2764] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:10:22.231810 24567 raft_consensus.cc:2749] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:22.234962 24561 consensus_queue.cc:1059] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:22.238116 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:22.238291 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:22.238973 22597 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 4: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:22.239169 24386 raft_consensus.cc:2804] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:22.214576 24521 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.239634 24386 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:22.240072 24386 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:22.241562 24412 raft_consensus.cc:3055] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:22.241935 24412 raft_consensus.cc:740] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:22.243427 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:22.243770 22496 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:22.244011 22604 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:22.245374 22528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56940 (request call id 1740) took 1200 ms. Trace:
I20260709 12:10:22.245719 22528 rpcz_store.cc:276] 0709 12:10:21.045413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.448742 (+403329us) service_pool.cc:224] Handling call
0709 12:10:22.245198 (+796456us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b54002ec554. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:22.245316 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":470633856}
I20260709 12:10:22.246696 24570 raft_consensus.cc:2749] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.231192 24571 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:22.248097 24571 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:22.249818 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.231495 24572 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:22.254204 24572 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:22.225865 24558 raft_consensus.cc:2749] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.255004 24572 consensus_queue.cc:1048] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:22.256085 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:22.256778 22523 raft_consensus.cc:2368] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 3. Current term is 4.
I20260709 12:10:21.849624 22605 rpcz_store.cc:276] 0709 12:10:19.985800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.377374 (+1391574us) service_pool.cc:224] Handling call
0709 12:10:21.377647 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.377847 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:21.568707 (+190860us) log.cc:844] Serialized 14 byte log entry
0709 12:10:21.843053 (+274346us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:21.843539 (+   486us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:21.843593 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.843653 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:21.843772 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":858,"prepare.queue_time_us":8372,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":1576,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":1555,"thread_start_us":422345,"threads_started":2}
I20260709 12:10:22.239347 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:22.259979 22602 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 3.
I20260709 12:10:22.246027 24547 raft_consensus.cc:2749] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:22.215468 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:22.238853 22601 raft_consensus.cc:2393] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 4: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:22.240024 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:22.252327 23116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57328 (request call id 777) took 2111 ms. Trace:
I20260709 12:10:22.210330 22570 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:22.263478 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:22.263967 22598 raft_consensus.cc:1275] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:22.264145 24561 consensus_queue.cc:1243] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer 6c6fa11e8ee34711b3551f0c670442bc log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:10:22.202963 24153 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:22.202391 24428 consensus_queue.cc:1059] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 12:10:22.268872 24558 consensus_queue.cc:1059] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:22.269817 24243 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:22.270224 22497 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:22.271492 22606 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:22.303280 22454 raft_consensus.cc:1240] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:22.256457 24572 consensus_queue.cc:1048] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:10:22.278329 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 68095.8us
I20260709 12:10:22.268493 22604 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7.
I20260709 12:10:22.279713 24465 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:10:22.291604 24563 log.cc:927] Time spent T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.296s	user 0.004s	sys 0.005s
I20260709 12:10:22.274612 24545 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:22.292950 22449 raft_consensus.cc:1275] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:22.294754 24575 consensus_queue.cc:1048] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:22.295419 24574 consensus_queue.cc:1048] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:22.298022 24548 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:22.354645 24548 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:22.298617 24569 raft_consensus.cc:3055] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:22.280053 24543 consensus_queue.cc:1059] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.019s
W20260709 12:10:22.300030 24566 log.cc:927] Time spent T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.295s	user 0.001s	sys 0.000s
I20260709 12:10:22.288645 24559 raft_consensus.cc:3055] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:22.300587 23120 raft_consensus.cc:1240] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:10:22.273967 23116 rpcz_store.cc:276] 0709 12:10:20.141177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.144684 (+  3507us) service_pool.cc:224] Handling call
0709 12:10:20.994531 (+849847us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b5800110198. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809eee 000000000036eb39 00007f9ccf87d1e0 00007f9ccf9460c4 00007f9ccf946131 00007f9ccf8f40a0 00007f9ccf8f3984 00007f9cc8e6e6d4 00007f9cc8e6e662
0709 12:10:22.252172 (+1257641us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b54001acf54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:22.252266 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":753109120}
I20260709 12:10:22.311262 22497 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:22.367121 22448 raft_consensus.cc:1240] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:22.309736 24465 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:22.286657 24153 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:22.282222 24509 raft_consensus.cc:2804] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:22.281754 24570 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:22.242692 24412 consensus_queue.cc:260] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:22.346869 22606 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 3.
W20260709 12:10:22.346385 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 121054us
I20260709 12:10:22.373716 22421 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:22.351603 22452 raft_consensus.cc:1275] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:22.359272 22455 raft_consensus.cc:1275] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:22.365917 22456 raft_consensus.cc:1275] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:10:22.310746 24544 raft_consensus.cc:2804] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:22.310676 22570 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:22.369805 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 58622us
I20260709 12:10:22.370098 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:22.377813 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 134125us
I20260709 12:10:22.378732 22496 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:22.375458 24570 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:22.382094 24570 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:22.362046 24569 raft_consensus.cc:740] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
W20260709 12:10:22.385322 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 74714.9us
I20260709 12:10:22.366854 24559 raft_consensus.cc:740] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:22.396198 22496 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:22.386173 24509 raft_consensus.cc:697] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:22.396409 24559 consensus_queue.cc:260] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:22.397787 24559 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:22.397596 24509 consensus_queue.cc:237] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:22.372152 24575 raft_consensus.cc:3055] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:22.399181 24575 raft_consensus.cc:740] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:22.399955 24575 consensus_queue.cc:260] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:22.389849 24312 raft_consensus.cc:2764] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:10:22.401109 24575 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:22.373456 24561 raft_consensus.cc:2804] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:22.388784 24578 raft_consensus.cc:2804] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:22.394379 24570 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:22.386077 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 113166us
I20260709 12:10:22.407176 22495 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:22.395531 24547 raft_consensus.cc:2749] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:22.396533 24465 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:22.390084 22570 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:22.372514 24543 consensus_queue.cc:1243] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer c863116d91c14d1ca50d6e8a46a37a8f log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:10:22.384449 22421 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:22.401397 24571 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:22.376708 24544 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.412535 22570 leader_election.cc:400] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 election: Vote denied by peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353) with higher term. Message: Invalid argument: T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 3. Current term is 4.
I20260709 12:10:22.415058 22570 leader_election.cc:403] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:10:22.416551 22570 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:22.415437 22421 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:22.454298 24385 raft_consensus.cc:2804] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:22.455190 24385 raft_consensus.cc:697] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:22.456137 24385 consensus_queue.cc:237] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:22.415088 24355 raft_consensus.cc:2804] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:22.431440 24450 raft_consensus.cc:2749] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353) with higher term. Message: Invalid argument: T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 3. Current term is 4.
I20260709 12:10:22.459980 22570 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:22.437691 24547 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.459981 24581 raft_consensus.cc:2749] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.468037 22570 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:22.450733 24428 raft_consensus.cc:2804] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:22.463148 24465 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.416832 24544 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.425855 24580 raft_consensus.cc:2804] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:22.414804 24578 raft_consensus.cc:697] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 4 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:22.415305 24570 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:22.435680 24348 consensus_queue.cc:1048] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:10:22.435645 24543 consensus_queue.cc:1059] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:10:22.481037 24386 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:22.484092 24546 raft_consensus.cc:3055] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:22.469139 24355 raft_consensus.cc:697] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:22.481835 24312 raft_consensus.cc:2749] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:22.487469 24584 log.cc:927] Time spent T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 12:10:22.488636 24571 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:22.472896 24509 raft_consensus.cc:2804] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:22.485680 22570 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:22.476362 24548 consensus_queue.cc:1048] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:10:22.482380 24428 raft_consensus.cc:697] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:22.485442 24580 raft_consensus.cc:697] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 4 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:22.465369 24569 consensus_queue.cc:260] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:22.510450 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:22.517484 22570 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:22.505335 24546 raft_consensus.cc:740] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:22.483443 24465 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:22.515875 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 108896us
I20260709 12:10:22.481719 24441 consensus_queue.cc:1048] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:10:22.519019 22570 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:22.516988 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 56157.5us
I20260709 12:10:22.519019 22495 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:22.520877 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 124767us
I20260709 12:10:22.521608 22496 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:22.510401 24545 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:22.522197 22495 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:22.514479 24425 raft_consensus.cc:2749] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:22.530289 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:22.531059 23123 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5.
I20260709 12:10:22.529027 22495 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:22.533944 23119 raft_consensus.cc:1275] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:22.536751 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:10:22.527159 24583 log.cc:927] Time spent T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:10:22.518224 24509 raft_consensus.cc:697] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:22.544669 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:22.524567 24571 raft_consensus.cc:2749] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.522375 24450 raft_consensus.cc:2749] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:22.548378 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:22.546506 22495 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:22.560559 24386 leader_election.cc:290] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:22.563786 24386 raft_consensus.cc:2749] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:22.530207 24543 raft_consensus.cc:2749] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:22.561323 22496 leader_election.cc:400] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 election: Vote denied by peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353) with higher term. Message: Invalid argument: T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 3. Current term is 4.
I20260709 12:10:22.569108 22496 leader_election.cc:403] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:10:22.541208 24545 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.572254 22497 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
W20260709 12:10:22.548663 24588 log.cc:927] Time spent T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:10:22.548589 24592 raft_consensus.cc:2749] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:22.549332 24593 raft_consensus.cc:993] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881: : Instructing follower c863116d91c14d1ca50d6e8a46a37a8f to start an election
I20260709 12:10:22.570367 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:22.577351 22456 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:22.571026 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:22.580093 22448 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 4: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:22.571084 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:22.571736 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:22.580761 22450 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:10:22.573496 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:22.575479 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:22.582574 22452 raft_consensus.cc:1240] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:22.582235 24428 consensus_queue.cc:237] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:22.583340 24581 consensus_queue.cc:1048] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:22.584461 23116 raft_consensus.cc:1275] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:22.584995 24386 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.545909 24453 consensus_queue.cc:1048] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:10:22.576656 24545 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:22.588050 24545 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:22.565891 24567 raft_consensus.cc:2749] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.591102 24582 raft_consensus.cc:2804] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:22.591297 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:22.591939 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:22.592744 22523 raft_consensus.cc:2410] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:22.594560 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:22.595211 24593 raft_consensus.cc:1081] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Signalling peer c863116d91c14d1ca50d6e8a46a37a8f to start an election
I20260709 12:10:22.595408 22528 raft_consensus.cc:2410] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:22.595675 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:22.596303 22600 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 4.
I20260709 12:10:22.596673 24580 consensus_queue.cc:237] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:22.597592 24582 raft_consensus.cc:697] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:22.598518 24582 consensus_queue.cc:237] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:22.596478 24509 consensus_queue.cc:237] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:22.602892 22453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2015) took 1149 ms. Trace:
I20260709 12:10:22.601812 24558 raft_consensus.cc:3055] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:22.603464 24558 raft_consensus.cc:740] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:22.603646 22422 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:22.604199 24465 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:22.604355 24558 consensus_queue.cc:260] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:22.605499 24590 raft_consensus.cc:2804] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:22.605903 24590 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.606189 24590 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.573810 24546 consensus_queue.cc:260] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:22.608213 24546 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:22.603286 22453 rpcz_store.cc:276] 0709 12:10:21.453774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.470117 (+ 16343us) service_pool.cc:224] Handling call
0709 12:10:22.602739 (+1132622us) spinlock_profiling.cc:243] Waited 544 ms on lock 0x7b540019fd54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:22.602832 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1250778880}
I20260709 12:10:22.571630 24355 consensus_queue.cc:237] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:22.611778 24558 raft_consensus.cc:3060] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:22.615664 24570 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:22.616462 24412 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.560796 24586 consensus_queue.cc:1048] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 12:10:22.624883 24564 raft_consensus.cc:3055] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:22.625304 24564 raft_consensus.cc:740] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:22.625046 24542 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:22.626130 24564 consensus_queue.cc:260] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:22.567062 24578 consensus_queue.cc:237] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:22.629455 22569 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:22.633920 22455 raft_consensus.cc:1275] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:22.639107 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:22.639896 22526 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 3.
I20260709 12:10:22.642079 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:22.642663 22528 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:22.648257 22421 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:22.640802 24312 raft_consensus.cc:2804] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:22.575932 24348 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:22.651775 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:22.666368 22527 raft_consensus.cc:2393] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 4: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:22.652264 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:22.652474 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:22.653146 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:22.655238 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:22.653184 24465 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.655850 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:22.576261 24571 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.629492 24547 raft_consensus.cc:2749] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:22.660097 22450 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7.
I20260709 12:10:22.660595 22456 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 3.
I20260709 12:10:22.664572 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:22.672577 22528 raft_consensus.cc:1240] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:22.672765 22526 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
I20260709 12:10:22.664785 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:22.667254 23125 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:10:22.667994 22523 raft_consensus.cc:2393] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 3: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:22.668444 22532 raft_consensus.cc:2368] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 2. Current term is 3.
I20260709 12:10:22.669013 22530 raft_consensus.cc:2393] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 4: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:22.655987 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:22.675266 22457 raft_consensus.cc:1240] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:22.676365 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.677284 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:22.677908 22524 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 5.
W20260709 12:10:22.682497 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 166201us
I20260709 12:10:22.683941 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:10:22.684232 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 164163us
I20260709 12:10:22.688208 22527 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.689163 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:22.691184 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:22.693773 22524 raft_consensus.cc:1275] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:22.696504 23088 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:22.685891 22421 leader_election.cc:336] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 1.553s (SENT)
I20260709 12:10:22.606853 24521 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:22.666671 24586 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:22.698405 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:22.658677 22449 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 3.
I20260709 12:10:22.699996 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:22.701905 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:22.641266 24385 consensus_queue.cc:1048] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 12:10:22.705318 22421 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:22.641642 24450 consensus_queue.cc:1048] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 12:10:22.707546 24153 raft_consensus.cc:2749] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.709693 23088 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:22.712785 22532 raft_consensus.cc:2410] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:22.713233 22526 raft_consensus.cc:1275] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:22.710729 22495 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:22.829355 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 118704us
I20260709 12:10:22.710076 24387 raft_consensus.cc:2749] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.719208 22530 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
 from {username='slave'} at 127.0.0.1:39980
I20260709 12:10:22.682678 24571 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:22.712324 24586 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.723501 24544 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:22.679620 24465 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:22.672008 24348 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:22.822259 22421 leader_election.cc:336] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 1.601s (SENT)
I20260709 12:10:22.847453 22421 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:10:22.848465 22421 leader_election.cc:336] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 1.614s (SENT)
I20260709 12:10:22.848826 22421 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:22.683200 24441 consensus_queue.cc:1048] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:10:22.683313 24548 consensus_queue.cc:1048] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:10:22.852368 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:22.823738 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:22.823518 24409 raft_consensus.cc:2749] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:22.860139 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:22.711675 24564 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.698164 24561 raft_consensus.cc:697] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:22.868209 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:22.832968 24386 raft_consensus.cc:2749] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353) with higher term. Message: Invalid argument: T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 3. Current term is 4.
I20260709 12:10:22.831501 22530 raft_consensus.cc:606] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 LEADER]: Received request to transfer leadership to TS c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:22.831630 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 122047us
I20260709 12:10:22.846514 24586 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:22.844233 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:22.845115 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:22.890129 22495 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:10:22.850871 22525 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:22.706389 24425 consensus_queue.cc:1048] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 12:10:22.850786 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:22.899111 23121 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 3.
I20260709 12:10:22.824352 22527 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
W20260709 12:10:22.855010 22421 leader_election.cc:336] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 1.676s (SENT)
I20260709 12:10:22.852798 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:22.901063 22421 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:22.856760 24542 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:22.858170 24550 consensus_queue.cc:1048] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:22.858500 22451 raft_consensus.cc:1275] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:10:22.906527 22451 pending_rounds.cc:85] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f: Aborting all ops after (but not including) 5
I20260709 12:10:22.862660 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:22.862928 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:22.867394 23119 raft_consensus.cc:1240] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:22.908560 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:22.908684 24348 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:22.910048 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:22.910842 22528 raft_consensus.cc:2410] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:22.911566 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:22.912060 22528 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:22.911865 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 223400us
I20260709 12:10:22.716216 24596 consensus_queue.cc:1048] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:10:22.869148 22454 raft_consensus.cc:2393] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 3: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:22.832671 24513 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:22.845952 24511 raft_consensus.cc:2804] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:22.872946 22448 raft_consensus.cc:1240] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:22.873284 23088 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:10:22.918848 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 45660us
I20260709 12:10:22.917078 24210 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:22.920013 24511 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:22.920184 24465 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:22.920475 24511 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.920588 24153 raft_consensus.cc:2749] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:22.842505 22526 raft_consensus.cc:1275] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:22.921209 24465 consensus_queue.cc:1059] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:22.840457 24590 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:22.921964 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:22.922518 22526 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 4.
I20260709 12:10:22.923326 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:22.923655 24590 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:22.923727 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:22.924561 22525 raft_consensus.cc:2393] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 4: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
W20260709 12:10:22.925983 24600 log.cc:927] Time spent T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:10:22.917361 24333 consensus_queue.cc:1048] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 12:10:22.902657 24591 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:22.928529 24270 raft_consensus.cc:3055] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:22.928901 24270 raft_consensus.cc:740] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:22.929066 24571 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:22.929960 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:22.930485 22606 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.866353 24312 raft_consensus.cc:697] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:22.931345 22523 raft_consensus.cc:1275] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:22.931649 24312 consensus_queue.cc:237] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:22.875722 22450 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
 from {username='slave'} at 127.0.0.1:51844
I20260709 12:10:22.881242 24544 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:22.877550 24561 consensus_queue.cc:237] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:22.898360 22453 raft_consensus.cc:1275] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:22.889850 23122 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 3.
I20260709 12:10:22.891096 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:22.861575 24578 raft_consensus.cc:2749] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:22.905062 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:22.898243 24450 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:22.948755 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:22.865068 24575 raft_consensus.cc:2749] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.950671 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:22.951962 23122 raft_consensus.cc:1275] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:10:22.914714 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 59753.6us
W20260709 12:10:22.953281 22421 leader_election.cc:336] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 1.711s (SENT)
I20260709 12:10:22.953665 22421 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:22.906857 22451 pending_rounds.cc:107] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:10:22.954481 22451 raft_consensus.cc:2889] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:22.954712 22421 leader_election.cc:336] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 1.756s (SENT)
I20260709 12:10:22.915387 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:22.955732 24521 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:22.915382 22456 raft_consensus.cc:1275] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:22.956561 24590 raft_consensus.cc:2749] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.859725 24603 consensus_queue.cc:1048] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 12:10:22.959247 22531 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
I20260709 12:10:22.929629 24513 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:22.901703 23124 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 4: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:22.895926 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:22.923869 22526 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 2.
I20260709 12:10:22.940428 22455 raft_consensus.cc:2368] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 4. Current term is 5.
I20260709 12:10:22.940946 22525 raft_consensus.cc:1275] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:22.945909 23120 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 4.
I20260709 12:10:22.905694 22496 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:22.906096 24386 raft_consensus.cc:2804] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:10:22.955710 22421 leader_election.cc:336] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 1.797s (SENT)
I20260709 12:10:22.968534 22421 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:10:22.947729 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 233984us
W20260709 12:10:22.969537 22421 leader_election.cc:336] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 1.838s (SENT)
I20260709 12:10:22.965840 22606 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5.
W20260709 12:10:22.970928 22421 leader_election.cc:336] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 1.911s (SENT)
I20260709 12:10:22.972127 22422 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:22.974346 22450 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 12:10:22.969494 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.982420 22450 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:22.988060 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:22.988698 22604 raft_consensus.cc:3060] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.991040 22606 raft_consensus.cc:1275] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:22.992813 22351 catalog_manager.cc:5697] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 1 to 2, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 2 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:22.994181 22351 catalog_manager.cc:5697] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 2 to 3, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 3 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:22.987244 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 67029.3us
I20260709 12:10:22.972959 24441 raft_consensus.cc:2749] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:22.996411 22604 raft_consensus.cc:2468] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 5.
I20260709 12:10:22.973145 24572 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.995771 22351 catalog_manager.cc:5697] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: config changed from index 4 to 5, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:22.985313 23117 raft_consensus.cc:2393] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 3: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:22.985905 24575 raft_consensus.cc:2804] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:23.005618 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:23.005566 22351 catalog_manager.cc:5697] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 3 to 4, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 4 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:10:22.929656 24270 consensus_queue.cc:260] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:22.998131 23088 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:23.024010 23088 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:22.962235 24450 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:23.009258 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:23.029996 22570 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
W20260709 12:10:23.042167 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:23.016199 22450 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:23.008567 22606 raft_consensus.cc:2368] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 4. Current term is 5.
I20260709 12:10:23.008821 22351 catalog_manager.cc:5697] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 3 to 4, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 4 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:23.048717 22351 catalog_manager.cc:5697] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 1 to 2, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 2 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:23.050493 22351 catalog_manager.cc:5697] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: config changed from index 3 to 4, term changed from 2 to 3, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to <none>, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:23.052086 22351 catalog_manager.cc:5697] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 2 to 3, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 3 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:22.995153 24509 consensus_queue.cc:1048] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 12:10:22.990450 24387 consensus_queue.cc:1059] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:10:23.071907 24575 raft_consensus.cc:697] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:23.081929 24270 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:23.165305 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 135400us
I20260709 12:10:23.168955 22570 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:23.007817 24572 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:23.202411 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:23.167660 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 141731us
W20260709 12:10:23.213569 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 188776us
W20260709 12:10:23.277561 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 108679us
I20260709 12:10:23.279342 22570 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:23.276558 23089 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:23.286860 23089 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:23.287768 22570 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:23.170879 24453 raft_consensus.cc:2749] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:23.167503 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:23.308702 23121 raft_consensus.cc:1275] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:23.169556 24521 consensus_queue.cc:1048] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.137s
W20260709 12:10:23.332600 24610 log.cc:927] Time spent T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
W20260709 12:10:23.339653 24616 log.cc:927] Time spent T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
W20260709 12:10:23.341419 24601 log.cc:927] Time spent T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.318s	user 0.000s	sys 0.001s
I20260709 12:10:23.355301 24605 consensus_queue.cc:1048] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
W20260709 12:10:23.370015 24611 log.cc:927] Time spent T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:10:23.371846 22598 raft_consensus.cc:1240] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:23.305734 24613 raft_consensus.cc:2804] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:23.375567 24613 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:23.376168 24613 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:23.299079 24609 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:23.379321 24609 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:23.379840 24609 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:23.383427 22449 raft_consensus.cc:2393] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 5: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
W20260709 12:10:23.387755 24604 log.cc:927] Time spent T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.214s	user 0.000s	sys 0.000s
I20260709 12:10:23.307441 24385 raft_consensus.cc:2749] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:23.307570 24387 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.392324 24387 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:23.398002 24575 consensus_queue.cc:237] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:23.405262 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:23.406157 22606 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 4.
I20260709 12:10:23.409070 22422 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:23.414161 24513 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:23.415314 24513 consensus_queue.cc:1059] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:23.299780 24355 raft_consensus.cc:2749] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:23.410768 24578 raft_consensus.cc:2804] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:23.482664 22421 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.007s	sys 0.001s
W20260709 12:10:23.483668 22421 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.007s	sys 0.001s
W20260709 12:10:23.484403 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 512011us
W20260709 12:10:23.487805 24312 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.003s	sys 0.006s
W20260709 12:10:23.488999 24312 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.004s	sys 0.006s
I20260709 12:10:23.491799 24153 raft_consensus.cc:2749] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:23.494560 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 195812us
I20260709 12:10:23.496439 23088 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:23.418889 24477 raft_consensus.cc:2804] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:23.497781 22421 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:10:23.494869 24210 consensus_meta.cc:287] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.575s	user 0.007s	sys 0.004s
I20260709 12:10:23.501588 24210 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:23.508220 24450 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:23.516191 24511 consensus_meta.cc:287] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.595s	user 0.009s	sys 0.002s
I20260709 12:10:23.516844 24511 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:23.523412 24632 raft_consensus.cc:2749] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:23.525695 24632 raft_consensus.cc:3055] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:23.526160 24632 raft_consensus.cc:740] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:23.531563 24477 raft_consensus.cc:697] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 5 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:23.533047 24477 consensus_queue.cc:237] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:23.540951 24521 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:23.541491 24521 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:23.541952 24521 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:23.545826 24586 consensus_meta.cc:287] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.640s	user 0.009s	sys 0.000s
I20260709 12:10:23.546243 24586 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:23.548683 24586 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:23.556160 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:23.476115 24578 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:23.563550 24578 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:23.568605 24428 raft_consensus.cc:2764] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
W20260709 12:10:23.582383 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:23.583199 24387 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:23.592317 24511 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:23.593694 22526 raft_consensus.cc:1240] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:10:23.593466 24632 consensus_queue.cc:260] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:23.594887 24632 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:23.596530 24210 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.596843 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:23.597046 24210 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:10:23.599517 24564 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.599952 24210 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:23.600287 22570 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:23.600131 24564 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:23.602721 24564 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:23.604197 24450 raft_consensus.cc:2749] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:23.604277 24348 consensus_queue.cc:1048] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:23.607070 22450 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:23.609092 22528 consensus_meta.cc:287] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.697s	user 0.010s	sys 0.001s
I20260709 12:10:23.609867 22528 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 4.
W20260709 12:10:23.614239 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 114953us
I20260709 12:10:23.613363 24511 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.632995 23124 raft_consensus.cc:1240] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:23.634366 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:23.642302 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:23.652081 23121 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 4.
I20260709 12:10:23.641858 23125 raft_consensus.cc:1275] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:10:23.664450 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 48118.3us
W20260709 12:10:23.669175 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 53824us
I20260709 12:10:23.672024 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:23.673580 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 177217us
I20260709 12:10:23.674665 23088 leader_election.cc:400] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 2. Current term is 3.
I20260709 12:10:23.675552 23088 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:23.629976 24620 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:23.619141 24509 consensus_queue.cc:1048] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 12:10:23.625568 24428 consensus_queue.cc:1059] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:10:23.684501 23088 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:23.688766 23088 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:23.687671 24620 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:23.679978 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:23.677712 24453 consensus_queue.cc:1048] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:10:23.671084 24511 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:23.749742 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 462940us
I20260709 12:10:23.755795 23089 leader_election.cc:400] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 4. Current term is 5.
I20260709 12:10:23.756990 23089 leader_election.cc:403] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:23.683817 24621 consensus_queue.cc:1059] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:10:23.770102 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:23.774952 23123 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 4.
I20260709 12:10:23.754372 23117 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:23.766521 22450 raft_consensus.cc:1275] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 12:10:23.771063 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 82400.6us
I20260709 12:10:23.742146 24635 raft_consensus.cc:2749] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:23.759996 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 73606.9us
I20260709 12:10:23.779985 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:23.781503 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:23.782598 23123 raft_consensus.cc:2410] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:23.762619 24636 raft_consensus.cc:2749] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:23.759598 24627 raft_consensus.cc:2804] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:23.788182 23123 raft_consensus.cc:1240] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 5 LEADER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:23.769330 24650 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:10:23.791095 24511 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:23.795357 24635 consensus_queue.cc:1048] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:10:23.799522 24631 log.cc:927] Time spent T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:10:23.799809 24650 raft_consensus.cc:2749] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 4. Current term is 5.
I20260709 12:10:23.800650 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:10:23.801487 24634 log.cc:927] Time spent T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:10:23.802327 23118 raft_consensus.cc:1275] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:10:23.805537 24606 log.cc:927] Time spent T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.854s	user 0.008s	sys 0.000s
I20260709 12:10:23.806351 24609 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:23.807467 23116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 689) took 1163 ms. Trace:
I20260709 12:10:23.814049 24620 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:23.787798 24636 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:10:23.825145 24270 consensus_meta.cc:287] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.651s	user 0.010s	sys 0.000s
I20260709 12:10:23.790150 24627 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:23.828820 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:23.852473 23124 raft_consensus.cc:2393] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 3: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:23.833540 24569 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:23.774830 24613 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:23.838891 22455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 425) took 1200 ms. Trace:
I20260709 12:10:23.854213 22455 rpcz_store.cc:276] 0709 12:10:22.638901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.749358 (+110457us) service_pool.cc:224] Handling call
0709 12:10:23.838612 (+1089254us) spinlock_profiling.cc:243] Waited 87.1 ms on lock 0x7b5400241b54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:23.838810 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":200386816}
I20260709 12:10:23.842015 24513 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:10:23.846100 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 940419us
I20260709 12:10:23.877516 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:23.848805 24386 raft_consensus.cc:697] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:23.850471 24592 consensus_queue.cc:1048] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:10:23.856660 24557 raft_consensus.cc:2749] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:23.882879 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:23.851265 24636 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:23.853983 24627 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:23.836018 23116 rpcz_store.cc:276] 0709 12:10:22.644075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.656919 (+ 12844us) service_pool.cc:224] Handling call
0709 12:10:22.657268 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:22.657611 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:22.657648 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:22.658093 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 12:10:22.851979 (+193886us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:22.852028 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.852120 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:23.805031 (+952911us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:10:23.807185 (+  2154us) raft_consensus.cc:1685] finished
0709 12:10:23.807212 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:23.807408 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1684,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":82,"spinlock_wait_cycles":35126528,"thread_start_us":193565,"threads_started":1,"wal-append.queue_time_us":259697}
I20260709 12:10:23.862192 24543 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:23.864593 24547 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.864697 24581 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.866243 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:23.866885 24607 raft_consensus.cc:3055] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:23.867329 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:23.869786 24561 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:23.869940 24613 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:23.870297 24453 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.866968 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:23.907773 22604 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:23.828820 24578 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:23.877874 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:23.848742 24593 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.883728 22525 raft_consensus.cc:2376] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4. Re-sending same reply.
I20260709 12:10:23.911433 22531 raft_consensus.cc:2410] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 5 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:10:23.911972 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:23.912482 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:23.913260 22531 raft_consensus.cc:2376] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4. Re-sending same reply.
I20260709 12:10:23.914275 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:23.888453 22602 raft_consensus.cc:1275] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:23.898233 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:23.902212 23118 raft_consensus.cc:1275] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:10:23.882794 24559 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:23.915370 22530 raft_consensus.cc:3055] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:23.914964 22531 raft_consensus.cc:2393] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 3: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:23.926810 22604 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 4.
I20260709 12:10:23.919540 22530 raft_consensus.cc:740] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:23.929330 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:23.930413 22531 raft_consensus.cc:2393] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 3: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:23.931525 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:23.932682 22531 raft_consensus.cc:2393] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 4: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:23.933524 22531 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b955a164159b49b9bf083e35e340e323"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:39980
I20260709 12:10:23.934254 22531 raft_consensus.cc:606] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 LEADER]: Received request to transfer leadership to TS 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:23.906908 24561 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:23.902925 24636 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:23.897022 24521 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:23.937493 24386 consensus_queue.cc:237] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:23.938566 24609 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:23.900758 24607 raft_consensus.cc:740] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:23.884423 24513 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:23.917337 24453 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:23.903811 24581 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:23.905738 24543 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:23.951844 22453 raft_consensus.cc:2393] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 5: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:23.900882 24547 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:23.958600 22530 consensus_queue.cc:260] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:23.965301 22530 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:23.967257 22525 raft_consensus.cc:2410] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:23.973680 24547 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:23.973821 24513 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:23.951972 24559 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:23.964789 24521 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:23.996094 24559 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:23.996531 24547 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.997112 24547 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:23.973891 24543 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:23.919648 24593 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:24.002648 22530 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:10:24.015640 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:24.012178 24453 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:24.013268 24578 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:24.026937 24615 log.cc:927] Time spent T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.677s	user 0.002s	sys 0.002s
I20260709 12:10:24.028179 22496 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:24.013793 24607 consensus_queue.cc:260] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:24.031255 24607 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.031304 22523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 1777) took 1167 ms. Trace:
I20260709 12:10:24.031721 22523 rpcz_store.cc:276] 0709 12:10:22.864223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.933828 (+ 69605us) service_pool.cc:224] Handling call
0709 12:10:22.934100 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:22.946259 (+ 12159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:22.946337 (+    78us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:22.946967 (+   630us) log.cc:844] Serialized 26 byte log entry
0709 12:10:23.004641 (+ 57674us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:23.084690 (+ 80049us) log.cc:844] Serialized 14 byte log entry
0709 12:10:23.847410 (+762720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.847516 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:24.013199 (+165683us) spinlock_profiling.cc:243] Waited 86 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:10:24.031041 (+ 17842us) raft_consensus.cc:1685] finished
0709 12:10:24.031132 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:24.031248 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":773045,"prepare.queue_time_us":16081,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":1688343,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":192,"spinlock_wait_cycles":197860224,"thread_start_us":134742,"threads_started":2,"wal-append.queue_time_us":358491}
I20260709 12:10:24.034219 22523 raft_consensus.cc:1275] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:23.993830 24581 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:24.036753 24593 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:24.060978 22523 raft_consensus.cc:1275] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:24.064406 24543 raft_consensus.cc:2804] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:24.066931 24543 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:24.067893 24543 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.070308 24641 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:24.070851 24641 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:24.072047 23119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 795) took 1153 ms. Trace:
I20260709 12:10:24.072546 23119 rpcz_store.cc:276] 0709 12:10:22.918234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.918398 (+   164us) service_pool.cc:224] Handling call
0709 12:10:22.918713 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.983379 (+ 64666us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:22.983409 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:22.983450 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:22.983479 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.071754 (+1088275us) spinlock_profiling.cc:243] Waited 64.5 ms on lock 0x7b540017e654. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:24.071810 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:24.071972 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":148256512}
I20260709 12:10:23.994377 23117 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 6.
I20260709 12:10:24.077160 22496 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:24.073299 24641 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:24.083446 24547 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:24.084152 24593 raft_consensus.cc:2804] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:24.084651 24593 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.085206 24593 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.092288 24465 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.092955 24465 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:24.095393 24465 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:24.097209 22451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1395) took 1786 ms. Trace:
I20260709 12:10:24.097908 24543 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:24.097681 22451 rpcz_store.cc:276] 0709 12:10:22.310524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.310655 (+   131us) service_pool.cc:224] Handling call
0709 12:10:22.350019 (+ 39364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.955028 (+605009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.096955 (+1141927us) spinlock_profiling.cc:243] Waited 508 ms on lock 0x7b5400240c54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:24.097141 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1168546048}
I20260709 12:10:24.104185 24564 raft_consensus.cc:3055] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:24.105373 24641 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:24.108902 22525 raft_consensus.cc:1240] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:10:24.111429 22530 raft_consensus.cc:1275] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:24.115804 24572 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:24.116137 24598 log.cc:927] Time spent T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 1.165s	user 0.003s	sys 0.006s
I20260709 12:10:24.134343 22526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 1780) took 1269 ms. Trace:
I20260709 12:10:24.138592 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:24.140635 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.201702 22526 rpcz_store.cc:276] 0709 12:10:22.864637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.962967 (+ 98330us) service_pool.cc:224] Handling call
0709 12:10:23.593460 (+630493us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:23.594112 (+   652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.134155 (+540043us) spinlock_profiling.cc:243] Waited 630 ms on lock 0x7b54004015d0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:24.134282 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1449092992}
I20260709 12:10:24.154999 24592 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:24.156068 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:10:24.203308 22570 leader_election.cc:336] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 2.102s (SENT)
I20260709 12:10:24.156703 24385 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.165354 22531 raft_consensus.cc:1275] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:24.168542 24580 consensus_queue.cc:1059] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:24.159044 24578 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:24.198180 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:24.198961 23121 raft_consensus.cc:1240] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 12:10:24.203423 22602 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.207072 22603 raft_consensus.cc:1275] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:24.203609 22526 raft_consensus.cc:1275] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:24.159348 24428 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:24.199616 24641 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:24.211840 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:24.193497 24612 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.199613 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:24.354655 22602 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
W20260709 12:10:24.473330 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.245539 22525 raft_consensus.cc:1240] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:24.491148 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 227780us
I20260709 12:10:24.200460 24586 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.490554 22603 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.194482 24564 raft_consensus.cc:740] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:24.492503 22526 raft_consensus.cc:1240] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:24.213423 22597 raft_consensus.cc:1240] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:24.492419 24598 log.cc:927] Time spent T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:10:24.205595 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:10:24.421857 24627 consensus_meta.cc:287] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.504s	user 0.005s	sys 0.004s
I20260709 12:10:24.209923 24385 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:24.531412 24385 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:24.532404 24564 consensus_queue.cc:260] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:24.420899 24450 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:24.446060 24547 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.420039 24569 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.525614 22529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 448) took 1949 ms. Trace:
I20260709 12:10:24.267201 24453 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.253312 24609 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.266192 24592 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:24.264074 24489 consensus_queue.cc:1048] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.280s
I20260709 12:10:24.392284 24243 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.468186 24581 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:24.442106 24580 consensus_queue.cc:1048] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 12:10:24.497380 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:24.533591 24564 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.547343 22529 rpcz_store.cc:276] 0709 12:10:22.575733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.576041 (+   308us) service_pool.cc:224] Handling call
0709 12:10:22.593967 (+ 17926us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:22.594327 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:22.594357 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:22.594777 (+   420us) log.cc:844] Serialized 26 byte log entry
0709 12:10:22.709540 (+114763us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:22.937167 (+227627us) log.cc:844] Serialized 14 byte log entry
0709 12:10:23.842947 (+905780us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b1800042880. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc77bbc0a 00007f9cd0efb219 00007f9cc7843a40 00007f9cc783e4e4 00007f9cc783e455 00007f9cca926060 00007f9cca938716 00007f9cca949287 00007f9cca949208
0709 12:10:23.843152 (+   205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.843227 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:24.115568 (+272341us) spinlock_profiling.cc:243] Waited 9.52 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:10:24.525382 (+409814us) raft_consensus.cc:1685] finished
0709 12:10:24.525412 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:24.525550 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10728,"prepare.queue_time_us":273932,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":2565,"raft.queue_time_us":909204,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":161,"spinlock_wait_cycles":25952768,"thread_start_us":222967,"threads_started":2,"wal-append.queue_time_us":351560}
I20260709 12:10:24.259681 24348 consensus_queue.cc:1048] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.281s
I20260709 12:10:24.498787 22570 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:24.258915 23117 raft_consensus.cc:1240] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:24.558781 22603 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5.
I20260709 12:10:24.517910 24586 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:24.564391 23120 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.872s	user 0.019s	sys 0.017s
W20260709 12:10:24.598611 23120 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.910s	user 0.020s	sys 0.017s
I20260709 12:10:24.253201 24578 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:24.559172 24640 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.793s	user 0.016s	sys 0.026s
I20260709 12:10:24.614550 22529 raft_consensus.cc:1275] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:24.539312 24627 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:24.595319 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 96603.1us
I20260709 12:10:24.254868 24428 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:24.522315 24593 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:24.588459 22497 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.019s	sys 0.020s
W20260709 12:10:24.624184 22497 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.020s	sys 0.020s
I20260709 12:10:24.619688 24605 consensus_queue.cc:1048] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:24.620656 24333 consensus_queue.cc:1048] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:24.643507 24428 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:24.563975 24453 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:24.651988 24453 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:24.646783 24572 raft_consensus.cc:3055] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:24.653208 24572 raft_consensus.cc:740] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:24.653321 23118 raft_consensus.cc:1240] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:24.521023 24612 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:24.654227 24572 consensus_queue.cc:260] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:24.559540 24569 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:24.572583 24609 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:24.591007 24243 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:24.625641 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 739361us
I20260709 12:10:24.554802 24547 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:24.640522 22420 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.879s	user 0.094s	sys 0.168s
W20260709 12:10:24.681125 22420 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.992s	user 0.094s	sys 0.168s
W20260709 12:10:24.683610 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.686225 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:24.686968 22453 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 4.
I20260709 12:10:24.621484 22570 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:24.659687 22525 raft_consensus.cc:1275] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:10:24.662678 22496 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.196.132:44353 timed out after 1.624s (SENT) [suppressed 78 similar messages]
I20260709 12:10:24.613606 24465 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.555624 24450 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:24.616667 24640 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.017s	sys 0.027s
I20260709 12:10:24.679077 22531 raft_consensus.cc:1240] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:24.709038 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:24.711740 22531 raft_consensus.cc:1275] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:24.600829 24385 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.597476 24641 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:24.713842 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:24.697749 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:24.694563 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:24.699132 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:24.596329 24581 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:24.716357 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:24.716967 22600 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 3.
I20260709 12:10:24.616400 24649 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:24.655616 24572 raft_consensus.cc:3060] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:24.677748 24545 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.921s	user 0.038s	sys 0.100s
I20260709 12:10:24.707450 22529 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.708222 24489 consensus_queue.cc:1048] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:24.708439 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:24.706095 24567 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.700404 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:24.720175 22497 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:24.786854 22525 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
W20260709 12:10:24.787195 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 67150.7us
I20260709 12:10:24.787999 22497 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:24.789247 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:24.789565 22497 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:10:24.789886 22449 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 3.
I20260709 12:10:24.790944 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:24.793733 24609 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:24.794517 24564 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.795385 24450 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:24.799052 24564 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:24.799959 24627 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:24.800547 24627 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.800976 24627 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:24.801424 24564 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:24.801931 24564 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.802342 24564 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:24.767199 24465 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:24.785091 24210 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.025s	user 0.011s	sys 0.026s
I20260709 12:10:24.776798 24649 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:24.718858 24580 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.768446 22601 raft_consensus.cc:1275] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:10:24.709069 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 87669.3us
I20260709 12:10:24.718642 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:10:24.717998 22530 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.771121 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:24.838330 22457 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 3.
I20260709 12:10:24.771322 22451 raft_consensus.cc:1240] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:24.771799 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:24.772056 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:24.777307 22421 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.023s	user 0.015s	sys 0.022s
I20260709 12:10:24.709141 24355 raft_consensus.cc:2749] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:24.681685 24543 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:24.776926 24545 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.021s	user 0.038s	sys 0.100s
I20260709 12:10:24.707113 24591 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
W20260709 12:10:24.840804 22421 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.087s	user 0.015s	sys 0.022s
I20260709 12:10:24.719825 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:24.856675 22421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.861177 22455 raft_consensus.cc:1275] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:24.860054 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:10:24.833490 24603 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.004s	user 0.012s	sys 0.028s
W20260709 12:10:24.865206 24603 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.053s	user 0.012s	sys 0.029s
I20260709 12:10:24.865360 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:24.861296 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:24.707064 24561 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:24.842756 22448 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.031s	user 0.014s	sys 0.027s
I20260709 12:10:24.802946 24627 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:10:24.857803 24387 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.022s	user 0.011s	sys 0.027s
I20260709 12:10:24.707852 24453 consensus_queue.cc:1048] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.153s
W20260709 12:10:24.832875 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:24.804629 24210 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.052s	user 0.012s	sys 0.026s
I20260709 12:10:24.868691 24543 raft_consensus.cc:2749] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:24.918370 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:24.899195 22602 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 3.
I20260709 12:10:24.834232 24567 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:24.894929 24441 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.020s	user 0.011s	sys 0.041s
W20260709 12:10:24.923323 23089 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.146s	user 0.014s	sys 0.031s
I20260709 12:10:24.820861 24581 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:24.824971 24593 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:24.813220 24578 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:24.826229 24569 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:24.805636 24465 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:24.823417 24649 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:24.898025 24621 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.112s	user 0.004s	sys 0.040s
I20260709 12:10:24.804277 24564 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:24.842056 24580 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:24.960597 24592 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:24.895468 24642 consensus_queue.cc:1048] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 12:10:24.898991 24609 consensus_queue.cc:1048] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 12:10:24.868875 24591 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:24.956583 24450 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.907397 22530 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
W20260709 12:10:24.907577 22454 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.203s	user 0.030s	sys 0.021s
W20260709 12:10:24.898078 23088 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.113s	user 0.009s	sys 0.034s
I20260709 12:10:24.905943 22529 raft_consensus.cc:1275] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:25.001911 24243 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:24.978462 24586 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:24.906635 24612 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:24.981076 24605 consensus_queue.cc:1048] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.109s
I20260709 12:10:24.978883 24489 consensus_queue.cc:1059] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
W20260709 12:10:25.136549 22532 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.286s	user 0.033s	sys 0.031s
W20260709 12:10:25.852164 22532 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.001s	user 0.046s	sys 0.062s
W20260709 12:10:25.668045 23124 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.104s	user 0.006s	sys 0.013s
W20260709 12:10:25.717940 22523 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.625s	user 0.020s	sys 0.034s
W20260709 12:10:25.853689 23124 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.289s	user 0.009s	sys 0.014s
W20260709 12:10:25.854208 22523 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.761s	user 0.021s	sys 0.035s
W20260709 12:10:25.093811 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:25.859747 22448 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.048s	user 0.015s	sys 0.040s
I20260709 12:10:25.853268 22456 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 3.
W20260709 12:10:25.573998 22604 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.416s	user 0.005s	sys 0.012s
W20260709 12:10:25.852001 23088 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.067s	user 0.017s	sys 0.047s
W20260709 12:10:25.861332 22604 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.703s	user 0.012s	sys 0.012s
W20260709 12:10:25.861693 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 2.08307e+06us
I20260709 12:10:25.862481 22455 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:25.636404 22422 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.120s	user 0.009s	sys 0.009s
W20260709 12:10:25.864643 22422 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.359s	user 0.009s	sys 0.015s
W20260709 12:10:25.865017 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 1.35943e+06us
I20260709 12:10:25.366211 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:10:25.226668 22498 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.342s	user 0.034s	sys 0.036s
W20260709 12:10:25.868777 22498 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.985s	user 0.046s	sys 0.046s
I20260709 12:10:25.029873 22570 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:25.870316 22454 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.166s	user 0.030s	sys 0.042s
W20260709 12:10:25.445156 23119 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.052s	user 0.018s	sys 0.054s
W20260709 12:10:25.871692 23119 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.596s	user 0.018s	sys 0.063s
W20260709 12:10:25.175649 22528 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.292s	user 0.015s	sys 0.050s
W20260709 12:10:25.872758 22528 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.990s	user 0.024s	sys 0.068s
W20260709 12:10:25.698513 22526 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.107s	user 0.000s	sys 0.019s
W20260709 12:10:25.874285 22526 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.284s	user 0.000s	sys 0.023s
W20260709 12:10:25.851951 23089 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.075s	user 0.025s	sys 0.044s
W20260709 12:10:25.190506 22527 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.344s	user 0.049s	sys 0.101s
W20260709 12:10:25.875479 22527 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.029s	user 0.058s	sys 0.138s
I20260709 12:10:25.887523 22448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1406) took 2877 ms. Trace:
W20260709 12:10:25.009836 24550 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.254s	user 0.022s	sys 0.027s
W20260709 12:10:25.287258 24385 consensus_meta.cc:287] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.575s	user 0.005s	sys 0.005s
W20260709 12:10:25.332548 24575 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.931s	user 0.016s	sys 0.042s
W20260709 12:10:25.860857 24621 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.075s	user 0.004s	sys 0.058s
I20260709 12:10:25.931592 22450 raft_consensus.cc:1275] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:25.932017 22455 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
I20260709 12:10:25.619814 24656 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:25.888833 24569 raft_consensus.cc:2804] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:25.890246 22530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56942 (request call id 1371) took 1231 ms. Trace:
I20260709 12:10:25.953233 22530 rpcz_store.cc:276] 0709 12:10:24.658793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.660223 (+  1430us) service_pool.cc:224] Handling call
0709 12:10:25.890082 (+1229859us) spinlock_profiling.cc:243] Waited 1.42 ms on lock 0x7b5400400bd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:25.890192 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3273088}
W20260709 12:10:25.591745 22598 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.002s	sys 0.015s
W20260709 12:10:25.418830 24645 log.cc:927] Time spent T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.233s	user 0.000s	sys 0.003s
W20260709 12:10:25.851776 24387 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.016s	user 0.020s	sys 0.039s
W20260709 12:10:25.861244 24441 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.988s	user 0.017s	sys 0.053s
W20260709 12:10:25.957087 22453 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.248s	user 0.016s	sys 0.023s
I20260709 12:10:25.926280 24592 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.927753 24593 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.878477 24666 raft_consensus.cc:2749] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:25.743005 24572 consensus_meta.cc:287] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.965s	user 0.012s	sys 0.000s
I20260709 12:10:25.933568 22455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 431) took 1072 ms. Trace:
I20260709 12:10:25.962582 22455 rpcz_store.cc:276] 0709 12:10:24.861156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.865079 (+  3923us) service_pool.cc:224] Handling call
0709 12:10:25.933504 (+1068425us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:25.365206 24311 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.238s	user 0.005s	sys 0.007s
W20260709 12:10:25.364888 24544 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.404s	user 0.021s	sys 0.059s
I20260709 12:10:25.249003 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:25.892251 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:25.400301 24626 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.245s	user 0.000s	sys 0.012s
W20260709 12:10:25.940856 22423 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.407s	user 0.012s	sys 0.024s
W20260709 12:10:25.984766 22423 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.451s	user 0.013s	sys 0.024s
I20260709 12:10:25.941856 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:25.985942 22456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1422) took 1027 ms. Trace:
W20260709 12:10:25.986215 22421 leader_election.cc:336] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 1.823s (SENT)
I20260709 12:10:25.986720 22421 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
W20260709 12:10:25.987498 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.986383 22456 rpcz_store.cc:276] 0709 12:10:24.958617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.888770 (+930153us) service_pool.cc:224] Handling call
0709 12:10:25.985869 (+ 97099us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:25.006681 24547 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:25.947479 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.773307 24657 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.721701 24655 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.960718 24569 raft_consensus.cc:697] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:25.951254 22450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2035) took 1170 ms. Trace:
I20260709 12:10:25.996874 22450 rpcz_store.cc:276] 0709 12:10:24.781093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.781971 (+   878us) service_pool.cc:224] Handling call
0709 12:10:24.833789 (+ 51818us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.932039 (+1098250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.950920 (+ 18881us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400241154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:25.951178 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2523920768}
W20260709 12:10:25.991838 22421 leader_election.cc:336] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 1.861s (SENT)
I20260709 12:10:25.889441 22529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1369) took 1861 ms. Trace:
W20260709 12:10:25.986510 24603 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.121s	user 0.012s	sys 0.041s
W20260709 12:10:25.931686 24575 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.530s	user 0.016s	sys 0.050s
I20260709 12:10:25.924378 22448 rpcz_store.cc:276] 0709 12:10:23.010494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.010865 (+   371us) service_pool.cc:224] Handling call
0709 12:10:23.075994 (+ 65129us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:23.086740 (+ 10746us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:23.086775 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:23.810854 (+724079us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b2c00033c98. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc9227a11 00007f9cc9237372 00007f9cca969a01 00007f9cca92e43a 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2
0709 12:10:23.811239 (+   385us) log.cc:844] Serialized 26 byte log entry
0709 12:10:25.860457 (+2049218us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:25.860493 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.860613 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:25.860649 (+    36us) raft_consensus.cc:1685] finished
0709 12:10:25.860658 (+     9us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:25.887442 (+ 26784us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4312,"raft.queue_time_us":7780,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":72,"spinlock_wait_cycles":33801600,"thread_start_us":2048844,"threads_started":1,"wal-append.queue_time_us":1554018}
I20260709 12:10:25.983961 24627 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:10:25.958525 22453 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.250s	user 0.016s	sys 0.023s
W20260709 12:10:25.959823 22496 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.269s	user 0.018s	sys 0.022s
I20260709 12:10:25.937402 24385 raft_consensus.cc:2749] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.943614 24543 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.889256 24612 consensus_queue.cc:1059] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.067s
W20260709 12:10:25.954780 22598 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.057s	user 0.002s	sys 0.032s
I20260709 12:10:25.940582 24581 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:25.975100 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:26.032543 22455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 434) took 1160 ms. Trace:
I20260709 12:10:26.032958 22455 rpcz_store.cc:276] 0709 12:10:24.871849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.974767 (+1102918us) service_pool.cc:224] Handling call
0709 12:10:26.032460 (+ 57693us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:26.034035 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:25.977763 23121 raft_consensus.cc:1240] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:25.978664 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:26.035526 23122 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.992257 24578 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:25.995306 24511 raft_consensus.cc:3055] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:25.972863 24592 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:25.990715 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:10:25.975651 24311 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.846s	user 0.010s	sys 0.024s
W20260709 12:10:25.975893 24544 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.015s	user 0.027s	sys 0.065s
I20260709 12:10:25.879818 22602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45576 (request call id 2147) took 1186 ms. Trace:
W20260709 12:10:25.987219 24626 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.867s	user 0.005s	sys 0.019s
W20260709 12:10:25.930915 24550 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.216s	user 0.032s	sys 0.051s
I20260709 12:10:25.998248 22529 rpcz_store.cc:276] 0709 12:10:24.027888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.618031 (+590143us) service_pool.cc:224] Handling call
0709 12:10:24.641572 (+ 23541us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.859834 (+1218262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.889217 (+ 29383us) spinlock_profiling.cc:243] Waited 65.7 ms on lock 0x7b54000d3ed4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:25.889385 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":151161600}
I20260709 12:10:25.889504 24561 consensus_queue.cc:1048] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 12:10:26.000125 22421 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:25.988996 24572 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.003333 23123 raft_consensus.cc:1275] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:10:25.953894 24656 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:26.005498 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:25.400307 24652 log.cc:927] Time spent T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:10:25.995146 24210 raft_consensus.cc:2749] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:25.991169 22449 raft_consensus.cc:2468] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 2.
I20260709 12:10:26.008072 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:26.026178 22496 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.335s	user 0.024s	sys 0.023s
W20260709 12:10:26.095969 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 1.43322e+06us
I20260709 12:10:26.079712 22456 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
I20260709 12:10:26.098222 22456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 435) took 1226 ms. Trace:
I20260709 12:10:26.098620 22456 rpcz_store.cc:276] 0709 12:10:24.872110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.988673 (+1116563us) service_pool.cc:224] Handling call
0709 12:10:26.098160 (+109487us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:26.050833 24642 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.037456 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:25.952744 24649 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.038367 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:25.009979 24355 consensus_queue.cc:1048] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.949s
I20260709 12:10:25.879921 24450 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:26.141573 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:26.053315 22452 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.088s	user 0.008s	sys 0.009s
W20260709 12:10:26.148334 22452 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.186s	user 0.009s	sys 0.010s
I20260709 12:10:26.147130 24591 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:26.101110 24575 raft_consensus.cc:2749] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:10:26.150411 22495 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.916s	user 0.018s	sys 0.026s
W20260709 12:10:26.150955 22495 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.917s	user 0.019s	sys 0.026s
I20260709 12:10:26.110075 24243 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.110674 22449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 436) took 1104 ms. Trace:
W20260709 12:10:26.024322 24603 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.139s	user 0.013s	sys 0.042s
I20260709 12:10:26.056962 22602 rpcz_store.cc:276] 0709 12:10:24.693419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.693554 (+   135us) service_pool.cc:224] Handling call
0709 12:10:25.879591 (+1186037us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b540013b354. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:25.879743 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":424701312}
I20260709 12:10:26.061472 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:26.059298 24578 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:25.995731 24428 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:26.076187 23120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 696) took 2437 ms. Trace:
I20260709 12:10:26.196200 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:26.149530 24591 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.081008 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:26.026875 22422 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:10:26.053452 24386 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.430s	user 0.016s	sys 0.011s
W20260709 12:10:26.057060 24348 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.171s	user 0.011s	sys 0.011s
W20260709 12:10:26.080533 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 88718.1us
I20260709 12:10:26.050273 24511 raft_consensus.cc:740] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:26.106411 23122 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5.
I20260709 12:10:26.024935 24441 consensus_queue.cc:1059] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
W20260709 12:10:26.076301 24333 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.256s	user 0.015s	sys 0.028s
I20260709 12:10:26.057396 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:25.995471 24657 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:26.062336 24385 raft_consensus.cc:2749] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:26.186134 24567 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:26.139750 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:26.316579 22456 raft_consensus.cc:2468] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:10:26.097384 23117 raft_consensus.cc:1240] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:10:26.047199 24627 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:26.053390 23087 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.920s	user 0.000s	sys 0.018s
I20260709 12:10:26.044410 24543 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:26.050500 24581 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:25.974200 24593 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:26.065660 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:26.353590 23125 raft_consensus.cc:2393] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 4: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:26.097419 24572 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:26.185732 23121 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
W20260709 12:10:26.185029 22451 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.292s	user 0.012s	sys 0.043s
I20260709 12:10:26.241684 24591 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:26.359534 22451 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.466s	user 0.012s	sys 0.043s
I20260709 12:10:26.196107 23120 rpcz_store.cc:276] 0709 12:10:23.638660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.638814 (+   154us) service_pool.cc:224] Handling call
0709 12:10:23.639248 (+   434us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:23.639733 (+   485us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:23.639770 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:23.665023 (+ 25253us) log.cc:844] Serialized 52 byte log entry
0709 12:10:24.599112 (+934089us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:24.599149 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.599206 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:25.367973 (+768767us) spinlock_profiling.cc:243] Waited 40.1 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:10:26.049936 (+681963us) raft_consensus.cc:1685] finished
0709 12:10:26.049965 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:26.076125 (+ 26160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":650,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":7532,"spinlock_wait_cycles":92132224,"thread_start_us":910644,"threads_started":1,"wal-append.queue_time_us":1456833}
W20260709 12:10:25.992982 24607 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.165s	user 0.009s	sys 0.011s
W20260709 12:10:26.361456 24607 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.534s	user 0.010s	sys 0.011s
I20260709 12:10:26.147614 24210 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:26.168269 24580 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:26.229833 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 222186us
I20260709 12:10:26.362564 24210 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:26.184952 24651 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.996s	user 0.011s	sys 0.040s
W20260709 12:10:26.363456 24651 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.174s	user 0.012s	sys 0.040s
I20260709 12:10:26.226001 23123 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
W20260709 12:10:26.225826 22497 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.435s	user 0.024s	sys 0.023s
W20260709 12:10:26.364260 22497 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.574s	user 0.025s	sys 0.023s
W20260709 12:10:26.364796 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 1.57521e+06us
W20260709 12:10:26.294057 22421 leader_election.cc:336] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 2.008s (SENT)
I20260709 12:10:26.366690 22421 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:10:26.367653 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 73627.6us
W20260709 12:10:26.368053 22421 connection.cc:256] RPC call timeout handler was delayed by -2.0241595980000966s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15910000000000002s for a response
W20260709 12:10:26.368500 22421 connection.cc:256] RPC call timeout handler was delayed by -1.8684595980000722s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1764s for a response
W20260709 12:10:26.368770 22421 connection.cc:256] RPC call timeout handler was delayed by -1.7442595980000988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1902s for a response
W20260709 12:10:26.369015 22421 connection.cc:256] RPC call timeout handler was delayed by -1.6803595980002228s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19730000000000003s for a response
I20260709 12:10:26.146297 24649 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:26.286543 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 1.25915e+06us
I20260709 12:10:26.112156 24569 consensus_queue.cc:237] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:26.310081 23089 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:10:26.312005 24676 log.cc:927] Time spent T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:10:26.002681 24655 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:26.286554 24386 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.663s	user 0.016s	sys 0.016s
W20260709 12:10:26.293804 24348 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.416s	user 0.011s	sys 0.011s
I20260709 12:10:26.140132 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:26.377580 22455 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 2.
I20260709 12:10:26.378456 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:26.282963 24465 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.185057 24243 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:26.169561 24642 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:26.307458 24333 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.484s	user 0.016s	sys 0.030s
I20260709 12:10:26.171232 22449 rpcz_store.cc:276] 0709 12:10:25.006758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.076542 (+ 69784us) service_pool.cc:224] Handling call
0709 12:10:26.101362 (+1024820us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:26.286841 24668 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.286705 24621 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:26.340920 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:26.343845 23087 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.211s	user 0.000s	sys 0.018s
W20260709 12:10:26.426487 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 1.29367e+06us
I20260709 12:10:26.374616 24580 raft_consensus.cc:2749] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:26.292687 24677 raft_consensus.cc:2804] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:26.312824 24675 raft_consensus.cc:3055] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:10:26.278247 23088 connection.cc:256] RPC call timeout handler was delayed by -2.2387147069998719s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18600000000000003s for a response
I20260709 12:10:26.364832 24210 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:26.370172 22570 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:26.399276 24561 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:26.307983 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:26.468322 23122 raft_consensus.cc:2468] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 1.
W20260709 12:10:26.371150 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 61138.1us
I20260709 12:10:26.470791 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:26.366202 22497 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:26.471403 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:26.229924 24428 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:26.396867 22450 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
I20260709 12:10:26.353188 24567 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.352375 24450 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:26.358598 24641 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:26.405369 22457 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:26.366890 24683 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:26.412973 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:26.415716 22495 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:10:26.428288 23087 connection.cc:256] RPC call timeout handler was delayed by -1.2614747599998282s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2068s for a response
W20260709 12:10:26.312857 24664 log.cc:927] Time spent T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 12:10:26.380218 24564 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:26.438617 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:26.446117 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:26.453732 22571 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.008s	user 0.008s	sys 0.045s
I20260709 12:10:26.433785 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:26.400521 24666 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:26.396306 24511 consensus_queue.cc:260] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:26.472615 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:26.607898 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:10:26.719552 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 303931us
I20260709 12:10:26.475302 23122 raft_consensus.cc:1275] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:10:26.720485 22571 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.534s	user 0.011s	sys 0.049s
I20260709 12:10:26.720367 23123 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:26.471881 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 105737us
W20260709 12:10:26.522390 22421 connection.cc:256] RPC call timeout handler was delayed by -1.1358595980000246s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2578s for a response
I20260709 12:10:26.466440 23088 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:26.722348 22455 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:10:26.471998 23121 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:26.722731 22495 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:26.618718 22604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43070 (request call id 332) took 2481 ms. Trace:
I20260709 12:10:26.661641 22528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 1784) took 2784 ms. Trace:
I20260709 12:10:26.719949 23120 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 3.
I20260709 12:10:26.723658 22604 rpcz_store.cc:276] 0709 12:10:24.136932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.140962 (+  4030us) service_pool.cc:224] Handling call
0709 12:10:24.141363 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:24.152203 (+ 10840us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:24.152248 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:24.157813 (+  5565us) log.cc:844] Serialized 26 byte log entry
0709 12:10:25.861970 (+1704157us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:25.862023 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.862166 (+   143us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:26.618452 (+756286us) raft_consensus.cc:1685] finished
0709 12:10:26.618482 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:26.618644 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10367,"raft.queue_time_us":11075,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":146,"thread_start_us":1703723,"threads_started":1,"wal-append.queue_time_us":1943033}
I20260709 12:10:26.431524 24635 raft_consensus.cc:2804] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:26.719722 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:26.601871 24690 log.cc:927] Time spent T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 12:10:26.599884 24678 log.cc:927] Time spent T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.313s	user 0.000s	sys 0.001s
I20260709 12:10:26.425706 24489 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:26.721760 22531 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:10:26.765029 22455 raft_consensus.cc:1240] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 5. Current term is 6. Ops: [5.8-5.8]
W20260709 12:10:26.690001 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 319890us
I20260709 12:10:26.724571 22528 rpcz_store.cc:276] 0709 12:10:23.876815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.876974 (+   159us) service_pool.cc:224] Handling call
0709 12:10:23.877364 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:25.873219 (+1995855us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:25.873279 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:25.873794 (+   515us) log.cc:844] Serialized 26 byte log entry
0709 12:10:26.379154 (+505360us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:26.379224 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.379353 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:26.661351 (+281998us) raft_consensus.cc:1685] finished
0709 12:10:26.661382 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:26.661566 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5393,"raft.queue_time_us":22942,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":9515,"thread_start_us":2424390,"threads_started":2,"wal-append.queue_time_us":631684}
I20260709 12:10:26.781486 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:26.756199 22421 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:26.782403 22455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1419) took 1910 ms. Trace:
W20260709 12:10:26.743856 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 285902us
I20260709 12:10:26.787848 22455 rpcz_store.cc:276] 0709 12:10:24.871571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.741935 (+1870364us) service_pool.cc:224] Handling call
0709 12:10:26.764736 (+ 22801us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:26.782125 (+ 17389us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.782345 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:26.403209 24465 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:26.740935 24683 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:26.539683 24657 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:26.789664 22455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1420) took 1910 ms. Trace:
I20260709 12:10:26.789731 24657 raft_consensus.cc:2804] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:26.790374 24657 raft_consensus.cc:697] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 4 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:26.790565 24465 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:26.790856 24683 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:26.741304 24561 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:26.480952 24592 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:26.791365 24489 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:26.791870 24592 raft_consensus.cc:2749] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:26.791533 24657 consensus_queue.cc:237] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:26.599404 24670 log.cc:927] Time spent T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.305s	user 0.000s	sys 0.001s
I20260709 12:10:26.480352 24385 raft_consensus.cc:2749] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:26.661163 24702 log.cc:927] Time spent T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
W20260709 12:10:26.624421 24686 log.cc:927] Time spent T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.429s	user 0.000s	sys 0.002s
I20260709 12:10:26.791436 24683 consensus_queue.cc:1048] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:10:26.817802 24697 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.818398 24697 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:26.819296 24706 consensus_queue.cc:1059] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:26.726037 24612 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.820672 24697 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:26.821028 24612 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:26.744951 24666 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:26.823549 24333 consensus_queue.cc:1048] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:26.825594 24612 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:10:26.601011 24673 log.cc:927] Time spent T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
W20260709 12:10:26.748677 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.741425 24567 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:26.742089 24450 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
W20260709 12:10:26.600282 24680 log.cc:927] Time spent T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.243s	user 0.000s	sys 0.000s
I20260709 12:10:26.793119 23124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 811) took 2605 ms. Trace:
W20260709 12:10:26.600705 24663 log.cc:927] Time spent T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.243s	user 0.000s	sys 0.000s
I20260709 12:10:26.790056 22455 rpcz_store.cc:276] 0709 12:10:24.879004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.788932 (+1909928us) service_pool.cc:224] Handling call
0709 12:10:26.789203 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:26.789378 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:26.789404 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:26.789444 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:26.789475 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.789521 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:26.789614 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:26.742679 22495 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:26.905182 22524 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56940 (request call id 1770) took 4042 ms (client timeout 1823 ms). Trace:
W20260709 12:10:26.905998 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 163382us
I20260709 12:10:26.748447 22497 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:26.783170 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:26.910275 22531 raft_consensus.cc:2468] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 4.
I20260709 12:10:26.911528 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:26.797089 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:26.802227 23123 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 5.
W20260709 12:10:26.626392 24682 log.cc:927] Time spent T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
I20260709 12:10:26.912533 22604 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:10:26.603312 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:26.667191 24578 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:26.807292 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:26.459568 24621 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:26.674187 24386 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.808668 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:26.961090 23120 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 4.
I20260709 12:10:26.962076 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:26.602679 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:26.457646 24675 raft_consensus.cc:740] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
W20260709 12:10:26.811741 24544 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.010s	sys 0.026s
I20260709 12:10:26.781322 24665 raft_consensus.cc:2804] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:26.974031 24674 log.cc:927] Time spent T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
W20260709 12:10:26.974279 24544 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.010s	sys 0.026s
I20260709 12:10:26.974382 24665 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:26.812806 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:26.975013 24665 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:26.975991 24712 log.cc:927] Time spent T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:10:26.976099 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:26.977216 24713 raft_consensus.cc:2749] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:26.977530 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:26.978223 22600 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 4.
I20260709 12:10:26.978336 24713 raft_consensus.cc:2804] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:26.813613 22597 raft_consensus.cc:1240] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 4. Current term is 5. Ops: [3.6-4.7]
I20260709 12:10:26.814232 24656 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317)
I20260709 12:10:26.978895 24713 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:26.807943 24311 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:26.979261 23119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 808) took 2799 ms. Trace:
I20260709 12:10:26.979369 24713 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:26.979557 24311 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:26.974932 24544 consensus_queue.cc:1048] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:10:26.979724 23119 rpcz_store.cc:276] 0709 12:10:24.180375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.180567 (+   192us) service_pool.cc:224] Handling call
0709 12:10:24.180989 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:24.199794 (+ 18805us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:24.199837 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:24.206018 (+  6181us) log.cc:844] Serialized 26 byte log entry
0709 12:10:25.872174 (+1666156us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:25.872237 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.872327 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:26.979049 (+1106722us) raft_consensus.cc:1685] finished
0709 12:10:26.979070 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:26.979206 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3010,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":8658,"thread_start_us":1603206,"threads_started":1,"wal-append.queue_time_us":2399904}
I20260709 12:10:26.981469 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:26.981714 24311 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:26.815812 24489 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:26.827488 22523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1352) took 2948 ms. Trace:
I20260709 12:10:26.982420 22523 rpcz_store.cc:276] 0709 12:10:23.879553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.074587 (+195034us) service_pool.cc:224] Handling call
0709 12:10:24.091348 (+ 16761us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:24.092212 (+   864us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:24.092242 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:24.092713 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 12:10:25.854729 (+1762016us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:26.395988 (+541259us) log.cc:844] Serialized 14 byte log entry
0709 12:10:26.396334 (+   346us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.396502 (+   168us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:26.827215 (+430713us) raft_consensus.cc:1685] finished
0709 12:10:26.827247 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:26.827416 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76410,"prepare.queue_time_us":820201,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":168482,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":191,"thread_start_us":2191569,"threads_started":2,"wal-append.queue_time_us":2221544}
I20260709 12:10:26.829671 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:26.984921 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:26.830379 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:26.831081 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:26.986388 24243 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:26.812737 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:26.827272 24572 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:26.982169 22600 raft_consensus.cc:1240] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:26.827821 24428 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:26.826525 24666 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:26.987818 24665 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:26.836292 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.960884 24450 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:26.434506 24668 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:26.992393 24665 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:26.992998 24668 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:26.776705 24543 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:26.761243 24627 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:26.759922 24698 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:26.775575 24547 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:26.994254 24547 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:26.872193 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:26.869791 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 60064.2us
I20260709 12:10:26.995968 24642 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:26.996608 24543 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.997110 24543 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:26.557518 24694 raft_consensus.cc:2804] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:26.912374 24677 raft_consensus.cc:697] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 5 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:26.999176 24694 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:26.999545 24694 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:26.999789 24677 consensus_queue.cc:237] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:27.003327 24593 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:26.885339 24655 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:26.885169 24649 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:27.004142 24489 consensus_queue.cc:1059] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:26.892736 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:26.805742 24591 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:26.558553 22598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2146) took 1847 ms. Trace:
W20260709 12:10:26.905742 22524 rpcz_store.cc:269] 0709 12:10:22.862313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.862442 (+   129us) service_pool.cc:224] Handling call
0709 12:10:26.904907 (+4042465us) spinlock_profiling.cc:243] Waited 3.49 s on lock 0x7b54004001d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:26.905084 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8028935424}
I20260709 12:10:26.820685 24706 raft_consensus.cc:3055] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:27.017498 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:26.952662 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:26.903571 23124 rpcz_store.cc:276] 0709 12:10:24.187531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.187724 (+   193us) service_pool.cc:224] Handling call
0709 12:10:24.505581 (+317857us) spinlock_profiling.cc:243] Waited 5.3 ms on lock 0x7b5800110198. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf907fc0 00007f9ccf8f2929 00007f9ccf8f23d2 00007f9cc8e69bd4
0709 12:10:24.505823 (+   242us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:24.506296 (+   473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:24.506338 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:24.524457 (+ 18119us) log.cc:844] Serialized 26 byte log entry
0709 12:10:25.854508 (+1330051us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:25.854568 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.854657 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:26.792858 (+938201us) raft_consensus.cc:1685] finished
0709 12:10:26.792879 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:26.793062 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9767,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":8338,"spinlock_wait_cycles":12184960,"thread_start_us":1289940,"threads_started":1,"wal-append.queue_time_us":1594978}
I20260709 12:10:26.953657 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:27.021114 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:27.021724 23123 raft_consensus.cc:2468] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 1.
I20260709 12:10:27.022604 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:26.954774 22603 raft_consensus.cc:2393] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 4: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:26.957239 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:27.015156 24656 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:26.962253 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 169403us
I20260709 12:10:26.962680 23120 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 3.
I20260709 12:10:26.967200 24386 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:26.972877 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:27.049218 24386 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:27.049600 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:27.050261 23117 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:27.051199 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:27.051985 23117 raft_consensus.cc:2410] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:27.052764 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:26.982014 23119 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 4.
I20260709 12:10:26.741005 24641 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:26.994215 24698 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:26.802850 24511 raft_consensus.cc:3060] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:26.624395 24580 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:27.006611 23125 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:26.869448 24683 consensus_queue.cc:1048] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.096s
I20260709 12:10:27.005607 24489 consensus_queue.cc:1059] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:10:26.895934 24697 consensus_queue.cc:1048] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.112s
W20260709 12:10:27.017764 24348 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.000s	sys 0.035s
I20260709 12:10:26.990839 24450 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:26.770859 24564 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:27.016556 24311 consensus_queue.cc:1059] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:10:27.017464 24543 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:27.017191 24706 raft_consensus.cc:740] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:27.033597 24612 raft_consensus.cc:3055] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:10:27.066916 24348 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.000s	sys 0.036s
I20260709 12:10:27.164001 23116 raft_consensus.cc:1275] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:27.171463 24311 raft_consensus.cc:3055] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:27.163532 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:27.172312 24348 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.172645 24450 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:27.172914 22523 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 3.
I20260709 12:10:27.173265 24348 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:27.173519 24450 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:27.174399 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:26.948237 22448 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:26.828172 22454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1411) took 3231 ms. Trace:
I20260709 12:10:27.176066 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:27.177043 22523 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:27.175778 22454 rpcz_store.cc:276] 0709 12:10:23.596299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.685806 (+ 89507us) service_pool.cc:224] Handling call
0709 12:10:23.704056 (+ 18250us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:25.870807 (+2166751us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:25.870851 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:25.925799 (+ 54948us) log.cc:844] Serialized 26 byte log entry
0709 12:10:26.358452 (+432653us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:26.358491 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.358683 (+   192us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:26.827967 (+469284us) raft_consensus.cc:1685] finished
0709 12:10:26.827985 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:26.828105 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":140647,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"thread_start_us":2562666,"threads_started":2,"wal-append.queue_time_us":778873}
I20260709 12:10:26.956228 22456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 433) took 2088 ms. Trace:
I20260709 12:10:27.179414 22456 rpcz_store.cc:276] 0709 12:10:24.867625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.955219 (+2087594us) service_pool.cc:224] Handling call
0709 12:10:26.955614 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:26.955829 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:26.955866 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:26.955922 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:26.955966 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.956032 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:26.956161 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:27.145469 22452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1417) took 2291 ms. Trace:
I20260709 12:10:27.172217 24311 raft_consensus.cc:740] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
W20260709 12:10:27.172642 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:27.171533 22570 connection.cc:256] RPC call timeout handler was delayed by -1.3548087909998685s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16310000000000002s for a response
W20260709 12:10:27.184792 22570 connection.cc:256] RPC call timeout handler was delayed by -1.331408791000058s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16570000000000001s for a response
I20260709 12:10:27.184464 24311 consensus_queue.cc:260] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:27.185702 22457 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1424) took 2190 ms (client timeout 1819 ms). Trace:
W20260709 12:10:27.186211 22457 rpcz_store.cc:269] 0709 12:10:24.995457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.891924 (+896467us) service_pool.cc:224] Handling call
0709 12:10:27.185308 (+1293384us) spinlock_profiling.cc:243] Waited 421 ms on lock 0x7b5400379e54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:27.185493 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":968857856}
I20260709 12:10:27.146649 22449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 441) took 1170 ms. Trace:
I20260709 12:10:27.187129 22449 rpcz_store.cc:276] 0709 12:10:25.975918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.469105 (+493187us) service_pool.cc:224] Handling call
0709 12:10:27.146332 (+677227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:27.187266 24607 consensus_queue.cc:1048] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:27.189865 24607 consensus_queue.cc:1059] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:26.985471 22527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 1778) took 4121 ms. Trace:
I20260709 12:10:27.191184 22527 rpcz_store.cc:276] 0709 12:10:22.864368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.955714 (+ 91346us) service_pool.cc:224] Handling call
0709 12:10:22.956046 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:23.845825 (+889779us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:23.845851 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:23.846334 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 12:10:25.875953 (+2029619us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:25.876003 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.876091 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:26.985268 (+1109177us) raft_consensus.cc:1685] finished
0709 12:10:26.985288 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:26.985417 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":889345,"raft.queue_time_us":894544,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":8443,"thread_start_us":2029228,"threads_started":1,"wal-append.queue_time_us":2394162}
I20260709 12:10:27.194492 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:27.204180 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:27.205672 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:27.206218 22451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1416) took 2365 ms. Trace:
I20260709 12:10:27.043195 22605 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 7.
I20260709 12:10:26.913578 22496 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:10:27.208998 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 295344us
I20260709 12:10:27.063980 23117 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:27.212901 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:27.044816 23121 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 4.
I20260709 12:10:27.155007 22530 raft_consensus.cc:1240] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 LEADER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:27.018744 22524 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:10:26.786767 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:26.988927 22531 raft_consensus.cc:2393] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 5: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:27.012223 22532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 1783) took 4146 ms. Trace:
I20260709 12:10:27.245633 22532 rpcz_store.cc:276] 0709 12:10:22.865369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.973609 (+108240us) service_pool.cc:224] Handling call
0709 12:10:22.974012 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:23.846647 (+872635us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:23.846682 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:23.850443 (+  3761us) log.cc:844] Serialized 26 byte log entry
0709 12:10:24.009141 (+158698us) spinlock_profiling.cc:243] Waited 5.5 ms on lock 0x7b4800250158. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9ccf857aa1 00007f9ccf84eb37 00007f9ccf84e9ca 00007f9ccf94626f 00007f9ccf945f37 00007f9ccf95a55c 00007f9ccf95a508 00007f9ccf95a488 00007f9ccf95a443 00007f9ccf9596ec 00007f9cce883a96
0709 12:10:25.852712 (+1843571us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:26.294367 (+441655us) log.cc:844] Serialized 14 byte log entry
0709 12:10:26.772527 (+478160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.772605 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:26.851393 (+ 78788us) raft_consensus.cc:1685] finished
0709 12:10:26.960219 (+108826us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:27.012138 (+ 51919us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":892696,"prepare.queue_time_us":800342,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":62,"raft.queue_time_us":1056075,"raft.run_cpu_time_us":1504,"raft.run_wall_time_us":228648,"spinlock_wait_cycles":12655360,"thread_start_us":2812445,"threads_started":3,"wal-append.queue_time_us":2215222}
I20260709 12:10:27.249053 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:27.251315 24592 raft_consensus.cc:2804] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:27.252401 22528 raft_consensus.cc:2393] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 3: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
W20260709 12:10:27.251343 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 494767us
I20260709 12:10:27.253684 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:27.254707 22421 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:27.156430 23123 raft_consensus.cc:2410] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:27.157763 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:27.206617 22451 rpcz_store.cc:276] 0709 12:10:24.840393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.840650 (+   257us) service_pool.cc:224] Handling call
0709 12:10:24.867851 (+ 27201us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.868115 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:26.360160 (+1492045us) log.cc:844] Serialized 14 byte log entry
0709 12:10:26.719000 (+358840us) log.cc:844] Serialized 14 byte log entry
0709 12:10:26.829976 (+110976us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b18003dac20. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc7841522 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd 0000000000388634 0000000000388479 00007f9cc782483a
0709 12:10:27.037730 (+207754us) spinlock_profiling.cc:243] Waited 5.91 ms on lock 0x7b18003dac20. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc7841522 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd 0000000000388634 0000000000388479 00007f9cc782483a
0709 12:10:27.205196 (+167466us) spinlock_profiling.cc:243] Waited 6.93 ms on lock 0x7b18003dac20. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc77bbc0a 00007f9cd0efb219 00007f9cc7843a40 00007f9cc783e4e4 00007f9cc783e455 00007f9cca926060 00007f9cca938716 00007f9cca949287 00007f9cca949208
0709 12:10:27.205497 (+   301us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:27.205596 (+    99us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:27.205729 (+   133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:27.205850 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:27.206049 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51481,"prepare.queue_time_us":1479988,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":87,"raft.queue_time_us":493158,"raft.run_cpu_time_us":422,"raft.run_wall_time_us":19737,"spinlock_wait_cycles":70506624,"thread_start_us":1824840,"threads_started":2,"wal-append.queue_time_us":400537}
I20260709 12:10:27.006198 22599 raft_consensus.cc:2468] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 2.
I20260709 12:10:27.022881 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:27.262337 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:27.263401 22524 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
I20260709 12:10:27.159859 23122 raft_consensus.cc:2468] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 3.
I20260709 12:10:27.046288 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:27.008000 23118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 704) took 1029 ms. Trace:
I20260709 12:10:27.083758 24385 raft_consensus.cc:3055] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:27.072532 24564 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:27.079052 24567 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:27.064715 24580 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:27.073782 24581 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:27.072448 24453 raft_consensus.cc:3055] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:27.089847 24605 raft_consensus.cc:3055] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:27.088573 24612 raft_consensus.cc:740] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:27.287153 24605 raft_consensus.cc:740] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:27.288358 24612 consensus_queue.cc:260] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:27.288621 24605 consensus_queue.cc:260] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:27.290024 24605 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:27.290511 24612 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.071738 24621 leader_election.cc:290] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:27.090306 24561 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:27.295902 22448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1425) took 2152 ms. Trace:
I20260709 12:10:27.296470 22448 rpcz_store.cc:276] 0709 12:10:25.090539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.168755 (+1078216us) service_pool.cc:224] Handling call
0709 12:10:27.235444 (+1066689us) spinlock_profiling.cc:243] Waited 751 ms on lock 0x7b5400379954. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:27.243053 (+  7609us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1727323520}
I20260709 12:10:27.297724 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:27.298434 22448 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 3.
I20260709 12:10:27.298929 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:27.299767 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:27.147815 22453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2029) took 2459 ms. Trace:
I20260709 12:10:27.186650 24311 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:27.149977 22455 raft_consensus.cc:1240] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:26.968288 22525 raft_consensus.cc:1275] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:27.196095 24489 raft_consensus.cc:3055] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:27.015571 22598 rpcz_store.cc:276] 0709 12:10:24.692645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.699776 (+  7131us) service_pool.cc:224] Handling call
0709 12:10:24.781811 (+ 82035us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.839707 (+ 57896us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:26.056483 (+1216776us) log.cc:844] Serialized 14 byte log entry
0709 12:10:26.403396 (+346913us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:26.425729 (+ 22333us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:26.431447 (+  5718us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.467487 (+ 36040us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:26.540162 (+ 72675us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47829,"prepare.queue_time_us":509131,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":3553,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":48777,"thread_start_us":1433139,"threads_started":2,"wal-append.queue_time_us":756472}
I20260709 12:10:27.196503 24348 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:27.191216 24547 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:27.198503 24450 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:27.006687 22569 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.009s	sys 0.023s
W20260709 12:10:27.200054 22450 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 437) took 1863 ms (client timeout 1902 ms). Trace:
I20260709 12:10:27.200035 22523 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
I20260709 12:10:27.202454 22570 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:10:27.202334 24333 consensus_queue.cc:1048] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:27.088034 24641 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:27.053815 24656 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:27.084956 24679 log.cc:927] Time spent T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.937s	user 0.002s	sys 0.009s
I20260709 12:10:27.082795 24694 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:27.074158 24698 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:27.078295 24706 consensus_queue.cc:260] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:27.052672 24713 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:27.174690 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 426196us
I20260709 12:10:27.236323 22454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1423) took 2258 ms. Trace:
I20260709 12:10:27.238889 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:27.158125 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 100074us
I20260709 12:10:27.251344 22495 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:27.264077 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:27.295964 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:27.299829 22529 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:27.303606 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:27.307130 23118 rpcz_store.cc:276] 0709 12:10:25.976806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.983662 (+  6856us) service_pool.cc:224] Handling call
0709 12:10:26.005166 (+ 21504us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:26.043992 (+ 38826us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:26.372708 (+328716us) log.cc:844] Serialized 14 byte log entry
0709 12:10:26.884026 (+511318us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:26.898511 (+ 14485us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:26.921150 (+ 22639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.957847 (+ 36697us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:27.006318 (+ 48471us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":564192,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":53,"raft.queue_time_us":136778,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":109,"thread_start_us":680955,"threads_started":2,"wal-append.queue_time_us":591911}
I20260709 12:10:27.309404 24453 raft_consensus.cc:740] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:27.312625 24580 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:27.313139 24385 raft_consensus.cc:740] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:27.315315 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:27.316318 23117 raft_consensus.cc:2410] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:10:27.181299 22452 rpcz_store.cc:276] 0709 12:10:24.854191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.854346 (+   155us) service_pool.cc:224] Handling call
0709 12:10:24.880132 (+ 25786us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:24.906361 (+ 26229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:24.906401 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:24.922366 (+ 15965us) log.cc:844] Serialized 26 byte log entry
0709 12:10:26.157691 (+1235325us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:26.157752 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.157852 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:27.144596 (+986744us) raft_consensus.cc:1685] finished
0709 12:10:27.144677 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:27.145162 (+   485us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15144,"raft.queue_time_us":15390,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":24187,"thread_start_us":1195529,"threads_started":1,"wal-append.queue_time_us":1420145}
I20260709 12:10:27.252075 24592 raft_consensus.cc:697] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:27.576213 22496 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:10:27.323509 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 69063.2us
I20260709 12:10:27.580703 24581 raft_consensus.cc:2804] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:27.341816 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:10:27.349691 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.317479 22453 rpcz_store.cc:276] 0709 12:10:24.688399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.688570 (+   171us) service_pool.cc:224] Handling call
0709 12:10:24.688935 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:24.698604 (+  9669us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:24.698640 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:24.708353 (+  9713us) log.cc:844] Serialized 26 byte log entry
0709 12:10:26.026704 (+1318351us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:26.341382 (+314678us) log.cc:844] Serialized 14 byte log entry
0709 12:10:26.342162 (+   780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.342614 (+   452us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:27.147224 (+804610us) raft_consensus.cc:1685] finished
0709 12:10:27.147267 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:27.147584 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":370776,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":16419,"raft.queue_time_us":178442,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":16614,"thread_start_us":1604092,"threads_started":2,"wal-append.queue_time_us":1599254}
I20260709 12:10:27.341907 22530 raft_consensus.cc:1275] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:27.583904 22454 rpcz_store.cc:276] 0709 12:10:24.976166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.178697 (+2202531us) service_pool.cc:224] Handling call
0709 12:10:27.207667 (+ 28970us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:27.234367 (+ 26700us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:27.234407 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:27.234461 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:27.234511 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:27.234575 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:27.234707 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29056}
I20260709 12:10:27.589641 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:27.591365 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:27.593025 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:27.596294 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:27.597254 23118 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 4.
I20260709 12:10:27.599284 23118 raft_consensus.cc:1240] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:27.338891 22351 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55978 (request call id 332) took 5591 ms. Trace:
I20260709 12:10:27.322875 23125 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 3.
I20260709 12:10:27.503238 22448 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 3.
I20260709 12:10:27.333186 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:27.594573 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:27.581277 24581 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:27.581635 22450 rpcz_store.cc:269] 0709 12:10:25.336797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.005846 (+669049us) service_pool.cc:224] Handling call
0709 12:10:27.199627 (+1193781us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b5400221854. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:27.199864 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":594636672}
I20260709 12:10:27.323392 22455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1421) took 2415 ms. Trace:
I20260709 12:10:27.604398 22532 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
I20260709 12:10:27.325410 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:27.621580 22455 rpcz_store.cc:276] 0709 12:10:24.908085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.953566 (+2045481us) service_pool.cc:224] Handling call
0709 12:10:27.149313 (+195747us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:27.323097 (+173784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:27.323307 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:27.322775 22449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1430) took 1274 ms. Trace:
I20260709 12:10:27.630348 22532 raft_consensus.cc:1240] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:10:27.627861 23124 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 3.
W20260709 12:10:27.631619 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:27.632158 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.632791 22524 raft_consensus.cc:1275] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:10:27.585400 24489 raft_consensus.cc:740] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:27.633744 22527 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 3.
I20260709 12:10:27.637676 23122 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 4.
I20260709 12:10:27.623497 24581 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:27.641738 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:27.632133 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:27.324561 24578 raft_consensus.cc:2804] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:27.337381 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:27.648825 24210 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:10:27.649303 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.684616 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:27.651446 24656 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:27.652585 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 450261us
I20260709 12:10:27.654681 24567 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:27.655150 22421 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:27.655910 24547 raft_consensus.cc:2804] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:27.335631 22353 catalog_manager.cc:5697] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 2 to 3, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 3 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:10:27.656330 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 420131us
I20260709 12:10:27.350147 24675 consensus_queue.cc:260] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:27.723539 24675 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:27.725371 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 144545us
I20260709 12:10:27.725680 24567 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:27.728034 24580 raft_consensus.cc:2749] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:27.630396 22449 rpcz_store.cc:276] 0709 12:10:26.048635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.188457 (+1139822us) service_pool.cc:224] Handling call
0709 12:10:27.209241 (+ 20784us) spinlock_profiling.cc:243] Waited 4.4 ms on lock 0x7b5800002a98. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf907fc0 00007f9ccf8f2929 00007f9ccf8f23d2 00007f9cc8e69bd4
0709 12:10:27.209541 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:27.210086 (+   545us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:27.210600 (+   514us) log.cc:844] Serialized 14 byte log entry
0709 12:10:27.322280 (+111680us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:27.322353 (+    73us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:27.322418 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:27.322533 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:27.322665 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77976,"prepare.queue_time_us":20283,"prepare.run_cpu_time_us":125,"prepare.run_wall_time_us":3111,"raft.queue_time_us":78147,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":132,"spinlock_wait_cycles":10110720,"thread_start_us":27573,"threads_started":1,"wal-append.queue_time_us":416852}
I20260709 12:10:27.731724 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:27.732136 22569 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.264s	user 0.011s	sys 0.039s
W20260709 12:10:27.732762 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 1.26508e+06us
I20260709 12:10:27.733093 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:27.644762 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:27.664386 24605 raft_consensus.cc:2804] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:27.672266 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:27.673754 24385 consensus_queue.cc:260] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:27.674741 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.677557 24641 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:27.678265 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.680032 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:27.680600 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:27.682091 22605 raft_consensus.cc:1240] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:27.682113 23120 raft_consensus.cc:2393] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 5: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:27.683130 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:27.684082 23119 raft_consensus.cc:1240] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:27.323580 24720 raft_consensus.cc:2749] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:27.649868 24621 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:27.684170 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:27.709439 24210 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:27.709888 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:27.687034 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:27.498898 24635 raft_consensus.cc:697] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 4 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:27.715524 24453 consensus_queue.cc:260] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:27.716962 22529 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
I20260709 12:10:27.717931 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:27.721469 23121 raft_consensus.cc:2393] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 4: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:27.720369 23123 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 3.
W20260709 12:10:28.122526 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.875290 22528 raft_consensus.cc:1240] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:27.735293 22450 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
W20260709 12:10:27.736933 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.971520 22531 raft_consensus.cc:2393] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 4: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
W20260709 12:10:28.128136 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:28.131671 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:27.967144 24612 consensus_meta.cc:287] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.634s	user 0.007s	sys 0.004s
I20260709 12:10:27.735584 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:27.734462 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:28.155985 22523 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 2.
I20260709 12:10:27.738365 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:27.739123 24547 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:27.737649 24734 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.743147 24683 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.161793 22606 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:10:27.738040 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:27.738631 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:27.737929 22353 catalog_manager.cc:5697] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 2 to 4, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 4 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:28.129558 24605 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:28.166360 22453 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
I20260709 12:10:28.169432 22570 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
W20260709 12:10:28.176378 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 594497us
I20260709 12:10:28.180299 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:28.183846 22448 raft_consensus.cc:2393] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 3: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
W20260709 12:10:28.186216 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.185913 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:10:28.186734 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.168568 24547 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:28.192493 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:28.173671 24385 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:28.195590 24333 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.201597 24333 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:28.204051 24333 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:28.195899 22599 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
I20260709 12:10:28.190232 22452 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 4.
I20260709 12:10:28.196382 24348 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:28.196902 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 65126.6us
I20260709 12:10:28.197091 24701 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.197750 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:27.603135 22351 rpcz_store.cc:276] 0709 12:10:21.747073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.747275 (+   202us) service_pool.cc:224] Handling call
0709 12:10:27.338593 (+5591318us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:23.535101 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:23.535909 (+   808us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:23.535956 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:10:23.535982 (+    26us) tablet.cc:662] Decoding operations
0709 12:10:23.537087 (+  1105us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:23.537163 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:23.537203 (+    40us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:10:23.538056 (+   853us) tablet.cc:701] Row locks acquired
0709 12:10:23.538077 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:10:23.538261 (+   184us) write_op.cc:270] Start()
0709 12:10:23.538401 (+   140us) write_op.cc:276] Timestamp: P: 1783599023538201 usec, L: 0
0709 12:10:23.538425 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:10:23.617568 (+ 79143us) log.cc:844] Serialized 3356 byte log entry
0709 12:10:25.189016 (+1571448us) op_driver.cc:464] REPLICATION: finished
0709 12:10:26.540236 (+1351220us) write_op.cc:301] APPLY: starting
0709 12:10:26.558714 (+ 18478us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:26.639130 (+ 80416us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:26.661997 (+ 22867us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:26.832369 (+170372us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:26.832585 (+   216us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:10:26.832627 (+    42us) write_op.cc:312] APPLY: finished
0709 12:10:26.832898 (+   271us) log.cc:844] Serialized 65 byte log entry
0709 12:10:27.065232 (+232334us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:27.068985 (+  3753us) write_op.cc:454] Released schema lock
0709 12:10:27.071301 (+  2316us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:27.095370 (+ 24069us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:27.095427 (+    57us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6428,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":1237205,"apply.run_cpu_time_us":84636,"apply.run_wall_time_us":627082,"num_ops":8,"prepare.queue_time_us":413341,"prepare.run_cpu_time_us":19102,"prepare.run_wall_time_us":270430,"raft.queue_time_us":1422759,"raft.run_cpu_time_us":52385,"raft.run_wall_time_us":1175262,"replication_time_us":1650384,"thread_start_us":2562799,"threads_started":5,"wal-append.queue_time_us":394800,"wal-append.run_cpu_time_us":57258,"wal-append.run_wall_time_us":3111372}]]}
I20260709 12:10:28.181943 24605 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:28.213059 24348 raft_consensus.cc:697] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:28.217113 22606 raft_consensus.cc:2393] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 4: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:28.217330 24210 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:28.217566 24701 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:28.218333 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:28.189277 24683 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:28.219868 24701 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:28.221563 24683 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:28.223197 24612 consensus_queue.cc:1048] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:28.224483 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:28.216651 24348 consensus_queue.cc:237] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:28.218475 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:28.229816 23116 raft_consensus.cc:1240] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:28.230074 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.231068 24333 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.231222 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:28.231884 23123 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
I20260709 12:10:28.231655 24333 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:28.233875 24333 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:28.210461 22598 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:10:28.236356 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:28.237133 22598 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 4.
I20260709 12:10:28.235263 22570 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:28.238251 24333 raft_consensus.cc:2804] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:28.238703 24333 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.238879 24453 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:28.239153 24333 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:28.241860 24547 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:28.242918 22570 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:28.243371 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:28.178110 24621 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:28.267462 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 76054.6us
I20260709 12:10:28.251762 24635 consensus_queue.cc:237] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:28.257580 24734 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:28.258944 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:28.263574 22606 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:10:28.266960 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:28.153838 24641 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:28.249369 22421 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:27.715519 24489 consensus_queue.cc:260] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:28.286445 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:28.280761 22527 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.004s	sys 0.012s
W20260709 12:10:28.287323 22527 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.004s	sys 0.012s
I20260709 12:10:28.276804 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:28.245429 22353 catalog_manager.cc:5697] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 2 to 3, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 3 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:28.262661 24333 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:28.289773 22449 raft_consensus.cc:2410] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:10:28.295094 22453 raft_consensus.cc:1275] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:28.303889 22606 raft_consensus.cc:1240] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:28.277012 24547 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:28.308838 22451 raft_consensus.cc:2410] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:10:28.311183 22496 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.031s	sys 0.055s
I20260709 12:10:28.311358 22453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2041) took 1019 ms. Trace:
W20260709 12:10:28.310518 23088 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.001s	sys 0.015s
I20260709 12:10:28.286957 24621 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:28.287031 24567 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:28.291894 24385 raft_consensus.cc:2804] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:28.314687 22605 raft_consensus.cc:2393] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 4: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
W20260709 12:10:28.315438 22496 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.031s	sys 0.055s
W20260709 12:10:28.315659 23088 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.002s	sys 0.015s
I20260709 12:10:28.315531 22453 rpcz_store.cc:276] 0709 12:10:27.287224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.208897 (+921673us) service_pool.cc:224] Handling call
0709 12:10:28.274293 (+ 65396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:28.306638 (+ 32345us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.306826 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:28.313743 22422 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:10:28.330974 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 604446us
I20260709 12:10:28.335162 22604 raft_consensus.cc:2368] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 2. Current term is 3.
I20260709 12:10:28.335743 22496 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:28.336093 24706 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:28.337224 22496 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:28.337669 22526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1367) took 4285 ms. Trace:
I20260709 12:10:28.338111 22526 rpcz_store.cc:276] 0709 12:10:24.027327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.519436 (+492109us) service_pool.cc:224] Handling call
0709 12:10:24.519840 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:24.526876 (+  7036us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:24.526922 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:24.527501 (+   579us) log.cc:844] Serialized 26 byte log entry
0709 12:10:25.874807 (+1347306us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:25.874861 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.874946 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:27.084325 (+1209379us) spinlock_profiling.cc:243] Waited 3.18 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:10:28.286544 (+1202219us) raft_consensus.cc:1685] finished
0709 12:10:28.292749 (+  6205us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:28.312990 (+ 20241us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":124019,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":120,"spinlock_wait_cycles":7317248,"thread_start_us":1284620,"threads_started":1,"wal-append.queue_time_us":1490757}
W20260709 12:10:28.339911 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 90689.7us
I20260709 12:10:28.340875 22421 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:28.344280 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:28.347708 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:10:28.339514 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 47120.2us
I20260709 12:10:28.353372 23123 raft_consensus.cc:1240] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:28.186918 24592 consensus_queue.cc:237] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:28.357517 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:28.357995 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.362413 22531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56942 (request call id 1379) took 1063 ms. Trace:
I20260709 12:10:28.363235 24641 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:28.363847 24641 raft_consensus.cc:2804] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:28.364194 24641 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:28.364547 24641 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:28.350565 22353 catalog_manager.cc:5697] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 2 to 3, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 3 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:28.318603 24489 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:28.368053 22353 catalog_manager.cc:5697] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 2 to 3, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 3 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:28.370683 22451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2053) took 1079 ms. Trace:
I20260709 12:10:28.375494 22451 rpcz_store.cc:276] 0709 12:10:27.318157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.671935 (+353778us) service_pool.cc:224] Handling call
0709 12:10:28.370504 (+698569us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b54002a5b54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:28.370624 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":398932864}
I20260709 12:10:28.314041 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:28.406006 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:28.364449 23119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 816) took 1352 ms. Trace:
I20260709 12:10:28.406342 22603 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 5.
I20260709 12:10:28.406657 23119 rpcz_store.cc:276] 0709 12:10:27.011940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.062599 (+ 50659us) service_pool.cc:224] Handling call
0709 12:10:27.683727 (+621128us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:28.152562 (+468835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.364231 (+211669us) spinlock_profiling.cc:243] Waited 621 ms on lock 0x7b54006a0ed0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:28.364358 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1427471744}
I20260709 12:10:28.408625 22598 raft_consensus.cc:2410] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 7 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:10:28.409741 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:28.362793 22531 rpcz_store.cc:276] 0709 12:10:27.298591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.324962 (+ 26371us) service_pool.cc:224] Handling call
0709 12:10:28.362208 (+1037246us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b54001f2a54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:28.362354 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":371958528}
I20260709 12:10:28.377724 22496 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:28.419902 22598 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
I20260709 12:10:28.377116 22457 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1431) took 2245 ms. Trace:
I20260709 12:10:28.380254 22528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 466) took 1412 ms. Trace:
I20260709 12:10:28.383155 24612 consensus_queue.cc:1048] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:28.424800 22457 rpcz_store.cc:276] 0709 12:10:26.088118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.190281 (+1102163us) service_pool.cc:224] Handling call
0709 12:10:27.520021 (+329740us) spinlock_profiling.cc:243] Waited 4.42 ms on lock 0x7b5800002a98. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf907fc0 00007f9ccf8f2929 00007f9ccf8f23d2 00007f9cc8e69bd4
0709 12:10:27.628311 (+108290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:27.651364 (+ 23053us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:27.651661 (+   297us) log.cc:844] Serialized 14 byte log entry
0709 12:10:28.332657 (+680996us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:28.332705 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:28.332761 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.332830 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:28.332936 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":4300,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":226220,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":25437,"spinlock_wait_cycles":10177280,"thread_start_us":575923,"threads_started":2,"wal-append.queue_time_us":720264}
I20260709 12:10:28.429035 24612 consensus_queue.cc:1048] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:28.384095 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:28.430714 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:28.384832 24698 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:28.330034 22449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2045) took 1040 ms. Trace:
I20260709 12:10:28.387650 24713 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:28.388293 24739 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:28.389279 24621 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:28.390609 24578 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:28.391321 24734 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:28.396728 22570 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:28.399539 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:28.404687 22525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1378) took 1106 ms. Trace:
I20260709 12:10:28.315357 24720 raft_consensus.cc:2804] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:28.329764 24385 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.410360 24547 raft_consensus.cc:2749] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:28.412462 24683 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.414525 22497 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:28.415192 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:28.416343 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:28.419867 22496 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:28.379688 24333 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:28.420972 24694 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:28.431370 22599 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 3.
W20260709 12:10:28.386011 23088 connection.cc:256] RPC call timeout handler was delayed by -1.083382679000124s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15990000000000001s for a response
I20260709 12:10:28.426352 22528 rpcz_store.cc:276] 0709 12:10:26.967519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.397190 (+429671us) service_pool.cc:224] Handling call
0709 12:10:27.654038 (+256848us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:28.128167 (+474129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.379960 (+251793us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b54003903d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:28.380163 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":502317312}
I20260709 12:10:28.939323 24746 raft_consensus.cc:2749] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:28.946537 22606 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 3.
I20260709 12:10:28.946749 24621 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:28.849588 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:28.930917 22456 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.005s	sys 0.004s
W20260709 12:10:28.948338 22450 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.000s	sys 0.013s
W20260709 12:10:28.635073 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:28.948700 22450 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.000s	sys 0.013s
I20260709 12:10:28.947122 24746 consensus_queue.cc:1048] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:10:28.947893 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 551185us
W20260709 12:10:28.549499 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:28.967842 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.968286 22527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1382) took 1467 ms. Trace:
I20260709 12:10:28.968642 22527 rpcz_store.cc:276] 0709 12:10:27.500977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.644236 (+143259us) service_pool.cc:224] Handling call
0709 12:10:27.738755 (+ 94519us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:27.739357 (+   602us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:27.739399 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:27.740054 (+   655us) log.cc:844] Serialized 26 byte log entry
0709 12:10:28.287682 (+547628us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:28.287720 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.287782 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:28.968072 (+680290us) raft_consensus.cc:1685] finished
0709 12:10:28.968091 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:28.968228 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":86833,"raft.queue_time_us":483002,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":123,"thread_start_us":547178,"threads_started":1,"wal-append.queue_time_us":1102875}
W20260709 12:10:28.939852 23124 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.006s	sys 0.011s
W20260709 12:10:28.970625 23124 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.007s	sys 0.011s
I20260709 12:10:28.947743 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:28.448980 22601 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
W20260709 12:10:28.665910 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:28.642247 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.442445 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:28.949278 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.966001 22450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1433) took 2560 ms. Trace:
W20260709 12:10:28.948366 22456 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.005s	sys 0.004s
I20260709 12:10:28.598270 22597 raft_consensus.cc:2410] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:10:28.991045 22454 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.011s	sys 0.012s
W20260709 12:10:28.991482 22454 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.011s	sys 0.012s
I20260709 12:10:28.426131 24567 raft_consensus.cc:2804] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:28.992370 22606 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:28.930388 24348 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.006s	sys 0.010s
W20260709 12:10:28.762586 24581 consensus_meta.cc:287] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 1.044s	user 0.007s	sys 0.005s
I20260709 12:10:28.976238 22601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43070 (request call id 335) took 1236 ms. Trace:
I20260709 12:10:28.966975 24578 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:28.995549 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:28.998571 22455 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.001s	sys 0.011s
W20260709 12:10:28.992192 23087 leader_election.cc:336] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.831s (SENT)
W20260709 12:10:28.998628 22604 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.001s	sys 0.013s
W20260709 12:10:29.024564 22455 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.002s	sys 0.011s
I20260709 12:10:28.967000 24385 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:29.006927 22421 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.014s	sys 0.015s
W20260709 12:10:29.024832 22604 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.001s	sys 0.013s
W20260709 12:10:29.025255 22421 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.019s	sys 0.015s
W20260709 12:10:29.020234 22526 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.013s	sys 0.005s
W20260709 12:10:29.025818 22523 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.000s	sys 0.015s
W20260709 12:10:29.026175 22526 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.013s	sys 0.005s
W20260709 12:10:29.026468 22523 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.000s	sys 0.015s
I20260709 12:10:28.949388 22525 rpcz_store.cc:276] 0709 12:10:27.298282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.343011 (+ 44729us) service_pool.cc:224] Handling call
0709 12:10:27.343456 (+   445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:27.344106 (+   650us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:27.344147 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:27.579992 (+235845us) log.cc:844] Serialized 26 byte log entry
0709 12:10:27.722617 (+142625us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:27.722673 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:27.722763 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:28.404409 (+681646us) raft_consensus.cc:1685] finished
0709 12:10:28.404427 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:28.404538 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15648,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":167,"thread_start_us":142185,"threads_started":1,"wal-append.queue_time_us":752787}
I20260709 12:10:28.827710 24743 raft_consensus.cc:2804] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:28.930655 23118 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.002s	sys 0.007s
I20260709 12:10:29.019145 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:28.974189 24333 raft_consensus.cc:2804] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:28.990084 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:29.025709 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 683380us
I20260709 12:10:29.037837 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:29.019448 22601 rpcz_store.cc:276] 0709 12:10:27.734874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.735289 (+   415us) service_pool.cc:224] Handling call
0709 12:10:28.971460 (+1236171us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:29.039719 22495 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.002s	sys 0.017s
W20260709 12:10:29.040041 22495 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.002s	sys 0.017s
W20260709 12:10:28.996975 24701 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.760s	user 0.015s	sys 0.018s
I20260709 12:10:29.041949 22603 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
I20260709 12:10:29.006938 24567 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:28.991386 22450 rpcz_store.cc:276] 0709 12:10:26.405499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.135694 (+1730195us) service_pool.cc:224] Handling call
0709 12:10:28.207808 (+ 72114us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:28.265225 (+ 57417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:28.265263 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:28.273725 (+  8462us) log.cc:844] Serialized 598 byte log entry
0709 12:10:28.949267 (+675542us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:28.949303 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.949371 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:28.964543 (+ 15172us) raft_consensus.cc:1685] finished
0709 12:10:28.964569 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:28.965655 (+  1086us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b54003f25d0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:28.965894 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48906,"raft.queue_time_us":64447,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":22020,"spinlock_wait_cycles":41288064,"thread_start_us":637389,"threads_started":1,"wal-append.queue_time_us":664077}
W20260709 12:10:28.995354 24641 consensus_meta.cc:287] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.630s	user 0.005s	sys 0.005s
W20260709 12:10:28.999828 24210 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.005s	sys 0.009s
I20260709 12:10:28.438249 22449 rpcz_store.cc:276] 0709 12:10:27.288587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.734171 (+445584us) service_pool.cc:224] Handling call
0709 12:10:28.328587 (+594416us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:28.975601 24683 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:29.032601 22529 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.000s	sys 0.016s
W20260709 12:10:29.052466 22529 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.001s	sys 0.017s
I20260709 12:10:29.034655 22600 raft_consensus.cc:2393] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 5: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
W20260709 12:10:29.045821 22495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:29.046066 22353 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.011s	sys 0.009s
I20260709 12:10:29.019016 24713 raft_consensus.cc:2804] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:29.036156 23118 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.002s	sys 0.008s
I20260709 12:10:28.949095 24720 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:10:29.043769 23120 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.005s	sys 0.014s
W20260709 12:10:29.036569 24592 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.007s	sys 0.012s
W20260709 12:10:29.048775 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.990509 24489 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.047909 24567 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.035272 24743 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:29.043628 24701 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.806s	user 0.015s	sys 0.019s
I20260709 12:10:29.055471 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:10:29.049801 22422 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.009s	sys 0.011s
W20260709 12:10:29.066972 24605 consensus_meta.cc:287] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.775s	user 0.005s	sys 0.005s
I20260709 12:10:29.074361 22421 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:10:29.065352 24675 consensus_meta.cc:287] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 1.341s	user 0.014s	sys 0.000s
I20260709 12:10:29.037139 24333 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:10:29.065119 22452 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.000s	sys 0.032s
W20260709 12:10:29.087525 22452 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.811s	user 0.000s	sys 0.032s
W20260709 12:10:29.048031 24210 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.005s	sys 0.009s
W20260709 12:10:29.070816 23120 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.005s	sys 0.014s
W20260709 12:10:29.053195 22569 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.000s	sys 0.025s
I20260709 12:10:28.478559 24698 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:29.067158 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 647365us
I20260709 12:10:28.995436 24739 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:29.028779 24581 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:29.080565 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:29.049237 24641 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:29.064283 22353 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.011s	sys 0.009s
I20260709 12:10:29.081058 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:29.049636 23088 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:29.025905 24348 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.009s	sys 0.020s
W20260709 12:10:29.072438 24592 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.007s	sys 0.013s
W20260709 12:10:29.091976 24561 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.000s	sys 0.019s
W20260709 12:10:29.089222 22569 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.003s	sys 0.026s
W20260709 12:10:29.092229 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 147691us
I20260709 12:10:29.100142 22496 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:10:29.081509 22422 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.009s	sys 0.011s
W20260709 12:10:29.101366 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 698540us
I20260709 12:10:29.073081 24720 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:29.095831 22597 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45576 (request call id 2155) took 1358 ms (client timeout 1663 ms). Trace:
I20260709 12:10:29.081686 24489 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:29.108131 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:29.096675 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 56071.4us
W20260709 12:10:29.101437 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 748409us
W20260709 12:10:29.086824 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 672377us
I20260709 12:10:29.083204 24713 raft_consensus.cc:697] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:29.089730 24333 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:29.107475 23089 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.009s	sys 0.006s
W20260709 12:10:29.114068 23089 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.855s	user 0.010s	sys 0.007s
I20260709 12:10:29.114223 22530 raft_consensus.cc:2393] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 5: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
W20260709 12:10:29.114416 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 956523us
I20260709 12:10:29.108261 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:29.097139 24635 raft_consensus.cc:2804] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:29.110071 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:29.094560 24756 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.112804 22496 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:10:29.103616 24561 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.000s	sys 0.019s
I20260709 12:10:29.086493 24743 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.117538 24635 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:29.128404 24635 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.128435 24713 consensus_queue.cc:237] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:29.089279 24605 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:29.131445 24561 raft_consensus.cc:2804] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:29.131850 24561 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.132202 24561 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.132515 24605 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:29.120389 22532 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 3.
I20260709 12:10:29.134232 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:29.135695 22532 raft_consensus.cc:1275] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:10:29.136713 22532 raft_consensus.cc:1240] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:29.126526 22527 raft_consensus.cc:2393] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 3: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:29.126336 22497 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:10:29.127627 23088 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:29.138520 24734 raft_consensus.cc:2749] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:29.119946 24592 raft_consensus.cc:2804] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:29.127884 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:29.140623 23088 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:10:29.107872 22597 rpcz_store.cc:269] 0709 12:10:27.737177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.738249 (+  1072us) service_pool.cc:224] Handling call
0709 12:10:29.086681 (+1348432us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b54000e9054. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:29.094379 (+  7698us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":809945856}
I20260709 12:10:29.162631 22524 raft_consensus.cc:2468] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 3.
I20260709 12:10:29.142740 22495 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:29.168416 24755 raft_consensus.cc:2804] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:29.168871 24755 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:29.169219 24755 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:29.172164 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 124433us
I20260709 12:10:29.173134 22606 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 4.
I20260709 12:10:29.174242 22421 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:29.144618 22497 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:29.117956 24675 raft_consensus.cc:2804] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:29.187975 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 74253.7us
W20260709 12:10:29.176564 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 52333.1us
I20260709 12:10:29.205207 24641 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:29.164988 24734 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.170629 24561 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:29.140966 24621 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:29.209070 22495 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:29.171311 24581 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:29.229681 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 201802us
W20260709 12:10:29.230475 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 85927.9us
I20260709 12:10:29.142750 24592 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:29.231552 22455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1434) took 2021 ms. Trace:
I20260709 12:10:29.210454 24694 raft_consensus.cc:2804] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:29.238953 24694 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.239362 24694 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.242096 24578 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:29.244144 24698 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:29.230180 24734 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:29.245718 24751 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:29.245355 24754 log.cc:927] Time spent T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 12:10:29.247493 22454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1432) took 3105 ms. Trace:
I20260709 12:10:29.141149 24756 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:29.247860 22454 rpcz_store.cc:276] 0709 12:10:26.142101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.000164 (+1858063us) service_pool.cc:224] Handling call
0709 12:10:28.144510 (+144346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:28.268540 (+124030us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:28.268585 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:28.297145 (+ 28560us) log.cc:844] Serialized 26 byte log entry
0709 12:10:28.991987 (+694842us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:28.992026 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.992094 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:29.247265 (+255171us) raft_consensus.cc:1685] finished
0709 12:10:29.247283 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:29.247431 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32743,"raft.queue_time_us":20415,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":138,"thread_start_us":662920,"threads_started":1,"wal-append.queue_time_us":740467}
I20260709 12:10:29.249902 24756 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:29.249965 22530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56942 (request call id 1389) took 1679 ms. Trace:
I20260709 12:10:29.250309 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:29.250555 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:29.250705 24763 raft_consensus.cc:2749] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:29.252246 24762 log.cc:927] Time spent T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:10:29.253432 22529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1384) took 1751 ms. Trace:
I20260709 12:10:29.253786 24561 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:29.200261 24744 raft_consensus.cc:2749] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:29.229224 22569 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:29.369809 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.376883 22523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1385) took 1875 ms. Trace:
I20260709 12:10:29.364602 23124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 829) took 1135 ms. Trace:
W20260709 12:10:29.433388 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 224471us
W20260709 12:10:29.362841 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.368150 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:29.235713 22455 rpcz_store.cc:276] 0709 12:10:27.210053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.158187 (+948134us) service_pool.cc:224] Handling call
0709 12:10:28.172473 (+ 14286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:28.214297 (+ 41824us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:29.029225 (+814928us) log.cc:844] Serialized 14 byte log entry
0709 12:10:29.231086 (+201861us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:29.231159 (+    73us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:29.231235 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.231332 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:29.231473 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":676674,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":31392,"thread_start_us":871026,"threads_started":2}
W20260709 12:10:29.433997 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.255596 22422 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:29.436791 24756 raft_consensus.cc:2804] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:29.437290 24756 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.437670 24756 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:29.439206 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 183726us
I20260709 12:10:29.439621 24683 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:29.432893 22523 rpcz_store.cc:276] 0709 12:10:27.501958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.171793 (+669835us) service_pool.cc:224] Handling call
0709 12:10:28.255330 (+ 83537us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:28.258311 (+  2981us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:28.258349 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:28.259296 (+   947us) log.cc:844] Serialized 26 byte log entry
0709 12:10:29.026864 (+767568us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:29.372510 (+345646us) log.cc:844] Serialized 14 byte log entry
0709 12:10:29.376579 (+  4069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.376645 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:29.376683 (+    38us) raft_consensus.cc:1685] finished
0709 12:10:29.376693 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:29.376812 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5888,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":208,"thread_start_us":1089527,"threads_started":2,"wal-append.queue_time_us":867532}
W20260709 12:10:29.260138 22602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45576 (request call id 2154) took 1523 ms (client timeout 1573 ms). Trace:
I20260709 12:10:29.250402 22530 rpcz_store.cc:276] 0709 12:10:27.573525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.624025 (+ 50500us) service_pool.cc:224] Handling call
0709 12:10:29.249754 (+1625729us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54001f3e54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:29.249881 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3379150080}
W20260709 12:10:29.446647 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.377516 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:29.368415 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:29.453625 23122 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:10:29.376448 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:29.517168 22422 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:10:29.509563 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 370458us
W20260709 12:10:29.511793 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 77688.5us
I20260709 12:10:29.253851 22529 rpcz_store.cc:276] 0709 12:10:27.501651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.165376 (+663725us) service_pool.cc:224] Handling call
0709 12:10:28.208527 (+ 43151us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:28.286622 (+ 78095us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:28.286663 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:28.305888 (+ 19225us) log.cc:844] Serialized 26 byte log entry
0709 12:10:29.052865 (+746977us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:29.052908 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.052970 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:29.253219 (+200249us) raft_consensus.cc:1685] finished
0709 12:10:29.253238 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:29.253370 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10379,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":11932,"thread_start_us":685634,"threads_started":1,"wal-append.queue_time_us":788176}
W20260709 12:10:29.536682 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 362571us
I20260709 12:10:29.345595 24621 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:29.450897 22602 rpcz_store.cc:269] 0709 12:10:27.736735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.738185 (+  1450us) service_pool.cc:224] Handling call
0709 12:10:29.259890 (+1521705us) spinlock_profiling.cc:243] Waited 904 ms on lock 0x7b54000ebd54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:29.260060 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2079051008}
W20260709 12:10:29.535254 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 395550us
I20260709 12:10:29.490690 23123 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:10:29.498149 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.529228 22452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2048) took 2239 ms. Trace:
W20260709 12:10:29.532348 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.540202 22452 rpcz_store.cc:276] 0709 12:10:27.289399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.207715 (+918316us) service_pool.cc:224] Handling call
0709 12:10:28.219228 (+ 11513us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:28.275927 (+ 56699us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:28.275960 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:28.276482 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 12:10:29.087924 (+811442us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:29.087961 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.088023 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:29.529027 (+441004us) raft_consensus.cc:1685] finished
0709 12:10:29.529042 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:29.529169 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55969,"raft.queue_time_us":65361,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":178,"thread_start_us":811084,"threads_started":1,"wal-append.queue_time_us":1063505}
W20260709 12:10:29.539130 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 59589.9us
W20260709 12:10:29.536335 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 272702us
I20260709 12:10:29.338562 24675 raft_consensus.cc:697] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:29.362447 24489 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:29.511682 24757 log.cc:927] Time spent T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
W20260709 12:10:29.511555 24765 log.cc:927] Time spent T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.255s	user 0.000s	sys 0.001s
I20260709 12:10:29.490738 24772 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.517896 24739 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:29.515316 24773 log.cc:927] Time spent T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:10:29.255584 24743 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:29.449131 24581 raft_consensus.cc:2804] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:29.264206 24592 raft_consensus.cc:3060] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:29.547518 22421 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:29.433491 23124 rpcz_store.cc:276] 0709 12:10:28.228766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.232530 (+  3764us) service_pool.cc:224] Handling call
0709 12:10:28.232914 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:28.233305 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:28.974550 (+741245us) log.cc:844] Serialized 14 byte log entry
0709 12:10:29.364157 (+389607us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:29.364226 (+    69us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:29.364295 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.364382 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:29.364527 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":810782,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":3106,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"thread_start_us":1079225,"threads_started":2}
I20260709 12:10:29.514159 24578 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:29.565490 22496 leader_election.cc:304] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:29.566684 22456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1429) took 3562 ms. Trace:
W20260709 12:10:29.551765 24385 consensus_meta.cc:287] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.507s	user 0.009s	sys 0.000s
I20260709 12:10:29.570621 22497 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:29.551075 24641 raft_consensus.cc:2804] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:29.558794 23118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 497) took 2267 ms. Trace:
I20260709 12:10:29.517088 24580 consensus_queue.cc:1059] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
W20260709 12:10:29.570032 24453 consensus_meta.cc:287] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 1.330s	user 0.008s	sys 0.006s
W20260709 12:10:29.589308 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.595353 22528 raft_consensus.cc:2393] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 5: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
W20260709 12:10:29.597134 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.597962 22422 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:29.580245 24581 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.510351 24768 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:29.611994 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 61295.5us
I20260709 12:10:29.551024 24621 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:29.608567 23088 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:29.582747 22456 rpcz_store.cc:276] 0709 12:10:26.004045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.180864 (+1176819us) service_pool.cc:224] Handling call
0709 12:10:27.335436 (+154572us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b5800002a98. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf907fc0 00007f9ccf8f2929 00007f9ccf8f23d2 00007f9cc8e69bd4
0709 12:10:27.335683 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:28.159741 (+824058us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:28.992357 (+832616us) log.cc:844] Serialized 14 byte log entry
0709 12:10:29.236106 (+243749us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:29.236153 (+    47us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:29.432075 (+195922us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.566377 (+134302us) spinlock_profiling.cc:243] Waited 811 ms on lock 0x7b540038a4d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:29.566443 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:29.566591 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":785182,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":687,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":30699,"spinlock_wait_cycles":1893054976,"thread_start_us":988723,"threads_started":2,"wal-append.queue_time_us":409234}
I20260709 12:10:29.617470 24739 raft_consensus.cc:2804] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:29.617938 24739 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.618316 24739 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.618141 24768 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:29.594543 24751 raft_consensus.cc:2804] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:29.608201 22495 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:10:29.627399 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 68078.9us
W20260709 12:10:29.620442 23087 leader_election.cc:336] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.520s (SENT)
W20260709 12:10:29.622310 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 59035.1us
W20260709 12:10:29.628863 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 43767.8us
I20260709 12:10:29.584739 24605 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:29.606355 24713 raft_consensus.cc:2804] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:29.587715 24641 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:29.605132 24734 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:10:29.629963 23087 leader_election.cc:336] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.526s (SENT)
I20260709 12:10:29.609076 24581 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.635437 22604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2162) took 1370 ms. Trace:
I20260709 12:10:29.590653 24385 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:29.640079 22497 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:29.641049 23120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 826) took 1418 ms. Trace:
W20260709 12:10:29.641219 23087 leader_election.cc:336] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.599s (SENT)
W20260709 12:10:29.639410 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 417848us
I20260709 12:10:29.627431 24683 raft_consensus.cc:2749] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:29.624570 24453 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.635988 22604 rpcz_store.cc:276] 0709 12:10:28.257169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.336747 (+ 79578us) service_pool.cc:224] Handling call
0709 12:10:28.337190 (+   443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:28.342993 (+  5803us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:28.343027 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:28.343613 (+   586us) log.cc:844] Serialized 26 byte log entry
0709 12:10:29.025471 (+681858us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:29.025510 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.025655 (+   145us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:29.627505 (+601850us) raft_consensus.cc:1685] finished
0709 12:10:29.627527 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:29.627659 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5152,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":150,"thread_start_us":681397,"threads_started":1,"wal-append.queue_time_us":877738}
W20260709 12:10:29.649698 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.627719 24578 raft_consensus.cc:3055] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:29.635293 24641 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:29.651986 22569 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:29.654438 22495 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:29.641438 23120 rpcz_store.cc:276] 0709 12:10:28.222767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.222929 (+   162us) service_pool.cc:224] Handling call
0709 12:10:28.223296 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:28.386514 (+163218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:28.386546 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:28.387070 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 12:10:29.088399 (+701329us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:29.088444 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.088520 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:29.640834 (+552314us) raft_consensus.cc:1685] finished
0709 12:10:29.640859 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:29.640989 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":162698,"raft.queue_time_us":162871,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":116,"thread_start_us":700923,"threads_started":1,"wal-append.queue_time_us":738596}
I20260709 12:10:29.644212 24561 raft_consensus.cc:2804] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:29.658192 24561 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:29.658600 24561 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:29.594457 23118 rpcz_store.cc:276] 0709 12:10:27.291453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.600497 (+309044us) service_pool.cc:224] Handling call
0709 12:10:27.600941 (+   444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:27.865954 (+265013us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:27.871577 (+  5623us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:28.141210 (+269633us) log.cc:844] Serialized 26 byte log entry
0709 12:10:28.368924 (+227714us) spinlock_profiling.cc:243] Waited 24.7 ms on lock 0x7b1800420dc0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc77bbc0a 00007f9cd0efb219 00007f9cce80258f 00007f9cc7841571 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd
0709 12:10:29.088002 (+719078us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:29.089166 (+  1164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.558352 (+469186us) spinlock_profiling.cc:243] Waited 84.8 ms on lock 0x7b5400135e54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:29.558426 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:29.558494 (+    68us) raft_consensus.cc:1685] finished
0709 12:10:29.558512 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:29.558709 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23204,"raft.queue_time_us":416923,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":39976,"spinlock_wait_cycles":251817088,"thread_start_us":834479,"threads_started":1,"wal-append.queue_time_us":784835}
I20260709 12:10:29.637636 24751 raft_consensus.cc:697] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:29.612664 24772 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:29.671269 24774 raft_consensus.cc:2749] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:29.679442 22497 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:29.681470 24772 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:29.682384 22497 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:29.652452 24769 raft_consensus.cc:2804] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:29.671753 24764 raft_consensus.cc:2749] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:29.678841 24683 raft_consensus.cc:2804] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:29.685498 22496 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:29.671514 22570 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 2.222s (SENT) [suppressed 35 similar messages]
I20260709 12:10:29.644435 24713 raft_consensus.cc:697] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:29.642867 24783 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.653590 24578 raft_consensus.cc:740] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
W20260709 12:10:29.692114 24333 consensus_meta.cc:287] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.567s	user 0.005s	sys 0.004s
W20260709 12:10:29.707687 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 55757.9us
W20260709 12:10:29.705639 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 64376.8us
W20260709 12:10:29.704257 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 58844.9us
W20260709 12:10:29.690968 24755 consensus_meta.cc:287] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.521s	user 0.011s	sys 0.000s
I20260709 12:10:29.646658 24605 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:29.686712 24769 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.634169 24675 consensus_queue.cc:237] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:29.712383 22570 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:29.692638 24683 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.717301 22422 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:29.655534 24453 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:29.695575 24763 raft_consensus.cc:2749] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:29.697583 24774 raft_consensus.cc:2749] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:29.710660 24567 consensus_meta.cc:287] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.620s	user 0.007s	sys 0.003s
I20260709 12:10:29.723819 23088 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:29.726835 24763 consensus_queue.cc:1048] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:29.715386 24764 raft_consensus.cc:2804] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:29.762686 24764 raft_consensus.cc:697] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:29.763753 24764 consensus_queue.cc:237] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:29.744457 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 61839.6us
I20260709 12:10:29.719492 24769 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:29.748706 24751 consensus_queue.cc:237] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:29.751228 24578 consensus_queue.cc:260] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:29.713538 24333 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:29.754190 24720 consensus_meta.cc:287] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.629s	user 0.004s	sys 0.004s
I20260709 12:10:29.757580 22421 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:29.761752 24756 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:29.726087 24683 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.767141 22497 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:29.746757 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 113075us
I20260709 12:10:29.805698 22496 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
W20260709 12:10:29.768090 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 92984.7us
W20260709 12:10:29.805949 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 92112.6us
I20260709 12:10:29.725113 24783 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:29.793708 22526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1387) took 2291 ms. Trace:
I20260709 12:10:29.810052 22495 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:29.794857 24782 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:29.795785 24385 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:29.796480 24779 log.cc:927] Time spent T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.180s	user 0.001s	sys 0.001s
W20260709 12:10:29.802062 23087 leader_election.cc:336] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.902s (SENT)
I20260709 12:10:29.767230 22422 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:29.809957 22526 rpcz_store.cc:276] 0709 12:10:27.502656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.341432 (+838776us) service_pool.cc:224] Handling call
0709 12:10:28.341814 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:29.026633 (+684819us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:29.026665 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:29.040579 (+ 13914us) log.cc:844] Serialized 26 byte log entry
0709 12:10:29.372191 (+331612us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:29.613742 (+241551us) log.cc:844] Serialized 14 byte log entry
0709 12:10:29.764704 (+150962us) spinlock_profiling.cc:243] Waited 8.32 ms on lock 0x7b18000d7da0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc780f2a6 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca8a9733 00007f9cca92edbf 00007f9cca92d83e
0709 12:10:29.793138 (+ 28434us) spinlock_profiling.cc:243] Waited 8.06 ms on lock 0x7b5400389120. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca8a9733 00007f9cca92edbf 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c
0709 12:10:29.793214 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.793321 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:29.793399 (+    78us) raft_consensus.cc:1685] finished
0709 12:10:29.793423 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:29.793634 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":73308,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":71634,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":6413,"spinlock_wait_cycles":37688448,"thread_start_us":1220524,"threads_started":3,"wal-append.queue_time_us":517788}
W20260709 12:10:29.806020 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 61472.6us
I20260709 12:10:29.747025 24797 raft_consensus.cc:2804] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:29.807140 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 49660.6us
I20260709 12:10:29.806942 24713 consensus_queue.cc:237] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:29.715687 24755 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:29.819628 24694 consensus_meta.cc:287] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.580s	user 0.009s	sys 0.000s
I20260709 12:10:29.820225 24694 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:29.821360 24783 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:29.822218 24694 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:29.808545 24333 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:29.798233 24547 raft_consensus.cc:2749] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:29.822896 24756 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:29.819687 24755 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:29.814788 23088 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:10:29.823971 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 56986.1us
I20260709 12:10:29.803797 24743 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:29.813299 24768 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:29.825555 24744 raft_consensus.cc:2749] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:29.829058 24621 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:29.809561 24720 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:29.767148 24567 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:29.846777 24720 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:29.830089 23087 leader_election.cc:336] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 2.181s (SENT)
I20260709 12:10:29.816900 24746 raft_consensus.cc:2804] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:29.815506 24734 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.813576 24782 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.855501 24782 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:29.855999 24605 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:29.855927 24734 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:29.856884 24453 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:29.831694 22496 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:29.833839 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 89892.1us
I20260709 12:10:29.809096 24561 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:29.842146 22421 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:29.842880 24785 raft_consensus.cc:2804] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:29.847785 23087 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:29.829694 24635 consensus_meta.cc:287] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.701s	user 0.004s	sys 0.004s
I20260709 12:10:29.848915 23123 raft_consensus.cc:2468] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
W20260709 12:10:29.854429 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:29.857755 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 47791.5us
I20260709 12:10:29.877086 22495 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:29.877758 22497 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:29.816251 24797 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:29.879406 22569 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:29.882469 23088 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:29.850185 24756 raft_consensus.cc:2804] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:29.885288 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:29.885725 24768 raft_consensus.cc:2804] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:29.849797 24746 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:29.888424 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:29.886270 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 54694.9us
I20260709 12:10:29.885771 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:29.886719 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:29.887696 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:29.892575 23123 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:29.868238 24567 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:29.858203 24734 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:29.894757 22605 raft_consensus.cc:2393] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 4: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:29.867506 24795 raft_consensus.cc:2749] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:29.891376 24768 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:29.904995 24793 raft_consensus.cc:2804] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:29.890271 24756 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.907136 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:10:29.917260 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 47111.5us
I20260709 12:10:29.917795 23125 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
W20260709 12:10:29.908365 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 78288.3us
I20260709 12:10:29.914683 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:29.887595 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:29.919984 23121 raft_consensus.cc:2410] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:29.920015 22597 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5.
I20260709 12:10:29.883889 24578 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.887362 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:29.921931 23116 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.887457 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:29.882846 24706 raft_consensus.cc:2749] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:29.848878 24581 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:29.923508 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 46505.9us
I20260709 12:10:29.923799 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:29.887148 24547 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.901479 24746 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.884222 24797 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:29.928246 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.915925 23118 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.891510 24720 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.891893 24744 raft_consensus.cc:2749] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:29.948622 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:29.929200 22570 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:10:29.909716 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 67647.2us
W20260709 12:10:29.932675 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.945732 22599 raft_consensus.cc:2393] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 5: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:29.866204 24739 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:29.946956 23087 leader_election.cc:336] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 2.734s (SENT)
I20260709 12:10:29.922812 24769 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:29.907680 24785 raft_consensus.cc:697] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 4 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:29.907959 24641 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:29.917089 24768 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.931907 22422 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:29.960973 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:29.934021 24694 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:10:29.974928 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 45806us
I20260709 12:10:29.975176 22603 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 5.
I20260709 12:10:29.883687 24635 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:29.923623 24756 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.917341 24567 raft_consensus.cc:2749] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:29.967085 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:29.991700 22606 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.968185 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:29.964072 22569 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:29.931735 24621 raft_consensus.cc:2804] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:29.965791 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:29.942147 24385 raft_consensus.cc:2804] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:29.973176 24706 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:29.955936 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:10:29.976068 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 44253.8us
I20260709 12:10:29.981288 22570 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:29.963575 24734 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:29.972801 24798 raft_consensus.cc:2749] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:30.001006 24783 raft_consensus.cc:2764] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:10:30.004408 23121 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
I20260709 12:10:29.918629 24793 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:10:30.016274 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 78716.7us
W20260709 12:10:30.017303 23087 leader_election.cc:336] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 2.317s (SENT)
I20260709 12:10:29.987958 24210 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:29.992614 24701 raft_consensus.cc:2804] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:29.966042 24720 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:29.988056 24796 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:30.009245 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:30.003295 24385 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:30.051329 24385 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:30.009944 22605 raft_consensus.cc:1275] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:10:29.997123 24621 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:30.090806 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 61953.6us
I20260709 12:10:30.024937 24210 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:30.026492 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.118476 22570 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:30.079511 24734 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:29.994428 24694 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:30.056761 24766 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:30.095139 23088 connection.cc:256] RPC call timeout handler was delayed by -1.0532866890000605s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20040000000000002s for a response
I20260709 12:10:30.127677 22570 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:10:30.120150 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:30.123696 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 196218us
I20260709 12:10:30.026813 24612 raft_consensus.cc:2804] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:30.023047 24793 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:30.127522 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 126857us
I20260709 12:10:30.142074 22497 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:30.123309 24621 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:30.116067 24701 raft_consensus.cc:697] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 3 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:30.123663 24210 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:30.025105 24706 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:30.129352 23116 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:30.130848 24763 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:10:30.172153 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 227363us
I20260709 12:10:30.143949 24612 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:30.143903 24453 raft_consensus.cc:2804] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:30.150437 24783 raft_consensus.cc:2804] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:30.178822 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 62389.7us
I20260709 12:10:30.193711 22606 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 5.
I20260709 12:10:30.165021 24561 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:30.198623 24561 consensus_queue.cc:1048] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:30.172816 24612 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:30.203686 24635 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:30.206852 22570 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:10:30.215461 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 64558us
I20260709 12:10:30.218940 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:30.219609 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:10:30.219000 23087 leader_election.cc:336] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 2.014s (SENT)
I20260709 12:10:30.220723 22530 raft_consensus.cc:2393] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 5: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:30.221616 24701 consensus_queue.cc:237] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:30.224663 24804 log.cc:927] Time spent T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 12:10:30.226137 24612 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:30.226804 24801 log.cc:927] Time spent T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 12:10:30.227239 24769 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:30.227984 24800 log.cc:927] Time spent T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:10:30.230502 24580 consensus_queue.cc:1059] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:30.231235 24641 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:30.231806 24815 raft_consensus.cc:3055] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:30.232168 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:30.179299 24713 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:30.178174 24783 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:30.231631 24580 consensus_queue.cc:1048] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:30.250746 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:30.231050 24774 raft_consensus.cc:2804] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:30.219717 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:30.251794 24807 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:10:30.237504 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.252358 24807 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:30.253645 24782 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:30.255213 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:30.255822 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:30.256435 22452 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 3.
I20260709 12:10:30.258062 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:30.258606 22452 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:30.263944 22421 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:30.265360 23118 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:30.266139 24744 consensus_queue.cc:1048] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:30.266352 22421 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:30.257758 24793 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:30.178035 24453 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:30.269019 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:30.274130 22452 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 3.
I20260709 12:10:30.131752 24766 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:30.278318 23121 raft_consensus.cc:2393] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 6: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:30.279213 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:30.279923 22457 raft_consensus.cc:2393] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 3: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:30.279011 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:30.242233 24713 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:30.244745 24783 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:30.289831 22495 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:30.281857 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:30.285948 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:30.295944 23122 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:30.283576 22523 raft_consensus.cc:1240] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 LEADER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 12:10:30.289733 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.232179 24815 raft_consensus.cc:740] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:30.303385 23120 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:30.303675 22529 raft_consensus.cc:1240] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 LEADER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:30.283624 24592 consensus_meta.cc:287] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.694s	user 0.009s	sys 0.001s
I20260709 12:10:30.291574 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:30.293501 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:30.294106 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:30.308112 22450 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:30.163739 24785 consensus_queue.cc:237] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:30.293767 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:30.294631 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:30.302728 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:30.284008 24641 raft_consensus.cc:2804] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:30.193833 24763 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:30.311831 22456 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:30.290629 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:30.304347 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:30.304374 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:30.304390 22495 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:30.312922 23121 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:30.312958 23124 raft_consensus.cc:2393] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 5: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:30.305208 22530 raft_consensus.cc:1240] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:30.273108 24581 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:30.278122 24453 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:30.272996 24739 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:30.308516 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:30.314240 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:30.290863 24580 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:30.294207 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:30.291677 24713 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:30.243674 24698 consensus_queue.cc:1059] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:10:30.311301 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:30.307017 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:30.287555 24774 raft_consensus.cc:697] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:30.280694 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:30.401803 23122 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 5.
I20260709 12:10:30.314630 24764 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:10:30.317567 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 51301.6us
W20260709 12:10:30.365139 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 53851.5us
I20260709 12:10:30.372064 24812 raft_consensus.cc:2804] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:30.373238 24746 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:30.378618 22456 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 4.
I20260709 12:10:30.383279 22448 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 4.
I20260709 12:10:30.388190 24782 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:30.420442 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:30.388324 24766 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:30.422938 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 118623us
I20260709 12:10:30.392428 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:30.392961 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 51599.2us
I20260709 12:10:30.408371 22450 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 4.
I20260709 12:10:30.293843 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:30.411157 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:30.412170 24774 consensus_queue.cc:237] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:30.400326 24605 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.415215 24807 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:30.418560 24743 raft_consensus.cc:2804] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:30.315315 24641 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:30.448642 24641 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:30.423555 23120 raft_consensus.cc:1275] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:10:30.312011 24592 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:30.395308 24580 raft_consensus.cc:697] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:30.458698 22530 raft_consensus.cc:1240] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:30.407974 24683 consensus_meta.cc:287] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.601s	user 0.006s	sys 0.004s
I20260709 12:10:30.400930 24796 raft_consensus.cc:2749] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:30.430174 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:30.342118 24348 consensus_queue.cc:1048] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.083s
I20260709 12:10:30.421499 24812 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:30.458525 22526 raft_consensus.cc:2468] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 3.
W20260709 12:10:30.463595 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 258094us
I20260709 12:10:30.473120 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:30.507901 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.426357 24210 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:30.511118 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:30.427202 24764 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:30.445998 24605 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:30.524183 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:30.527725 22530 raft_consensus.cc:2393] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 4: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:30.523942 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:30.526166 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 57131.8us
I20260709 12:10:30.533890 22524 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:30.515053 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:30.530298 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 57429.2us
I20260709 12:10:30.426445 24797 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:30.468045 24743 raft_consensus.cc:697] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:30.468586 24812 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:30.473104 24612 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:30.589737 22454 raft_consensus.cc:2393] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 6: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
W20260709 12:10:30.587450 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 55142.1us
I20260709 12:10:30.588392 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:30.522521 24734 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:30.596273 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:30.597159 22530 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
I20260709 12:10:30.596395 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:30.512040 24698 consensus_queue.cc:1059] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 12:10:30.516458 24385 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:30.468878 24683 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:30.610141 24821 consensus_queue.cc:1048] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.152s
I20260709 12:10:30.610791 24816 consensus_queue.cc:1059] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.150s
W20260709 12:10:30.611812 24810 log.cc:927] Time spent T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
W20260709 12:10:30.612054 24823 log.cc:927] Time spent T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
W20260709 12:10:30.614568 24822 log.cc:927] Time spent T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:10:30.615164 24743 consensus_queue.cc:237] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:30.616443 24698 raft_consensus.cc:3055] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:30.619465 24793 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:30.586447 24706 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:30.642969 22602 raft_consensus.cc:2393] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 4: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:30.632355 24210 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:30.602867 24580 consensus_queue.cc:237] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:30.424710 24815 consensus_queue.cc:260] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:30.623593 24756 consensus_meta.cc:287] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.627s	user 0.005s	sys 0.006s
I20260709 12:10:30.645068 24739 raft_consensus.cc:3055] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:10:30.646168 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.626377 24621 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:30.646940 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:30.667520 22530 raft_consensus.cc:2393] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 5: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:30.649641 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:30.650851 22421 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:30.638382 24807 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:30.642285 24769 raft_consensus.cc:3055] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:30.642871 24698 raft_consensus.cc:740] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:30.678248 22526 raft_consensus.cc:1275] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:30.678902 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:30.670212 24605 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:30.669814 24756 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:30.684016 22497 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
W20260709 12:10:30.704011 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 53234.7us
W20260709 12:10:30.685410 24768 consensus_meta.cc:287] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.674s	user 0.010s	sys 0.000s
I20260709 12:10:30.685847 24746 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:30.686971 24807 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:30.677466 24815 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:30.707415 24793 raft_consensus.cc:2749] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:30.666306 24739 raft_consensus.cc:740] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:30.670791 24592 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:30.671630 24683 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:30.675586 24769 raft_consensus.cc:740] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
W20260709 12:10:30.740446 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 74442.8us
I20260709 12:10:30.743031 22451 raft_consensus.cc:2393] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 4: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:30.744380 22421 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:30.714097 24567 raft_consensus.cc:2804] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:30.676221 24453 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:30.762496 23121 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 4.
I20260709 12:10:30.739202 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:30.775987 22496 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:30.759904 24547 consensus_meta.cc:287] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.799s	user 0.004s	sys 0.006s
I20260709 12:10:30.715854 24783 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:30.716046 24768 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:30.778755 22496 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:30.770251 24797 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:30.775671 24675 raft_consensus.cc:2804] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:30.819046 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 44670.7us
I20260709 12:10:30.772115 24567 raft_consensus.cc:697] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:30.805454 24811 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:30.826527 24683 raft_consensus.cc:2749] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:30.827085 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 48389.4us
I20260709 12:10:30.831284 22496 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:30.833310 22496 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:30.834817 22496 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:30.820387 24547 raft_consensus.cc:2749] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:30.817667 24769 consensus_queue.cc:260] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:30.871335 24769 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:30.872792 24830 log.cc:927] Time spent T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.210s	user 0.001s	sys 0.001s
I20260709 12:10:30.837275 24385 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:10:30.878038 24818 log.cc:927] Time spent T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.354s	user 0.002s	sys 0.000s
I20260709 12:10:30.880606 24739 consensus_queue.cc:260] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:30.881644 24739 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:30.844228 24453 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:30.828569 24698 consensus_queue.cc:260] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:30.885135 24698 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:30.828083 24675 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:30.840806 24839 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:30.841509 24827 raft_consensus.cc:2749] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:10:30.842199 24829 log.cc:927] Time spent T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:10:30.865824 24797 raft_consensus.cc:2804] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:30.895629 24797 raft_consensus.cc:697] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:30.896636 24797 consensus_queue.cc:237] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:30.899832 24783 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:30.906536 24838 log.cc:927] Time spent T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 12:10:30.908987 24820 log.cc:927] Time spent T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.533s	user 0.000s	sys 0.011s
I20260709 12:10:30.910095 24675 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:30.911437 24694 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:30.912299 24720 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:30.915583 24764 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:30.915742 22605 raft_consensus.cc:1275] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:30.851913 24807 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:30.852636 24567 consensus_queue.cc:237] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:30.855475 24763 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:30.862502 23088 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:10:30.917939 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 175517us
I20260709 12:10:30.848922 22496 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
W20260709 12:10:30.923580 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 61158.8us
W20260709 12:10:30.924223 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 75397us
I20260709 12:10:30.931552 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:30.932294 22600 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:30.864251 24701 raft_consensus.cc:2955] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:30.888724 24827 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:30.942688 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:30.917052 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:30.887769 24839 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:30.958317 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.839048 24826 raft_consensus.cc:2749] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:30.927584 24764 raft_consensus.cc:2749] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:30.928784 24744 raft_consensus.cc:2804] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:30.973281 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:30.974387 22523 raft_consensus.cc:2393] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 4: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:30.979965 22570 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:30.981226 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:30.988436 22599 raft_consensus.cc:1240] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:31.040606 22570 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:30.987269 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:31.041838 22524 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 3.
I20260709 12:10:30.991274 22528 raft_consensus.cc:2393] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 4: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:30.987645 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:30.986812 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:30.968931 24744 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:30.940673 24807 consensus_queue.cc:1048] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:10:31.043061 22526 raft_consensus.cc:2468] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 3.
W20260709 12:10:31.045037 23087 leader_election.cc:336] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.828s (SENT)
I20260709 12:10:31.051245 22570 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:31.051952 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:30.969798 24720 consensus_queue.cc:1048] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 12:10:31.057546 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:31.057911 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 50684.2us
I20260709 12:10:31.056232 24774 raft_consensus.cc:2749] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:30.963267 24827 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:31.060022 24846 log.cc:927] Time spent T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:10:31.060381 22599 raft_consensus.cc:1240] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:31.043669 24210 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.128993 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:31.052255 24751 consensus_queue.cc:1059] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:10:31.052047 24744 raft_consensus.cc:3060] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:31.075766 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:31.079272 24768 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:31.083431 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:31.084474 24713 consensus_meta.cc:287] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.708s	user 0.006s	sys 0.002s
I20260709 12:10:31.154731 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:31.092188 24792 consensus_queue.cc:1059] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:10:31.107262 24831 log.cc:927] Time spent T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.278s	user 0.002s	sys 0.000s
I20260709 12:10:31.094908 22570 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:30.982542 24756 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:30.986644 24782 raft_consensus.cc:2749] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:30.986446 24821 consensus_queue.cc:1059] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.120s
W20260709 12:10:31.098956 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.110911 24827 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:31.104231 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:31.169771 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:31.142448 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:31.170442 23121 raft_consensus.cc:2393] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 4: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:31.170773 22524 raft_consensus.cc:2393] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 4: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
W20260709 12:10:31.111666 23089 leader_election.cc:336] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Timed out: RequestConsensusVote RPC to 127.20.196.131:37785 timed out after 1.520s (SENT)
I20260709 12:10:31.171218 23089 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:31.102684 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:31.107350 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:31.132000 22495 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:31.136267 23088 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:31.172797 23125 raft_consensus.cc:2393] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 3: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:31.108763 22496 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:31.101661 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:31.153041 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:31.153968 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:31.117321 24812 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:31.153304 22528 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 4.
I20260709 12:10:31.174098 23088 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:31.154728 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:31.155350 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:31.175961 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:31.155447 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:31.155858 22605 raft_consensus.cc:1275] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:10:31.177748 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 45879.2us
I20260709 12:10:31.178506 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:31.156188 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:31.104239 24641 consensus_meta.cc:287] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.655s	user 0.010s	sys 0.001s
I20260709 12:10:31.190567 24641 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:31.193272 24641 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:31.196218 22600 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 6.
I20260709 12:10:31.197804 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:31.198948 22454 raft_consensus.cc:2410] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:10:31.200002 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:31.202785 23087 leader_election.cc:336] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.990s (SENT)
I20260709 12:10:31.159884 24210 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:31.205974 24210 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:31.091266 24843 raft_consensus.cc:2749] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:31.162657 23122 raft_consensus.cc:1240] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:31.162142 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:31.162487 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:31.216115 22606 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 5.
I20260709 12:10:31.100859 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:31.216460 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:31.140364 24578 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:31.166769 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:31.218631 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 106986us
I20260709 12:10:31.218806 22450 raft_consensus.cc:2393] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 4: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:31.099748 24621 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:31.111466 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:31.172369 24605 raft_consensus.cc:2804] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:31.167445 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 72632.6us
I20260709 12:10:31.177225 24739 raft_consensus.cc:2804] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:31.168934 22456 raft_consensus.cc:1240] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:31.107702 23123 raft_consensus.cc:1275] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:10:31.174613 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 65917.1us
I20260709 12:10:31.171937 23119 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:10:31.159041 24720 raft_consensus.cc:3055] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:31.179702 22495 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:10:31.243969 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 64333.4us
I20260709 12:10:31.209849 24827 raft_consensus.cc:2804] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:31.253059 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.182638 24734 raft_consensus.cc:2804] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:31.117255 24675 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:31.187568 24847 raft_consensus.cc:3055] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:31.188938 24812 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:31.189978 22528 raft_consensus.cc:1240] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:31.208355 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:31.213135 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:31.213204 22421 connection.cc:256] RPC call timeout handler was delayed by -3.5553185799999483s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1569s for a response
I20260709 12:10:31.214023 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:31.263842 22457 raft_consensus.cc:2393] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 6: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:31.221081 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:31.222883 23122 raft_consensus.cc:1240] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:31.217046 22605 raft_consensus.cc:2376] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 5. Re-sending same reply.
I20260709 12:10:31.224300 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:31.225245 23121 raft_consensus.cc:1240] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:31.265635 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:31.227161 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:31.267007 22454 raft_consensus.cc:2393] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 3: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:31.266682 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:31.168569 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:31.268576 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:31.269378 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:31.269593 22599 raft_consensus.cc:2393] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 7: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:31.269976 22530 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 4.
I20260709 12:10:31.227670 22570 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:31.175608 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:31.270969 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:31.231745 24605 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:31.271386 22449 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
I20260709 12:10:31.271860 24605 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:31.159471 24713 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:31.240198 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:31.275034 22525 raft_consensus.cc:2393] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 6: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:31.276762 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:31.278173 22602 raft_consensus.cc:1240] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:31.250480 23116 raft_consensus.cc:2393] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 5: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:31.279402 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:31.279711 22422 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:31.280967 22570 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:31.283177 24782 raft_consensus.cc:2749] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:31.284030 24782 consensus_queue.cc:1048] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:31.285284 22448 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
I20260709 12:10:31.286789 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:31.287554 22528 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:31.254801 24561 raft_consensus.cc:2804] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:31.291335 24561 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:31.291703 24561 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:31.292237 24815 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:31.292891 24815 raft_consensus.cc:697] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:31.293653 23118 raft_consensus.cc:1275] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:31.243451 24720 raft_consensus.cc:740] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:31.293980 24815 consensus_queue.cc:237] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:31.242749 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:31.252104 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:31.255297 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:31.222015 24756 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.330210 24834 raft_consensus.cc:3055] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:31.330009 24756 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:31.330799 24834 raft_consensus.cc:740] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:31.331647 24834 consensus_queue.cc:260] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:31.332381 24756 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:31.332814 24834 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:31.278070 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:31.336496 22525 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:31.262847 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.337421 23122 raft_consensus.cc:1275] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 12:10:31.337641 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.294787 24720 consensus_queue.cc:260] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:31.245153 24739 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:31.295734 24827 raft_consensus.cc:697] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:31.181998 24848 raft_consensus.cc:2749] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:31.233209 24578 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:31.229063 24698 raft_consensus.cc:2749] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:31.373208 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:31.373975 23124 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:31.266592 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:31.266571 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:10:31.309875 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.376667 23121 raft_consensus.cc:2393] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 4: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:31.313302 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:31.377404 22532 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
W20260709 12:10:31.314747 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 49524.1us
I20260709 12:10:31.329160 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:31.378746 22524 raft_consensus.cc:2393] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 6: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:31.340191 22453 raft_consensus.cc:2410] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:10:31.264889 22421 connection.cc:256] RPC call timeout handler was delayed by -3.2997185799999897s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18530000000000002s for a response
W20260709 12:10:31.379320 22421 connection.cc:256] RPC call timeout handler was delayed by -3.284418579999965s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18700000000000003s for a response
I20260709 12:10:31.348405 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:31.254528 24734 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:31.261204 24847 raft_consensus.cc:740] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:31.381474 22528 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
I20260709 12:10:31.383360 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:31.348551 24739 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:31.423971 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:10:31.427886 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.423638 22530 raft_consensus.cc:2393] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 3: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:31.377668 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:31.431252 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:31.440661 22532 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:31.441977 23121 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:31.457213 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:31.460599 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:31.469417 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:31.471405 24847 consensus_queue.cc:260] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:31.472164 24850 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:31.475051 24547 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.427835 24734 raft_consensus.cc:3060] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:31.427933 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:31.475809 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:31.897464 24839 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:31.297521 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:31.878629 24751 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.032611 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:32.033409 22599 raft_consensus.cc:2393] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 5: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:32.032996 24751 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:32.034448 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:31.974766 22602 raft_consensus.cc:1275] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:31.888933 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:31.511271 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 200417us
I20260709 12:10:31.482376 22570 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:10:32.039011 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 556673us
I20260709 12:10:31.556032 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:32.039893 22601 raft_consensus.cc:2468] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5.
I20260709 12:10:32.040673 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:32.041373 22528 raft_consensus.cc:2393] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 6: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:32.035473 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:31.482362 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:10:31.806977 23119 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.014s	sys 0.026s
I20260709 12:10:31.958473 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:32.012506 22525 consensus_meta.cc:287] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.676s	user 0.008s	sys 0.000s
I20260709 12:10:31.760354 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:32.044119 23117 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:32.043740 22525 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5.
I20260709 12:10:31.627435 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:10:31.900105 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.889880 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:32.049736 22606 raft_consensus.cc:2393] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 5: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:32.050354 22524 raft_consensus.cc:2393] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 4: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
W20260709 12:10:31.543224 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 115572us
I20260709 12:10:31.633205 23088 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:32.031783 23121 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:32.054239 22599 raft_consensus.cc:2393] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 5: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
W20260709 12:10:32.042553 23119 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.017s	sys 0.027s
I20260709 12:10:32.043146 22526 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 4.
I20260709 12:10:32.057044 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:32.035806 24751 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:31.960493 22497 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:31.545632 24701 consensus_meta.cc:287] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.610s	user 0.010s	sys 0.006s
I20260709 12:10:31.753986 24675 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:32.063526 24850 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:32.101673 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:31.465412 24756 consensus_queue.cc:1059] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.641s
I20260709 12:10:32.102475 22606 raft_consensus.cc:2393] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 6: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:32.102970 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:32.103519 24850 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:31.625861 24578 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:31.889405 24720 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:32.104149 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:32.104848 22603 raft_consensus.cc:2393] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 5: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:32.061985 22599 raft_consensus.cc:2376] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4. Re-sending same reply.
I20260709 12:10:32.106899 22603 raft_consensus.cc:1275] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:32.100800 24839 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.103439 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:31.746151 24811 consensus_meta.cc:287] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.907s	user 0.008s	sys 0.004s
I20260709 12:10:31.431208 24843 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
W20260709 12:10:32.109037 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 148666us
I20260709 12:10:32.064384 23089 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:32.103444 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:32.111835 22457 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.776s	user 0.029s	sys 0.049s
W20260709 12:10:32.119031 22457 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.030s	sys 0.049s
I20260709 12:10:31.769083 22351 catalog_manager.cc:5697] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 2 to 4, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 4 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
W20260709 12:10:31.943447 24561 consensus_meta.cc:287] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.651s	user 0.011s	sys 0.001s
I20260709 12:10:32.120657 22351 catalog_manager.cc:5697] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 4 to 6, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 6 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:10:31.630950 24713 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:32.192175 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:32.137122 22448 raft_consensus.cc:1240] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:31.955371 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:32.195650 22528 raft_consensus.cc:2393] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 4: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:32.136821 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:32.060741 24845 raft_consensus.cc:2804] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:32.226181 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:32.229267 22603 raft_consensus.cc:1275] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:32.151410 23121 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
I20260709 12:10:31.483083 24348 raft_consensus.cc:2804] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:31.737046 24855 log.cc:927] Time spent T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
W20260709 12:10:31.510430 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.245311 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:32.197103 22454 raft_consensus.cc:2393] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 5: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
W20260709 12:10:32.246490 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.247408 22422 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:32.171425 23125 raft_consensus.cc:1275] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:31.431411 24694 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:32.235744 22448 raft_consensus.cc:2368] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 2. Current term is 3.
I20260709 12:10:31.431429 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:31.959717 23124 consensus_meta.cc:287] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.585s	user 0.008s	sys 0.000s
I20260709 12:10:32.269325 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:32.269693 23124 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:31.742647 24739 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:32.121989 24811 raft_consensus.cc:2749] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:31.746543 22353 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48412 (request call id 239) took 7487 ms. Trace:
I20260709 12:10:32.176739 24863 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:10:32.259358 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 138276us
W20260709 12:10:32.261397 22569 leader_election.cc:336] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.657s (SENT)
I20260709 12:10:32.119472 24675 raft_consensus.cc:3055] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:10:31.934926 24744 consensus_meta.cc:287] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.772s	user 0.009s	sys 0.001s
I20260709 12:10:32.011382 22597 raft_consensus.cc:1275] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:10:32.254693 24621 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.811s	user 0.008s	sys 0.037s
I20260709 12:10:32.192107 24807 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:31.630529 24605 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:32.117476 24743 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:32.285075 23117 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:10:32.286281 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:32.172247 22351 catalog_manager.cc:5697] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 3 to 4, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 4 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:32.268101 24845 raft_consensus.cc:697] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:32.298126 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:32.303953 24863 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:32.321244 24859 log.cc:927] Time spent T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
I20260709 12:10:32.322700 23123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 729) took 1165 ms. Trace:
I20260709 12:10:32.304118 24547 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:32.323494 24863 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:32.310173 24621 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.872s	user 0.008s	sys 0.037s
I20260709 12:10:32.290366 24694 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:31.662387 24827 consensus_queue.cc:237] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:32.301904 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:32.307250 22532 raft_consensus.cc:1240] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 LEADER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:32.289085 22353 rpcz_store.cc:276] 0709 12:10:24.259269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.259874 (+   605us) service_pool.cc:224] Handling call
0709 12:10:31.746459 (+7486585us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:29.122867 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:29.123625 (+   758us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:29.123681 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:10:29.123693 (+    12us) tablet.cc:662] Decoding operations
0709 12:10:29.219262 (+ 95569us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:29.219353 (+    91us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:29.219385 (+    32us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:10:29.220126 (+   741us) tablet.cc:701] Row locks acquired
0709 12:10:29.220172 (+    46us) write_op.cc:260] PREPARE: finished
0709 12:10:29.220368 (+   196us) write_op.cc:270] Start()
0709 12:10:29.220525 (+   157us) write_op.cc:276] Timestamp: P: 1783599029220297 usec, L: 0
0709 12:10:29.220551 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:10:29.373173 (+152622us) log.cc:844] Serialized 2084 byte log entry
0709 12:10:29.868070 (+494897us) op_driver.cc:464] REPLICATION: finished
0709 12:10:29.987496 (+119426us) write_op.cc:301] APPLY: starting
0709 12:10:29.987594 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:29.987774 (+   180us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:30.027993 (+ 40219us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:30.212312 (+184319us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:30.212733 (+   421us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:10:30.212802 (+    69us) write_op.cc:312] APPLY: finished
0709 12:10:30.213200 (+   398us) log.cc:844] Serialized 47 byte log entry
0709 12:10:30.213439 (+   239us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:30.213581 (+   142us) write_op.cc:454] Released schema lock
0709 12:10:30.213662 (+    81us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:30.214199 (+   537us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:30.214230 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":200314,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":119126,"apply.run_cpu_time_us":16064,"apply.run_wall_time_us":226696,"num_ops":5,"prepare.queue_time_us":709289,"prepare.run_cpu_time_us":25567,"prepare.run_wall_time_us":488706,"raft.queue_time_us":119669,"raft.run_cpu_time_us":10753,"raft.run_wall_time_us":125098,"replication_time_us":647326,"spinlock_wait_cycles":1792,"thread_start_us":970198,"threads_started":4,"wal-append.queue_time_us":299335,"wal-append.run_cpu_time_us":11422,"wal-append.run_wall_time_us":1530228}]]}
I20260709 12:10:32.311581 22528 raft_consensus.cc:1240] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:32.279721 24756 raft_consensus.cc:2804] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:32.314465 22351 catalog_manager.cc:5697] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 2 to 3, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 3 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:10:31.974721 24812 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.225935 24561 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:32.330473 22601 raft_consensus.cc:2393] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 6: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:32.327783 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:32.346716 22448 raft_consensus.cc:2368] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 4. Current term is 5.
I20260709 12:10:32.333557 22351 catalog_manager.cc:5697] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 1 to 2, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 2 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:32.327198 22605 raft_consensus.cc:1240] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:32.327040 22457 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1448) took 1062 ms. Trace:
I20260709 12:10:32.348238 22351 catalog_manager.cc:5697] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 3 to 5, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 5 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:32.347990 22457 rpcz_store.cc:276] 0709 12:10:31.264629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.264918 (+   289us) service_pool.cc:224] Handling call
0709 12:10:31.298357 (+ 33439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:31.335336 (+ 36979us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:31.335377 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:31.335836 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 12:10:32.119413 (+783577us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:32.119455 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.119532 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:32.326829 (+207297us) raft_consensus.cc:1685] finished
0709 12:10:32.326856 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:32.326969 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1661,"raft.queue_time_us":5281,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":20413,"thread_start_us":783209,"threads_started":1,"wal-append.queue_time_us":954580}
I20260709 12:10:32.118638 24843 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:32.133368 24839 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:32.297695 24675 raft_consensus.cc:740] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:32.329677 22532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 497) took 1083 ms. Trace:
I20260709 12:10:32.358368 22532 rpcz_store.cc:276] 0709 12:10:31.246478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.255394 (+1008916us) service_pool.cc:224] Handling call
0709 12:10:32.291669 (+ 36275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:32.329457 (+ 37788us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.329627 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.323052 23123 rpcz_store.cc:276] 0709 12:10:31.157143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.267711 (+110568us) service_pool.cc:224] Handling call
0709 12:10:31.268009 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:31.268265 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:31.268289 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:31.268751 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 12:10:31.375669 (+106918us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:31.375720 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:31.375808 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:32.322519 (+946711us) raft_consensus.cc:1685] finished
0709 12:10:32.322537 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:32.322646 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":106529,"threads_started":1,"wal-append.queue_time_us":736170}
I20260709 12:10:32.329535 22603 raft_consensus.cc:1240] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:32.358815 24675 consensus_queue.cc:260] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:32.360213 24675 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.325279 24848 raft_consensus.cc:2955] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
W20260709 12:10:32.324144 24857 log.cc:927] Time spent T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:10:32.356405 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:32.350304 22351 catalog_manager.cc:5697] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:10:32.377717 22351 catalog_manager.cc:5697] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 4 to 5, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 5 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:32.269145 24797 consensus_queue.cc:1059] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:10:32.379675 22454 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 6.
I20260709 12:10:32.415565 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:32.416308 22454 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 3.
W20260709 12:10:32.333019 24854 log.cc:927] Time spent T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 12:10:32.325047 24547 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:32.412462 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:32.413765 22351 catalog_manager.cc:5697] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:32.312788 24764 consensus_queue.cc:1048] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 12:10:32.324116 24863 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.326321 24739 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:32.331732 24756 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:32.327013 24605 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:32.310102 24744 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:32.324998 24621 raft_consensus.cc:2804] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:32.376819 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:32.358870 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:32.430884 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:32.327071 24743 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:32.423532 22351 catalog_manager.cc:5697] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 2 to 5, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 5 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:32.454099 23120 raft_consensus.cc:2368] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 3. Current term is 4.
W20260709 12:10:32.433406 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 392186us
I20260709 12:10:32.332175 24812 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:32.431814 22421 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:32.421455 24797 raft_consensus.cc:3055] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:10:32.442369 22452 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.015s	sys 0.050s
W20260709 12:10:32.463543 22452 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.015s	sys 0.050s
I20260709 12:10:32.436093 24756 raft_consensus.cc:3060] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:32.466886 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:32.474462 23118 raft_consensus.cc:1240] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:32.475307 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:32.475950 23124 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
I20260709 12:10:32.476012 24843 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:32.479084 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.483552 24865 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.483927 24694 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:32.485365 24739 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.485869 24739 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:32.487104 24751 raft_consensus.cc:2764] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:10:32.487885 24561 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:32.444662 22351 catalog_manager.cc:5697] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 1 to 3, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 3 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:32.445539 24713 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:32.489353 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 57654.2us
I20260709 12:10:32.493826 22452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1449) took 1169 ms. Trace:
I20260709 12:10:32.452461 24621 raft_consensus.cc:697] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 4 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:32.495955 22531 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
I20260709 12:10:32.500757 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:32.497350 22351 catalog_manager.cc:5697] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 2 to 3, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 3 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:32.503645 22351 catalog_manager.cc:5697] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 1 to 2, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 2 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:10:32.504561 22351 catalog_manager.cc:5697] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 2 to 4, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 4 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:10:32.504660 22421 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:32.468236 22454 raft_consensus.cc:2468] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
I20260709 12:10:32.506147 22454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 454) took 1027 ms. Trace:
I20260709 12:10:32.506415 22454 rpcz_store.cc:276] 0709 12:10:31.478341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.417055 (+938714us) service_pool.cc:224] Handling call
0709 12:10:32.506093 (+ 89038us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.507268 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:32.507826 22457 raft_consensus.cc:2410] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
W20260709 12:10:32.518442 22420 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:51844 dropped due to backpressure: service queue is full with 50 items
I20260709 12:10:32.502530 24713 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:32.529299 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:32.530112 22453 raft_consensus.cc:2468] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 2.
I20260709 12:10:32.530593 22453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 449) took 1053 ms. Trace:
I20260709 12:10:32.537943 22453 rpcz_store.cc:276] 0709 12:10:31.477002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.739827 (+262825us) service_pool.cc:224] Handling call
0709 12:10:32.529120 (+789293us) spinlock_profiling.cc:243] Waited 56.4 ms on lock 0x7b5800002a98. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf8f40a0 00007f9ccf8f3984 00007f9cc8e6e6d4 00007f9cc8e6e662
0709 12:10:32.530532 (+  1412us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129712512}
W20260709 12:10:32.531279 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.533380 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:32.534138 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:32.451761 24845 consensus_queue.cc:237] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:32.441419 24863 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:32.536250 24621 consensus_queue.cc:237] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:32.456676 24797 raft_consensus.cc:740] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:32.541093 22570 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:32.544407 23120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57332 (request call id 513) took 1324 ms. Trace:
I20260709 12:10:32.553413 23120 rpcz_store.cc:276] 0709 12:10:31.219999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.227062 (+  7063us) service_pool.cc:224] Handling call
0709 12:10:32.544194 (+1317132us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54006f1154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:32.544343 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2617832832}
I20260709 12:10:32.539898 22455 raft_consensus.cc:2376] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4. Re-sending same reply.
I20260709 12:10:32.554358 22455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 445) took 1078 ms. Trace:
I20260709 12:10:32.546692 22351 catalog_manager.cc:5697] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:10:32.549993 22457 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 455) took 1071 ms. Trace:
I20260709 12:10:32.552076 22451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1450) took 1172 ms. Trace:
I20260709 12:10:32.555744 22451 rpcz_store.cc:276] 0709 12:10:31.379285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.379448 (+   163us) service_pool.cc:224] Handling call
0709 12:10:32.534012 (+1154564us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b5800002a98. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf8f40a0 00007f9ccf8f3984 00007f9cc8e6e6d4 00007f9cc8e6e662
0709 12:10:32.552001 (+ 17989us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":242483968}
I20260709 12:10:32.554682 22455 rpcz_store.cc:276] 0709 12:10:31.475759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.479091 (+  3332us) service_pool.cc:224] Handling call
0709 12:10:32.533240 (+1054149us) spinlock_profiling.cc:243] Waited 91.8 ms on lock 0x7b5800002a98. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf8f40a0 00007f9ccf8f3984 00007f9cc8e6e6d4 00007f9cc8e6e662
0709 12:10:32.554301 (+ 21061us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":211204480}
I20260709 12:10:32.555303 22457 rpcz_store.cc:276] 0709 12:10:31.478588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.500500 (+1021912us) service_pool.cc:224] Handling call
0709 12:10:32.549933 (+ 49433us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.558017 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:32.559000 22457 raft_consensus.cc:2393] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 4: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:32.559962 22351 catalog_manager.cc:5697] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 2 to 4, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 4 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:10:32.561618 24751 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.562161 24839 leader_election.cc:290] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:32.498965 24744 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:32.565905 22351 catalog_manager.cc:5697] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 2 to 4, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 4 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:32.564666 22570 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:32.606841 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:32.619918 22526 raft_consensus.cc:1240] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:32.591958 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:32.621557 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:32.623916 22351 catalog_manager.cc:5697] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 2 to 4, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 4 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:32.625021 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 60458.4us
I20260709 12:10:32.627126 22526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 500) took 1379 ms. Trace:
I20260709 12:10:32.627625 22526 rpcz_store.cc:276] 0709 12:10:31.247535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.544075 (+1296540us) service_pool.cc:224] Handling call
0709 12:10:32.608097 (+ 64022us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:32.626888 (+ 18791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.627071 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.619451 24865 raft_consensus.cc:2749] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:32.629326 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:32.630223 22456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 446) took 1154 ms. Trace:
I20260709 12:10:32.634618 24348 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:32.635242 24348 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.635377 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:32.636204 22455 raft_consensus.cc:2393] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 5: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:32.640872 22448 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:32.644556 22528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 1810) took 1398 ms. Trace:
I20260709 12:10:32.644996 22528 rpcz_store.cc:276] 0709 12:10:31.246042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.227915 (+981873us) service_pool.cc:224] Handling call
0709 12:10:32.228598 (+   683us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:32.329554 (+100956us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.644286 (+314732us) spinlock_profiling.cc:243] Waited 82.8 ms on lock 0x7b54001f1b54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:32.644483 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":190357248}
W20260709 12:10:32.647888 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.651609 22351 catalog_manager.cc:5697] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 1 to 2, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 2 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:10:32.655344 22526 raft_consensus.cc:1240] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:32.630584 22456 rpcz_store.cc:276] 0709 12:10:31.476139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.479373 (+  3234us) service_pool.cc:224] Handling call
0709 12:10:32.629151 (+1149778us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b5800002a98. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf8f40a0 00007f9ccf8f3984 00007f9cc8e6e6d4 00007f9cc8e6e662
0709 12:10:32.630154 (+  1003us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":242238848}
I20260709 12:10:32.655489 22351 catalog_manager.cc:5697] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 2 to 4, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 4 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:10:32.646754 22528 raft_consensus.cc:1240] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:32.591177 24843 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:32.662528 24847 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.666455 22351 catalog_manager.cc:5697] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:10:32.704648 22524 raft_consensus.cc:1275] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:32.704499 22351 catalog_manager.cc:5697] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:32.496745 22452 rpcz_store.cc:276] 0709 12:10:31.340233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.340474 (+   241us) service_pool.cc:224] Handling call
0709 12:10:31.371837 (+ 31363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:31.430006 (+ 58169us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:31.462196 (+ 32190us) log.cc:844] Serialized 14 byte log entry
0709 12:10:32.493499 (+1031303us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:32.493554 (+    55us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:32.493609 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.493670 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:32.493774 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2660,"prepare.queue_time_us":17070,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":32103,"thread_start_us":578430,"threads_started":1}
I20260709 12:10:32.680086 22605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 1827) took 1403 ms. Trace:
I20260709 12:10:32.681986 22531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56942 (request call id 1417) took 1335 ms. Trace:
I20260709 12:10:32.706993 22531 rpcz_store.cc:276] 0709 12:10:31.346484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.379271 (+ 32787us) service_pool.cc:224] Handling call
0709 12:10:32.681770 (+1302499us) spinlock_profiling.cc:243] Waited 458 ms on lock 0x7b5400082ad4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:32.681912 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1052759296}
I20260709 12:10:32.682730 24605 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:32.683341 24797 consensus_queue.cc:260] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:32.680927 24348 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:32.685943 24713 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:32.687803 24743 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:32.690066 24739 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:32.703939 24561 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.703264 22528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1416) took 1311 ms. Trace:
I20260709 12:10:32.761291 22528 rpcz_store.cc:276] 0709 12:10:31.346201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.646019 (+1299818us) service_pool.cc:224] Handling call
0709 12:10:32.646442 (+   423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:32.657358 (+ 10916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.657623 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.706298 22605 rpcz_store.cc:276] 0709 12:10:31.276521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.276999 (+   478us) service_pool.cc:224] Handling call
0709 12:10:31.277297 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:32.355085 (+1077788us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.679756 (+324671us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54003ae8d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:32.679995 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2414075648}
W20260709 12:10:32.695896 24720 consensus_meta.cc:287] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.591s	user 0.008s	sys 0.002s
I20260709 12:10:32.662591 24333 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:32.704367 24843 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:32.756978 23087 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.010s	sys 0.010s
W20260709 12:10:32.773762 23087 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.010s	sys 0.010s
I20260709 12:10:32.696949 22526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 1815) took 1449 ms. Trace:
I20260709 12:10:32.774498 22526 rpcz_store.cc:276] 0709 12:10:31.247595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.654798 (+1407203us) service_pool.cc:224] Handling call
0709 12:10:32.655189 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:32.696610 (+ 41421us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.696877 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:32.776997 23087 leader_election.cc:336] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.625s (SENT)
I20260709 12:10:32.758495 22524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 499) took 1491 ms. Trace:
W20260709 12:10:32.777768 23087 leader_election.cc:336] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.805s (SENT)
W20260709 12:10:32.788102 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:32.801138 23119 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.012s	sys 0.012s
I20260709 12:10:32.777667 22524 rpcz_store.cc:276] 0709 12:10:31.246969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.531631 (+1284662us) service_pool.cc:224] Handling call
0709 12:10:32.694277 (+162646us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:32.704999 (+ 10722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.738285 (+ 33286us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b5400082ad0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:32.738503 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":373246336}
W20260709 12:10:32.801647 23119 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.012s	sys 0.012s
W20260709 12:10:32.760305 23088 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.008s	sys 0.012s
W20260709 12:10:32.768118 23089 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.027s	sys 0.022s
I20260709 12:10:32.768769 22531 raft_consensus.cc:1240] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:32.805989 23088 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.008s	sys 0.012s
I20260709 12:10:32.806558 22531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1419) took 1383 ms. Trace:
W20260709 12:10:32.806022 23089 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.027s	sys 0.022s
I20260709 12:10:32.807001 22531 rpcz_store.cc:276] 0709 12:10:31.423601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.738773 (+1315172us) service_pool.cc:224] Handling call
0709 12:10:32.768609 (+ 29836us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:32.806282 (+ 37673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.806489 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:32.806573 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 1.17338e+06us
W20260709 12:10:32.810675 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:32.811269 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:32.819196 23087 leader_election.cc:336] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.832s (SENT)
I20260709 12:10:32.802775 23119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 511) took 1583 ms. Trace:
W20260709 12:10:32.831929 23087 leader_election.cc:336] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 2.848s (SENT)
I20260709 12:10:32.833446 22449 raft_consensus.cc:2368] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 4. Current term is 6.
I20260709 12:10:32.835928 22449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 444) took 1375 ms. Trace:
I20260709 12:10:32.836308 22449 rpcz_store.cc:276] 0709 12:10:31.460276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.469880 (+  9604us) service_pool.cc:224] Handling call
0709 12:10:32.358725 (+888845us) spinlock_profiling.cc:243] Waited 33.2 ms on lock 0x7b5800002a98. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf8f40a0 00007f9ccf8f3984 00007f9cc8e6e6d4 00007f9cc8e6e662
0709 12:10:32.835712 (+476987us) spinlock_profiling.cc:243] Waited 326 ms on lock 0x7b5400241b54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:32.835865 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":826271360}
I20260709 12:10:32.837921 22531 raft_consensus.cc:1240] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 4. Current term is 5. Ops: [4.5-4.5]
W20260709 12:10:32.834497 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 770183us
I20260709 12:10:32.838585 22531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1424) took 1348 ms. Trace:
I20260709 12:10:32.839051 22531 rpcz_store.cc:276] 0709 12:10:31.489915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.807861 (+1317946us) service_pool.cc:224] Handling call
0709 12:10:32.837665 (+ 29804us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:32.838328 (+   663us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.838533 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.839519 23089 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:32.832614 23087 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:32.518882 22420 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:51844 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1463)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 475)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 470)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 474)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 473)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 465)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1471)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 467)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 468)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2080)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1472)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 462)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 471)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2071)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2072)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2073)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2078)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2068)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2067)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2076)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 469)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1453)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 463)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2069)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 456)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 458)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 461)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1454)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1455)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1456)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1457)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1459)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1461)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1462)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1464)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1465)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1466)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1467)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1468)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1469)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1470)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2070)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2075)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2077)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2079)
I20260709 12:10:32.799130 24843 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:32.800442 24739 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.714444 24605 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:32.876709 24734 consensus_meta.cc:287] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.639s	user 0.007s	sys 0.002s
I20260709 12:10:32.841341 24578 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.888350 22531 raft_consensus.cc:1240] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:32.816493 24333 raft_consensus.cc:697] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:32.766963 24850 consensus_queue.cc:1048] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 12:10:32.830404 24751 raft_consensus.cc:2749] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:32.899549 22531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1425) took 1382 ms. Trace:
I20260709 12:10:32.770476 24561 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:32.907488 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.905114 23089 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:32.906612 22531 rpcz_store.cc:276] 0709 12:10:31.516788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.839936 (+1323148us) service_pool.cc:224] Handling call
0709 12:10:32.888107 (+ 48171us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:32.899212 (+ 11105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.899474 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.844815 24744 raft_consensus.cc:2749] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:32.922338 22497 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.018s	sys 0.021s
I20260709 12:10:32.923844 22531 raft_consensus.cc:1240] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:32.926241 22497 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.018s	sys 0.021s
W20260709 12:10:32.924693 23122 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.017s	sys 0.012s
W20260709 12:10:32.927613 23122 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.017s	sys 0.012s
I20260709 12:10:32.904390 24698 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:32.917886 22532 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.019s	sys 0.047s
I20260709 12:10:32.933421 22531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1426) took 1376 ms. Trace:
I20260709 12:10:32.936553 22531 rpcz_store.cc:276] 0709 12:10:31.557081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.908394 (+1351313us) service_pool.cc:224] Handling call
0709 12:10:32.923613 (+ 15219us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:32.925771 (+  2158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.933330 (+  7559us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:32.937759 22532 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.020s	sys 0.047s
W20260709 12:10:32.973031 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 68006.1us
I20260709 12:10:32.974140 23089 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:32.904294 24578 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:32.978282 23089 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:32.983058 23089 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:32.980926 22531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1428) took 1094 ms. Trace:
I20260709 12:10:32.983887 22531 rpcz_store.cc:276] 0709 12:10:31.886185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.937538 (+1051353us) service_pool.cc:224] Handling call
0709 12:10:32.980446 (+ 42908us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:32.980619 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:32.980643 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:32.980679 (+    36us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:32.980714 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.980762 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:32.980860 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:32.975684 24815 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.023s	sys 0.008s
I20260709 12:10:32.902423 24739 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:32.906598 24734 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:32.982565 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:32.990824 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.895280 24756 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:33.009222 22604 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.000s	sys 0.051s
W20260709 12:10:33.050326 22604 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.000s	sys 0.051s
I20260709 12:10:32.970412 24868 raft_consensus.cc:2749] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:33.022019 22525 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.028s	sys 0.021s
I20260709 12:10:33.055917 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:33.012357 23123 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.007s	sys 0.018s
W20260709 12:10:33.057977 23123 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.008s	sys 0.018s
I20260709 12:10:33.016054 22569 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
W20260709 12:10:33.017036 23087 leader_election.cc:336] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 2.378s (SENT)
W20260709 12:10:33.017738 22495 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.004s	sys 0.048s
W20260709 12:10:33.059226 22495 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.005s	sys 0.048s
I20260709 12:10:33.059156 23087 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:33.059782 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 619229us
W20260709 12:10:33.052609 22525 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.028s	sys 0.021s
I20260709 12:10:32.976358 24865 consensus_queue.cc:1048] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:10:32.978708 24713 consensus_queue.cc:1059] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
W20260709 12:10:33.063971 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.970517 24698 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:33.021111 24815 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.023s	sys 0.008s
W20260709 12:10:33.044442 24848 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.018s	sys 0.022s
W20260709 12:10:33.073486 22421 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.010s	sys 0.025s
W20260709 12:10:33.092525 22421 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.010s	sys 0.025s
I20260709 12:10:33.091018 22450 raft_consensus.cc:1240] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:32.979998 24694 consensus_queue.cc:1048] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.069s
W20260709 12:10:33.099560 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 82558.9us
W20260709 12:10:33.095568 24701 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.036s	sys 0.014s
W20260709 12:10:33.103173 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 598588us
I20260709 12:10:33.023310 24889 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:33.065073 24827 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:33.069545 24872 raft_consensus.cc:2749] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:33.092314 24848 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.018s	sys 0.022s
I20260709 12:10:33.100922 24873 raft_consensus.cc:2749] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:33.105334 23116 raft_consensus.cc:1240] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:33.026091 24843 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:33.125905 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:33.150592 22605 raft_consensus.cc:2410] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:10:33.130576 22570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.009s	sys 0.034s
I20260709 12:10:33.018247 24333 consensus_queue.cc:237] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:33.023036 22531 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:39980
I20260709 12:10:33.124205 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:10:33.155783 22570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.010s	sys 0.034s
I20260709 12:10:33.126585 24863 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:10:33.161437 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 535615us
I20260709 12:10:33.163257 24713 consensus_queue.cc:1243] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer 6c6fa11e8ee34711b3551f0c670442bc log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:10:33.173415 24890 raft_consensus.cc:2804] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:33.173921 24890 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:33.174304 24890 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:33.174655 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:33.182674 24694 raft_consensus.cc:3055] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:33.183204 24694 raft_consensus.cc:740] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:33.183537 24890 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:33.139261 24889 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:33.184213 24694 consensus_queue.cc:260] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:33.185498 24694 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:33.172204 24713 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.189257 22570 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:33.191891 22570 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:33.164353 24621 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:33.165594 24751 consensus_queue.cc:1048] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:33.168497 22605 raft_consensus.cc:1240] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:33.130831 24701 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.036s	sys 0.014s
W20260709 12:10:33.169416 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.128502 24348 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:10:33.170388 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 187410us
I20260709 12:10:33.136231 24879 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.194016 22523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1415) took 1848 ms. Trace:
I20260709 12:10:33.136427 24875 raft_consensus.cc:2804] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:33.197889 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.220686 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:33.187882 24605 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:33.207217 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 51487.3us
I20260709 12:10:33.207787 22523 rpcz_store.cc:276] 0709 12:10:31.345858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.641533 (+1295675us) service_pool.cc:224] Handling call
0709 12:10:32.641896 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:32.642116 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:33.070484 (+428368us) log.cc:844] Serialized 14 byte log entry
0709 12:10:33.193613 (+123129us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:33.193665 (+    52us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:33.193713 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.193798 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:33.193938 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":519541,"thread_start_us":547496,"threads_started":2}
I20260709 12:10:33.204926 23089 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:33.205229 24865 raft_consensus.cc:2749] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:33.202381 24888 raft_consensus.cc:2804] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:33.212719 24348 raft_consensus.cc:2804] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:33.205400 24713 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:33.133378 24887 consensus_queue.cc:1059] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 12:10:33.230677 22421 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:33.226317 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:33.230933 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:33.213721 24875 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:33.193575 22570 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:33.152485 24827 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:33.214411 24743 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.247783 23089 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:33.213109 24879 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:33.251363 22603 raft_consensus.cc:1275] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:33.239166 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:10:33.238935 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 222976us
I20260709 12:10:33.216527 24848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:56928 (request call id 87) took 19322 ms. Trace:
W20260709 12:10:33.347098 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 99370.2us
W20260709 12:10:33.300025 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 106470us
I20260709 12:10:33.303225 22523 raft_consensus.cc:2393] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 4: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:33.253378 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:33.348922 22606 raft_consensus.cc:3060] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:33.247498 24874 log.cc:927] Time spent T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 12:10:33.358733 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:10:33.311090 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 50726.1us
I20260709 12:10:33.359444 23118 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:33.301344 22605 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:10:33.330758 22453 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:33.360949 24605 raft_consensus.cc:2804] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:33.361490 24605 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:33.361936 24605 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:33.363637 24885 log.cc:927] Time spent T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
W20260709 12:10:33.365489 24883 log.cc:927] Time spent T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 12:10:33.367285 24734 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:33.303736 24875 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:33.371824 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:33.372848 22606 raft_consensus.cc:2468] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 6.
I20260709 12:10:33.339375 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:33.347955 23089 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:33.249895 24744 raft_consensus.cc:2749] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:33.375172 24734 raft_consensus.cc:2749] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:33.222867 24751 consensus_queue.cc:1059] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.085s
I20260709 12:10:33.251364 24621 raft_consensus.cc:697] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 5 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:33.355273 22569 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:33.349548 24863 raft_consensus.cc:2749] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:33.356684 24878 log.cc:927] Time spent T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.187s	user 0.000s	sys 0.000s
I20260709 12:10:33.356923 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:10:33.357508 24886 log.cc:927] Time spent T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:10:33.358471 24879 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:33.372963 24877 log.cc:927] Time spent T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 12:10:33.374881 23089 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:10:33.422999 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 48195.6us
I20260709 12:10:33.423959 23089 leader_election.cc:304] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:33.354262 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:33.376544 22448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 470) took 1137 ms. Trace:
I20260709 12:10:33.425745 22448 rpcz_store.cc:276] 0709 12:10:32.239510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.304612 (+1065102us) service_pool.cc:224] Handling call
0709 12:10:33.376477 (+ 71865us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:33.334719 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.427429 22422 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:33.378854 22453 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
I20260709 12:10:33.428263 22453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 475) took 1099 ms. Trace:
I20260709 12:10:33.428649 22453 rpcz_store.cc:276] 0709 12:10:32.328847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.238897 (+910050us) service_pool.cc:224] Handling call
0709 12:10:33.428192 (+189295us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:33.247709 24561 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:33.430608 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:33.214676 24872 consensus_queue.cc:1059] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.112s
W20260709 12:10:33.405571 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 50414.7us
W20260709 12:10:33.412693 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 182079us
I20260709 12:10:33.442476 22421 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:33.298564 24348 raft_consensus.cc:697] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:33.250128 24701 consensus_queue.cc:1059] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.166s
I20260709 12:10:33.430435 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:10:33.381295 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.431348 22523 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:33.437427 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 375945us
I20260709 12:10:33.453722 24756 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:33.415949 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:33.470343 22451 raft_consensus.cc:2410] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:33.458987 22531 raft_consensus.cc:606] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Received request to transfer leadership to TS 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:33.459134 22524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1423) took 1997 ms. Trace:
I20260709 12:10:33.463303 23120 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
I20260709 12:10:33.470778 22531 raft_consensus.cc:614] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:33.473266 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:33.474231 22453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1472) took 1062 ms. Trace:
I20260709 12:10:33.474644 22453 rpcz_store.cc:276] 0709 12:10:32.412266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.472986 (+1060720us) service_pool.cc:224] Handling call
0709 12:10:33.474165 (+  1179us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:33.479120 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.482355 24751 raft_consensus.cc:2804] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:33.470818 22524 rpcz_store.cc:276] 0709 12:10:31.462080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.802077 (+1339997us) service_pool.cc:224] Handling call
0709 12:10:32.802446 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:32.802685 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:33.140667 (+337982us) log.cc:844] Serialized 14 byte log entry
0709 12:10:33.458701 (+318034us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:33.458773 (+    72us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:33.458834 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.458931 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:33.459078 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":376597,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"thread_start_us":568235,"threads_started":3}
W20260709 12:10:33.499212 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.501127 22451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 474) took 1211 ms. Trace:
I20260709 12:10:33.501672 22451 rpcz_store.cc:276] 0709 12:10:32.289571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.306133 (+1016562us) service_pool.cc:224] Handling call
0709 12:10:33.501045 (+194912us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:33.503398 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:33.495661 22523 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:33.506443 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:33.507300 22453 raft_consensus.cc:2393] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 5: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:33.507467 22523 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
I20260709 12:10:33.498138 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:33.509940 22524 raft_consensus.cc:3060] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:33.376142 24743 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:33.513204 22453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 462) took 1482 ms. Trace:
I20260709 12:10:33.347476 24848 rpcz_store.cc:276] 0709 12:10:13.883741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.884384 (+   643us) service_pool.cc:224] Handling call
0709 12:10:13.905812 (+ 21428us) log.cc:844] Serialized 508 byte log entry
0709 12:10:33.186646 (+19280834us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5879,"raft.queue_time_us":11277,"raft.run_cpu_time_us":1429,"raft.run_wall_time_us":102283,"thread_start_us":263145,"threads_started":1,"wal-append.queue_time_us":272404,"wal-append.run_cpu_time_us":1794,"wal-append.run_wall_time_us":1031005}
I20260709 12:10:33.463228 24734 raft_consensus.cc:2749] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:33.463608 24879 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.457508 24698 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:33.459498 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:33.525602 22453 rpcz_store.cc:276] 0709 12:10:32.030744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.503055 (+1472311us) service_pool.cc:224] Handling call
0709 12:10:33.513126 (+ 10071us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:33.513389 22604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2198) took 2131 ms. Trace:
W20260709 12:10:33.532282 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.533356 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:10:33.558136 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 119056us
I20260709 12:10:33.535792 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:33.559826 23122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 518) took 2320 ms. Trace:
W20260709 12:10:33.560779 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 136925us
I20260709 12:10:33.561563 23089 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:10:33.562343 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 119996us
I20260709 12:10:33.561355 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:33.564281 22421 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:33.564766 22523 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:33.558341 22451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 471) took 1313 ms. Trace:
I20260709 12:10:33.567564 23088 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:33.566967 22451 rpcz_store.cc:276] 0709 12:10:32.245184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.502535 (+1257351us) service_pool.cc:224] Handling call
0709 12:10:33.558274 (+ 55739us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:33.561182 23122 rpcz_store.cc:276] 0709 12:10:31.239709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.345934 (+106225us) service_pool.cc:224] Handling call
0709 12:10:31.346436 (+   502us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:31.364151 (+ 17715us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:31.364182 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:32.064067 (+699885us) log.cc:844] Serialized 534 byte log entry
0709 12:10:32.928329 (+864262us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:32.928367 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.929673 (+  1306us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:33.559618 (+629945us) raft_consensus.cc:1685] finished
0709 12:10:33.559637 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:33.559771 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18525,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":12943,"thread_start_us":690689,"threads_started":1,"wal-append.queue_time_us":939605}
I20260709 12:10:33.558926 22604 rpcz_store.cc:276] 0709 12:10:31.382367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.888773 (+506406us) service_pool.cc:224] Handling call
0709 12:10:31.944825 (+ 56052us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:31.945015 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:32.438530 (+493515us) log.cc:844] Serialized 14 byte log entry
0709 12:10:33.509230 (+1070700us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:33.509299 (+    69us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:33.509357 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.509436 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:33.513318 (+  3882us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":712239,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":53,"raft.queue_time_us":122305,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":82,"thread_start_us":1512335,"threads_started":3,"wal-append.queue_time_us":709645}
I20260709 12:10:33.472268 24744 raft_consensus.cc:2749] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:33.572026 24698 raft_consensus.cc:2804] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:33.573472 24910 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.590919 24910 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:33.591431 24880 log.cc:927] Time spent T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.338s	user 0.001s	sys 0.000s
W20260709 12:10:33.592543 22529 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56940 (request call id 1801) took 2489 ms (client timeout 2036 ms). Trace:
I20260709 12:10:33.593097 24910 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:33.592996 22529 rpcz_store.cc:269] 0709 12:10:31.103282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.169233 (+ 65951us) service_pool.cc:224] Handling call
0709 12:10:33.592299 (+2423066us) spinlock_profiling.cc:243] Waited 1.85 s on lock 0x7b54000d52d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:33.592439 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4252969344}
I20260709 12:10:33.594339 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:33.595036 24743 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:33.573590 24348 consensus_queue.cc:237] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:33.595611 24894 log.cc:927] Time spent T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.220s	user 0.000s	sys 0.000s
I20260709 12:10:33.511303 24782 raft_consensus.cc:2749] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:33.483366 24906 raft_consensus.cc:2749] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:33.559939 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:33.580013 22601 raft_consensus.cc:1240] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:33.584913 24915 raft_consensus.cc:2749] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:33.557456 24865 consensus_queue.cc:1048] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:10:33.585647 24889 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:33.598702 22525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 498) took 2352 ms. Trace:
I20260709 12:10:33.599393 22527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 1806) took 2357 ms. Trace:
I20260709 12:10:33.619524 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:33.576653 22421 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:10:33.623167 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 46662us
I20260709 12:10:33.624065 22421 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:33.608729 22453 raft_consensus.cc:2393] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 3: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:33.692725 22453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2071) took 1279 ms. Trace:
I20260709 12:10:33.693055 22453 rpcz_store.cc:276] 0709 12:10:32.413582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.559684 (+1146102us) service_pool.cc:224] Handling call
0709 12:10:33.692668 (+132984us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:33.556612 24903 raft_consensus.cc:3055] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:33.547078 24756 raft_consensus.cc:2804] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:33.694018 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:33.696862 22524 raft_consensus.cc:2468] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
I20260709 12:10:33.697875 22453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2073) took 1283 ms. Trace:
I20260709 12:10:33.698141 22523 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:10:33.698231 22453 rpcz_store.cc:276] 0709 12:10:32.414149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.693745 (+1279596us) service_pool.cc:224] Handling call
0709 12:10:33.697811 (+  4066us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:33.617319 22526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1420) took 2189 ms. Trace:
I20260709 12:10:33.699509 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:33.222625 22598 raft_consensus.cc:2955] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:33.623767 24744 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:33.619074 24875 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:33.568768 24879 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:33.675766 22340 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1ba02be77861491da7dbcfee1161e46c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:33.598587 24698 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:33.677816 24605 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:33.567966 24621 consensus_queue.cc:237] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:33.619982 22525 rpcz_store.cc:276] 0709 12:10:31.246728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.332097 (+1085369us) service_pool.cc:224] Handling call
0709 12:10:32.332416 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:32.332792 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:32.332830 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:32.367801 (+ 34971us) log.cc:844] Serialized 26 byte log entry
0709 12:10:33.061890 (+694089us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:33.061954 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.062050 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:33.598477 (+536427us) raft_consensus.cc:1685] finished
0709 12:10:33.598501 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:33.598640 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21124,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":3157,"thread_start_us":652668,"threads_started":1,"wal-append.queue_time_us":761232}
I20260709 12:10:33.620381 22527 rpcz_store.cc:276] 0709 12:10:31.242103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.242223 (+   120us) service_pool.cc:224] Handling call
0709 12:10:31.628162 (+385939us) spinlock_profiling.cc:243] Waited 4.64 ms on lock 0x7b5800037898. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf907fc0 00007f9ccf8f2929 00007f9ccf8f23d2 00007f9cc8e69bd4
0709 12:10:31.628391 (+   229us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:31.995711 (+367320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:31.995753 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:32.050316 (+ 54563us) log.cc:844] Serialized 26 byte log entry
0709 12:10:32.665446 (+615130us) spinlock_profiling.cc:243] Waited 8.31 ms on lock 0x7b180048a840. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc7823e07 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc7840c02 00007f9cca4c820b 00007f9cca4cdd23 00007f9cca4ce0d1 00007f9cca8e9a0f
0709 12:10:33.066094 (+400648us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:33.066156 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.066256 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:33.599145 (+532889us) raft_consensus.cc:1685] finished
0709 12:10:33.599164 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:33.599326 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":366749,"raft.queue_time_us":410415,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":24138,"spinlock_wait_cycles":29769344,"thread_start_us":400430,"threads_started":1,"wal-append.queue_time_us":1118971}
I20260709 12:10:33.576360 24898 raft_consensus.cc:2749] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:33.605758 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:33.689666 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:33.680001 24675 raft_consensus.cc:3055] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:33.691972 24906 raft_consensus.cc:2804] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:33.699270 22526 rpcz_store.cc:276] 0709 12:10:31.427525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.775252 (+1347727us) service_pool.cc:224] Handling call
0709 12:10:32.775550 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:32.775766 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:33.114048 (+338282us) log.cc:844] Serialized 14 byte log entry
0709 12:10:33.616845 (+502797us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:33.616919 (+    74us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:33.616991 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.617080 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:33.617250 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":175296,"prepare.queue_time_us":361565,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":154676,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":21285,"thread_start_us":579164,"threads_started":2}
W20260709 12:10:33.617980 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 47687.1us
W20260709 12:10:33.701236 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 77276.7us
I20260709 12:10:33.702299 22453 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:33.702600 23088 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:33.708076 22530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1418) took 2332 ms. Trace:
W20260709 12:10:33.680938 24847 consensus_meta.cc:287] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.975s	user 0.012s	sys 0.000s
I20260709 12:10:33.710335 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:33.678953 24713 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:33.711056 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:32.828703 23119 rpcz_store.cc:276] 0709 12:10:31.219504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.280636 (+ 61132us) service_pool.cc:224] Handling call
0709 12:10:31.280902 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:31.281089 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:32.061821 (+780732us) log.cc:844] Serialized 14 byte log entry
0709 12:10:32.802348 (+740527us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:32.802418 (+    70us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:32.802475 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.802561 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:32.802710 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":188442,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":15775,"thread_start_us":1514413,"threads_started":2}
I20260709 12:10:33.837600 24812 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:34.038082 24675 raft_consensus.cc:740] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:33.967586 24890 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:34.086733 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:33.970831 23124 raft_consensus.cc:1275] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:33.716329 24744 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:34.057278 24739 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:33.895118 24918 consensus_queue.cc:1048] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.316s
I20260709 12:10:33.974239 24863 raft_consensus.cc:3055] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:33.608174 23118 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
W20260709 12:10:34.162055 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 459511us
I20260709 12:10:34.082935 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:33.815598 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:34.243371 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.212743 22421 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:34.213601 22456 raft_consensus.cc:2393] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 5: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:34.214644 22451 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:33.959080 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:34.244778 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:34.245322 22452 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1471) took 1833 ms (client timeout 1689 ms). Trace:
I20260709 12:10:34.054540 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:34.246093 22452 rpcz_store.cc:269] 0709 12:10:32.412006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.958694 (+1546688us) service_pool.cc:224] Handling call
0709 12:10:34.245255 (+286561us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:33.712177 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:34.158706 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.041323 22532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 1813) took 2794 ms. Trace:
I20260709 12:10:34.050812 22570 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:33.841185 23123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 862) took 1372 ms. Trace:
I20260709 12:10:33.959525 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:10:34.256111 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 205428us
I20260709 12:10:33.843771 22528 raft_consensus.cc:1240] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:34.256610 22456 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 465) took 2148 ms (client timeout 1990 ms). Trace:
W20260709 12:10:33.866657 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:34.257603 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.255726 23123 rpcz_store.cc:276] 0709 12:10:32.469282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.472169 (+  2887us) service_pool.cc:224] Handling call
0709 12:10:32.472444 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:32.472633 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:32.473146 (+   513us) log.cc:844] Serialized 14 byte log entry
0709 12:10:33.840508 (+1367362us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b18002e8f40. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cca4d64bc 00007f9cc782448b 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc783e455 00007f9cca926060 00007f9cca938716 00007f9cca949287
0709 12:10:33.840646 (+   138us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:33.840721 (+    75us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:33.840792 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.840912 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:33.841103 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68773,"prepare.queue_time_us":2770,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":153592,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"spinlock_wait_cycles":4854528,"thread_start_us":626375,"threads_started":2,"wal-append.queue_time_us":683606}
I20260709 12:10:34.069139 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:33.894829 22497 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:34.054555 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:34.257267 22456 rpcz_store.cc:269] 0709 12:10:32.108449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.335552 (+1227103us) service_pool.cc:224] Handling call
0709 12:10:33.689443 (+353891us) spinlock_profiling.cc:243] Waited 7.92 ms on lock 0x7b5800002a98. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf8f40a0 00007f9ccf8f3984 00007f9cc8e6e6d4 00007f9cc8e6e662
0709 12:10:34.256541 (+567098us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18222976}
I20260709 12:10:33.856411 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:33.798671 22340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 123074us
W20260709 12:10:34.259797 22455 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 473) took 1987 ms (client timeout 1805 ms). Trace:
I20260709 12:10:33.696261 24915 raft_consensus.cc:2749] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:10:33.897617 24867 log.cc:927] Time spent T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.999s	user 0.002s	sys 0.000s
I20260709 12:10:34.213632 23089 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:33.708241 24888 raft_consensus.cc:697] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:33.698727 24561 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.849352 24578 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:34.211643 22530 rpcz_store.cc:276] 0709 12:10:31.376165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.648850 (+1272685us) service_pool.cc:224] Handling call
0709 12:10:32.649110 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:32.649324 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:33.070835 (+421511us) log.cc:844] Serialized 14 byte log entry
0709 12:10:33.707630 (+636795us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:33.707699 (+    69us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:33.707763 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.707845 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:33.707999 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9155,"prepare.queue_time_us":529744,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":14884,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"thread_start_us":954429,"threads_started":3,"wal-append.queue_time_us":637207}
I20260709 12:10:34.267587 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:34.268235 22606 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 6.
I20260709 12:10:34.268318 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:33.846372 23116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 730) took 2689 ms. Trace:
I20260709 12:10:34.268923 22530 raft_consensus.cc:2468] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
W20260709 12:10:34.039081 22420 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:51836 dropped due to backpressure: service queue is full with 50 items
I20260709 12:10:34.247637 22605 raft_consensus.cc:1240] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:34.087256 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:34.248136 22421 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:34.271637 22453 raft_consensus.cc:2410] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:34.249024 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:34.210920 24873 raft_consensus.cc:2804] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:34.238476 24701 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:34.273310 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 59751.9us
I20260709 12:10:34.039966 24797 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:34.009699 24870 log.cc:927] Time spent T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 1.105s	user 0.002s	sys 0.001s
I20260709 12:10:34.251035 22457 raft_consensus.cc:2410] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 12:10:34.256654 22454 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1463) took 1944 ms (client timeout 1727 ms). Trace:
W20260709 12:10:34.279492 22454 rpcz_store.cc:269] 0709 12:10:32.312049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.958542 (+1646493us) service_pool.cc:224] Handling call
0709 12:10:34.256590 (+298048us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:34.279700 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:33.844419 22450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 443) took 2413 ms. Trace:
I20260709 12:10:34.258471 22570 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:10:34.213613 22524 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 6.
I20260709 12:10:34.281275 22524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38310 (request call id 506) took 1089 ms. Trace:
I20260709 12:10:34.280319 22450 rpcz_store.cc:276] 0709 12:10:31.430972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.431220 (+   248us) service_pool.cc:224] Handling call
0709 12:10:32.535996 (+1104776us) spinlock_profiling.cc:243] Waited 878 us on lock 0x7b5800002a98. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf907fc0 00007f9ccf8f2929 00007f9ccf8f23d2 00007f9cc8e69bd4
0709 12:10:32.536168 (+   172us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.095025 (+558857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.844125 (+749100us) spinlock_profiling.cc:243] Waited 555 ms on lock 0x7b5400222c54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:33.844356 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1277468672}
I20260709 12:10:34.281855 22524 rpcz_store.cc:276] 0709 12:10:33.192168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.710059 (+517891us) service_pool.cc:224] Handling call
0709 12:10:34.281148 (+571089us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:34.259497 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 364740us
I20260709 12:10:34.045508 24889 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.260366 22531 raft_consensus.cc:2393] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 6: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
W20260709 12:10:34.260236 22455 rpcz_store.cc:269] 0709 12:10:32.272523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.972165 (+1699642us) service_pool.cc:224] Handling call
0709 12:10:34.259727 (+287562us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":140160}
I20260709 12:10:34.292248 24889 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:34.062556 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:34.293076 24744 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:34.293411 22449 raft_consensus.cc:2468] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 3.
W20260709 12:10:34.293926 22449 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 468) took 2100 ms (client timeout 2014 ms). Trace:
I20260709 12:10:34.264745 24812 raft_consensus.cc:2804] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:34.294471 24812 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:34.294320 22449 rpcz_store.cc:269] 0709 12:10:32.193102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.981523 (+1788421us) service_pool.cc:224] Handling call
0709 12:10:34.062340 (+ 80817us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b5800002a98. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf8f40a0 00007f9ccf8f3984 00007f9cc8e6e6d4 00007f9cc8e6e662
0709 12:10:34.293856 (+231516us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44457344}
I20260709 12:10:34.294925 24812 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:34.295131 22602 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 3.
I20260709 12:10:34.295555 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:34.296746 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:34.297614 22497 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:34.297851 24348 consensus_queue.cc:1059] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:34.298353 24713 raft_consensus.cc:2804] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:34.298730 24713 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.298628 24348 consensus_queue.cc:1059] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:33.849937 24815 raft_consensus.cc:3055] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:34.299182 24713 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:34.299340 24839 consensus_queue.cc:1059] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:10:34.256192 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.299355 24815 raft_consensus.cc:740] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:34.259516 22448 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 4.
I20260709 12:10:34.300976 24815 consensus_queue.cc:260] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:34.301467 22448 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2068) took 1888 ms (client timeout 2144 ms). Trace:
I20260709 12:10:34.301939 24815 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.071890 24827 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:34.301896 22448 rpcz_store.cc:269] 0709 12:10:32.412834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.928304 (+1515470us) service_pool.cc:224] Handling call
0709 12:10:34.068939 (+140635us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b5800002a98. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf8f40a0 00007f9ccf8f3984 00007f9cc8e6e6d4 00007f9cc8e6e662
0709 12:10:34.301405 (+232466us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57195392}
I20260709 12:10:34.261160 22528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1429) took 2362 ms. Trace:
I20260709 12:10:34.262025 22601 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 4.
I20260709 12:10:34.303495 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:34.303251 24889 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:10:34.304263 22457 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 467) took 2134 ms (client timeout 1982 ms). Trace:
I20260709 12:10:34.217618 24906 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.293093 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:34.272897 24887 consensus_queue.cc:1059] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:10:34.262894 22527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1431) took 1610 ms. Trace:
I20260709 12:10:34.255314 22532 rpcz_store.cc:276] 0709 12:10:31.246961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.360666 (+1113705us) service_pool.cc:224] Handling call
0709 12:10:32.361210 (+   544us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:32.361459 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:32.941412 (+579953us) log.cc:844] Serialized 14 byte log entry
0709 12:10:33.978782 (+1037370us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b180033e620. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cca4d64bc 00007f9cc782448b 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc7840c02 00007f9cca4c820b 00007f9cca4cdd23 00007f9cca4ce23a
0709 12:10:34.040957 (+ 62175us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:34.041026 (+    69us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:34.041084 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.041151 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:34.041267 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":751265,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":3421,"raft.queue_time_us":603,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":91,"spinlock_wait_cycles":4039936,"thread_start_us":723386,"threads_started":2,"wal-append.queue_time_us":207917,"wal-append.run_cpu_time_us":1286,"wal-append.run_wall_time_us":1032164}
I20260709 12:10:33.696944 24756 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:34.305960 24918 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.242153 24863 raft_consensus.cc:740] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:34.306175 24756 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.306186 24348 raft_consensus.cc:3055] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:34.307178 24348 raft_consensus.cc:740] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:33.695937 24903 raft_consensus.cc:740] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:34.309423 24903 consensus_queue.cc:260] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:34.310539 24903 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:34.051095 24926 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.265606 22523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 501) took 1098 ms. Trace:
I20260709 12:10:34.304991 24906 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.045243 24333 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.220443 24698 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:34.306211 24922 log.cc:927] Time spent T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:10:34.269479 22420 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:51836 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 469)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1453)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 463)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1475)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1476)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2069)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1473)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2089)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1478)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1480)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2084)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2087)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1477)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1479)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1481)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1482)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1483)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2086)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1485)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2085)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1486)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1484)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2083)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 456)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 458)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 461)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1454)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1455)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1456)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1457)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1459)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1461)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1462)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1464)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1465)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1466)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1467)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1468)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1469)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1470)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2070)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2075)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2077)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2079)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2082)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1474)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2088)
I20260709 12:10:34.272361 22452 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
W20260709 12:10:34.337633 22452 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2067) took 1925 ms (client timeout 2151 ms). Trace:
I20260709 12:10:34.067957 24892 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:34.276836 23088 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:34.275792 22422 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:10:34.340101 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 64386.9us
I20260709 12:10:34.284083 22603 raft_consensus.cc:1240] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:34.284619 24873 raft_consensus.cc:697] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 4 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:34.261165 24890 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:34.285123 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:34.285789 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:34.288009 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:34.288929 22530 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
 from {username='slave'} at 127.0.0.1:39980
W20260709 12:10:34.326196 24845 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.112s	user 0.026s	sys 0.022s
W20260709 12:10:34.363036 22454 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 469) took 2135 ms (client timeout 2378 ms). Trace:
I20260709 12:10:34.363240 22530 raft_consensus.cc:606] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Received request to transfer leadership to TS c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:34.363620 22530 raft_consensus.cc:614] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:34.290277 22421 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:34.291181 24847 raft_consensus.cc:2804] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:34.261094 24927 raft_consensus.cc:2749] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:34.306481 24918 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:33.708801 24751 raft_consensus.cc:697] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 6 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
W20260709 12:10:34.304744 22457 rpcz_store.cc:269] 0709 12:10:32.170042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.956306 (+1786264us) service_pool.cc:224] Handling call
0709 12:10:34.304183 (+347877us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:34.310846 24713 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:34.302769 24812 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:34.305444 22455 raft_consensus.cc:2410] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:10:34.313091 22497 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:34.303298 22528 rpcz_store.cc:276] 0709 12:10:31.898842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.843101 (+1944259us) service_pool.cc:224] Handling call
0709 12:10:33.843521 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.256815 (+413294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.261101 (+  4286us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:34.379041 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:34.379684 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 64299.3us
I20260709 12:10:34.380275 22457 raft_consensus.cc:2393] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 4: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:34.319061 22456 raft_consensus.cc:2393] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 4: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:34.380693 22457 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1473) took 1001 ms. Trace:
W20260709 12:10:34.380786 22456 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2076) took 1938 ms (client timeout 2137 ms). Trace:
I20260709 12:10:34.381021 22457 rpcz_store.cc:276] 0709 12:10:33.379800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.378739 (+998939us) service_pool.cc:224] Handling call
0709 12:10:34.380641 (+  1902us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:34.381146 22456 rpcz_store.cc:269] 0709 12:10:32.442159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.260076 (+1817917us) service_pool.cc:224] Handling call
0709 12:10:34.380735 (+120659us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:34.305513 22527 rpcz_store.cc:276] 0709 12:10:32.652797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.237487 (+1584690us) service_pool.cc:224] Handling call
0709 12:10:34.262434 (+ 24947us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.262607 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:34.262630 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:34.262669 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:34.262699 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.262748 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:34.262836 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:34.318004 22523 rpcz_store.cc:276] 0709 12:10:33.167629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.240768 (+1073139us) service_pool.cc:224] Handling call
0709 12:10:34.265142 (+ 24374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.265314 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:34.265341 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:34.265377 (+    36us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:34.265410 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.265459 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:34.265557 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:34.381920 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:34.383270 22457 raft_consensus.cc:2393] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 5: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:34.311347 24701 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:34.321776 23089 connection.cc:256] RPC call timeout handler was delayed by -2.8090910890000487s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.199s for a response
I20260709 12:10:34.323185 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:34.044179 24875 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:34.235827 24868 consensus_queue.cc:1048] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:10:34.316766 22449 raft_consensus.cc:2376] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5. Re-sending same reply.
I20260709 12:10:34.400050 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:34.275104 24898 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.407449 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:34.338117 22452 rpcz_store.cc:269] 0709 12:10:32.412562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.248799 (+1836237us) service_pool.cc:224] Handling call
0709 12:10:34.337557 (+ 88758us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:34.408224 22457 raft_consensus.cc:2393] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 5: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:34.396510 24925 consensus_queue.cc:1048] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:10:34.408435 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:34.408969 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:34.305418 24887 consensus_queue.cc:1243] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer 6c6fa11e8ee34711b3551f0c670442bc log is divergent from this leader: its last log entry 7.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:10:34.304728 24889 raft_consensus.cc:3055] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:34.325178 24915 raft_consensus.cc:2804] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:34.358340 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 81586.1us
W20260709 12:10:34.360430 22450 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1453) took 2348 ms (client timeout 2611 ms). Trace:
W20260709 12:10:34.363427 22454 rpcz_store.cc:269] 0709 12:10:32.227379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.284821 (+2057442us) service_pool.cc:224] Handling call
0709 12:10:34.362963 (+ 78142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:34.291643 22524 raft_consensus.cc:1275] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:34.328641 24926 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:34.328524 24739 consensus_queue.cc:1048] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:10:34.276466 24561 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:34.367486 24845 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.161s	user 0.026s	sys 0.022s
I20260709 12:10:33.940832 24843 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:34.388062 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:34.369977 24933 consensus_queue.cc:1059] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:10:34.357627 24923 raft_consensus.cc:2804] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:34.392316 23123 raft_consensus.cc:1275] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:34.471856 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:34.472807 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:34.392552 23124 raft_consensus.cc:1240] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:34.393537 23120 raft_consensus.cc:1275] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:34.393893 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:34.394181 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:10:34.395349 22455 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 463) took 2364 ms (client timeout 2848 ms). Trace:
W20260709 12:10:34.475227 22455 rpcz_store.cc:269] 0709 12:10:32.031106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.292853 (+2261747us) service_pool.cc:224] Handling call
0709 12:10:34.395289 (+102436us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:34.395732 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:34.395370 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:34.371918 24744 raft_consensus.cc:2804] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:34.397935 23119 raft_consensus.cc:1275] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:34.398186 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:34.273206 24675 consensus_queue.cc:260] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:34.370561 24847 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.275864 23116 rpcz_store.cc:276] 0709 12:10:31.157406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.279598 (+122192us) service_pool.cc:224] Handling call
0709 12:10:31.279888 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.155174 (+1875286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.846054 (+690880us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b5400284bd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:33.846284 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4164595584}
I20260709 12:10:34.409044 22452 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 6.
W20260709 12:10:34.274226 22453 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2078) took 1757 ms (client timeout 1994 ms). Trace:
I20260709 12:10:34.308121 24348 consensus_queue.cc:260] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:34.334858 24333 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:34.311970 24863 consensus_queue.cc:260] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:34.410874 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:34.412977 22495 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:34.415982 22604 raft_consensus.cc:2410] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:10:34.418944 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 84352.1us
I20260709 12:10:34.456609 23088 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:34.554934 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:34.555438 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 98944us
W20260709 12:10:34.419030 22450 rpcz_store.cc:269] 0709 12:10:32.011825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.282422 (+2270597us) service_pool.cc:224] Handling call
0709 12:10:34.360352 (+ 77930us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:34.379002 24890 consensus_queue.cc:1059] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.037s
W20260709 12:10:34.388713 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 73185.4us
I20260709 12:10:34.460175 24887 raft_consensus.cc:2749] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:34.477689 24744 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.483685 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:34.416827 24889 raft_consensus.cc:740] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:34.579787 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:34.486166 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:34.580569 23119 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.581760 22529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1436) took 1194 ms. Trace:
I20260709 12:10:34.487320 22599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2216) took 1261 ms. Trace:
I20260709 12:10:34.582129 22529 rpcz_store.cc:276] 0709 12:10:33.387532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.281023 (+893491us) service_pool.cc:224] Handling call
0709 12:10:34.332846 (+ 51823us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.332992 (+   146us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:34.465660 (+132668us) log.cc:844] Serialized 14 byte log entry
0709 12:10:34.581445 (+115785us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:34.581494 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:34.581538 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.581598 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:34.581707 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33024,"prepare.queue_time_us":124713,"prepare.run_cpu_time_us":7851,"prepare.run_wall_time_us":61452,"thread_start_us":189723,"threads_started":2}
I20260709 12:10:34.553277 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:34.583632 22597 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
W20260709 12:10:34.584040 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 171110us
I20260709 12:10:34.583127 22599 rpcz_store.cc:276] 0709 12:10:33.225793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.226767 (+   974us) service_pool.cc:224] Handling call
0709 12:10:33.227232 (+   465us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:33.227683 (+   451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:33.227717 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:33.248532 (+ 20815us) log.cc:844] Serialized 52 byte log entry
0709 12:10:33.560464 (+311932us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:33.560504 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.560568 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:34.487054 (+926486us) raft_consensus.cc:1685] finished
0709 12:10:34.487084 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:34.487247 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18474,"raft.queue_time_us":20321,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":48839,"thread_start_us":108457,"threads_started":1,"wal-append.queue_time_us":669076}
I20260709 12:10:34.415683 22449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1476) took 1029 ms. Trace:
I20260709 12:10:34.585346 24875 consensus_queue.cc:1048] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:34.585521 22449 rpcz_store.cc:276] 0709 12:10:33.380616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.296504 (+915888us) service_pool.cc:224] Handling call
0709 12:10:34.409700 (+113196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:34.585832 22495 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:34.586565 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:34.453317 24915 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:34.587471 23119 raft_consensus.cc:2410] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:10:34.587632 24915 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:34.490413 22453 rpcz_store.cc:269] 0709 12:10:32.516685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.699200 (+1182515us) service_pool.cc:224] Handling call
0709 12:10:34.274182 (+574982us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:34.587824 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:34.588456 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:34.589171 22453 raft_consensus.cc:2393] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 4: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:34.589902 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:34.545863 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:34.591248 22452 raft_consensus.cc:2376] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5. Re-sending same reply.
I20260709 12:10:34.465464 24848 raft_consensus.cc:2804] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:34.559602 22569 leader_election.cc:336] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.581s (SENT)
W20260709 12:10:34.565688 23087 leader_election.cc:336] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.698s (SENT)
I20260709 12:10:34.599359 23087 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:34.569825 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:34.363811 24892 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:34.477672 24923 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.485431 24827 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.575379 22606 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.491145 24847 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.576730 24863 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:34.577066 23116 raft_consensus.cc:1275] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:34.573525 24898 raft_consensus.cc:2804] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:34.577786 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:34.488336 24873 consensus_queue.cc:237] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:34.578375 24744 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.578485 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:34.489846 24720 consensus_queue.cc:1059] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 12:10:34.579173 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:34.453086 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:34.643566 24812 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:34.644227 24812 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.588671 22450 raft_consensus.cc:2410] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:10:34.644991 22450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1485) took 1019 ms. Trace:
I20260709 12:10:34.645499 22450 rpcz_store.cc:276] 0709 12:10:33.625777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.556711 (+930934us) service_pool.cc:224] Handling call
0709 12:10:34.644912 (+ 88201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49664}
I20260709 12:10:34.591786 22452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1483) took 1009 ms. Trace:
I20260709 12:10:34.619232 24906 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:34.647158 22452 rpcz_store.cc:276] 0709 12:10:33.581824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.490220 (+908396us) service_pool.cc:224] Handling call
0709 12:10:34.591723 (+101503us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:34.648396 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:34.648644 24675 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.649207 24906 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:34.548727 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:34.590901 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:34.379774 24888 consensus_queue.cc:237] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:34.592231 22454 raft_consensus.cc:2393] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 4: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:34.585373 22599 raft_consensus.cc:1240] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 5. Current term is 6. Ops: [3.6-5.7]
I20260709 12:10:34.651154 24713 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:34.651773 24713 consensus_queue.cc:1048] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:34.614710 24898 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.617475 24797 raft_consensus.cc:2749] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.652832 24898 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:34.605290 24923 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:34.594046 22598 consensus_meta.cc:287] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.695s	user 0.009s	sys 0.000s
W20260709 12:10:34.595445 23089 leader_election.cc:336] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Timed out: RequestConsensusVote RPC to 127.20.196.131:37785 timed out after 1.990s (SENT)
I20260709 12:10:34.654162 23089 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:34.602509 22605 raft_consensus.cc:1240] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:34.651990 22454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1481) took 1070 ms. Trace:
I20260709 12:10:34.655356 22454 rpcz_store.cc:276] 0709 12:10:33.581469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.419276 (+837807us) service_pool.cc:224] Handling call
0709 12:10:34.651818 (+232542us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b540019fd54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:34.651939 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":274140416}
W20260709 12:10:34.633903 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.587867 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:10:34.606735 24900 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.914s	user 0.000s	sys 0.002s
I20260709 12:10:34.603894 24875 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.650905 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:34.597756 24848 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.656061 23120 raft_consensus.cc:2393] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 4: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
W20260709 12:10:34.656329 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.646837 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:34.604377 24872 raft_consensus.cc:2749] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:34.593142 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:34.649155 22452 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:34.674446 22606 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 6.
I20260709 12:10:34.634816 24845 raft_consensus.cc:3055] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:34.679628 22450 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 5.
I20260709 12:10:34.687930 22450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2083) took 1701 ms. Trace:
W20260709 12:10:34.664229 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 68825.7us
I20260709 12:10:34.684048 22454 raft_consensus.cc:1240] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:34.688395 22450 rpcz_store.cc:276] 0709 12:10:32.986960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.646470 (+1659510us) service_pool.cc:224] Handling call
0709 12:10:34.687863 (+ 41393us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:34.663617 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 108656us
I20260709 12:10:34.689049 22454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 456) took 3210 ms. Trace:
I20260709 12:10:34.689360 22454 rpcz_store.cc:276] 0709 12:10:31.478845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.663291 (+3184446us) service_pool.cc:224] Handling call
0709 12:10:34.683888 (+ 20597us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.688807 (+  4919us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.688998 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:34.690263 22570 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:34.686498 22453 raft_consensus.cc:1240] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:34.638230 24782 raft_consensus.cc:3055] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:34.662135 24605 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:34.694718 22570 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:34.663441 24900 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.971s	user 0.000s	sys 0.003s
W20260709 12:10:34.695492 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.651784 24879 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:34.699220 24929 log.cc:927] Time spent T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 12:10:34.697219 22453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 458) took 3008 ms. Trace:
I20260709 12:10:34.699710 22453 rpcz_store.cc:276] 0709 12:10:31.683537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.685914 (+3002377us) service_pool.cc:224] Handling call
0709 12:10:34.686267 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.691370 (+  5103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.691593 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:34.566043 24751 consensus_queue.cc:237] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:34.698362 24756 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:34.701149 22600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43070 (request call id 362) took 3351 ms (client timeout 1990 ms). Trace:
I20260709 12:10:34.702803 22570 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
W20260709 12:10:34.703660 24938 log.cc:927] Time spent T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:10:34.687536 24845 raft_consensus.cc:740] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:34.677403 24875 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:34.744812 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:34.746101 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.694968 24782 raft_consensus.cc:740] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:34.707427 24940 raft_consensus.cc:2749] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:34.667261 22449 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.611097 24827 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:34.677788 24739 raft_consensus.cc:2749] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.680297 24848 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:34.712857 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 115839us
I20260709 12:10:34.804374 22496 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
W20260709 12:10:34.714049 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.803112 24605 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:34.715566 22600 rpcz_store.cc:269] 0709 12:10:31.349717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.363930 (+ 14213us) service_pool.cc:224] Handling call
0709 12:10:34.700885 (+3336955us) spinlock_profiling.cc:243] Waited 2.2 s on lock 0x7b54002de454. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:34.701047 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5056835968}
I20260709 12:10:34.716102 22450 raft_consensus.cc:1240] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:34.807518 24956 raft_consensus.cc:2749] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.809266 23117 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 3.
I20260709 12:10:34.727854 22454 raft_consensus.cc:1240] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:34.614822 24944 consensus_queue.cc:1048] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.108s
W20260709 12:10:34.703940 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.829003 23119 raft_consensus.cc:2410] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:34.698271 24890 raft_consensus.cc:2804] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:34.753461 22451 consensus_meta.cc:287] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.509s	user 0.010s	sys 0.000s
W20260709 12:10:34.757921 23087 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.925s (SENT) [suppressed 47 similar messages]
W20260709 12:10:34.830608 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 72709.3us
I20260709 12:10:34.755638 24906 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.759374 24918 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:34.814306 22454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1455) took 2801 ms. Trace:
I20260709 12:10:34.859637 22454 rpcz_store.cc:276] 0709 12:10:32.012483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.695415 (+2682932us) service_pool.cc:224] Handling call
0709 12:10:34.715105 (+ 19690us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.814009 (+ 98904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.814236 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:34.806764 22450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1454) took 2794 ms. Trace:
I20260709 12:10:34.860595 22450 rpcz_store.cc:276] 0709 12:10:32.012190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.694266 (+2682076us) service_pool.cc:224] Handling call
0709 12:10:34.715932 (+ 21666us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.806492 (+ 90560us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.806703 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:34.824502 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 511451us
I20260709 12:10:34.837960 22451 raft_consensus.cc:2410] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:10:34.802445 22457 raft_consensus.cc:2393] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 5: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
W20260709 12:10:34.921262 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 116998us
W20260709 12:10:34.870838 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.878783 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:34.878922 24845 consensus_queue.cc:260] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:34.924600 22450 raft_consensus.cc:2393] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 3: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:34.924885 24845 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:34.877151 22606 raft_consensus.cc:1240] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:10:34.925454 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:10:34.923488 22451 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2072) took 2509 ms (client timeout 2020 ms). Trace:
I20260709 12:10:34.926259 22450 raft_consensus.cc:2410] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:10:34.926416 22451 rpcz_store.cc:269] 0709 12:10:32.413855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.569012 (+1155157us) service_pool.cc:224] Handling call
0709 12:10:34.923394 (+1354382us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:34.921463 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 177990us
I20260709 12:10:34.928088 22570 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:34.810019 24927 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.928524 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:34.930176 22496 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:34.827976 24605 raft_consensus.cc:697] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:34.932317 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:34.939631 22451 raft_consensus.cc:2410] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:10:34.946561 22496 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
W20260709 12:10:34.929900 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 639655us
I20260709 12:10:34.941673 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:34.950919 22421 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:10:34.956110 22572 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.033s	sys 0.040s
W20260709 12:10:34.970564 22572 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.033s	sys 0.040s
I20260709 12:10:34.970315 22421 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:34.953886 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:34.971853 22450 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 4.
I20260709 12:10:34.917500 24701 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:34.931676 24812 raft_consensus.cc:2749] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.927564 24956 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:34.976312 22421 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:34.977053 24953 raft_consensus.cc:2804] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:34.975703 24720 raft_consensus.cc:2749] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:34.984018 24955 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.984259 22529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:39980
I20260709 12:10:35.044158 22529 raft_consensus.cc:606] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 LEADER]: Received request to transfer leadership to TS 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:34.985038 24958 consensus_queue.cc:1059] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:34.942209 24333 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:34.988256 24915 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:35.053875 24915 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:34.991422 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:34.991276 24605 consensus_queue.cc:237] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:35.020090 24744 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:35.056882 24744 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:34.961156 24797 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:35.057693 23123 raft_consensus.cc:2393] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 5: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:35.019915 24868 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:35.058135 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:10:35.058430 24868 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:35.059885 24958 raft_consensus.cc:3055] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:35.060118 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:35.060359 24958 raft_consensus.cc:740] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:35.061273 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:34.943457 24782 consensus_queue.cc:260] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:34.960426 24952 consensus_queue.cc:1059] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:10:35.062348 24952 consensus_queue.cc:1243] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer 6c6fa11e8ee34711b3551f0c670442bc log is divergent from this leader: its last log entry 7.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:10:34.949970 24941 consensus_queue.cc:1048] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
W20260709 12:10:34.998579 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.062855 22449 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:34.966483 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:35.063911 22452 raft_consensus.cc:1240] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:34.993501 24756 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:34.950186 24739 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:35.020018 22448 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 6.
I20260709 12:10:35.021438 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:35.023864 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:35.032477 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 56286.3us
I20260709 12:10:35.069092 22421 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:10:34.992591 24815 consensus_meta.cc:287] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.690s	user 0.011s	sys 0.000s
W20260709 12:10:34.993616 24954 log.cc:927] Time spent T 00000000000000000000000000000000 P 136fd3da76544029a815aef59e698e17: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
W20260709 12:10:34.983513 24948 log.cc:927] Time spent T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
W20260709 12:10:34.994086 24949 log.cc:927] Time spent T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 12:10:34.878051 24906 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:35.042575 24924 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:34.996742 24843 raft_consensus.cc:3055] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:34.994288 24875 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:35.048650 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:10:35.049283 24698 consensus_meta.cc:287] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.683s	user 0.009s	sys 0.000s
I20260709 12:10:35.063830 22451 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 2.
I20260709 12:10:34.942247 24621 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:35.015362 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 67587.2us
W20260709 12:10:35.071444 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 102189us
W20260709 12:10:35.076089 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.063534 22449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1484) took 1452 ms. Trace:
I20260709 12:10:34.993778 24944 consensus_queue.cc:1048] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:10:35.077637 23120 raft_consensus.cc:1240] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:35.077672 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:35.087396 22456 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:35.110648 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:35.109823 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:35.046514 24953 raft_consensus.cc:697] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 5 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:34.952152 24927 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:35.112661 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:10:35.118043 22421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.077382 24675 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:35.125905 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:35.119736 24951 log.cc:927] Time spent T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 12:10:35.107923 24890 raft_consensus.cc:697] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:35.112490 24965 raft_consensus.cc:2749] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:35.112380 24843 raft_consensus.cc:740] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:35.163578 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:35.164346 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:35.161473 22450 raft_consensus.cc:2468] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 4.
I20260709 12:10:35.173890 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:35.181206 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:35.182687 22599 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:35.120601 24815 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.183677 22524 raft_consensus.cc:2393] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 4: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:35.183763 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:35.184125 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:35.184892 22530 raft_consensus.cc:2468] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 4.
I20260709 12:10:35.185257 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:35.184916 22523 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 5: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:35.186041 22451 raft_consensus.cc:2393] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 4: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:35.187673 22531 raft_consensus.cc:1240] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 LEADER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:35.078580 24739 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:35.191687 22570 leader_election.cc:304] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
W20260709 12:10:35.171434 24903 consensus_meta.cc:287] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.860s	user 0.020s	sys 0.000s
I20260709 12:10:35.128252 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:35.198765 22570 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:35.198884 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:35.143072 22569 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:35.189694 23124 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:35.131102 23089 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:10:35.200769 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 69869.7us
I20260709 12:10:35.161121 24675 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:35.194936 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:10:35.195242 23087 leader_election.cc:336] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.982s (SENT)
I20260709 12:10:35.128856 22449 rpcz_store.cc:276] 0709 12:10:33.618437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.587511 (+969074us) service_pool.cc:224] Handling call
0709 12:10:35.063467 (+475956us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36736}
W20260709 12:10:35.172016 24847 consensus_meta.cc:287] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.534s	user 0.007s	sys 0.003s
I20260709 12:10:35.171623 24797 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.201368 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:35.209059 22532 raft_consensus.cc:2393] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 5: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:35.172549 24941 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:35.160478 24961 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:35.204027 23087 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:35.046283 24956 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:35.199944 22570 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:35.160653 24868 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:35.206012 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:35.160120 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:35.206434 22453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1456) took 3193 ms. Trace:
I20260709 12:10:35.128062 24698 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:35.061286 24958 consensus_queue.cc:260] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:35.212425 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:35.213809 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:35.129940 24875 consensus_queue.cc:1059] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:10:35.218256 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:35.131466 24621 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:35.171883 24848 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:35.212038 22525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 510) took 1532 ms. Trace:
I20260709 12:10:35.204984 24701 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:35.204998 24675 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:35.237845 22523 raft_consensus.cc:2393] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 4: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:35.197805 24815 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:35.221161 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 78145.8us
I20260709 12:10:35.241434 22525 rpcz_store.cc:276] 0709 12:10:33.680009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.327866 (+647857us) service_pool.cc:224] Handling call
0709 12:10:34.339782 (+ 11916us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:34.388593 (+ 48811us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:34.388623 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:34.389280 (+   657us) log.cc:844] Serialized 52 byte log entry
0709 12:10:34.603013 (+213733us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:34.603052 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.603118 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:35.211740 (+608622us) raft_consensus.cc:1685] finished
0709 12:10:35.211769 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:35.211962 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1644,"raft.queue_time_us":69731,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":61729,"thread_start_us":198166,"threads_started":2,"wal-append.queue_time_us":276768}
I20260709 12:10:35.202993 24924 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:35.204500 24744 raft_consensus.cc:2804] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:35.205304 24887 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:35.202536 24605 raft_consensus.cc:2804] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:35.343693 24605 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:35.343556 24887 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:35.344141 24605 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:35.344282 22598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2205) took 2361 ms. Trace:
I20260709 12:10:35.344651 22598 rpcz_store.cc:276] 0709 12:10:32.983115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.985916 (+  2801us) service_pool.cc:224] Handling call
0709 12:10:33.072585 (+ 86669us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.214792 (+142207us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:34.653715 (+1438923us) log.cc:844] Serialized 14 byte log entry
0709 12:10:34.847943 (+194228us) log.cc:844] Serialized 14 byte log entry
0709 12:10:34.859242 (+ 11299us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:34.859318 (+    76us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:34.859390 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.344047 (+484657us) spinlock_profiling.cc:243] Waited 96.8 ms on lock 0x7b54003aedd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:35.344087 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:35.344204 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14437,"prepare.queue_time_us":37357,"prepare.run_wall_time_us":38,"raft.queue_time_us":256452,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":17812,"spinlock_wait_cycles":270470912,"thread_start_us":140011,"threads_started":1,"wal-append.queue_time_us":320938}
I20260709 12:10:35.345844 24887 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:35.346429 24739 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:35.254437 23124 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5.
I20260709 12:10:35.347680 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:35.348258 23124 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5.
I20260709 12:10:35.349036 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:35.237845 22532 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:35.350026 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:35.226642 24903 raft_consensus.cc:2749] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:35.226783 24873 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.255825 23121 raft_consensus.cc:2393] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 5: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:35.228462 24863 raft_consensus.cc:2749] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:35.231791 22570 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:35.385814 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 45809.6us
W20260709 12:10:35.386561 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 154883us
I20260709 12:10:35.237282 23116 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:35.233803 24967 raft_consensus.cc:2804] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:35.387409 24967 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:35.387939 24967 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:35.389194 24903 raft_consensus.cc:2804] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:35.389748 24903 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:35.390200 24903 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:35.302786 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:35.393198 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:35.393672 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:35.394312 23124 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
I20260709 12:10:35.396437 22451 raft_consensus.cc:1240] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:35.397135 22451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1457) took 3384 ms. Trace:
I20260709 12:10:35.397708 24926 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:35.400309 23087 leader_election.cc:336] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 2.203s (SENT)
I20260709 12:10:35.400746 23087 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:35.400944 22602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2223) took 1103 ms. Trace:
W20260709 12:10:35.401841 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.401283 22602 rpcz_store.cc:276] 0709 12:10:34.297897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.313531 (+ 15634us) service_pool.cc:224] Handling call
0709 12:10:34.340276 (+ 26745us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:34.544893 (+204617us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:34.544939 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:34.552960 (+  8021us) log.cc:844] Serialized 52 byte log entry
0709 12:10:34.850330 (+297370us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:34.850387 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.400531 (+550144us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b5400043154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:35.400577 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:35.400623 (+    46us) raft_consensus.cc:1685] finished
0709 12:10:35.400636 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:35.400857 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80905,"raft.queue_time_us":82098,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":14232,"spinlock_wait_cycles":336770944,"thread_start_us":296935,"threads_started":1,"wal-append.queue_time_us":502743}
I20260709 12:10:35.405025 22449 raft_consensus.cc:1240] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:35.405328 22570 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:35.405687 22449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1459) took 3388 ms. Trace:
I20260709 12:10:35.409051 24926 raft_consensus.cc:2804] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:35.397434 22451 rpcz_store.cc:276] 0709 12:10:32.013047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.395945 (+3382898us) service_pool.cc:224] Handling call
0709 12:10:35.396256 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:35.396844 (+   588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.397046 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:35.410374 24927 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:35.410885 22451 raft_consensus.cc:1240] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:35.411507 22451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1461) took 3220 ms. Trace:
I20260709 12:10:35.411671 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:35.411834 22451 rpcz_store.cc:276] 0709 12:10:32.191271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.410386 (+3219115us) service_pool.cc:224] Handling call
0709 12:10:35.410723 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:35.411277 (+   554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.411455 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:35.412760 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:35.409466 24926 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:10:35.416285 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.277307 22569 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:35.242825 24578 raft_consensus.cc:3055] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:35.233764 24839 consensus_queue.cc:1048] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:10:35.311633 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:10:35.266893 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:35.419319 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 142080us
I20260709 12:10:35.419608 22524 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:35.419853 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.218283 24847 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:35.295392 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:35.421693 22525 raft_consensus.cc:2368] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 4. Current term is 5.
W20260709 12:10:35.251770 24898 consensus_meta.cc:287] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.598s	user 0.011s	sys 0.000s
I20260709 12:10:35.308028 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:10:35.311383 24957 log.cc:927] Time spent T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:10:35.223804 24959 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.268652 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:35.301220 24875 raft_consensus.cc:3055] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:35.240620 24843 consensus_queue.cc:260] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:35.231324 24961 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:35.301524 24958 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:35.222687 24797 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:35.280077 22526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1430) took 2627 ms. Trace:
I20260709 12:10:35.224972 24941 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:35.235561 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:35.336930 24924 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:35.337736 24698 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:35.339036 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:35.340329 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:35.292248 22603 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
I20260709 12:10:35.354753 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:35.439224 23122 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5.
I20260709 12:10:35.439478 22454 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 4.
I20260709 12:10:35.352553 24906 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:35.351274 24873 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:35.336231 24923 consensus_meta.cc:287] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.683s	user 0.011s	sys 0.000s
I20260709 12:10:35.312783 24956 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:35.375177 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.451303 22523 raft_consensus.cc:1275] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:35.294001 24953 consensus_queue.cc:237] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:35.384039 24975 log.cc:927] Time spent T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.098s	user 0.003s	sys 0.000s
I20260709 12:10:35.453610 24815 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:35.280176 24890 consensus_queue.cc:237] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:35.352332 22527 raft_consensus.cc:2468] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5.
I20260709 12:10:35.454797 22603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43070 (request call id 376) took 1125 ms. Trace:
I20260709 12:10:35.259222 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:35.455430 22527 raft_consensus.cc:1240] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:35.455746 22450 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 3.
I20260709 12:10:35.456537 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:35.457597 22570 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:10:35.420040 22569 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:35.420624 22421 connection.cc:256] RPC call timeout handler was delayed by -2.7782847949999905s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15000000000000002s for a response
I20260709 12:10:35.420528 22599 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 4.
I20260709 12:10:35.424364 22525 raft_consensus.cc:1240] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:35.459273 22421 connection.cc:256] RPC call timeout handler was delayed by -2.6927847949998522s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1595s for a response
W20260709 12:10:35.459630 22421 connection.cc:256] RPC call timeout handler was delayed by -2.4992847949999941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18100000000000002s for a response
I20260709 12:10:35.413365 24926 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:35.459892 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:35.460695 22599 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 4.
I20260709 12:10:35.460944 22525 raft_consensus.cc:1240] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 12:10:35.462204 22599 raft_consensus.cc:1240] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:35.462507 22525 raft_consensus.cc:1240] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:35.459889 22421 connection.cc:256] RPC call timeout handler was delayed by -2.4929847949999839s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1817s for a response
I20260709 12:10:35.464015 22525 raft_consensus.cc:1240] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:35.464264 22421 connection.cc:256] RPC call timeout handler was delayed by -2.3948847949998253s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1926s for a response
W20260709 12:10:35.464708 22421 connection.cc:256] RPC call timeout handler was delayed by -2.3129847949999203s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2017s for a response
W20260709 12:10:35.465059 22421 connection.cc:256] RPC call timeout handler was delayed by -2.2958847949998926s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2036s for a response
I20260709 12:10:35.425578 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:35.406049 22449 rpcz_store.cc:276] 0709 12:10:32.017229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.404520 (+3387291us) service_pool.cc:224] Handling call
0709 12:10:35.404829 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:35.405454 (+   625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.405638 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:35.429070 22524 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 4.
I20260709 12:10:35.385419 24744 raft_consensus.cc:697] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 6 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:35.418278 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:35.419355 24943 raft_consensus.cc:2749] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:35.420056 24578 raft_consensus.cc:740] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:35.434201 22526 rpcz_store.cc:276] 0709 12:10:32.652418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.237864 (+1585446us) service_pool.cc:224] Handling call
0709 12:10:34.238124 (+   260us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:34.238779 (+   655us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:34.238806 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:34.239291 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 12:10:34.757554 (+518263us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:34.757612 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.757685 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:35.279868 (+522183us) raft_consensus.cc:1685] finished
0709 12:10:35.279886 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:35.280017 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":273,"raft.queue_time_us":386,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":97,"thread_start_us":474032,"threads_started":1,"wal-append.queue_time_us":669615}
I20260709 12:10:35.423401 24887 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.425014 24875 raft_consensus.cc:740] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:35.427943 24739 raft_consensus.cc:2749] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:35.444159 24847 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:35.444432 24797 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:35.445837 24561 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:35.446751 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:35.431257 24959 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:35.447042 24675 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:35.447508 24941 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:35.438591 24843 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:35.441658 24863 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.483166 23118 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 3.
I20260709 12:10:35.449136 24955 raft_consensus.cc:2749] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:35.427697 24898 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:35.441658 22600 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 5.
W20260709 12:10:35.465415 22421 connection.cc:256] RPC call timeout handler was delayed by -1.4633847949999108s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2961s for a response
I20260709 12:10:35.466697 22599 raft_consensus.cc:1240] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:35.511516 24845 raft_consensus.cc:2804] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:35.512171 24924 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:35.463515 22422 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:35.455154 22603 rpcz_store.cc:276] 0709 12:10:34.329354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.370293 (+ 40939us) service_pool.cc:224] Handling call
0709 12:10:35.454671 (+1084378us) spinlock_profiling.cc:243] Waited 727 ms on lock 0x7b5400448c54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:35.454751 (+    80us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1671632640}
W20260709 12:10:35.513013 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 49580.5us
I20260709 12:10:35.513425 24845 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:35.514050 24845 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:35.472424 22527 raft_consensus.cc:1240] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:35.514792 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:35.514890 24953 raft_consensus.cc:2804] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:35.470561 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 50580.2us
I20260709 12:10:35.515409 24953 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:35.515779 24953 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:35.515995 22569 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:35.517117 22569 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:35.477007 22598 raft_consensus.cc:1240] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:35.473071 24839 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:35.483455 22570 leader_election.cc:400] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 4. Current term is 5.
I20260709 12:10:35.518256 22570 leader_election.cc:403] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:10:35.441560 24621 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:35.447358 24982 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:35.526336 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 67249.8us
I20260709 12:10:35.493177 24744 consensus_queue.cc:237] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:35.504675 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:10:35.505626 22448 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2069) took 3092 ms (client timeout 2597 ms). Trace:
W20260709 12:10:35.528105 22448 rpcz_store.cc:269] 0709 12:10:32.413089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.303223 (+1890134us) service_pool.cc:224] Handling call
0709 12:10:35.505425 (+1202202us) spinlock_profiling.cc:243] Waited 716 ms on lock 0x7b54004051d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:35.505546 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1646291328}
I20260709 12:10:35.529414 22448 raft_consensus.cc:1240] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:35.507449 24863 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:35.511529 22421 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:35.531375 22421 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:35.532711 22421 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:35.533502 22448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1467) took 3119 ms. Trace:
I20260709 12:10:35.491959 24848 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:35.533892 22448 rpcz_store.cc:276] 0709 12:10:32.410896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.528952 (+3118056us) service_pool.cc:224] Handling call
0709 12:10:35.529240 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:35.529717 (+   477us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.529827 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:35.538969 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.539539 22448 raft_consensus.cc:1240] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 5 LEADER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:35.540020 22448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1468) took 3128 ms. Trace:
I20260709 12:10:35.540220 22448 rpcz_store.cc:276] 0709 12:10:32.411209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.538945 (+3127736us) service_pool.cc:224] Handling call
0709 12:10:35.539382 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:35.539837 (+   455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.539981 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:35.541178 22448 raft_consensus.cc:1275] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:35.541584 22448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1469) took 3130 ms. Trace:
I20260709 12:10:35.541853 22448 rpcz_store.cc:276] 0709 12:10:32.411464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.540793 (+3129329us) service_pool.cc:224] Handling call
0709 12:10:35.540988 (+   195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:35.541414 (+   426us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.541548 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:35.474457 22454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1464) took 3118 ms. Trace:
I20260709 12:10:35.521036 22598 raft_consensus.cc:1275] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:35.519797 22604 raft_consensus.cc:1240] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:35.486730 24698 consensus_queue.cc:1059] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:10:35.451268 24923 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:35.536561 22421 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:35.542691 22454 rpcz_store.cc:276] 0709 12:10:32.355685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.440133 (+3084448us) service_pool.cc:224] Handling call
0709 12:10:35.474143 (+ 34010us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:35.474261 (+   118us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:35.474275 (+    14us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:35.474300 (+    25us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:35.474323 (+    23us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.474353 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:35.474415 (+    62us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:35.545877 22604 raft_consensus.cc:1240] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 12:10:35.536863 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 52608.9us
I20260709 12:10:35.549392 22421 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:35.492586 24868 consensus_queue.cc:1059] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:10:35.551355 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:35.525676 24943 raft_consensus.cc:2764] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:10:35.487102 24887 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:35.560801 22569 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:10:35.563107 24943 consensus_queue.cc:1059] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:35.534307 24971 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:35.565433 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:35.572054 22455 raft_consensus.cc:2368] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 6. Current term is 7.
I20260709 12:10:35.538300 24952 raft_consensus.cc:2749] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:35.533679 24950 consensus_queue.cc:1059] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 12:10:35.563475 24889 consensus_queue.cc:260] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:35.549712 24578 consensus_queue.cc:260] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:35.551041 24906 consensus_queue.cc:1059] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.120s
I20260709 12:10:35.534181 24982 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:35.759454 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 207313us
I20260709 12:10:35.772015 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:35.616285 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 57089.3us
I20260709 12:10:35.548035 24751 raft_consensus.cc:2749] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:35.712818 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:35.550509 24924 raft_consensus.cc:3055] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:10:35.622515 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 63473.9us
I20260709 12:10:35.636008 22529 raft_consensus.cc:1240] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 LEADER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:35.711637 23119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57332 (request call id 535) took 1133 ms. Trace:
I20260709 12:10:35.684231 22449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1466) took 3273 ms. Trace:
I20260709 12:10:35.546057 24847 raft_consensus.cc:2749] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:35.702455 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:35.826942 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.685649 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:35.666812 24839 raft_consensus.cc:2749] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:35.551398 24915 raft_consensus.cc:2749] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:35.551265 24698 consensus_queue.cc:1243] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer c863116d91c14d1ca50d6e8a46a37a8f log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:10:35.866227 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:35.866647 24698 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:35.867888 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:10:35.868428 24701 consensus_meta.cc:287] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.617s	user 0.005s	sys 0.005s
I20260709 12:10:35.868701 23125 raft_consensus.cc:2393] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 4: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:35.868855 24701 raft_consensus.cc:2749] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:35.868999 24992 consensus_queue.cc:1048] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:10:35.869567 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:35.571943 24979 consensus_queue.cc:1059] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.316s
I20260709 12:10:35.870203 23125 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 5.
I20260709 12:10:35.805302 22448 raft_consensus.cc:1240] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:35.871253 24348 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:35.871459 22448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1470) took 3459 ms. Trace:
I20260709 12:10:35.870760 24906 raft_consensus.cc:3055] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:35.872285 24906 raft_consensus.cc:740] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:35.711880 22495 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:10:35.873297 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 161512us
I20260709 12:10:35.872984 24995 consensus_queue.cc:1059] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:35.873159 24906 consensus_queue.cc:260] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:35.874065 22495 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:35.874686 24993 raft_consensus.cc:3055] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:35.811129 22527 raft_consensus.cc:1240] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:35.874831 24906 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:35.870813 22451 raft_consensus.cc:1240] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:35.878809 24970 consensus_queue.cc:1059] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:10:35.889703 24970 consensus_queue.cc:1243] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Peer c863116d91c14d1ca50d6e8a46a37a8f log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 12:10:35.816673 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 218876us
I20260709 12:10:35.883241 24843 consensus_queue.cc:1048] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:10:35.891741 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:35.868884 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:35.892812 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:35.886114 22452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 461) took 3925 ms. Trace:
I20260709 12:10:35.893288 22602 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:35.807981 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:35.550186 24605 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:35.828186 22524 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 5.
I20260709 12:10:35.828750 23119 rpcz_store.cc:276] 0709 12:10:34.578134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.592921 (+ 14787us) service_pool.cc:224] Handling call
0709 12:10:35.711442 (+1118521us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b540069ffd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:35.711580 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":333084544}
I20260709 12:10:35.829972 24943 consensus_queue.cc:1059] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:35.575556 24333 raft_consensus.cc:2804] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:35.830482 24959 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:35.830925 24578 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:35.830482 24892 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:35.831939 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:35.815568 24924 raft_consensus.cc:740] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:35.564193 24863 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:35.826625 22449 rpcz_store.cc:276] 0709 12:10:32.410606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.487683 (+3077077us) service_pool.cc:224] Handling call
0709 12:10:35.525372 (+ 37689us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:35.548435 (+ 23063us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:35.551630 (+  3195us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:35.554777 (+  3147us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:35.564685 (+  9908us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.576099 (+ 11414us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:35.670544 (+ 94445us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:35.832062 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:35.875334 24955 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:35.921636 22454 raft_consensus.cc:2393] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 4: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:35.711802 24887 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:35.893795 24993 raft_consensus.cc:740] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:35.706872 24926 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:35.786020 24873 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:35.867198 24698 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:35.708043 24827 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:35.835120 24756 consensus_queue.cc:1175] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6c6fa11e8ee34711b3551f0c670442bc" responder_term: 7 status { last_received { term: 7 index: 9 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 6. Current term is 7. Ops: [6.8-6.8]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:10:35.559356 24621 consensus_queue.cc:1059] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.282s
I20260709 12:10:35.564111 24675 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:35.564644 24815 raft_consensus.cc:2749] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:35.576381 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:10:35.864174 22457 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2085) took 2287 ms (client timeout 2245 ms). Trace:
I20260709 12:10:35.865818 24965 consensus_queue.cc:1059] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:35.866966 22605 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 4.
I20260709 12:10:35.893708 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:35.811957 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:35.885716 23123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57332 (request call id 534) took 1308 ms. Trace:
I20260709 12:10:35.892524 24843 consensus_queue.cc:1059] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:10:35.893527 22452 rpcz_store.cc:276] 0709 12:10:31.961119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.695312 (+2734193us) service_pool.cc:224] Handling call
0709 12:10:35.063735 (+368423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:35.067212 (+  3477us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.885950 (+818738us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b54002206d0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:35.886063 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":807617920}
I20260709 12:10:35.875560 24950 raft_consensus.cc:3055] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:35.554021 24927 consensus_queue.cc:1048] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.275s
I20260709 12:10:35.875245 22495 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:10:36.002673 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 127492us
I20260709 12:10:35.998793 22450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1465) took 3588 ms. Trace:
I20260709 12:10:36.003768 22495 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:35.885254 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:36.004889 23117 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 6.
I20260709 12:10:35.894264 22528 raft_consensus.cc:2393] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 5: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:35.223189 22453 rpcz_store.cc:276] 0709 12:10:32.012783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.700461 (+2687678us) service_pool.cc:224] Handling call
0709 12:10:34.700737 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.701013 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:35.034751 (+333738us) log.cc:844] Serialized 14 byte log entry
0709 12:10:35.205758 (+171007us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:35.205835 (+    77us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:35.205914 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.206023 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:35.206362 (+   339us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19499,"raft.queue_time_us":22199,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":10943,"thread_start_us":451250,"threads_started":2}
W20260709 12:10:36.007756 23087 leader_election.cc:336] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.731s (SENT)
I20260709 12:10:36.007933 22453 raft_consensus.cc:1240] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:36.008774 22453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2075) took 3594 ms. Trace:
W20260709 12:10:36.008948 23087 leader_election.cc:336] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.787s (SENT)
I20260709 12:10:36.009203 22453 rpcz_store.cc:276] 0709 12:10:32.414658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.007356 (+3592698us) service_pool.cc:224] Handling call
0709 12:10:36.007716 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.008479 (+   763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.008708 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:35.892984 22527 raft_consensus.cc:1240] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:35.871840 22448 rpcz_store.cc:276] 0709 12:10:32.411743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.554809 (+3143066us) service_pool.cc:224] Handling call
0709 12:10:35.805062 (+250253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:35.871201 (+ 66139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.871403 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:35.900784 22606 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5.
I20260709 12:10:35.896857 23119 raft_consensus.cc:2955] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:35.877821 24848 raft_consensus.cc:2749] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:35.816537 24898 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:35.962649 24863 consensus_queue.cc:1059] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:10:35.625587 24961 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:35.774973 23116 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 4.
I20260709 12:10:36.028232 22452 raft_consensus.cc:1275] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:36.028831 22452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2070) took 3615 ms. Trace:
I20260709 12:10:36.028980 22448 raft_consensus.cc:1275] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:36.029161 22452 rpcz_store.cc:276] 0709 12:10:32.413332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.001556 (+3588224us) service_pool.cc:224] Handling call
0709 12:10:36.027899 (+ 26343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.028620 (+   721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.028781 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:35.889704 24720 raft_consensus.cc:3055] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:35.709659 24923 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:35.716264 24845 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:35.936583 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.835011 22421 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:35.967247 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:36.037619 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.037848 22454 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 4.
I20260709 12:10:36.039179 22454 raft_consensus.cc:1275] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:36.039683 22454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1474) took 2659 ms. Trace:
I20260709 12:10:36.040032 22454 rpcz_store.cc:276] 0709 12:10:33.380087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.038494 (+2658407us) service_pool.cc:224] Handling call
0709 12:10:36.038786 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.039484 (+   698us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.039635 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:35.882826 24967 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:36.042520 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 207653us
W20260709 12:10:36.042806 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.021256 24941 raft_consensus.cc:2804] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:35.983991 22598 raft_consensus.cc:1813] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Handling vote request from an unknown peer c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:36.043829 22598 raft_consensus.cc:2393] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 5: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
W20260709 12:10:35.984853 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 104441us
I20260709 12:10:36.044595 23089 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:35.921038 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:35.930271 24955 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:10:35.986864 22457 rpcz_store.cc:269] 0709 12:10:33.576586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.569570 (+992984us) service_pool.cc:224] Handling call
0709 12:10:35.863919 (+1294349us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54003f43d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:35.864092 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":367122304}
W20260709 12:10:35.987756 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 264253us
W20260709 12:10:35.982892 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 104655us
I20260709 12:10:35.989578 23124 raft_consensus.cc:2393] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 4: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:35.989322 23123 rpcz_store.cc:276] 0709 12:10:34.577771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.579579 (+  1808us) service_pool.cc:224] Handling call
0709 12:10:35.885538 (+1305959us) spinlock_profiling.cc:243] Waited 477 ms on lock 0x7b5400671bd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:35.885660 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1097260416}
I20260709 12:10:35.990058 23125 raft_consensus.cc:1240] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:35.910015 24995 consensus_queue.cc:1059] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 12:10:35.919102 24333 raft_consensus.cc:697] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:35.882158 24875 consensus_queue.cc:260] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:36.014236 22495 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:36.003795 22450 rpcz_store.cc:276] 0709 12:10:32.410238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.456310 (+3046072us) service_pool.cc:224] Handling call
0709 12:10:35.456586 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:35.485293 (+ 28707us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:35.485335 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:35.485364 (+    29us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:35.485400 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.998480 (+513080us) spinlock_profiling.cc:243] Waited 26.1 ms on lock 0x7b54003cad54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:35.998542 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:35.998705 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59919616}
W20260709 12:10:36.016511 22456 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1478) took 2435 ms (client timeout 1623 ms). Trace:
W20260709 12:10:36.102171 22456 rpcz_store.cc:269] 0709 12:10:33.580666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.381802 (+801136us) service_pool.cc:224] Handling call
0709 12:10:36.016284 (+1634482us) spinlock_profiling.cc:243] Waited 600 ms on lock 0x7b54003895d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:36.016421 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1381002496}
I20260709 12:10:36.010960 22453 raft_consensus.cc:1240] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:36.104849 22453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2077) took 3615 ms. Trace:
W20260709 12:10:36.087878 24953 consensus_meta.cc:287] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.572s	user 0.004s	sys 0.007s
I20260709 12:10:35.989929 24621 consensus_queue.cc:1243] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer c863116d91c14d1ca50d6e8a46a37a8f log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:10:36.032007 22497 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:36.000391 24950 raft_consensus.cc:740] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:36.035195 22448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2079) took 3512 ms. Trace:
I20260709 12:10:36.114389 24926 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:36.114171 22448 rpcz_store.cc:276] 0709 12:10:32.517097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.011510 (+3494413us) service_pool.cc:224] Handling call
0709 12:10:36.028708 (+ 17198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.029322 (+   614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.029496 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:36.009536 23087 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:35.982574 24873 consensus_queue.cc:1059] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
W20260709 12:10:36.088143 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 43661.2us
I20260709 12:10:36.114765 24950 consensus_queue.cc:260] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:36.049852 23125 raft_consensus.cc:1240] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:36.092352 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 44547us
I20260709 12:10:36.024456 24827 raft_consensus.cc:2749] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:36.033025 24720 raft_consensus.cc:740] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
W20260709 12:10:36.073824 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 181518us
W20260709 12:10:36.087911 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 451698us
I20260709 12:10:36.092036 22421 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:36.097834 23123 raft_consensus.cc:1275] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:10:36.033962 24993 consensus_queue.cc:260] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:36.098445 24751 consensus_queue.cc:1059] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.003s
W20260709 12:10:36.099429 24990 log.cc:927] Time spent T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:10:36.100704 24698 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:36.105299 22453 rpcz_store.cc:276] 0709 12:10:32.489629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.010437 (+3520808us) service_pool.cc:224] Handling call
0709 12:10:36.010752 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.104557 (+ 93805us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.104785 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:36.133817 22453 raft_consensus.cc:1240] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:36.019462 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.106722 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:36.107908 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:36.110666 22569 leader_election.cc:336] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 2.000s (SENT)
I20260709 12:10:36.091886 24982 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:36.049839 24955 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:36.050346 24941 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:36.139691 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:36.101423 24903 consensus_meta.cc:287] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.711s	user 0.013s	sys 0.002s
I20260709 12:10:36.088843 24675 raft_consensus.cc:2764] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:10:36.013113 24924 consensus_queue.cc:260] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:36.033257 24890 consensus_queue.cc:1059] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 12:10:36.160622 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:36.171561 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 162644us
I20260709 12:10:36.172514 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:36.173033 23087 leader_election.cc:336] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.538s (SENT)
I20260709 12:10:36.173179 24621 raft_consensus.cc:2749] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:36.173472 23087 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:36.173703 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:36.173897 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 58128.8us
I20260709 12:10:36.174315 24982 consensus_queue.cc:1059] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:36.174563 23089 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:36.139007 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:36.136379 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:36.175885 24873 raft_consensus.cc:2804] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:36.176393 24873 raft_consensus.cc:697] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 4 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:36.176543 24989 consensus_queue.cc:1059] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:36.177340 24989 consensus_queue.cc:1243] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer 6c6fa11e8ee34711b3551f0c670442bc log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:10:36.177387 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:36.177584 24873 consensus_queue.cc:237] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:36.142598 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:36.178946 22453 raft_consensus.cc:3060] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:36.160622 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:36.181103 24782 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:36.141002 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.164790 24924 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:36.165336 24605 leader_election.cc:290] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:36.133497 24979 raft_consensus.cc:2804] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:36.184201 24979 raft_consensus.cc:697] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 5 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:36.185135 24979 consensus_queue.cc:237] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:36.165475 24967 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:36.111882 24815 consensus_queue.cc:1059] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 12:10:36.165841 24993 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:36.187568 22455 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1482) took 2605 ms (client timeout 2000 ms). Trace:
I20260709 12:10:36.187705 24815 raft_consensus.cc:3055] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:36.161564 24827 raft_consensus.cc:2749] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:36.189461 24827 raft_consensus.cc:2804] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:36.190128 24827 raft_consensus.cc:697] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
W20260709 12:10:36.190436 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.191645 23122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 540) took 1065 ms. Trace:
I20260709 12:10:36.192085 23122 rpcz_store.cc:276] 0709 12:10:35.125821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.439953 (+314132us) service_pool.cc:224] Handling call
0709 12:10:35.440247 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:35.440608 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:35.440634 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:35.440946 (+   312us) log.cc:844] Serialized 26 byte log entry
0709 12:10:35.572567 (+131621us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:35.572606 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.572781 (+   175us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:36.191426 (+618645us) raft_consensus.cc:1685] finished
0709 12:10:36.191457 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:36.191589 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1203,"raft.queue_time_us":88,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":41807,"spinlock_wait_cycles":1451392,"thread_start_us":85476,"threads_started":1,"wal-append.queue_time_us":505741}
I20260709 12:10:36.193953 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:36.194288 24981 raft_consensus.cc:3055] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:36.194657 24981 raft_consensus.cc:740] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:36.195138 22601 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
I20260709 12:10:36.131472 24953 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:36.196120 22570 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:36.196630 24933 raft_consensus.cc:3055] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:36.196972 24933 raft_consensus.cc:740] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:36.197436 22570 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:36.197765 22457 raft_consensus.cc:1240] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 3. Current term is 5. Ops: []
I20260709 12:10:36.168591 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:36.089917 22449 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:36.204500 23121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57332 (request call id 527) took 1811 ms. Trace:
I20260709 12:10:36.134302 24863 raft_consensus.cc:2804] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:36.172565 24890 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:36.174443 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:36.176767 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:36.178334 24989 raft_consensus.cc:3055] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:36.178423 23123 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:36.195822 24981 consensus_queue.cc:260] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:36.161158 24998 raft_consensus.cc:3055] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:36.198561 22570 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:36.117967 24898 raft_consensus.cc:3055] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:36.145599 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:36.170054 22523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1439) took 1003 ms. Trace:
W20260709 12:10:36.199832 22601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43070 (request call id 374) took 1877 ms (client timeout 1538 ms). Trace:
I20260709 12:10:36.167215 24720 consensus_queue.cc:260] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:36.171617 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.201116 22496 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:36.174775 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:36.168188 24997 log.cc:927] Time spent T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.067s	user 0.003s	sys 0.000s
W20260709 12:10:36.188251 22455 rpcz_store.cc:269] 0709 12:10:33.581645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.475894 (+894249us) service_pool.cc:224] Handling call
0709 12:10:36.187368 (+1711474us) spinlock_profiling.cc:243] Waited 922 ms on lock 0x7b5400241b54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:36.187498 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2119875840}
I20260709 12:10:36.206010 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:36.207230 22451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1462) took 3925 ms. Trace:
W20260709 12:10:36.171219 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 48765us
W20260709 12:10:36.209359 23087 leader_election.cc:336] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 2.014s (SENT)
I20260709 12:10:36.188328 24815 raft_consensus.cc:740] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:36.139094 24915 raft_consensus.cc:3055] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:36.231655 22599 raft_consensus.cc:2393] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 4: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:36.140192 24941 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:36.252632 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.204981 23121 rpcz_store.cc:276] 0709 12:10:34.393500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.393624 (+   124us) service_pool.cc:224] Handling call
0709 12:10:36.204329 (+1810705us) spinlock_profiling.cc:243] Waited 781 ms on lock 0x7b5400759754. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:36.204447 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1795578240}
I20260709 12:10:36.284307 23121 raft_consensus.cc:1275] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:36.279325 22457 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1489) took 1928 ms. Trace:
I20260709 12:10:36.288550 22457 rpcz_store.cc:276] 0709 12:10:34.350605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.046013 (+1695408us) service_pool.cc:224] Handling call
0709 12:10:36.046387 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.198176 (+151789us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.279060 (+ 80884us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b5400243954. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:36.279256 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":347701120}
I20260709 12:10:36.252218 22523 rpcz_store.cc:276] 0709 12:10:35.166586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.423515 (+256929us) service_pool.cc:224] Handling call
0709 12:10:35.432832 (+  9317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:35.451675 (+ 18843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.169738 (+718063us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b5400262854. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:36.169975 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41718656}
I20260709 12:10:36.144641 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:36.293929 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:36.294891 22456 raft_consensus.cc:2368] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 6. Current term is 7.
I20260709 12:10:36.210716 24751 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:10:36.271927 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 62613.5us
W20260709 12:10:36.303452 23087 leader_election.cc:336] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 2.018s (SENT)
I20260709 12:10:36.303821 23087 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:36.204028 24965 raft_consensus.cc:2749] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:36.272909 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:36.309742 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:36.310915 22599 raft_consensus.cc:2393] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 5: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:36.311854 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:36.239346 22448 raft_consensus.cc:2393] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 4: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:36.308955 22605 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
I20260709 12:10:36.314528 24845 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:36.316720 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:36.317101 22597 raft_consensus.cc:1240] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:36.317359 22455 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 3.
I20260709 12:10:36.318318 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:36.277643 24333 consensus_queue.cc:237] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:36.282676 24915 raft_consensus.cc:740] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:36.322642 24915 consensus_queue.cc:260] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:36.200374 24827 consensus_queue.cc:237] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:36.198596 24903 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:36.323819 24915 raft_consensus.cc:3060] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:36.274554 22526 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:36.274228 22451 rpcz_store.cc:276] 0709 12:10:32.281420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.412529 (+3131109us) service_pool.cc:224] Handling call
0709 12:10:35.870644 (+458115us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:35.889421 (+ 18777us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.206990 (+317569us) spinlock_profiling.cc:243] Waited 458 ms on lock 0x7b54003f43d0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:36.207156 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1052901120}
I20260709 12:10:36.333027 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:36.334132 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:36.239326 24890 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:36.276883 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 78379.2us
I20260709 12:10:36.249727 24898 raft_consensus.cc:740] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:36.272470 24982 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:36.236197 24863 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:36.336398 24863 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:36.291765 24815 consensus_queue.cc:260] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:36.338438 24815 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:36.338768 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:36.292765 25003 raft_consensus.cc:2749] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:36.340507 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:10:36.341295 22606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45562 (request call id 1842) took 1320 ms (client timeout 1722 ms). Trace:
W20260709 12:10:36.341820 22606 rpcz_store.cc:269] 0709 12:10:35.021034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.021194 (+   160us) service_pool.cc:224] Handling call
0709 12:10:36.341102 (+1319908us) spinlock_profiling.cc:243] Waited 814 ms on lock 0x7b54003b3154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:36.341224 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1873080576}
W20260709 12:10:36.298029 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.345534 22422 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:36.346583 24923 raft_consensus.cc:2804] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:36.348379 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:36.349134 22598 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:36.289599 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:10:36.298344 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.235605 24953 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:36.235945 24989 raft_consensus.cc:740] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:36.325253 24933 consensus_queue.cc:260] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:36.327205 22604 raft_consensus.cc:1240] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:36.323743 24981 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:36.237062 24995 raft_consensus.cc:2749] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:36.362848 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:36.250097 24998 raft_consensus.cc:740] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
W20260709 12:10:36.393303 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 57888.2us
W20260709 12:10:36.395875 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 92460.2us
I20260709 12:10:36.350510 22457 raft_consensus.cc:2376] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5. Re-sending same reply.
W20260709 12:10:36.274168 22601 rpcz_store.cc:269] 0709 12:10:34.322680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.322848 (+   168us) service_pool.cc:224] Handling call
0709 12:10:36.199667 (+1876819us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b54000ec254. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:36.199760 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4149245184}
I20260709 12:10:36.400774 22605 raft_consensus.cc:1240] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:36.402158 24926 consensus_queue.cc:1059] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:36.209702 22453 raft_consensus.cc:2468] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
I20260709 12:10:36.407568 22599 raft_consensus.cc:1240] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 5. Current term is 6. Ops: [3.6-5.7]
I20260709 12:10:36.425410 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:36.433224 22456 raft_consensus.cc:2393] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 4: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:36.318849 22455 raft_consensus.cc:2376] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4. Re-sending same reply.
I20260709 12:10:36.434127 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:36.436362 22598 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5.
I20260709 12:10:36.440742 22422 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:36.443254 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:10:36.446018 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 414029us
I20260709 12:10:36.318853 22597 raft_consensus.cc:1240] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:36.448388 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:36.461155 22453 raft_consensus.cc:2376] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4. Re-sending same reply.
I20260709 12:10:36.462268 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:36.462921 22453 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:36.302163 23116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 876) took 1136 ms. Trace:
I20260709 12:10:36.452931 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:10:36.457031 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 442856us
I20260709 12:10:36.470173 22495 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:36.394731 24923 raft_consensus.cc:697] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:36.454305 24903 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:36.424150 24889 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:36.493376 22453 raft_consensus.cc:2468] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 5.
I20260709 12:10:36.496371 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:36.497308 22453 raft_consensus.cc:2376] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 5. Re-sending same reply.
I20260709 12:10:36.485539 24995 consensus_queue.cc:1048] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.018s
W20260709 12:10:36.487923 22602 consensus_meta.cc:287] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.594s	user 0.009s	sys 0.002s
I20260709 12:10:36.406045 25005 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:36.490659 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:36.492390 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:36.452265 24953 raft_consensus.cc:2804] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:36.447822 24868 raft_consensus.cc:2749] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:36.504763 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:36.350540 24751 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:36.471592 24943 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.524871 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:36.526816 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:36.527632 22453 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 5.
I20260709 12:10:36.443096 24967 consensus_queue.cc:1048] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:10:36.521864 22451 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 6.
I20260709 12:10:36.518723 22602 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 7.
W20260709 12:10:36.520268 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 319284us
I20260709 12:10:36.533923 22496 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:36.528764 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:36.536118 22453 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 3.
I20260709 12:10:36.537202 22422 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:36.537997 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:36.541641 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:36.542632 22453 raft_consensus.cc:2468] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 3.
I20260709 12:10:36.543956 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:36.544646 22453 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:36.545543 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:36.571269 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:36.600829 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:36.606541 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.608283 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:36.609382 22451 raft_consensus.cc:2410] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
W20260709 12:10:36.618698 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.471807 23116 rpcz_store.cc:276] 0709 12:10:35.159443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.050205 (+890762us) service_pool.cc:224] Handling call
0709 12:10:36.135696 (+ 85491us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.198170 (+ 62474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:36.210817 (+ 12647us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:36.229302 (+ 18485us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:36.238042 (+  8740us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.268471 (+ 30429us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:36.295431 (+ 26960us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:36.638192 22453 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 7.
I20260709 12:10:36.639698 22453 raft_consensus.cc:1275] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260709 12:10:36.637671 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 190758us
I20260709 12:10:36.642393 22497 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:36.637141 22451 raft_consensus.cc:1275] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:10:36.611658 24578 raft_consensus.cc:2804] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:36.544879 24868 consensus_queue.cc:1059] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 12:10:36.667874 22453 raft_consensus.cc:1275] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:36.668053 22497 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:36.532090 25005 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:36.537182 24943 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:36.630846 25011 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:36.634012 24924 raft_consensus.cc:2749] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:36.681108 22454 raft_consensus.cc:1275] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:10:36.681596 22454 pending_rounds.cc:85] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f: Aborting all ops after (but not including) 5
I20260709 12:10:36.635653 24887 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.684705 22453 raft_consensus.cc:1275] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:10:36.678812 24906 consensus_meta.cc:287] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.790s	user 0.011s	sys 0.005s
W20260709 12:10:36.683727 24971 consensus_meta.cc:287] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 1.014s	user 0.018s	sys 0.000s
I20260709 12:10:36.681914 22454 pending_rounds.cc:107] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:10:36.705606 22454 raft_consensus.cc:2889] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:36.699282 22526 raft_consensus.cc:2468] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 5.
I20260709 12:10:36.675367 24578 raft_consensus.cc:697] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:36.534884 24998 consensus_queue.cc:260] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:36.710875 24971 raft_consensus.cc:2749] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 4. Current term is 5.
I20260709 12:10:36.666728 24955 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:36.690709 24965 raft_consensus.cc:3055] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:36.704635 25015 raft_consensus.cc:2749] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:36.686439 24873 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:36.719348 23119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 541) took 1593 ms. Trace:
W20260709 12:10:36.720968 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 187152us
I20260709 12:10:36.722182 22496 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:36.722343 24961 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:36.725009 23124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 879) took 1564 ms. Trace:
I20260709 12:10:36.695387 25020 raft_consensus.cc:2749] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:36.641338 24923 consensus_queue.cc:237] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:36.686561 25011 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:36.696530 24887 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:36.430764 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:36.801126 22603 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 5.
I20260709 12:10:36.725517 23119 rpcz_store.cc:276] 0709 12:10:35.126046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.896285 (+770239us) service_pool.cc:224] Handling call
0709 12:10:35.896542 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:35.896743 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:36.049078 (+152335us) log.cc:844] Serialized 14 byte log entry
0709 12:10:36.718678 (+669600us) log.cc:844] Serialized 14 byte log entry
0709 12:10:36.718913 (+   235us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:36.718958 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:36.719028 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.719087 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:36.719288 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3995,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":43208,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":15445,"thread_start_us":663615,"threads_started":2,"wal-append.queue_time_us":493949}
W20260709 12:10:36.748773 22421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.740653 22528 raft_consensus.cc:1240] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:36.793618 23122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 885) took 1336 ms. Trace:
I20260709 12:10:36.737612 22601 raft_consensus.cc:1240] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:36.837580 23122 rpcz_store.cc:276] 0709 12:10:35.457239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.202596 (+745357us) service_pool.cc:224] Handling call
0709 12:10:36.202920 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:36.215126 (+ 12206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:36.215157 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:36.215733 (+   576us) log.cc:844] Serialized 26 byte log entry
0709 12:10:36.548736 (+333003us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:36.548786 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.548850 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:36.793309 (+244459us) raft_consensus.cc:1685] finished
0709 12:10:36.793338 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:36.793541 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7471,"spinlock_wait_cycles":16927872,"thread_start_us":255159,"threads_started":1,"wal-append.queue_time_us":460072}
I20260709 12:10:36.762262 22454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2088) took 3184 ms. Trace:
I20260709 12:10:36.843194 22454 rpcz_store.cc:276] 0709 12:10:33.577354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.055644 (+2478290us) service_pool.cc:224] Handling call
0709 12:10:36.098190 (+ 42546us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.706255 (+608065us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.761959 (+ 55704us) spinlock_profiling.cc:243] Waited 579 ms on lock 0x7b540037b754. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:36.762181 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1332097280}
I20260709 12:10:36.723511 25024 raft_consensus.cc:2804] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:36.845757 25024 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:36.771836 24578 consensus_queue.cc:237] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:36.846112 25024 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:36.728475 24998 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:36.852557 24924 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.853171 24924 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:36.777336 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:36.857185 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:36.857448 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:36.857936 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.859666 22457 raft_consensus.cc:1240] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 4. Current term is 5. Ops: [4.4-4.4]
W20260709 12:10:36.781179 25021 log.cc:927] Time spent T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:10:36.864665 24924 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:36.865639 23125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 544) took 1536 ms. Trace:
I20260709 12:10:36.719153 24982 raft_consensus.cc:2749] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:36.866171 23125 rpcz_store.cc:276] 0709 12:10:35.329409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.116525 (+787116us) service_pool.cc:224] Handling call
0709 12:10:36.186147 (+ 69622us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b5800110198. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf907fc0 00007f9ccf8f2929 00007f9ccf8f23d2 00007f9cc8e69bd4
0709 12:10:36.186349 (+   202us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:36.186735 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:36.186768 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:36.218511 (+ 31743us) log.cc:844] Serialized 26 byte log entry
0709 12:10:36.505620 (+287109us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:36.505664 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.505727 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:36.865337 (+359610us) raft_consensus.cc:1685] finished
0709 12:10:36.865369 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:36.865581 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33068,"raft.queue_time_us":12498,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":25239,"spinlock_wait_cycles":26587008,"thread_start_us":211617,"threads_started":1,"wal-append.queue_time_us":383798}
I20260709 12:10:36.734887 24873 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:36.791560 25017 log.cc:927] Time spent T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:10:36.791909 25008 log.cc:927] Time spent T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 12:10:36.865686 24943 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:10:36.868582 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 377207us
W20260709 12:10:36.777974 24782 consensus_meta.cc:287] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.596s	user 0.012s	sys 0.000s
W20260709 12:10:36.772153 25007 log.cc:927] Time spent T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.235s	user 0.001s	sys 0.001s
W20260709 12:10:36.845145 24815 consensus_meta.cc:287] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.506s	user 0.016s	sys 0.000s
I20260709 12:10:36.778335 24955 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:36.733095 22496 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:36.719050 24965 raft_consensus.cc:740] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:36.883955 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:36.885108 23087 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:36.896610 22457 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:10:36.764608 24751 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:36.886173 22602 raft_consensus.cc:1240] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:36.887751 22421 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
W20260709 12:10:36.881481 24863 consensus_meta.cc:287] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.545s	user 0.007s	sys 0.009s
I20260709 12:10:36.802177 22450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2092) took 2051 ms. Trace:
I20260709 12:10:36.889747 22599 raft_consensus.cc:1240] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:36.913862 22457 raft_consensus.cc:1275] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:36.912463 22450 rpcz_store.cc:276] 0709 12:10:34.750870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.111840 (+1360970us) service_pool.cc:224] Handling call
0709 12:10:36.138537 (+ 26697us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.138761 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:36.538267 (+399506us) log.cc:844] Serialized 14 byte log entry
0709 12:10:36.801716 (+263449us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:36.801798 (+    82us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:36.801872 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.801960 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:36.802106 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":620090,"prepare.run_wall_time_us":61,"raft.queue_time_us":95,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":111,"spinlock_wait_cycles":7413120,"thread_start_us":595969,"threads_started":2,"wal-append.queue_time_us":240521}
I20260709 12:10:36.915759 23087 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:36.916689 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 183692us
I20260709 12:10:36.918120 23087 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:36.741490 25015 consensus_queue.cc:1059] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.179s
I20260709 12:10:36.878233 24926 consensus_queue.cc:1048] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:10:36.921096 24926 consensus_queue.cc:1243] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer c863116d91c14d1ca50d6e8a46a37a8f log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:10:36.921504 25023 consensus_queue.cc:1059] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:10:36.922494 24981 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:36.923050 24863 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:36.924320 23120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 542) took 1798 ms. Trace:
I20260709 12:10:36.925201 24863 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:36.886618 24839 consensus_queue.cc:1059] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:10:36.927430 25032 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.928020 25032 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:36.930215 25032 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:36.932463 25011 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:36.933019 25011 raft_consensus.cc:3055] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:36.933317 25011 raft_consensus.cc:740] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:36.935094 24965 consensus_queue.cc:260] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:36.936295 24965 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:36.936825 24843 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.937328 24843 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:36.938445 24887 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:36.940740 24873 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:36.934017 25011 consensus_queue.cc:260] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:36.882392 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 412269us
I20260709 12:10:36.891647 22598 raft_consensus.cc:1275] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:36.893218 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:36.942310 22597 raft_consensus.cc:1240] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:36.942729 22605 raft_consensus.cc:2393] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 4: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:36.787125 25005 leader_election.cc:290] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:36.942829 22495 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:36.791451 25031 raft_consensus.cc:2804] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:36.943554 25031 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:36.741176 25012 raft_consensus.cc:2804] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:36.944013 22495 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:36.944392 25002 raft_consensus.cc:2804] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:36.944901 25002 raft_consensus.cc:697] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 5 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:36.945446 22495 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:36.945771 25002 consensus_queue.cc:237] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:36.946532 22495 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:36.896909 22454 raft_consensus.cc:1275] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:36.881148 24953 raft_consensus.cc:697] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:36.878448 24971 consensus_queue.cc:1048] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 12:10:36.947597 22495 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:36.910197 22421 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:36.952884 22496 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:36.898224 22569 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:36.881266 23124 rpcz_store.cc:276] 0709 12:10:35.160155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.049927 (+889772us) service_pool.cc:224] Handling call
0709 12:10:36.101799 (+ 51872us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.117835 (+ 16036us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:36.487016 (+369181us) log.cc:844] Serialized 14 byte log entry
0709 12:10:36.724330 (+237314us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:36.724653 (+   323us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:36.724725 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.724806 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:36.724942 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15671,"prepare.queue_time_us":512663,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":51,"raft.queue_time_us":38815,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":32097,"thread_start_us":531813,"threads_started":2,"wal-append.queue_time_us":276497}
W20260709 12:10:36.890012 24941 consensus_meta.cc:287] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.539s	user 0.007s	sys 0.005s
I20260709 12:10:36.943642 24955 raft_consensus.cc:2749] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:36.924839 23120 rpcz_store.cc:276] 0709 12:10:35.126275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.986163 (+859888us) service_pool.cc:224] Handling call
0709 12:10:35.996714 (+ 10551us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:35.997023 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:35.997051 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:36.001623 (+  4572us) log.cc:844] Serialized 26 byte log entry
0709 12:10:36.235507 (+233884us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:36.235548 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.235616 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:36.924041 (+688425us) raft_consensus.cc:1685] finished
0709 12:10:36.924070 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:36.924233 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10088,"raft.queue_time_us":39092,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":46487,"thread_start_us":199496,"threads_started":1,"wal-append.queue_time_us":455193}
W20260709 12:10:36.953965 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.912700 25020 raft_consensus.cc:2804] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:36.880326 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 343182us
W20260709 12:10:36.963549 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 53438.7us
W20260709 12:10:36.963549 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 65434.3us
I20260709 12:10:36.968194 22457 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51832
I20260709 12:10:36.897307 24845 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.854457 24979 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:37.000496 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 322639us
I20260709 12:10:37.022326 22497 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:37.024188 22421 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:10:37.025372 22457 raft_consensus.cc:606] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Received request to transfer leadership
I20260709 12:10:37.025830 22457 raft_consensus.cc:614] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:36.911485 24924 raft_consensus.cc:2749] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:36.946866 24915 consensus_meta.cc:287] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.605s	user 0.006s	sys 0.004s
I20260709 12:10:37.034091 22448 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
I20260709 12:10:37.040848 22421 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:36.957531 25006 raft_consensus.cc:2804] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:36.969655 24827 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:36.968403 24751 raft_consensus.cc:2749] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:37.047092 22454 pending_rounds.cc:85] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f: Aborting all ops after (but not including) 7
I20260709 12:10:36.943940 25031 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:36.980042 24782 raft_consensus.cc:2804] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:37.050611 22454 pending_rounds.cc:107] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:10:37.002179 24875 raft_consensus.cc:3060] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:36.973016 24961 raft_consensus.cc:2749] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:36.975059 24955 raft_consensus.cc:2749] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:37.068356 22454 raft_consensus.cc:2889] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:37.043663 25006 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:37.027838 25032 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.034605 24965 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.034317 24863 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:37.077160 22421 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:36.979756 24941 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:37.050908 24827 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:37.050338 24981 raft_consensus.cc:2749] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:37.075980 24936 raft_consensus.cc:993] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881: : Instructing follower 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:10:37.100881 22421 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:37.069319 25039 raft_consensus.cc:2764] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:37.035147 24979 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:37.173255 24979 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:37.036439 24845 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:37.103086 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:37.177389 22602 raft_consensus.cc:2393] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 4: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:37.044474 24993 consensus_queue.cc:1048] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:10:37.045939 24943 consensus_queue.cc:1048] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:10:37.068042 24782 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.105373 24955 raft_consensus.cc:2749] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:37.108708 24953 consensus_queue.cc:237] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:37.110251 25024 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:37.223426 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:37.103336 25032 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:37.106211 24965 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:37.224442 23124 raft_consensus.cc:1240] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:36.976835 24898 consensus_queue.cc:260] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:37.114054 22449 consensus_meta.cc:287] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.876s	user 0.015s	sys 0.002s
I20260709 12:10:37.114887 22421 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:37.115629 24751 raft_consensus.cc:2804] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:37.119244 25036 raft_consensus.cc:2764] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:37.050030 25027 consensus_queue.cc:1059] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:10:37.080449 24815 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:37.122020 24961 raft_consensus.cc:2749] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:37.122457 24936 raft_consensus.cc:1081] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 LEADER]: Signalling peer 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:10:37.123538 24950 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.105458 24924 raft_consensus.cc:2749] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:37.105399 24827 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.107663 24863 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:37.132508 25012 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:37.133788 22604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 1851) took 1576 ms. Trace:
I20260709 12:10:37.276975 22604 rpcz_store.cc:276] 0709 12:10:35.557345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.557507 (+   162us) service_pool.cc:224] Handling call
0709 12:10:35.557831 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.398378 (+840547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.133516 (+735138us) spinlock_profiling.cc:243] Waited 769 ms on lock 0x7b5400350cd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:37.133682 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1768979200}
I20260709 12:10:37.134086 24941 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:37.137384 24890 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:37.142181 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.143102 22452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2082) took 4207 ms. Trace:
W20260709 12:10:37.290273 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.290217 22452 rpcz_store.cc:276] 0709 12:10:32.935325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.029918 (+3094593us) service_pool.cc:224] Handling call
0709 12:10:36.049230 (+ 19312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.717837 (+668607us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:36.717883 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:36.717945 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:36.717994 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.142845 (+424851us) spinlock_profiling.cc:243] Waited 666 ms on lock 0x7b5400379454. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:37.142892 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:37.143043 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1839,"raft.queue_time_us":3673,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":10857,"spinlock_wait_cycles":1532341632}
I20260709 12:10:37.291958 22570 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:37.149742 22456 raft_consensus.cc:2468] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
I20260709 12:10:37.292255 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:37.154894 24933 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:36.957829 24739 raft_consensus.cc:3055] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:37.156436 25011 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:37.158187 23118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 543) took 1856 ms. Trace:
I20260709 12:10:37.160122 24720 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.162307 24847 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.166230 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:37.089716 25006 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:37.210698 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 263145us
I20260709 12:10:37.307587 22495 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:37.055274 24873 consensus_queue.cc:1059] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:10:37.218051 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:37.294628 24926 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.050136 25023 consensus_queue.cc:1048] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:10:37.225057 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:37.102546 25035 raft_consensus.cc:2804] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:37.226274 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:37.227016 23121 raft_consensus.cc:1275] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:37.228050 22530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1457) took 1104 ms. Trace:
I20260709 12:10:37.229286 22606 raft_consensus.cc:1275] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:10:37.228125 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 113338us
I20260709 12:10:37.316504 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:37.317199 23121 raft_consensus.cc:2368] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 3. Current term is 4.
I20260709 12:10:37.318008 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:10:37.318106 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.318950 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:37.243383 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:37.244400 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:37.339147 23121 raft_consensus.cc:2393] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 6: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:37.339299 23123 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:10:37.211465 24698 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.220590 25020 raft_consensus.cc:697] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
W20260709 12:10:37.253754 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:37.253603 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 231392us
I20260709 12:10:37.240862 25039 raft_consensus.cc:2804] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:37.293362 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:37.420895 22421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:37.421396 22421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.255841 24744 raft_consensus.cc:3055] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:37.300078 24924 consensus_queue.cc:1059] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
W20260709 12:10:37.424736 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 77884.8us
W20260709 12:10:37.300329 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 347531us
I20260709 12:10:37.247315 24751 raft_consensus.cc:697] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
W20260709 12:10:37.241503 24621 consensus_queue.cc:1175] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6c6fa11e8ee34711b3551f0c670442bc" responder_term: 5 status { last_received { term: 4 index: 6 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:10:37.293305 25012 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.245589 25031 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:37.291664 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:37.311992 23125 raft_consensus.cc:2393] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 7: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:37.219506 23120 raft_consensus.cc:1240] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:37.299342 24739 raft_consensus.cc:740] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:37.294435 24994 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:37.319204 22570 leader_election.cc:400] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Vote denied by peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353) with higher term. Message: Invalid argument: T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 3. Current term is 4.
I20260709 12:10:37.442970 22570 leader_election.cc:403] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:37.219475 24782 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:37.315944 22530 rpcz_store.cc:276] 0709 12:10:36.123220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.124346 (+  1126us) service_pool.cc:224] Handling call
0709 12:10:36.124656 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.124892 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:36.617123 (+492231us) log.cc:844] Serialized 14 byte log entry
0709 12:10:37.227629 (+610506us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:37.227699 (+    70us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:37.227759 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.227843 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:37.227978 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26185,"prepare.queue_time_us":591634,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":8494,"raft.queue_time_us":130912,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":4639,"thread_start_us":1011917,"threads_started":3,"wal-append.queue_time_us":454362}
I20260709 12:10:37.321130 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:37.321384 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:37.321672 25035 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:10:37.321844 25040 log.cc:927] Time spent T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:10:37.321996 24875 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.323037 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:37.435135 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:37.328544 24863 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:37.328902 22495 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:37.437481 25049 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:37.330757 24936 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:37.331943 24965 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:37.332985 25024 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:37.333482 25046 log.cc:927] Time spent T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:10:37.310180 24943 raft_consensus.cc:2804] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:37.473297 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 144471us
I20260709 12:10:37.473999 22495 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:37.302313 23118 rpcz_store.cc:276] 0709 12:10:35.301903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.095954 (+794051us) service_pool.cc:224] Handling call
0709 12:10:36.195667 (+ 99713us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b5800110198. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809e9c 00007f9cc7809a5b 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf907fc0 00007f9ccf8f2929 00007f9ccf8f23d2 00007f9cc8e69bd4
0709 12:10:36.239131 (+ 43464us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.278636 (+ 39505us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:36.291375 (+ 12739us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:36.291446 (+    71us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:36.291485 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.291543 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:37.157946 (+866403us) spinlock_profiling.cc:243] Waited 41.5 ms on lock 0x7b5400135e50. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:37.158110 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":122311168}
I20260709 12:10:37.338621 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:37.344379 23121 raft_consensus.cc:1275] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:37.313529 24873 consensus_queue.cc:1243] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer 6c6fa11e8ee34711b3551f0c670442bc log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:10:37.421203 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:37.239210 22449 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 4.
I20260709 12:10:37.422921 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:37.461308 24971 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:37.482420 22457 raft_consensus.cc:2376] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4. Re-sending same reply.
I20260709 12:10:37.483534 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:37.433705 22421 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:37.434667 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:37.423527 24744 raft_consensus.cc:740] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:37.436671 23123 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 7.
I20260709 12:10:37.311542 24890 consensus_queue.cc:1048] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.121s
I20260709 12:10:37.444877 22456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 486) took 1191 ms. Trace:
W20260709 12:10:37.446617 22603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43070 (request call id 388) took 1340 ms (client timeout 1565 ms). Trace:
I20260709 12:10:37.490451 22456 rpcz_store.cc:276] 0709 12:10:36.253954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.443276 (+189322us) service_pool.cc:224] Handling call
0709 12:10:37.444663 (+1001387us) spinlock_profiling.cc:243] Waited 522 ms on lock 0x7b540019b4d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:37.444801 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1199732480}
W20260709 12:10:37.490579 22603 rpcz_store.cc:269] 0709 12:10:36.106693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.106939 (+   246us) service_pool.cc:224] Handling call
0709 12:10:37.446481 (+1339542us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b540013b354. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:37.446568 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1237580160}
W20260709 12:10:37.477816 25041 log.cc:927] Time spent T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.255s	user 0.000s	sys 0.001s
I20260709 12:10:37.492347 22603 raft_consensus.cc:1275] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:37.453141 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:37.453645 22448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 484) took 1247 ms. Trace:
W20260709 12:10:37.457131 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:37.460245 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 141259us
I20260709 12:10:37.493749 22598 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.493714 22448 rpcz_store.cc:276] 0709 12:10:36.206273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.339930 (+133657us) service_pool.cc:224] Handling call
0709 12:10:37.453439 (+1113509us) spinlock_profiling.cc:243] Waited 555 ms on lock 0x7b540037ad54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:37.453570 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1277267712}
I20260709 12:10:37.461438 22605 raft_consensus.cc:2393] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 6: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:37.327065 24926 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:37.462013 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.503250 22605 raft_consensus.cc:1240] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:37.310907 24847 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:37.512491 24847 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:37.502779 24739 consensus_queue.cc:260] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:37.514055 24739 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.464243 23120 raft_consensus.cc:1275] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:10:37.515008 23120 pending_rounds.cc:85] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270: Aborting all ops after (but not including) 5
I20260709 12:10:37.475961 25049 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:37.515455 23120 pending_rounds.cc:107] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:10:37.515918 23120 raft_consensus.cc:2889] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:37.503638 24751 consensus_queue.cc:237] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:37.465245 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:37.516925 25049 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:37.477046 24955 raft_consensus.cc:2749] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:37.424353 24698 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:37.440964 25051 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.441143 24578 consensus_queue.cc:1048] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:10:37.534226 24578 consensus_queue.cc:1243] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer 8701cd5186a949538d8efafb5f987270 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 12:10:37.534490 25045 log.cc:927] Time spent T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:10:37.433032 25048 consensus_queue.cc:1059] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:10:37.535666 25004 raft_consensus.cc:3055] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:37.537731 25004 raft_consensus.cc:740] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:37.538622 25004 consensus_queue.cc:260] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:37.539703 25004 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:37.461406 25035 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:37.496398 23087 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:37.501751 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:37.465862 24923 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.505156 24348 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.505576 24993 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:37.488034 22449 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2104) took 1850 ms (client timeout 2272 ms). Trace:
I20260709 12:10:37.469296 24875 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:37.484150 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:37.507282 24744 consensus_queue.cc:260] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:37.470877 25020 consensus_queue.cc:237] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:37.509526 23116 raft_consensus.cc:1275] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:37.480690 24941 raft_consensus.cc:2804] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:37.438592 25039 raft_consensus.cc:697] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:37.473073 24943 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:37.519093 22605 raft_consensus.cc:1240] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:37.524092 22598 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 5.
I20260709 12:10:37.461462 24994 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:37.531917 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.533502 24926 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:37.550905 24873 raft_consensus.cc:2804] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:37.537134 25048 raft_consensus.cc:3055] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:10:37.540913 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 44590.9us
I20260709 12:10:37.504695 22570 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:37.540731 22604 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 4.
W20260709 12:10:37.528764 25037 log.cc:927] Time spent T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.274s	user 0.000s	sys 0.001s
I20260709 12:10:37.553329 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:37.553369 23122 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:37.581887 23119 raft_consensus.cc:1240] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:37.533773 25053 log.cc:927] Time spent T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:10:37.582086 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:37.527611 22600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43070 (request call id 390) took 1416 ms. Trace:
W20260709 12:10:37.569914 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 95969.5us
I20260709 12:10:37.533571 24698 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:37.577432 22497 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:37.582271 23117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 875) took 2423 ms. Trace:
W20260709 12:10:37.555758 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.580920 23087 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:37.582832 22600 rpcz_store.cc:276] 0709 12:10:36.108771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.111839 (+  3068us) service_pool.cc:224] Handling call
0709 12:10:37.427097 (+1315258us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b58001b3098. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf8f40a0 00007f9ccf8f3984 00007f9cc8e6e6d4 00007f9cc8e6e662
0709 12:10:37.524944 (+ 97847us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40696576}
I20260709 12:10:37.582190 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:37.564396 22597 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.585222 22495 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:37.585604 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 81041.2us
I20260709 12:10:37.583228 23117 rpcz_store.cc:276] 0709 12:10:35.159169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.005760 (+846591us) service_pool.cc:224] Handling call
0709 12:10:36.006161 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:36.443774 (+437613us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:36.443800 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:36.480332 (+ 36532us) log.cc:844] Serialized 26 byte log entry
0709 12:10:36.880083 (+399751us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:36.880118 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.880185 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:37.582082 (+701897us) raft_consensus.cc:1685] finished
0709 12:10:37.582098 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:37.582214 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":95158,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":29160,"thread_start_us":797061,"threads_started":2,"wal-append.queue_time_us":600680}
I20260709 12:10:37.592561 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:37.593174 23117 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:37.594135 22570 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:37.595199 23087 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:37.596721 23087 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:37.574266 24941 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.601966 22570 leader_election.cc:304] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:37.577127 22598 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:45576
I20260709 12:10:37.575659 24744 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.552618 24923 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:37.578938 24943 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:37.612483 22598 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:37.554483 24348 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:37.584698 24873 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:37.554945 24993 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:37.615913 22598 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.584524 25048 raft_consensus.cc:740] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
W20260709 12:10:37.616693 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.599108 25059 raft_consensus.cc:2749] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:37.603597 24839 raft_consensus.cc:2749] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:37.544756 25051 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:37.611630 24941 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.602396 25023 raft_consensus.cc:2804] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:37.602200 24863 raft_consensus.cc:2804] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:37.631126 24873 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:37.631038 24926 raft_consensus.cc:2749] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:37.686072 22600 raft_consensus.cc:1275] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:37.687295 24923 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:37.631052 25031 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:37.604807 25027 consensus_queue.cc:1048] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 12:10:37.706301 25068 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:10:37.707214 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.601625 25002 consensus_queue.cc:1048] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 12:10:37.655786 25024 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:37.599265 24698 raft_consensus.cc:2749] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:37.711632 25039 consensus_queue.cc:237] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:37.722628 25068 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:37.700611 25050 raft_consensus.cc:2804] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:37.693490 25023 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:37.703312 24961 raft_consensus.cc:3060] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:37.687492 25048 consensus_queue.cc:260] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:37.691228 25006 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:37.740765 25023 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:37.756202 25060 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.747541 25050 raft_consensus.cc:697] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:37.723012 25024 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:37.769479 25058 log.cc:927] Time spent T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 12:10:37.772886 25032 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:37.779757 25051 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:37.768688 25060 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:37.784034 25060 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:37.785360 25064 log.cc:927] Time spent T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:10:37.788880 25006 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:37.762498 25048 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:37.778848 25035 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:37.801692 25068 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:37.544449 22451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1497) took 1256 ms. Trace:
W20260709 12:10:37.833556 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 399753us
W20260709 12:10:37.836350 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 258810us
I20260709 12:10:37.836850 22455 raft_consensus.cc:2410] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 12:10:37.832046 22403 auto_rebalancer.cc:893] Removing replace marker failed: Replica c863116d91c14d1ca50d6e8a46a37a8f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:37.851845 23123 raft_consensus.cc:1240] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:37.858166 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:37.874076 22403 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 12:10:37.874871 22403 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:10:37.874758 25050 consensus_queue.cc:237] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:37.876242 24989 consensus_queue.cc:260] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:37.551499 22449 rpcz_store.cc:269] 0709 12:10:35.637367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.920777 (+283410us) service_pool.cc:224] Handling call
0709 12:10:37.484327 (+1563550us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:37.921550 25049 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:37.924757 25049 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:37.928354 22422 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:37.929303 25049 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:37.929690 24924 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.917047 24863 raft_consensus.cc:697] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 7 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:37.932590 24915 consensus_queue.cc:1059] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:37.933559 24863 consensus_queue.cc:237] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:37.934684 24675 raft_consensus.cc:2804] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:37.935398 24675 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.935979 24675 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.930780 24924 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:37.945448 22601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43070 (request call id 398) took 1552 ms. Trace:
I20260709 12:10:37.946020 22601 rpcz_store.cc:276] 0709 12:10:36.392842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.432444 (+ 39602us) service_pool.cc:224] Handling call
0709 12:10:36.432849 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:36.842858 (+410009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.944717 (+1101859us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b5400449654. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:37.945172 (+   455us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":698188032}
I20260709 12:10:37.952220 24923 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.953158 24923 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:37.959683 24979 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.960829 24979 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:37.964270 24924 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:37.964778 24756 raft_consensus.cc:3055] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:37.965297 24756 raft_consensus.cc:740] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:37.967931 24756 consensus_queue.cc:260] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:37.969336 24756 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:37.969565 24924 consensus_queue.cc:1048] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:37.970057 24845 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:37.971443 25035 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:37.971909 22450 raft_consensus.cc:1275] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:10:37.972398 22450 pending_rounds.cc:85] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f: Aborting all ops after (but not including) 6
I20260709 12:10:37.972728 22450 pending_rounds.cc:107] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:10:37.973075 22450 raft_consensus.cc:2889] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:37.973837 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.974473 24348 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:37.975137 24953 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.977003 22603 raft_consensus.cc:1240] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:37.978112 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:37.981886 22602 raft_consensus.cc:1275] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:37.833108 22451 rpcz_store.cc:276] 0709 12:10:36.287583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.653070 (+365487us) service_pool.cc:224] Handling call
0709 12:10:36.653508 (+   438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:36.653953 (+   445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:36.653993 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:36.669973 (+ 15980us) log.cc:844] Serialized 26 byte log entry
0709 12:10:36.839710 (+169737us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:36.839767 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.839859 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:37.544164 (+704305us) raft_consensus.cc:1685] finished
0709 12:10:37.544194 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:37.544357 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":33755,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":16334,"thread_start_us":120823,"threads_started":1,"wal-append.queue_time_us":380517}
I20260709 12:10:37.919219 22421 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
W20260709 12:10:37.959915 22455 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 491) took 1659 ms (client timeout 2039 ms). Trace:
I20260709 12:10:37.911777 25072 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:37.984606 22455 rpcz_store.cc:269] 0709 12:10:36.300884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.433830 (+132946us) service_pool.cc:224] Handling call
0709 12:10:37.959549 (+1525719us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b5400378554. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:37.959774 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3221224192}
I20260709 12:10:37.995157 24994 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:37.996243 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:37.997253 24993 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:10:37.997642 25011 consensus_meta.cc:287] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.693s	user 0.010s	sys 0.000s
W20260709 12:10:38.019354 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 147477us
I20260709 12:10:37.939154 24989 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.790561 25012 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:38.076290 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:38.080377 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 59905.9us
I20260709 12:10:38.081883 24845 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.082671 24845 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:38.083112 25024 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:38.055723 24924 raft_consensus.cc:2749] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:38.100787 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:38.102555 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:38.102954 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.103204 24845 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:38.130622 25032 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:38.131556 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 529472us
I20260709 12:10:38.129807 25004 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:38.094678 25024 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:38.160486 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:38.165462 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:38.165992 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:38.166867 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:38.172542 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 45844.8us
I20260709 12:10:38.103336 25072 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:38.176117 25072 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:38.176801 25072 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.177670 24863 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.177536 25072 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:38.120711 25081 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.178352 24863 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:38.179397 25081 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:38.181638 24863 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:38.179116 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:38.182066 25081 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:38.182749 22451 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:38.182725 24845 consensus_queue.cc:1048] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:38.183883 24845 consensus_queue.cc:1243] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer 1676e7af5e4a47cb86ee7db83e3d4881 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 12:10:38.187808 24827 consensus_meta.cc:287] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.898s	user 0.013s	sys 0.004s
W20260709 12:10:38.188862 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 95133.2us
W20260709 12:10:38.190446 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 83920.1us
W20260709 12:10:38.196314 22597 consensus_meta.cc:287] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.595s	user 0.013s	sys 0.000s
I20260709 12:10:38.151408 25035 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.163808 24923 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:38.188445 24827 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:38.209288 24906 consensus_queue.cc:1048] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:38.209761 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:38.210687 25012 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:38.214184 25024 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:38.197482 24979 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:38.219924 24782 consensus_meta.cc:287] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.755s	user 0.012s	sys 0.008s
I20260709 12:10:38.220172 25020 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.222513 25068 consensus_queue.cc:1048] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
W20260709 12:10:38.223250 24950 consensus_meta.cc:287] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.967s	user 0.007s	sys 0.032s
I20260709 12:10:38.227654 25072 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:38.229570 24971 consensus_meta.cc:287] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.741s	user 0.008s	sys 0.011s
I20260709 12:10:38.208184 22597 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 6.
I20260709 12:10:38.231331 23121 raft_consensus.cc:1275] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
W20260709 12:10:38.210789 24933 consensus_meta.cc:287] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.907s	user 0.022s	sys 0.000s
W20260709 12:10:38.233165 24941 consensus_meta.cc:287] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.536s	user 0.010s	sys 0.007s
I20260709 12:10:38.278638 23121 pending_rounds.cc:85] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270: Aborting all ops after (but not including) 6
I20260709 12:10:38.240552 24923 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:38.240899 24827 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:38.242874 22454 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:38.244830 25024 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:38.245486 24744 consensus_meta.cc:287] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.633s	user 0.010s	sys 0.003s
I20260709 12:10:38.245800 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:38.248831 24843 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:38.208592 25004 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:38.251371 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:38.252285 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:38.256752 24898 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:38.257509 22598 consensus_meta.cc:287] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.636s	user 0.003s	sys 0.016s
I20260709 12:10:38.260690 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:38.224686 22421 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
W20260709 12:10:38.256654 24943 consensus_meta.cc:287] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.624s	user 0.006s	sys 0.006s
I20260709 12:10:38.193646 25032 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:38.238153 24873 consensus_meta.cc:287] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.527s	user 0.009s	sys 0.000s
W20260709 12:10:38.260730 24739 consensus_meta.cc:287] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.746s	user 0.008s	sys 0.008s
I20260709 12:10:38.235020 24675 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:38.341727 24675 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:38.290606 23121 pending_rounds.cc:107] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:10:38.342440 23121 raft_consensus.cc:2889] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:38.298348 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:38.343758 22452 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
I20260709 12:10:38.344545 24863 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.345132 24863 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:38.298564 24875 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:38.299072 24843 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:38.299104 22570 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:38.347851 24843 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:38.348513 22606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 1856) took 2157 ms. Trace:
I20260709 12:10:38.348886 22606 rpcz_store.cc:276] 0709 12:10:36.191338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.342852 (+151514us) service_pool.cc:224] Handling call
0709 12:10:36.360675 (+ 17823us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:37.316065 (+955390us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.348083 (+1032018us) spinlock_profiling.cc:243] Waited 868 ms on lock 0x7b54000e8654. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:38.348350 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1996901760}
I20260709 12:10:38.350087 24843 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:38.300037 23120 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 5.
I20260709 12:10:38.300876 24892 consensus_queue.cc:1048] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:38.296348 22601 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 4.
I20260709 12:10:38.301757 24845 consensus_queue.cc:1048] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:38.315861 23123 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
I20260709 12:10:38.320364 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:38.353569 22527 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 6.
I20260709 12:10:38.321396 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:38.355049 22523 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 4.
I20260709 12:10:38.355271 24675 consensus_queue.cc:1048] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:38.323509 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:38.356205 22524 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.324304 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:38.359555 24943 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:38.325413 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:38.361860 24943 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:38.361943 22448 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
W20260709 12:10:38.364182 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 155813us
I20260709 12:10:38.365103 22421 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:38.326115 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:38.326174 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:38.326396 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:38.367215 23089 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:38.327667 24923 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:38.369915 24923 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:38.370360 24621 raft_consensus.cc:2749] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:38.370494 24923 raft_consensus.cc:2749] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:38.328724 22497 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:38.294734 25020 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:38.373634 25020 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:38.329748 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:38.374282 25020 raft_consensus.cc:2804] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:38.332135 24744 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.294415 24971 raft_consensus.cc:2749] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353) with higher term. Message: Invalid argument: T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 3. Current term is 4.
I20260709 12:10:38.375247 24744 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:38.376098 22605 raft_consensus.cc:1240] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:38.278218 24782 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:38.378607 24782 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:10:38.379290 25077 log.cc:927] Time spent T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.575s	user 0.002s	sys 0.003s
W20260709 12:10:38.380770 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 81856us
I20260709 12:10:38.382200 22570 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:38.296380 25035 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:38.384778 25074 log.cc:927] Time spent T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.582s	user 0.000s	sys 0.002s
I20260709 12:10:38.385351 25035 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:38.337278 25004 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:38.322369 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:10:38.386821 25075 log.cc:927] Time spent T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.439s	user 0.002s	sys 0.000s
I20260709 12:10:38.388372 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:38.388814 24961 consensus_meta.cc:287] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.641s	user 0.014s	sys 0.005s
I20260709 12:10:38.389194 22529 raft_consensus.cc:2468] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 4.
I20260709 12:10:38.296741 24941 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:38.386968 22525 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.392192 24941 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:38.392271 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:38.306654 22598 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:38.394500 22598 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:38.396349 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:38.396438 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:38.397305 22597 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.397403 22526 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 4.
I20260709 12:10:38.398099 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:38.398824 22531 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5.
I20260709 12:10:38.399016 24845 raft_consensus.cc:2804] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:38.399873 24933 raft_consensus.cc:2804] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:38.400295 24933 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:38.400744 24933 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:38.370718 22602 raft_consensus.cc:1275] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:38.389273 24961 raft_consensus.cc:2749] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:38.378660 24744 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:38.408349 22532 raft_consensus.cc:2393] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 5: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:38.410458 24333 consensus_queue.cc:1059] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:38.356462 22422 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:38.416136 22524 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5.
W20260709 12:10:38.386767 24936 consensus_meta.cc:287] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.911s	user 0.006s	sys 0.011s
I20260709 12:10:38.374830 25020 raft_consensus.cc:697] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:38.410544 24926 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.303908 24889 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.412176 24953 raft_consensus.cc:2749] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:38.431910 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 78729.8us
I20260709 12:10:38.407682 24845 raft_consensus.cc:697] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:38.423671 24843 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.434578 24923 consensus_queue.cc:1048] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:38.434696 24843 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:38.436398 22530 raft_consensus.cc:1240] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:38.437136 24843 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:38.437868 25039 raft_consensus.cc:2804] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:38.438364 25039 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:38.437809 24578 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:38.443329 24578 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:38.444516 25020 consensus_queue.cc:237] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:38.446360 24675 consensus_queue.cc:1048] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:38.441699 24889 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:38.445909 24578 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:38.439921 25004 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.439867 25039 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.418056 24873 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:38.450876 24843 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.450168 24936 raft_consensus.cc:2749] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:38.489329 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.490619 22524 raft_consensus.cc:1240] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:38.497629 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:38.501883 22598 raft_consensus.cc:1275] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:10:38.503094 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.448519 24926 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:38.512960 22531 raft_consensus.cc:1275] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:10:38.519308 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.528318 22525 raft_consensus.cc:2410] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 12:10:38.530681 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 128655us
I20260709 12:10:38.532437 22570 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:38.533716 24782 raft_consensus.cc:2804] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:38.534220 24782 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:38.514532 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:38.545910 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:38.501276 25004 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:38.547432 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:38.536666 24782 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.562366 22531 raft_consensus.cc:1240] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:38.569528 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.565192 22599 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 5.
I20260709 12:10:38.530544 24843 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:38.576583 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:38.558125 24970 raft_consensus.cc:3055] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:10:38.559763 24915 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.014s	sys 0.016s
I20260709 12:10:38.590701 22526 raft_consensus.cc:1240] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:38.591264 23120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57332 (request call id 554) took 1044 ms. Trace:
I20260709 12:10:38.586421 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:38.590118 24926 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:38.607175 25032 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:38.607555 24873 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:38.608978 23121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 898) took 1292 ms. Trace:
I20260709 12:10:38.614101 23120 rpcz_store.cc:276] 0709 12:10:37.546359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.581935 (+ 35576us) service_pool.cc:224] Handling call
0709 12:10:38.591014 (+1009079us) spinlock_profiling.cc:243] Waited 715 ms on lock 0x7b5400670f54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:38.591174 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1645210368}
I20260709 12:10:38.611586 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:38.612095 24923 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:38.592868 24970 raft_consensus.cc:740] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:38.613196 22525 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:38.615155 23121 rpcz_store.cc:276] 0709 12:10:37.317065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.478864 (+161799us) service_pool.cc:224] Handling call
0709 12:10:37.479149 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:38.343045 (+863896us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.608677 (+265632us) spinlock_profiling.cc:243] Waited 752 ms on lock 0x7b540055f854. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:38.608897 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1728505600}
W20260709 12:10:38.632006 25023 consensus_meta.cc:287] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.774s	user 0.010s	sys 0.010s
I20260709 12:10:38.632504 22532 raft_consensus.cc:1275] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:38.632623 25023 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:38.635164 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 325786us
I20260709 12:10:38.635656 23118 raft_consensus.cc:1240] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:38.635901 22597 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5.
I20260709 12:10:38.636150 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:38.636445 24843 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:38.636754 23119 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:38.613888 24915 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.014s	sys 0.016s
I20260709 12:10:38.645126 22497 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:38.645716 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:38.646377 23124 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:38.647131 24578 consensus_queue.cc:1059] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:38.648425 25047 raft_consensus.cc:2764] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:38.650091 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:38.651115 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:10:38.652372 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.653496 22606 raft_consensus.cc:2393] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 5: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:38.650875 22603 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.610505 24933 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:38.635834 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:38.658603 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:38.560045 24845 consensus_queue.cc:237] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:38.663487 23124 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:10:38.677561 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:38.665982 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:38.656144 24923 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:38.688573 23117 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:38.679893 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:38.693696 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:38.714216 23120 raft_consensus.cc:2410] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:38.684712 23087 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:38.686297 25023 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:38.720580 25004 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:38.725903 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:38.728539 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:38.742347 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:38.743827 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:38.744532 22531 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:38.744590 22526 raft_consensus.cc:1240] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 12:10:38.745543 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:38.745958 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:38.747287 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:38.746713 22531 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:38.750924 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:38.751880 22531 raft_consensus.cc:3055] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:38.752283 22531 raft_consensus.cc:740] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:38.753334 24720 raft_consensus.cc:3055] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:38.731546 24970 consensus_queue.cc:260] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:38.753825 24720 raft_consensus.cc:740] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:38.753674 22531 consensus_queue.cc:260] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:38.748492 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:38.754662 24970 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:38.755474 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:38.756724 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:38.757555 22524 raft_consensus.cc:2410] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:38.758667 22524 raft_consensus.cc:1240] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:38.759323 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:38.760054 22523 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
I20260709 12:10:38.761014 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:38.761744 22527 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:38.768244 23117 raft_consensus.cc:1217] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Deduplicated request from leader. Original: 2.5->[3.6-6.8]   Dedup: 3.6->[4.7-6.8]
I20260709 12:10:38.768761 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:38.769439 23124 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 4.
I20260709 12:10:38.769651 23121 raft_consensus.cc:1275] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:38.768800 23117 pending_rounds.cc:85] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270: Aborting all ops after (but not including) 6
I20260709 12:10:38.770809 23117 pending_rounds.cc:107] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:10:38.771117 23117 raft_consensus.cc:2889] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:38.775535 25100 log.cc:927] Time spent T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:10:38.777252 24923 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:38.777575 24889 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:38.779013 24751 raft_consensus.cc:2749] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:38.735204 22597 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 5.
I20260709 12:10:38.781349 22497 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:38.781849 22528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1455) took 2662 ms. Trace:
I20260709 12:10:38.782248 24936 raft_consensus.cc:2804] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:38.782742 24936 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:38.783175 24936 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:38.783295 22495 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.138s	user 0.007s	sys 0.002s
W20260709 12:10:38.785115 25073 log.cc:927] Time spent T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.984s	user 0.001s	sys 0.002s
I20260709 12:10:38.787848 22597 raft_consensus.cc:1240] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:38.788074 25096 log.cc:927] Time spent T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.312s	user 0.002s	sys 0.000s
I20260709 12:10:38.789598 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:38.782205 22528 rpcz_store.cc:276] 0709 12:10:36.119815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.122204 (+  2389us) service_pool.cc:224] Handling call
0709 12:10:36.122522 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.837030 (+714508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.781402 (+1944372us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b54003f07d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:38.781665 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1414727936}
I20260709 12:10:38.799719 22525 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:10:38.790319 23120 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 4.
I20260709 12:10:38.809962 24933 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:38.810117 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 143164us
W20260709 12:10:38.815526 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 413290us
I20260709 12:10:38.817657 22450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 508) took 1394 ms. Trace:
I20260709 12:10:38.819159 22532 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:38.822297 24923 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:38.826318 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 163210us
I20260709 12:10:38.818173 22450 rpcz_store.cc:276] 0709 12:10:37.422817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.422932 (+   115us) service_pool.cc:224] Handling call
0709 12:10:37.971195 (+548263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:37.973661 (+  2466us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.817437 (+843776us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b5400378550. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:38.817576 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1236708608}
I20260709 12:10:38.855068 23119 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
W20260709 12:10:38.867173 22495 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.281s	user 0.008s	sys 0.002s
I20260709 12:10:38.809993 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:38.834878 22603 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 5.
W20260709 12:10:38.980038 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:38.981985 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.823899 24875 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.823354 25027 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:38.981237 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 163640us
I20260709 12:10:38.907903 24756 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:38.869077 25087 log.cc:927] Time spent T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.608s	user 0.003s	sys 0.000s
I20260709 12:10:39.004979 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:38.980731 24348 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.935271 25099 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.826143 24621 raft_consensus.cc:2804] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:39.008608 23120 raft_consensus.cc:2410] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:38.867415 24751 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:39.011492 22570 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:38.864676 24720 consensus_queue.cc:260] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:39.028146 22421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.028865 24720 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.822821 25039 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:39.036085 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:39.038025 23088 leader_election.cc:336] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 1.553s (SENT)
I20260709 12:10:39.038511 23088 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:10:39.039728 23088 leader_election.cc:336] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 1.565s (SENT)
I20260709 12:10:39.040136 23088 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:39.043370 22531 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:39.044365 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:39.044900 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.045069 25023 raft_consensus.cc:2749] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:39.046852 24927 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.047487 24927 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:39.048887 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:39.049588 23122 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:39.051075 24751 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:39.053310 24751 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:39.057489 24936 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:38.822922 24923 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:39.063561 22531 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:10:39.064275 23119 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:39.078645 23122 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:10:39.080521 22451 raft_consensus.cc:1240] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 3. Current term is 5. Ops: []
I20260709 12:10:39.033370 24621 raft_consensus.cc:697] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 4 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:39.079790 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:39.091882 22570 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:39.094694 22603 raft_consensus.cc:1275] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:39.033030 24915 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.099018 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:39.099207 24915 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:39.100459 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:39.101188 22602 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 6.
I20260709 12:10:39.101280 22599 raft_consensus.cc:1240] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:39.059069 24992 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.082538 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:10:39.103492 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.059549 24845 raft_consensus.cc:2804] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:39.105576 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:39.108670 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:39.109109 22456 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:39.106573 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:39.109860 23122 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 5.
I20260709 12:10:39.089941 22569 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:39.101835 24915 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:39.081966 25023 raft_consensus.cc:2749] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:39.113794 23119 raft_consensus.cc:1240] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:39.098124 22422 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:39.109310 22457 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
I20260709 12:10:39.064435 25032 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:39.121241 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.034116 24756 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:39.033511 25027 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:39.004211 24875 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:39.124778 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 64440.2us
I20260709 12:10:39.125187 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:39.031097 24348 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:39.130327 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:39.131429 24992 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:39.132357 24923 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:39.133499 24992 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:39.135264 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:10:39.136106 25111 log.cc:927] Time spent T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.268s	user 0.000s	sys 0.002s
I20260709 12:10:39.136566 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:39.081729 25099 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:39.137492 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:39.137719 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:39.139564 24621 consensus_queue.cc:237] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:39.142365 22456 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 6.
I20260709 12:10:39.138918 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:39.143648 23122 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 5.
I20260709 12:10:39.093568 24333 consensus_queue.cc:1048] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:10:39.148224 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:39.148442 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:39.148644 25090 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.815s	user 0.043s	sys 0.024s
W20260709 12:10:39.149014 25090 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.849s	user 0.043s	sys 0.024s
I20260709 12:10:39.148994 22456 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
I20260709 12:10:39.149526 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:39.150061 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:39.152853 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:39.152886 22457 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
I20260709 12:10:39.155314 22450 raft_consensus.cc:1240] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 12:10:39.153602 22455 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
W20260709 12:10:39.151284 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 1.56601e+06us
I20260709 12:10:39.162029 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:39.124436 25020 consensus_queue.cc:1048] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:10:39.163334 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:39.163996 22452 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
I20260709 12:10:39.164294 22453 raft_consensus.cc:1275] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:39.165313 24933 raft_consensus.cc:2804] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:39.165709 24933 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:39.166035 24756 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:39.166107 24933 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:39.169834 23087 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:39.170735 25068 raft_consensus.cc:2804] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:39.172420 22601 raft_consensus.cc:1275] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:39.177454 22456 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 3.
I20260709 12:10:39.128721 24970 raft_consensus.cc:2764] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:10:39.126483 24845 raft_consensus.cc:697] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:39.170665 24744 consensus_queue.cc:1048] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:39.129355 24751 raft_consensus.cc:2804] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:39.178186 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 49209.7us
I20260709 12:10:39.199905 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:39.200639 22455 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:39.152356 25099 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:39.207386 22452 raft_consensus.cc:1275] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:10:39.213307 25106 log.cc:927] Time spent T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.305s	user 0.002s	sys 0.001s
I20260709 12:10:39.215782 24927 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:39.198246 22569 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:39.171247 25068 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:39.229454 24845 consensus_queue.cc:237] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:39.241008 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 63261.7us
W20260709 12:10:39.227018 24782 consensus_meta.cc:287] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.640s	user 0.007s	sys 0.004s
I20260709 12:10:39.233372 25068 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.253762 22569 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:39.158764 25032 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:39.237696 24751 raft_consensus.cc:697] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 5 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:39.272106 23123 raft_consensus.cc:1275] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:39.264163 24941 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.264155 24993 raft_consensus.cc:2804] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:39.264299 25039 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:39.277021 22495 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:39.252562 24782 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:39.279721 24993 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:39.269097 24970 consensus_queue.cc:1048] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:10:39.284260 24943 raft_consensus.cc:2804] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:39.299666 24751 consensus_queue.cc:237] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:39.303984 24875 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:39.302847 22495 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:39.313493 22496 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:39.315261 22449 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:39.278120 24941 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:39.294591 25027 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:39.293741 24993 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.294435 24961 raft_consensus.cc:2749] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:39.307410 24943 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:39.288316 25109 consensus_queue.cc:1059] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
W20260709 12:10:39.327106 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 195910us
I20260709 12:10:39.330298 22422 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:39.313086 25020 consensus_queue.cc:1048] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:10:39.323508 25047 raft_consensus.cc:2749] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:39.330231 24943 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.387346 25039 consensus_queue.cc:1059] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:39.388265 25039 raft_consensus.cc:3055] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:39.388610 25039 raft_consensus.cc:740] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:39.389405 25039 consensus_queue.cc:260] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:39.390594 25039 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:39.391346 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:39.393570 25032 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:39.399964 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:39.400830 22603 raft_consensus.cc:2393] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 6: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:39.401152 24961 raft_consensus.cc:2804] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:39.401201 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:39.401701 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:39.402277 22603 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 5.
I20260709 12:10:39.402526 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:39.403095 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:39.403765 22603 raft_consensus.cc:2393] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 5: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:39.404629 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:39.407714 24348 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:39.408480 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:39.409195 22451 raft_consensus.cc:2393] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 5: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:39.409132 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:39.410140 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:39.411021 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 108289us
W20260709 12:10:39.400600 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 73732.2us
I20260709 12:10:39.414075 22449 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
I20260709 12:10:39.423005 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:39.424345 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:39.425123 22451 raft_consensus.cc:2393] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 8: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:39.425294 24941 leader_election.cc:290] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:39.426563 22600 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 6.
I20260709 12:10:39.427284 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:39.427863 22452 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:39.364951 25119 raft_consensus.cc:2804] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:39.429258 25119 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:39.429637 25119 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:39.431025 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:39.325443 24892 consensus_queue.cc:1048] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 12:10:39.380889 22455 raft_consensus.cc:2468] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
I20260709 12:10:39.435932 22453 raft_consensus.cc:1240] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:39.380985 24863 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:39.438563 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.401723 24961 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:39.441766 25047 consensus_queue.cc:1048] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:39.442054 24782 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:39.445886 23088 leader_election.cc:336] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 1.903s (SENT)
W20260709 12:10:39.451076 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 290207us
I20260709 12:10:39.453356 22570 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:39.455667 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:39.460846 22598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 1880) took 1012 ms. Trace:
I20260709 12:10:39.463922 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:39.465216 22455 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
I20260709 12:10:39.461439 22598 rpcz_store.cc:276] 0709 12:10:38.448308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:38.450945 (+  2637us) service_pool.cc:224] Handling call
0709 12:10:38.454533 (+  3588us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:38.502385 (+ 47852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:39.453206 (+950821us) spinlock_profiling.cc:243] Waited 36.6 ms on lock 0x7b54000c08d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:39.460752 (+  7546us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":84291968}
W20260709 12:10:39.480031 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 172285us
I20260709 12:10:39.480772 22496 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:10:39.443150 25117 log.cc:927] Time spent T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.172s	user 0.000s	sys 0.005s
I20260709 12:10:39.496807 22496 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:39.442957 24961 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.501932 22605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2248) took 1945 ms. Trace:
I20260709 12:10:39.515050 22452 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
I20260709 12:10:39.520232 22570 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:39.521659 22570 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:39.516326 22605 rpcz_store.cc:276] 0709 12:10:37.556822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.593206 (+ 36384us) service_pool.cc:224] Handling call
0709 12:10:37.599715 (+  6509us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:38.376540 (+776825us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:39.452967 (+1076427us) spinlock_profiling.cc:243] Waited 776 ms on lock 0x7b54002dfd54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:39.501870 (+ 48903us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1784718208}
W20260709 12:10:39.523250 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 77402.4us
I20260709 12:10:39.523904 22570 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:10:39.532647 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:39.533437 22455 raft_consensus.cc:2393] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 5: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:39.515589 25127 raft_consensus.cc:2804] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:39.541656 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 44919.2us
I20260709 12:10:39.518296 25132 raft_consensus.cc:2804] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:39.540795 22570 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:39.523043 25108 consensus_queue.cc:1059] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:10:39.539984 24348 raft_consensus.cc:2804] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:39.549335 24348 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:39.549851 24348 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.537359 25020 consensus_queue.cc:1048] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:10:39.531611 24782 raft_consensus.cc:2749] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:39.535192 24970 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:39.561480 22496 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:39.522429 24941 consensus_queue.cc:1059] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
W20260709 12:10:39.574208 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.555904 25047 raft_consensus.cc:2749] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:39.543346 25127 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:39.556154 25132 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:39.554764 24993 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:39.598953 22421 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:39.584060 25132 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:39.606496 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 45108.4us
I20260709 12:10:39.584167 25127 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.609805 22421 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:39.610884 24751 raft_consensus.cc:2804] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:39.611467 24751 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:39.611939 24751 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.611775 24348 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:39.614035 24348 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:39.615758 25126 log.cc:927] Time spent T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:10:39.598788 25143 raft_consensus.cc:2749] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:39.625615 25135 consensus_queue.cc:1059] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:10:39.629499 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:39.597937 25108 consensus_queue.cc:1243] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer 1676e7af5e4a47cb86ee7db83e3d4881 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:10:39.633184 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:39.638805 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 55083.5us
I20260709 12:10:39.641215 22529 raft_consensus.cc:1275] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:10:39.695778 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.703924 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:39.704922 22529 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 4.
I20260709 12:10:39.643680 24941 raft_consensus.cc:3055] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:39.709038 25144 consensus_queue.cc:1059] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:39.709625 22532 raft_consensus.cc:1275] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:39.722224 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:39.723505 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:39.724687 23089 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:39.728749 25039 consensus_queue.cc:1048] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:39.729463 23089 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:39.730226 24863 raft_consensus.cc:2749] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:39.731173 24863 raft_consensus.cc:2804] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:39.731318 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:39.731600 24863 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:39.731995 22605 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
I20260709 12:10:39.711362 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:39.733392 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:39.733696 24993 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:39.734067 22529 raft_consensus.cc:2468] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5.
I20260709 12:10:39.711866 24923 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:39.710081 22528 raft_consensus.cc:1275] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:39.735101 24923 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:39.736814 25119 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:39.711611 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:39.737643 24923 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:39.715335 25109 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.710812 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:39.628911 24845 consensus_queue.cc:1059] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 12:10:39.714107 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:39.739513 23089 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:39.717525 22525 raft_consensus.cc:1275] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:39.739959 24970 raft_consensus.cc:2749] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:39.719365 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:39.726826 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:39.649866 25090 raft_consensus.cc:2749] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:39.730314 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:39.740988 23119 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 3.
I20260709 12:10:39.738829 22524 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.727485 24720 consensus_queue.cc:1048] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:39.739754 22523 raft_consensus.cc:2410] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:39.718703 22456 raft_consensus.cc:2410] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:39.740469 25027 raft_consensus.cc:2804] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:39.713464 22527 raft_consensus.cc:1275] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:39.715925 24751 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:39.717178 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 154999us
I20260709 12:10:39.732029 24863 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:39.743266 23089 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:39.747117 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:39.749186 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 48126us
I20260709 12:10:39.718590 24941 raft_consensus.cc:740] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:39.756664 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:39.757555 22529 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:39.759542 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:39.759572 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:39.760357 22523 raft_consensus.cc:2468] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:39.760609 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:39.761511 22421 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:39.762918 22525 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
I20260709 12:10:39.763136 22526 raft_consensus.cc:1240] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:39.764164 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:39.751190 24845 consensus_queue.cc:1243] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer 1676e7af5e4a47cb86ee7db83e3d4881 log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:10:39.763266 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:39.767506 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:39.768100 22531 raft_consensus.cc:2376] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6. Re-sending same reply.
I20260709 12:10:39.768639 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:39.769233 22529 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.769351 22605 raft_consensus.cc:2393] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 5: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:39.759328 25109 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:39.771448 25020 consensus_queue.cc:1048] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:39.772395 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:39.753052 25027 raft_consensus.cc:697] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 6 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:39.756623 24875 raft_consensus.cc:2804] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:39.773555 25109 leader_election.cc:290] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:39.773765 24875 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:39.774062 22530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 1832) took 1548 ms. Trace:
I20260709 12:10:39.774223 24875 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.774426 22530 rpcz_store.cc:276] 0709 12:10:38.319137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:38.325001 (+  5864us) service_pool.cc:224] Handling call
0709 12:10:38.325372 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:38.436788 (+111416us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:39.773818 (+1337030us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b540030e3d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:39.773992 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":246097280}
I20260709 12:10:39.775653 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:39.776196 22530 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:39.778292 25119 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:39.761091 25115 log.cc:927] Time spent T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.626s	user 0.001s	sys 0.004s
I20260709 12:10:39.773485 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:39.745131 24943 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:39.782915 22421 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:39.785223 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:39.788337 22527 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:39.766575 25090 raft_consensus.cc:2804] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:39.801925 22524 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5.
I20260709 12:10:39.803438 22421 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:39.767269 25140 raft_consensus.cc:2804] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:39.787003 24720 raft_consensus.cc:2749] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:39.803423 24933 consensus_meta.cc:287] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.636s	user 0.012s	sys 0.000s
I20260709 12:10:39.812740 24943 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:39.813340 24961 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:39.816843 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:39.817083 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:39.817752 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:39.817977 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:10:39.819156 25068 consensus_meta.cc:287] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.539s	user 0.010s	sys 0.002s
I20260709 12:10:39.819684 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:39.820845 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:39.821441 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:39.822746 22529 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
W20260709 12:10:39.835050 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.840718 23122 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.831326 22570 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
W20260709 12:10:39.854015 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 89460.7us
W20260709 12:10:39.870148 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.803107 25090 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:10:39.880219 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 49020us
I20260709 12:10:39.882790 22570 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:39.891290 22532 raft_consensus.cc:2410] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 12:10:39.895789 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.773523 25027 consensus_queue.cc:237] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:39.910897 22570 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:39.914225 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:39.882051 25090 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:39.933702 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 130321us
I20260709 12:10:39.935364 22421 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:39.886013 25067 raft_consensus.cc:2804] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:39.880502 25068 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:39.889626 24756 raft_consensus.cc:2749] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:39.953590 23122 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 5.
I20260709 12:10:39.877367 24933 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:39.957414 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 199972us
W20260709 12:10:39.947407 25142 log.cc:927] Time spent T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
W20260709 12:10:39.976368 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 148480us
I20260709 12:10:39.947926 24923 raft_consensus.cc:2804] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:39.981112 22602 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 6: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:39.881816 24941 consensus_queue.cc:260] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:39.947752 25119 consensus_queue.cc:1048] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.039s
W20260709 12:10:39.990300 23087 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.621s (SENT) [suppressed 33 similar messages]
W20260709 12:10:40.024282 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:40.026641 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 90026.5us
I20260709 12:10:40.027980 22421 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:39.981097 24923 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.033149 25127 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:40.057735 25127 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:40.022367 23116 raft_consensus.cc:1240] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:40.084252 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 112869us
I20260709 12:10:40.085239 22496 leader_election.cc:304] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:40.086249 25127 raft_consensus.cc:2804] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:39.954923 22453 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
mode: GRACEFUL
new_leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:44568
I20260709 12:10:40.092161 22453 raft_consensus.cc:606] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Received request to transfer leadership to TS 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:40.092617 22453 raft_consensus.cc:614] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:39.983768 24756 consensus_queue.cc:1048] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.079s
W20260709 12:10:40.061968 25142 log.cc:927] Time spent T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:10:40.092264 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:40.087642 24961 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:40.094291 22524 raft_consensus.cc:1240] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 12:10:40.062323 24923 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.982656 25132 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:40.060693 25039 raft_consensus.cc:2804] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:40.105334 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:40.106815 22531 raft_consensus.cc:1240] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:40.093889 24941 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:40.095769 25127 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.119839 25161 consensus_queue.cc:1048] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:40.124243 24933 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:40.127712 25068 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:40.129009 24756 consensus_queue.cc:1048] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:40.134604 22605 raft_consensus.cc:1240] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:10:40.130637 25156 consensus_queue.cc:1048] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:10:40.137873 25132 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:40.138303 24993 raft_consensus.cc:3055] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:40.113243 25039 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.138705 24993 raft_consensus.cc:740] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:40.132915 25127 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.149909 22421 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
W20260709 12:10:40.147078 24992 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.013s	user 0.000s	sys 0.019s
I20260709 12:10:40.148725 25153 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.143597 25039 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.151036 24993 consensus_queue.cc:260] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:40.151826 25143 raft_consensus.cc:3055] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:40.155375 22421 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:40.146281 24875 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:40.154918 25153 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:40.162482 24875 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:40.162546 25153 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:40.159344 25068 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.163738 25108 raft_consensus.cc:3055] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:40.164096 25108 raft_consensus.cc:740] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:40.163650 25068 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:40.164702 25108 consensus_queue.cc:260] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:40.165560 25108 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:40.165874 25068 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:40.157296 23118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 911) took 1592 ms. Trace:
I20260709 12:10:40.166662 23118 rpcz_store.cc:276] 0709 12:10:38.564475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:38.589101 (+ 24626us) service_pool.cc:224] Handling call
0709 12:10:38.589503 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:38.636127 (+ 46624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:40.150934 (+1514807us) spinlock_profiling.cc:243] Waited 45.8 ms on lock 0x7b5400690354. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:40.157227 (+  6293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":105318656}
I20260709 12:10:40.162926 22450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 510) took 1133 ms. Trace:
I20260709 12:10:40.158746 24923 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:40.167929 22450 rpcz_store.cc:276] 0709 12:10:39.029392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:39.035067 (+  5675us) service_pool.cc:224] Handling call
0709 12:10:39.105153 (+ 70086us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:39.155825 (+ 50672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:40.162662 (+1006837us) spinlock_profiling.cc:243] Waited 38.9 ms on lock 0x7b54002a5b54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:40.162862 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89409280}
I20260709 12:10:40.169781 24923 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:40.155835 24992 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.022s	user 0.000s	sys 0.020s
I20260709 12:10:40.162432 24936 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:40.180578 24923 raft_consensus.cc:2749] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:40.157503 25143 raft_consensus.cc:740] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:40.183981 25143 consensus_queue.cc:260] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:40.185083 25148 log.cc:927] Time spent T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.216s	user 0.000s	sys 0.003s
I20260709 12:10:40.158265 25156 raft_consensus.cc:2749] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:40.204857 25161 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.205366 25161 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:40.206141 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:40.206738 22530 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:40.207583 25161 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:40.212644 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:40.212735 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:40.213433 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:40.213644 22457 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.214367 23087 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:40.214974 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:40.149235 24863 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:40.216301 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:40.217080 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:40.217126 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:40.217461 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:40.217754 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:40.217217 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:40.221815 22450 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:40.218827 23087 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:40.218897 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:40.219480 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:40.219764 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:40.221573 22523 raft_consensus.cc:2468] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 4.
I20260709 12:10:40.223321 23087 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:40.222131 22526 raft_consensus.cc:2376] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5. Re-sending same reply.
I20260709 12:10:40.224478 22453 raft_consensus.cc:2393] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 5: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:40.225353 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:40.225893 22524 raft_consensus.cc:2376] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5. Re-sending same reply.
I20260709 12:10:40.227772 22451 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.224162 24875 raft_consensus.cc:2749] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:40.228682 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:40.229384 22528 raft_consensus.cc:2393] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 5: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:40.219187 24744 raft_consensus.cc:2804] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:40.229769 24744 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:40.230116 23116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 560) took 1127 ms. Trace:
I20260709 12:10:40.230155 24744 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:40.230530 23116 rpcz_store.cc:276] 0709 12:10:39.102302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:39.113365 (+ 11063us) service_pool.cc:224] Handling call
0709 12:10:39.173012 (+ 59647us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:40.094588 (+921576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:40.229868 (+135280us) spinlock_profiling.cc:243] Waited 800 ms on lock 0x7b54004e4154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:40.230060 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1839573376}
I20260709 12:10:40.232031 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:40.232156 24782 raft_consensus.cc:3055] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:40.233616 22532 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 4.
I20260709 12:10:40.235977 22453 raft_consensus.cc:1275] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:40.235713 24782 raft_consensus.cc:740] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:40.234030 25068 raft_consensus.cc:2804] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:40.237128 22457 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 6.
I20260709 12:10:40.239725 25068 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:40.239585 25023 consensus_queue.cc:1048] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:40.239991 24782 consensus_queue.cc:260] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:40.240820 24782 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:40.241070 25068 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:40.243637 24751 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:40.248009 24873 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:40.248338 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:40.248574 24873 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:40.249063 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.248988 23121 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:40.250358 22351 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55962 (request call id 342) took 10410 ms. Trace:
I20260709 12:10:40.251123 24621 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:40.251331 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:40.251888 23122 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.251616 24621 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:40.253539 24621 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:40.254590 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:40.224743 24993 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.255411 22449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 524) took 1114 ms. Trace:
I20260709 12:10:40.255193 22353 catalog_manager.cc:5697] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 3 to 4, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 4 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:40.255852 22449 rpcz_store.cc:276] 0709 12:10:39.140648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:39.149317 (+  8669us) service_pool.cc:224] Handling call
0709 12:10:40.255273 (+1105956us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b54003f2fd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:40.255359 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":379736960}
W20260709 12:10:40.258052 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.259419 25020 consensus_queue.cc:1059] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:10:40.259550 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:40.250689 24873 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317)
I20260709 12:10:40.263583 25141 raft_consensus.cc:3055] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:40.264115 25141 raft_consensus.cc:740] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:40.263686 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:40.265039 23121 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:40.265569 22525 raft_consensus.cc:2410] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:40.259130 23124 raft_consensus.cc:1275] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:40.257422 22353 catalog_manager.cc:5697] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 2 to 4, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 4 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:10:40.255438 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:40.266223 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:40.260591 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:40.268225 22526 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.268607 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:40.269299 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:40.270287 22450 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 3.
I20260709 12:10:40.271101 22451 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 5.
I20260709 12:10:40.269893 23125 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 4.
I20260709 12:10:40.279721 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:40.280156 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:40.280841 23119 raft_consensus.cc:2393] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 4: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:40.280984 22525 raft_consensus.cc:1275] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:40.281929 22449 raft_consensus.cc:2393] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 5: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:40.282797 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:40.283535 22524 raft_consensus.cc:2393] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 6: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:40.284485 22524 raft_consensus.cc:1240] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:40.285614 24889 raft_consensus.cc:3055] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:40.286124 24889 raft_consensus.cc:740] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:40.264894 25141 consensus_queue.cc:260] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:40.287231 24889 consensus_queue.cc:260] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:40.287495 25141 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:40.288301 24889 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.280970 24863 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:40.289880 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:40.290652 23121 raft_consensus.cc:2410] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:40.294515 23122 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:40.279726 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:10:40.297040 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 60934.1us
I20260709 12:10:40.296198 22530 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 7.
I20260709 12:10:40.298547 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:40.301460 22526 raft_consensus.cc:2468] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5.
I20260709 12:10:40.302567 22449 raft_consensus.cc:1240] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:10:40.303695 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:40.304432 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:40.304594 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:40.305285 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:40.307178 22421 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:40.307235 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:40.307837 23123 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.308379 22451 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 5.
I20260709 12:10:40.307956 22457 raft_consensus.cc:2376] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 6. Re-sending same reply.
W20260709 12:10:40.282827 25114 log.cc:927] Time spent T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 1.128s	user 0.006s	sys 0.000s
I20260709 12:10:40.303442 24751 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:40.313571 25162 raft_consensus.cc:2749] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:40.306140 25023 consensus_queue.cc:1048] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:10:40.313643 24751 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:40.314678 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:40.315327 23122 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5.
I20260709 12:10:40.313604 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:40.316623 22453 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.317130 22353 catalog_manager.cc:5697] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:10:40.319245 24845 raft_consensus.cc:2804] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:40.319125 25039 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:40.319775 24845 raft_consensus.cc:697] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:40.320789 22526 raft_consensus.cc:1240] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:40.321215 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:40.321856 22530 raft_consensus.cc:2393] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 6: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:40.324326 23087 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:40.325706 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:40.326387 22457 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.329723 22530 raft_consensus.cc:1240] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:40.332386 22421 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:40.333490 23087 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:40.262262 25090 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:40.342788 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:40.320470 24751 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:40.343053 25023 raft_consensus.cc:2804] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:40.353199 24992 raft_consensus.cc:2804] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:40.353685 24992 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:40.354171 24992 raft_consensus.cc:3060] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.357416 22606 raft_consensus.cc:1240] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:40.357868 22353 catalog_manager.cc:5697] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 1 to 3, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 3 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:40.332932 24943 raft_consensus.cc:2804] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:40.358969 22606 raft_consensus.cc:1240] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:40.359369 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:40.363672 22605 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.363821 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:40.353591 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:40.367337 22452 raft_consensus.cc:2393] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 7: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:40.367228 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:40.367988 23125 raft_consensus.cc:2393] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 6: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:40.368830 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:40.369390 22523 raft_consensus.cc:2376] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 5. Re-sending same reply.
I20260709 12:10:40.370453 22496 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:40.371002 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:40.371244 22606 raft_consensus.cc:1240] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:40.371904 25039 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:40.372085 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:40.341385 25068 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:40.327366 25067 raft_consensus.cc:697] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:40.373708 22531 raft_consensus.cc:1275] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:40.373797 25067 consensus_queue.cc:237] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:40.374527 25143 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:40.374701 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:40.370217 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:40.360607 22598 raft_consensus.cc:1240] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:40.372700 22532 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
I20260709 12:10:40.360967 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:40.362012 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:40.382364 22603 raft_consensus.cc:2393] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 5: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:40.377636 23119 raft_consensus.cc:1240] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:40.377032 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:40.383404 22528 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.375492 22531 raft_consensus.cc:2393] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 6: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
W20260709 12:10:40.377140 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.375934 23121 raft_consensus.cc:1240] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:40.361697 22601 raft_consensus.cc:1275] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:40.377715 24875 raft_consensus.cc:2804] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:40.385327 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:40.385579 24875 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.386022 24875 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.388123 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:40.388816 22523 raft_consensus.cc:2393] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 6: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:40.389592 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:40.390237 22523 raft_consensus.cc:2393] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 7: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:40.392346 23123 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5.
I20260709 12:10:40.381603 22604 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 4.
W20260709 12:10:40.448946 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 57441.8us
W20260709 12:10:40.417779 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 47429.5us
I20260709 12:10:40.417276 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:40.424886 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:40.332386 25140 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:40.416994 25023 raft_consensus.cc:697] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 4 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
W20260709 12:10:40.464517 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 86548.3us
I20260709 12:10:40.457298 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:40.334234 24845 consensus_queue.cc:237] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:40.250713 22351 rpcz_store.cc:276] 0709 12:10:29.840037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.840249 (+   212us) service_pool.cc:224] Handling call
0709 12:10:40.250170 (+10409921us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:33.425163 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:33.596835 (+171672us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:33.596872 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:10:33.596892 (+    20us) tablet.cc:662] Decoding operations
0709 12:10:33.683510 (+ 86618us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:33.683572 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:33.683603 (+    31us) tablet.cc:685] Acquiring locks for 22 operations
0709 12:10:33.685310 (+  1707us) tablet.cc:701] Row locks acquired
0709 12:10:33.685333 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:10:33.685487 (+   154us) write_op.cc:270] Start()
0709 12:10:33.685609 (+   122us) write_op.cc:276] Timestamp: P: 1783599033685441 usec, L: 0
0709 12:10:33.685634 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:10:33.691811 (+  6177us) log.cc:844] Serialized 8761 byte log entry
0709 12:10:35.424894 (+1733083us) op_driver.cc:464] REPLICATION: finished
0709 12:10:35.499597 (+ 74703us) write_op.cc:301] APPLY: starting
0709 12:10:35.499714 (+   117us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:35.500449 (+   735us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:35.500609 (+   160us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:35.785624 (+285015us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:35.836603 (+ 50979us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=22
0709 12:10:35.870787 (+ 34184us) write_op.cc:312] APPLY: finished
0709 12:10:35.871257 (+   470us) log.cc:844] Serialized 152 byte log entry
0709 12:10:35.871440 (+   183us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:35.871638 (+   198us) write_op.cc:454] Released schema lock
0709 12:10:35.871697 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:35.872113 (+   416us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:35.872141 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":40483,"reported_tablets":35,"child_traces":[["op",{"apply.queue_time_us":67935,"apply.run_cpu_time_us":6607,"apply.run_wall_time_us":372507,"num_ops":22,"prepare.queue_time_us":288075,"prepare.run_cpu_time_us":11559,"prepare.run_wall_time_us":1322741,"raft.queue_time_us":143329,"raft.run_cpu_time_us":12173,"raft.run_wall_time_us":134830,"replication_time_us":1700425,"thread_start_us":1237172,"threads_started":4,"wal-append.queue_time_us":1021805,"wal-append.run_cpu_time_us":22687,"wal-append.run_wall_time_us":2166421}]]}
W20260709 12:10:40.816867 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.557194 22528 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5.
I20260709 12:10:40.466368 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:40.539953 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:40.837702 22603 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:40.464149 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 73488.8us
I20260709 12:10:40.520490 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:40.839409 22531 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
I20260709 12:10:40.839694 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:40.840302 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:40.840576 22530 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
W20260709 12:10:40.841032 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.841403 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:40.828624 23117 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 5.
I20260709 12:10:40.841724 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:40.842834 24941 consensus_queue.cc:1048] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:40.845551 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:40.519887 25165 log.cc:927] Time spent T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 12:10:40.819042 22524 raft_consensus.cc:2393] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 6: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:40.525206 22457 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 5.
I20260709 12:10:40.375998 24892 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:10:40.528347 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 617510us
I20260709 12:10:40.848647 24892 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:40.815222 22569 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:40.540330 22527 raft_consensus.cc:2410] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:40.464102 23116 raft_consensus.cc:1240] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:40.561964 22605 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 6.
W20260709 12:10:40.816087 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.816649 23124 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 5.
I20260709 12:10:40.464339 25150 consensus_queue.cc:1059] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.359s
I20260709 12:10:40.823975 25141 consensus_queue.cc:1059] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:10:40.859128 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 44045.6us
W20260709 12:10:40.812469 25127 consensus_meta.cc:287] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.658s	user 0.008s	sys 0.002s
I20260709 12:10:40.859489 22457 pending_rounds.cc:85] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f: Aborting all ops after (but not including) 5
I20260709 12:10:40.504050 25047 consensus_queue.cc:1059] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.320s
I20260709 12:10:40.766623 22451 raft_consensus.cc:1240] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 12:10:40.779888 24744 consensus_meta.cc:287] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.549s	user 0.008s	sys 0.001s
I20260709 12:10:40.585235 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:40.458107 24936 raft_consensus.cc:2804] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:40.540454 22604 raft_consensus.cc:1240] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:40.465075 25140 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:40.827311 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.546818 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:40.867168 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.828500 22450 raft_consensus.cc:1275] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:40.505465 22526 raft_consensus.cc:2393] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 5: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:40.868834 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:40.872746 22526 raft_consensus.cc:2376] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 7. Re-sending same reply.
I20260709 12:10:40.374959 25068 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:10:40.829777 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 435535us
I20260709 12:10:40.584892 24621 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:40.830446 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:40.882186 22603 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 5.
W20260709 12:10:40.831848 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:40.847564 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 503894us
I20260709 12:10:40.886679 22497 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:40.849723 22570 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:40.850725 24782 consensus_queue.cc:1059] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:40.559634 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:40.850718 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:40.852587 24941 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:40.872062 22600 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.036s	sys 0.038s
I20260709 12:10:40.362375 24943 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.859894 22457 pending_rounds.cc:107] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:10:40.905411 22457 raft_consensus.cc:2889] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:40.360126 22353 catalog_manager.cc:5697] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: config changed from index 4 to 3, term changed from 3 to 4, leader changed from <none> to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131), 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from VOTER to NON_VOTER, now has a pending config: VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129), VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130), VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131), VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 4 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:40.464956 22454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 514) took 1434 ms. Trace:
I20260709 12:10:40.508314 22453 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 5.
I20260709 12:10:40.810500 25090 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:40.568643 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:40.559638 25027 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:10:40.853292 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 137362us
I20260709 12:10:40.896788 22602 raft_consensus.cc:2393] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 6: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:40.904198 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:40.907863 22455 raft_consensus.cc:1240] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:40.912249 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:40.882836 25067 raft_consensus.cc:2804] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:10:40.903863 22600 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.036s	sys 0.039s
I20260709 12:10:40.914517 22456 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.915942 22353 catalog_manager.cc:5697] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 2 to 4, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 4 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:40.919777 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:40.939239 22527 raft_consensus.cc:1275] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:40.907133 22454 rpcz_store.cc:276] 0709 12:10:39.030683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:39.031563 (+   880us) service_pool.cc:224] Handling call
0709 12:10:39.063623 (+ 32060us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:39.281177 (+217554us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:39.281211 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:39.291908 (+ 10697us) log.cc:844] Serialized 26 byte log entry
0709 12:10:39.375232 (+ 83324us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:39.472713 (+ 97481us) log.cc:844] Serialized 14 byte log entry
0709 12:10:39.473043 (+   330us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:40.345631 (+872588us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b18003c4720. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc780f2a6 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419
0709 12:10:40.464669 (+119038us) spinlock_profiling.cc:243] Waited 39.3 ms on lock 0x7b54002a5154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:40.464723 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:40.464768 (+    45us) raft_consensus.cc:1685] finished
0709 12:10:40.464779 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:40.464901 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7661,"prepare.queue_time_us":26969,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":23,"raft.queue_time_us":8205,"raft.run_cpu_time_us":352,"raft.run_wall_time_us":37444,"spinlock_wait_cycles":134283904,"thread_start_us":334676,"threads_started":3,"wal-append.queue_time_us":143771,"wal-append.run_cpu_time_us":3772,"wal-append.run_wall_time_us":1184902}
I20260709 12:10:40.896756 25134 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.921231 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:40.941867 23089 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:40.942873 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:40.943782 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 94138.4us
I20260709 12:10:40.945211 22528 raft_consensus.cc:2393] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 6: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:40.945761 22570 leader_election.cc:304] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:40.938436 22353 catalog_manager.cc:5697] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 1 to 3, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 3 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:40.933526 24936 raft_consensus.cc:697] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:40.912624 24943 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.865195 25127 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:40.940688 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:40.950459 22570 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:40.943234 22421 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:40.891544 25143 consensus_queue.cc:1059] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:10:40.953409 22530 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 5.
I20260709 12:10:40.946928 24933 consensus_queue.cc:1059] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:10:40.954892 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:40.905366 24756 consensus_queue.cc:1059] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:10:40.951573 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:40.955457 22353 catalog_manager.cc:5697] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 1 to 3, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 3 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:40.969971 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:40.962314 22531 raft_consensus.cc:1275] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:40.964075 22421 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
W20260709 12:10:40.947496 24875 consensus_meta.cc:287] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.558s	user 0.010s	sys 0.000s
I20260709 12:10:40.966123 22605 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5.
I20260709 12:10:40.888531 24744 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:40.936890 25150 raft_consensus.cc:3055] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:40.949729 25067 raft_consensus.cc:697] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:40.966650 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:40.970767 22524 raft_consensus.cc:2393] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 6: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:40.906534 24941 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:41.023399 24941 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:41.023976 24941 consensus_queue.cc:1059] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:10:41.024520 24992 consensus_meta.cc:287] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.670s	user 0.003s	sys 0.007s
I20260709 12:10:40.935216 25027 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:40.972330 22421 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:40.975390 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:41.025954 24782 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.026198 25047 raft_consensus.cc:3055] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:41.026093 25067 consensus_queue.cc:237] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:41.026659 25047 raft_consensus.cc:740] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:41.026506 24782 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:41.027616 25047 consensus_queue.cc:260] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:41.028592 24782 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:41.028820 25047 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.996732 24751 raft_consensus.cc:2749] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:41.030019 25173 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.998207 25023 consensus_queue.cc:237] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:41.030514 25173 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:41.032629 25173 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:41.033450 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:41.034021 25138 raft_consensus.cc:3055] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:41.034430 25190 raft_consensus.cc:2804] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:41.035015 25190 raft_consensus.cc:697] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:41.035938 25190 consensus_queue.cc:237] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:41.037704 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 65478.2us
I20260709 12:10:41.038552 22421 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:41.039129 25167 consensus_queue.cc:1059] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:41.039763 22421 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:41.040022 25167 raft_consensus.cc:3055] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:40.965999 25144 raft_consensus.cc:2804] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:40.996460 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.998108 22529 raft_consensus.cc:2393] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 5: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:40.947460 25141 raft_consensus.cc:3055] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:41.000639 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:41.059532 23122 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:41.008550 25180 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.009446 25176 consensus_queue.cc:1059] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:40.897744 24621 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:40.956722 24994 raft_consensus.cc:2804] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:41.015512 22450 raft_consensus.cc:1240] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:41.017468 24936 consensus_queue.cc:237] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:41.018893 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:41.108903 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:41.024943 24992 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:40.960915 25039 raft_consensus.cc:2749] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:40.976378 22455 raft_consensus.cc:1275] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:41.054263 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:41.056942 23121 raft_consensus.cc:1275] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:40.970667 24333 raft_consensus.cc:2804] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:41.057314 24863 raft_consensus.cc:2804] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:41.091224 24751 raft_consensus.cc:2749] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:41.144380 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 257771us
I20260709 12:10:41.059303 25141 raft_consensus.cc:740] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:41.154548 22598 raft_consensus.cc:1240] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:41.080147 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 180519us
I20260709 12:10:41.091261 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:41.094310 22524 raft_consensus.cc:1275] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:41.096771 22456 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 5.
I20260709 12:10:41.026831 24756 raft_consensus.cc:3055] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:10:41.108857 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 66507.4us
I20260709 12:10:41.040371 25167 raft_consensus.cc:740] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:41.114041 22454 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.965687 24993 consensus_queue.cc:1048] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.125s
I20260709 12:10:41.121476 22601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0da3e85670e74df8af94383289960785"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:10:41.158370 22601 raft_consensus.cc:606] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Received request to transfer leadership to TS 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:41.158691 22601 raft_consensus.cc:614] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:41.112334 24994 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:41.123546 22450 raft_consensus.cc:1240] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:41.010848 24875 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:41.124022 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:41.124683 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:41.127199 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:41.130896 22495 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:41.011157 25150 raft_consensus.cc:740] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:41.183571 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:41.138237 23122 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:10:41.055593 25144 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:41.055075 25178 raft_consensus.cc:3055] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:40.952819 25134 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:41.146970 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:41.191009 22451 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:41.034443 25138 raft_consensus.cc:740] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
W20260709 12:10:41.156419 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 238340us
I20260709 12:10:41.109145 25090 raft_consensus.cc:2749] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:41.122234 24621 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:41.109704 24845 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.160329 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:41.155390 23087 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:41.157624 23088 leader_election.cc:336] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 2.210s (SENT)
I20260709 12:10:41.183188 25039 raft_consensus.cc:2749] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:41.164048 22452 raft_consensus.cc:2393] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 5: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:41.170079 22525 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
I20260709 12:10:41.184207 22602 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 5.
I20260709 12:10:41.197643 22496 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:41.219926 22455 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:41.220762 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:41.191183 25144 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:41.173388 24994 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:41.166287 24333 raft_consensus.cc:697] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:41.212860 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:41.165129 24863 raft_consensus.cc:697] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 5 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:41.160527 24756 raft_consensus.cc:740] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
W20260709 12:10:41.247072 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 91747.8us
I20260709 12:10:41.221108 22448 raft_consensus.cc:1240] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:41.226629 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:41.227428 22527 raft_consensus.cc:2393] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 5: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:41.150970 25196 consensus_queue.cc:1059] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 12:10:41.234021 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:41.234894 22604 raft_consensus.cc:1275] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:41.190750 25178 raft_consensus.cc:740] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:41.236763 22529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56942 (request call id 1495) took 1133 ms. Trace:
I20260709 12:10:41.196431 24751 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:41.131808 25180 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:41.239176 22450 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
I20260709 12:10:41.245736 22451 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:10:41.217264 25177 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.250684 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:41.303944 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:10:41.271621 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:41.254756 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 97185.6us
W20260709 12:10:41.343374 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.348675 22601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "263d51d0b43744d899e37466045af890"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:60938
W20260709 12:10:41.253778 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 122958us
W20260709 12:10:41.306017 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 58185.4us
I20260709 12:10:41.251822 22497 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
W20260709 12:10:41.250818 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 211099us
I20260709 12:10:41.355552 22495 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:41.236558 25090 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:10:41.311730 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 125652us
I20260709 12:10:41.305790 25023 raft_consensus.cc:2749] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:41.239742 25068 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.334022 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:41.355584 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 103891us
I20260709 12:10:41.379173 22448 raft_consensus.cc:2468] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 4.
I20260709 12:10:41.356287 22421 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:41.241504 24845 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:41.219856 25189 consensus_queue.cc:1059] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.145s
W20260709 12:10:41.358316 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:41.360167 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 117844us
I20260709 12:10:41.310057 22529 rpcz_store.cc:276] 0709 12:10:40.091728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.091906 (+   178us) service_pool.cc:224] Handling call
0709 12:10:41.224839 (+1132933us) spinlock_profiling.cc:243] Waited 898 ms on lock 0x7b5400262d54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:41.224963 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2064579328}
I20260709 12:10:41.305387 25188 raft_consensus.cc:2749] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:41.396072 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:41.396679 22452 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 5.
I20260709 12:10:41.380736 22421 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:41.309649 22455 raft_consensus.cc:2393] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 5: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:41.401404 22570 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:10:41.368289 22569 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:41.373942 22422 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:10:41.370819 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.307881 24892 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:41.409320 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:41.365285 25202 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:41.399966 22599 raft_consensus.cc:1240] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:41.412369 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 44129.3us
I20260709 12:10:41.365108 25173 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:41.414647 22455 raft_consensus.cc:1240] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:41.364403 25127 leader_election.cc:290] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:41.340735 24751 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:41.395001 25190 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.316679 25141 consensus_queue.cc:260] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:41.401154 24744 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:41.425103 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 51263.5us
I20260709 12:10:41.373467 24621 consensus_queue.cc:1048] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:10:41.308310 25150 consensus_queue.cc:260] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:41.374004 25067 consensus_queue.cc:1048] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:10:41.417762 25189 raft_consensus.cc:2804] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:41.434455 24892 raft_consensus.cc:2804] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:41.387483 25090 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:41.437405 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.397509 25068 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:41.443022 25197 log.cc:927] Time spent T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:10:41.444572 25068 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:41.446676 25090 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:41.439054 22448 raft_consensus.cc:1275] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:41.420674 24933 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:41.441699 24875 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:41.442129 25150 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:41.470644 23088 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:41.425370 25188 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:41.448537 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.456496 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:41.421720 25196 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:41.470014 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 89356.4us
I20260709 12:10:41.432657 25127 raft_consensus.cc:2749] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:41.343571 25167 consensus_queue.cc:260] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:41.435091 24992 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:41.425047 25173 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:41.478186 25134 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:41.427711 24863 consensus_queue.cc:237] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:41.481189 23088 leader_election.cc:304] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:41.357434 25138 consensus_queue.cc:260] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:41.475033 24933 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:41.414431 24756 consensus_queue.cc:260] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:41.429843 25190 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:41.423192 24333 consensus_queue.cc:237] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:41.423578 25202 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:41.365749 25177 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:41.474648 25200 log.cc:927] Time spent T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
I20260709 12:10:41.605832 22454 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:41.589251 22526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 1875) took 1220 ms. Trace:
W20260709 12:10:41.636439 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 148706us
W20260709 12:10:41.640966 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 246480us
W20260709 12:10:41.648828 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 451242us
I20260709 12:10:41.474992 25141 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:41.683096 22570 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:41.683188 22496 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:41.684819 22421 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:41.447173 25213 raft_consensus.cc:2749] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:41.475179 25189 raft_consensus.cc:697] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:41.656175 22526 rpcz_store.cc:276] 0709 12:10:40.368726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.892079 (+523353us) service_pool.cc:224] Handling call
0709 12:10:40.892397 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:40.981130 (+ 88733us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:40.981173 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:41.057018 (+ 75845us) log.cc:844] Serialized 26 byte log entry
0709 12:10:41.386897 (+329879us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:41.386937 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:41.387032 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:41.589023 (+201991us) raft_consensus.cc:1685] finished
0709 12:10:41.589045 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:41.589190 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41082,"raft.queue_time_us":126645,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"thread_start_us":283419,"threads_started":2,"wal-append.queue_time_us":317640}
I20260709 12:10:41.479647 25090 raft_consensus.cc:2804] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:41.583529 25143 raft_consensus.cc:3055] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:10:41.699656 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 218547us
I20260709 12:10:41.481822 25188 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:41.701253 23088 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:10:41.642707 25172 log.cc:927] Time spent T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.420s	user 0.001s	sys 0.000s
I20260709 12:10:41.690243 22570 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:41.492478 25023 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:41.484540 25039 raft_consensus.cc:2764] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:41.692464 22421 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:41.480110 24892 raft_consensus.cc:697] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
W20260709 12:10:41.696583 22449 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.016s	sys 0.009s
I20260709 12:10:41.484615 24950 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:41.723600 22449 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.016s	sys 0.009s
I20260709 12:10:41.487514 25196 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:41.476020 25067 consensus_queue.cc:1059] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.216s
I20260709 12:10:41.571928 25187 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:10:41.702641 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 347163us
W20260709 12:10:41.624678 25166 log.cc:927] Time spent T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.320s	user 0.000s	sys 0.001s
I20260709 12:10:41.649899 24744 consensus_queue.cc:1059] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
W20260709 12:10:41.752628 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 60236.8us
I20260709 12:10:41.699612 25143 raft_consensus.cc:740] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:41.762147 22421 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:41.713174 25204 raft_consensus.cc:2749] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:41.756997 22495 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:41.757282 22449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2123) took 1072 ms. Trace:
I20260709 12:10:41.577664 25184 consensus_queue.cc:1048] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.269s
I20260709 12:10:41.708515 25188 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:41.699769 25090 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:41.751726 25068 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:41.766175 22449 rpcz_store.cc:276] 0709 12:10:40.685417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.685650 (+   233us) service_pool.cc:224] Handling call
0709 12:10:40.694120 (+  8470us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:40.852419 (+158299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:40.852456 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:40.853017 (+   561us) log.cc:844] Serialized 52 byte log entry
0709 12:10:40.912190 (+ 59173us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:41.748875 (+836685us) log.cc:844] Serialized 14 byte log entry
0709 12:10:41.756771 (+  7896us) log.cc:844] Serialized 14 byte log entry
0709 12:10:41.756965 (+   194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:41.757041 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:41.757091 (+    50us) raft_consensus.cc:1685] finished
0709 12:10:41.757102 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:41.757227 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":160677,"prepare.queue_time_us":660001,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":71,"raft.queue_time_us":164117,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":4968,"thread_start_us":832255,"threads_started":2,"wal-append.queue_time_us":153299}
I20260709 12:10:41.757741 24875 raft_consensus.cc:2749] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:41.759389 24992 raft_consensus.cc:2749] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:41.779282 22421 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:41.755788 25196 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:41.805387 22421 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:10:41.790227 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 107522us
I20260709 12:10:41.764278 25180 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:41.803195 25179 log.cc:927] Time spent T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.368s	user 0.000s	sys 0.001s
I20260709 12:10:41.774928 25090 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:41.755630 24950 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:41.806455 25211 log.cc:927] Time spent T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:10:41.813396 24892 consensus_queue.cc:237] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:41.814172 24933 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:10:41.817446 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 116263us
I20260709 12:10:41.776435 25134 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:41.841403 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.788563 25175 raft_consensus.cc:3055] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:41.803655 25213 raft_consensus.cc:2749] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:41.808065 25204 raft_consensus.cc:2804] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:41.833609 23088 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:10:41.831879 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 142617us
I20260709 12:10:41.835680 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:41.807480 24845 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:41.822085 22495 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:41.814940 24751 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:41.835619 22454 raft_consensus.cc:1240] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:41.820868 25067 raft_consensus.cc:2804] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:41.822512 24992 raft_consensus.cc:2804] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:41.761229 25187 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:41.882462 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:41.883307 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:41.892206 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 58672.1us
I20260709 12:10:41.884456 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:41.885205 22456 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 7.
I20260709 12:10:41.894958 25234 raft_consensus.cc:2804] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:41.895423 25184 raft_consensus.cc:2749] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:41.895913 22597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2265) took 1541 ms. Trace:
W20260709 12:10:41.889271 25216 log.cc:927] Time spent T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.262s	user 0.000s	sys 0.001s
I20260709 12:10:41.896365 25202 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:41.896648 22452 raft_consensus.cc:1275] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:41.899407 22603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2272) took 1015 ms. Trace:
I20260709 12:10:41.900153 22600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 1895) took 2125 ms. Trace:
W20260709 12:10:41.901696 25222 log.cc:927] Time spent T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 12:10:41.902338 25140 consensus_meta.cc:287] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.999s	user 0.002s	sys 0.006s
W20260709 12:10:41.914244 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 92283.9us
I20260709 12:10:41.915282 22570 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:10:41.920658 22448 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 5.
I20260709 12:10:41.883741 25225 raft_consensus.cc:2804] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:41.889511 24933 raft_consensus.cc:3055] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:41.915086 25067 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:41.891367 25175 raft_consensus.cc:740] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:41.849910 25204 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:41.826327 25143 consensus_queue.cc:260] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:41.965657 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:41.949488 23088 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:41.915762 25127 raft_consensus.cc:2749] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:41.952565 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:41.953318 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:41.954432 22570 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:41.916569 24845 consensus_queue.cc:1059] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:10:41.930439 22603 rpcz_store.cc:276] 0709 12:10:40.884290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.884484 (+   194us) service_pool.cc:224] Handling call
0709 12:10:40.884828 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:40.939272 (+ 54444us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:41.064308 (+125036us) log.cc:844] Serialized 14 byte log entry
0709 12:10:41.419330 (+355022us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:41.420101 (+   771us) log.cc:844] Serialized 26 byte log entry
0709 12:10:41.420245 (+   144us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:41.420288 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:41.421068 (+   780us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:41.899196 (+478128us) raft_consensus.cc:1685] finished
0709 12:10:41.899219 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:41.899349 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31985,"prepare.queue_time_us":359322,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":79291,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":23644,"thread_start_us":361608,"threads_started":2,"wal-append.queue_time_us":306256}
I20260709 12:10:41.927910 22597 rpcz_store.cc:276] 0709 12:10:40.354833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.359456 (+  4623us) service_pool.cc:224] Handling call
0709 12:10:40.359786 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:40.540799 (+181013us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:40.547044 (+  6245us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:40.848835 (+301791us) log.cc:844] Serialized 26 byte log entry
0709 12:10:40.954557 (+105722us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:40.959526 (+  4969us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:40.975160 (+ 15634us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:41.849752 (+874592us) raft_consensus.cc:1685] finished
0709 12:10:41.884895 (+ 35143us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:41.895840 (+ 10945us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":118092,"raft.queue_time_us":105871,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":19354,"thread_start_us":69635,"threads_started":1,"wal-append.queue_time_us":530057}
I20260709 12:10:41.944489 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:41.963235 22495 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:41.926599 25234 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:10:41.949553 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 140921us
I20260709 12:10:41.815243 25189 consensus_queue.cc:237] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:41.966454 25039 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.958817 24933 raft_consensus.cc:740] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:41.962877 24992 raft_consensus.cc:697] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:41.964100 25067 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:41.982259 22569 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.016s	sys 0.029s
I20260709 12:10:41.983322 22454 raft_consensus.cc:2376] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4. Re-sending same reply.
W20260709 12:10:42.004230 22569 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.016s	sys 0.029s
W20260709 12:10:41.984387 25182 log.cc:927] Time spent T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.280s	user 0.000s	sys 0.001s
I20260709 12:10:41.990809 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:41.965492 25204 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:41.971117 25228 raft_consensus.cc:2804] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:41.952301 25140 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:41.992411 24936 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.996193 23088 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:41.971836 25190 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:42.005419 22456 raft_consensus.cc:1240] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:41.983841 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 45592.5us
I20260709 12:10:42.069497 22421 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:41.851246 25134 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:41.988412 25184 raft_consensus.cc:2749] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:41.999449 25143 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:41.987962 25234 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.000348 25127 raft_consensus.cc:2749] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:42.010258 25175 consensus_queue.cc:260] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:42.073825 22454 raft_consensus.cc:1275] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:42.020684 24992 consensus_queue.cc:237] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:42.072562 24936 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:42.075883 25202 raft_consensus.cc:2749] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:42.077239 25229 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.077096 25230 consensus_queue.cc:1059] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.115s
I20260709 12:10:42.072409 24621 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.107707 24941 raft_consensus.cc:2804] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:42.077816 25223 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.077950 25233 raft_consensus.cc:2749] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:42.079466 24950 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:42.076929 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 88574.2us
I20260709 12:10:42.119061 25214 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:42.078835 25171 log.cc:927] Time spent T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.233s	user 0.000s	sys 0.000s
I20260709 12:10:42.110427 22456 raft_consensus.cc:1240] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:10:42.006827 25039 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:42.147193 22523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 1872) took 1779 ms. Trace:
W20260709 12:10:42.113879 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 137797us
W20260709 12:10:42.118010 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:42.131793 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 168623us
W20260709 12:10:42.148882 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.137099 23088 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:42.090387 22421 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:10:42.151829 25192 log.cc:927] Time spent T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:10:42.152491 22495 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:42.153712 22495 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:42.144062 24845 consensus_queue.cc:1048] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:10:42.155413 25242 raft_consensus.cc:2749] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:42.156159 25242 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:42.156620 25242 raft_consensus.cc:697] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:42.157043 25241 consensus_queue.cc:1048] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:42.157526 25242 consensus_queue.cc:237] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:42.119253 25190 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:10:42.161257 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.091595 25225 raft_consensus.cc:697] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:42.172138 23121 raft_consensus.cc:1275] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:42.166365 25184 raft_consensus.cc:2749] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:42.173588 23119 raft_consensus.cc:1275] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:41.936028 22600 rpcz_store.cc:276] 0709 12:10:39.757016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:39.759157 (+  2141us) service_pool.cc:224] Handling call
0709 12:10:39.762679 (+  3522us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:39.786934 (+ 24255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:39.786998 (+    64us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:40.331434 (+544436us) spinlock_profiling.cc:243] Waited 1.88 ms on lock 0x7b2c000fd4f8. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc9227a11 00007f9cc9237372 00007f9cca969a01 00007f9cca92e43a 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2
0709 12:10:40.331889 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 12:10:40.953136 (+621247us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:40.960803 (+  7667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:40.969970 (+  9167us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:41.804394 (+834424us) raft_consensus.cc:1685] finished
0709 12:10:41.806881 (+  2487us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:41.882640 (+ 75759us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15622,"raft.queue_time_us":22672,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":7998,"spinlock_wait_cycles":4318464,"thread_start_us":606928,"threads_started":1,"wal-append.queue_time_us":780747}
I20260709 12:10:42.174721 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:42.175344 23125 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
I20260709 12:10:42.175634 24936 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:42.161932 24941 raft_consensus.cc:697] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:42.176256 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:42.145183 25175 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:42.176942 24941 consensus_queue.cc:237] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:42.188118 22448 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
W20260709 12:10:42.191037 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 116541us
I20260709 12:10:42.191799 22421 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:10:42.196475 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 59444.5us
I20260709 12:10:42.197265 23088 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:10:42.167106 24994 consensus_meta.cc:287] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.862s	user 0.009s	sys 0.003s
I20260709 12:10:42.198900 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:42.205497 23117 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
I20260709 12:10:42.202150 22421 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:42.208997 23088 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:42.209043 25232 raft_consensus.cc:2764] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 12:10:42.207096 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 43892.5us
I20260709 12:10:42.150198 25214 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:42.217258 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:42.195276 25230 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.193818 25202 raft_consensus.cc:2749] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:42.145505 24621 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:42.250258 22525 raft_consensus.cc:1240] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:42.229710 25214 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:42.230181 24333 consensus_queue.cc:1048] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:42.230893 25240 consensus_queue.cc:1048] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:42.232091 25226 raft_consensus.cc:2749] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:42.233685 25225 consensus_queue.cc:237] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:42.234453 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:42.275302 22531 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.235755 22529 raft_consensus.cc:1275] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:42.236531 25177 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:42.238725 22495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:42.221149 25047 consensus_meta.cc:287] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 1.184s	user 0.008s	sys 0.005s
I20260709 12:10:42.224609 22570 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:10:42.283180 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 58648.9us
I20260709 12:10:42.253830 25175 raft_consensus.cc:2749] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:42.223429 25184 consensus_queue.cc:1048] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.050s
W20260709 12:10:42.311617 24943 consensus_meta.cc:287] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 1.345s	user 0.011s	sys 0.002s
I20260709 12:10:42.312162 24943 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:42.284775 25214 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.313597 25214 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:42.215615 24994 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:42.315652 22601 raft_consensus.cc:606] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Received request to transfer leadership to TS 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:42.316007 22601 raft_consensus.cc:614] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:42.317245 24994 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:42.318255 22601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:60938 (request call id 17) took 1010 ms. Trace:
I20260709 12:10:42.318598 22601 rpcz_store.cc:276] 0709 12:10:41.308255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.308421 (+   166us) service_pool.cc:224] Handling call
0709 12:10:42.318067 (+1009646us) spinlock_profiling.cc:243] Waited 966 ms on lock 0x7b54000ec254. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca928853 00007f9ccf8f660a 00007f9cc8e7c7d4 00007f9cc8e7c762 00007f9cc8e7c691 00007f9cc8e7c60c 00007f9cc8e7b8c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:42.318167 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2222385536}
I20260709 12:10:42.249060 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:10:42.229256 25215 log.cc:927] Time spent T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 12:10:42.207278 25213 raft_consensus.cc:2804] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:42.253545 22527 raft_consensus.cc:1275] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:42.213652 25027 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:42.322198 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:42.136978 25229 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:42.178122 25190 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:42.327517 25190 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:42.327556 25229 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:42.271387 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 55675us
I20260709 12:10:42.271354 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:42.272049 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 63115.7us
I20260709 12:10:42.330610 23088 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:42.332609 23088 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:42.243536 25241 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.243526 24845 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.132874 24933 consensus_queue.cc:260] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:42.224684 25228 raft_consensus.cc:697] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:42.314743 24943 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:42.283104 25187 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:42.347966 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:42.249501 25230 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:42.282261 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:42.289361 25144 consensus_meta.cc:287] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.983s	user 0.009s	sys 0.000s
I20260709 12:10:42.291213 25177 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:42.293017 25150 consensus_meta.cc:287] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.808s	user 0.007s	sys 0.001s
W20260709 12:10:42.296402 25188 consensus_meta.cc:287] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.512s	user 0.006s	sys 0.004s
I20260709 12:10:42.296761 24621 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:42.297314 25039 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:42.298460 25223 raft_consensus.cc:2749] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:42.299762 23118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 918) took 2052 ms. Trace:
I20260709 12:10:42.274761 24751 consensus_queue.cc:1048] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:10:42.304854 24950 raft_consensus.cc:2804] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:42.377758 24950 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.378324 24950 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:42.378609 25068 consensus_meta.cc:287] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.594s	user 0.010s	sys 0.000s
I20260709 12:10:42.377008 23118 rpcz_store.cc:276] 0709 12:10:40.247029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.247154 (+   125us) service_pool.cc:224] Handling call
0709 12:10:40.247488 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:40.340087 (+ 92599us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:40.360458 (+ 20371us) log.cc:844] Serialized 14 byte log entry
0709 12:10:40.889703 (+529245us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:40.956402 (+ 66699us) log.cc:844] Serialized 26 byte log entry
0709 12:10:40.976029 (+ 19627us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:40.997583 (+ 21554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:41.019721 (+ 22138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:42.299483 (+1279762us) raft_consensus.cc:1685] finished
0709 12:10:42.299509 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:42.299687 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43357,"prepare.queue_time_us":18627,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":327295,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":6336,"thread_start_us":531806,"threads_started":3,"wal-append.queue_time_us":1416774}
I20260709 12:10:42.379609 25134 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:42.380355 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:10:42.306644 25141 consensus_meta.cc:287] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.617s	user 0.003s	sys 0.005s
I20260709 12:10:42.156150 25196 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:42.383919 25196 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:42.333638 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:42.387176 22599 raft_consensus.cc:1275] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:42.387476 23123 raft_consensus.cc:2410] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
W20260709 12:10:42.330989 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 87108.4us
I20260709 12:10:42.335748 23087 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:42.337397 22601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:10:42.388479 22601 raft_consensus.cc:606] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:10:42.387190 22604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 1901) took 1492 ms. Trace:
I20260709 12:10:42.284610 22570 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:10:42.389751 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 105205us
W20260709 12:10:42.359170 25090 consensus_meta.cc:287] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.520s	user 0.011s	sys 0.001s
I20260709 12:10:42.403460 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:42.405315 22602 raft_consensus.cc:2393] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 6: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:42.356410 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:42.356570 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:42.335947 25184 raft_consensus.cc:2749] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:42.353828 25027 raft_consensus.cc:2804] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:42.337653 25213 raft_consensus.cc:697] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:42.359043 25177 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:42.369059 23116 raft_consensus.cc:1240] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 5 LEADER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:42.362150 25188 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:42.415071 22531 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:10:42.356362 25144 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:42.359561 24933 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.324455 25214 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:42.416389 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:42.417049 22531 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.399513 22530 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 5.
I20260709 12:10:42.403460 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:42.406478 22527 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:42.407554 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:42.389041 22604 rpcz_store.cc:276] 0709 12:10:40.895122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.905153 (+ 10031us) service_pool.cc:224] Handling call
0709 12:10:40.936444 (+ 31291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:41.309157 (+372713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:42.386897 (+1077740us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b54003507d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:42.387119 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":660778368}
I20260709 12:10:42.348809 25175 consensus_queue.cc:1048] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:10:42.410324 22570 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:42.337620 24845 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:42.360551 22597 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 7.
W20260709 12:10:42.410398 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 74722.8us
I20260709 12:10:42.385808 25039 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.410251 25249 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.412225 23120 raft_consensus.cc:2410] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:42.339282 25241 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:42.420822 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:42.436777 22531 raft_consensus.cc:2468] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 6.
I20260709 12:10:42.437527 24993 raft_consensus.cc:3055] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:42.442766 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:42.442945 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:42.404081 25068 raft_consensus.cc:2749] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:42.439790 23087 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:42.442175 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:42.442461 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:42.411269 25233 raft_consensus.cc:2804] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:42.449319 22528 raft_consensus.cc:2393] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 6: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:42.450519 22605 raft_consensus.cc:2393] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 5: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:42.448426 22604 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 8.
I20260709 12:10:42.438630 25177 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:42.423537 24744 raft_consensus.cc:2804] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:42.468542 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:42.432344 25027 raft_consensus.cc:697] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 4 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:42.446662 25180 consensus_queue.cc:1059] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:10:42.472548 22570 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:42.442927 24993 raft_consensus.cc:740] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:42.479420 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:10:42.479851 25239 log.cc:927] Time spent T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 12:10:42.480664 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:42.480804 25241 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:42.481856 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:42.482463 23116 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:42.482908 25246 log.cc:927] Time spent T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:10:42.483115 22603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb7fd922979743428612619e8de33af1"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:10:42.414291 25090 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:42.473187 23121 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:42.424443 25224 consensus_queue.cc:1048] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:10:42.477550 25187 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:42.549482 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.522636 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:42.470875 22531 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 5.
I20260709 12:10:42.420395 25196 consensus_queue.cc:1059] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:10:42.483670 22603 raft_consensus.cc:606] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Received request to transfer leadership to TS 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:42.459600 25233 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:42.525279 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 52805us
I20260709 12:10:42.473816 24621 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:42.462841 24333 raft_consensus.cc:2749] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:42.474603 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:42.424548 25223 consensus_queue.cc:1048] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:10:42.449519 25249 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:42.580406 25249 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:42.538329 25230 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:42.442178 25245 consensus_queue.cc:1048] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
W20260709 12:10:42.539130 25067 consensus_meta.cc:287] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.516s	user 0.008s	sys 0.002s
I20260709 12:10:42.479357 24993 consensus_queue.cc:260] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:42.529928 25150 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:42.529243 24941 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:42.586501 25067 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:42.586861 25150 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:42.587020 24941 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:42.588617 25067 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:42.588932 25150 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:42.447816 25228 consensus_queue.cc:237] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:42.589154 24941 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:42.532716 24863 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:42.550586 22527 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:42.552351 25241 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.552111 25214 consensus_queue.cc:1059] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:42.552883 25213 consensus_queue.cc:237] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:42.530174 25243 raft_consensus.cc:2804] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:42.555372 23088 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:42.524909 25177 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.556658 25144 leader_election.cc:290] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:42.557359 25261 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.601140 25243 raft_consensus.cc:697] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:42.601478 25261 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:42.602180 25243 consensus_queue.cc:237] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:42.603667 25261 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:42.446264 25039 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:42.606526 25039 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:42.599735 25214 consensus_queue.cc:1243] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer 8701cd5186a949538d8efafb5f987270 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:10:42.611016 25090 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:42.612092 25207 log.cc:927] Time spent T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 1.174s	user 0.000s	sys 0.005s
I20260709 12:10:42.613250 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:42.615384 22527 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 5.
I20260709 12:10:42.564576 22603 raft_consensus.cc:614] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:42.527381 24889 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.618253 24889 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:42.620913 24889 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:42.565815 22452 raft_consensus.cc:2393] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 5: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:42.474315 25184 consensus_queue.cc:1048] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:10:42.598508 25241 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:42.599434 25177 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:42.630132 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:42.593263 24863 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:42.632102 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:42.633102 24863 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:42.633692 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:42.634006 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:42.634806 22525 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.635396 24845 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:42.600134 25223 raft_consensus.cc:2804] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:42.636138 25223 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.636489 25223 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.638300 22569 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:42.639391 24845 raft_consensus.cc:2749] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:42.640954 22495 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:42.147552 22523 rpcz_store.cc:276] 0709 12:10:40.367984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.465375 (+ 97391us) service_pool.cc:224] Handling call
0709 12:10:40.838307 (+372932us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:40.998535 (+160228us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:41.248489 (+249954us) log.cc:844] Serialized 14 byte log entry
0709 12:10:41.636898 (+388409us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:41.656316 (+ 19418us) log.cc:844] Serialized 26 byte log entry
0709 12:10:41.656451 (+   135us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:41.656636 (+   185us) log.cc:844] Serialized 14 byte log entry
0709 12:10:41.767897 (+111261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:41.768305 (+   408us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:42.146974 (+378669us) raft_consensus.cc:1685] finished
0709 12:10:42.147011 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:42.147139 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15354,"prepare.queue_time_us":1125314,"raft.queue_time_us":360522,"raft.run_cpu_time_us":3688,"raft.run_wall_time_us":43051,"spinlock_wait_cycles":81487232,"thread_start_us":681732,"threads_started":4,"wal-append.queue_time_us":449399}
W20260709 12:10:42.643224 25143 consensus_meta.cc:287] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.508s	user 0.007s	sys 0.004s
I20260709 12:10:42.644495 24756 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.646931 22495 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:10:42.566011 23121 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 5.
W20260709 12:10:42.566820 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.567346 22570 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:42.565634 24751 consensus_queue.cc:1048] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
W20260709 12:10:42.571275 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 123606us
I20260709 12:10:42.662714 23087 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:42.530738 25068 raft_consensus.cc:3055] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:42.663612 25068 raft_consensus.cc:740] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:42.527573 24744 raft_consensus.cc:697] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 5 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:42.667400 25068 consensus_queue.cc:260] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:42.667646 24744 consensus_queue.cc:237] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:42.669057 25068 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.669603 25173 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:42.582152 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:42.463243 25234 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:42.578223 25248 log.cc:927] Time spent T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 12:10:42.582538 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:42.561803 25027 consensus_queue.cc:237] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:42.585487 22421 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:10:42.581362 23116 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:10:42.581375 25249 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.681391 23087 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:42.681591 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:42.682508 23087 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:42.551820 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:42.572461 25233 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.685230 25196 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.685384 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:42.685837 25196 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:42.671702 25234 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:42.687150 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:42.687781 25234 raft_consensus.cc:2804] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:42.687891 22456 raft_consensus.cc:2393] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 6: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:42.687956 25196 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:42.688274 25234 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:42.688766 25234 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.570221 24621 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:42.689531 24621 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:42.690196 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:42.690814 23124 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 5.
I20260709 12:10:42.692155 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:42.614051 23119 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 6.
I20260709 12:10:42.562829 25187 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:42.618285 22457 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2126) took 1759 ms. Trace:
I20260709 12:10:42.693655 22496 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:42.688781 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:42.667412 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:42.563846 25023 consensus_meta.cc:287] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.846s	user 0.009s	sys 0.004s
I20260709 12:10:42.664839 25189 raft_consensus.cc:2804] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:42.674877 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:42.677352 22455 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 5.
W20260709 12:10:42.678493 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 111225us
I20260709 12:10:42.679198 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:42.684758 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:42.704772 22450 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.704931 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:42.662705 25150 raft_consensus.cc:3060] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:42.689576 24863 raft_consensus.cc:2804] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:42.686745 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:42.673614 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:42.693572 22457 rpcz_store.cc:276] 0709 12:10:40.858755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.858910 (+   155us) service_pool.cc:224] Handling call
0709 12:10:40.859291 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:40.935787 (+ 76496us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:40.935832 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:40.947842 (+ 12010us) log.cc:844] Serialized 26 byte log entry
0709 12:10:41.236876 (+289034us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:41.648146 (+411270us) log.cc:844] Serialized 14 byte log entry
0709 12:10:41.648461 (+   315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:41.648574 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:42.554831 (+906257us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:10:42.613176 (+ 58345us) raft_consensus.cc:1685] finished
0709 12:10:42.618098 (+  4922us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:42.618229 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":513485,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":136,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":37070,"spinlock_wait_cycles":41786240,"thread_start_us":536492,"threads_started":2,"wal-append.queue_time_us":435541}
I20260709 12:10:42.717211 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:42.661692 25177 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:42.703069 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:42.720830 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:42.721432 22456 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:10:42.722337 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:42.703668 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:42.661818 25241 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:42.672876 24889 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.660465 22525 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:10:42.713593 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:42.714286 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 117687us
W20260709 12:10:42.729700 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.730198 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:42.718806 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:42.726040 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:42.731067 22525 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
I20260709 12:10:42.726321 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:42.731434 22457 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:10:42.732501 22455 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
I20260709 12:10:42.732707 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:42.730471 23088 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:42.735100 22456 raft_consensus.cc:1275] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:42.733287 22525 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.737844 22451 raft_consensus.cc:1275] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:42.711829 25189 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.702770 25225 raft_consensus.cc:2804] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:42.703220 25184 raft_consensus.cc:2749] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:42.713091 25023 raft_consensus.cc:2749] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:42.743376 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:42.672024 25230 consensus_queue.cc:1048] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:10:42.754611 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:42.755432 22531 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:42.755861 22457 raft_consensus.cc:1275] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:10:42.750861 22450 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 6.
I20260709 12:10:42.715840 25090 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:42.699124 25263 raft_consensus.cc:2749] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:42.756331 22457 pending_rounds.cc:85] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f: Aborting all ops after (but not including) 6
I20260709 12:10:42.768996 22457 pending_rounds.cc:107] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:10:42.769397 22457 raft_consensus.cc:2889] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:42.716150 25173 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.720036 24863 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:42.692808 25249 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:42.760536 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:42.783972 22450 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.784876 25249 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:42.782557 24863 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.774073 22525 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:10:42.775682 22422 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:42.752002 25189 raft_consensus.cc:3060] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:42.751808 25225 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:42.782698 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 85512.1us
I20260709 12:10:42.798308 22450 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:10:42.778769 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:42.810453 22531 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:42.811390 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:42.812120 22531 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:42.813098 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:10:42.813191 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 227759us
I20260709 12:10:42.813947 22531 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.814450 22421 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:42.734897 24889 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:42.805606 22456 raft_consensus.cc:2393] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 6: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:42.805243 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:42.779690 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:42.814615 25143 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.802897 25263 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.841712 25203 raft_consensus.cc:2804] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:42.806099 22457 raft_consensus.cc:1275] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:42.736706 25232 consensus_queue.cc:1059] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:10:42.846949 22421 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:42.802711 25023 raft_consensus.cc:2804] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:42.849257 23087 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:42.845666 23118 raft_consensus.cc:2410] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:10:42.804797 22422 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:42.803942 25225 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.815991 25249 raft_consensus.cc:2804] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:42.861687 22450 raft_consensus.cc:1275] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:42.851975 22525 raft_consensus.cc:2393] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 7: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:42.848737 25184 consensus_queue.cc:1048] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:10:42.869055 25167 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:42.871985 25187 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:42.780298 25090 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:42.905136 25199 log.cc:927] Time spent T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 1.555s	user 0.002s	sys 0.002s
I20260709 12:10:42.905701 25090 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:42.847493 25252 raft_consensus.cc:2749] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:42.907177 22448 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 4.
I20260709 12:10:42.799566 25173 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:42.883658 22421 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:10:42.897248 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 92529.1us
I20260709 12:10:42.909369 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:42.912189 22531 raft_consensus.cc:2468] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:10:42.914383 22457 raft_consensus.cc:2376] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5. Re-sending same reply.
I20260709 12:10:42.914944 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:42.891921 25204 consensus_meta.cc:287] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.825s	user 0.007s	sys 0.006s
I20260709 12:10:42.915627 22531 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:10:42.918903 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:42.921650 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:42.923211 22525 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:10:42.924013 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:42.924258 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:42.924963 22525 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5.
I20260709 12:10:42.925747 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:42.923149 22450 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 5.
I20260709 12:10:42.851438 24950 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:42.878787 23116 raft_consensus.cc:2468] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 2.
I20260709 12:10:42.896703 25176 raft_consensus.cc:2804] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:42.928359 22457 raft_consensus.cc:1275] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:42.895467 25249 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.897161 25203 raft_consensus.cc:697] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 6 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:42.915620 25090 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:42.937681 25271 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:42.885753 25263 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:42.946270 25271 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:42.947309 25280 raft_consensus.cc:2749] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:42.948613 25269 log.cc:927] Time spent T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:10:42.949357 25271 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:42.952122 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:42.880632 25143 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:42.956995 25143 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:42.960039 25173 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:42.921073 25252 raft_consensus.cc:2804] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:42.960780 25252 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.961154 25252 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:42.961470 24889 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:42.964355 24950 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:42.928447 25204 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:42.966833 25204 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:42.967439 25090 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:42.967870 25090 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:42.968124 25263 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:42.935418 25023 raft_consensus.cc:697] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 5 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:42.971935 25023 consensus_queue.cc:237] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:42.974442 22450 raft_consensus.cc:1275] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:42.975178 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:42.975517 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:42.976364 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:42.977620 22453 raft_consensus.cc:2393] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 6: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:42.978087 22525 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
I20260709 12:10:42.979056 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:42.979883 22569 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:42.981484 22569 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:10:42.984753 22421 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:42.977448 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:43.003149 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:43.004142 22456 raft_consensus.cc:2393] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 7: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:43.005072 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:43.005864 22457 raft_consensus.cc:2376] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6. Re-sending same reply.
I20260709 12:10:42.958451 25189 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:43.013374 23087 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:42.937065 25249 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:42.938388 25140 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:43.023869 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:43.029590 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 73863.6us
I20260709 12:10:43.030902 22495 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:43.030932 22569 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:43.002255 25271 raft_consensus.cc:2804] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:43.001189 24950 raft_consensus.cc:2804] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:43.013427 23116 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
I20260709 12:10:43.031528 22600 raft_consensus.cc:2368] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 4. Current term is 5.
I20260709 12:10:43.110350 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:43.017642 25173 raft_consensus.cc:2804] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:43.109531 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 78690.6us
I20260709 12:10:43.115419 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:43.041546 25230 raft_consensus.cc:2804] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:43.010242 24621 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:43.144003 22457 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:43.041261 24950 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:43.041766 25271 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:43.016342 24863 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:43.121250 24994 raft_consensus.cc:2804] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:43.155656 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.126942 25140 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:10:43.147379 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 202198us
I20260709 12:10:43.040697 25243 consensus_queue.cc:1048] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.100s
I20260709 12:10:43.160111 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:43.161476 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:43.164502 22457 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:43.164865 22531 raft_consensus.cc:2393] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 5: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:43.165904 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:43.167972 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:43.161082 22570 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:43.169222 22531 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5.
I20260709 12:10:43.116310 25223 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:43.146400 25230 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:43.146260 24892 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:43.142117 25228 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:43.120278 25187 consensus_queue.cc:1048] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:10:43.037315 25203 consensus_queue.cc:237] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:43.142887 25173 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:43.149252 24950 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:43.192662 24621 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:43.194185 25278 log.cc:927] Time spent T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:10:43.187001 24933 raft_consensus.cc:2804] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:43.195492 24933 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:43.195956 24933 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:43.149741 25271 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:43.199545 23119 raft_consensus.cc:2393] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 6: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:43.137481 25234 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:43.155990 25274 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.173759 23124 raft_consensus.cc:2410] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 12:10:43.170728 24756 consensus_meta.cc:287] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.526s	user 0.004s	sys 0.008s
I20260709 12:10:43.191932 25173 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:43.194835 25289 consensus_queue.cc:1048] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:43.200300 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:43.174154 22457 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:43.167274 24994 raft_consensus.cc:697] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:43.170136 25027 raft_consensus.cc:2749] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:43.185880 25230 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:43.185276 25167 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.167794 24845 consensus_queue.cc:1048] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:10:43.189229 25187 consensus_queue.cc:1243] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer c863116d91c14d1ca50d6e8a46a37a8f log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:10:43.238020 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:43.235345 22531 raft_consensus.cc:2393] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 5: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
W20260709 12:10:43.220644 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 188365us
I20260709 12:10:43.235899 22452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 546) took 1318 ms. Trace:
W20260709 12:10:43.228760 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.173034 25140 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:43.243189 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.243269 22495 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:43.220428 22454 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 6.
I20260709 12:10:43.240463 22452 rpcz_store.cc:276] 0709 12:10:41.917636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.930747 (+ 13111us) service_pool.cc:224] Handling call
0709 12:10:43.235600 (+1304853us) spinlock_profiling.cc:243] Waited 597 ms on lock 0x7b540037ad54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:43.235807 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1371962624}
I20260709 12:10:43.245889 25234 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:43.247130 25289 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.247666 25289 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:43.248368 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:43.249171 23125 raft_consensus.cc:2393] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 4: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:43.249846 25289 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:43.250046 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:10:43.251983 22605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45576 (request call id 2275) took 2020 ms (client timeout 1713 ms). Trace:
W20260709 12:10:43.252408 22605 rpcz_store.cc:269] 0709 12:10:41.231702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.231831 (+   129us) service_pool.cc:224] Handling call
0709 12:10:43.251732 (+2019901us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400449154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:43.251870 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2549522688}
I20260709 12:10:43.253638 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:43.254014 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:43.254784 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:43.256004 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:43.256599 22526 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:43.257086 22526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56942 (request call id 1507) took 1020 ms. Trace:
I20260709 12:10:43.186949 25176 raft_consensus.cc:697] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 4 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:43.204859 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:43.190773 24892 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:43.255213 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:43.256351 22531 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:43.365264 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:43.366180 23120 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
I20260709 12:10:43.367386 24892 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:43.189920 25228 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:43.368028 22526 rpcz_store.cc:276] 0709 12:10:42.236342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.255782 (+1019440us) service_pool.cc:224] Handling call
0709 12:10:43.257037 (+  1255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:43.371950 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:10:43.369594 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 221870us
I20260709 12:10:43.372630 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:43.373577 22569 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
W20260709 12:10:43.369359 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 356056us
I20260709 12:10:43.374512 23087 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:43.373813 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:43.280575 25167 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:43.255530 24994 consensus_queue.cc:237] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:43.376890 22526 raft_consensus.cc:1813] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Handling vote request from an unknown peer c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:43.372535 22570 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:43.257169 25140 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:43.392215 25140 raft_consensus.cc:2804] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:43.392779 25140 raft_consensus.cc:697] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:43.392936 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:43.393927 25140 consensus_queue.cc:237] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:43.380564 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 138037us
I20260709 12:10:43.395412 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:43.397298 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:43.385671 23087 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:43.400564 23120 raft_consensus.cc:2410] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:43.301990 25234 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.314313 25189 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:43.410542 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:43.414331 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 171182us
I20260709 12:10:43.415057 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:43.220691 25274 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:43.412978 23087 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:43.414449 22605 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 5.
I20260709 12:10:43.418123 22495 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:43.391220 22526 raft_consensus.cc:2410] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:10:43.417198 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:43.415913 22604 raft_consensus.cc:2410] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:10:43.370549 25294 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:43.406730 22531 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:10:43.420738 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:43.424867 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:43.425082 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:43.419710 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:43.420547 23120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 582) took 1083 ms. Trace:
I20260709 12:10:43.426577 23120 rpcz_store.cc:276] 0709 12:10:42.337420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.419770 (+1082350us) service_pool.cc:224] Handling call
0709 12:10:43.420064 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.420240 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:43.420267 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:43.420310 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:43.420353 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.420403 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:43.420495 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:43.291010 25090 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:43.431946 22601 raft_consensus.cc:2393] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 6: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:43.390939 23116 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:10:43.399657 25287 raft_consensus.cc:2749] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:43.383553 24892 consensus_queue.cc:1048] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:10:43.442301 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:43.443220 22601 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 6.
I20260709 12:10:43.415243 25234 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:43.415829 24950 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:43.440071 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:43.474753 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:43.511242 22529 raft_consensus.cc:1240] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 12:10:43.505102 22455 raft_consensus.cc:1240] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 LEADER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:43.565053 22529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 1877) took 1328 ms. Trace:
I20260709 12:10:43.445804 22602 raft_consensus.cc:1240] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:43.565486 22529 rpcz_store.cc:276] 0709 12:10:42.236846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.510443 (+1273597us) service_pool.cc:224] Handling call
0709 12:10:43.510900 (+   457us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:43.564768 (+ 53868us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.564982 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:43.508955 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 112706us
I20260709 12:10:43.471570 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:43.441325 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:43.545588 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:43.568431 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 195974us
I20260709 12:10:43.567394 22606 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 5.
I20260709 12:10:43.569646 22601 raft_consensus.cc:2410] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:43.464568 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:43.465946 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:43.567718 22605 raft_consensus.cc:2410] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 12:10:43.435652 25233 consensus_meta.cc:287] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.750s	user 0.008s	sys 0.002s
I20260709 12:10:43.579914 22526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 571) took 1236 ms. Trace:
I20260709 12:10:43.580474 22526 rpcz_store.cc:276] 0709 12:10:42.343163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.578460 (+1235297us) service_pool.cc:224] Handling call
0709 12:10:43.578804 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.579113 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:43.579157 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:43.579221 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:43.579277 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.579353 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:43.579836 (+   483us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:43.583333 22529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 1881) took 1236 ms. Trace:
I20260709 12:10:43.583467 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:43.584245 22606 raft_consensus.cc:2393] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 5: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:43.583735 22529 rpcz_store.cc:276] 0709 12:10:42.338281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.566375 (+1228094us) service_pool.cc:224] Handling call
0709 12:10:43.566668 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.566830 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:43.566854 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:43.566892 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:43.566922 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.566967 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:43.574154 (+  7187us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:43.534375 25249 consensus_meta.cc:287] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.503s	user 0.006s	sys 0.004s
W20260709 12:10:43.537308 25150 consensus_meta.cc:287] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.814s	user 0.009s	sys 0.000s
W20260709 12:10:43.587754 22530 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38310 (request call id 560) took 2548 ms (client timeout 2237 ms). Trace:
W20260709 12:10:43.598517 22530 rpcz_store.cc:269] 0709 12:10:41.029827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.033203 (+  3376us) service_pool.cc:224] Handling call
0709 12:10:43.578103 (+2544900us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54000d52d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:43.578229 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2877418240}
I20260709 12:10:43.601701 22603 raft_consensus.cc:1275] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:10:43.520000 25303 log.cc:927] Time spent T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:10:43.439029 25196 raft_consensus.cc:2804] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:43.445804 25225 consensus_meta.cc:287] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.547s	user 0.010s	sys 0.001s
W20260709 12:10:43.539950 25288 log.cc:927] Time spent T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 12:10:43.470084 25143 consensus_queue.cc:1048] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.135s
W20260709 12:10:43.591852 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 158285us
W20260709 12:10:43.541745 25252 consensus_meta.cc:287] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.580s	user 0.006s	sys 0.002s
I20260709 12:10:43.567665 22497 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:43.441231 24863 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317)
I20260709 12:10:43.466064 25068 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.596807 22526 raft_consensus.cc:1240] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 12:10:43.637012 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 69471.1us
I20260709 12:10:43.606280 25150 raft_consensus.cc:2749] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:43.597344 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:43.468580 23118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57332 (request call id 585) took 1098 ms. Trace:
I20260709 12:10:43.533802 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:43.439159 25298 raft_consensus.cc:2804] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:43.467499 25090 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:43.597363 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:43.671803 22602 raft_consensus.cc:2393] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 6: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:43.466233 25027 raft_consensus.cc:2804] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:43.604795 22604 raft_consensus.cc:2393] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 9: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:43.471007 25293 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:43.464383 24756 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:43.570251 25223 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:43.495018 25300 raft_consensus.cc:2804] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:43.609316 25286 log.cc:927] Time spent T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 12:10:43.583966 25297 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:43.660691 25299 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.610695 25274 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:43.613044 25227 raft_consensus.cc:3055] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:43.614408 24950 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:43.603293 25249 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:43.617888 25230 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:43.470389 24621 consensus_queue.cc:1048] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.135s
I20260709 12:10:43.638020 22497 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:43.698343 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 60447.3us
I20260709 12:10:43.699436 22497 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:43.597000 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:43.700408 22601 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 5.
I20260709 12:10:43.591882 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:43.700582 22606 raft_consensus.cc:1240] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:43.653278 22526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 573) took 1309 ms. Trace:
I20260709 12:10:43.701622 22526 rpcz_store.cc:276] 0709 12:10:42.343788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.593016 (+1249228us) service_pool.cc:224] Handling call
0709 12:10:43.593392 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:43.652894 (+ 59502us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.653207 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10880}
I20260709 12:10:43.703142 22526 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:10:43.607745 25196 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:43.614696 25271 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:43.654739 25252 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:43.651620 25068 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:43.440291 25176 consensus_queue.cc:237] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:43.683670 23120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 938) took 1274 ms. Trace:
I20260709 12:10:43.722326 22531 raft_consensus.cc:2393] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 9: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:43.590903 25233 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:43.660481 25298 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:43.626401 25225 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:43.651543 23118 rpcz_store.cc:276] 0709 12:10:42.369921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.380057 (+ 10136us) service_pool.cc:224] Handling call
0709 12:10:43.468304 (+1088247us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b54001acf54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:43.468483 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":949393152}
I20260709 12:10:43.735134 23118 raft_consensus.cc:1240] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:43.735767 23118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 586) took 1263 ms. Trace:
I20260709 12:10:43.736073 23118 rpcz_store.cc:276] 0709 12:10:42.472256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.734555 (+1262299us) service_pool.cc:224] Handling call
0709 12:10:43.734902 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.735516 (+   614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.735712 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:43.721493 23120 rpcz_store.cc:276] 0709 12:10:42.409609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.436453 (+1026844us) service_pool.cc:224] Handling call
0709 12:10:43.436783 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:43.463878 (+ 27095us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:43.463908 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:43.472451 (+  8543us) log.cc:844] Serialized 26 byte log entry
0709 12:10:43.655163 (+182712us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:43.655212 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.655292 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:43.683454 (+ 28162us) raft_consensus.cc:1685] finished
0709 12:10:43.683475 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:43.683613 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26738,"raft.queue_time_us":60336,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":122,"thread_start_us":166414,"threads_started":1,"wal-append.queue_time_us":206070}
I20260709 12:10:43.683683 25300 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:43.660115 25307 raft_consensus.cc:2749] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:43.673710 25027 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:43.677831 25167 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:10:43.704960 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.709414 25196 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:43.705687 22527 raft_consensus.cc:2468] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5.
I20260709 12:10:43.676993 25293 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:43.634588 25294 raft_consensus.cc:697] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
W20260709 12:10:43.700552 24933 consensus_meta.cc:287] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.504s	user 0.010s	sys 0.001s
I20260709 12:10:43.756210 24933 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:43.758196 24933 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:43.758435 22600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43070 (request call id 432) took 1373 ms. Trace:
I20260709 12:10:43.714135 25249 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:43.714599 25292 log.cc:927] Time spent T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.445s	user 0.002s	sys 0.000s
I20260709 12:10:43.716204 25271 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:43.717108 25068 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:43.694144 25228 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:43.693764 25227 raft_consensus.cc:740] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:43.683938 24756 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:43.732203 25298 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:43.737433 23118 raft_consensus.cc:1275] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:10:43.752789 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 53442.7us
I20260709 12:10:43.765134 22497 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:43.766429 22497 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:43.752975 25234 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:43.754227 25307 raft_consensus.cc:2749] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:43.693742 25299 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:43.768554 22497 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:43.726009 25223 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:43.692057 25297 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:43.758846 22600 rpcz_store.cc:276] 0709 12:10:42.384993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.414486 (+ 29493us) service_pool.cc:224] Handling call
0709 12:10:43.758238 (+1343752us) spinlock_profiling.cc:243] Waited 399 ms on lock 0x7b5400350cd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:43.758377 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":917750144}
I20260709 12:10:43.745723 22526 raft_consensus.cc:1275] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:43.772538 22526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1509) took 1359 ms. Trace:
I20260709 12:10:43.772881 22526 rpcz_store.cc:276] 0709 12:10:42.412794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.702648 (+1289854us) service_pool.cc:224] Handling call
0709 12:10:43.703008 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.772249 (+ 69241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.772475 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:43.762488 25227 consensus_queue.cc:260] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:43.745697 25027 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:43.749186 25304 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.744321 25300 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:43.755257 25294 consensus_queue.cc:237] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:43.769444 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.771099 23118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 588) took 1212 ms. Trace:
I20260709 12:10:43.797992 23118 rpcz_store.cc:276] 0709 12:10:42.558302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.736841 (+1178539us) service_pool.cc:224] Handling call
0709 12:10:43.737123 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.767157 (+ 30034us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.769509 (+  2352us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:43.800735 25313 raft_consensus.cc:2749] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:43.800684 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:43.800958 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:43.802853 22603 raft_consensus.cc:1813] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Handling vote request from an unknown peer c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:43.805033 22603 raft_consensus.cc:2393] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 6: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:43.773582 25223 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:43.816239 25223 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:43.805341 23118 raft_consensus.cc:1240] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:43.817778 23118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 944) took 1096 ms. Trace:
I20260709 12:10:43.818112 23118 rpcz_store.cc:276] 0709 12:10:42.721625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.801424 (+1079799us) service_pool.cc:224] Handling call
0709 12:10:43.805154 (+  3730us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.817517 (+ 12363us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.817720 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:43.796023 25234 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.823341 25234 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:43.802951 25225 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:43.835292 22603 raft_consensus.cc:1240] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:43.863525 25299 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:43.863782 25297 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:43.864267 25299 raft_consensus.cc:2749] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:43.877652 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:43.803156 25307 consensus_queue.cc:1059] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
W20260709 12:10:43.873018 25173 consensus_meta.cc:287] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.639s	user 0.009s	sys 0.002s
I20260709 12:10:43.872562 25299 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:43.889686 23089 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:43.907976 22530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 574) took 1563 ms. Trace:
I20260709 12:10:43.874392 24756 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:43.908421 22530 rpcz_store.cc:276] 0709 12:10:42.344112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.599577 (+1255465us) service_pool.cc:224] Handling call
0709 12:10:43.599932 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:43.600404 (+   472us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:43.600444 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:43.607068 (+  6624us) log.cc:844] Serialized 26 byte log entry
0709 12:10:43.764680 (+157612us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:43.765398 (+   718us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.765472 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:43.907720 (+142248us) raft_consensus.cc:1685] finished
0709 12:10:43.907739 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:43.907903 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3461,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":11137,"thread_start_us":110066,"threads_started":1,"wal-append.queue_time_us":261970}
I20260709 12:10:43.912892 22528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56942 (request call id 1503) took 1677 ms. Trace:
I20260709 12:10:43.913488 22528 rpcz_store.cc:276] 0709 12:10:42.235252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.249881 (+ 14629us) service_pool.cc:224] Handling call
0709 12:10:43.912636 (+1662755us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b5400400bd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:43.912818 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":272892160}
W20260709 12:10:43.918946 22454 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2143) took 1241 ms (client timeout 1551 ms). Trace:
W20260709 12:10:43.919566 22454 rpcz_store.cc:269] 0709 12:10:42.677148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.686495 (+  9347us) service_pool.cc:224] Handling call
0709 12:10:43.918725 (+1232230us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b54003f43d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:43.918867 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1148664576}
W20260709 12:10:43.920969 22532 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38310 (request call id 546) took 3463 ms (client timeout 3142 ms). Trace:
I20260709 12:10:43.927838 22455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1553) took 1247 ms. Trace:
I20260709 12:10:43.928397 22455 rpcz_store.cc:276] 0709 12:10:42.680297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.740947 (+ 60650us) service_pool.cc:224] Handling call
0709 12:10:42.741236 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.565523 (+824287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.927548 (+362025us) spinlock_profiling.cc:243] Waited 764 ms on lock 0x7b5400241654. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:43.927763 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1756180736}
I20260709 12:10:43.798782 25304 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:43.943913 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:43.878772 25230 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:43.921535 22532 rpcz_store.cc:269] 0709 12:10:40.457748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.466070 (+  8322us) service_pool.cc:224] Handling call
0709 12:10:43.920710 (+3454640us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b540010c7d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:43.920876 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2658827008}
I20260709 12:10:43.945566 22455 raft_consensus.cc:1275] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:43.947732 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:43.950996 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:43.954092 22450 pending_rounds.cc:85] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f: Aborting all ops after (but not including) 4
I20260709 12:10:43.954484 22450 pending_rounds.cc:107] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:10:43.954429 22569 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:43.955003 22450 raft_consensus.cc:2889] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:43.955652 22569 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:43.908579 25234 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:43.957391 22452 raft_consensus.cc:1240] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:10:43.944002 25225 raft_consensus.cc:3055] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:43.906531 25299 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:43.947301 25226 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:43.949122 25233 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:43.958535 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:43.982740 22457 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 5.
I20260709 12:10:43.943814 25090 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.946698 25293 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:43.965374 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:43.911679 25223 raft_consensus.cc:2804] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:43.912657 25252 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:43.972513 25304 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:43.972815 25178 consensus_queue.cc:260] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:43.978147 22422 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:43.999447 25178 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:43.999643 25280 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:44.000109 22422 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:43.979043 25234 raft_consensus.cc:2804] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:43.979267 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:43.980348 22452 raft_consensus.cc:1240] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:10:43.966239 22495 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:43.908690 25173 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:43.964490 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:43.969951 25299 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:44.010907 22452 raft_consensus.cc:1240] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:43.991029 25223 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:43.964265 25225 raft_consensus.cc:740] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:43.966627 25316 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:44.008294 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:44.012766 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.005537 25213 raft_consensus.cc:2749] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:44.003965 25234 raft_consensus.cc:697] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:44.035770 22531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56940 (request call id 1884) took 1681 ms. Trace:
I20260709 12:10:44.036278 22531 rpcz_store.cc:276] 0709 12:10:42.354225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.431963 (+1077738us) service_pool.cc:224] Handling call
0709 12:10:44.035492 (+603529us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b540035fa54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:44.035702 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":344383360}
I20260709 12:10:44.037477 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:44.040946 22527 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56940 (request call id 1882) took 1696 ms (client timeout 1947 ms). Trace:
I20260709 12:10:44.040848 25300 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:44.041472 22527 rpcz_store.cc:269] 0709 12:10:42.344580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.624045 (+279465us) service_pool.cc:224] Handling call
0709 12:10:44.040756 (+1416711us) spinlock_profiling.cc:243] Waited 968 ms on lock 0x7b5400230854. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:44.040886 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2225774336}
I20260709 12:10:44.042384 22529 raft_consensus.cc:1240] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:44.003826 24756 consensus_queue.cc:1059] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:10:44.011305 25304 raft_consensus.cc:2804] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:44.052546 22527 raft_consensus.cc:1240] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:43.991842 25090 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:44.038883 22531 raft_consensus.cc:1240] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:44.014498 25223 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:44.059336 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.987632 25226 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:44.045768 25316 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:44.071393 25316 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:44.075053 25226 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:44.080426 22527 raft_consensus.cc:1240] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:44.083024 22452 raft_consensus.cc:1275] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:10:44.098449 25233 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.099164 25233 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:44.051648 25304 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:44.051926 25196 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:44.197155 25138 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:44.219008 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:44.202570 25227 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:44.231540 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 463065us
I20260709 12:10:44.127876 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:44.235235 22452 raft_consensus.cc:2393] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 9: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
W20260709 12:10:44.225595 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 486902us
I20260709 12:10:44.242345 22497 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:44.087939 24756 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:44.189179 25221 log.cc:927] Time spent T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 1.886s	user 0.001s	sys 0.004s
W20260709 12:10:44.230995 23116 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.007s	sys 0.060s
I20260709 12:10:44.253021 22497 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
W20260709 12:10:44.144819 25296 log.cc:927] Time spent T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.607s	user 0.003s	sys 0.000s
I20260709 12:10:44.262190 22601 raft_consensus.cc:1240] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:44.069420 25225 consensus_queue.cc:260] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:44.264101 22497 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:44.115362 25304 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:44.191457 25090 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:44.102869 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:44.274129 22497 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:44.144110 25173 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:44.279083 25289 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:44.298306 22526 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.013s	sys 0.035s
W20260709 12:10:44.300981 22526 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.013s	sys 0.035s
W20260709 12:10:44.265533 23116 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.008s	sys 0.060s
I20260709 12:10:44.205595 25316 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:44.384732 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:44.416440 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.262097 25214 raft_consensus.cc:2749] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:44.267257 24756 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:44.422290 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.297695 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:44.257230 25294 consensus_queue.cc:1048] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.108s
I20260709 12:10:44.164712 25234 consensus_queue.cc:237] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:44.438776 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:44.383074 24941 raft_consensus.cc:2804] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:44.454382 22448 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.027s	sys 0.057s
I20260709 12:10:44.455039 22528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1516) took 1747 ms. Trace:
I20260709 12:10:44.302464 25319 raft_consensus.cc:2749] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:44.476399 22448 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.028s	sys 0.062s
I20260709 12:10:44.419203 25175 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:44.477622 23120 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.032s	sys 0.077s
I20260709 12:10:44.424316 25324 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:44.506201 22532 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.002s	sys 0.014s
W20260709 12:10:44.507576 22532 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.002s	sys 0.014s
W20260709 12:10:44.482743 25027 consensus_meta.cc:287] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.690s	user 0.012s	sys 0.000s
I20260709 12:10:44.480340 22528 rpcz_store.cc:276] 0709 12:10:42.707424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.914521 (+1207097us) service_pool.cc:224] Handling call
0709 12:10:43.951653 (+ 37132us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:43.953271 (+  1618us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:43.953300 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:43.953711 (+   411us) log.cc:844] Serialized 26 byte log entry
0709 12:10:44.229892 (+276181us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:44.229938 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.230011 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:44.454730 (+224719us) raft_consensus.cc:1685] finished
0709 12:10:44.454751 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:44.454943 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1235,"raft.queue_time_us":27882,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":8038,"thread_start_us":248618,"threads_started":1,"wal-append.queue_time_us":296663}
I20260709 12:10:44.491650 22449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2133) took 1825 ms. Trace:
W20260709 12:10:44.503520 23120 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.032s	sys 0.078s
I20260709 12:10:44.459635 25230 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.500005 22448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 555) took 1055 ms. Trace:
I20260709 12:10:44.421367 25225 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:44.482275 22570 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.035s	sys 0.032s
I20260709 12:10:44.476016 24992 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:44.476423 25189 consensus_queue.cc:1048] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.058s
W20260709 12:10:44.953383 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.585485 25196 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:44.985443 25178 consensus_meta.cc:287] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.986s	user 0.011s	sys 0.006s
W20260709 12:10:44.921133 22421 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.012s	sys 0.018s
W20260709 12:10:44.518251 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:44.986579 22421 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.013s	sys 0.019s
I20260709 12:10:44.963848 22530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 1885) took 2380 ms. Trace:
I20260709 12:10:44.583781 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:10:44.719681 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 297576us
W20260709 12:10:44.951493 25334 log.cc:927] Time spent T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 12:10:44.783633 22526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1510) took 2358 ms. Trace:
W20260709 12:10:44.989269 25280 consensus_meta.cc:287] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.989s	user 0.005s	sys 0.008s
I20260709 12:10:44.985961 25150 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:44.515157 22450 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.015s	sys 0.004s
W20260709 12:10:44.990306 22450 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.009s	user 0.016s	sys 0.005s
I20260709 12:10:44.487402 25233 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:10:44.989362 22570 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.083s	user 0.046s	sys 0.048s
I20260709 12:10:44.987596 22530 rpcz_store.cc:276] 0709 12:10:42.583823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.913457 (+1329634us) service_pool.cc:224] Handling call
0709 12:10:43.913841 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:43.914227 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:43.914252 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:43.914759 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 12:10:44.306531 (+391772us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:44.306568 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.306633 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:44.963581 (+656948us) raft_consensus.cc:1685] finished
0709 12:10:44.963607 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:44.963772 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":46471,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":6662,"thread_start_us":349703,"threads_started":1,"wal-append.queue_time_us":795578}
W20260709 12:10:44.996417 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 1.09029e+06us
W20260709 12:10:44.805635 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:44.638837 25291 log.cc:927] Time spent T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 1.445s	user 0.000s	sys 0.003s
I20260709 12:10:44.589534 22529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 572) took 2246 ms. Trace:
W20260709 12:10:44.701381 22457 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.008s	sys 0.014s
W20260709 12:10:45.000396 22457 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.010s	sys 0.022s
W20260709 12:10:44.617978 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.000310 22529 rpcz_store.cc:276] 0709 12:10:42.343485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.592997 (+1249512us) service_pool.cc:224] Handling call
0709 12:10:44.042152 (+449155us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:44.048151 (+  5999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.589248 (+541097us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b5400230850. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:44.589444 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1032218496}
W20260709 12:10:45.001973 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:44.979583 25326 log.cc:927] Time spent T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 12:10:44.579663 22606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2292) took 1106 ms. Trace:
I20260709 12:10:44.989240 22526 rpcz_store.cc:276] 0709 12:10:42.424771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.778491 (+1353720us) service_pool.cc:224] Handling call
0709 12:10:43.778876 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.779240 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:44.302257 (+523017us) log.cc:844] Serialized 14 byte log entry
0709 12:10:44.782863 (+480606us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:44.782924 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:44.782990 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.783406 (+   416us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:44.783571 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":46938,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":17810,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"thread_start_us":988449,"threads_started":2}
I20260709 12:10:44.993248 22600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 1917) took 1167 ms. Trace:
W20260709 12:10:44.986932 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 687569us
W20260709 12:10:44.590593 25277 log.cc:927] Time spent T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 1.627s	user 0.000s	sys 0.002s
W20260709 12:10:45.005558 22421 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 1.947s (SENT) [suppressed 21 similar messages]
I20260709 12:10:45.005040 22606 rpcz_store.cc:276] 0709 12:10:43.472901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.597417 (+124516us) service_pool.cc:224] Handling call
0709 12:10:43.598315 (+   898us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.701354 (+103039us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.579357 (+878003us) spinlock_profiling.cc:243] Waited 99.4 ms on lock 0x7b54000ec254. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:44.579585 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":228687232}
I20260709 12:10:44.780102 25316 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:44.789139 25313 raft_consensus.cc:2749] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:44.990356 22448 rpcz_store.cc:276] 0709 12:10:43.444445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.690060 (+245615us) service_pool.cc:224] Handling call
0709 12:10:43.700183 (+ 10123us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.700395 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:10:43.726966 (+ 26571us) log.cc:844] Serialized 14 byte log entry
0709 12:10:44.499514 (+772548us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:44.499592 (+    78us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:44.499670 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.499767 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:44.499930 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":26572,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":73,"raft.queue_time_us":1145,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":34054,"thread_start_us":771984,"threads_started":1,"wal-append.queue_time_us":853168}
W20260709 12:10:44.997582 22570 connection.cc:256] RPC call timeout handler was delayed by -1.013627151999799s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22360000000000002s for a response
W20260709 12:10:45.009356 23124 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57332 (request call id 587) took 2461 ms (client timeout 1833 ms). Trace:
W20260709 12:10:45.009775 23124 rpcz_store.cc:269] 0709 12:10:42.547929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.691891 (+143962us) service_pool.cc:224] Handling call
0709 12:10:45.009098 (+2317207us) spinlock_profiling.cc:243] Waited 481 ms on lock 0x7b540059b354. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:45.009264 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1105476480}
I20260709 12:10:45.010548 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:45.012372 25188 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:44.521330 25203 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.977s	user 0.016s	sys 0.032s
W20260709 12:10:44.988519 25304 consensus_meta.cc:287] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.685s	user 0.010s	sys 0.002s
I20260709 12:10:45.013629 25304 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:44.949819 25289 consensus_meta.cc:287] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.670s	user 0.010s	sys 0.004s
I20260709 12:10:44.985206 25027 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:45.028455 25304 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:44.862864 25223 consensus_meta.cc:287] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.784s	user 0.012s	sys 0.001s
W20260709 12:10:44.698963 25187 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.833s	user 0.047s	sys 0.132s
W20260709 12:10:44.847255 25298 consensus_meta.cc:287] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 1.078s	user 0.013s	sys 0.006s
W20260709 12:10:44.574551 25322 log.cc:927] Time spent T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.267s	user 0.006s	sys 0.000s
I20260709 12:10:45.007398 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:44.999346 25150 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:45.012276 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:44.992895 22449 rpcz_store.cc:276] 0709 12:10:42.665830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.666295 (+   465us) service_pool.cc:224] Handling call
0709 12:10:42.682920 (+ 16625us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:43.026632 (+343712us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:43.026673 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:43.038997 (+ 12324us) log.cc:844] Serialized 26 byte log entry
0709 12:10:43.279432 (+240435us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:43.279486 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.279578 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:44.114873 (+835295us) spinlock_profiling.cc:243] Waited 27.3 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:10:44.491351 (+376478us) raft_consensus.cc:1685] finished
0709 12:10:44.491372 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:44.491588 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28538,"raft.queue_time_us":91452,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":1352,"spinlock_wait_cycles":62817152,"thread_start_us":453198,"threads_started":2,"wal-append.queue_time_us":322596}
W20260709 12:10:45.015895 23119 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57328 (request call id 940) took 2582 ms (client timeout 2068 ms). Trace:
I20260709 12:10:45.049153 22606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45562 (request call id 1926) took 1079 ms. Trace:
I20260709 12:10:45.005203 22600 rpcz_store.cc:276] 0709 12:10:43.826701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.826825 (+   124us) service_pool.cc:224] Handling call
0709 12:10:43.873468 (+ 46643us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:43.879147 (+  5679us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:43.879198 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:43.888640 (+  9442us) log.cc:844] Serialized 26 byte log entry
0709 12:10:44.299823 (+411183us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:44.299927 (+   104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.300069 (+   142us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:44.992991 (+692922us) raft_consensus.cc:1685] finished
0709 12:10:44.993016 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:44.993183 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6053,"raft.queue_time_us":1447,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":12166,"thread_start_us":334945,"threads_started":1,"wal-append.queue_time_us":755051}
I20260709 12:10:45.049770 22606 rpcz_store.cc:276] 0709 12:10:43.969892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.007068 (+1037176us) service_pool.cc:224] Handling call
0709 12:10:45.049096 (+ 42028us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:45.049322 23119 rpcz_store.cc:269] 0709 12:10:42.433448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.703461 (+270013us) service_pool.cc:224] Handling call
0709 12:10:45.015703 (+2312242us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b5400759754. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:45.015829 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1094654208}
I20260709 12:10:45.050522 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:45.051340 22600 raft_consensus.cc:2410] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:45.051712 23119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 789) took 2069 ms. Trace:
I20260709 12:10:45.019826 23124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 787) took 2083 ms. Trace:
I20260709 12:10:44.609206 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:44.576169 25319 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:45.022106 25203 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.472s	user 0.019s	sys 0.051s
I20260709 12:10:44.515789 25175 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:45.029532 22529 raft_consensus.cc:1240] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:45.031556 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:44.507627 25300 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:45.032285 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:44.990522 25280 raft_consensus.cc:2749] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:44.635627 24756 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:44.737074 25218 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
W20260709 12:10:45.002434 25299 consensus_meta.cc:287] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.983s	user 0.006s	sys 0.010s
I20260709 12:10:45.033833 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:45.000310 24992 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:45.029386 25223 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:45.034437 22524 raft_consensus.cc:1275] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:45.034863 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:45.037133 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:45.072906 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:45.073298 22527 raft_consensus.cc:2410] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:45.003325 25230 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:45.057468 25245 consensus_queue.cc:1048] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:10:45.030265 25263 raft_consensus.cc:3055] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:45.029037 25027 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:45.043071 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:45.071209 25184 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.078688 22457 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:45.044214 25274 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.052048 23119 rpcz_store.cc:276] 0709 12:10:42.982640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.050898 (+2068258us) service_pool.cc:224] Handling call
0709 12:10:45.051201 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:45.051386 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:45.051421 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:45.051467 (+    46us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:45.051508 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.051576 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:45.051664 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:45.052887 22454 raft_consensus.cc:2393] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 7: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:45.077266 25263 raft_consensus.cc:740] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:45.082036 25300 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:45.050624 25316 consensus_queue.cc:1059] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:10:45.082343 25263 consensus_queue.cc:260] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:45.082569 25300 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:45.057835 25233 consensus_queue.cc:1059] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:10:45.083498 25263 raft_consensus.cc:3060] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:45.083750 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:45.084368 22454 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 4.
I20260709 12:10:45.085225 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:45.085429 25223 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:45.084718 25300 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:45.079136 25184 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:45.087941 25230 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:45.089221 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:45.089342 25184 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:45.054800 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:45.090260 22606 raft_consensus.cc:2393] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 6: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
W20260709 12:10:45.091552 22453 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 534) took 3257 ms (client timeout 4209 ms). Trace:
I20260709 12:10:45.091214 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:45.091928 22453 rpcz_store.cc:269] 0709 12:10:41.834418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.834542 (+   124us) service_pool.cc:224] Handling call
0709 12:10:45.091349 (+3256807us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54004056d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:45.091475 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2441210112}
I20260709 12:10:45.092546 22531 raft_consensus.cc:1275] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:10:45.092698 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:45.093138 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:45.093462 22606 raft_consensus.cc:2393] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 5: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:45.094172 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:45.077437 25218 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:45.027274 25289 raft_consensus.cc:2749] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:45.065775 25319 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:45.095974 22451 raft_consensus.cc:1240] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:45.096980 25319 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:45.097117 22451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1554) took 2416 ms. Trace:
I20260709 12:10:45.097430 25218 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:45.075436 25299 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:45.097515 22451 rpcz_store.cc:276] 0709 12:10:42.680578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.738620 (+ 58042us) service_pool.cc:224] Handling call
0709 12:10:45.095741 (+2357121us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:45.096344 (+   603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.096922 (+   578us) spinlock_profiling.cc:243] Waited 2.36 s on lock 0x7b54004056d0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:45.097043 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5420222208}
I20260709 12:10:45.099278 24992 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:45.099345 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:45.099656 25299 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:45.058956 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:45.100728 22600 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:45.046329 25187 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.181s	user 0.058s	sys 0.134s
I20260709 12:10:45.067719 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:45.069130 22526 raft_consensus.cc:2393] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 7: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:45.069260 22525 raft_consensus.cc:2410] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:44.541642 25324 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:45.073868 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:45.106477 22528 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:45.074658 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:45.106889 22526 raft_consensus.cc:1275] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:45.107297 22449 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:10:45.074632 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:45.050833 24889 consensus_queue.cc:1059] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 12:10:45.076327 23118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 949) took 2260 ms. Trace:
I20260709 12:10:45.076587 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:45.050340 25298 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:45.114672 22527 raft_consensus.cc:2393] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 7: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:45.116087 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:45.116242 22600 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 6.
I20260709 12:10:45.080631 23116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 939) took 2657 ms. Trace:
I20260709 12:10:45.081166 25274 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:45.052340 23124 rpcz_store.cc:276] 0709 12:10:42.936253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.010730 (+2074477us) service_pool.cc:224] Handling call
0709 12:10:45.019334 (+  8604us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:45.019530 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:45.019555 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:45.019594 (+    39us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:45.019628 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.019683 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:45.019776 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:45.119293 22497 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:45.081295 24941 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:45.094560 22531 raft_consensus.cc:1275] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:45.100260 22455 raft_consensus.cc:2393] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 9: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:45.102617 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:45.067128 22530 raft_consensus.cc:2393] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 9: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
W20260709 12:10:45.120504 22604 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45576 (request call id 2288) took 1649 ms (client timeout 2022 ms). Trace:
I20260709 12:10:45.094172 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:45.103502 22454 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:45.098771 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:45.094790 22453 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
I20260709 12:10:45.122148 22451 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:45.105235 22457 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 6.
W20260709 12:10:45.092479 25138 consensus_meta.cc:287] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.866s	user 0.008s	sys 0.004s
I20260709 12:10:45.111636 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:45.112151 24889 consensus_queue.cc:1243] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer c863116d91c14d1ca50d6e8a46a37a8f log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:10:45.124534 22449 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7.
I20260709 12:10:45.125010 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:45.125823 22600 raft_consensus.cc:2393] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 6: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:45.126173 22600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43070 (request call id 445) took 1179 ms. Trace:
I20260709 12:10:45.126466 22600 rpcz_store.cc:276] 0709 12:10:43.947159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.124792 (+1177633us) service_pool.cc:224] Handling call
0709 12:10:45.126122 (+  1330us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:45.126899 23088 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:10:45.117234 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.127676 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:45.128593 22455 raft_consensus.cc:1275] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:10:45.119462 25039 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:45.128549 25206 raft_consensus.cc:3055] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:45.128786 25276 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.130611 25176 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:45.119155 22599 raft_consensus.cc:2393] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 7: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:45.130785 25276 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:45.131134 25176 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:45.131372 25274 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:45.131696 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:45.132234 22599 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:45.123085 24941 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:45.132784 25276 leader_election.cc:290] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:45.133270 25176 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:45.120867 22604 rpcz_store.cc:269] 0709 12:10:43.471546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.474336 (+  2790us) service_pool.cc:224] Handling call
0709 12:10:45.120325 (+1645989us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b54000e9a54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:45.120445 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":65867648}
I20260709 12:10:45.120388 22529 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:10:45.129649 25295 raft_consensus.cc:2804] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:45.138173 25295 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:45.138454 22455 raft_consensus.cc:1275] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:45.138578 25295 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:45.140112 22449 raft_consensus.cc:1240] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:45.105863 25027 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:45.141314 25027 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:45.114297 23118 rpcz_store.cc:276] 0709 12:10:42.816346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.818943 (+1002597us) service_pool.cc:224] Handling call
0709 12:10:43.833123 (+ 14180us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.833357 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:10:44.272423 (+439066us) log.cc:844] Serialized 14 byte log entry
0709 12:10:45.054094 (+781671us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:45.066183 (+ 12089us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:45.068517 (+  2334us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.071841 (+  3324us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:45.076272 (+  4431us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":864129,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":293370,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":9977,"thread_start_us":1177624,"threads_started":3,"wal-append.queue_time_us":716099}
I20260709 12:10:45.130127 25206 raft_consensus.cc:740] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:45.143396 25027 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:45.143602 25206 consensus_queue.cc:260] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:45.144871 25206 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:45.147116 23088 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:45.149428 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:45.108348 25299 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.151788 25243 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.152207 25299 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:45.136581 25289 raft_consensus.cc:2804] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:45.119350 23116 rpcz_store.cc:276] 0709 12:10:42.423580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.549621 (+1126041us) service_pool.cc:224] Handling call
0709 12:10:43.606152 (+ 56531us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:43.656509 (+ 50357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:43.659998 (+  3489us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:43.699317 (+ 39319us) log.cc:844] Serialized 26 byte log entry
0709 12:10:44.406324 (+707007us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:44.419270 (+ 12946us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.431217 (+ 11947us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:45.073266 (+642049us) raft_consensus.cc:1685] finished
0709 12:10:45.074346 (+  1080us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:45.080565 (+  6219us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2690,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":6905,"thread_start_us":616187,"threads_started":1,"wal-append.queue_time_us":981888}
I20260709 12:10:45.130069 25232 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.155364 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:45.113528 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:45.152303 25243 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:45.153846 22451 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
W20260709 12:10:45.154624 25338 log.cc:927] Time spent T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:10:45.127286 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:45.157655 22606 raft_consensus.cc:2393] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 9: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:45.116254 25298 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:45.127501 22528 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:10:45.156483 22526 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
I20260709 12:10:45.159226 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:45.158227 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:45.163375 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:45.165388 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:45.161077 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:45.157652 22454 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
I20260709 12:10:45.161268 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:45.166316 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:45.166278 22600 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 6.
I20260709 12:10:45.167498 22451 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 6.
I20260709 12:10:45.167995 22599 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7.
I20260709 12:10:45.160439 25276 raft_consensus.cc:2749] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:45.168793 24993 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:45.171104 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:45.173341 22598 raft_consensus.cc:1275] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:45.173872 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:45.174316 22600 raft_consensus.cc:2393] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 9: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:45.174470 22526 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 6.
I20260709 12:10:45.154800 25289 raft_consensus.cc:697] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:45.175987 22497 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:45.129482 25039 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:45.177273 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:45.178896 22600 raft_consensus.cc:2468] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 6.
I20260709 12:10:45.180012 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:45.180509 22497 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:45.181412 25319 raft_consensus.cc:2804] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:45.181459 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:45.181934 25319 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:45.182304 22604 raft_consensus.cc:2393] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 6: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:45.183411 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:45.185482 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:45.186146 22600 raft_consensus.cc:2393] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 9: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:45.188084 22532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1518) took 2480 ms. Trace:
I20260709 12:10:45.190627 22600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45562 (request call id 1925) took 1232 ms. Trace:
I20260709 12:10:45.191021 22600 rpcz_store.cc:276] 0709 12:10:43.958084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.185285 (+1227201us) service_pool.cc:224] Handling call
0709 12:10:45.190566 (+  5281us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:45.192085 22600 raft_consensus.cc:1240] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:45.192691 22600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 1928) took 1147 ms. Trace:
I20260709 12:10:45.182359 25319 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:45.188377 22532 rpcz_store.cc:276] 0709 12:10:42.708046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.949233 (+1241187us) service_pool.cc:224] Handling call
0709 12:10:43.949577 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:43.952827 (+  3250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:43.952858 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:43.960210 (+  7352us) log.cc:844] Serialized 26 byte log entry
0709 12:10:44.509082 (+548872us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:44.509148 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.509244 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:45.187913 (+678669us) raft_consensus.cc:1685] finished
0709 12:10:45.187932 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:45.188041 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2011,"raft.queue_time_us":14913,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":42679,"thread_start_us":510502,"threads_started":1,"wal-append.queue_time_us":1087232}
I20260709 12:10:45.193222 22600 rpcz_store.cc:276] 0709 12:10:44.045079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.191700 (+1146621us) service_pool.cc:224] Handling call
0709 12:10:45.191973 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:45.192482 (+   509us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.192645 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:45.180663 25187 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:45.229825 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:45.230669 22532 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
I20260709 12:10:45.236090 22601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 1918) took 1408 ms. Trace:
I20260709 12:10:45.236644 22601 rpcz_store.cc:276] 0709 12:10:43.827452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.827571 (+   119us) service_pool.cc:224] Handling call
0709 12:10:43.827955 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:44.272784 (+444829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.235773 (+962989us) spinlock_profiling.cc:243] Waited 433 ms on lock 0x7b54000ea454. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:45.236011 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":996263808}
I20260709 12:10:45.242439 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:45.163987 25232 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:45.244535 22601 raft_consensus.cc:1240] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:45.246107 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:10:45.252674 22525 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56942 (request call id 1523) took 2507 ms (client timeout 2849 ms). Trace:
W20260709 12:10:45.254875 22525 rpcz_store.cc:269] 0709 12:10:42.744979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.237739 (+492760us) service_pool.cc:224] Handling call
0709 12:10:45.252466 (+2014727us) spinlock_profiling.cc:243] Waited 1.83 s on lock 0x7b540038fed4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:45.252613 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4209393920}
I20260709 12:10:45.252899 22532 raft_consensus.cc:2376] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5. Re-sending same reply.
W20260709 12:10:45.261773 23121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57332 (request call id 579) took 2933 ms (client timeout 1713 ms). Trace:
W20260709 12:10:45.262212 23121 rpcz_store.cc:269] 0709 12:10:42.328140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.333224 (+  5084us) service_pool.cc:224] Handling call
0709 12:10:45.261600 (+2928376us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54006a0ed4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:45.261697 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":285534080}
I20260709 12:10:45.262996 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:45.263862 22532 raft_consensus.cc:2376] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6. Re-sending same reply.
W20260709 12:10:45.240897 25344 log.cc:927] Time spent T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 12:10:45.271198 22450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2155) took 1323 ms. Trace:
I20260709 12:10:45.271344 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:45.250280 23120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 942) took 2541 ms. Trace:
I20260709 12:10:45.239326 25261 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:45.271587 22450 rpcz_store.cc:276] 0709 12:10:43.947895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.953472 (+  5577us) service_pool.cc:224] Handling call
0709 12:10:43.953857 (+   385us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:43.961592 (+  7735us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:43.961636 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:43.962224 (+   588us) log.cc:844] Serialized 52 byte log entry
0709 12:10:44.991032 (+1028808us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:45.264099 (+273067us) log.cc:844] Serialized 14 byte log entry
0709 12:10:45.270879 (+  6780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.270952 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:45.271006 (+    54us) raft_consensus.cc:1685] finished
0709 12:10:45.271017 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:45.271146 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3421,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":14012,"thread_start_us":1240674,"threads_started":2,"wal-append.queue_time_us":1023626}
I20260709 12:10:45.275621 23117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 950) took 2416 ms. Trace:
W20260709 12:10:45.277333 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 220520us
I20260709 12:10:45.272658 23120 rpcz_store.cc:276] 0709 12:10:42.708602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.738337 (+1029735us) service_pool.cc:224] Handling call
0709 12:10:43.738700 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.738993 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:44.993930 (+1254937us) log.cc:844] Serialized 14 byte log entry
0709 12:10:45.249854 (+255924us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:45.249920 (+    66us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:45.249996 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.250079 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:45.250214 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18388,"prepare.queue_time_us":883154,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":71,"raft.queue_time_us":95,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":12622,"thread_start_us":1510022,"threads_started":2}
I20260709 12:10:45.252071 25187 raft_consensus.cc:697] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
W20260709 12:10:45.274559 25273 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.312s	user 0.032s	sys 0.038s
I20260709 12:10:45.278918 23117 rpcz_store.cc:276] 0709 12:10:42.859027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.009223 (+2150196us) service_pool.cc:224] Handling call
0709 12:10:45.009505 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:45.009702 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:45.009959 (+   257us) log.cc:844] Serialized 14 byte log entry
0709 12:10:45.273243 (+263284us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:45.273308 (+    65us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:45.275370 (+  2062us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.275451 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:45.275555 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":6447,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":5046,"raft.queue_time_us":101,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":4482,"thread_start_us":262932,"threads_started":1}
I20260709 12:10:45.299207 22570 leader_election.cc:304] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:45.286067 22569 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:45.287106 22604 raft_consensus.cc:1240] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:45.270190 25298 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:45.268610 25175 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:45.299024 23122 raft_consensus.cc:2468] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5.
W20260709 12:10:45.277908 25346 log.cc:927] Time spent T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
W20260709 12:10:45.301487 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 171328us
W20260709 12:10:45.283620 25227 consensus_meta.cc:287] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 1.053s	user 0.010s	sys 0.003s
I20260709 12:10:45.307363 22569 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:45.311064 22570 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:45.308460 22569 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:10:45.319959 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:45.306782 25273 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.341s	user 0.032s	sys 0.038s
I20260709 12:10:45.318871 22450 raft_consensus.cc:2955] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:45.272842 25289 consensus_queue.cc:237] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:45.331187 23117 raft_consensus.cc:1240] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 5 LEADER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:45.309703 25144 raft_consensus.cc:2749] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:45.335209 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:45.336004 22532 raft_consensus.cc:2376] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5. Re-sending same reply.
I20260709 12:10:45.337103 23120 raft_consensus.cc:1275] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:45.301667 25140 consensus_queue.cc:1059] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:10:45.286372 25261 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:45.355876 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:45.342500 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:45.357761 23117 raft_consensus.cc:2410] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:45.359414 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:45.312203 25298 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:45.368214 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:45.369719 22457 raft_consensus.cc:2410] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:45.370088 22452 raft_consensus.cc:1275] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:45.322724 25230 consensus_queue.cc:1059] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:10:45.355894 25138 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:45.356178 25299 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:45.356487 25234 raft_consensus.cc:2749] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:45.401968 25138 raft_consensus.cc:697] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:45.343834 25324 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:45.379516 25358 raft_consensus.cc:3055] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:10:45.380141 25350 log.cc:927] Time spent T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:10:45.373534 24941 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:45.382939 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:45.383352 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:10:45.384461 23122 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57318 (request call id 782) took 3038 ms (client timeout 1947 ms). Trace:
I20260709 12:10:45.384536 25295 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:45.385660 25230 raft_consensus.cc:3055] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:45.437529 25230 raft_consensus.cc:740] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:45.438453 25230 consensus_queue.cc:260] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:45.387293 25261 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:45.387547 23124 raft_consensus.cc:1240] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:45.440469 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:45.388273 25351 log.cc:927] Time spent T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:10:45.388357 24751 consensus_queue.cc:1059] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:45.389043 22605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43070 (request call id 444) took 1442 ms. Trace:
I20260709 12:10:45.455242 22605 rpcz_store.cc:276] 0709 12:10:43.946812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.947759 (+   947us) service_pool.cc:224] Handling call
0709 12:10:45.388862 (+1441103us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400350cd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:45.388988 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2728707840}
I20260709 12:10:45.389634 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:45.456887 23123 raft_consensus.cc:2410] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:45.390138 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:45.391287 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:45.458446 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:45.393524 22496 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:45.396394 23121 raft_consensus.cc:1240] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:45.396610 22598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43070 (request call id 436) took 3010 ms. Trace:
I20260709 12:10:45.462958 22598 rpcz_store.cc:276] 0709 12:10:42.386069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.386183 (+   114us) service_pool.cc:224] Handling call
0709 12:10:42.386469 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:45.173788 (+2787319us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.396379 (+222591us) spinlock_profiling.cc:243] Waited 2.79 s on lock 0x7b54000ea954. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:45.396558 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6406065536}
W20260709 12:10:45.463564 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 70134.9us
I20260709 12:10:45.464190 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:45.465437 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:45.396960 25297 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.397356 22597 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 7.
I20260709 12:10:45.398603 25227 consensus_queue.cc:1048] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:45.330349 25363 raft_consensus.cc:2804] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:45.402814 25138 consensus_queue.cc:237] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:45.404502 22524 raft_consensus.cc:1275] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:10:45.475623 22524 pending_rounds.cc:85] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting all ops after (but not including) 5
I20260709 12:10:45.475942 22524 pending_rounds.cc:107] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:10:45.476261 22524 raft_consensus.cc:2889] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:45.415441 25319 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:45.415926 25039 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:45.341655 25233 consensus_queue.cc:1048] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 12:10:45.416486 25232 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:45.380853 25349 log.cc:927] Time spent T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:10:45.419896 25298 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:45.477385 25363 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:45.420317 25196 raft_consensus.cc:3055] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:45.367807 25187 consensus_queue.cc:237] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:45.421236 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:10:45.427503 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.434319 24941 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:45.432354 23122 rpcz_store.cc:269] 0709 12:10:42.345835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.346883 (+  1048us) service_pool.cc:224] Handling call
0709 12:10:45.016517 (+2669634us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x7b5800110198. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf8f40a0 00007f9ccf8f3984 00007f9cc8e6e6d4 00007f9cc8e6e662
0709 12:10:45.089122 (+ 72605us) spinlock_profiling.cc:243] Waited 3.52 ms on lock 0x7b5800110198. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809e9c 00007f9cc7809a5b 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf8f40a0 00007f9ccf8f3984 00007f9cc8e6e6d4 00007f9cc8e6e662
0709 12:10:45.384299 (+295177us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b54006f1154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:45.384396 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":435120512}
W20260709 12:10:45.388067 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 81854.6us
I20260709 12:10:45.442337 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:45.452605 25150 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:45.477041 25316 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:45.454385 25364 log.cc:927] Time spent T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:10:45.423147 25358 raft_consensus.cc:740] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:45.459720 23120 raft_consensus.cc:2393] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 5: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:45.466753 22602 raft_consensus.cc:2368] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 5. Current term is 6.
I20260709 12:10:45.478507 24751 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:45.467442 23119 raft_consensus.cc:2410] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 7 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:10:45.478703 22597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45562 (request call id 1923) took 1566 ms. Trace:
I20260709 12:10:45.471046 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:45.474746 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:45.480170 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:10:45.509230 22602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45562 (request call id 1921) took 1629 ms (client timeout 2033 ms). Trace:
I20260709 12:10:45.509620 22604 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:45.440653 23116 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:45.482563 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:45.461200 25230 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:45.484586 22496 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:45.466634 25307 raft_consensus.cc:2749] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:45.487757 23117 raft_consensus.cc:2376] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 5. Re-sending same reply.
W20260709 12:10:45.496147 23125 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57328 (request call id 952) took 2512 ms (client timeout 2453 ms). Trace:
W20260709 12:10:45.467741 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 156840us
I20260709 12:10:45.508967 22598 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 5.
I20260709 12:10:45.526427 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:45.527006 22598 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 7.
I20260709 12:10:45.527076 22497 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:45.477874 25299 consensus_queue.cc:1059] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:10:45.513800 25090 consensus_queue.cc:1059] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:45.488307 25363 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:45.515142 24950 consensus_queue.cc:1048] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:45.517707 25319 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:45.487382 25196 raft_consensus.cc:740] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
W20260709 12:10:45.538585 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:45.524255 23125 rpcz_store.cc:269] 0709 12:10:42.984082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.250933 (+266851us) service_pool.cc:224] Handling call
0709 12:10:45.495955 (+2245022us) spinlock_profiling.cc:243] Waited 806 ms on lock 0x7b54007300d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:45.496085 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1854011776}
I20260709 12:10:45.527966 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:45.509588 22602 rpcz_store.cc:269] 0709 12:10:43.879961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.880145 (+   184us) service_pool.cc:224] Handling call
0709 12:10:45.389992 (+1509847us) spinlock_profiling.cc:243] Waited 1.45 ms on lock 0x7b58001b3098. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf8f40a0 00007f9ccf8f3984 00007f9cc8e6e6d4 00007f9cc8e6e662
0709 12:10:45.509168 (+119176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3339520}
I20260709 12:10:45.534054 22570 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:45.536338 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 51819.1us
I20260709 12:10:45.475262 25297 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:45.535893 22421 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:45.540457 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:45.544243 22601 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:45.544168 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:45.544111 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:45.545770 22605 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 5.
I20260709 12:10:45.546309 24941 raft_consensus.cc:3055] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:45.512840 24751 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:45.565059 24941 raft_consensus.cc:740] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:45.565412 22602 raft_consensus.cc:1275] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:45.565910 24941 consensus_queue.cc:260] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:45.566619 24751 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:45.567094 24941 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:45.567337 25144 consensus_queue.cc:1048] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:45.504679 25261 consensus_queue.cc:1059] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:10:45.550340 22570 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:45.580955 22603 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:10:45.508646 22597 rpcz_store.cc:276] 0709 12:10:43.912127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.583325 (+671198us) service_pool.cc:224] Handling call
0709 12:10:45.475735 (+892410us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:45.544620 25231 raft_consensus.cc:2804] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:45.541848 24756 consensus_queue.cc:1048] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 12:10:45.602525 22597 raft_consensus.cc:1275] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:45.603050 25231 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:45.544945 25206 raft_consensus.cc:2749] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:45.538282 24992 consensus_queue.cc:1059] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 12:10:45.544816 25177 raft_consensus.cc:2749] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:45.535064 25233 consensus_queue.cc:1048] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:10:45.586557 25144 raft_consensus.cc:2749] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:45.611021 22570 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:45.613819 22570 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:45.614877 22570 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:45.618765 25138 consensus_queue.cc:1048] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:45.619107 25144 raft_consensus.cc:2749] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:45.607908 25231 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:45.621251 22570 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:10:45.606106 25196 consensus_queue.cc:260] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:45.628374 25196 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:45.631047 25295 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:45.631832 25090 raft_consensus.cc:2804] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:45.632340 25090 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:45.631772 25260 raft_consensus.cc:3055] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:45.632992 25260 raft_consensus.cc:740] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:45.633828 23087 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:45.633795 25260 consensus_queue.cc:260] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:45.635087 25260 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:45.635771 25374 log.cc:927] Time spent T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:10:45.636483 25023 raft_consensus.cc:2749] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:45.626691 25297 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:45.632692 25090 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:45.635727 23087 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:45.638085 22602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:45546
I20260709 12:10:45.640002 22602 raft_consensus.cc:606] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Received request to transfer leadership
I20260709 12:10:45.650396 22604 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 6.
I20260709 12:10:45.651355 22598 raft_consensus.cc:1240] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:45.617961 25234 raft_consensus.cc:2749] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:45.631184 25231 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:45.622709 24950 raft_consensus.cc:2804] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:45.655689 22570 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
W20260709 12:10:45.663888 25375 log.cc:927] Time spent T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:10:45.623128 25206 consensus_queue.cc:1048] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:10:45.667152 25218 raft_consensus.cc:3055] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:45.667524 25218 raft_consensus.cc:740] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:45.633857 25180 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.668318 25218 consensus_queue.cc:260] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:45.668663 25180 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:45.669596 25218 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:45.676887 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 149877us
I20260709 12:10:45.678303 23089 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:45.686286 24889 raft_consensus.cc:3055] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:45.686719 24889 raft_consensus.cc:740] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:45.687723 25180 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:45.687614 24889 consensus_queue.cc:260] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:45.688854 24889 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:45.695859 23125 raft_consensus.cc:1275] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:10:45.700663 25281 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.701336 25281 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:45.705077 23116 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 6.
W20260709 12:10:45.705765 25370 log.cc:927] Time spent T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:10:45.706003 25177 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.706957 25368 raft_consensus.cc:2804] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:45.707487 25368 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:45.708078 25368 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:45.708423 22606 raft_consensus.cc:1275] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:45.708370 25313 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:45.709046 25313 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:45.707516 25090 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:45.711061 25313 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:45.711129 25090 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:45.711274 25355 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:45.711822 25232 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.711910 25355 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:45.712390 25232 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:45.712852 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:45.713760 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:45.714339 25355 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:45.714686 22524 raft_consensus.cc:2393] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 6: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:45.715145 25175 raft_consensus.cc:2804] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:45.715536 25175 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:45.715693 25364 log.cc:927] Time spent T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:10:45.583767 25358 consensus_queue.cc:260] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:45.716643 25358 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:45.716758 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 81090.8us
I20260709 12:10:45.717175 22532 raft_consensus.cc:1275] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:45.717749 23087 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:45.706524 25177 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:45.719216 25023 raft_consensus.cc:2749] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:10:45.719537 25371 log.cc:927] Time spent T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:10:45.711155 25295 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.720921 25177 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:45.722246 25313 consensus_queue.cc:1048] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:45.715956 25175 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:45.720233 25023 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:45.724241 25231 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:45.725126 23087 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:45.725643 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 70081.9us
I20260709 12:10:45.725606 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:45.714442 25232 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:45.729115 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:45.745299 22525 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 6.
I20260709 12:10:45.704932 23118 raft_consensus.cc:1240] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:45.735298 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:45.739362 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:45.740869 23120 raft_consensus.cc:1240] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:45.743829 22570 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:45.742285 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:45.731647 22526 raft_consensus.cc:1240] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:45.750046 23087 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:45.747493 22523 raft_consensus.cc:1240] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:10:45.747511 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:45.750303 22570 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:45.750841 22532 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 6.
I20260709 12:10:45.751573 22570 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:45.749922 22524 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 5.
I20260709 12:10:45.756784 23087 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:45.760878 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 225033us
I20260709 12:10:45.763228 22421 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:45.790120 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:45.790932 23120 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:10:45.795024 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:45.795907 22455 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 4.
I20260709 12:10:45.797194 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:45.798559 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:45.799376 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:45.806188 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.806569 22456 raft_consensus.cc:1275] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:45.800218 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:45.742317 24950 raft_consensus.cc:697] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
W20260709 12:10:45.810801 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.801826 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:45.817512 22457 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 5.
I20260709 12:10:45.817633 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:45.743055 25245 raft_consensus.cc:2749] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:45.804589 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.821022 22524 raft_consensus.cc:1275] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:45.821175 22422 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:45.714944 25355 consensus_queue.cc:1048] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 12:10:45.818331 22449 raft_consensus.cc:2368] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 6. Current term is 7.
I20260709 12:10:45.801005 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:45.761461 25348 raft_consensus.cc:2749] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:45.820945 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:45.742421 25027 consensus_queue.cc:1048] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 12:10:45.789572 25206 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:45.842229 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:45.838107 22523 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 5.
I20260709 12:10:45.789279 25273 raft_consensus.cc:2749] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:10:45.825067 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 61916.4us
I20260709 12:10:45.803911 25232 raft_consensus.cc:2749] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:45.744961 25295 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:45.840998 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:45.762396 25196 raft_consensus.cc:2804] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:45.803686 25233 raft_consensus.cc:2804] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:45.842850 23125 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:45.853888 22454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1591) took 1133 ms. Trace:
I20260709 12:10:45.810361 25266 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.802569 25231 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.822885 25090 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:45.895606 25090 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:45.851927 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:45.854403 22454 rpcz_store.cc:276] 0709 12:10:44.720399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.084978 (+364579us) service_pool.cc:224] Handling call
0709 12:10:45.853703 (+768725us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b5400221854. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:45.853829 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40703360}
I20260709 12:10:45.898487 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:45.899377 22530 raft_consensus.cc:2368] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 5. Current term is 6.
I20260709 12:10:45.856081 22452 raft_consensus.cc:1275] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:45.856735 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:45.902881 22455 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 5.
I20260709 12:10:45.858000 22606 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:45.841145 25261 raft_consensus.cc:2804] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:45.909790 25261 raft_consensus.cc:697] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:45.840147 24751 raft_consensus.cc:2749] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:45.821620 25187 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:45.943260 25266 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:45.943804 25187 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:45.946022 22603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45562 (request call id 1920) took 2079 ms (client timeout 1535 ms). Trace:
I20260709 12:10:45.947609 22600 raft_consensus.cc:1275] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:45.948326 25196 raft_consensus.cc:697] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:45.949488 25196 consensus_queue.cc:237] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:45.865084 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.953152 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:45.950757 25243 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:45.946513 22603 rpcz_store.cc:269] 0709 12:10:43.866901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.867431 (+   530us) service_pool.cc:224] Handling call
0709 12:10:45.945765 (+2078334us) spinlock_profiling.cc:243] Waited 1.7 s on lock 0x7b54003ae3d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:45.945929 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3915412352}
I20260709 12:10:45.865629 25295 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:45.867460 25281 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:45.868177 23116 raft_consensus.cc:1240] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:45.837517 24993 consensus_queue.cc:1059] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:10:45.876827 23119 raft_consensus.cc:1275] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:45.960887 24970 raft_consensus.cc:3055] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:45.961544 24970 raft_consensus.cc:740] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:45.878754 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:45.818835 24992 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:45.880721 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:45.881934 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:45.882362 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:45.883113 25231 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:45.883157 22525 raft_consensus.cc:1275] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:45.891359 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:45.891306 24950 consensus_queue.cc:237] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:45.893268 22457 raft_consensus.cc:1275] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:45.905646 22495 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:45.843125 25280 consensus_queue.cc:1059] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:10:45.897892 22524 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 4.
I20260709 12:10:45.911216 25261 consensus_queue.cc:237] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:45.912673 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:45.879338 25382 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:45.847036 25203 consensus_queue.cc:1059] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 12:10:45.938591 22448 raft_consensus.cc:2468] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 6.
I20260709 12:10:45.962795 22453 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 3.
I20260709 12:10:46.197891 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:46.173075 22599 raft_consensus.cc:1240] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:46.051883 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.205896 22532 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 6.
W20260709 12:10:46.115154 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 281011us
I20260709 12:10:46.186170 23125 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:10:46.205170 22603 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:10:46.220528 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:46.210563 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:46.210361 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:46.209272 22606 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 6.
I20260709 12:10:46.241333 22456 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 7.
W20260709 12:10:46.204207 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.207517 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:46.178422 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.163053 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:46.020956 22601 raft_consensus.cc:2468] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7.
I20260709 12:10:46.210525 22451 raft_consensus.cc:1240] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:46.243607 22598 raft_consensus.cc:2368] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 5. Current term is 6.
I20260709 12:10:46.223889 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:46.240336 22452 raft_consensus.cc:2393] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 5: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:46.246644 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:46.282971 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:46.282739 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:46.139735 25271 raft_consensus.cc:3055] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:46.285390 25271 raft_consensus.cc:740] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:46.285609 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:46.286688 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:10:46.287722 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 44716.9us
I20260709 12:10:46.291762 22528 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 7.
W20260709 12:10:46.211401 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 305844us
I20260709 12:10:46.157398 25294 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.294929 23123 raft_consensus.cc:1275] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:10:45.943328 23118 raft_consensus.cc:1275] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:46.319562 22496 leader_election.cc:304] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:46.213001 22449 raft_consensus.cc:2393] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 3: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
W20260709 12:10:46.163342 25372 log.cc:927] Time spent T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.512s	user 0.000s	sys 0.005s
I20260709 12:10:46.239832 23119 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:10:46.321058 23118 raft_consensus.cc:1240] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:46.207988 25243 consensus_queue.cc:1048] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.091s
I20260709 12:10:46.322544 22450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1595) took 1043 ms. Trace:
I20260709 12:10:46.297235 24751 consensus_queue.cc:1059] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:10:46.323089 22450 rpcz_store.cc:276] 0709 12:10:45.279573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.279758 (+   185us) service_pool.cc:224] Handling call
0709 12:10:45.280095 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:45.284536 (+  4441us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:45.363077 (+ 78541us) log.cc:844] Serialized 14 byte log entry
0709 12:10:45.541722 (+178645us) log.cc:844] Serialized 14 byte log entry
0709 12:10:45.628546 (+ 86824us) spinlock_profiling.cc:243] Waited 3.69 ms on lock 0x7b18003f7000. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc77bbc0a 00007f9cd0efb219 00007f9cc7843a40 00007f9cc783e4e4 00007f9cc783e455 00007f9cca926060 00007f9cca938716 00007f9cca949287 00007f9cca949208
0709 12:10:45.808310 (+179764us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:45.825047 (+ 16737us) log.cc:844] Serialized 26 byte log entry
0709 12:10:45.825318 (+   271us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:45.825366 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.825450 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:46.050684 (+225234us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:10:46.322336 (+271652us) raft_consensus.cc:1685] finished
0709 12:10:46.322359 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.322474 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81376,"prepare.queue_time_us":29920,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":101845,"raft.run_cpu_time_us":339,"raft.run_wall_time_us":3395,"spinlock_wait_cycles":14706432,"thread_start_us":307265,"threads_started":2,"wal-append.queue_time_us":222882}
I20260709 12:10:46.163997 25023 raft_consensus.cc:2749] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:46.198041 25313 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:46.326085 25175 consensus_meta.cc:287] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.571s	user 0.011s	sys 0.001s
I20260709 12:10:46.326428 25313 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:46.326663 25175 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:46.329285 25175 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:46.329346 25313 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:46.082613 25363 consensus_meta.cc:287] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.538s	user 0.006s	sys 0.006s
W20260709 12:10:46.214803 24941 consensus_meta.cc:287] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.647s	user 0.010s	sys 0.000s
I20260709 12:10:46.284369 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:46.249043 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:46.296597 22422 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:46.330559 23120 raft_consensus.cc:2368] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 7. Current term is 8.
W20260709 12:10:46.340577 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 44070.4us
I20260709 12:10:46.289316 22604 raft_consensus.cc:1240] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 5. Current term is 7. Ops: []
I20260709 12:10:46.256623 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:46.341993 22422 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:46.299410 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:46.133881 24970 consensus_queue.cc:260] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:46.300675 25177 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.298805 23123 raft_consensus.cc:1240] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:45.915757 25233 raft_consensus.cc:697] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
W20260709 12:10:46.304739 25358 consensus_meta.cc:287] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.588s	user 0.007s	sys 0.004s
I20260709 12:10:46.305085 25294 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:46.306695 25387 consensus_queue.cc:1048] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:46.312193 23087 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:10:46.356104 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 44011.7us
I20260709 12:10:46.357234 23087 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:46.361537 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:46.360153 24970 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:46.351259 24751 consensus_queue.cc:1059] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:10:46.325327 25280 raft_consensus.cc:3055] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:46.298576 22495 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:46.344707 22496 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:46.341246 22531 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 6.
I20260709 12:10:46.287755 25282 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.371353 22528 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 7.
W20260709 12:10:46.376742 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 78262.2us
I20260709 12:10:46.377130 22496 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:46.214128 25230 raft_consensus.cc:2749] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:46.348960 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:46.382694 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:46.383852 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:46.347569 25202 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:46.351269 22529 raft_consensus.cc:2410] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:46.291872 25090 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:46.218657 25266 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:46.353897 22422 leader_election.cc:400] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 5. Current term is 6.
I20260709 12:10:46.391781 22422 leader_election.cc:403] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:46.353642 25260 raft_consensus.cc:2804] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:46.124789 25368 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:46.291149 24992 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:46.366190 25348 consensus_queue.cc:1048] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:10:46.352174 25313 raft_consensus.cc:2804] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:46.371402 23087 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:46.377808 25280 raft_consensus.cc:740] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:46.385375 24941 raft_consensus.cc:2804] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:46.366583 25023 raft_consensus.cc:2804] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:46.349896 25363 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:46.391016 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:46.369288 25232 raft_consensus.cc:2804] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:46.373999 25281 consensus_queue.cc:1059] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:10:46.353279 25177 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:46.286868 25271 consensus_queue.cc:260] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:46.394857 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:10:46.395390 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 47044.6us
I20260709 12:10:46.239283 25382 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:46.380069 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:46.398654 25266 raft_consensus.cc:2749] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 5. Current term is 6.
W20260709 12:10:46.407166 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.369797 25175 consensus_queue.cc:1048] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:10:46.417959 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:46.411250 25295 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:46.393808 25202 raft_consensus.cc:697] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 7 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:46.414669 25232 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:46.402189 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:46.488219 23123 raft_consensus.cc:2376] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5. Re-sending same reply.
I20260709 12:10:46.430312 23122 raft_consensus.cc:2393] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 6: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:46.397500 25260 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:46.476689 22449 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:46.418375 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:46.494874 22530 raft_consensus.cc:2393] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 5: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:46.495438 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:46.495723 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:46.496740 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:46.497419 22530 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 4.
I20260709 12:10:46.498044 22421 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:46.498382 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:46.429821 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:46.500062 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:46.483276 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:46.504128 22421 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:46.387591 25282 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:46.414886 25023 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:46.414762 25313 raft_consensus.cc:697] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:46.492723 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:46.510880 23122 raft_consensus.cc:2393] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 6: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:46.480787 25355 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:46.504387 22603 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:46.478766 25271 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:46.509759 25023 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:46.489215 25232 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:46.513494 22570 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:46.515435 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:46.529644 23125 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5.
I20260709 12:10:46.500447 25260 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:46.540817 22603 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 7.
I20260709 12:10:46.514328 22421 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:46.505843 25202 consensus_queue.cc:237] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:46.550042 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.508771 25387 raft_consensus.cc:2749] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:46.514623 25218 raft_consensus.cc:2749] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:46.556897 22530 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:10:46.430106 25233 consensus_queue.cc:237] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:46.558478 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:46.559559 22449 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 8.
I20260709 12:10:46.457419 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:46.528262 25348 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:46.562158 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:46.565109 22530 raft_consensus.cc:2376] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6. Re-sending same reply.
I20260709 12:10:46.568235 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:46.568822 22530 raft_consensus.cc:2376] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6. Re-sending same reply.
I20260709 12:10:46.517840 25358 consensus_queue.cc:1048] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:10:46.412446 24941 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:46.517998 25243 consensus_queue.cc:1059] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:10:46.571552 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:46.533660 25196 consensus_queue.cc:1059] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:10:46.560956 25249 raft_consensus.cc:2749] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:46.583280 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:46.582864 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:46.524114 25355 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:46.578838 22530 raft_consensus.cc:2368] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 6. Current term is 7.
I20260709 12:10:46.457950 25090 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.413029 25230 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:46.563539 25294 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:46.582195 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:46.626628 23125 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 6.
I20260709 12:10:46.625814 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:46.627782 22530 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:46.575520 24941 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:46.629739 25388 log.cc:927] Time spent T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 12:10:46.631315 25294 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:46.631942 24889 consensus_queue.cc:1048] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:46.633953 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:46.634685 22532 raft_consensus.cc:2393] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 7: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:46.635468 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:46.636003 22532 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
W20260709 12:10:46.636268 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 258765us
I20260709 12:10:46.569383 25363 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:46.536459 25280 consensus_queue.cc:260] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:46.582643 25390 log.cc:927] Time spent T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 12:10:46.638541 22495 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
W20260709 12:10:46.630908 25394 log.cc:927] Time spent T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:10:46.651582 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:46.570043 25348 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:46.659951 25230 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:46.679569 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 302501us
W20260709 12:10:46.649019 25389 log.cc:927] Time spent T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260709 12:10:46.682265 22530 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 7.
I20260709 12:10:46.685118 22496 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:46.697520 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:46.697677 22496 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:46.708137 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:46.710206 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:46.717763 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:46.718472 22450 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:46.725952 22532 raft_consensus.cc:2393] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 9: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:46.730715 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:46.703615 23089 leader_election.cc:304] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:10:46.738672 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.742235 22453 raft_consensus.cc:1275] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:46.745139 23089 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:46.750133 22453 raft_consensus.cc:1275] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:46.750227 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:46.751058 23125 raft_consensus.cc:2410] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:46.757719 25282 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:46.661844 25382 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:46.642256 25090 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:46.643251 24941 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:46.815237 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:46.815294 25175 consensus_queue.cc:1048] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:46.816082 22532 raft_consensus.cc:2393] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 7: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:46.816324 24941 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:46.802644 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:46.818104 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.695389 24992 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:46.813313 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:46.701551 25177 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:46.847630 22530 raft_consensus.cc:2393] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 6: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
W20260709 12:10:46.748418 25394 log.cc:927] Time spent T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:10:46.826534 22450 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
I20260709 12:10:46.727015 25280 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:46.656854 25368 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:46.640862 25313 consensus_queue.cc:237] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:46.810349 25316 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:46.809630 25282 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:46.902828 25282 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:46.903630 22530 raft_consensus.cc:1240] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:46.905478 25282 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:46.902302 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:46.821156 25281 raft_consensus.cc:2804] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:46.894718 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 380459us
I20260709 12:10:46.902212 25316 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:46.699271 25230 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:46.875746 25175 raft_consensus.cc:2804] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:46.874120 25392 raft_consensus.cc:2804] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:46.898730 25400 raft_consensus.cc:2804] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:46.911798 22421 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:46.890359 25177 raft_consensus.cc:2804] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:46.916002 22422 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:46.898780 22597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2319) took 1049 ms. Trace:
W20260709 12:10:46.908516 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 379747us
I20260709 12:10:46.929458 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:46.912919 25281 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:46.920110 25392 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:46.932668 25399 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.939512 25281 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:46.931106 25175 raft_consensus.cc:697] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 6 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
W20260709 12:10:47.022518 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 383801us
I20260709 12:10:46.937455 25249 raft_consensus.cc:2749] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:46.930246 25400 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:46.954371 25392 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:47.026846 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 93120.8us
W20260709 12:10:47.028981 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 390532us
I20260709 12:10:47.131744 22495 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:47.133786 22495 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:46.941058 25282 raft_consensus.cc:2804] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:10:47.136278 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 224583us
I20260709 12:10:47.137030 22421 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:47.037988 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:47.041059 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.045588 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:47.050328 25213 raft_consensus.cc:3055] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:47.052628 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:47.145027 23121 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:47.053560 22448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2166) took 1262 ms. Trace:
I20260709 12:10:47.147215 22448 rpcz_store.cc:276] 0709 12:10:45.791068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.799944 (+  8876us) service_pool.cc:224] Handling call
0709 12:10:47.053351 (+1253407us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b540037a354. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:47.053479 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":296716032}
I20260709 12:10:47.054425 22531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38310 (request call id 597) took 1153 ms. Trace:
I20260709 12:10:47.055245 22606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45576 (request call id 2318) took 1330 ms. Trace:
I20260709 12:10:47.028478 25404 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:47.149005 22606 rpcz_store.cc:276] 0709 12:10:45.724860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.724994 (+   134us) service_pool.cc:224] Handling call
0709 12:10:47.055059 (+1330065us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54000e9f54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:47.055178 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":249516800}
I20260709 12:10:47.150286 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:47.056456 22454 raft_consensus.cc:1240] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:47.060883 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:47.061609 25226 raft_consensus.cc:3055] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:47.065986 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:47.152848 23117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57328 (request call id 964) took 1257 ms. Trace:
I20260709 12:10:47.153257 23117 rpcz_store.cc:276] 0709 12:10:45.895237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.896528 (+  1291us) service_pool.cc:224] Handling call
0709 12:10:47.065798 (+1169270us) spinlock_profiling.cc:243] Waited 1.12 ms on lock 0x7b5800110198. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf8f40a0 00007f9ccf8f3984 00007f9cc8e6e6d4 00007f9cc8e6e662
0709 12:10:47.152777 (+ 86979us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2573056}
I20260709 12:10:47.067931 23124 raft_consensus.cc:3055] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:47.154505 23124 raft_consensus.cc:740] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:47.068841 23120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57328 (request call id 960) took 1252 ms. Trace:
I20260709 12:10:47.156061 23120 rpcz_store.cc:276] 0709 12:10:45.816946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.817218 (+   272us) service_pool.cc:224] Handling call
0709 12:10:45.952982 (+135764us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b5800110198. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf8f40a0 00007f9ccf8f3984 00007f9cc8e6e6d4 00007f9cc8e6e662
0709 12:10:47.068590 (+1115608us) spinlock_profiling.cc:243] Waited 376 ms on lock 0x7b540018ef54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:47.068769 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":869860480}
I20260709 12:10:47.081816 25231 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:47.087616 25039 raft_consensus.cc:3055] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:47.160957 25039 raft_consensus.cc:740] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:47.162426 25039 consensus_queue.cc:260] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:47.151640 25404 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:47.163892 25039 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:47.165349 25404 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:47.090044 22600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2295) took 2072 ms. Trace:
W20260709 12:10:47.167440 25395 log.cc:927] Time spent T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.285s	user 0.000s	sys 0.000s
I20260709 12:10:47.058733 23116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 958) took 1313 ms. Trace:
I20260709 12:10:47.168084 23116 rpcz_store.cc:276] 0709 12:10:45.745492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.746857 (+  1365us) service_pool.cc:224] Handling call
0709 12:10:45.823607 (+ 76750us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:45.959767 (+136160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.058400 (+1098633us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b5400750154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:47.058654 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46353152}
I20260709 12:10:47.142825 25400 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:47.171897 23124 consensus_queue.cc:260] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:47.173153 23124 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:47.173197 25348 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:47.030122 25399 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:47.148543 22531 rpcz_store.cc:276] 0709 12:10:45.900609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.900760 (+   151us) service_pool.cc:224] Handling call
0709 12:10:47.054243 (+1153483us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b5400263c54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:47.054358 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":231762176}
I20260709 12:10:47.176263 25399 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:47.176860 25399 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.160293 25226 raft_consensus.cc:740] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:47.177402 25399 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:47.178356 25226 consensus_queue.cc:260] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:47.094146 25187 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:47.179316 25363 consensus_queue.cc:1048] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:47.179883 25187 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.180487 25187 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:47.180760 25175 consensus_queue.cc:237] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:47.172537 25230 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:47.127709 25347 raft_consensus.cc:3055] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:47.184495 25230 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.185086 25230 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:47.172237 25407 consensus_queue.cc:1048] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:47.151322 22606 raft_consensus.cc:2410] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:10:47.189311 25294 consensus_meta.cc:287] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.558s	user 0.007s	sys 0.000s
I20260709 12:10:47.189775 25294 raft_consensus.cc:2749] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:47.167528 22600 rpcz_store.cc:276] 0709 12:10:45.017711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.250948 (+233237us) service_pool.cc:224] Handling call
0709 12:10:45.947202 (+696254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:45.948050 (+   848us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.089755 (+1141705us) spinlock_profiling.cc:243] Waited 696 ms on lock 0x7b54003ae3d0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:47.089963 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1600463744}
I20260709 12:10:47.191162 25187 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:47.143816 25213 raft_consensus.cc:740] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:47.195732 25230 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:47.198812 22599 raft_consensus.cc:1240] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:47.183491 25393 log.cc:927] Time spent T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.261s	user 0.000s	sys 0.000s
I20260709 12:10:47.238086 22497 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:47.239770 22497 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
W20260709 12:10:47.234637 22569 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.007s	sys 0.010s
I20260709 12:10:47.237277 22601 raft_consensus.cc:1240] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:47.241174 22569 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.007s	sys 0.010s
I20260709 12:10:47.184408 25347 raft_consensus.cc:740] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:47.247252 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:47.248090 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.249158 22606 raft_consensus.cc:1275] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:47.262378 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:47.263149 22606 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 6.
I20260709 12:10:47.264585 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:47.265298 22606 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 6.
I20260709 12:10:47.258337 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:47.269855 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.224876 23121 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
W20260709 12:10:47.275705 23121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57328 (request call id 965) took 1380 ms (client timeout 1583 ms). Trace:
W20260709 12:10:47.276202 23121 rpcz_store.cc:269] 0709 12:10:45.895650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.896784 (+  1134us) service_pool.cc:224] Handling call
0709 12:10:47.052434 (+1155650us) spinlock_profiling.cc:243] Waited 20.1 ms on lock 0x7b5800110198. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf8f40a0 00007f9ccf8f3984 00007f9cc8e6e6d4 00007f9cc8e6e662
0709 12:10:47.275628 (+223194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46279552}
I20260709 12:10:47.199667 25282 raft_consensus.cc:697] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:47.286752 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:47.193992 25295 consensus_meta.cc:287] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.706s	user 0.006s	sys 0.001s
I20260709 12:10:47.296089 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:47.300267 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 163296us
I20260709 12:10:47.302911 22421 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
W20260709 12:10:47.203814 25260 consensus_meta.cc:287] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.656s	user 0.005s	sys 0.005s
I20260709 12:10:47.235911 25266 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.204666 25348 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.307155 22421 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:47.313653 22528 raft_consensus.cc:1240] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:47.317415 22497 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
W20260709 12:10:47.296182 24970 consensus_meta.cc:287] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.922s	user 0.011s	sys 0.000s
I20260709 12:10:47.318698 22497 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
W20260709 12:10:47.305624 25232 consensus_meta.cc:287] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.759s	user 0.002s	sys 0.007s
I20260709 12:10:47.295439 25233 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.329525 25233 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:47.320966 25348 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:47.330506 25203 raft_consensus.cc:2749] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:47.312742 25404 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.331311 25404 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:47.331841 25233 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:47.321425 22569 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:47.305531 24992 raft_consensus.cc:2749] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:47.312908 25403 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.326516 25347 consensus_queue.cc:260] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:47.324326 22603 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 8.
I20260709 12:10:47.308986 25187 raft_consensus.cc:2749] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:47.337481 22599 raft_consensus.cc:1240] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:47.312532 24756 raft_consensus.cc:2749] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:47.339376 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:47.304311 25090 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:47.314663 25295 raft_consensus.cc:2749] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:47.326143 23124 raft_consensus.cc:1275] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:10:47.317646 25213 consensus_queue.cc:260] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:47.383674 23124 pending_rounds.cc:85] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270: Aborting all ops after (but not including) 5
I20260709 12:10:47.386881 23124 pending_rounds.cc:107] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:10:47.387187 23124 raft_consensus.cc:2889] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:47.335018 24970 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.338276 25294 raft_consensus.cc:2804] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:47.321019 25414 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:47.316043 25260 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:47.318459 25266 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:47.414058 22455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 570) took 1505 ms. Trace:
I20260709 12:10:47.452716 22455 rpcz_store.cc:276] 0709 12:10:45.908462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.955426 (+ 46964us) service_pool.cc:224] Handling call
0709 12:10:47.386899 (+1431473us) spinlock_profiling.cc:243] Waited 978 us on lock 0x7b5800002a98. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809eee 000000000036eb39 00007f9ccf87d1e0 00007f9ccf9460c4 00007f9ccf946131 00007f9ccf907fc0 00007f9ccf8f2929 00007f9ccf8f23d2 00007f9cc8e69bd4
0709 12:10:47.413527 (+ 26628us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.413716 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.413747 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:47.413788 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:47.413823 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.413874 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.413984 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2273920}
I20260709 12:10:47.414062 23124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 966) took 1518 ms. Trace:
W20260709 12:10:47.426435 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:47.461745 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.334760 25232 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:47.428026 25233 raft_consensus.cc:2804] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:47.429697 25409 consensus_queue.cc:1048] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:10:47.430742 22498 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.042s	sys 0.084s
W20260709 12:10:47.470003 22498 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.042s	sys 0.085s
I20260709 12:10:47.452414 24970 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:47.455467 25415 consensus_queue.cc:1048] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:47.456266 25294 raft_consensus.cc:697] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:47.383674 25184 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.459185 25213 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:47.460942 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.426864 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:46.934121 22597 rpcz_store.cc:276] 0709 12:10:45.849661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.851896 (+  2235us) service_pool.cc:224] Handling call
0709 12:10:45.908774 (+ 56878us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:45.956848 (+ 48074us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:45.956933 (+    85us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:45.957866 (+   933us) log.cc:844] Serialized 26 byte log entry
0709 12:10:46.208240 (+250374us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:46.230145 (+ 21905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.230583 (+   438us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:46.895864 (+665281us) raft_consensus.cc:1685] finished
0709 12:10:46.898433 (+  2569us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.898691 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47494,"raft.queue_time_us":51570,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":123,"thread_start_us":228630,"threads_started":1,"wal-append.queue_time_us":412722}
W20260709 12:10:47.463358 22523 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.019s	sys 0.015s
I20260709 12:10:47.384351 25402 raft_consensus.cc:2804] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:47.385636 25347 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:47.430598 25404 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:47.472210 22449 raft_consensus.cc:2393] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 4: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:47.485083 22523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 591) took 1605 ms. Trace:
W20260709 12:10:47.487023 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.486821 22523 rpcz_store.cc:276] 0709 12:10:45.879846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.882427 (+  2581us) service_pool.cc:224] Handling call
0709 12:10:46.053780 (+171353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:46.054045 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:10:46.292273 (+238228us) log.cc:844] Serialized 14 byte log entry
0709 12:10:46.938352 (+646079us) log.cc:844] Serialized 14 byte log entry
0709 12:10:47.063994 (+125642us) spinlock_profiling.cc:243] Waited 34.2 ms on lock 0x7b18003ff4c0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc78413f3 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd 0000000000388634 0000000000388479 00007f9cc782483a
0709 12:10:47.484659 (+420665us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:47.484724 (+    65us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:47.484802 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.484885 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.485020 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14812,"prepare.queue_time_us":350830,"prepare.run_cpu_time_us":128,"prepare.run_wall_time_us":23013,"raft.queue_time_us":428090,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":34121,"spinlock_wait_cycles":78770048,"thread_start_us":1329512,"threads_started":4,"wal-append.queue_time_us":517420}
W20260709 12:10:47.463677 25177 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.012s	sys 0.022s
I20260709 12:10:47.452766 25414 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.417704 25399 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:47.426734 25392 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:47.350389 25403 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:47.461515 23124 rpcz_store.cc:276] 0709 12:10:45.896063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.897014 (+   951us) service_pool.cc:224] Handling call
0709 12:10:47.067515 (+1170501us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b5800110198. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf907fc0 00007f9ccf8f2929 00007f9ccf8f23d2 00007f9cc8e69bd4
0709 12:10:47.067744 (+   229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.413874 (+346130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.414014 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44170624}
I20260709 12:10:47.475281 25243 raft_consensus.cc:993] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc: : Instructing follower c863116d91c14d1ca50d6e8a46a37a8f to start an election
W20260709 12:10:47.504467 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.505569 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:47.474889 25408 raft_consensus.cc:2804] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:47.418097 25282 consensus_queue.cc:237] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:47.509081 22523 raft_consensus.cc:1240] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 12:10:47.481685 25233 raft_consensus.cc:697] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:47.510288 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:47.519273 23120 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 6.
I20260709 12:10:47.511372 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:47.520552 23116 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 6.
I20260709 12:10:47.497815 25412 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.511579 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:47.512392 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:47.498947 25177 raft_consensus.cc:697] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:47.511706 25408 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.506405 25348 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:47.532739 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 399021us
I20260709 12:10:47.503266 25414 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:47.511314 25243 raft_consensus.cc:1081] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Signalling peer c863116d91c14d1ca50d6e8a46a37a8f to start an election
W20260709 12:10:47.534816 22527 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.007s	sys 0.007s
I20260709 12:10:47.510562 25402 raft_consensus.cc:697] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
W20260709 12:10:47.535306 22527 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.007s	sys 0.007s
I20260709 12:10:47.532186 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:47.528088 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 179559us
I20260709 12:10:47.536811 22523 raft_consensus.cc:2393] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 6: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:47.482903 25184 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:47.501224 25281 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:47.551748 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:47.552883 25281 leader_election.cc:290] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:47.553489 25403 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:47.553555 22523 raft_consensus.cc:1240] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 LEADER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:47.554584 25266 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:47.559695 22532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 1913) took 1377 ms. Trace:
I20260709 12:10:47.509704 25419 raft_consensus.cc:2804] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:47.565902 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:47.561887 22569 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:47.560060 22532 rpcz_store.cc:276] 0709 12:10:46.181895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.816712 (+634817us) service_pool.cc:224] Handling call
0709 12:10:46.817023 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:46.817305 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:46.817334 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:46.842890 (+ 25556us) log.cc:844] Serialized 26 byte log entry
0709 12:10:47.239696 (+396806us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:47.239745 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.239815 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:47.559479 (+319664us) raft_consensus.cc:1685] finished
0709 12:10:47.559501 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.559640 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":274461,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102,"thread_start_us":334153,"threads_started":1,"wal-append.queue_time_us":570621}
W20260709 12:10:47.552088 25023 consensus_meta.cc:287] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 1.015s	user 0.010s	sys 0.000s
I20260709 12:10:47.525787 25358 raft_consensus.cc:3055] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:10:47.534585 25196 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.889s	user 0.006s	sys 0.015s
W20260709 12:10:47.534723 24941 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.007s	sys 0.009s
I20260709 12:10:47.512679 25187 consensus_queue.cc:1048] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
W20260709 12:10:47.622118 22529 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38310 (request call id 585) took 1889 ms (client timeout 1999 ms). Trace:
W20260709 12:10:47.627282 22529 rpcz_store.cc:269] 0709 12:10:45.732344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.734987 (+  2643us) service_pool.cc:224] Handling call
0709 12:10:47.621840 (+1886853us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b5400082ad4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:47.622029 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1383514368}
I20260709 12:10:47.576586 22496 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:47.529613 25408 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:47.636502 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 330540us
I20260709 12:10:47.528776 25412 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:47.638417 22570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.040s	sys 0.035s
W20260709 12:10:47.639024 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 62518.3us
W20260709 12:10:47.640045 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 78249.7us
I20260709 12:10:47.642104 22421 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
W20260709 12:10:47.453053 25406 consensus_queue.cc:1175] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6c6fa11e8ee34711b3551f0c670442bc" responder_term: 6 status { last_received { term: 5 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:10:47.560204 25294 consensus_queue.cc:237] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:47.832719 22528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1561) took 1602 ms. Trace:
W20260709 12:10:47.920684 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:47.776063 22605 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.865s	user 0.034s	sys 0.067s
W20260709 12:10:47.943557 22605 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.033s	user 0.049s	sys 0.085s
W20260709 12:10:47.663633 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:47.786194 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:47.820536 25425 log.cc:927] Time spent T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
W20260709 12:10:47.936910 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 294846us
I20260709 12:10:47.937825 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:47.572365 25358 raft_consensus.cc:740] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:47.938804 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:47.949657 22599 raft_consensus.cc:2393] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 8: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:47.949673 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:47.570755 25419 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:47.677525 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 144034us
I20260709 12:10:47.939738 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:47.957319 22495 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:10:47.941042 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:47.623950 25196 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.986s	user 0.007s	sys 0.016s
W20260709 12:10:47.635083 24941 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.007s	sys 0.009s
I20260709 12:10:47.958858 22495 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:47.685083 25392 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:47.784571 25260 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:47.828388 22601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 1943) took 1400 ms. Trace:
I20260709 12:10:47.565534 24889 consensus_queue.cc:1048] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.383s
W20260709 12:10:47.920190 22570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.053s	sys 0.076s
I20260709 12:10:47.827459 22449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1604) took 1122 ms. Trace:
W20260709 12:10:47.945329 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.965555 22495 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
W20260709 12:10:47.811456 25280 consensus_meta.cc:287] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.926s	user 0.011s	sys 0.000s
I20260709 12:10:47.921838 22528 rpcz_store.cc:276] 0709 12:10:46.230272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.130520 (+900248us) service_pool.cc:224] Handling call
0709 12:10:47.130897 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.314127 (+183230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.832517 (+518390us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b540030f2d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:47.832667 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":419729280}
I20260709 12:10:47.947559 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:47.964522 22601 rpcz_store.cc:276] 0709 12:10:46.427964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.428084 (+   120us) service_pool.cc:224] Handling call
0709 12:10:46.428374 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.241345 (+812971us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.828156 (+586811us) spinlock_profiling.cc:243] Waited 809 ms on lock 0x7b5400044054. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:47.828332 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1859864448}
I20260709 12:10:47.966276 22449 rpcz_store.cc:276] 0709 12:10:46.705491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.707864 (+  2373us) service_pool.cc:224] Handling call
0709 12:10:47.827258 (+1119394us) spinlock_profiling.cc:243] Waited 763 ms on lock 0x7b5400264dd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:47.827402 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1754910976}
W20260709 12:10:47.676638 25420 log.cc:927] Time spent T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
I20260709 12:10:47.948710 22605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2311) took 2558 ms. Trace:
W20260709 12:10:47.951783 22524 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.850s	user 0.018s	sys 0.034s
I20260709 12:10:47.687198 25403 raft_consensus.cc:2804] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:47.980413 22605 rpcz_store.cc:276] 0709 12:10:45.390801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.605505 (+214704us) service_pool.cc:224] Handling call
0709 12:10:45.620511 (+ 15006us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:45.620858 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:45.654342 (+ 33484us) log.cc:844] Serialized 14 byte log entry
0709 12:10:46.549940 (+895598us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b1800458920. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cca4d64bc 00007f9cc782448b 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc7840c02 00007f9cca4c820b 00007f9cca4cdd23 00007f9cca4ce23a
0709 12:10:46.909966 (+360026us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:46.910510 (+   544us) log.cc:844] Serialized 26 byte log entry
0709 12:10:47.944088 (+1033578us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:47.944148 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.944240 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:47.944299 (+    59us) raft_consensus.cc:1685] finished
0709 12:10:47.948537 (+  4238us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.948660 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74329,"prepare.queue_time_us":31730,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":191870,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":39397,"spinlock_wait_cycles":2819840,"thread_start_us":1538074,"threads_started":3,"wal-append.queue_time_us":1141562,"wal-append.run_cpu_time_us":2672,"wal-append.run_wall_time_us":1058334}
I20260709 12:10:47.952945 23122 raft_consensus.cc:2410] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:47.742810 25281 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.684264 25184 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:47.803716 24970 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:47.737728 25382 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.902046 25273 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:47.941999 25438 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:47.965350 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 835282us
W20260709 12:10:47.581070 25271 consensus_meta.cc:287] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 1.063s	user 0.011s	sys 0.000s
I20260709 12:10:47.963665 25422 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.965071 25187 raft_consensus.cc:2804] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:47.967528 25431 log.cc:927] Time spent T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 12:10:47.967707 25426 raft_consensus.cc:2749] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:47.967854 25436 consensus_queue.cc:1048] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:10:47.968468 25434 log.cc:927] Time spent T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.184s	user 0.000s	sys 0.004s
W20260709 12:10:47.969347 25423 log.cc:927] Time spent T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 12:10:47.970052 25417 raft_consensus.cc:2804] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:47.581238 25023 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:48.223537 24970 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.224828 24970 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:48.226117 25023 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:47.953624 22421 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:10:48.228243 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 274544us
I20260709 12:10:48.229856 22421 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:48.231564 23118 raft_consensus.cc:1240] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:47.710610 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:48.180244 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:47.964690 22525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.894s	user 0.003s	sys 0.052s
W20260709 12:10:48.235466 22525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.165s	user 0.003s	sys 0.053s
W20260709 12:10:48.237324 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.971961 22495 leader_election.cc:400] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 election: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 6. Current term is 7.
I20260709 12:10:48.239326 22495 leader_election.cc:403] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:10:48.239828 22422 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:10:48.241237 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 269450us
I20260709 12:10:48.184031 22527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 1916) took 2001 ms. Trace:
I20260709 12:10:48.243160 22527 rpcz_store.cc:276] 0709 12:10:46.182702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.895070 (+712368us) service_pool.cc:224] Handling call
0709 12:10:46.914357 (+ 19287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:46.914583 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:46.914606 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:46.915026 (+   420us) log.cc:844] Serialized 26 byte log entry
0709 12:10:47.535846 (+620820us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:47.535902 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.535987 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:48.183191 (+647204us) raft_consensus.cc:1685] finished
0709 12:10:48.183263 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.183754 (+   491us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":591326,"threads_started":1,"wal-append.queue_time_us":871880}
I20260709 12:10:48.184018 22530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1556) took 1954 ms. Trace:
I20260709 12:10:48.185536 22531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1562) took 1954 ms. Trace:
I20260709 12:10:48.245378 22530 rpcz_store.cc:276] 0709 12:10:46.228965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.904489 (+675524us) service_pool.cc:224] Handling call
0709 12:10:46.904787 (+   298us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:46.905134 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:46.905159 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:46.905690 (+   531us) log.cc:844] Serialized 52 byte log entry
0709 12:10:47.273596 (+367906us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:47.311608 (+ 38012us) log.cc:844] Serialized 14 byte log entry
0709 12:10:47.317065 (+  5457us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.317168 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:48.183201 (+866033us) raft_consensus.cc:1685] finished
0709 12:10:48.183268 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.183758 (+   490us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5157,"prepare.queue_time_us":39113,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":422222,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":244,"thread_start_us":367462,"threads_started":1,"wal-append.queue_time_us":577690}
I20260709 12:10:48.245507 22531 rpcz_store.cc:276] 0709 12:10:46.230513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.175576 (+945063us) service_pool.cc:224] Handling call
0709 12:10:47.176033 (+   457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:47.176395 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.176434 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:47.177014 (+   580us) log.cc:844] Serialized 26 byte log entry
0709 12:10:47.571224 (+394210us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:47.638946 (+ 67722us) log.cc:844] Serialized 14 byte log entry
0709 12:10:47.639196 (+   250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.639286 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:47.822261 (+182975us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b18003fa000. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc78413f3 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd 0000000000388634 0000000000388479 00007f9cc782483a
0709 12:10:47.829367 (+  7106us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b18003fa000. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc78413f3 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd 0000000000388634 0000000000388479 00007f9cc782483a
0709 12:10:47.871073 (+ 41706us) spinlock_profiling.cc:243] Waited 7.28 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:10:48.184965 (+313892us) raft_consensus.cc:1685] finished
0709 12:10:48.185020 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.185333 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9968,"prepare.queue_time_us":104014,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":182648,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":6922,"spinlock_wait_cycles":72426240,"thread_start_us":393056,"threads_started":1,"wal-append.queue_time_us":467259}
I20260709 12:10:48.250028 22527 raft_consensus.cc:1240] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:48.251813 23124 raft_consensus.cc:1240] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 7. Current term is 8. Ops: []
W20260709 12:10:48.253263 22631 heartbeater.cc:646] Failed to heartbeat to 127.20.196.190:44877 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.20.196.190:44877 timed out after 15.000s (SENT)
I20260709 12:10:48.018831 22570 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:48.256407 25090 raft_consensus.cc:2749] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:48.256968 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 238103us
I20260709 12:10:48.258174 22570 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:47.993834 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:48.259930 22601 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:48.261359 25090 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.262065 25090 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:48.196533 22602 raft_consensus.cc:1240] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:48.196559 22605 raft_consensus.cc:1275] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:48.197500 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:48.264504 22599 raft_consensus.cc:2393] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 8: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:48.264719 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:10:48.095201 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:48.059957 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.268728 23087 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:48.023645 23119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 606) took 1443 ms. Trace:
W20260709 12:10:47.983184 22524 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.881s	user 0.018s	sys 0.034s
I20260709 12:10:48.238049 24970 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:48.238574 24751 raft_consensus.cc:2804] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:48.271433 25090 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:48.271795 24751 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:48.272089 24970 raft_consensus.cc:2804] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:48.272169 25090 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:48.272439 24751 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.272833 24970 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:48.273368 24970 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.273254 25090 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:48.273797 22524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1558) took 2044 ms. Trace:
I20260709 12:10:48.255426 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:48.275950 23124 raft_consensus.cc:2393] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 8: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:48.271342 23119 rpcz_store.cc:276] 0709 12:10:46.579778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.625434 (+ 45656us) service_pool.cc:224] Handling call
0709 12:10:46.625722 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:47.021607 (+395885us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.021653 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:47.022233 (+   580us) log.cc:844] Serialized 26 byte log entry
0709 12:10:47.499857 (+477624us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:47.499916 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.500007 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:48.023406 (+523399us) raft_consensus.cc:1685] finished
0709 12:10:48.023438 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.023589 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12257,"raft.queue_time_us":57083,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":27122,"thread_start_us":850392,"threads_started":2,"wal-append.queue_time_us":532834}
I20260709 12:10:48.274286 22524 rpcz_store.cc:276] 0709 12:10:46.229515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.066959 (+837444us) service_pool.cc:224] Handling call
0709 12:10:47.100028 (+ 33069us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:47.100496 (+   468us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.100538 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:47.101248 (+   710us) log.cc:844] Serialized 52 byte log entry
0709 12:10:48.272109 (+1170861us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:48.272733 (+   624us) log.cc:844] Serialized 14 byte log entry
0709 12:10:48.273170 (+   437us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.273307 (+   137us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:48.273371 (+    64us) raft_consensus.cc:1685] finished
0709 12:10:48.273385 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.273644 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6352,"raft.queue_time_us":184870,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":11142,"thread_start_us":1170090,"threads_started":1,"wal-append.queue_time_us":920112}
I20260709 12:10:48.270756 23088 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:48.284379 25090 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:48.285046 25090 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:48.285778 25090 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:48.288125 25090 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:48.296353 24941 raft_consensus.cc:2749] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 6. Current term is 7.
I20260709 12:10:48.297099 25090 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:48.297801 25090 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:48.298311 25090 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:48.303409 22601 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 8.
I20260709 12:10:48.304217 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:48.290745 24970 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:48.305027 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:48.307345 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:48.307497 24970 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:48.271332 22570 leader_election.cc:400] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Vote denied by peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353) with higher term. Message: Invalid argument: T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 7. Current term is 8.
I20260709 12:10:48.309008 22570 leader_election.cc:403] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:10:48.309644 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:48.290678 25023 raft_consensus.cc:2804] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:48.312064 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:48.312889 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:48.096216 25184 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.313815 25140 consensus_queue.cc:1059] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:48.314472 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:48.022641 25187 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:48.315418 22527 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 6.
I20260709 12:10:48.315658 25187 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:48.316591 25243 raft_consensus.cc:2749] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353) with higher term. Message: Invalid argument: T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 7. Current term is 8.
I20260709 12:10:48.316665 25175 consensus_queue.cc:1048] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:10:48.004703 25316 consensus_meta.cc:287] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 1.085s	user 0.010s	sys 0.000s
I20260709 12:10:47.990795 25266 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.314144 25184 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:47.685196 25177 consensus_queue.cc:237] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:48.318631 25316 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:48.318954 25266 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:48.317652 25243 consensus_queue.cc:1059] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:48.321214 25316 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:48.321342 25243 raft_consensus.cc:3055] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:48.321791 25243 raft_consensus.cc:740] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:48.321940 25316 raft_consensus.cc:3055] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:48.322340 25316 raft_consensus.cc:740] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:48.323448 22597 raft_consensus.cc:1240] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:48.093914 25202 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.324433 25184 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:48.325474 25184 raft_consensus.cc:2749] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:48.325042 25202 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:48.325079 25243 consensus_queue.cc:260] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:47.684113 25233 consensus_queue.cc:237] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:48.327845 25316 consensus_queue.cc:260] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:48.021695 25273 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:48.004467 25281 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:48.193447 22569 connection.cc:256] RPC call timeout handler was delayed by -1.1504044569999223s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1589s for a response
I20260709 12:10:47.948678 25357 raft_consensus.cc:2804] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:48.141995 25400 consensus_meta.cc:287] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.972s	user 0.010s	sys 0.000s
I20260709 12:10:47.758435 25402 consensus_queue.cc:237] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:48.391393 25392 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.392256 25392 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:48.145159 25408 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:48.397367 25408 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:48.011610 25409 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:48.398780 25409 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:48.399633 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:48.401087 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:48.401254 25409 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:48.135887 25412 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:48.401911 22529 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:48.402263 25243 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:48.388840 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:48.403007 22603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:45546
I20260709 12:10:48.384786 24970 raft_consensus.cc:2749] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:48.403779 22603 raft_consensus.cc:606] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Received request to transfer leadership
W20260709 12:10:48.141372 25414 consensus_meta.cc:287] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.509s	user 0.005s	sys 0.002s
I20260709 12:10:48.405432 25414 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:48.007447 25403 raft_consensus.cc:697] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:48.407984 25414 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:48.407768 25400 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:47.960518 25419 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.408293 25403 consensus_queue.cc:237] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:48.105268 25417 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:48.148821 25438 raft_consensus.cc:2749] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:48.368479 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:48.027828 25422 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:48.411317 22526 raft_consensus.cc:1240] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:48.411695 25417 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.020439 25382 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:48.413672 25422 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:48.371862 22605 raft_consensus.cc:1275] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:48.326745 25226 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:48.294270 24751 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:48.415105 25313 raft_consensus.cc:2749] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:48.417194 24751 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:48.385572 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:10:48.419612 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.370010 25187 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:48.386755 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:48.423848 22531 raft_consensus.cc:2410] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:10:48.380183 25023 raft_consensus.cc:697] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 8 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:48.424813 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:48.391625 22606 raft_consensus.cc:2410] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:48.428751 25202 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:48.429464 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:48.381044 22570 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:48.440274 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:48.430265 25187 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:48.430285 22531 raft_consensus.cc:2468] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 5.
I20260709 12:10:48.443902 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:48.445747 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 175406us
I20260709 12:10:48.458130 22525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1560) took 2228 ms. Trace:
I20260709 12:10:48.458624 22525 rpcz_store.cc:276] 0709 12:10:46.230038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.069725 (+839687us) service_pool.cc:224] Handling call
0709 12:10:47.070189 (+   464us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:48.236189 (+1166000us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:48.236237 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:48.237185 (+   948us) log.cc:844] Serialized 52 byte log entry
0709 12:10:48.378568 (+141383us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:48.378613 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.384291 (+  5678us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:48.457810 (+ 73519us) raft_consensus.cc:1685] finished
0709 12:10:48.457832 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.458030 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":167654,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":34759,"thread_start_us":1306145,"threads_started":2,"wal-append.queue_time_us":206280}
I20260709 12:10:48.462056 25355 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:48.410624 25400 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:48.475522 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.478029 22529 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 5.
I20260709 12:10:48.441699 25392 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:48.480924 22524 raft_consensus.cc:2368] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 6. Current term is 7.
I20260709 12:10:48.483819 25187 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.484478 25187 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:48.487246 22598 raft_consensus.cc:1240] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 12:10:48.488673 25429 log.cc:927] Time spent T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:10:48.490039 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:48.491485 25408 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.492293 25408 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:48.501147 25415 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.501430 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:48.501962 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:48.502170 23121 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 6.
I20260709 12:10:48.501878 25415 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:48.503070 22525 raft_consensus.cc:2368] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 5. Current term is 6.
I20260709 12:10:48.503860 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:48.507915 23116 pending_rounds.cc:85] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270: Aborting all ops after (but not including) 6
I20260709 12:10:48.508262 23116 pending_rounds.cc:107] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:10:48.508549 23116 raft_consensus.cc:2889] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:48.504135 25273 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:48.508679 23122 raft_consensus.cc:2410] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:48.504690 25415 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:48.486649 25187 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:48.505434 23119 raft_consensus.cc:2393] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 6: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:48.510727 25023 consensus_queue.cc:237] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:48.505232 25090 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:48.502383 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 191408us
I20260709 12:10:48.507490 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:48.509616 25230 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:48.506531 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:48.023484 25358 consensus_queue.cc:260] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:48.486742 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:48.501730 25408 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:48.521664 22421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:48.523995 22421 connection.cc:256] RPC call timeout handler was delayed by -1.3968597630000659s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15080000000000002s for a response
W20260709 12:10:48.524370 22421 connection.cc:256] RPC call timeout handler was delayed by -1.3725597630000266s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1535s for a response
I20260709 12:10:48.522539 22530 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 5.
I20260709 12:10:48.481739 25382 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:48.534921 22421 connection.cc:256] RPC call timeout handler was delayed by -1.2132597629999964s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17120000000000002s for a response
I20260709 12:10:48.534363 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:48.533875 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:48.528650 25273 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.542933 25316 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.544974 25281 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317)
I20260709 12:10:48.537392 25232 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:48.531283 25266 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:48.548681 22604 raft_consensus.cc:1240] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:48.549587 25406 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.550236 25406 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:48.556767 23119 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.557235 23124 raft_consensus.cc:1275] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:48.559013 25358 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.564170 23125 raft_consensus.cc:1275] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:10:48.537966 25090 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:48.567009 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:48.568037 22496 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:48.543015 25273 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:48.571736 25415 raft_consensus.cc:2804] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:48.572263 25415 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:48.572688 25415 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.573665 25273 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:48.573454 25422 consensus_queue.cc:1048] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:48.548739 25363 raft_consensus.cc:2804] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:48.576232 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:48.576974 23124 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:48.600835 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:48.601331 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:48.601789 23117 raft_consensus.cc:2410] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:10:48.601895 22528 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.602253 22525 raft_consensus.cc:1240] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:48.603348 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:48.604424 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:48.579591 25363 raft_consensus.cc:697] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:48.606691 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:48.608942 22530 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:48.611011 22421 connection.cc:256] RPC call timeout handler was delayed by -1.0728597629999967s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18680000000000002s for a response
W20260709 12:10:48.611371 22421 connection.cc:256] RPC call timeout handler was delayed by -1.0503597629999604s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18930000000000002s for a response
I20260709 12:10:48.606746 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:48.597795 25230 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:48.620307 24950 raft_consensus.cc:3055] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:48.620728 24950 raft_consensus.cc:740] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:48.621714 24950 consensus_queue.cc:260] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:48.626629 25363 consensus_queue.cc:237] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:48.595057 25090 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:48.631004 23119 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7.
W20260709 12:10:48.632555 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.632718 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:48.677440 23123 raft_consensus.cc:1240] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:48.678691 25189 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:10:48.646592 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.680369 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:48.633317 22528 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
I20260709 12:10:48.632225 23118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 610) took 2051 ms. Trace:
W20260709 12:10:48.636776 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 158457us
I20260709 12:10:48.631908 22531 raft_consensus.cc:2410] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:48.635798 25266 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:48.632257 25382 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:48.645668 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.685729 22496 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:48.684367 23118 rpcz_store.cc:276] 0709 12:10:46.581137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.624157 (+ 43020us) service_pool.cc:224] Handling call
0709 12:10:46.661161 (+ 37004us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.232129 (+1570968us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.631932 (+399803us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b54004e6454. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:48.632145 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3610234624}
I20260709 12:10:48.693997 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:48.694742 22528 raft_consensus.cc:1275] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 12:10:48.700989 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.702461 25422 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:48.703071 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:48.703085 25422 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:48.703989 22606 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 7.
I20260709 12:10:48.705204 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:48.705348 25422 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:48.705860 22606 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 8.
I20260709 12:10:48.705803 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:48.707031 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:48.707050 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:48.707608 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:48.708329 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:48.708798 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:48.709481 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:48.688503 25023 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.707741 22600 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.710641 25230 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:48.631513 25090 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:48.710193 25266 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:48.721053 25406 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:48.722862 22421 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:48.723894 22528 raft_consensus.cc:1240] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:48.740636 23119 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:10:48.741782 22528 raft_consensus.cc:1275] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:48.679333 25189 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:48.729496 25402 raft_consensus.cc:2804] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:48.731244 25232 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.743947 25402 raft_consensus.cc:697] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:48.744004 25232 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:48.744670 25189 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:48.745095 25402 consensus_queue.cc:237] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:48.746384 25232 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:48.688390 25202 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:48.735687 22530 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:10:48.747206 24751 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:48.747226 25202 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:48.748986 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:48.749665 23125 raft_consensus.cc:2468] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 3.
I20260709 12:10:48.736953 22606 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 5.
W20260709 12:10:48.739289 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:48.796813 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:48.768885 22570 connection.cc:256] RPC call timeout handler was delayed by -1.3722922669999207s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1589s for a response
W20260709 12:10:48.799103 22570 connection.cc:256] RPC call timeout handler was delayed by -1.0149922670000251s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1986s for a response
I20260709 12:10:48.756050 23119 raft_consensus.cc:1240] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:48.760818 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:48.755609 22531 raft_consensus.cc:1275] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:10:48.799510 22570 connection.cc:256] RPC call timeout handler was delayed by -1.0104922670000178s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19910000000000003s for a response
I20260709 12:10:48.750384 22601 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 6.
I20260709 12:10:48.773782 22598 raft_consensus.cc:1275] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:48.710404 25273 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.779683 22604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:45546
I20260709 12:10:48.805401 22604 raft_consensus.cc:606] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Received request to transfer leadership
I20260709 12:10:48.757155 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:48.771605 22526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1557) took 2542 ms. Trace:
W20260709 12:10:48.810410 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 63636.8us
I20260709 12:10:48.810786 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:48.811596 22530 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.805987 22526 rpcz_store.cc:276] 0709 12:10:46.229251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.907060 (+677809us) service_pool.cc:224] Handling call
0709 12:10:46.907374 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.411929 (+1504555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.771289 (+359360us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b54001f3e54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:48.771526 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3457752960}
I20260709 12:10:48.770921 25232 consensus_queue.cc:1059] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:10:48.818300 25232 consensus_queue.cc:1243] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer 1676e7af5e4a47cb86ee7db83e3d4881 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:10:48.819043 22421 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:48.822187 25406 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.693967 25417 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:48.826712 22600 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 6.
W20260709 12:10:48.827062 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.761360 25090 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:48.822758 25406 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:48.829840 23088 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:48.831051 23124 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:10:48.778837 25357 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:48.766675 25202 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:48.832404 25457 consensus_queue.cc:1059] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:10:48.763943 25419 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:48.762617 25023 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:48.841686 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:48.759989 22597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 1956) took 1233 ms. Trace:
I20260709 12:10:48.842347 22531 raft_consensus.cc:2468] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:48.755831 25382 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:48.843988 22529 raft_consensus.cc:1240] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:48.850363 22530 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
I20260709 12:10:48.837659 25412 consensus_queue.cc:1048] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:10:48.825652 25273 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:48.842887 25357 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:48.867934 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 44156.1us
I20260709 12:10:48.864223 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:48.844653 25232 raft_consensus.cc:2764] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:10:48.871367 22526 raft_consensus.cc:2393] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 8: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:48.835251 25458 consensus_queue.cc:1048] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:10:48.874269 22523 raft_consensus.cc:1240] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 5. Current term is 7. Ops: []
I20260709 12:10:48.882480 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:48.871706 25202 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:10:48.890669 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 71826us
I20260709 12:10:48.891165 25202 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:48.891721 22421 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:48.893142 22421 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:10:48.893431 25202 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:48.894086 25202 raft_consensus.cc:2749] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:48.894778 25202 raft_consensus.cc:2804] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:48.900161 25202 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:48.843983 22597 rpcz_store.cc:276] 0709 12:10:47.526635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.527727 (+  1092us) service_pool.cc:224] Handling call
0709 12:10:47.620333 (+ 92606us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.324053 (+703720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.759643 (+435590us) spinlock_profiling.cc:243] Waited 690 ms on lock 0x7b5400041854. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:48.759899 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1586920704}
I20260709 12:10:48.851976 25415 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:48.894815 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 55996.7us
I20260709 12:10:48.900245 25023 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:48.899488 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.903208 25202 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:48.909392 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:48.915064 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.909046 22355 catalog_manager.cc:5697] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 4 to 6, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 6 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:10:48.919452 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:48.920219 22597 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.910825 25249 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.923406 25438 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:48.923614 25249 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:48.924187 25226 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:48.924069 25438 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:48.924747 25226 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:48.925271 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.923297 22570 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:48.926020 25249 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:48.927467 25437 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.927570 22570 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:10:48.928103 25437 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:48.929018 22570 leader_election.cc:400] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 election: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 6. Current term is 7.
I20260709 12:10:48.929371 22570 leader_election.cc:403] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:10:48.930337 25226 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:48.897199 25273 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:48.926203 25438 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:48.931437 25266 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:48.933189 25402 consensus_queue.cc:1048] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:48.934118 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:48.935678 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:48.936543 22450 raft_consensus.cc:2410] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:48.936628 23088 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:48.937808 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:48.938077 23088 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:48.938473 22452 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 6.
I20260709 12:10:48.938969 22604 raft_consensus.cc:1275] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:48.939464 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:48.897751 25382 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:48.940112 25419 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:48.941867 22448 raft_consensus.cc:2410] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:10:48.943295 22605 raft_consensus.cc:2410] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:48.940773 25280 raft_consensus.cc:2749] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:48.944592 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:48.875424 24751 consensus_queue.cc:1048] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 12:10:48.895988 25406 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:48.930356 25437 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:48.953768 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:48.957734 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:48.958215 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:48.968704 22600 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 7.
I20260709 12:10:48.958701 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:48.969753 22598 raft_consensus.cc:2393] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 8: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:48.958966 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:48.960594 25415 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:48.961776 25475 log.cc:927] Time spent T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.093s	user 0.000s	sys 0.002s
I20260709 12:10:48.944212 25273 raft_consensus.cc:2749] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:48.963325 22454 raft_consensus.cc:1275] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:48.966163 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:48.945745 25458 raft_consensus.cc:2749] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:48.973199 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 44331.2us
I20260709 12:10:48.956693 25316 raft_consensus.cc:2804] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:48.977334 23088 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:48.978215 22449 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 5.
I20260709 12:10:48.956974 25363 raft_consensus.cc:2749] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 6. Current term is 7.
I20260709 12:10:48.969136 25409 raft_consensus.cc:2804] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:48.985128 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:48.987033 25316 raft_consensus.cc:697] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:48.988587 25417 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:48.988188 25316 consensus_queue.cc:237] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:48.989485 22527 raft_consensus.cc:1240] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:48.991207 22451 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7.
W20260709 12:10:48.994177 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 89860.8us
I20260709 12:10:48.994860 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:48.997480 23087 leader_election.cc:336] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.551s (SENT)
I20260709 12:10:48.998005 22452 raft_consensus.cc:1240] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:48.997938 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:49.000960 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:48.992756 25023 raft_consensus.cc:2749] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:49.002270 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:49.002415 22341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 93928.8us
I20260709 12:10:49.003934 22604 raft_consensus.cc:2393] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 7: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:49.006016 22421 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:49.007359 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:49.008167 22600 raft_consensus.cc:2393] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 7: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:49.007977 22421 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:49.010957 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:49.011288 23118 raft_consensus.cc:1240] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:49.011765 22604 raft_consensus.cc:2468] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:10:49.012316 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:49.013159 22599 raft_consensus.cc:2410] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:49.014021 25280 consensus_queue.cc:1059] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:49.014473 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:49.015079 22602 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 8.
I20260709 12:10:49.016140 22452 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:48.999243 25409 raft_consensus.cc:697] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
W20260709 12:10:49.019248 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 49233.2us
I20260709 12:10:49.021179 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:49.020117 25409 consensus_queue.cc:237] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:49.023353 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:49.024098 22456 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.024014 22570 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:49.025496 22570 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:49.027565 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:49.028271 22455 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 6.
I20260709 12:10:49.028425 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:49.029719 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:49.030414 25281 raft_consensus.cc:3055] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:49.030705 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:49.018159 25437 raft_consensus.cc:2804] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:49.030849 25281 raft_consensus.cc:740] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:49.031185 25358 raft_consensus.cc:2749] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:49.021018 23089 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:49.037839 22597 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7.
I20260709 12:10:49.038596 22452 raft_consensus.cc:2410] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:49.040223 22422 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:49.040170 25281 consensus_queue.cc:260] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:49.041016 25138 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.042433 22422 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:49.040154 25213 consensus_queue.cc:1059] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:49.054411 25355 raft_consensus.cc:3055] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:49.054819 25355 raft_consensus.cc:740] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:49.054878 25438 raft_consensus.cc:3055] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:49.055691 25438 raft_consensus.cc:740] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:49.055886 25355 consensus_queue.cc:260] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:49.056768 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:49.057026 25355 raft_consensus.cc:3060] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:49.056911 25438 consensus_queue.cc:260] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:49.058058 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:49.046578 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.046864 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:49.062399 22606 raft_consensus.cc:2393] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 8: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:49.062592 24950 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.036396 25437 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:49.063591 25437 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:49.047685 25090 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:49.064057 25090 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.064416 25090 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:49.048216 22421 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:49.049077 25280 raft_consensus.cc:2804] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:49.068645 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 52436.6us
I20260709 12:10:49.073047 25428 consensus_queue.cc:1059] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:49.075053 22523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 1921) took 1573 ms. Trace:
I20260709 12:10:49.075313 25417 raft_consensus.cc:3055] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:49.075572 22601 raft_consensus.cc:1275] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:49.075838 25417 raft_consensus.cc:740] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:49.076498 22601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:45546
I20260709 12:10:49.076717 25023 raft_consensus.cc:2804] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:49.077126 25023 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:49.076733 25417 consensus_queue.cc:260] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:49.077579 25023 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:49.078020 25406 raft_consensus.cc:3055] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:49.078235 25417 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.052618 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:49.053504 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:49.077039 22601 raft_consensus.cc:606] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Received request to transfer leadership
I20260709 12:10:49.058197 25438 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:49.081329 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:49.083814 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:49.084798 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:49.085395 23119 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:49.083271 22457 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 5.
I20260709 12:10:49.081444 25213 raft_consensus.cc:2749] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:49.078487 25406 raft_consensus.cc:740] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:49.075435 22523 rpcz_store.cc:276] 0709 12:10:47.502604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.554578 (+ 51974us) service_pool.cc:224] Handling call
0709 12:10:47.554888 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.904020 (+1349132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.074836 (+170816us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b540030ded4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:49.074997 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3014839552}
I20260709 12:10:49.088392 22421 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:49.089334 22421 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:10:49.089999 22353 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55980 (request call id 372) took 16041 ms (client timeout 15000 ms). Trace:
I20260709 12:10:49.080533 23116 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:10:49.086230 22355 catalog_manager.cc:5697] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 4 to 5, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 5 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:49.090595 25226 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:49.091161 25266 raft_consensus.cc:2749] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:49.087769 25406 consensus_queue.cc:260] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:49.093165 25406 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.092814 22355 catalog_manager.cc:5697] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 2 to 3, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 3 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:49.079958 25280 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.094696 22355 catalog_manager.cc:5697] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: config changed from index 3 to 4, term changed from 3 to 4, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130), VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New cstate: current_term: 4 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:49.096457 22598 raft_consensus.cc:1240] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:49.095431 25280 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:49.090528 22421 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:49.046840 22456 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 6.
I20260709 12:10:49.038647 25363 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.107955 22532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1563) took 1473 ms. Trace:
I20260709 12:10:49.108359 23089 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:49.114779 22422 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:49.118712 23088 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:49.110760 25428 consensus_queue.cc:1048] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:10:49.128305 25226 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:49.129101 25226 raft_consensus.cc:697] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:49.132493 22600 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 6.
I20260709 12:10:49.131748 22355 catalog_manager.cc:5697] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:49.133688 22456 raft_consensus.cc:1240] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:49.090380 22353 rpcz_store.cc:269] 0709 12:10:33.048788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.048989 (+   201us) service_pool.cc:224] Handling call
0709 12:10:49.089737 (+16040748us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:42.206709 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:42.235178 (+ 28469us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:42.235225 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:10:42.235242 (+    17us) tablet.cc:662] Decoding operations
0709 12:10:42.236210 (+   968us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:42.236281 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:42.236321 (+    40us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:10:42.237082 (+   761us) tablet.cc:701] Row locks acquired
0709 12:10:42.237130 (+    48us) write_op.cc:260] PREPARE: finished
0709 12:10:42.237311 (+   181us) write_op.cc:270] Start()
0709 12:10:42.237453 (+   142us) write_op.cc:276] Timestamp: P: 1783599042237240 usec, L: 0
0709 12:10:42.237472 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:10:42.286866 (+ 49394us) log.cc:844] Serialized 3577 byte log entry
0709 12:10:42.783766 (+496900us) op_driver.cc:464] REPLICATION: finished
0709 12:10:42.787043 (+  3277us) write_op.cc:301] APPLY: starting
0709 12:10:42.787145 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:42.787385 (+   240us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:42.787530 (+   145us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:42.791428 (+  3898us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:42.791743 (+   315us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:10:42.791793 (+    50us) write_op.cc:312] APPLY: finished
0709 12:10:42.792150 (+   357us) log.cc:844] Serialized 65 byte log entry
0709 12:10:42.792306 (+   156us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:42.792423 (+   117us) write_op.cc:454] Released schema lock
0709 12:10:42.792477 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:42.851294 (+ 58817us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:42.858617 (+  7323us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":53576,"reported_tablets":37,"child_traces":[["op",{"apply.queue_time_us":2957,"apply.run_cpu_time_us":3460,"apply.run_wall_time_us":32146,"num_ops":8,"prepare.queue_time_us":373394,"prepare.run_cpu_time_us":30483,"prepare.run_wall_time_us":270632,"raft.queue_time_us":236983,"raft.run_cpu_time_us":2320,"raft.run_wall_time_us":24767,"replication_time_us":545746,"thread_start_us":490201,"threads_started":4,"wal-append.queue_time_us":235312,"wal-append.run_cpu_time_us":37929,"wal-append.run_wall_time_us":1342914}]]}
I20260709 12:10:49.103828 25382 raft_consensus.cc:2749] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:49.110589 25281 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.039206 25202 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:49.152451 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 62006.5us
W20260709 12:10:49.148738 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 48644.7us
W20260709 12:10:49.157966 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 45822.1us
I20260709 12:10:49.159271 22355 catalog_manager.cc:5697] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 2 to 3, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 3 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:49.162403 22421 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:49.135397 24751 raft_consensus.cc:2749] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:49.112135 22532 rpcz_store.cc:276] 0709 12:10:47.502957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.581402 (+ 78445us) service_pool.cc:224] Handling call
0709 12:10:47.651916 (+ 70514us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:47.702818 (+ 50902us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.702863 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:47.740155 (+ 37292us) log.cc:844] Serialized 26 byte log entry
0709 12:10:48.577304 (+837149us) spinlock_profiling.cc:243] Waited 3.76 ms on lock 0x7b18002a14e0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc7823e07 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc7840c02 00007f9cca4c820b 00007f9cca4cdd23 00007f9cca4ce0d1 00007f9cca8e9a0f
0709 12:10:48.872848 (+295544us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:48.883322 (+ 10474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.912375 (+ 29053us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:48.970312 (+ 57937us) raft_consensus.cc:1685] finished
0709 12:10:48.970329 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.976519 (+  6190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50425,"raft.queue_time_us":85853,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":32935,"spinlock_wait_cycles":8652160,"thread_start_us":262378,"threads_started":1,"wal-append.queue_time_us":1210001}
I20260709 12:10:49.130271 25226 consensus_queue.cc:237] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:49.175663 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:49.165606 25458 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:49.179601 22457 raft_consensus.cc:2410] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:49.172583 22355 catalog_manager.cc:5697] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:49.183137 23119 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
W20260709 12:10:49.192054 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 80419.3us
I20260709 12:10:49.161219 25363 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:49.173858 25232 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:49.207427 22497 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
W20260709 12:10:49.208454 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 76427.5us
I20260709 12:10:49.209161 22497 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:10:49.211031 25231 raft_consensus.cc:2749] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:49.213081 22497 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:49.184911 25458 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.184572 25273 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.230544 22456 raft_consensus.cc:1275] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:49.243826 25202 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:49.246296 25090 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:49.199909 25422 consensus_queue.cc:1059] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 12:10:49.247159 25177 raft_consensus.cc:2749] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:49.248656 24889 raft_consensus.cc:993] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc: : Instructing follower 1676e7af5e4a47cb86ee7db83e3d4881 to start an election
I20260709 12:10:49.228629 25231 raft_consensus.cc:2804] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:49.212214 25232 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:49.230296 25138 raft_consensus.cc:2749] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:49.250780 25273 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:49.261686 22603 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 6.
I20260709 12:10:49.250455 25428 consensus_queue.cc:1059] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:10:49.250142 25415 consensus_queue.cc:1048] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:10:49.265116 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:49.304553 22457 raft_consensus.cc:2410] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 12:10:49.270102 22341 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 263d51d0b43744d899e37466045af890 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:10:49.270816 23123 raft_consensus.cc:2410] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:49.271725 25090 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:49.275231 25422 consensus_queue.cc:1243] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer 1676e7af5e4a47cb86ee7db83e3d4881 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:10:49.288388 25363 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:49.268829 25232 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:49.264135 22355 catalog_manager.cc:5697] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 2 to 3, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 3 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:49.235498 25458 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:49.296309 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:49.310518 22456 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:49.296715 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:49.297670 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:49.297820 22451 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:49.300256 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:49.195773 25357 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:49.305956 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 141420us
I20260709 12:10:49.307662 22605 raft_consensus.cc:1275] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:49.308387 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:49.304888 23089 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:49.316156 22448 raft_consensus.cc:1275] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
W20260709 12:10:49.312250 25452 log.cc:927] Time spent T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:10:49.302556 25231 raft_consensus.cc:697] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:49.316524 22448 pending_rounds.cc:85] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f: Aborting all ops after (but not including) 6
I20260709 12:10:49.329187 22448 pending_rounds.cc:107] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:10:49.329468 22448 raft_consensus.cc:2889] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:49.306671 25358 raft_consensus.cc:1081] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Signalling peer 1676e7af5e4a47cb86ee7db83e3d4881 to start an election
I20260709 12:10:49.334919 22452 raft_consensus.cc:2393] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 7: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:49.336614 23088 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:49.337998 22599 raft_consensus.cc:1240] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:49.317176 25438 raft_consensus.cc:2749] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:49.360613 24889 raft_consensus.cc:3055] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:49.361156 24889 raft_consensus.cc:740] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
W20260709 12:10:49.363436 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 49361.5us
I20260709 12:10:49.335067 25400 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:49.364761 25400 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:49.365083 25231 consensus_queue.cc:237] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:49.368335 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 44746.7us
I20260709 12:10:49.342391 22355 catalog_manager.cc:5697] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 1 to 4, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 4 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
W20260709 12:10:49.349747 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.338745 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:49.371062 22455 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:49.374084 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.375130 22456 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 5.
I20260709 12:10:49.378429 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:49.379166 22450 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.382561 25412 raft_consensus.cc:2749] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:49.382547 25457 consensus_queue.cc:1048] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:49.383664 25419 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.383545 25230 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.384258 25419 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:49.384415 25230 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:49.385048 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.386711 25189 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.387382 25189 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:49.389734 25357 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:49.390195 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.392620 22355 catalog_manager.cc:5697] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:49.400349 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 63820.5us
I20260709 12:10:49.369588 23089 leader_election.cc:304] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:49.358021 25281 raft_consensus.cc:2804] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:49.316431 25437 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:49.362210 24889 consensus_queue.cc:260] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:49.409794 25358 consensus_queue.cc:1048] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:49.411211 25313 raft_consensus.cc:3055] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:49.319056 25023 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:49.412139 23088 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:10:49.416966 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 47177.3us
I20260709 12:10:49.422199 22570 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:49.334570 25177 consensus_queue.cc:1048] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 12:10:49.423774 22456 raft_consensus.cc:1275] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 12:10:49.437479 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 275101us
I20260709 12:10:49.445117 23089 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:49.445365 22450 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 6.
I20260709 12:10:49.415449 25313 raft_consensus.cc:740] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:49.419540 25281 raft_consensus.cc:697] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 5 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:49.452131 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:49.424702 25457 raft_consensus.cc:2804] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:49.453198 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.468745 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:49.469153 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.469406 22448 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
W20260709 12:10:49.451398 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 49546us
I20260709 12:10:49.470950 23089 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:49.474121 25437 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:49.474747 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.475862 25313 consensus_queue.cc:260] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:49.477176 25313 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.479398 22606 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:10:49.481086 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:49.481959 25280 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:49.421471 25357 consensus_queue.cc:1048] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:10:49.516204 25357 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:49.516863 25357 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:49.483368 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:49.517765 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:49.518250 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:49.518953 22600 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
I20260709 12:10:49.484740 25281 consensus_queue.cc:237] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:49.520102 25357 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:49.483739 25400 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:49.521377 25273 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:49.443663 25412 raft_consensus.cc:2804] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:49.488366 25489 raft_consensus.cc:2804] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:49.494874 25355 raft_consensus.cc:2804] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:49.495317 24889 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.471647 25230 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:49.496088 22456 raft_consensus.cc:1240] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 5. Current term is 6. Ops: [4.6-5.7]
I20260709 12:10:49.496989 24970 consensus_queue.cc:1059] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:49.497190 22570 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:49.499183 25226 consensus_queue.cc:1048] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:49.500315 25419 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:49.500902 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.504822 25189 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:49.504958 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:49.505705 22457 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
 from {username='slave'} at 127.0.0.1:51836
I20260709 12:10:49.547205 22457 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:49.547557 22457 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:49.506668 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:49.508435 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:49.513620 25505 raft_consensus.cc:2804] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:49.518319 22448 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:10:49.519126 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:49.493134 25232 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:49.523458 23088 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:10:49.526089 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 53559.7us
I20260709 12:10:49.535933 22455 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7.
I20260709 12:10:49.540781 22451 raft_consensus.cc:1275] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:49.488346 25023 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:49.555503 22606 raft_consensus.cc:606] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Received request to transfer leadership to TS 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:49.543509 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:49.548869 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 51795.4us
I20260709 12:10:49.549225 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:49.546845 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:49.524338 25412 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.550158 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:49.531174 25355 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.542688 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:49.595125 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 71759.6us
I20260709 12:10:49.597371 22454 raft_consensus.cc:2393] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 4: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:49.554199 22453 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
W20260709 12:10:49.736311 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 283730us
I20260709 12:10:49.629938 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:49.595897 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:49.835513 22523 raft_consensus.cc:1813] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Handling vote request from an unknown peer c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:49.596833 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:49.597622 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:49.659837 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:49.842041 23119 raft_consensus.cc:1813] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Handling vote request from an unknown peer c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:49.678726 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:49.842772 23119 raft_consensus.cc:2410] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 7 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:10:49.628192 23088 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:49.840585 22451 raft_consensus.cc:2393] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 4: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:49.812543 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:49.596288 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:49.837899 23089 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:49.841434 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:49.838940 22523 raft_consensus.cc:2393] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 7: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:49.875392 22448 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 7.
I20260709 12:10:49.875696 22450 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 8.
I20260709 12:10:49.645627 24950 raft_consensus.cc:2804] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:49.553547 22497 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
W20260709 12:10:49.845575 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.881194 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:49.537700 25489 raft_consensus.cc:697] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 8 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:49.550695 25505 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.850265 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:49.865653 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:49.863466 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:49.835669 22570 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:49.868829 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:49.871721 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:49.843139 22531 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 6.
I20260709 12:10:49.870007 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:49.596323 25273 raft_consensus.cc:2749] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:49.760728 25415 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:49.881880 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:49.839466 25412 raft_consensus.cc:3060] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:49.882542 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 329056us
I20260709 12:10:49.839286 25355 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:49.803107 25457 raft_consensus.cc:697] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 6 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:49.890666 22530 raft_consensus.cc:2393] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 5: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:49.550941 25230 consensus_queue.cc:1059] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.329s
I20260709 12:10:49.885950 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:49.891223 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 55667.6us
I20260709 12:10:49.905898 22452 raft_consensus.cc:2393] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 7: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:49.906252 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:49.891145 22528 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 6.
W20260709 12:10:49.891811 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 263687us
I20260709 12:10:49.894161 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:49.894196 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:49.894827 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:49.907629 23088 leader_election.cc:400] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 5. Current term is 6.
I20260709 12:10:49.894889 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:49.890592 23122 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 6.
I20260709 12:10:49.908196 23088 leader_election.cc:403] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:49.896396 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:49.909659 23124 raft_consensus.cc:2468] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 3.
I20260709 12:10:49.896631 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:49.916836 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:49.771284 25458 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:49.880262 24950 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:49.897974 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:49.892323 25419 raft_consensus.cc:2804] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:49.892292 25505 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:49.895700 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 57895.6us
I20260709 12:10:49.917740 23119 raft_consensus.cc:2393] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 6: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:49.936570 22599 raft_consensus.cc:3055] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:49.937052 22599 raft_consensus.cc:740] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:49.918246 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:49.908046 22453 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 8.
I20260709 12:10:49.897766 23118 raft_consensus.cc:2393] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 6: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:49.923170 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:49.923403 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:49.908540 25273 raft_consensus.cc:2804] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:49.942871 22528 raft_consensus.cc:2393] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 5: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
W20260709 12:10:49.851701 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.927402 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:49.943954 23125 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 8.
I20260709 12:10:49.895455 24970 raft_consensus.cc:2804] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:49.930531 22455 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:49.945973 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:49.903395 22532 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 6.
I20260709 12:10:49.931326 22531 raft_consensus.cc:2393] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 5: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:49.888063 25226 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.905180 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:49.939785 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:49.940186 22530 raft_consensus.cc:1275] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:49.924340 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:49.951931 22452 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 5.
I20260709 12:10:49.952884 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:49.953490 22452 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
I20260709 12:10:49.954316 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:49.955575 23122 raft_consensus.cc:1275] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:49.955282 25226 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:49.956286 25457 consensus_queue.cc:237] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:49.957576 23119 raft_consensus.cc:1275] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:49.949230 23120 raft_consensus.cc:2468] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5.
I20260709 12:10:49.956681 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:49.959367 22452 raft_consensus.cc:2393] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 8: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:49.960309 23123 raft_consensus.cc:2368] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 8. Current term is 9.
I20260709 12:10:49.932132 24950 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.898765 25415 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:49.928006 25023 raft_consensus.cc:2804] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:49.949694 25495 log.cc:927] Time spent T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.426s	user 0.000s	sys 0.001s
I20260709 12:10:49.945902 25273 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.939366 25232 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:49.961628 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:49.965487 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:49.965699 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:49.971526 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:49.975881 22452 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 6.
I20260709 12:10:49.976630 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:49.966441 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:49.932369 25419 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.932433 25281 raft_consensus.cc:2749] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 5. Current term is 6.
I20260709 12:10:49.968432 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:49.979419 22421 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:49.943109 25280 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:49.983595 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:49.973821 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:49.985059 23120 raft_consensus.cc:1275] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:10:49.985606 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:49.985888 22452 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 6.
I20260709 12:10:49.986382 22606 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:49.966339 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:49.958109 25226 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:49.974812 22448 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
I20260709 12:10:49.968847 22451 raft_consensus.cc:2410] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:10:49.989162 22528 raft_consensus.cc:2368] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 4. Current term is 5.
I20260709 12:10:49.985304 22453 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 6.
I20260709 12:10:49.990645 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:49.990697 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:49.995613 23122 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 6.
I20260709 12:10:49.995893 22603 raft_consensus.cc:2410] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:49.964251 24970 raft_consensus.cc:697] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
W20260709 12:10:50.008240 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.012162 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:50.016064 22604 raft_consensus.cc:1275] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:10:50.018703 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:50.026857 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:50.027714 22449 raft_consensus.cc:2410] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:50.027549 25404 consensus_queue.cc:1048] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:50.029325 25404 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.029913 25404 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:50.033279 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:50.036149 22452 raft_consensus.cc:2410] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:49.978402 25273 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.038357 23125 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.043206 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:49.982137 25419 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:50.047155 22455 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 5.
I20260709 12:10:50.047924 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:50.048470 22455 raft_consensus.cc:1240] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:10:50.049772 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:50.054701 22452 raft_consensus.cc:1240] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:50.056789 22570 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:50.065392 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:50.068847 22527 raft_consensus.cc:1275] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:50.066313 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:50.070958 23116 raft_consensus.cc:2410] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:49.996752 25023 raft_consensus.cc:697] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 5 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:50.072280 22531 raft_consensus.cc:1275] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:10:50.082928 22531 pending_rounds.cc:85] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting all ops after (but not including) 3
I20260709 12:10:50.083266 22531 pending_rounds.cc:107] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:10:50.083570 22531 raft_consensus.cc:2889] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:50.083602 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:50.074476 22532 raft_consensus.cc:1240] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:50.078397 22602 raft_consensus.cc:1275] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:10:50.084954 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 107101us
W20260709 12:10:50.087616 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 44942.2us
W20260709 12:10:50.091087 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.088313 22570 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:50.055929 25438 raft_consensus.cc:2749] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:50.075457 24889 consensus_meta.cc:287] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.538s	user 0.010s	sys 0.001s
I20260709 12:10:50.048277 25428 consensus_queue.cc:1048] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.043s
W20260709 12:10:50.102677 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 123373us
I20260709 12:10:50.101478 22448 raft_consensus.cc:1240] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:50.103461 22421 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
W20260709 12:10:50.102118 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 277995us
W20260709 12:10:50.105852 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.108757 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:50.109534 23124 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5.
I20260709 12:10:50.118888 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:50.118191 22606 raft_consensus.cc:2468] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 4.
W20260709 12:10:50.121107 25501 log.cc:927] Time spent T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.188s	user 0.000s	sys 0.000s
I20260709 12:10:50.121438 23121 raft_consensus.cc:1275] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:10:50.122248 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:50.123474 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:50.123775 23124 raft_consensus.cc:1275] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:50.125331 22456 raft_consensus.cc:1240] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:50.123963 23116 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:50.126785 22457 consensus_meta.cc:287] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.575s	user 0.007s	sys 0.001s
I20260709 12:10:49.992096 25489 consensus_queue.cc:237] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:50.050467 25230 consensus_queue.cc:1048] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:10:50.129354 23119 raft_consensus.cc:1240] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:50.127964 22457 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:50.130471 25512 log.cc:927] Time spent T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
W20260709 12:10:50.131646 25502 log.cc:927] Time spent T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:10:50.135747 23116 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
I20260709 12:10:50.135373 24970 consensus_queue.cc:237] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:50.142812 22450 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 7: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
W20260709 12:10:50.156139 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 52751us
I20260709 12:10:50.159026 23088 leader_election.cc:400] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 election: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 6. Current term is 7.
I20260709 12:10:50.160028 22421 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:50.157761 22448 raft_consensus.cc:1240] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:50.110378 25404 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:50.108685 25428 consensus_queue.cc:1243] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer 8701cd5186a949538d8efafb5f987270 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:10:50.161746 22421 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:50.165567 22531 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:56942
I20260709 12:10:50.168205 22457 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:50.100123 25358 consensus_queue.cc:1059] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 12:10:50.139858 24889 raft_consensus.cc:2804] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:50.170915 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 409629us
I20260709 12:10:50.137142 25280 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:50.280954 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 112336us
W20260709 12:10:50.284852 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 123167us
I20260709 12:10:50.286028 22421 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:50.287793 22421 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:50.289168 23124 raft_consensus.cc:1275] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:50.291296 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:50.292187 22606 raft_consensus.cc:2393] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 7: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:50.294797 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:50.296054 22606 raft_consensus.cc:1240] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 12:10:50.301398 22448 raft_consensus.cc:1240] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:50.163319 25415 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:50.304464 22456 raft_consensus.cc:1275] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:10:50.169569 25438 raft_consensus.cc:2749] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:50.166811 25458 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:50.311221 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:10:50.311251 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 171530us
I20260709 12:10:50.312764 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:50.281970 24889 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.328351 22456 raft_consensus.cc:1240] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:50.167145 25226 consensus_queue.cc:1048] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.145s
I20260709 12:10:50.332366 22570 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:50.335971 22448 raft_consensus.cc:1275] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:50.304129 25266 raft_consensus.cc:2749] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:50.302771 25499 raft_consensus.cc:2804] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:50.343410 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 48772.1us
I20260709 12:10:50.351187 25507 consensus_queue.cc:1059] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:50.351954 25507 consensus_queue.cc:1243] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer 1676e7af5e4a47cb86ee7db83e3d4881 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:10:50.352428 25507 raft_consensus.cc:3055] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:50.352726 25507 raft_consensus.cc:740] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:50.353552 25507 consensus_queue.cc:260] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:50.355463 22599 consensus_queue.cc:260] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:50.356848 22599 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.343119 25438 raft_consensus.cc:2749] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:50.359691 25438 consensus_queue.cc:1048] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:10:50.364746 25368 raft_consensus.cc:2764] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:10:50.368907 25358 raft_consensus.cc:2804] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:50.369390 25358 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.369791 25358 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.380242 25404 consensus_queue.cc:1048] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:50.381750 25437 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.382316 25437 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:50.384708 25437 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:50.332934 25023 consensus_queue.cc:237] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:50.334429 24889 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:50.420922 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:50.431962 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 376780us
I20260709 12:10:50.354804 25507 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.435583 23125 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7.
W20260709 12:10:50.442065 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:50.449652 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.366837 25368 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.453944 25368 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:50.457072 25368 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:50.462378 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.348614 25499 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:50.463086 23087 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.542s (SENT) [suppressed 48 similar messages]
I20260709 12:10:50.474915 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:50.474673 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 142299us
I20260709 12:10:50.348381 25281 consensus_queue.cc:1059] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.119s
I20260709 12:10:50.482501 22449 raft_consensus.cc:1275] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:50.477881 22448 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:50.483244 22456 raft_consensus.cc:1275] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:50.447705 25230 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:50.522369 22570 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:50.473343 25499 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:50.600502 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 78265.5us
W20260709 12:10:50.606760 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:50.623219 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 311929us
W20260709 12:10:50.651402 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 363663us
I20260709 12:10:50.656287 22421 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:50.657812 22421 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:50.659188 22421 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:50.660876 22422 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:50.590165 25458 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:50.575165 25230 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:50.610605 25357 raft_consensus.cc:2749] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:50.715262 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 70377.4us
I20260709 12:10:50.716291 22495 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:50.719318 22403 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:10:50.719754 22403 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 67b097456aac41edb06c5a4efd504ca1 already in progress
W20260709 12:10:50.720088 22403 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 67b097456aac41edb06c5a4efd504ca1 already in progress
I20260709 12:10:50.720625 25202 raft_consensus.cc:2804] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:50.721169 25202 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.721611 25202 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:50.723310 22453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1622) took 1222 ms. Trace:
I20260709 12:10:50.723694 22453 rpcz_store.cc:276] 0709 12:10:49.500749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.071732 (+570983us) service_pool.cc:224] Handling call
0709 12:10:50.098180 (+ 26448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:50.101727 (+  3547us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:50.101757 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:50.158659 (+ 56902us) log.cc:844] Serialized 26 byte log entry
0709 12:10:50.470849 (+312190us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:50.471055 (+   206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.471336 (+   281us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:50.723089 (+251753us) raft_consensus.cc:1685] finished
0709 12:10:50.723106 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:50.723248 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6868,"raft.queue_time_us":4293,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":12457,"thread_start_us":137349,"threads_started":1,"wal-append.queue_time_us":424310}
I20260709 12:10:50.725883 25536 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:50.732290 25189 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.732788 25189 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:50.736547 22452 raft_consensus.cc:1240] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:50.754817 22599 raft_consensus.cc:1275] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:10:50.761900 23125 pending_rounds.cc:85] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270: Aborting all ops after (but not including) 5
I20260709 12:10:50.762349 23125 pending_rounds.cc:107] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:10:50.762650 23125 raft_consensus.cc:2889] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:50.716182 25266 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:50.769246 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 419141us
I20260709 12:10:50.648450 25520 consensus_queue.cc:1048] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.123s
I20260709 12:10:50.767208 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:50.734645 25189 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:50.770776 22569 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:50.768590 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 109493us
I20260709 12:10:50.787482 22421 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
W20260709 12:10:50.787848 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 71686.1us
I20260709 12:10:50.710369 25458 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:50.765301 25487 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:10:50.794229 22421 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:50.701567 25518 consensus_queue.cc:1048] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.089s
I20260709 12:10:50.800352 22569 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:50.803424 22495 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:50.805018 22531 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:50.805527 22531 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.771008 25531 raft_consensus.cc:2804] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:50.763774 25357 consensus_queue.cc:1048] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:10:50.817509 23123 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 5.
I20260709 12:10:50.768558 25491 consensus_queue.cc:1059] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
W20260709 12:10:50.801503 25273 consensus_meta.cc:287] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.730s	user 0.007s	sys 0.004s
I20260709 12:10:50.801384 25189 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.813509 25368 consensus_queue.cc:1048] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:10:50.843349 25189 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:50.787597 25266 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:50.846269 25202 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:50.848328 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.830355 25531 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:50.849073 25531 raft_consensus.cc:3060] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:50.849467 25523 log.cc:927] Time spent T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:10:50.847088 25273 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:50.847092 25266 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:50.804392 25313 raft_consensus.cc:3055] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:50.852646 22569 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:50.831163 25233 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.016s	sys 0.047s
W20260709 12:10:50.865792 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 204978us
I20260709 12:10:50.831528 25535 raft_consensus.cc:2749] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:50.878449 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.882462 25527 raft_consensus.cc:2749] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:50.883009 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:50.907603 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.897590 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:50.831894 25529 raft_consensus.cc:2804] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:50.890245 22569 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:50.863090 25313 raft_consensus.cc:740] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:50.955556 22598 raft_consensus.cc:1240] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:50.957360 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 67215us
I20260709 12:10:50.958427 22569 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:50.868378 25266 raft_consensus.cc:2749] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:50.939289 22571 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.005s	sys 0.006s
I20260709 12:10:50.874537 25538 raft_consensus.cc:2804] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:50.875448 24970 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:50.965082 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:50.965760 22571 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.005s	sys 0.009s
W20260709 12:10:50.882506 25419 consensus_meta.cc:287] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.805s	user 0.008s	sys 0.003s
W20260709 12:10:50.983528 23087 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.003s	sys 0.003s
I20260709 12:10:50.974468 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:50.975476 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:50.983960 23087 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.003s	sys 0.003s
I20260709 12:10:50.976626 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:50.973922 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:50.984781 22598 raft_consensus.cc:3055] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:50.972393 22599 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 6.
I20260709 12:10:50.883723 25202 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:50.959606 25428 raft_consensus.cc:2749] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:50.985451 22600 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 8.
I20260709 12:10:50.985181 22598 raft_consensus.cc:740] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
W20260709 12:10:50.984447 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 521366us
W20260709 12:10:50.969799 25525 log.cc:927] Time spent T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.308s	user 0.001s	sys 0.000s
I20260709 12:10:50.967530 25520 raft_consensus.cc:2749] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:51.001857 22601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "254fb9df2b39405996039a40091b4875"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:10:50.973709 25491 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.969668 25541 raft_consensus.cc:2804] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:51.015218 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 56831.7us
W20260709 12:10:51.002038 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 121764us
I20260709 12:10:50.966784 25230 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:50.969005 25535 raft_consensus.cc:2749] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:50.967671 25538 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:51.010490 22601 raft_consensus.cc:606] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Received request to transfer leadership to TS 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:51.036700 22601 raft_consensus.cc:614] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:10:50.977577 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:51.037987 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:51.020622 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 231954us
W20260709 12:10:51.021991 25023 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.005s	sys 0.009s
I20260709 12:10:50.973181 25527 consensus_queue.cc:1048] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:10:50.989701 25266 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:51.020051 22569 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:51.044201 22569 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:51.045361 22569 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:51.015218 25541 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:51.052280 22422 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:51.001439 25419 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:51.049896 25233 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.043105 25538 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.048703 25357 raft_consensus.cc:2804] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:10:51.045964 25023 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.005s	sys 0.009s
I20260709 12:10:51.036187 25551 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:51.068061 22495 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:10:51.070279 22526 raft_consensus.cc:2393] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 10: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:51.016510 25491 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:51.065165 25412 consensus_meta.cc:287] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 1.155s	user 0.013s	sys 0.000s
I20260709 12:10:51.055887 25541 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:51.092973 25355 consensus_meta.cc:287] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 1.171s	user 0.010s	sys 0.000s
I20260709 12:10:51.093395 25355 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:51.096153 25419 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:51.062453 25535 raft_consensus.cc:2749] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:51.061024 25438 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:51.061404 25458 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:51.098807 25438 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.099284 25438 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:51.087448 25549 log.cc:927] Time spent T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
W20260709 12:10:51.105829 24889 consensus_meta.cc:287] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.647s	user 0.008s	sys 0.000s
I20260709 12:10:51.106273 24889 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:51.107048 25280 consensus_meta.cc:287] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.807s	user 0.006s	sys 0.006s
W20260709 12:10:51.107197 25526 log.cc:927] Time spent T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.244s	user 0.001s	sys 0.000s
I20260709 12:10:51.107488 25280 raft_consensus.cc:2749] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:51.108538 25280 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.109056 25280 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:51.111829 25280 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:51.113394 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:51.087710 25542 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.087901 25273 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:51.088647 25540 log.cc:927] Time spent T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 12:10:51.089332 25544 log.cc:927] Time spent T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 12:10:51.091137 22599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:10:51.124393 25415 consensus_queue.cc:1048] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:51.133342 22599 raft_consensus.cc:606] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Received request to transfer leadership to TS 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:51.133724 22599 raft_consensus.cc:614] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:51.091652 25412 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:51.098104 25491 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:51.019451 25313 consensus_queue.cc:260] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:51.063685 25553 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.067108 25536 raft_consensus.cc:2749] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:51.124692 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 89910.2us
I20260709 12:10:51.076608 25230 consensus_queue.cc:1048] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 12:10:51.077055 25357 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.067826 25529 raft_consensus.cc:697] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:51.131330 25520 consensus_queue.cc:1059] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:51.131713 25419 raft_consensus.cc:2804] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:51.156826 25419 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:51.157325 25419 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.156947 25559 consensus_queue.cc:1048] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:10:51.127552 25542 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:51.161423 25542 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:51.132740 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 64767.8us
I20260709 12:10:51.136689 22528 raft_consensus.cc:1240] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:51.137154 22602 raft_consensus.cc:2368] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 7. Current term is 8.
I20260709 12:10:51.128165 23087 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:51.115053 25551 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:51.164427 23087 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:51.165676 25551 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:51.166129 23087 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:51.163319 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:51.167169 25273 raft_consensus.cc:2804] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:51.167572 25273 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.167899 25273 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.169413 25419 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:51.050418 25266 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:51.127576 25280 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:10:51.138608 25507 consensus_meta.cc:287] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.672s	user 0.010s	sys 0.000s
W20260709 12:10:51.171474 25505 consensus_meta.cc:287] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 1.224s	user 0.011s	sys 0.001s
I20260709 12:10:51.073539 25552 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.171437 25561 raft_consensus.cc:2749] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:51.172037 25505 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:51.172163 25552 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:51.174266 25552 leader_election.cc:290] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:51.169649 25550 consensus_queue.cc:1048] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:51.174916 23118 raft_consensus.cc:1275] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:51.170459 25280 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:51.143030 24950 consensus_meta.cc:287] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 1.165s	user 0.007s	sys 0.004s
I20260709 12:10:51.176440 25273 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:51.176649 25491 consensus_queue.cc:1048] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:10:51.177736 25280 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:51.178617 25513 log.cc:927] Time spent T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 1.029s	user 0.006s	sys 0.012s
I20260709 12:10:51.171417 25507 raft_consensus.cc:2764] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:10:51.179980 22605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2363) took 1661 ms. Trace:
W20260709 12:10:51.180491 25537 log.cc:927] Time spent T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 12:10:51.180765 22599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:10:51.180361 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:51.180419 22605 rpcz_store.cc:276] 0709 12:10:49.518717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.531527 (+ 12810us) service_pool.cc:224] Handling call
0709 12:10:49.541036 (+  9509us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:49.631158 (+ 90122us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:49.631200 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:49.668652 (+ 37452us) log.cc:844] Serialized 52 byte log entry
0709 12:10:49.891997 (+223345us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:49.892054 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.892122 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:51.177930 (+1285808us) spinlock_profiling.cc:243] Waited 3.26 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:10:51.179675 (+  1745us) raft_consensus.cc:1685] finished
0709 12:10:51.179695 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:51.179896 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":160295,"raft.queue_time_us":90465,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":19304,"spinlock_wait_cycles":7486848,"thread_start_us":143805,"threads_started":1,"wal-append.queue_time_us":386825}
I20260709 12:10:51.182557 25412 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:10:51.182118 25545 log.cc:927] Time spent T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 12:10:51.152742 22569 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:51.143150 22527 raft_consensus.cc:1275] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:51.185004 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:51.176543 25505 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:51.127337 25023 consensus_queue.cc:1059] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:10:51.155718 25357 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:51.205233 25232 raft_consensus.cc:3055] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:51.205768 25232 raft_consensus.cc:740] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
W20260709 12:10:51.196473 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 43838us
W20260709 12:10:51.197361 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 54707.9us
W20260709 12:10:51.197278 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 55170.1us
I20260709 12:10:51.169189 25438 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:51.201292 25273 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:51.215319 22496 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:51.196157 25355 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317)
W20260709 12:10:51.235941 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.215883 22495 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:51.145150 25535 consensus_queue.cc:1059] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 12:10:51.203016 25491 raft_consensus.cc:2804] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:51.176427 24950 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:51.200829 25518 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:51.239509 22421 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:51.236194 22531 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:51.245748 22529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1587) took 1194 ms. Trace:
W20260709 12:10:51.245767 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 79691.7us
I20260709 12:10:51.247262 23087 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:51.260723 25419 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:51.236632 25536 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.236023 25542 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:51.246289 22529 rpcz_store.cc:276] 0709 12:10:50.051082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.643539 (+592457us) service_pool.cc:224] Handling call
0709 12:10:50.676354 (+ 32815us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:50.715259 (+ 38905us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:50.715286 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:50.720503 (+  5217us) log.cc:844] Serialized 26 byte log entry
0709 12:10:50.852403 (+131900us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:50.852458 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.852548 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:51.245558 (+393010us) raft_consensus.cc:1685] finished
0709 12:10:51.245576 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:51.245693 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11153,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"thread_start_us":131537,"threads_started":1,"wal-append.queue_time_us":152324}
I20260709 12:10:51.154668 25553 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:51.252204 23087 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:51.300957 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 99780.6us
I20260709 12:10:51.302021 22495 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:51.303144 22421 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:51.304268 25562 raft_consensus.cc:2749] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:51.296970 22497 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:51.240562 25491 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.264357 25273 raft_consensus.cc:2804] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:51.240372 25232 consensus_queue.cc:260] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:51.323189 25358 consensus_meta.cc:287] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.953s	user 0.010s	sys 0.003s
I20260709 12:10:51.323137 25273 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:51.323061 25554 consensus_queue.cc:1048] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.121s
I20260709 12:10:51.324021 25273 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.323812 25358 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:51.249465 25518 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:51.245123 25531 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:51.250499 25565 consensus_queue.cc:1059] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.103s
I20260709 12:10:51.264554 25280 raft_consensus.cc:2749] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:51.358973 25189 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:51.360616 25518 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:51.265705 25536 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:51.363034 25536 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:51.326773 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:51.364092 22600 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:51.363772 22598 consensus_queue.cc:260] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:51.364813 22598 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.365658 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:51.352152 25543 log.cc:927] Time spent T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
W20260709 12:10:51.351553 25547 log.cc:927] Time spent T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
W20260709 12:10:51.369297 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.336336 24950 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:51.369594 22525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1588) took 1308 ms. Trace:
I20260709 12:10:51.369976 22525 rpcz_store.cc:276] 0709 12:10:50.061135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.700373 (+639238us) service_pool.cc:224] Handling call
0709 12:10:50.704151 (+  3778us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:10:50.726922 (+ 22771us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:50.726965 (+    43us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:10:50.745772 (+ 18807us) log.cc:844] Serialized 78 byte log entry
0709 12:10:50.936285 (+190513us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:50.969018 (+ 32733us) log.cc:844] Serialized 14 byte log entry
0709 12:10:50.974328 (+  5310us) log.cc:844] Serialized 14 byte log entry
0709 12:10:50.974488 (+   160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.974548 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:51.369380 (+394832us) raft_consensus.cc:1685] finished
0709 12:10:51.369398 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:51.369527 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93064,"prepare.queue_time_us":78560,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":97,"raft.queue_time_us":157486,"raft.run_cpu_time_us":352,"raft.run_wall_time_us":13396,"thread_start_us":131214,"threads_started":1,"wal-append.queue_time_us":313248}
I20260709 12:10:51.337728 25553 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:51.371927 25568 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.335259 24889 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:51.372807 22604 raft_consensus.cc:1240] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:51.339205 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:51.343832 22452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1621) took 1843 ms. Trace:
I20260709 12:10:51.352393 22532 raft_consensus.cc:1240] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 LEADER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:51.372800 25023 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:51.375681 22452 rpcz_store.cc:276] 0709 12:10:49.500435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.055648 (+555213us) service_pool.cc:224] Handling call
0709 12:10:50.734795 (+679147us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:50.737090 (+  2295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:51.343608 (+606518us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b54003f25d0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:51.343748 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1561100032}
I20260709 12:10:51.308770 25542 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:51.380744 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:10:51.314350 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 62339.7us
I20260709 12:10:51.318668 25550 consensus_queue.cc:1048] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:51.299196 25527 raft_consensus.cc:2804] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:51.236792 25541 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:51.319428 25266 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:51.316568 25355 raft_consensus.cc:2749] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:51.419680 24889 consensus_queue.cc:1059] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 12:10:51.430135 24889 raft_consensus.cc:3055] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:51.430347 22602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43070 (request call id 486) took 1136 ms. Trace:
I20260709 12:10:51.430516 24889 raft_consensus.cc:740] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:51.430787 22602 rpcz_store.cc:276] 0709 12:10:50.293724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.293870 (+   146us) service_pool.cc:224] Handling call
0709 12:10:51.430151 (+1136281us) spinlock_profiling.cc:243] Waited 825 ms on lock 0x7b54000e8b54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:51.430271 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1897740160}
I20260709 12:10:51.431463 24889 consensus_queue.cc:260] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:51.432118 25499 consensus_meta.cc:287] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.838s	user 0.011s	sys 0.000s
I20260709 12:10:51.432765 24889 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.432605 25499 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:51.320897 25438 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:51.376880 24970 raft_consensus.cc:2749] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:51.435197 25575 raft_consensus.cc:2804] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:51.377111 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 80239.6us
I20260709 12:10:51.435673 22603 raft_consensus.cc:1240] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:51.441118 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.441311 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:51.441689 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.441902 22604 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 6.
I20260709 12:10:51.378934 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:51.396737 22600 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 9.
I20260709 12:10:51.403927 22570 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:51.379252 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:51.443420 23125 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:51.443691 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:51.330137 25510 log.cc:927] Time spent T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 1.174s	user 0.000s	sys 0.013s
W20260709 12:10:51.414332 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 112428us
I20260709 12:10:51.413890 23118 raft_consensus.cc:1240] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:51.418865 23087 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:51.420738 22524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1581) took 1376 ms. Trace:
I20260709 12:10:51.317199 25491 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.426604 23117 raft_consensus.cc:1240] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:10:51.419705 25226 consensus_queue.cc:1059] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:10:51.372550 25568 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:51.456267 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:51.456351 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:10:51.456923 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 53065.8us
I20260709 12:10:51.308014 22421 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:51.445945 22598 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 7.
I20260709 12:10:51.446393 22422 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:51.458438 22599 raft_consensus.cc:606] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Received request to transfer leadership to TS 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:51.421528 25527 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.383517 25415 raft_consensus.cc:2749] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:51.448490 22524 rpcz_store.cc:276] 0709 12:10:50.044024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.044128 (+   104us) service_pool.cc:224] Handling call
0709 12:10:50.050933 (+  6805us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:50.054063 (+  3130us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:50.424082 (+370019us) log.cc:844] Serialized 14 byte log entry
0709 12:10:51.179824 (+755742us) spinlock_profiling.cc:243] Waited 7.05 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:10:51.360663 (+180839us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b18000d7c80. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cca4d64bc 00007f9cc782448b 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc783e455 00007f9cca926060 00007f9cca938716 00007f9cca949287
0709 12:10:51.361027 (+   364us) log.cc:844] Serialized 14 byte log entry
0709 12:10:51.420291 (+ 59264us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:51.420362 (+    71us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:51.420417 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:51.420510 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:51.420663 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93075,"prepare.queue_time_us":536600,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":20329,"raft.queue_time_us":177198,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":44030,"spinlock_wait_cycles":19160832,"thread_start_us":805589,"threads_started":3,"wal-append.queue_time_us":532125}
I20260709 12:10:51.451917 22497 leader_election.cc:304] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:51.434787 25499 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:51.397274 25233 raft_consensus.cc:2749] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:51.442775 23120 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:51.475703 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 167772us
I20260709 12:10:51.345322 25368 raft_consensus.cc:3055] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:51.458932 22599 raft_consensus.cc:614] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:10:51.443658 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 232425us
W20260709 12:10:51.484925 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 66169.2us
I20260709 12:10:51.484860 22421 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:51.485538 22496 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:51.460393 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:51.486483 22496 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:10:51.487306 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.380252 25554 consensus_queue.cc:1059] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 12:10:51.464886 22495 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:10:51.435680 25575 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.495476 22421 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
W20260709 12:10:51.463173 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 255463us
I20260709 12:10:51.379036 25023 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:51.467713 25527 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.329651 25538 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:51.467931 25531 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:51.487754 25232 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:51.527094 23125 raft_consensus.cc:2468] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 4.
I20260709 12:10:51.475914 25355 raft_consensus.cc:2749] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:51.527870 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 79943.2us
I20260709 12:10:51.466338 25551 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:10:51.511960 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.497707 25231 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:51.487022 25368 raft_consensus.cc:740] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:51.528596 22495 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:10:51.511935 25510 log.cc:927] Time spent T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:10:51.516335 22421 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:51.457185 25400 consensus_queue.cc:1059] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 12:10:51.497030 25202 raft_consensus.cc:2749] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:51.527498 25230 raft_consensus.cc:2804] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:51.490490 24950 raft_consensus.cc:2804] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:51.511226 25419 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:51.559705 22496 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:51.533581 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:51.536751 23089 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:51.561450 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:51.537858 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:51.519066 25499 raft_consensus.cc:2804] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:51.511752 25316 consensus_queue.cc:1048] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:10:51.517081 25574 raft_consensus.cc:2804] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:51.543190 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:51.343044 25529 consensus_queue.cc:237] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:51.498528 25575 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.518404 25412 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:51.551879 25189 raft_consensus.cc:2804] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:51.552403 22449 raft_consensus.cc:1240] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:10:51.553263 22526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56942 (request call id 1583) took 1508 ms. Trace:
I20260709 12:10:51.519591 25559 raft_consensus.cc:3055] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:51.556105 22421 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:51.557175 23118 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
W20260709 12:10:51.562677 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.556174 25230 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.552824 25551 raft_consensus.cc:697] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 9 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:51.568894 25568 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:51.561920 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:51.559670 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:51.491678 25438 raft_consensus.cc:2804] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:51.579361 22451 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:10:51.594826 22526 rpcz_store.cc:276] 0709 12:10:50.044639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.044742 (+   103us) service_pool.cc:224] Handling call
0709 12:10:51.553022 (+1508280us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b540035fa54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:51.553173 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2306988800}
I20260709 12:10:51.596174 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:51.598209 22421 leader_election.cc:400] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 election: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 4. Current term is 5.
I20260709 12:10:51.562263 25536 raft_consensus.cc:2749] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:51.602965 22454 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:10:51.570161 25561 raft_consensus.cc:2749] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:51.603991 22421 leader_election.cc:403] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:10:51.616377 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:51.603442 22455 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.570684 25499 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:51.551529 25458 consensus_queue.cc:1059] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:10:51.585031 25574 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.618952 23122 raft_consensus.cc:1240] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:10:51.619871 22421 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:51.627635 23124 raft_consensus.cc:2393] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 7: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:51.601383 25230 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:51.596987 25559 raft_consensus.cc:740] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:51.640103 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:10:51.640136 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 111617us
I20260709 12:10:51.569528 25368 consensus_queue.cc:260] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:51.570438 25226 consensus_queue.cc:1048] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:10:51.603133 25280 raft_consensus.cc:2749] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:51.645040 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:51.653541 22454 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.599712 25412 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:51.580618 25355 consensus_queue.cc:1059] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:10:51.605780 25438 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.619482 25507 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.648377 23119 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.649047 22495 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:51.615984 24950 raft_consensus.cc:697] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:51.633868 25499 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:51.649456 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 79539.3us
I20260709 12:10:51.632823 25437 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:51.667758 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:51.599710 25542 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:51.633714 25562 raft_consensus.cc:2749] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 4. Current term is 5.
I20260709 12:10:51.645184 25574 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:51.661717 25581 log.cc:927] Time spent T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:10:51.661659 25558 raft_consensus.cc:2749] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:51.662597 25355 raft_consensus.cc:3055] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:51.662962 25571 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.663367 25584 raft_consensus.cc:3055] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:51.649492 25415 raft_consensus.cc:2804] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:51.664644 25575 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:51.665830 25577 consensus_queue.cc:1059] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:10:51.655938 25518 consensus_queue.cc:1059] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
W20260709 12:10:51.670615 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.669296 22455 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:10:51.681648 23122 raft_consensus.cc:2393] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 7: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
W20260709 12:10:51.678593 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 119007us
I20260709 12:10:51.667270 25313 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.654465 25541 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:51.657713 25438 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.685004 25437 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:51.681025 25553 raft_consensus.cc:2804] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:51.676749 25189 raft_consensus.cc:697] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:51.672727 25507 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:51.669344 23119 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:10:51.654929 25273 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:51.716312 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 96559.8us
I20260709 12:10:51.738476 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:51.707353 23120 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 7.
I20260709 12:10:51.694666 25458 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.708452 25584 raft_consensus.cc:740] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:51.679317 25266 raft_consensus.cc:3055] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:51.705590 25355 raft_consensus.cc:740] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:51.734860 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:51.740574 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:51.741473 23121 raft_consensus.cc:1240] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:51.747622 23120 raft_consensus.cc:2393] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 7: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
W20260709 12:10:51.727654 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 78714.7us
I20260709 12:10:51.737784 22421 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:51.675887 25573 consensus_queue.cc:1048] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.160s
I20260709 12:10:51.707891 25415 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:51.667557 25551 consensus_queue.cc:237] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:51.743701 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:51.773653 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:51.784762 22524 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 8.
W20260709 12:10:51.774482 23087 leader_election.cc:336] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.775s (SENT)
I20260709 12:10:51.753108 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:51.786512 22523 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 7: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:51.790226 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:51.790802 22451 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.742333 25553 raft_consensus.cc:697] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:51.791671 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:51.792057 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:51.793373 22449 raft_consensus.cc:1275] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:51.746933 25266 raft_consensus.cc:740] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:51.744182 25316 consensus_queue.cc:1059] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:10:51.774271 24970 consensus_queue.cc:1048] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 12:10:51.804728 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:51.832414 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:51.837646 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:51.748937 25458 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:51.839349 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:51.848692 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:51.716073 25571 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:51.779476 25562 raft_consensus.cc:2749] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:51.787250 25573 consensus_queue.cc:1243] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer 8701cd5186a949538d8efafb5f987270 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:10:51.850190 23123 raft_consensus.cc:1240] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:51.838222 22529 raft_consensus.cc:1275] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:51.882604 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:51.854161 22421 leader_election.cc:400] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 election: Vote denied by peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353) with higher term. Message: Invalid argument: T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 8. Current term is 9.
I20260709 12:10:51.844626 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:51.885140 22421 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:51.847431 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:51.773622 25415 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:51.819955 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:51.888475 22524 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:51.822359 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:51.854774 22527 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
I20260709 12:10:51.889602 22528 raft_consensus.cc:2393] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 7: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:51.831990 23122 raft_consensus.cc:1275] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:51.850457 22453 raft_consensus.cc:2376] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 5. Re-sending same reply.
I20260709 12:10:51.876343 22449 raft_consensus.cc:2368] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 7. Current term is 8.
I20260709 12:10:51.891181 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:51.754733 25585 raft_consensus.cc:2804] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:51.851163 25575 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:51.879639 25489 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.002s	user 0.013s	sys 0.002s
I20260709 12:10:51.899381 22451 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 7.
I20260709 12:10:51.897230 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:51.895531 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:51.906759 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 118359us
I20260709 12:10:51.862865 25487 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:51.913546 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:51.913929 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:51.914659 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:51.736058 25559 consensus_queue.cc:260] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:51.891629 25586 log.cc:927] Time spent T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.244s	user 0.001s	sys 0.000s
I20260709 12:10:51.914333 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:51.918771 25226 consensus_queue.cc:1059] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:51.819625 25189 consensus_queue.cc:237] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:51.831519 24950 consensus_queue.cc:237] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:51.920996 22454 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
I20260709 12:10:51.921167 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:52.104290 23122 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:52.057008 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 279685us
I20260709 12:10:52.106592 22495 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:52.113312 22455 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.115289 22531 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:51.898131 25562 raft_consensus.cc:2749] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:51.900477 25585 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:10:52.116791 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 202035us
I20260709 12:10:52.120870 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:52.122571 22601 raft_consensus.cc:1240] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:52.123296 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.124982 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:10:52.103142 25489 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.252s	user 0.014s	sys 0.011s
W20260709 12:10:51.929061 25579 log.cc:927] Time spent T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 12:10:52.129338 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:51.917061 25558 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.138996 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:52.139335 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:52.138549 22528 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:52.129828 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:52.132318 24970 consensus_queue.cc:1048] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:52.128973 23087 leader_election.cc:400] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 election: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 7. Current term is 8.
I20260709 12:10:52.145859 23087 leader_election.cc:403] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:10:52.137806 22531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:56942 (request call id 1584) took 2071 ms. Trace:
I20260709 12:10:51.853168 25584 consensus_queue.cc:260] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:51.928905 25590 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.089637 25281 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.144799 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:52.154800 23116 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 7.
I20260709 12:10:51.927605 25611 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:51.924618 25571 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:52.145327 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.917002 25023 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:51.928277 25598 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.118043 25437 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:52.135493 25585 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:51.927201 25458 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:52.146852 22531 rpcz_store.cc:276] 0709 12:10:50.050217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.115075 (+ 64858us) service_pool.cc:224] Handling call
0709 12:10:51.925846 (+1810771us) spinlock_profiling.cc:243] Waited 639 ms on lock 0x7b54003f0cd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca925a3d 00007f9ccf8f5cd0 00007f9cc8e7a254 00007f9cc8e7a1e2 00007f9cc8e7a111 00007f9cc8e7a08c 00007f9cc8e79342 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:52.116526 (+190680us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1468826880}
I20260709 12:10:52.133518 25273 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:52.178867 22495 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:52.137141 25507 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:52.148075 23125 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.013s	sys 0.013s
W20260709 12:10:52.190299 23125 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.013s	sys 0.013s
I20260709 12:10:52.149626 24970 consensus_queue.cc:1243] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer 1676e7af5e4a47cb86ee7db83e3d4881 log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:10:52.160588 25541 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.925328 25266 consensus_queue.cc:260] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:52.016105 25355 consensus_queue.cc:260] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:52.160789 25552 raft_consensus.cc:2749] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:52.179406 25592 raft_consensus.cc:2749] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 7. Current term is 8.
I20260709 12:10:52.015921 25553 consensus_queue.cc:237] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:52.269996 25355 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:52.160290 25590 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:52.239421 25594 log.cc:927] Time spent T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 12:10:52.239650 22421 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:10:52.240307 25608 log.cc:927] Time spent T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:10:52.160117 25428 consensus_queue.cc:1059] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 12:10:52.246876 25400 consensus_queue.cc:1048] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:52.136220 25561 consensus_queue.cc:1048] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.118s
W20260709 12:10:52.252177 25597 log.cc:927] Time spent T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.255s	user 0.001s	sys 0.000s
I20260709 12:10:52.263231 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:52.192322 25598 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:52.237823 22528 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 9.
W20260709 12:10:52.282651 25574 consensus_meta.cc:287] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.583s	user 0.000s	sys 0.010s
I20260709 12:10:52.274447 22530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1595) took 1132 ms. Trace:
W20260709 12:10:52.196576 25357 consensus_meta.cc:287] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.971s	user 0.011s	sys 0.000s
I20260709 12:10:52.280345 22455 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 7.
I20260709 12:10:52.161173 25529 raft_consensus.cc:3055] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:52.282024 22524 raft_consensus.cc:2468] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
W20260709 12:10:52.285553 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 181525us
I20260709 12:10:52.128466 25487 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:52.323452 25593 log.cc:927] Time spent T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.401s	user 0.001s	sys 0.000s
W20260709 12:10:52.324410 25613 log.cc:927] Time spent T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:10:52.159994 25281 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:52.369083 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:52.370762 25281 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:52.345857 22530 rpcz_store.cc:276] 0709 12:10:51.141831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.150332 (+  8501us) service_pool.cc:224] Handling call
0709 12:10:51.189496 (+ 39164us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:51.211547 (+ 22051us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:51.211581 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:51.212144 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 12:10:51.494359 (+282215us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:51.494408 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:51.494482 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:52.274188 (+779706us) raft_consensus.cc:1685] finished
0709 12:10:52.274216 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:52.274371 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34111,"raft.queue_time_us":45242,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":4703,"thread_start_us":269111,"threads_started":1,"wal-append.queue_time_us":334534}
I20260709 12:10:52.148083 25558 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:52.353627 22570 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:52.372561 25607 raft_consensus.cc:2804] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:52.372982 25607 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:52.373373 25607 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:52.373679 25558 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:52.375348 25487 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:52.185443 25611 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:52.283242 25541 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:52.348157 25542 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:52.496421 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 256830us
I20260709 12:10:52.499275 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:52.396399 22523 raft_consensus.cc:1275] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:10:52.492333 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 368198us
W20260709 12:10:52.496584 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 114587us
I20260709 12:10:52.505738 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:52.513542 22524 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 7.
I20260709 12:10:52.496450 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:52.490782 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 311986us
I20260709 12:10:52.391559 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:52.515367 22531 raft_consensus.cc:2393] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 5: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:52.345569 25573 raft_consensus.cc:2749] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:52.515214 22495 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:52.513119 22570 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:52.513476 23087 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:52.526705 23125 raft_consensus.cc:1240] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:52.353076 25529 raft_consensus.cc:740] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:52.530725 22495 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:52.394358 25232 consensus_meta.cc:287] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.862s	user 0.007s	sys 0.002s
I20260709 12:10:52.538298 22495 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:52.538133 22421 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:52.539564 23087 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:52.540132 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:52.540303 22421 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:52.541213 22530 raft_consensus.cc:2393] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 10: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
W20260709 12:10:52.286366 25437 consensus_queue.cc:1175] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6c6fa11e8ee34711b3551f0c670442bc" responder_term: 6 status { last_received { term: 5 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:10:52.507227 25572 raft_consensus.cc:3055] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:52.524884 25590 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:52.394819 25520 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.000s	sys 0.018s
I20260709 12:10:52.545037 22421 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:52.530195 25546 raft_consensus.cc:2749] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:52.530323 25558 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
W20260709 12:10:52.547056 25491 consensus_meta.cc:287] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 1.083s	user 0.010s	sys 0.002s
I20260709 12:10:52.536475 25487 raft_consensus.cc:2804] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:52.536522 25561 raft_consensus.cc:2804] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:10:52.553642 25520 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.003s	sys 0.034s
I20260709 12:10:52.359795 25357 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:52.561823 22421 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:52.543321 25536 raft_consensus.cc:2749] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:52.354280 25574 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:52.546049 25551 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:52.556053 22495 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:10:52.551162 25232 raft_consensus.cc:2804] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:52.551183 25552 raft_consensus.cc:2749] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:52.547905 25572 raft_consensus.cc:740] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:52.585302 25572 consensus_queue.cc:260] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:52.586360 25572 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:52.641669 23119 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.009s	sys 0.032s
W20260709 12:10:52.562696 24889 consensus_meta.cc:287] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 1.129s	user 0.013s	sys 0.001s
I20260709 12:10:52.394677 25607 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:52.658000 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:52.658258 22603 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7.
I20260709 12:10:52.658631 22597 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.659631 25607 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:52.659761 25232 raft_consensus.cc:697] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 7 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:52.661548 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:52.661381 25232 consensus_queue.cc:237] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:52.662281 22601 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 7: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:52.662331 25546 raft_consensus.cc:2804] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:52.662971 25546 raft_consensus.cc:697] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:52.663288 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:52.663895 22601 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 5.
I20260709 12:10:52.644827 22602 raft_consensus.cc:2393] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 10: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:52.563645 25562 raft_consensus.cc:2749] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:52.573386 25615 raft_consensus.cc:2749] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:52.646284 23123 consensus_meta.cc:287] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.505s	user 0.006s	sys 0.000s
I20260709 12:10:52.676821 23123 raft_consensus.cc:2468] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5.
W20260709 12:10:52.646044 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 90109us
W20260709 12:10:52.647360 23119 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.010s	sys 0.033s
I20260709 12:10:52.649251 25610 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.657227 25412 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:52.664028 25590 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.664937 22598 raft_consensus.cc:1240] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:52.665213 22605 raft_consensus.cc:1240] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:52.666174 23122 consensus_meta.cc:287] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.560s	user 0.009s	sys 0.000s
I20260709 12:10:52.689441 23122 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 6.
W20260709 12:10:52.582052 25313 consensus_meta.cc:287] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.853s	user 0.010s	sys 0.002s
I20260709 12:10:52.578280 25624 raft_consensus.cc:2749] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:52.573846 25561 raft_consensus.cc:697] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 7 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:52.572402 22421 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:52.563153 25553 consensus_queue.cc:1048] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:10:52.563962 25491 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:52.663990 25415 consensus_meta.cc:287] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.750s	user 0.009s	sys 0.001s
W20260709 12:10:52.673595 25230 consensus_meta.cc:287] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 1.017s	user 0.012s	sys 0.000s
W20260709 12:10:52.695173 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 122898us
I20260709 12:10:52.564801 25558 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:52.702307 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:52.746958 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 57015.6us
W20260709 12:10:52.756421 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.573233 25529 consensus_queue.cc:260] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:52.740262 22597 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7.
I20260709 12:10:52.765183 22495 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:10:52.766896 25598 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:52.768913 25598 raft_consensus.cc:2804] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:52.769375 25598 raft_consensus.cc:697] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
W20260709 12:10:52.758419 25588 log.cc:927] Time spent T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:10:52.770349 25598 consensus_queue.cc:237] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:52.772245 25527 consensus_meta.cc:287] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 1.237s	user 0.011s	sys 0.002s
I20260709 12:10:52.772675 25527 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:52.774159 22495 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:52.774803 25529 raft_consensus.cc:3060] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:52.774910 25640 raft_consensus.cc:2804] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:52.775630 25640 raft_consensus.cc:697] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:52.776293 22495 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:52.776538 25640 consensus_queue.cc:237] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:52.777155 25641 consensus_queue.cc:1048] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:52.703850 25226 raft_consensus.cc:2749] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:52.774710 23119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 1008) took 1097 ms. Trace:
I20260709 12:10:52.714684 23122 raft_consensus.cc:1275] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:52.779667 23119 rpcz_store.cc:276] 0709 12:10:51.676896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.787582 (+110686us) service_pool.cc:224] Handling call
0709 12:10:51.849997 (+ 62415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:51.850395 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:51.850424 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:51.887244 (+ 36820us) log.cc:844] Serialized 26 byte log entry
0709 12:10:52.678621 (+791377us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:52.678658 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:52.678717 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:52.774526 (+ 95809us) raft_consensus.cc:1685] finished
0709 12:10:52.774547 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:52.774654 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1540,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":8813,"spinlock_wait_cycles":34432,"thread_start_us":636731,"threads_started":1,"wal-append.queue_time_us":872683}
I20260709 12:10:52.701622 25623 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.806563 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:52.797204 25438 consensus_meta.cc:287] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 1.053s	user 0.011s	sys 0.002s
I20260709 12:10:52.807786 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:52.805893 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:52.772207 25574 leader_election.cc:290] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:52.811336 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:52.811494 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:52.845310 22530 raft_consensus.cc:2376] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 5. Re-sending same reply.
I20260709 12:10:52.845816 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:52.796139 25541 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:52.699837 25590 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:52.810388 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:52.820062 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:52.853060 22448 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:52.663890 25546 consensus_queue.cc:237] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:52.778637 25428 raft_consensus.cc:2749] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:52.846596 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:52.693879 25610 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:52.710342 25415 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:52.857492 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:52.858125 22530 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:52.858618 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 60903.2us
I20260709 12:10:52.846616 22450 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 7: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:52.774900 25527 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:52.848104 22454 raft_consensus.cc:1240] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:10:52.848776 22453 raft_consensus.cc:1240] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:52.786585 25487 raft_consensus.cc:697] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:52.849459 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:52.864058 22456 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:52.853068 22451 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 5.
I20260709 12:10:52.714254 25230 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:52.850186 25499 consensus_meta.cc:287] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 1.164s	user 0.009s	sys 0.002s
W20260709 12:10:52.861346 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 153566us
W20260709 12:10:52.866147 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.851126 25553 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:10:52.862533 25585 consensus_meta.cc:287] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.624s	user 0.008s	sys 0.002s
I20260709 12:10:52.873960 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:52.874749 22454 raft_consensus.cc:2393] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 6: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:52.819761 25438 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:52.876616 22527 raft_consensus.cc:2393] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 6: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:52.877274 22454 raft_consensus.cc:1275] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:52.879882 25438 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:52.880610 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.880702 25415 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:52.881536 25592 consensus_queue.cc:1048] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:10:52.869714 25355 consensus_meta.cc:287] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.598s	user 0.011s	sys 0.000s
I20260709 12:10:52.864080 25611 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:52.884214 22530 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 7.
I20260709 12:10:52.856956 25561 consensus_queue.cc:237] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:52.895539 22448 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 10.
I20260709 12:10:52.814292 25623 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:52.898836 22456 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
I20260709 12:10:52.899865 22454 raft_consensus.cc:1240] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:52.900421 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:52.900707 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:52.901013 22530 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 7.
I20260709 12:10:52.901183 23119 raft_consensus.cc:2376] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 7. Re-sending same reply.
I20260709 12:10:52.869573 25626 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:52.901839 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:52.873494 25357 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:52.902356 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:52.904808 22453 raft_consensus.cc:2393] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 7: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:52.907639 22495 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:52.909472 25610 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:52.910768 25590 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:52.875891 25585 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:52.912838 25585 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:52.912947 25643 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:52.913627 25643 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:52.915236 25487 consensus_queue.cc:237] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:52.915830 25643 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:52.904081 22530 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.874337 25553 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:52.868944 25499 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:52.921216 22495 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:52.926311 22456 raft_consensus.cc:1240] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 12:10:52.930584 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.933012 22530 raft_consensus.cc:2410] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:10:52.937844 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:52.939471 22452 raft_consensus.cc:2393] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 6: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:52.941814 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:52.942584 22530 raft_consensus.cc:2393] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 6: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:52.943629 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:52.944634 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:52.945608 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:52.946293 22530 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 7: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:52.946748 25357 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:52.947337 22530 raft_consensus.cc:1240] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:10:52.947307 25357 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:52.948261 25623 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:52.942495 25230 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:52.949290 25357 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:52.923638 25611 raft_consensus.cc:2749] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:52.937284 25610 raft_consensus.cc:2749] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:52.955806 25499 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:52.940922 25491 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:52.971251 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 50101.5us
I20260709 12:10:52.972923 25611 consensus_queue.cc:1059] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:52.973076 22495 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:10:52.974536 22495 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:52.972657 25640 consensus_queue.cc:1059] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:10:52.976130 22570 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:52.978732 25357 raft_consensus.cc:2804] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:52.979242 25357 raft_consensus.cc:697] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 8 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:52.916894 25626 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:52.980767 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.982777 22495 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:10:52.982933 23118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57328 (request call id 995) took 1531 ms. Trace:
I20260709 12:10:52.983579 23118 rpcz_store.cc:276] 0709 12:10:51.449208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.449352 (+   144us) service_pool.cc:224] Handling call
0709 12:10:52.980372 (+1531020us) spinlock_profiling.cc:243] Waited 64.9 ms on lock 0x7b5400750154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:52.980479 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":149224192}
W20260709 12:10:52.984782 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:52.987251 25518 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.005s	sys 0.001s
W20260709 12:10:52.987720 25518 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.005s	sys 0.001s
I20260709 12:10:52.988781 25230 raft_consensus.cc:2804] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:52.989019 25553 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:52.989399 25230 raft_consensus.cc:697] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:52.989617 25553 raft_consensus.cc:3055] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:52.990031 25553 raft_consensus.cc:740] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:52.993111 22497 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:52.986615 25572 consensus_queue.cc:1048] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:10:52.993710 25610 raft_consensus.cc:2804] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:52.993983 22497 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:52.994288 25610 raft_consensus.cc:697] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:52.994638 25642 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:52.995654 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:52.996393 23124 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 7: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:52.996132 25357 consensus_queue.cc:237] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:52.995253 25610 consensus_queue.cc:237] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:53.006928 23119 pending_rounds.cc:85] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270: Aborting all ops after (but not including) 6
I20260709 12:10:53.007683 23119 pending_rounds.cc:107] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:10:53.007908 23119 raft_consensus.cc:2889] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:52.982081 25542 raft_consensus.cc:2749] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:52.982971 25585 raft_consensus.cc:2804] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:53.010936 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:53.014257 25611 consensus_queue.cc:1059] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:52.990360 25230 consensus_queue.cc:237] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:53.019364 25535 raft_consensus.cc:3055] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:53.009522 25642 raft_consensus.cc:2804] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:53.045514 25642 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.045887 25642 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:53.020826 22497 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:53.034327 25585 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.051746 25585 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:53.054610 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:53.055585 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:53.055902 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:53.056418 22597 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.056790 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:53.027668 25626 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:53.060865 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:53.027813 23117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 1005) took 1405 ms. Trace:
I20260709 12:10:53.056018 22449 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7.
I20260709 12:10:53.045785 22532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 1961) took 1121 ms. Trace:
I20260709 12:10:53.024387 22523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1598) took 1236 ms. Trace:
I20260709 12:10:53.064230 22523 rpcz_store.cc:276] 0709 12:10:51.787979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.796971 (+  8992us) service_pool.cc:224] Handling call
0709 12:10:51.797226 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:52.510150 (+712924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.024145 (+513995us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b5400262854. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:53.024327 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1342965504}
I20260709 12:10:53.057842 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:53.058580 22605 raft_consensus.cc:1275] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:53.058477 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:53.066892 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:53.072853 22523 raft_consensus.cc:1240] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:10:53.064162 22532 rpcz_store.cc:276] 0709 12:10:51.923937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.370229 (+446292us) service_pool.cc:224] Handling call
0709 12:10:52.370622 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:52.371719 (+  1097us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:52.496612 (+124893us) log.cc:844] Serialized 14 byte log entry
0709 12:10:52.814746 (+318134us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:52.815330 (+   584us) log.cc:844] Serialized 26 byte log entry
0709 12:10:52.815485 (+   155us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:52.815788 (+   303us) log.cc:844] Serialized 14 byte log entry
0709 12:10:52.816020 (+   232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:52.816110 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:53.020846 (+204736us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b18003fac60. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc78413f3 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd 0000000000388634 0000000000388479 00007f9cc782483a
0709 12:10:53.045512 (+ 24666us) raft_consensus.cc:1685] finished
0709 12:10:53.045548 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:53.045709 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":130442,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":70,"raft.queue_time_us":11558,"raft.run_cpu_time_us":362,"raft.run_wall_time_us":30825,"spinlock_wait_cycles":4644736,"thread_start_us":317527,"threads_started":2,"wal-append.queue_time_us":357726}
I20260709 12:10:53.062141 23117 rpcz_store.cc:276] 0709 12:10:51.622299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.695090 (+ 72791us) service_pool.cc:224] Handling call
0709 12:10:51.715853 (+ 20763us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:51.864667 (+148814us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:51.864711 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:51.864770 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:51.864818 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.026852 (+1162034us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b18004843c0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc780f2a6 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419
0709 12:10:53.027524 (+   672us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b54001acf54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:53.027580 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:53.027739 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":92,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":13127,"spinlock_wait_cycles":367132288}
I20260709 12:10:53.043761 25535 raft_consensus.cc:740] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:53.060802 25578 raft_consensus.cc:3055] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:53.066915 25590 raft_consensus.cc:2804] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:52.990818 25553 consensus_queue.cc:260] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:53.063460 25592 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:53.071998 25355 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.087605 22532 raft_consensus.cc:1217] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 LEADER]: Deduplicated request from leader. Original: 2.5->[5.6-5.6]   Dedup: 5.6->[]
I20260709 12:10:53.090969 22597 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7.
I20260709 12:10:53.093550 22532 raft_consensus.cc:1240] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 LEADER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:10:53.094359 22497 leader_election.cc:304] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:53.083163 25574 consensus_queue.cc:1048] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:10:53.085700 25232 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:53.085765 25578 raft_consensus.cc:740] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
W20260709 12:10:53.102793 23087 leader_election.cc:336] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.542s (SENT)
I20260709 12:10:53.103271 23087 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:53.104923 25561 raft_consensus.cc:2749] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:10:53.107002 25587 log.cc:927] Time spent T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 1.524s	user 0.002s	sys 0.001s
I20260709 12:10:53.101009 25553 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.114068 25535 consensus_queue.cc:260] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:53.115312 25535 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.117179 25578 consensus_queue.cc:260] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:53.118352 25578 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:53.120960 25622 log.cc:927] Time spent T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.441s	user 0.000s	sys 0.001s
I20260709 12:10:53.124993 22526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 1947) took 1388 ms. Trace:
I20260709 12:10:53.125329 22526 rpcz_store.cc:276] 0709 12:10:51.736904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.737266 (+   362us) service_pool.cc:224] Handling call
0709 12:10:51.737601 (+   335us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:51.887576 (+149975us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:51.887625 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:52.043023 (+155398us) log.cc:844] Serialized 52 byte log entry
0709 12:10:52.361247 (+318224us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:52.361301 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:52.361397 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:53.120396 (+758999us) spinlock_profiling.cc:243] Waited 5.88 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:10:53.124630 (+  4234us) raft_consensus.cc:1685] finished
0709 12:10:53.124653 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:53.124868 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":848,"raft.queue_time_us":139610,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":130,"spinlock_wait_cycles":13534976,"thread_start_us":411576,"threads_started":2,"wal-append.queue_time_us":472193}
I20260709 12:10:53.126562 22532 raft_consensus.cc:1240] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 LEADER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:53.095575 25590 raft_consensus.cc:697] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:53.154349 25590 consensus_queue.cc:237] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:53.157637 25559 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.158284 22599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:60938 (request call id 23) took 1982 ms. Trace:
I20260709 12:10:53.158743 22599 rpcz_store.cc:276] 0709 12:10:51.175868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.180617 (+  4749us) service_pool.cc:224] Handling call
0709 12:10:53.158062 (+1977445us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b54000eae54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca928853 00007f9ccf8f660a 00007f9cc8e7c7d4 00007f9cc8e7c762 00007f9cc8e7c691 00007f9cc8e7c60c 00007f9cc8e7b8c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:53.158190 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":636915072}
I20260709 12:10:53.161360 25419 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:53.161836 25419 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:53.162773 23088 connection.cc:256] RPC call timeout handler was delayed by -1.3252608600000713s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1658s for a response
I20260709 12:10:53.095520 25355 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:53.163285 23088 connection.cc:256] RPC call timeout handler was delayed by -1.1866608600000745s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18120000000000003s for a response
I20260709 12:10:53.100243 25521 raft_consensus.cc:2804] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:53.165069 25281 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.165531 25521 raft_consensus.cc:697] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:53.165757 25281 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:53.094465 25592 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:53.165083 25355 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:53.168941 25592 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:53.096690 25428 consensus_queue.cc:1175] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6c6fa11e8ee34711b3551f0c670442bc" responder_term: 8 status { last_received { term: 7 index: 6 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:10:53.134799 25358 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:53.136957 22524 raft_consensus.cc:1240] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 LEADER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:53.141338 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:53.142110 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:53.142823 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:53.143536 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:53.175433 23122 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 6.
I20260709 12:10:53.144217 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:53.176352 23123 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:53.130326 25561 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:53.145346 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:53.186328 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:53.186709 23125 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 6.
I20260709 12:10:53.187000 22531 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 6.
I20260709 12:10:53.146485 25584 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:53.147435 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:53.152002 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.152464 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:10:53.190953 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.178061 22496 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:53.144306 25457 raft_consensus.cc:3055] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:53.198359 23125 raft_consensus.cc:1240] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:53.179351 22495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.181983 23123 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 6.
I20260709 12:10:53.183393 25404 consensus_queue.cc:1048] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:53.183622 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:53.183996 23088 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:53.103237 25232 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:53.103298 25574 consensus_queue.cc:1243] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer 6c6fa11e8ee34711b3551f0c670442bc log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:10:53.213526 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:53.192435 22496 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:53.203470 23124 raft_consensus.cc:2410] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:10:53.206396 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:53.214498 22604 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.207875 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:53.215610 22601 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:53.212700 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:53.216408 22600 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.212957 23088 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:10:53.170264 25650 log.cc:927] Time spent T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:10:53.218900 22496 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
W20260709 12:10:53.219502 22495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.220862 22606 raft_consensus.cc:1275] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:53.221771 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:53.223863 23088 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:53.170356 25281 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:53.228902 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:53.235387 22599 raft_consensus.cc:1275] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:53.237984 23088 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:53.239424 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:53.196676 25552 raft_consensus.cc:2804] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:53.246119 23089 leader_election.cc:336] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Timed out: RequestConsensusVote RPC to 127.20.196.131:37785 timed out after 1.530s (SENT)
I20260709 12:10:53.248059 22601 raft_consensus.cc:2410] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 12:10:53.249827 22600 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 7.
I20260709 12:10:53.212761 25404 consensus_queue.cc:1243] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer 1676e7af5e4a47cb86ee7db83e3d4881 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:10:53.196664 25457 raft_consensus.cc:740] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:53.212972 25489 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.196899 25487 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:53.279603 22496 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:53.279628 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:53.280937 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:53.231777 25355 raft_consensus.cc:2804] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:53.220683 25563 raft_consensus.cc:3055] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:53.274439 22605 consensus_queue.cc:237] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:53.233110 25612 raft_consensus.cc:2804] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:53.166569 25521 consensus_queue.cc:237] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:53.229152 25231 raft_consensus.cc:2749] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:53.287181 22523 raft_consensus.cc:1240] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:53.229427 25592 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:53.234700 25412 raft_consensus.cc:2749] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:53.288421 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:53.281296 22601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb7fd922979743428612619e8de33af1"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:10:53.295609 22599 raft_consensus.cc:1240] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:53.296414 22601 raft_consensus.cc:606] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Received request to transfer leadership to TS 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:53.296701 22597 raft_consensus.cc:2393] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 7: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:53.296792 22601 raft_consensus.cc:614] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:53.289624 22496 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:53.278666 25552 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:10:53.293332 22603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45576 (request call id 2378) took 1853 ms (client timeout 2129 ms). Trace:
I20260709 12:10:53.275331 25281 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:53.298319 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:53.298337 22496 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:10:53.304349 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 73848.8us
I20260709 12:10:53.304905 25538 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:53.311437 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:53.312861 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:10:53.324018 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.295820 25612 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:53.301329 22603 rpcz_store.cc:269] 0709 12:10:51.439697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.441986 (+  2289us) service_pool.cc:224] Handling call
0709 12:10:53.293175 (+1851189us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b5400042254. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:53.293277 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2762641152}
I20260709 12:10:53.335906 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:53.337211 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:53.338943 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:53.291152 25355 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.293792 25563 raft_consensus.cc:740] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:53.293538 25610 raft_consensus.cc:2749] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:53.295593 25531 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.299943 25536 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.246003 25561 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:53.316470 25552 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.299893 25554 raft_consensus.cc:2749] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:53.356400 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:53.329749 25612 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.309681 25615 raft_consensus.cc:2804] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:53.360299 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:53.291316 25489 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:53.347954 25355 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.385160 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:53.395877 22524 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
W20260709 12:10:53.396768 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 91723.8us
I20260709 12:10:53.294329 25487 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:53.406141 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:53.408736 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:53.330595 25230 consensus_queue.cc:1059] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 12:10:53.410969 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:53.412765 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:53.412889 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:53.347393 25412 consensus_queue.cc:1059] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:10:53.418968 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:53.419214 23117 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.423038 23088 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:53.416981 22605 raft_consensus.cc:2376] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 7. Re-sending same reply.
I20260709 12:10:53.417532 25592 raft_consensus.cc:697] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 7 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
W20260709 12:10:53.415328 25649 log.cc:927] Time spent T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.322s	user 0.001s	sys 0.000s
I20260709 12:10:53.402787 25615 raft_consensus.cc:697] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:53.438179 25612 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:53.439409 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:53.434676 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:53.475977 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:53.439637 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:53.440768 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:53.477370 23123 raft_consensus.cc:2468] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
I20260709 12:10:53.441154 25419 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:53.448141 25561 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:53.448644 25563 consensus_queue.cc:260] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:53.368643 25536 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:53.512543 25536 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:53.450691 25489 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:10:53.452234 22602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45576 (request call id 2379) took 2012 ms (client timeout 1865 ms). Trace:
W20260709 12:10:53.513398 22602 rpcz_store.cc:269] 0709 12:10:51.439983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.446439 (+  6456us) service_pool.cc:224] Handling call
0709 12:10:53.451958 (+2005519us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54000e9a54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:53.452118 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2730977920}
I20260709 12:10:53.514600 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:53.413970 25404 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:53.455143 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.526801 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:53.527531 22457 raft_consensus.cc:2393] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 7: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:53.458132 22421 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:53.377982 25531 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:53.458732 25499 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.533114 22449 raft_consensus.cc:1240] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:10:53.459926 25609 consensus_queue.cc:1059] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:10:53.463629 25658 log.cc:927] Time spent T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
W20260709 12:10:53.463946 22452 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 613) took 1670 ms (client timeout 1542 ms). Trace:
W20260709 12:10:53.464388 25655 log.cc:927] Time spent T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.255s	user 0.001s	sys 0.000s
W20260709 12:10:53.465420 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.465189 25592 consensus_queue.cc:237] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:53.468799 25529 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.470083 25232 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:53.470934 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:53.558775 23118 raft_consensus.cc:2393] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 6: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
W20260709 12:10:53.472213 25660 log.cc:927] Time spent T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:10:53.472134 25368 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.479429 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:53.481253 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:53.569758 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.569705 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:53.570779 22602 raft_consensus.cc:2410] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:53.571620 23118 raft_consensus.cc:1240] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:10:53.487764 23124 raft_consensus.cc:2393] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 9: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:53.488036 22600 raft_consensus.cc:1240] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:53.476366 22523 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 8.
I20260709 12:10:53.479733 22570 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:53.573632 22523 raft_consensus.cc:1240] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:10:53.491207 23123 raft_consensus.cc:1240] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:53.495414 25612 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:53.495909 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:53.500598 25585 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:53.424801 25554 raft_consensus.cc:3055] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:10:53.502460 25659 log.cc:927] Time spent T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:10:53.502914 22529 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 4.
I20260709 12:10:53.503329 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:53.505031 25419 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:53.506887 22597 raft_consensus.cc:1275] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:53.487946 25202 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:53.507987 22605 raft_consensus.cc:1275] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:10:53.510097 22604 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 7.
I20260709 12:10:53.515440 25457 consensus_queue.cc:260] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:53.452782 25642 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:53.607724 22603 raft_consensus.cc:2393] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 10: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:53.519346 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:53.519942 25412 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:53.520079 25563 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:53.530938 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 72878.4us
I20260709 12:10:53.535866 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:53.611601 22421 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:53.538890 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:10:53.540270 22452 rpcz_store.cc:269] 0709 12:10:51.793256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.837825 (+ 44569us) service_pool.cc:224] Handling call
0709 12:10:53.463652 (+1625827us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400379454. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:53.463822 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2491062016}
I20260709 12:10:53.545954 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:53.493513 25624 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.543502 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:53.552565 22455 raft_consensus.cc:1240] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 7. Current term is 8. Ops: []
W20260709 12:10:53.616153 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 300885us
I20260709 12:10:53.553483 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:53.617130 22456 raft_consensus.cc:2468] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
I20260709 12:10:53.554625 22453 raft_consensus.cc:1240] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:10:53.531495 25561 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.534319 25536 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.579144 22523 raft_consensus.cc:1240] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:53.580139 22569 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
W20260709 12:10:53.582152 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 102489us
I20260709 12:10:53.625128 22598 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
I20260709 12:10:53.539880 25499 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:53.612349 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:53.620105 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:53.621455 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:53.626437 22452 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 6.
I20260709 12:10:53.541388 25404 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:53.587926 25554 raft_consensus.cc:740] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:53.624848 22570 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:53.593447 25538 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.635322 22526 raft_consensus.cc:1240] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:53.632978 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:10:53.637228 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.644624 22528 raft_consensus.cc:1240] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:53.631686 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:53.632958 22600 raft_consensus.cc:1240] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:53.587590 24970 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.650384 22524 raft_consensus.cc:1240] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 LEADER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:10:53.560828 25529 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:53.675274 25585 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:53.659945 22523 raft_consensus.cc:2368] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 6. Current term is 7.
I20260709 12:10:53.678153 25529 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:53.614161 25357 raft_consensus.cc:2804] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:53.679327 22523 raft_consensus.cc:1240] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:53.678925 25554 consensus_queue.cc:260] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:53.680145 24970 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:53.662428 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:53.681357 22454 raft_consensus.cc:2393] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 10: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:53.658531 25457 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:53.682179 24970 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:53.682286 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:53.665010 22497 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:10:53.685065 25640 raft_consensus.cc:2764] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 12:10:53.666464 25535 consensus_meta.cc:287] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.551s	user 0.005s	sys 0.004s
I20260709 12:10:53.686470 22606 raft_consensus.cc:2410] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
W20260709 12:10:53.666697 25663 log.cc:927] Time spent T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:10:53.591790 25489 consensus_queue.cc:1059] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 12:10:53.687973 25489 raft_consensus.cc:3055] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:53.688344 25489 raft_consensus.cc:740] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:53.623131 25615 consensus_queue.cc:237] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:53.689126 25489 consensus_queue.cc:260] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:53.690291 25489 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:53.622923 25624 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:53.691155 22601 raft_consensus.cc:2410] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:10:53.663147 25538 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:53.672474 25499 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:53.672405 25355 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:53.673146 25626 raft_consensus.cc:2764] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:10:53.673822 25559 raft_consensus.cc:2804] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:53.622234 25202 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:53.629104 25561 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:53.707734 25355 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:53.708585 25561 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:53.709458 23124 raft_consensus.cc:1240] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:10:53.628206 25623 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.710340 25623 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:53.675307 25400 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.711755 25400 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:53.676805 22449 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.668398 25404 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:53.633154 25536 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:53.725160 25202 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:53.664520 22524 pending_rounds.cc:85] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting all ops after (but not including) 6
I20260709 12:10:53.726368 22524 pending_rounds.cc:107] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 12:10:53.726765 22524 raft_consensus.cc:2889] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:53.680859 25531 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:53.678871 25529 raft_consensus.cc:2749] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:53.731756 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:53.736083 22454 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:53.692601 25624 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:53.727146 25358 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.729796 25499 raft_consensus.cc:2749] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:53.640313 25552 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:53.727901 25559 raft_consensus.cc:697] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
W20260709 12:10:53.770471 23119 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.018s	sys 0.010s
W20260709 12:10:53.822641 23119 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.018s	sys 0.010s
I20260709 12:10:53.823961 22454 raft_consensus.cc:2410] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:53.824791 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:53.826653 23121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 998) took 2309 ms. Trace:
W20260709 12:10:53.829609 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.810390 25536 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:53.816121 25358 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:53.832985 25358 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:53.835989 25400 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:53.827034 23121 rpcz_store.cc:276] 0709 12:10:51.510675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.510870 (+   195us) service_pool.cc:224] Handling call
0709 12:10:51.741224 (+230354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:51.752307 (+ 11083us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.820137 (+2067830us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b5400212ad0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:53.820267 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":491186048}
I20260709 12:10:53.844609 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:53.845453 22454 raft_consensus.cc:2393] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 8: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
W20260709 12:10:53.849706 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 224922us
I20260709 12:10:53.784070 25561 consensus_queue.cc:1059] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 12:10:53.822461 25624 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:53.865124 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:53.861382 22570 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:53.866271 22601 raft_consensus.cc:2410] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:53.870215 22525 raft_consensus.cc:1240] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 LEADER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:10:53.863430 25358 consensus_queue.cc:1059] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:10:53.882387 23117 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
I20260709 12:10:53.886346 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:53.888891 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:53.889710 22601 raft_consensus.cc:2393] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 7: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:53.877252 25404 consensus_queue.cc:1059] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:10:53.877118 25626 consensus_queue.cc:1059] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 12:10:53.873771 25576 raft_consensus.cc:2749] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:53.893296 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.894770 23121 raft_consensus.cc:1275] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:53.895983 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:53.896639 23117 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
I20260709 12:10:53.899870 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:53.900949 23117 raft_consensus.cc:1275] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:53.905336 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:53.906266 22601 raft_consensus.cc:2410] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 12:10:53.884900 25575 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.555s	user 0.031s	sys 0.024s
W20260709 12:10:53.907323 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:53.918229 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 306676us
I20260709 12:10:53.918687 22570 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:53.919008 22421 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:53.920576 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:53.921276 22600 raft_consensus.cc:1813] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Handling vote request from an unknown peer c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:53.922021 22600 raft_consensus.cc:2410] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:10:53.874351 25368 consensus_queue.cc:1059] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:10:53.870846 25624 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:53.924700 25404 raft_consensus.cc:3055] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:53.885511 25559 consensus_queue.cc:237] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:53.943755 22450 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
mode: GRACEFUL
new_leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:44568
I20260709 12:10:53.944346 22450 raft_consensus.cc:606] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Received request to transfer leadership to TS 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:53.944669 22450 raft_consensus.cc:614] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:53.929493 25400 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.945571 22526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 629) took 1076 ms. Trace:
I20260709 12:10:53.945930 22526 rpcz_store.cc:276] 0709 12:10:52.869080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.126846 (+257766us) service_pool.cc:224] Handling call
0709 12:10:53.132374 (+  5528us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:53.635695 (+503321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.945357 (+309662us) spinlock_profiling.cc:243] Waited 503 ms on lock 0x7b540030f2d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:53.945518 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1156258688}
I20260709 12:10:53.945953 25400 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:53.947084 22527 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56940 (request call id 1960) took 2034 ms (client timeout 1623 ms). Trace:
I20260709 12:10:53.947324 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:53.947463 22527 rpcz_store.cc:269] 0709 12:10:51.913189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.119467 (+206278us) service_pool.cc:224] Handling call
0709 12:10:53.946859 (+1827392us) spinlock_profiling.cc:243] Waited 737 ms on lock 0x7b54004010d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:53.947012 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1694262144}
I20260709 12:10:53.947912 22526 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
I20260709 12:10:53.948604 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:53.948815 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:53.949370 22526 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:10:53.950321 22526 raft_consensus.cc:1240] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:53.932286 25552 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:53.950678 22570 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:53.951601 25558 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:53.952292 22530 raft_consensus.cc:1240] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:53.952536 22531 raft_consensus.cc:1240] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:53.953536 22530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 622) took 1107 ms. Trace:
I20260709 12:10:53.953938 22526 pending_rounds.cc:85] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting all ops after (but not including) 5
I20260709 12:10:53.954270 22526 pending_rounds.cc:107] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:10:53.954555 22526 raft_consensus.cc:2889] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:53.908449 25642 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:53.958577 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 378532us
I20260709 12:10:53.948819 25400 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:53.939066 25576 raft_consensus.cc:3055] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:10:53.920611 25575 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.635s	user 0.031s	sys 0.025s
I20260709 12:10:53.953889 22530 rpcz_store.cc:276] 0709 12:10:52.845692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.948211 (+102519us) service_pool.cc:224] Handling call
0709 12:10:53.952093 (+1003882us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:53.952634 (+   541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.953377 (+   743us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54004010d0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:53.953489 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2308130560}
I20260709 12:10:53.958904 25626 raft_consensus.cc:2804] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:53.941668 25404 raft_consensus.cc:740] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:53.959920 22531 raft_consensus.cc:1240] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:10:53.970302 22449 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
I20260709 12:10:53.957667 22570 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
W20260709 12:10:53.975270 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 84217.1us
I20260709 12:10:53.958690 25368 raft_consensus.cc:3055] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:10:53.978690 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 59764.5us
W20260709 12:10:53.980060 23088 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.026s	sys 0.006s
W20260709 12:10:54.003386 23088 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.026s	sys 0.006s
W20260709 12:10:54.004233 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 581270us
I20260709 12:10:54.005205 23088 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:53.980369 22527 raft_consensus.cc:1240] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 LEADER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:53.972575 22569 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
W20260709 12:10:53.982452 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:54.007511 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.009467 22606 pending_rounds.cc:85] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc: Aborting all ops after (but not including) 2
I20260709 12:10:54.009773 22606 pending_rounds.cc:107] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:10:54.010004 22606 raft_consensus.cc:2889] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:54.015007 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:10:54.021344 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:54.025146 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.010085 22422 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:53.971472 25576 raft_consensus.cc:740] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
W20260709 12:10:53.979285 25521 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.013s	sys 0.020s
I20260709 12:10:54.033313 22454 raft_consensus.cc:1275] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:54.039009 22450 raft_consensus.cc:1275] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:54.041656 22454 raft_consensus.cc:1275] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:54.027475 25679 raft_consensus.cc:2804] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:54.042918 25679 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.043330 25679 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:54.043830 22421 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:54.044592 25624 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:54.044991 22421 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:54.045115 25624 consensus_queue.cc:1059] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:10:54.046027 25676 raft_consensus.cc:2804] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:54.046363 25531 raft_consensus.cc:2804] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:54.046504 25676 raft_consensus.cc:697] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 5 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:54.047361 25499 raft_consensus.cc:3055] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:54.047745 25499 raft_consensus.cc:740] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:54.047492 25676 consensus_queue.cc:237] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:54.048499 25499 consensus_queue.cc:260] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:54.049623 25499 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.051147 25536 consensus_queue.cc:1048] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:54.052145 22421 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:54.046861 25531 raft_consensus.cc:697] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 6 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:54.053743 25531 consensus_queue.cc:237] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:54.032364 25521 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.013s	sys 0.020s
I20260709 12:10:54.056775 25678 raft_consensus.cc:2804] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:54.057204 25678 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.057520 25678 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:54.062701 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:54.063431 22450 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:54.068593 23117 raft_consensus.cc:1240] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:54.003095 25368 raft_consensus.cc:740] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:54.081442 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:54.085184 22532 raft_consensus.cc:1240] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 LEADER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:54.086598 22454 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.072130 25624 raft_consensus.cc:2749] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:54.143867 22450 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 6.
I20260709 12:10:54.151747 22454 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7.
I20260709 12:10:54.153559 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:54.155395 22450 raft_consensus.cc:1275] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:54.156550 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:54.113399 25677 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:54.070848 25404 consensus_queue.cc:260] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:54.223961 22450 raft_consensus.cc:1275] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:10:54.220319 25677 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.225862 22454 raft_consensus.cc:2410] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 12:10:54.221554 25669 log.cc:927] Time spent T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
W20260709 12:10:54.227531 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 217564us
W20260709 12:10:54.304034 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 251943us
I20260709 12:10:54.141739 25368 consensus_queue.cc:260] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:54.235632 25677 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.311616 25368 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.313936 25487 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:54.314438 22454 raft_consensus.cc:1240] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:54.348678 25531 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.349256 25531 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:54.349716 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 12:10:54.316778 25682 log.cc:927] Time spent T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
I20260709 12:10:54.322134 24970 raft_consensus.cc:2804] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:54.360502 22454 raft_consensus.cc:1275] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:54.361616 22450 raft_consensus.cc:1240] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:54.327848 25674 log.cc:927] Time spent T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 12:10:54.330385 22529 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56940 (request call id 1957) took 2466 ms (client timeout 1610 ms). Trace:
W20260709 12:10:54.370138 22529 rpcz_store.cc:269] 0709 12:10:51.864471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.882288 (+ 17817us) service_pool.cc:224] Handling call
0709 12:10:54.330170 (+2447882us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b5400263754. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:54.330293 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3724717312}
I20260709 12:10:54.331915 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:54.333364 25673 log.cc:927] Time spent T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 12:10:54.142925 25576 consensus_queue.cc:260] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:54.222324 25675 consensus_queue.cc:1059] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.090s
I20260709 12:10:54.299933 25624 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.303687 25437 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.304920 25404 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:54.363337 22450 raft_consensus.cc:1240] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:54.364377 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:54.368415 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:54.242519 25559 consensus_queue.cc:1059] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.100s
I20260709 12:10:54.376649 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:54.408468 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.464464 22603 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 7.
I20260709 12:10:54.462852 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:54.463560 22454 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 5.
I20260709 12:10:54.386379 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:54.488317 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:54.369074 25683 log.cc:927] Time spent T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
W20260709 12:10:54.478502 25696 log.cc:927] Time spent T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 12:10:54.367228 24970 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.465042 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:54.491638 23119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 649) took 1505 ms. Trace:
W20260709 12:10:54.436599 25680 log.cc:927] Time spent T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.286s	user 0.000s	sys 0.001s
W20260709 12:10:54.381172 25668 log.cc:927] Time spent T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:10:54.369552 25626 raft_consensus.cc:697] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:54.466746 25576 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:54.465689 25531 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:54.499348 22450 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 6.
I20260709 12:10:54.498085 23119 rpcz_store.cc:276] 0709 12:10:52.985997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.986134 (+   137us) service_pool.cc:224] Handling call
0709 12:10:53.006729 (+ 20595us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:53.012296 (+  5567us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:53.012326 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:53.012882 (+   556us) log.cc:844] Serialized 52 byte log entry
0709 12:10:53.823227 (+810345us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:53.823285 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.823374 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:54.491439 (+668065us) raft_consensus.cc:1685] finished
0709 12:10:54.491457 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:54.491583 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":802,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":68,"thread_start_us":753445,"threads_started":1,"wal-append.queue_time_us":990341}
W20260709 12:10:54.499743 22570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.006s	sys 0.023s
W20260709 12:10:54.510758 22570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.006s	sys 0.024s
I20260709 12:10:54.376798 25611 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:10:54.505424 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.489423 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:54.511686 22450 raft_consensus.cc:1275] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:10:54.532683 22454 raft_consensus.cc:2393] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 9: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
W20260709 12:10:54.511411 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 521480us
I20260709 12:10:54.490411 25676 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:10:54.546403 22526 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.009s	sys 0.013s
W20260709 12:10:54.549296 22526 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.009s	sys 0.013s
I20260709 12:10:54.548738 22451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1653) took 1022 ms. Trace:
I20260709 12:10:54.547911 22450 raft_consensus.cc:1275] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:10:54.554040 22569 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.031s	sys 0.042s
W20260709 12:10:54.554431 22569 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.031s	sys 0.042s
W20260709 12:10:54.552470 22601 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.006s	sys 0.003s
W20260709 12:10:54.554955 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 582452us
I20260709 12:10:54.551172 22451 rpcz_store.cc:276] 0709 12:10:53.526221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.535751 (+  9530us) service_pool.cc:224] Handling call
0709 12:10:53.536007 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:53.536213 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:53.555813 (+ 19600us) log.cc:844] Serialized 14 byte log entry
0709 12:10:54.332018 (+776205us) spinlock_profiling.cc:243] Waited 3.66 ms on lock 0x7b18003cf040. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc7823e07 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc7840c02 00007f9cca4c820b 00007f9cca4cdd23 00007f9cca4ce23a 00007f9cca938a2a
0709 12:10:54.548418 (+216400us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:54.548467 (+    49us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:54.548519 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.548584 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:54.548686 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":19404,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":4820,"raft.queue_time_us":3765,"spinlock_wait_cycles":8426752,"thread_start_us":214198,"threads_started":1}
I20260709 12:10:54.513271 22422 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:10:54.555132 22601 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.006s	sys 0.003s
W20260709 12:10:54.560053 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.561198 22569 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:10:54.544732 25676 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:54.561678 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:54.562244 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.563865 25676 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:54.537976 25611 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:54.560114 25701 log.cc:927] Time spent T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:10:54.567595 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:54.566684 25611 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:54.498970 24970 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.487239 25624 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:54.450830 25487 raft_consensus.cc:3055] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:54.514798 25202 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.572213 25233 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:54.580544 23120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 1022) took 1145 ms. Trace:
I20260709 12:10:54.550351 25697 consensus_queue.cc:1059] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:10:54.592558 23120 rpcz_store.cc:276] 0709 12:10:53.435525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.622764 (+187239us) service_pool.cc:224] Handling call
0709 12:10:53.659675 (+ 36911us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:53.659946 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:53.659971 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:53.692341 (+ 32370us) log.cc:844] Serialized 26 byte log entry
0709 12:10:54.030511 (+338170us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:54.030555 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.030638 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:54.580270 (+549632us) raft_consensus.cc:1685] finished
0709 12:10:54.580294 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:54.580459 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":337820,"threads_started":1,"wal-append.queue_time_us":449076}
W20260709 12:10:54.599622 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 86456.4us
I20260709 12:10:54.485695 25437 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:54.589501 25412 consensus_meta.cc:287] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.970s	user 0.005s	sys 0.006s
W20260709 12:10:54.592245 25693 log.cc:927] Time spent T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:10:54.591558 25266 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:54.590189 25624 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:54.580571 25487 raft_consensus.cc:740] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:54.605674 25692 raft_consensus.cc:2749] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:54.601020 25233 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:54.616384 25412 raft_consensus.cc:2749] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:54.605531 25676 consensus_queue.cc:1048] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:10:54.581270 25626 consensus_queue.cc:237] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:54.648651 25697 raft_consensus.cc:2804] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:10:54.669837 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 108715us
W20260709 12:10:54.662917 25499 consensus_meta.cc:287] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.613s	user 0.012s	sys 0.000s
W20260709 12:10:54.679538 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 78956.3us
I20260709 12:10:54.681524 22569 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:54.683842 22422 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:54.606199 25202 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:54.735096 25202 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:54.708690 25499 raft_consensus.cc:2749] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:54.736236 22451 raft_consensus.cc:2468] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 6.
I20260709 12:10:54.738039 25711 raft_consensus.cc:2749] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:54.715078 25531 consensus_queue.cc:1059] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:54.743641 25531 raft_consensus.cc:3055] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:54.744009 25531 raft_consensus.cc:740] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:54.744853 25531 consensus_queue.cc:260] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:54.723830 25704 log.cc:927] Time spent T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:10:54.679111 25487 consensus_queue.cc:260] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:54.682868 25695 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.726425 25437 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:54.727838 25576 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:54.728222 25489 consensus_meta.cc:287] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 1.037s	user 0.011s	sys 0.003s
I20260709 12:10:54.728083 22422 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:54.709146 25692 consensus_queue.cc:1048] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
W20260709 12:10:54.731870 25679 consensus_meta.cc:287] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.688s	user 0.010s	sys 0.000s
I20260709 12:10:54.732247 25542 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.748245 22526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1617) took 1200 ms. Trace:
I20260709 12:10:54.770705 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:54.770787 22526 rpcz_store.cc:276] 0709 12:10:53.547434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.953418 (+405984us) service_pool.cc:224] Handling call
0709 12:10:53.953726 (+   308us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:10:53.958269 (+  4543us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:53.958299 (+    30us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:10:53.958943 (+   644us) log.cc:844] Serialized 78 byte log entry
0709 12:10:54.550644 (+591701us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:54.550686 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.550750 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:54.747991 (+197241us) raft_consensus.cc:1685] finished
0709 12:10:54.748015 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:54.748180 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2767,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"thread_start_us":523763,"threads_started":1,"wal-append.queue_time_us":674495}
I20260709 12:10:54.772786 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:10:54.754482 25706 log.cc:927] Time spent T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:10:54.773545 22600 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:54.760396 25624 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.755069 25695 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:54.774436 25624 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:54.746182 25531 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:54.775641 22604 raft_consensus.cc:1275] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:54.776733 25624 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:54.762166 25542 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:54.762382 25679 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:54.779119 25584 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:54.779680 25584 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:54.781399 25679 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:54.774670 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:54.782562 25584 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:54.783047 25558 raft_consensus.cc:2764] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 12:10:54.758327 25202 raft_consensus.cc:2804] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:54.784758 25689 log.cc:927] Time spent T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
I20260709 12:10:54.783663 25611 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.785061 25202 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.785442 25202 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:54.785315 25611 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:54.787070 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:54.787364 25611 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:54.755756 25576 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:54.764604 25577 raft_consensus.cc:3055] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:54.788863 25577 raft_consensus.cc:740] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:54.769883 22601 raft_consensus.cc:1275] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:10:54.770182 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:54.776754 22597 raft_consensus.cc:3055] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:54.791280 22603 raft_consensus.cc:2393] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 10: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:54.791484 22597 raft_consensus.cc:740] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:54.789642 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:54.792292 22597 consensus_queue.cc:260] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:54.789656 25577 consensus_queue.cc:260] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:54.793378 22597 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:54.793794 25617 consensus_queue.cc:1048] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:54.768415 22452 raft_consensus.cc:1240] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:10:54.793825 25577 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.796907 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:54.797644 22603 raft_consensus.cc:2393] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 8: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:54.797930 22525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1597) took 3035 ms. Trace:
I20260709 12:10:54.798496 22605 pending_rounds.cc:85] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc: Aborting all ops after (but not including) 5
I20260709 12:10:54.798875 22605 pending_rounds.cc:107] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 12:10:54.798419 25202 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:54.799292 25617 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.799902 25617 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:54.801430 25202 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:54.799131 22605 raft_consensus.cc:2889] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:54.802847 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:54.803743 22452 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7.
I20260709 12:10:54.804940 25617 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:54.807145 25617 consensus_queue.cc:1048] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:54.810385 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:54.798439 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:54.811337 22601 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
I20260709 12:10:54.813792 22601 raft_consensus.cc:1275] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:10:54.814181 22601 pending_rounds.cc:85] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc: Aborting all ops after (but not including) 4
I20260709 12:10:54.814440 22601 pending_rounds.cc:107] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:10:54.814718 22601 raft_consensus.cc:2889] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:54.816519 22497 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:54.817535 25521 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:54.818032 25521 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.818480 25521 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:10:54.818775 25653 log.cc:927] Time spent T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 1.519s	user 0.000s	sys 0.012s
W20260709 12:10:54.823800 25688 log.cc:927] Time spent T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.455s	user 0.002s	sys 0.000s
I20260709 12:10:54.824267 25489 consensus_queue.cc:1048] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:54.826273 25489 consensus_queue.cc:1048] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:54.831622 25592 raft_consensus.cc:3055] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:54.832163 25592 raft_consensus.cc:740] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:54.798333 22525 rpcz_store.cc:276] 0709 12:10:51.762373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.775043 (+ 12670us) service_pool.cc:224] Handling call
0709 12:10:51.775458 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:53.873353 (+2097895us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.797684 (+924331us) spinlock_profiling.cc:243] Waited 2.09 s on lock 0x7b540030f7d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:54.797850 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4816807296}
I20260709 12:10:54.832999 25592 consensus_queue.cc:260] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:54.710659 25563 consensus_meta.cc:287] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 1.089s	user 0.013s	sys 0.000s
I20260709 12:10:54.834156 25592 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:54.835434 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 830272us
W20260709 12:10:54.835798 25662 log.cc:927] Time spent T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 1.406s	user 0.003s	sys 0.007s
I20260709 12:10:54.838524 23088 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:10:54.840365 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:54.840778 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.842687 25665 raft_consensus.cc:2749] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:54.843406 25665 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.843825 25665 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:54.835803 25678 consensus_meta.cc:287] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.778s	user 0.005s	sys 0.007s
I20260709 12:10:54.845963 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:54.846017 22448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 624) took 1978 ms. Trace:
I20260709 12:10:54.847302 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:54.848376 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:54.848870 22597 raft_consensus.cc:1275] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:54.849174 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:54.849742 25357 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.850294 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:54.851372 25281 consensus_queue.cc:1059] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:54.852236 25281 raft_consensus.cc:3055] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:54.852574 25281 raft_consensus.cc:740] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:54.853400 25281 consensus_queue.cc:260] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:54.854615 25281 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:54.826841 22527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1610) took 1504 ms. Trace:
I20260709 12:10:54.831709 25457 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:54.855470 25665 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:54.830572 22524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1606) took 1509 ms. Trace:
I20260709 12:10:54.856629 23122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 660) took 1710 ms. Trace:
I20260709 12:10:54.850299 25357 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:54.829749 23116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 647) took 3099 ms. Trace:
I20260709 12:10:54.859654 23118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 1018) took 1480 ms. Trace:
I20260709 12:10:54.860093 23118 rpcz_store.cc:276] 0709 12:10:53.378797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.578307 (+199510us) service_pool.cc:224] Handling call
0709 12:10:53.578546 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:53.578731 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:54.094356 (+515625us) log.cc:844] Serialized 14 byte log entry
0709 12:10:54.859203 (+764847us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:54.859272 (+    69us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:54.859342 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.859429 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:54.859581 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":753919,"prepare.queue_time_us":325016,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":66,"thread_start_us":525542,"threads_started":2,"wal-append.queue_time_us":543162}
I20260709 12:10:54.857151 23123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 1019) took 1443 ms. Trace:
I20260709 12:10:54.862082 23123 rpcz_store.cc:276] 0709 12:10:53.413471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.574488 (+161017us) service_pool.cc:224] Handling call
0709 12:10:53.574736 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:53.574933 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:10:54.089390 (+514457us) log.cc:844] Serialized 14 byte log entry
0709 12:10:54.856821 (+767431us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:54.856869 (+    48us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:10:54.856909 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.856971 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:54.857086 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":544520,"prepare.queue_time_us":300040,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":1036,"raft.queue_time_us":303168,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":72,"thread_start_us":718420,"threads_started":2,"wal-append.queue_time_us":517934}
I20260709 12:10:54.863317 22529 raft_consensus.cc:1275] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:54.847095 22448 rpcz_store.cc:276] 0709 12:10:52.867580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.905220 (+ 37640us) service_pool.cc:224] Handling call
0709 12:10:52.927614 (+ 22394us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:52.928090 (+   476us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:53.080310 (+152220us) log.cc:844] Serialized 14 byte log entry
0709 12:10:53.287731 (+207421us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:53.300675 (+ 12944us) log.cc:844] Serialized 52 byte log entry
0709 12:10:53.300834 (+   159us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:53.301042 (+   208us) log.cc:844] Serialized 14 byte log entry
0709 12:10:53.301228 (+   186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.301291 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:54.835210 (+1533919us) spinlock_profiling.cc:243] Waited 58.7 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:10:54.845820 (+ 10610us) raft_consensus.cc:1685] finished
0709 12:10:54.845841 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:54.845962 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24025,"prepare.queue_time_us":50506,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":66,"raft.queue_time_us":492,"raft.run_cpu_time_us":309,"raft.run_wall_time_us":5163,"spinlock_wait_cycles":135053568,"thread_start_us":299524,"threads_started":2,"wal-append.queue_time_us":305066}
I20260709 12:10:54.855942 25457 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:54.855952 22598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45576 (request call id 2403) took 1801 ms. Trace:
I20260709 12:10:54.866562 22529 raft_consensus.cc:1240] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:54.849340 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.868216 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:54.848891 22530 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 7.
I20260709 12:10:54.856772 22524 rpcz_store.cc:276] 0709 12:10:53.321562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.663760 (+342198us) service_pool.cc:224] Handling call
0709 12:10:53.664069 (+   309us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:53.783593 (+119524us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:53.783637 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:53.784416 (+   779us) log.cc:844] Serialized 52 byte log entry
0709 12:10:54.093538 (+309122us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:54.093577 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.093638 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:54.823166 (+729528us) spinlock_profiling.cc:243] Waited 67.8 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:10:54.830168 (+  7002us) raft_consensus.cc:1685] finished
0709 12:10:54.830196 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:54.830500 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1829,"raft.queue_time_us":88,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":26060,"spinlock_wait_cycles":156041472,"thread_start_us":240936,"threads_started":1,"wal-append.queue_time_us":428665}
I20260709 12:10:54.870383 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:54.872758 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:54.868896 23124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 1020) took 1444 ms. Trace:
I20260709 12:10:54.874562 22600 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 6.
I20260709 12:10:54.874696 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:54.855118 22527 rpcz_store.cc:276] 0709 12:10:53.322503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.949468 (+626965us) service_pool.cc:224] Handling call
0709 12:10:53.949741 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.006261 (+ 56520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.826603 (+820342us) spinlock_profiling.cc:243] Waited 30.1 ms on lock 0x7b5400262354. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:54.826784 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":69208320}
I20260709 12:10:54.876348 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:54.857126 23122 rpcz_store.cc:276] 0709 12:10:53.146547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.187818 (+ 41271us) service_pool.cc:224] Handling call
0709 12:10:53.225060 (+ 37242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:53.225255 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:10:54.070880 (+845625us) log.cc:844] Serialized 14 byte log entry
0709 12:10:54.856247 (+785367us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:54.856305 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:10:54.856367 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.856441 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:54.856566 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1185540,"prepare.queue_time_us":643164,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":619355,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"thread_start_us":420122,"threads_started":2,"wal-append.queue_time_us":376186}
W20260709 12:10:54.877810 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 61397.8us
I20260709 12:10:54.873059 22602 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 8.
I20260709 12:10:54.873888 23124 rpcz_store.cc:276] 0709 12:10:53.424769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.575594 (+150825us) service_pool.cc:224] Handling call
0709 12:10:53.575985 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:53.709935 (+133950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.868679 (+1158744us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b540074fc54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:54.868838 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":306248960}
I20260709 12:10:54.866959 22598 rpcz_store.cc:276] 0709 12:10:53.054238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.057623 (+  3385us) service_pool.cc:224] Handling call
0709 12:10:54.855726 (+1798103us) spinlock_profiling.cc:243] Waited 559 ms on lock 0x7b54003ae8d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:54.855869 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1286842240}
I20260709 12:10:54.884140 22497 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:54.885555 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:54.886520 22526 raft_consensus.cc:2393] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 7: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:54.887388 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:54.887827 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:54.888579 23118 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5.
I20260709 12:10:54.888196 23124 raft_consensus.cc:2410] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:54.891559 22531 raft_consensus.cc:2410] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:10:54.888739 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:10:54.892086 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 53628.6us
I20260709 12:10:54.893018 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:54.893644 22598 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 7.
I20260709 12:10:54.894097 22601 raft_consensus.cc:1275] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:54.868420 25457 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:54.900071 23125 raft_consensus.cc:2393] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 8: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:54.900437 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:54.900612 25412 raft_consensus.cc:2804] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:54.901005 22597 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:54.901103 25412 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:54.901435 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:54.901731 25412 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.902159 23122 raft_consensus.cc:2393] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 7: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:54.903137 25671 consensus_queue.cc:1059] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:54.903493 25575 consensus_queue.cc:1048] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:10:54.893303 25711 consensus_queue.cc:1048] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:10:54.882161 25611 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.905166 25611 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:54.859038 23116 rpcz_store.cc:276] 0709 12:10:51.730805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.160376 (+429571us) service_pool.cc:224] Handling call
0709 12:10:52.237471 (+ 77095us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:52.237939 (+   468us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:52.494125 (+256186us) log.cc:844] Serialized 14 byte log entry
0709 12:10:53.055169 (+561044us) spinlock_profiling.cc:243] Waited 38.7 ms on lock 0x7b18002f7ca0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc7841522 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd 0000000000388634 0000000000388479 00007f9cc782483a
0709 12:10:53.735842 (+680673us) spinlock_profiling.cc:243] Waited 6.82 ms on lock 0x7b18002f7ca0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc77bbc0a 00007f9cd0efb219 00007f9cc7843a40 00007f9cc783e4e4 00007f9cc783e455 00007f9cce3263c7 00007f9cca9389a7 00007f9cca9480bf 00007f9cca948038
0709 12:10:53.770888 (+ 35046us) log.cc:844] Serialized 14 byte log entry
0709 12:10:54.829119 (+1058231us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b18002f7ca0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc77bbc0a 00007f9cd0efb219 00007f9cc7843a40 00007f9cc783e4e4 00007f9cc783e455 00007f9cca926060 00007f9cca938716 00007f9cca949287 00007f9cca949208
0709 12:10:54.829294 (+   175us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:54.829360 (+    66us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:54.829430 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.829529 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:54.829681 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":751415,"prepare.queue_time_us":1611507,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":1501,"raft.queue_time_us":1063819,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":11363,"spinlock_wait_cycles":150768512,"thread_start_us":389158,"threads_started":2,"wal-append.queue_time_us":255205,"wal-append.run_cpu_time_us":1030,"wal-append.run_wall_time_us":1020325}
I20260709 12:10:54.907271 25404 consensus_queue.cc:1059] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:54.908353 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:10:54.909655 23089 connection.cc:256] RPC call timeout handler was delayed by -1.3994243140000435s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25920000000000004s for a response
I20260709 12:10:54.901048 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:54.911240 23123 raft_consensus.cc:1813] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Handling vote request from an unknown peer c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:54.911701 23123 raft_consensus.cc:2393] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 7: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
W20260709 12:10:54.912307 23089 connection.cc:256] RPC call timeout handler was delayed by -1.0081882249999126s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31170000000000003s for a response
I20260709 12:10:54.907527 25611 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:54.925841 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.925951 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:54.930441 23123 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 6.
I20260709 12:10:54.913416 25667 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.932721 25667 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:54.934139 25677 consensus_meta.cc:287] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.572s	user 0.010s	sys 0.001s
I20260709 12:10:54.882874 25678 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:54.937050 25230 consensus_queue.cc:1048] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:10:54.937639 25678 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:54.938472 25667 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:54.941054 25671 consensus_queue.cc:1059] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:54.941871 25671 raft_consensus.cc:3055] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:54.942173 25671 raft_consensus.cc:740] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:54.945230 23118 raft_consensus.cc:1275] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:54.949208 23119 raft_consensus.cc:1240] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:54.948475 23124 raft_consensus.cc:1275] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:10:54.952219 23124 pending_rounds.cc:85] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270: Aborting all ops after (but not including) 6
I20260709 12:10:54.952481 23124 pending_rounds.cc:107] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:10:54.952744 23124 raft_consensus.cc:2889] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:54.949819 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:54.953527 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:54.953789 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:54.943821 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:54.954475 23124 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7.
I20260709 12:10:54.955410 22600 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 8: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:54.958702 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:54.959502 23124 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:54.960086 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 76014.7us
I20260709 12:10:54.951876 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:54.934571 25677 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:54.962880 22528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 634) took 2056 ms. Trace:
I20260709 12:10:54.979331 23089 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:10:54.966929 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 490426us
I20260709 12:10:54.965792 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:54.988914 22526 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:54.928268 22597 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 8.
I20260709 12:10:54.983752 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:54.983405 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:54.943269 25457 raft_consensus.cc:3055] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:54.993701 22421 leader_election.cc:400] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 election: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 6. Current term is 7.
I20260709 12:10:54.994304 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:55.004149 22421 leader_election.cc:403] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:10:55.010836 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:55.011628 23116 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:54.983752 25704 log.cc:927] Time spent T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:10:54.986104 25231 raft_consensus.cc:2804] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:54.985133 25642 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.985353 25584 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.016641 22421 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:55.029820 22421 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:55.034112 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:55.034931 22525 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.993185 25670 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.002758 25665 raft_consensus.cc:2749] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:55.078367 22606 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.058s	sys 0.098s
I20260709 12:10:54.999737 22497 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:55.002184 23118 raft_consensus.cc:2393] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 6: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:54.949404 25561 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.079619 25561 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:55.080189 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:55.070050 25536 raft_consensus.cc:2749] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:55.081027 23118 raft_consensus.cc:2410] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:55.003065 23124 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:10:54.962172 25559 consensus_queue.cc:1059] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.057s
W20260709 12:10:55.037949 22449 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1660) took 1510 ms (client timeout 1979 ms). Trace:
W20260709 12:10:55.097491 22449 rpcz_store.cc:269] 0709 12:10:53.527910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.619868 (+ 91958us) service_pool.cc:224] Handling call
0709 12:10:55.037710 (+1417842us) spinlock_profiling.cc:243] Waited 50.7 ms on lock 0x7b54003f39d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:55.037871 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116711296}
I20260709 12:10:55.048353 25233 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:55.051759 25695 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:55.068653 25542 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:54.962888 25678 consensus_queue.cc:1048] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 12:10:54.979979 22528 rpcz_store.cc:276] 0709 12:10:52.906033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.137792 (+231759us) service_pool.cc:224] Handling call
0709 12:10:53.138064 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:53.645091 (+507027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.962658 (+1317567us) spinlock_profiling.cc:243] Waited 506 ms on lock 0x7b54004001d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:54.962813 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1164456704}
I20260709 12:10:55.082113 23118 raft_consensus.cc:1275] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:55.003717 25457 raft_consensus.cc:740] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:55.082573 23124 raft_consensus.cc:1275] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:55.037670 25202 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:10:55.083493 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 53745.5us
I20260709 12:10:55.141330 22421 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:55.013347 25529 raft_consensus.cc:2749] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 6. Current term is 7.
W20260709 12:10:55.078830 22606 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.059s	sys 0.099s
I20260709 12:10:54.984797 25667 consensus_queue.cc:1048] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
W20260709 12:10:55.097033 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 97407.9us
I20260709 12:10:55.117573 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:54.942677 25357 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:54.962369 25671 consensus_queue.cc:260] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:55.024925 25489 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:55.084846 25702 log.cc:927] Time spent T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.399s	user 0.000s	sys 0.001s
I20260709 12:10:54.993471 24970 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:55.083519 25642 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:55.136365 25704 log.cc:927] Time spent T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
W20260709 12:10:55.223608 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.216610 22422 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:55.197916 23121 raft_consensus.cc:1275] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:10:55.149744 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 468288us
I20260709 12:10:55.138926 23124 raft_consensus.cc:3055] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:55.238240 23124 raft_consensus.cc:740] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:55.238792 22569 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:54.943332 25521 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:55.083416 25231 raft_consensus.cc:697] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:55.120059 25665 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:10:55.262161 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.201112 23120 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 8.
I20260709 12:10:55.119467 25230 raft_consensus.cc:2804] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:55.239527 22422 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:55.113672 25536 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.241595 22569 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:10:55.269380 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:55.270105 23121 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:55.270287 22569 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:55.151547 22421 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:10:55.242772 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.117269 25576 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:55.264597 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:55.273242 22526 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:10:55.274925 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:55.255487 22525 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
I20260709 12:10:55.234822 23116 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7.
W20260709 12:10:55.250449 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 87198.6us
W20260709 12:10:55.277055 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 125609us
I20260709 12:10:55.239248 23124 consensus_queue.cc:260] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:55.261149 22450 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
I20260709 12:10:55.140388 25233 raft_consensus.cc:3055] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:55.248641 25529 raft_consensus.cc:2804] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:55.082183 25584 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:55.070204 25677 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:55.278843 23124 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.283452 22523 raft_consensus.cc:1240] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:55.164976 25542 raft_consensus.cc:2749] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:55.290145 22422 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:55.291383 22569 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:55.257464 25577 raft_consensus.cc:2749] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:55.208923 25538 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:55.293037 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:55.183975 25561 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:55.331895 23117 raft_consensus.cc:2410] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:55.098754 25670 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:55.225654 25357 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:55.294690 22525 raft_consensus.cc:1240] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:55.294678 22598 raft_consensus.cc:1275] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:55.322665 22569 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:55.249012 25505 consensus_queue.cc:1048] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:10:55.305383 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:55.285426 25558 raft_consensus.cc:2749] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:55.328562 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 444483us
I20260709 12:10:55.358455 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:55.259033 25489 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:55.265280 25565 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:55.165856 25202 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:55.267179 25230 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:55.179036 25457 consensus_queue.cc:260] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:55.305730 22570 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:55.344393 22449 raft_consensus.cc:1275] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:55.345065 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:55.346215 22453 raft_consensus.cc:1240] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 6 LEADER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:55.350162 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:55.351052 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:55.285123 25710 raft_consensus.cc:2804] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:55.359000 22495 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:55.324774 25697 raft_consensus.cc:697] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:55.374622 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:55.380321 22448 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 8: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:55.375087 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:55.380942 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 75270.2us
I20260709 12:10:55.339268 25538 raft_consensus.cc:2749] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:55.357582 25542 raft_consensus.cc:2804] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:55.295250 25576 raft_consensus.cc:2749] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:55.292846 25529 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:55.333626 25368 consensus_meta.cc:287] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.979s	user 0.010s	sys 0.001s
I20260709 12:10:55.365088 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:55.392364 22598 raft_consensus.cc:2410] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 12:10:55.371842 25577 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.286067 25233 raft_consensus.cc:740] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:55.379639 25558 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:55.324405 25358 raft_consensus.cc:2749] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:55.334717 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:55.423729 22526 raft_consensus.cc:2393] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 7: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
W20260709 12:10:55.372439 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 393148us
I20260709 12:10:55.284478 25412 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:55.272970 25665 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:55.381078 22529 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 6.
I20260709 12:10:55.427520 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:55.328979 22605 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.026s	sys 0.057s
W20260709 12:10:55.447059 22605 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.027s	sys 0.057s
I20260709 12:10:55.375569 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:55.448705 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:55.449754 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:55.359141 22525 raft_consensus.cc:2468] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 6.
W20260709 12:10:55.375814 22599 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.016s	sys 0.051s
I20260709 12:10:55.377508 22454 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
W20260709 12:10:55.450807 22599 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.016s	sys 0.051s
I20260709 12:10:55.451534 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:55.382193 22570 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:55.375881 22451 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:10:55.454003 22451 raft_consensus.cc:1275] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:55.395521 25487 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.460846 22454 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.385977 23124 raft_consensus.cc:1275] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:55.393601 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:55.371870 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:55.464031 22456 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 4.
I20260709 12:10:55.396312 25542 raft_consensus.cc:697] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:55.374253 25230 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.372577 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:55.465152 22528 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 4.
I20260709 12:10:55.466212 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:55.466866 22528 raft_consensus.cc:2468] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5.
I20260709 12:10:55.468205 22528 raft_consensus.cc:1275] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:10:55.397203 22604 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7.
I20260709 12:10:55.399873 25670 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:55.401382 25233 consensus_queue.cc:260] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:55.386585 25357 raft_consensus.cc:2804] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:55.405611 25697 consensus_queue.cc:237] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:55.407076 25577 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:55.408340 25623 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:55.410275 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:55.483541 23120 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 6.
I20260709 12:10:55.410473 24970 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:55.413328 23118 raft_consensus.cc:1275] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:55.363088 25575 consensus_queue.cc:1048] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:10:55.383031 25611 raft_consensus.cc:2749] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:55.420832 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:55.425117 23089 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:55.440223 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 441086us
I20260709 12:10:55.396163 25457 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:55.474188 25640 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:55.293915 25531 raft_consensus.cc:2804] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:55.395015 25529 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.455797 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:55.504247 22448 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
W20260709 12:10:55.457072 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 65399.5us
I20260709 12:10:55.426436 25558 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:55.377220 22452 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:10:55.472960 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:55.472929 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:55.475811 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:55.476270 23122 raft_consensus.cc:1240] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:55.386394 25231 consensus_queue.cc:237] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:55.376855 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:55.525678 22453 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 8: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
W20260709 12:10:55.525662 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 145235us
I20260709 12:10:55.527552 22525 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 8: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:55.450309 22449 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
I20260709 12:10:55.479327 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:55.378787 25710 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:55.456579 25676 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:55.489246 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:55.530217 23117 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 8: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:55.463651 25538 consensus_queue.cc:1048] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
W20260709 12:10:55.491168 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 66117.6us
I20260709 12:10:55.491683 22526 raft_consensus.cc:2393] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 6: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:55.531139 23089 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:55.528381 22598 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 9.
I20260709 12:10:55.532977 23089 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:55.496954 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:55.500069 23087 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.624s (SENT) [suppressed 16 similar messages]
I20260709 12:10:55.504479 22421 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
W20260709 12:10:55.473114 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 91007.9us
I20260709 12:10:55.377854 25565 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:55.530361 22454 raft_consensus.cc:1275] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:55.490578 22455 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
I20260709 12:10:55.531690 22495 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:55.524395 23124 raft_consensus.cc:2468] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 6.
I20260709 12:10:55.545137 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:55.484282 25233 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.501483 25531 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.497402 25554 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.550743 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:55.553558 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:55.579542 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 79495.6us
W20260709 12:10:55.580587 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:55.581004 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.582307 23087 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:55.499351 25584 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:55.491331 25667 raft_consensus.cc:2749] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:55.484127 25357 raft_consensus.cc:697] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
W20260709 12:10:55.577701 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 73313.9us
I20260709 12:10:55.598412 22421 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
W20260709 12:10:55.577929 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 287848us
W20260709 12:10:55.574823 25715 log.cc:927] Time spent T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:10:55.483620 25718 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:55.492856 25412 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:55.613250 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:55.533396 25710 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:55.494632 25640 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:55.629964 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.586658 25531 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:55.632349 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:55.637127 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:55.653113 22454 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
I20260709 12:10:55.533260 25611 consensus_queue.cc:1048] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 12:10:55.575883 25626 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.608414 25281 raft_consensus.cc:2749] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:55.643770 25695 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:55.499089 25542 consensus_queue.cc:237] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:55.631098 22569 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:55.577282 25561 raft_consensus.cc:2749] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:55.579486 25623 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:55.656790 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:55.657392 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:55.585790 25415 consensus_queue.cc:1048] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 12:10:55.586082 25642 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:55.539068 25676 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:55.599320 25725 raft_consensus.cc:2749] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:55.577133 25670 raft_consensus.cc:2804] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:55.665982 22523 raft_consensus.cc:1240] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:55.658373 22421 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:55.614667 25584 consensus_queue.cc:1048] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 12:10:54.961730 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:55.719831 22598 raft_consensus.cc:1275] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:10:55.684682 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:55.735765 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.667008 23121 raft_consensus.cc:2468] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:55.725800 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:10:55.733222 22355 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55978 (request call id 333) took 16348 ms (client timeout 15000 ms). Trace:
I20260709 12:10:55.718945 22531 raft_consensus.cc:1275] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:55.679280 22527 raft_consensus.cc:1275] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:55.786899 23124 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:10:55.790299 23124 raft_consensus.cc:1240] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:55.785248 22570 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:55.794575 22603 raft_consensus.cc:1240] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:55.796243 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:55.654711 25718 raft_consensus.cc:697] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
W20260709 12:10:55.790129 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 199670us
W20260709 12:10:55.805845 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 174855us
I20260709 12:10:55.806540 22569 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:55.807017 23117 raft_consensus.cc:1275] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:10:55.807585 22569 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:55.808207 23117 raft_consensus.cc:1240] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:10:55.802520 22570 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:10:55.698561 25719 log.cc:927] Time spent T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 12:10:55.697921 25714 log.cc:927] Time spent T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
W20260709 12:10:55.727711 25720 log.cc:927] Time spent T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 12:10:55.809772 22569 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:55.829950 22569 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
W20260709 12:10:55.697387 25721 log.cc:927] Time spent T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 12:10:55.722651 25724 log.cc:927] Time spent T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:10:55.708345 25675 raft_consensus.cc:3055] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:55.850171 25577 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:55.850334 25675 raft_consensus.cc:740] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:55.851507 25675 consensus_queue.cc:260] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:55.852981 25675 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.853055 25529 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:55.667889 25695 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:55.668427 25733 raft_consensus.cc:2804] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:55.855432 25733 raft_consensus.cc:697] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:55.856412 25733 consensus_queue.cc:237] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:55.856868 25695 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:55.675534 25358 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.857667 25358 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:55.833581 24970 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:55.859364 24970 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:55.859720 24970 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.860520 25358 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:55.780694 25670 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.801255 25623 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:55.861308 25670 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:55.814162 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.669471 25202 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:55.864198 22569 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:55.832432 23121 raft_consensus.cc:1275] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:55.698038 25536 raft_consensus.cc:2749] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:55.835644 25699 raft_consensus.cc:2804] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:55.836162 25558 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:55.836443 25708 log.cc:927] Time spent T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.757s	user 0.015s	sys 0.000s
I20260709 12:10:55.836077 25561 consensus_queue.cc:1048] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:10:55.826539 25538 raft_consensus.cc:2749] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:55.836921 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:55.833158 25576 raft_consensus.cc:2804] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:55.835829 22351 catalog_manager.cc:5697] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 5 to 7, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 7 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:55.840418 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:55.814312 25694 raft_consensus.cc:2804] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:55.849363 25457 consensus_queue.cc:1048] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:55.865658 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:55.896358 22528 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:10:55.897185 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:55.866787 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:55.736085 25489 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:55.709200 25281 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:55.912345 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:55.736244 25521 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:55.739238 25640 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:55.713675 25730 raft_consensus.cc:2749] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:10:55.784817 22355 rpcz_store.cc:269] 0709 12:10:39.384667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:39.384964 (+   297us) service_pool.cc:224] Handling call
0709 12:10:55.733139 (+16348175us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:50.169378 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:50.661397 (+492019us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:50.705236 (+ 43839us) write_op.cc:435] Acquired schema lock
0709 12:10:50.705267 (+    31us) tablet.cc:662] Decoding operations
0709 12:10:51.011540 (+306273us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:51.017363 (+  5823us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:51.019267 (+  1904us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:10:51.112074 (+ 92807us) tablet.cc:701] Row locks acquired
0709 12:10:51.112124 (+    50us) write_op.cc:260] PREPARE: finished
0709 12:10:51.112319 (+   195us) write_op.cc:270] Start()
0709 12:10:51.112474 (+   155us) write_op.cc:276] Timestamp: P: 1783599051112254 usec, L: 0
0709 12:10:51.112496 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:10:51.128400 (+ 15904us) log.cc:844] Serialized 4024 byte log entry
0709 12:10:51.652918 (+524518us) op_driver.cc:464] REPLICATION: finished
0709 12:10:51.891697 (+238779us) write_op.cc:301] APPLY: starting
0709 12:10:51.911692 (+ 19995us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:52.094792 (+183100us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:52.144404 (+ 49612us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:52.241025 (+ 96621us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:52.241484 (+   459us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 12:10:52.241560 (+    76us) write_op.cc:312] APPLY: finished
0709 12:10:52.242038 (+   478us) log.cc:844] Serialized 77 byte log entry
0709 12:10:52.242258 (+   220us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:52.242398 (+   140us) write_op.cc:454] Released schema lock
0709 12:10:52.242596 (+   198us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:52.348873 (+106277us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:52.351609 (+  2736us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":993034,"reported_tablets":35,"child_traces":[["op",{"apply.queue_time_us":179284,"apply.run_cpu_time_us":5194,"apply.run_wall_time_us":430376,"num_ops":10,"prepare.queue_time_us":619053,"prepare.run_cpu_time_us":35634,"prepare.run_wall_time_us":1168745,"raft.queue_time_us":133864,"raft.run_cpu_time_us":25703,"raft.run_wall_time_us":125787,"replication_time_us":528422,"thread_start_us":433974,"threads_started":4,"wal-append.queue_time_us":115637,"wal-append.run_cpu_time_us":12375,"wal-append.run_wall_time_us":1979678}]]}
I20260709 12:10:55.873157 25677 raft_consensus.cc:2804] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:55.862831 25623 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:55.928380 22532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 630) took 3052 ms. Trace:
I20260709 12:10:55.803462 25665 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:55.888615 22569 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:55.933643 22604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45576 (request call id 2425) took 1123 ms. Trace:
I20260709 12:10:55.934389 23122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 1029) took 1002 ms. Trace:
I20260709 12:10:55.934998 23122 rpcz_store.cc:276] 0709 12:10:54.932068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.932520 (+   452us) service_pool.cc:224] Handling call
0709 12:10:54.932826 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:55.524132 (+591306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.934126 (+409994us) spinlock_profiling.cc:243] Waited 543 ms on lock 0x7b54001acf54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:55.934313 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1249253120}
W20260709 12:10:55.935689 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 277421us
I20260709 12:10:55.827425 25642 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.898254 23117 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:10:55.934119 22604 rpcz_store.cc:276] 0709 12:10:54.810027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.810141 (+   114us) service_pool.cc:224] Handling call
0709 12:10:55.933490 (+1123349us) spinlock_profiling.cc:243] Waited 586 ms on lock 0x7b5400044054. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:55.933594 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1347941248}
I20260709 12:10:55.941051 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:55.941854 22604 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 7.
I20260709 12:10:55.891703 25529 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:55.855461 25565 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:55.665943 25626 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:55.875836 25536 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.918532 22570 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:55.918008 25694 raft_consensus.cc:697] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
W20260709 12:10:55.967626 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 49179.4us
I20260709 12:10:55.807205 25731 consensus_queue.cc:1048] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.114s
I20260709 12:10:55.873376 25699 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.877739 25695 raft_consensus.cc:2804] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:55.833416 25535 consensus_queue.cc:1048] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 12:10:55.911584 25558 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:55.917747 25281 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:55.923710 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:55.924331 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:55.925733 25713 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.920904 25358 consensus_queue.cc:1048] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:10:55.928750 22532 rpcz_store.cc:276] 0709 12:10:52.875960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.131025 (+255065us) service_pool.cc:224] Handling call
0709 12:10:53.133408 (+  2383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.085844 (+952436us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.928170 (+1842326us) spinlock_profiling.cc:243] Waited 940 ms on lock 0x7b5400262d54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:55.928326 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2160887040}
I20260709 12:10:55.936589 22421 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:55.911461 25571 raft_consensus.cc:2804] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:55.988310 25571 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:55.988730 25571 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.899464 25576 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:55.991859 25576 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:55.995453 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 58961.6us
I20260709 12:10:55.995752 25676 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:55.996369 25676 raft_consensus.cc:2749] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:55.996238 25487 raft_consensus.cc:2955] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Committing config change with OpId 6.7: config changed from index 5 to 7, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:55.998268 22421 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:55.939893 22605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2423) took 1142 ms. Trace:
I20260709 12:10:55.999228 22605 rpcz_store.cc:276] 0709 12:10:54.797921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.798031 (+   110us) service_pool.cc:224] Handling call
0709 12:10:54.798323 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:54.803671 (+  5348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:54.803699 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:54.804091 (+   392us) log.cc:844] Serialized 26 byte log entry
0709 12:10:55.447439 (+643348us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:55.447478 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.447540 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:55.939623 (+492083us) raft_consensus.cc:1685] finished
0709 12:10:55.939650 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:55.939817 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":643017,"threads_started":1,"wal-append.queue_time_us":659856}
I20260709 12:10:56.001556 25281 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:56.002071 25558 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:55.943817 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:56.004133 25558 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:55.946075 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:56.006770 23121 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
I20260709 12:10:56.007710 25400 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.946939 22351 catalog_manager.cc:5697] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 3 to 4, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 4 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:56.008222 25400 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:56.009078 22351 catalog_manager.cc:5697] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
W20260709 12:10:55.907617 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 375963us
I20260709 12:10:56.011355 22495 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:56.010571 22351 catalog_manager.cc:5697] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 4 to 5, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 5 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:56.013087 25400 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:56.013620 25400 raft_consensus.cc:2804] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:55.961575 25665 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.014204 25665 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:56.013803 22351 catalog_manager.cc:5697] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 reported cstate change: config changed from index 3 to 4, term changed from 4 to 6, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to <none>, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129), VOTER 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130), VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131), VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 6 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:56.016353 25665 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:55.965822 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 77305.8us
I20260709 12:10:56.017663 22569 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:56.020676 25711 raft_consensus.cc:2749] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:55.928716 25677 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.971148 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:56.021399 22598 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:56.022715 25230 consensus_meta.cc:287] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.542s	user 0.008s	sys 0.000s
I20260709 12:10:56.023138 25230 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:56.024137 22455 raft_consensus.cc:1275] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:56.025038 25230 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:56.025234 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:56.026005 25736 log.cc:927] Time spent T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:10:56.026134 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:55.977735 25529 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.954056 25718 consensus_queue.cc:237] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:56.027247 25529 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:56.026734 22449 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:56.029317 25529 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:56.021286 25677 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:55.979821 23123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 1028) took 1048 ms. Trace:
I20260709 12:10:56.031340 23123 rpcz_store.cc:276] 0709 12:10:54.931775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.931903 (+   128us) service_pool.cc:224] Handling call
0709 12:10:54.932210 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:54.951502 (+ 19292us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:54.951531 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:54.962770 (+ 11239us) log.cc:844] Serialized 26 byte log entry
0709 12:10:55.054859 (+ 92089us) spinlock_profiling.cc:243] Waited 3.89 ms on lock 0x7b18002ff080. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc7823e07 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc7840c02 00007f9cca4c820b 00007f9cca4cdd23 00007f9cca4ce0d1 00007f9cca8e9a0f
0709 12:10:55.421191 (+366332us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:55.421248 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.421337 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:55.969746 (+548409us) raft_consensus.cc:1685] finished
0709 12:10:55.969768 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:55.979755 (+  9987us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18900,"raft.queue_time_us":26067,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":17008,"spinlock_wait_cycles":8950528,"thread_start_us":366094,"threads_started":1,"wal-append.queue_time_us":595059}
I20260709 12:10:55.980237 22570 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:55.739425 25357 consensus_queue.cc:237] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:56.033192 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 53052.1us
I20260709 12:10:55.983593 23120 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
I20260709 12:10:55.984135 22599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2027) took 1115 ms. Trace:
I20260709 12:10:56.035444 22599 rpcz_store.cc:276] 0709 12:10:54.868834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.868967 (+   133us) service_pool.cc:224] Handling call
0709 12:10:54.869264 (+   297us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:54.869650 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:54.869678 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:54.870249 (+   571us) log.cc:844] Serialized 52 byte log entry
0709 12:10:55.451203 (+580954us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:55.451242 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.451305 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:55.983853 (+532548us) raft_consensus.cc:1685] finished
0709 12:10:55.983875 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:55.984061 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9000,"raft.queue_time_us":6574,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":9670,"thread_start_us":580613,"threads_started":1,"wal-append.queue_time_us":613082}
I20260709 12:10:56.037149 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:55.917588 25489 consensus_queue.cc:1048] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:10:56.042467 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:56.006175 25626 leader_election.cc:290] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:56.012244 22495 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:55.947484 22422 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:55.959801 22497 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:56.044234 22570 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:56.016059 22351 catalog_manager.cc:5697] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:55.928032 25705 consensus_queue.cc:1048] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:10:56.043341 23123 raft_consensus.cc:2410] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:56.039283 22529 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 8.
W20260709 12:10:56.046139 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 233330us
I20260709 12:10:56.049785 22598 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 8.
W20260709 12:10:56.050603 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 90921.1us
I20260709 12:10:55.980834 25699 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:56.062079 22495 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:56.062505 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:56.039340 22527 raft_consensus.cc:2955] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 5 to 7, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
W20260709 12:10:56.068338 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 70259.8us
I20260709 12:10:56.069083 22421 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:56.069911 22421 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:55.980351 25623 raft_consensus.cc:2804] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:55.981662 25678 raft_consensus.cc:2804] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:55.981019 25695 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:56.021322 25671 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:56.072268 22351 catalog_manager.cc:5697] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 3 to 4, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 4 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:56.070813 22421 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:56.076609 23120 raft_consensus.cc:1275] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:55.953233 25642 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:56.079260 22570 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
W20260709 12:10:56.080113 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.046483 25358 raft_consensus.cc:2804] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:56.080364 22606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2405) took 2071 ms. Trace:
I20260709 12:10:56.083556 22495 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:10:56.080200 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 132823us
I20260709 12:10:56.087436 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:55.986215 25404 consensus_queue.cc:1059] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 12:10:56.066808 25585 raft_consensus.cc:2804] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:56.096809 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:56.097410 22452 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7.
I20260709 12:10:56.089182 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:56.090524 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:56.098340 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:56.091317 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:56.066951 25419 raft_consensus.cc:2749] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:56.050009 25400 raft_consensus.cc:697] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:56.083597 22606 rpcz_store.cc:276] 0709 12:10:54.008652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.008816 (+   164us) service_pool.cc:224] Handling call
0709 12:10:54.009224 (+   408us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:54.236067 (+226843us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:54.236100 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:54.236844 (+   744us) log.cc:844] Serialized 52 byte log entry
0709 12:10:55.149078 (+912234us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:55.149131 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.149223 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:55.814739 (+665516us) spinlock_profiling.cc:243] Waited 6.66 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:10:56.075485 (+260746us) raft_consensus.cc:1685] finished
0709 12:10:56.075508 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.080303 (+  4795us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":308097,"raft.run_cpu_time_us":50,"raft.run_wall_time_us":49,"spinlock_wait_cycles":15325056,"thread_start_us":899303,"threads_started":2,"wal-append.queue_time_us":686901}
I20260709 12:10:56.073568 25740 raft_consensus.cc:2764] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:10:56.085033 23088 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:56.075201 25202 raft_consensus.cc:2804] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:56.077904 25678 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.111387 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:56.099607 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:56.112205 22456 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:56.075663 25623 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:56.055223 25535 consensus_queue.cc:1048] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:10:56.122376 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:56.081113 25695 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:56.079898 25676 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:56.112861 22524 raft_consensus.cc:1275] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:56.077654 25575 consensus_queue.cc:1048] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:10:56.099254 25585 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.083436 25358 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.088496 25529 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:56.111222 25202 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.113433 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:56.114363 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:56.124322 25623 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.121796 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:56.075071 25584 consensus_queue.cc:1048] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
W20260709 12:10:56.050578 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 433637us
I20260709 12:10:56.096532 25612 consensus_queue.cc:1048] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:10:56.112958 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:56.114763 25694 consensus_queue.cc:237] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:56.080686 25626 raft_consensus.cc:2804] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:56.102046 22351 catalog_manager.cc:5697] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 3 to 6, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 6 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:56.134485 22604 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
I20260709 12:10:56.110805 25554 raft_consensus.cc:2804] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:56.099849 25558 raft_consensus.cc:2804] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:56.101622 25737 raft_consensus.cc:2804] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:56.116724 25678 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:56.096554 25368 raft_consensus.cc:2804] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:56.148334 22456 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 6.
I20260709 12:10:56.150460 22523 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 5.
I20260709 12:10:56.150728 22530 raft_consensus.cc:2393] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 7: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
W20260709 12:10:56.245675 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 159769us
I20260709 12:10:56.101827 25731 consensus_queue.cc:1048] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
W20260709 12:10:56.190080 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 59302.4us
I20260709 12:10:56.201053 23089 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:10:56.247730 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 46798.2us
I20260709 12:10:56.248447 23089 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:56.248996 25743 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:56.250056 23089 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:56.044059 25713 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:56.125860 25665 raft_consensus.cc:2804] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:56.125054 25553 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:56.142697 25585 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.151305 25358 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:56.114073 25741 consensus_queue.cc:1059] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.102s
I20260709 12:10:56.189628 25202 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:56.206853 25710 consensus_meta.cc:287] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.547s	user 0.009s	sys 0.000s
W20260709 12:10:56.230973 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 135381us
I20260709 12:10:56.236730 22495 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:56.190414 25529 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:56.138566 25531 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:56.113994 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:56.303920 22531 raft_consensus.cc:2468] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 5.
I20260709 12:10:56.251962 23089 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:56.150045 25592 consensus_queue.cc:1048] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 12:10:56.268343 25281 raft_consensus.cc:2749] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:56.255409 25665 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:56.251942 22422 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:10:56.339320 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 87418.8us
I20260709 12:10:56.340276 23089 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:56.226212 25554 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:56.273183 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:56.342471 22456 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7.
I20260709 12:10:56.233145 25558 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.226403 25626 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:56.269680 22351 catalog_manager.cc:5697] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 3 to 5, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 5 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:10:56.281112 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.231112 25737 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:56.244443 25489 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.244936 25368 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:10:56.311722 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 64563.3us
W20260709 12:10:56.252123 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 172944us
I20260709 12:10:56.273653 25739 raft_consensus.cc:2749] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:56.303107 25529 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:56.315632 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 79057.2us
I20260709 12:10:56.303165 25710 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:56.317425 25565 raft_consensus.cc:2804] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:56.343175 25457 raft_consensus.cc:2749] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:56.336306 25713 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:56.284365 25553 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:56.344075 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:56.457556 22531 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5.
W20260709 12:10:56.418651 25763 log.cc:927] Time spent T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:10:56.348938 25695 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:56.352164 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:56.467829 22530 raft_consensus.cc:2393] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 6: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:56.352834 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:56.353509 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:56.353993 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:56.400893 25368 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.370298 22450 raft_consensus.cc:2393] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 9: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:56.370249 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:56.370450 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:56.483651 23124 raft_consensus.cc:2410] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:56.440995 25565 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.337039 25571 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:56.487623 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:56.310923 25357 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:56.333472 25677 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:56.356369 25233 consensus_meta.cc:287] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.766s	user 0.011s	sys 0.000s
I20260709 12:10:56.354950 25554 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.392297 22497 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:56.343255 25665 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.417454 23088 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:56.401543 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:56.506413 23120 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5.
I20260709 12:10:56.366250 25561 raft_consensus.cc:2749] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:56.430701 22495 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:56.319429 25742 log.cc:927] Time spent T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 12:10:56.367447 25558 raft_consensus.cc:3060] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:56.449110 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:56.451725 22351 catalog_manager.cc:5697] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:56.375741 25626 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:56.448554 25721 log.cc:927] Time spent T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:10:56.345760 23089 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:56.462071 22570 leader_election.cc:304] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:56.382294 25737 raft_consensus.cc:3060] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:56.384119 25757 raft_consensus.cc:3055] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:56.469682 22526 raft_consensus.cc:2410] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:56.354291 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:56.379211 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 127386us
I20260709 12:10:56.430133 25642 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:56.376187 25741 consensus_queue.cc:1048] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.094s
I20260709 12:10:56.487498 22600 raft_consensus.cc:1240] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:56.231309 25400 consensus_queue.cc:237] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:56.488329 23122 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:10:56.401748 25489 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:56.581236 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:10:56.504369 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.504009 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:56.505000 25743 raft_consensus.cc:2749] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:56.510634 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 118422us
I20260709 12:10:56.487257 25565 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.457239 25711 consensus_queue.cc:1048] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:10:56.530943 22599 raft_consensus.cc:1240] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:56.501694 25542 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:56.501117 25576 consensus_meta.cc:287] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.509s	user 0.010s	sys 0.000s
W20260709 12:10:56.539431 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 108805us
I20260709 12:10:56.604480 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:56.604629 22495 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:56.580924 25505 raft_consensus.cc:2804] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:56.579041 25757 raft_consensus.cc:740] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:56.555693 25713 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.557161 25553 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:56.560961 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 215257us
I20260709 12:10:56.618319 22495 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:56.621336 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:56.621451 23089 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:56.495860 25676 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.561611 22351 catalog_manager.cc:5697] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:56.501085 22601 raft_consensus.cc:2410] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 12:10:56.509832 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 92439.6us
I20260709 12:10:56.492962 25699 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:56.628455 22351 catalog_manager.cc:5697] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 2 to 6, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 6 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:56.630828 22351 catalog_manager.cc:5697] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:56.632372 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:56.632731 25765 log.cc:927] Time spent T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:10:56.560941 25415 raft_consensus.cc:2749] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:56.633055 22451 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 5.
I20260709 12:10:56.495586 25357 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:56.634223 25758 log.cc:927] Time spent T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 12:10:56.636266 25357 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:56.505080 25678 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:56.638621 22603 raft_consensus.cc:2368] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 6. Current term is 7.
I20260709 12:10:56.552011 25535 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:56.639590 25535 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:56.640307 25678 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:10:56.589643 25748 log.cc:927] Time spent T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:10:56.582502 25404 raft_consensus.cc:2749] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:56.587569 25745 log.cc:927] Time spent T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 12:10:56.536216 25592 raft_consensus.cc:2804] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:56.587399 25628 raft_consensus.cc:2804] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:56.588064 25755 raft_consensus.cc:2804] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:56.590487 25762 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:56.613749 25576 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:56.626103 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:56.626648 25676 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:56.644394 22495 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:10:56.700753 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 56472.8us
I20260709 12:10:56.620421 25531 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:56.653090 22606 raft_consensus.cc:1240] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 12:10:56.653376 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 191393us
I20260709 12:10:56.661090 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:56.795985 22449 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:56.685920 22496 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:56.667363 25535 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:56.666169 25563 raft_consensus.cc:2749] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:56.696058 22456 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:56.611104 25505 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:56.799700 25505 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:56.613842 25772 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
W20260709 12:10:56.659343 24970 consensus_meta.cc:287] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.799s	user 0.008s	sys 0.003s
I20260709 12:10:56.701560 22495 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:56.634236 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:56.808254 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 106773us
I20260709 12:10:56.810745 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:10:56.717319 25744 log.cc:927] Time spent T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.332s	user 0.000s	sys 0.001s
I20260709 12:10:56.686940 25592 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.704144 25738 consensus_queue.cc:1059] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.102s
I20260709 12:10:56.611554 25542 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:56.695086 25763 log.cc:927] Time spent T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:10:56.633083 25699 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:56.656934 25743 raft_consensus.cc:2749] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:56.694778 25719 log.cc:927] Time spent T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:10:56.756336 25755 raft_consensus.cc:697] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:56.798549 22421 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:10:56.860283 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 61942.9us
I20260709 12:10:56.860491 22456 raft_consensus.cc:2468] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
W20260709 12:10:56.798949 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 113087us
I20260709 12:10:56.861445 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:56.861476 22421 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:56.820396 25521 raft_consensus.cc:2804] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:56.703673 25628 raft_consensus.cc:697] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:56.645963 25713 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:56.684784 25457 consensus_queue.cc:1048] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.115s
I20260709 12:10:56.704797 25710 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:56.818888 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:56.880369 23123 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 6.
I20260709 12:10:56.820158 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:56.881461 23124 raft_consensus.cc:2376] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7. Re-sending same reply.
I20260709 12:10:56.882481 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:56.883172 23124 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7.
I20260709 12:10:56.883989 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:56.884873 23124 raft_consensus.cc:2393] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 8: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:56.885592 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:56.821139 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:56.887614 23118 raft_consensus.cc:2410] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:56.890233 22421 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:56.822125 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:56.823603 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:56.895216 22451 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:10:56.801946 25724 log.cc:927] Time spent T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:10:56.701613 25762 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:56.842710 22449 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
I20260709 12:10:56.801000 25676 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:56.703933 25611 consensus_queue.cc:1048] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.122s
I20260709 12:10:56.806900 25563 raft_consensus.cc:2749] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:56.819842 25592 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:56.821229 25695 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:56.812000 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:56.794754 25617 raft_consensus.cc:2804] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:56.879704 25521 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.894503 23125 raft_consensus.cc:2468] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 6.
W20260709 12:10:56.903646 25782 log.cc:927] Time spent T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:10:56.904722 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:56.933727 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:10:56.934974 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 44812.6us
I20260709 12:10:56.936919 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:56.908865 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:56.947316 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:10:56.901163 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 120097us
I20260709 12:10:56.816779 24970 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:56.860881 25571 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:10:56.906113 25747 log.cc:927] Time spent T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.303s	user 0.000s	sys 0.001s
I20260709 12:10:56.902690 25776 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:56.934932 25670 consensus_meta.cc:287] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 1.073s	user 0.013s	sys 0.000s
I20260709 12:10:56.874351 25677 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:56.947948 23124 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7.
I20260709 12:10:56.907967 25743 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:56.946766 25358 consensus_meta.cc:287] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.644s	user 0.005s	sys 0.006s
I20260709 12:10:56.954701 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:56.987365 22606 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 7.
I20260709 12:10:56.988184 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:56.988724 22606 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7.
I20260709 12:10:56.989542 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:56.990005 22606 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:56.816640 25772 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:56.973419 23117 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.058s	sys 0.113s
W20260709 12:10:56.997905 23117 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.058s	sys 0.113s
I20260709 12:10:56.961999 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:56.962405 22456 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.964499 22598 raft_consensus.cc:2393] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 7: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:56.983764 22597 raft_consensus.cc:1240] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:56.990815 22451 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 10.
I20260709 12:10:56.952405 23088 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:56.802300 25757 consensus_queue.cc:260] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:57.003239 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 140960us
W20260709 12:10:57.014030 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 61696.3us
W20260709 12:10:57.037755 25671 consensus_meta.cc:287] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.955s	user 0.016s	sys 0.001s
I20260709 12:10:56.992406 25489 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:57.042127 22442 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ba02be77861491da7dbcfee1161e46c with delete_type TABLET_DATA_TOMBSTONED (TS c863116d91c14d1ca50d6e8a46a37a8f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51832
I20260709 12:10:56.985338 25740 consensus_queue.cc:1048] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 12:10:56.987578 25357 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.067142 25457 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:57.073937 25585 consensus_meta.cc:287] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.774s	user 0.012s	sys 0.000s
I20260709 12:10:56.966023 25521 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.047251 25755 consensus_queue.cc:237] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:56.952899 25676 raft_consensus.cc:2804] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:57.067454 25554 consensus_meta.cc:287] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.537s	user 0.014s	sys 0.000s
I20260709 12:10:56.974206 25617 raft_consensus.cc:697] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:57.082969 25677 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.054627 25628 consensus_queue.cc:237] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:56.957204 25642 consensus_queue.cc:1048] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.119s
I20260709 12:10:57.039568 25760 raft_consensus.cc:2749] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:57.110322 23119 raft_consensus.cc:2410] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:56.972424 25553 consensus_queue.cc:1048] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.125s
W20260709 12:10:57.170770 25487 consensus_meta.cc:287] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 1.173s	user 0.015s	sys 0.001s
I20260709 12:10:56.986500 25743 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:57.111827 25563 consensus_queue.cc:1048] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.101s
I20260709 12:10:57.148820 25415 consensus_queue.cc:1048] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 12:10:57.147558 25585 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:57.148017 25357 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:57.146088 25786 log.cc:927] Time spent T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:10:57.083273 25731 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.983881 25670 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:57.053841 25789 raft_consensus.cc:2749] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:57.160811 22456 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:10:57.239063 25415 consensus_queue.cc:1243] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer 8701cd5186a949538d8efafb5f987270 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:10:57.001578 25358 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:57.104200 25796 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.130244 25531 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.155745 25554 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:57.148321 25671 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.149765 25676 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.214828 25759 raft_consensus.cc:2804] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:57.149410 25457 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:57.221907 25565 consensus_meta.cc:287] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.605s	user 0.010s	sys 0.007s
I20260709 12:10:57.219388 25412 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:57.219333 25769 log.cc:927] Time spent T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.283s	user 0.001s	sys 0.000s
I20260709 12:10:57.141556 22606 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 9.
I20260709 12:10:57.171271 25677 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:57.145074 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 182930us
I20260709 12:10:57.307195 22421 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:57.307725 25740 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:57.308239 25740 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:56.992350 25776 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:57.304508 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:57.310024 22606 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 9.
W20260709 12:10:57.250794 22604 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.005s	sys 0.008s
I20260709 12:10:57.168428 22496 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:57.261668 22456 raft_consensus.cc:1240] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 LEADER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 12:10:57.317245 22604 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.005s	sys 0.008s
I20260709 12:10:57.295131 25676 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:57.271901 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:57.273483 22598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45562 (request call id 2036) took 1187 ms. Trace:
I20260709 12:10:57.321347 22598 rpcz_store.cc:276] 0709 12:10:56.086271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.087184 (+   913us) service_pool.cc:224] Handling call
0709 12:10:57.273276 (+1186092us) spinlock_profiling.cc:243] Waited 876 ms on lock 0x7b54000ebd54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:57.273409 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2015133952}
I20260709 12:10:57.322932 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:57.275158 23119 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57332 (request call id 669) took 2329 ms (client timeout 1725 ms). Trace:
W20260709 12:10:57.323849 23119 rpcz_store.cc:269] 0709 12:10:54.945728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.962060 (+ 16332us) service_pool.cc:224] Handling call
0709 12:10:57.274896 (+2312836us) spinlock_profiling.cc:243] Waited 2.11 s on lock 0x7b5400135e54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:57.275066 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4843474304}
I20260709 12:10:57.325388 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:57.326058 23119 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:57.276722 25358 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:57.251256 25787 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.328526 25787 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:57.280138 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:57.240096 25542 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:57.251893 25623 consensus_meta.cc:287] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 1.039s	user 0.008s	sys 0.004s
I20260709 12:10:57.210728 25795 consensus_queue.cc:1048] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:10:57.283113 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:57.332615 25623 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:57.334070 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:57.334777 23123 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:10:57.335186 25623 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:57.283257 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:57.247781 25797 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.285521 22455 raft_consensus.cc:1240] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:57.286160 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:57.336340 23118 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
I20260709 12:10:57.336392 25797 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:57.337271 22605 raft_consensus.cc:1240] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:57.337574 23120 raft_consensus.cc:1275] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:10:57.289256 25794 log.cc:927] Time spent T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:10:57.338792 25797 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:57.291678 25538 raft_consensus.cc:3055] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:57.293849 22451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1689) took 1051 ms. Trace:
I20260709 12:10:57.288298 22570 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:57.339758 25538 raft_consensus.cc:740] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:57.253934 25713 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:57.340257 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 52034.2us
I20260709 12:10:57.340668 25713 raft_consensus.cc:2804] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:57.338531 25787 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:57.317721 22456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 641) took 1010 ms. Trace:
I20260709 12:10:57.342131 25538 consensus_queue.cc:260] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:57.342948 22456 rpcz_store.cc:276] 0709 12:10:56.307488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.261064 (+953576us) service_pool.cc:224] Handling call
0709 12:10:57.261419 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:57.317446 (+ 56027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.317669 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:57.342857 22451 rpcz_store.cc:276] 0709 12:10:56.242585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.043057 (+800472us) service_pool.cc:224] Handling call
0709 12:10:57.060443 (+ 17386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:57.061062 (+   619us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:57.061105 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:57.061803 (+   698us) log.cc:844] Serialized 26 byte log entry
0709 12:10:57.253968 (+192165us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:57.254018 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.254086 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:57.293583 (+ 39497us) raft_consensus.cc:1685] finished
0709 12:10:57.293610 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:57.293772 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1348,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":113,"spinlock_wait_cycles":5888,"thread_start_us":191610,"threads_started":1,"wal-append.queue_time_us":228533}
I20260709 12:10:57.345028 22451 raft_consensus.cc:1240] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:10:57.270228 25563 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.346112 25563 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:57.240733 25617 consensus_queue.cc:237] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:57.341135 25713 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:57.351207 25713 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.310905 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:57.341995 25801 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.355027 25801 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:57.358425 22606 raft_consensus.cc:1275] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:10:57.361845 22606 raft_consensus.cc:1240] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:57.369035 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:57.370095 23120 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
I20260709 12:10:57.385543 25801 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:57.390718 22606 raft_consensus.cc:1240] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:57.285825 25772 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:57.321038 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 152975us
I20260709 12:10:57.406819 22496 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:57.305778 25777 log.cc:927] Time spent T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:10:57.413008 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:57.305953 25705 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.450078 22496 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:57.304283 25759 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:57.287312 25531 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:57.417851 25536 consensus_meta.cc:287] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 1.436s	user 0.013s	sys 0.001s
I20260709 12:10:57.294819 25671 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:57.320739 25230 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.481729 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:57.403393 25789 raft_consensus.cc:2749] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:57.304041 25788 raft_consensus.cc:2804] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:57.412492 25400 raft_consensus.cc:2804] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:57.318188 25762 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:57.417675 25368 consensus_meta.cc:287] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.930s	user 0.014s	sys 0.001s
I20260709 12:10:57.455713 22601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43070 (request call id 512) took 2089 ms. Trace:
I20260709 12:10:57.451989 22496 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:57.456641 22598 raft_consensus.cc:2410] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 12:10:57.515591 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 63703.9us
I20260709 12:10:57.457744 25553 raft_consensus.cc:2804] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:57.459014 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:10:57.505679 25202 consensus_meta.cc:287] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 1.194s	user 0.013s	sys 0.002s
I20260709 12:10:57.475461 25487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:45546 (request call id 97) took 4254 ms. Trace:
I20260709 12:10:57.304497 25565 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:57.311048 25412 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:57.492293 23122 raft_consensus.cc:2955] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 5 to 7, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:10:57.499294 22602 raft_consensus.cc:2393] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 9: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:57.252837 25731 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:57.518538 23120 raft_consensus.cc:1275] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:10:57.512742 25400 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.461933 25759 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.464059 23119 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
I20260709 12:10:57.512598 25623 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:57.472412 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:57.534871 25415 raft_consensus.cc:2804] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:10:57.539767 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 231033us
I20260709 12:10:57.582039 22421 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:57.583146 22421 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:57.583583 23125 raft_consensus.cc:1275] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:10:57.583936 23125 pending_rounds.cc:85] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270: Aborting all ops after (but not including) 6
I20260709 12:10:57.584209 23125 pending_rounds.cc:107] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:10:57.584434 23125 raft_consensus.cc:2889] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:57.504508 25230 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:57.516973 25788 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:57.554488 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:57.513208 22601 rpcz_store.cc:276] 0709 12:10:55.366254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.550399 (+184145us) service_pool.cc:224] Handling call
0709 12:10:57.447401 (+1897002us) spinlock_profiling.cc:243] Waited 922 ms on lock 0x7b5400449b54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:57.455636 (+  8235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2119793024}
I20260709 12:10:57.595575 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:57.596056 22601 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5.
I20260709 12:10:57.461179 25798 raft_consensus.cc:2749] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:57.569010 23120 pending_rounds.cc:85] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270: Aborting all ops after (but not including) 6
I20260709 12:10:57.574241 25400 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:57.537854 25529 consensus_meta.cc:287] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 1.074s	user 0.010s	sys 0.005s
I20260709 12:10:57.286551 25796 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:57.306079 25779 consensus_queue.cc:1059] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.474s
I20260709 12:10:57.477741 25536 raft_consensus.cc:2749] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:57.537238 25553 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:57.460631 25705 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:57.541429 25531 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:57.546422 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:57.542467 25554 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:57.591125 22421 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
W20260709 12:10:57.655660 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 64599.3us
I20260709 12:10:57.452791 22422 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:10:57.657795 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 205055us
I20260709 12:10:57.658607 22422 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:57.568228 25670 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:57.597570 23120 pending_rounds.cc:107] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:10:57.661952 23120 raft_consensus.cc:2889] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:57.508002 25577 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:57.579197 25784 log.cc:927] Time spent T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:10:57.599218 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:57.603881 22452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2251) took 1478 ms. Trace:
I20260709 12:10:57.608803 25806 tablet_replica.cc:333] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:10:57.609252 25812 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.646793 25357 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:57.528198 25368 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:57.552976 25202 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:57.592025 25762 raft_consensus.cc:2804] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:57.643306 22453 raft_consensus.cc:1240] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 LEADER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:10:57.591723 25585 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:57.591830 25797 raft_consensus.cc:2749] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:57.645977 22454 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:10:57.594221 25415 raft_consensus.cc:697] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:57.598603 25788 raft_consensus.cc:3060] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:57.652551 25677 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:57.585003 25623 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:57.664351 25536 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:10:57.697438 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 85154.5us
I20260709 12:10:57.664865 25779 raft_consensus.cc:2804] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:10:57.648989 25793 log.cc:927] Time spent T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.349s	user 0.001s	sys 0.000s
I20260709 12:10:57.667114 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:57.666805 22452 rpcz_store.cc:276] 0709 12:10:56.125452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.125691 (+   239us) service_pool.cc:224] Handling call
0709 12:10:56.126024 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:56.232669 (+106645us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:56.232715 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:56.243024 (+ 10309us) log.cc:844] Serialized 26 byte log entry
0709 12:10:56.665484 (+422460us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:56.665549 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.665651 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:57.603676 (+938025us) raft_consensus.cc:1685] finished
0709 12:10:57.603696 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:57.603831 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":121485,"raft.run_cpu_time_us":55,"raft.run_wall_time_us":55,"thread_start_us":429816,"threads_started":2,"wal-append.queue_time_us":655291}
I20260709 12:10:57.707903 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:57.667881 22422 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:57.639125 25529 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:57.651436 25626 consensus_meta.cc:287] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 1.070s	user 0.013s	sys 0.001s
I20260709 12:10:57.647495 25553 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.611060 25230 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:57.713045 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:57.652899 25755 raft_consensus.cc:3055] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:57.666121 25531 raft_consensus.cc:2749] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:57.683455 25762 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.698241 22457 raft_consensus.cc:2393] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 7: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:57.540205 25487 rpcz_store.cc:276] 0709 12:10:53.203683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.209453 (+  5770us) service_pool.cc:224] Handling call
0709 12:10:53.299982 (+ 90529us) log.cc:844] Serialized 508 byte log entry
0709 12:10:54.333844 (+1033862us) spinlock_profiling.cc:243] Waited 5.68 ms on lock 0x7b18000d3540. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc78413f3 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd 0000000000388634 0000000000388479 00007f9cc782483a
0709 12:10:57.453157 (+3119313us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17790,"raft.queue_time_us":16359,"raft.run_cpu_time_us":1521,"raft.run_wall_time_us":107912,"spinlock_wait_cycles":13063424,"thread_start_us":78222,"threads_started":1,"wal-append.queue_time_us":233376,"wal-append.run_cpu_time_us":2548,"wal-append.run_wall_time_us":1168488}
I20260709 12:10:57.673738 25812 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:57.704120 25368 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:57.704597 22527 raft_consensus.cc:2393] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 7: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:57.706774 23117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 869) took 1336 ms. Trace:
I20260709 12:10:57.674551 22451 raft_consensus.cc:1240] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:57.673246 25577 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:57.714854 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:57.715378 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 47594.5us
I20260709 12:10:57.731110 23117 rpcz_store.cc:276] 0709 12:10:56.370019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.370565 (+   546us) service_pool.cc:224] Handling call
0709 12:10:56.370847 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:56.371271 (+   424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:56.371311 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:56.371827 (+   516us) log.cc:844] Serialized 26 byte log entry
0709 12:10:56.998486 (+626659us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:56.998544 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.998638 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:57.706565 (+707927us) raft_consensus.cc:1685] finished
0709 12:10:57.706582 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:57.706718 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4304,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":21607,"thread_start_us":548273,"threads_started":1,"wal-append.queue_time_us":699878}
I20260709 12:10:57.715469 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:57.718730 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:57.718886 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:57.720666 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:57.713097 25617 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.698623 25797 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:57.721251 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:10:57.739205 25558 consensus_meta.cc:287] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 1.163s	user 0.015s	sys 0.000s
W20260709 12:10:57.725739 25505 consensus_meta.cc:287] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.925s	user 0.007s	sys 0.003s
I20260709 12:10:57.728832 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:10:57.751928 25807 log.cc:927] Time spent T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:10:57.728924 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:57.734545 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:57.699559 25536 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:57.759666 25808 log.cc:927] Time spent T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:10:57.764397 22604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13854b1cf45740e680c203d064295c78"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:10:57.739185 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:57.712512 25671 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:57.748597 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:10:57.750420 25811 log.cc:927] Time spent T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:10:57.716421 25755 raft_consensus.cc:740] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:57.720605 25762 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:57.714589 25779 raft_consensus.cc:697] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 9 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:57.734478 22422 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:57.731770 25670 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.724715 22525 raft_consensus.cc:1275] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:10:57.760195 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:57.714852 25626 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:57.751993 25565 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:57.767125 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:57.790709 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 56288.3us
I20260709 12:10:57.792068 25542 raft_consensus.cc:2804] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:57.792562 25542 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:57.793011 25542 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:57.797755 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:57.764901 25505 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:57.798388 23118 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 7.
I20260709 12:10:57.798611 23124 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:57.799546 23118 pending_rounds.cc:85] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270: Aborting all ops after (but not including) 6
I20260709 12:10:57.799752 25505 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:57.800417 25755 consensus_queue.cc:260] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:57.800582 25779 consensus_queue.cc:237] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:57.801723 25755 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:57.756174 25731 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:57.740811 25531 consensus_queue.cc:1048] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:10:57.774412 25796 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:57.775167 25812 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:57.776376 25529 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:57.759907 25558 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:57.780915 25521 consensus_meta.cc:287] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.624s	user 0.006s	sys 0.004s
W20260709 12:10:57.781759 22351 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.137s	user 0.017s	sys 0.056s
W20260709 12:10:57.821015 22351 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.177s	user 0.018s	sys 0.056s
I20260709 12:10:57.783200 22599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2446) took 1723 ms. Trace:
I20260709 12:10:57.821671 22599 rpcz_store.cc:276] 0709 12:10:56.059714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.060417 (+   703us) service_pool.cc:224] Handling call
0709 12:10:56.060715 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:56.596237 (+535522us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.782956 (+1186719us) spinlock_profiling.cc:243] Waited 451 ms on lock 0x7b54003507d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:57.783143 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1036312832}
I20260709 12:10:57.823392 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:10:57.823766 25819 log.cc:927] Time spent T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:10:57.762681 25536 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:10:57.788285 25592 consensus_meta.cc:287] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.823s	user 0.007s	sys 0.003s
I20260709 12:10:57.760941 25415 consensus_queue.cc:237] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:57.789072 25705 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:57.789161 25400 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:57.789970 25202 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:57.756090 25617 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:57.839257 23124 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 10.
I20260709 12:10:57.804021 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:57.757016 25713 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:57.828115 22602 raft_consensus.cc:1240] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:57.831880 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:57.799839 23118 pending_rounds.cc:107] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:10:57.757966 25797 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:57.764767 25815 log.cc:927] Time spent T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:10:57.842445 23118 raft_consensus.cc:2889] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:57.830814 25732 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.962s	user 0.006s	sys 0.009s
I20260709 12:10:57.847929 22604 raft_consensus.cc:606] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:10:57.850827 22599 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 7.
I20260709 12:10:57.853783 22604 raft_consensus.cc:614] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:57.842442 22606 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 8.
I20260709 12:10:57.852543 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:57.854712 22526 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 6.
I20260709 12:10:57.855082 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:57.830252 25230 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.858213 22531 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:57.859129 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:57.859449 23088 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:57.865949 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:57.867703 22526 raft_consensus.cc:2393] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 9: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:57.867918 22599 raft_consensus.cc:1240] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:57.865896 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 72983.5us
W20260709 12:10:57.853492 25732 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.994s	user 0.006s	sys 0.009s
I20260709 12:10:57.871217 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:57.881017 22526 raft_consensus.cc:1813] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Handling vote request from an unknown peer c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:57.875543 22422 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:57.869828 25230 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:57.883280 25577 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:57.884018 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:57.884841 23119 raft_consensus.cc:2410] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:57.885457 22456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2255) took 1467 ms. Trace:
I20260709 12:10:57.885571 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:57.886133 23119 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.889405 22526 raft_consensus.cc:2410] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:10:57.818959 25798 consensus_queue.cc:1048] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:10:57.827281 25521 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:57.885843 22456 rpcz_store.cc:276] 0709 12:10:56.418042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.344080 (+926038us) service_pool.cc:224] Handling call
0709 12:10:57.344391 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:57.344725 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:57.344752 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:57.345176 (+   424us) log.cc:844] Serialized 26 byte log entry
0709 12:10:57.504921 (+159745us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:57.504979 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.505071 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:57.885264 (+380193us) raft_consensus.cc:1685] finished
0709 12:10:57.885282 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:57.885402 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":29737,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":210,"thread_start_us":159327,"threads_started":1,"wal-append.queue_time_us":338971}
I20260709 12:10:57.892443 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:57.830842 25592 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:57.870046 25623 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:57.900323 22531 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 5.
I20260709 12:10:57.913648 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:57.914583 22526 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
I20260709 12:10:57.916764 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:10:57.923203 25821 log.cc:927] Time spent T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:10:57.924188 25670 raft_consensus.cc:2749] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:57.890434 25792 raft_consensus.cc:2804] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:57.924845 25792 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.925184 25792 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.928552 22422 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:57.944182 23119 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 7.
I20260709 12:10:57.952327 25713 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:57.953691 25831 log.cc:927] Time spent T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:10:57.955559 25797 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:57.957850 23120 raft_consensus.cc:3055] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:57.958226 23120 raft_consensus.cc:740] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:57.958820 25740 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:57.928984 25676 consensus_meta.cc:287] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.510s	user 0.002s	sys 0.008s
I20260709 12:10:57.930446 25531 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:57.964771 22606 raft_consensus.cc:1275] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:57.894107 25759 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:57.958957 23120 consensus_queue.cc:260] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:57.945577 25670 raft_consensus.cc:2804] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:57.967495 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:57.967973 23120 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.968021 23122 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 6.
I20260709 12:10:57.970516 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:57.968992 25670 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.971473 25670 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:57.971737 25230 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:57.959482 25626 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:57.974615 25665 consensus_meta.cc:287] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 1.439s	user 0.011s	sys 0.002s
I20260709 12:10:57.974766 22602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2455) took 1008 ms. Trace:
I20260709 12:10:57.975139 22602 rpcz_store.cc:276] 0709 12:10:56.966566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.598196 (+631630us) service_pool.cc:224] Handling call
0709 12:10:57.598442 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:57.847594 (+249152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.974520 (+126926us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b5400002154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:57.974707 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":527654656}
I20260709 12:10:57.980810 22526 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 8.
I20260709 12:10:57.963889 25740 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:57.995687 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:57.965931 25617 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:57.960049 25536 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:57.958920 25542 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:57.969594 25531 raft_consensus.cc:697] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:57.963413 25676 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:58.013842 25521 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:58.014540 22449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1688) took 1776 ms. Trace:
I20260709 12:10:58.014931 22605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2445) took 1955 ms. Trace:
I20260709 12:10:58.015388 22605 rpcz_store.cc:276] 0709 12:10:56.059352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.059884 (+   532us) service_pool.cc:224] Handling call
0709 12:10:56.060209 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:57.337651 (+1277442us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.014726 (+677075us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54000e8654. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:58.014876 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2936573696}
I20260709 12:10:58.014894 22449 rpcz_store.cc:276] 0709 12:10:56.238342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.042603 (+804261us) service_pool.cc:224] Handling call
0709 12:10:57.062868 (+ 20265us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:57.298097 (+235229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:57.298142 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:57.298721 (+   579us) log.cc:844] Serialized 26 byte log entry
0709 12:10:57.479954 (+181233us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:57.480011 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.014159 (+534148us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b5400379954. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:58.014209 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:58.014258 (+    49us) raft_consensus.cc:1685] finished
0709 12:10:58.014270 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.014479 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3037,"raft.queue_time_us":14039,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":4951,"spinlock_wait_cycles":510650112,"thread_start_us":180877,"threads_started":1,"wal-append.queue_time_us":294085}
W20260709 12:10:58.018345 22454 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1685) took 1995 ms (client timeout 1505 ms). Trace:
I20260709 12:10:58.018662 22453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 640) took 1711 ms. Trace:
W20260709 12:10:58.018874 22454 rpcz_store.cc:269] 0709 12:10:56.022739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.025008 (+  2269us) service_pool.cc:224] Handling call
0709 12:10:58.018121 (+1993113us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b5400221854. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:58.018261 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3725803264}
I20260709 12:10:57.999341 25592 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:58.001729 25740 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:58.021369 25531 consensus_queue.cc:237] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:58.024276 22453 rpcz_store.cc:276] 0709 12:10:56.307218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.066692 (+759474us) service_pool.cc:224] Handling call
0709 12:10:57.067186 (+   494us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:57.683569 (+616383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.018431 (+334862us) spinlock_profiling.cc:243] Waited 576 ms on lock 0x7b54003f1bd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:58.018604 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1324289920}
I20260709 12:10:57.998211 25797 consensus_queue.cc:1048] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:10:57.969870 25553 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:58.052714 25553 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:10:58.053503 22450 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1680) took 2431 ms (client timeout 1831 ms). Trace:
W20260709 12:10:58.053936 22450 rpcz_store.cc:269] 0709 12:10:55.621663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.632027 (+ 10364us) service_pool.cc:224] Handling call
0709 12:10:58.053291 (+2421264us) spinlock_profiling.cc:243] Waited 717 ms on lock 0x7b54004051d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:58.053412 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1649683200}
I20260709 12:10:58.054608 25757 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:58.033295 23120 raft_consensus.cc:1275] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
W20260709 12:10:58.034946 25829 log.cc:927] Time spent T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 12:10:58.035175 25670 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:58.035867 25836 log.cc:927] Time spent T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:10:58.036525 25400 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:57.986195 25665 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:58.071517 25670 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:58.072110 25665 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:58.073549 23116 raft_consensus.cc:1240] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:58.076773 25740 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:58.078441 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:58.079070 22523 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:58.037106 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:58.080477 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:58.080982 22605 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:58.083590 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:58.085325 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:58.085901 22531 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.087890 22422 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:58.088994 25755 raft_consensus.cc:2749] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:58.039047 25676 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:58.040732 25542 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:57.997375 25737 consensus_meta.cc:287] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 1.412s	user 0.005s	sys 0.008s
I20260709 12:10:58.042524 25788 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:57.971050 25762 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:58.049310 22601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2453) took 1096 ms. Trace:
I20260709 12:10:58.094615 22523 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 6.
I20260709 12:10:58.094808 22601 rpcz_store.cc:276] 0709 12:10:56.953224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.596505 (+643281us) service_pool.cc:224] Handling call
0709 12:10:57.596780 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:57.720019 (+123239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:57.720050 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:57.720096 (+    46us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:57.720133 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.049070 (+328937us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b5400448c54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:58.049116 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.049253 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":273663360}
I20260709 12:10:58.095896 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:58.096131 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:58.055917 22527 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56940 (request call id 1986) took 1704 ms (client timeout 1853 ms). Trace:
I20260709 12:10:58.056005 25759 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:58.056568 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:58.098569 22606 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:58.010262 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:58.061267 23120 pending_rounds.cc:85] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270: Aborting all ops after (but not including) 6
I20260709 12:10:58.100010 23120 pending_rounds.cc:107] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:10:58.100360 23120 raft_consensus.cc:2889] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:58.043269 25536 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:58.096705 22523 raft_consensus.cc:2393] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 8: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
W20260709 12:10:58.096880 22527 rpcz_store.cc:269] 0709 12:10:56.351402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.354034 (+  2632us) service_pool.cc:224] Handling call
0709 12:10:58.055709 (+1701675us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54003f02d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:58.055856 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2603719040}
I20260709 12:10:58.101563 22601 raft_consensus.cc:2393] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 7: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:58.102208 22497 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:10:58.104050 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:58.104621 22601 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:58.101639 22526 raft_consensus.cc:2393] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 7: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:58.110953 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:58.112474 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:58.113113 22527 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:58.094015 25400 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:58.105252 25575 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:58.114120 25400 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:58.114573 25575 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:58.118086 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:58.122077 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:58.097493 25737 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:58.133968 22605 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 6.
I20260709 12:10:58.136704 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:58.134886 22598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45562 (request call id 2043) took 1320 ms. Trace:
I20260709 12:10:58.137012 22422 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:58.135054 22523 raft_consensus.cc:3060] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:58.137255 22598 rpcz_store.cc:276] 0709 12:10:56.814403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.322609 (+508206us) service_pool.cc:224] Handling call
0709 12:10:58.134699 (+812090us) spinlock_profiling.cc:243] Waited 94.7 ms on lock 0x7b5400044054. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:58.134827 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":217854720}
I20260709 12:10:58.138372 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:58.139065 22598 raft_consensus.cc:2393] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 5: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:58.134582 22601 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 9.
I20260709 12:10:58.141732 22422 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:58.146885 22606 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 10.
I20260709 12:10:58.110437 25521 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:58.147904 22523 raft_consensus.cc:2468] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 7.
I20260709 12:10:58.147852 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:58.153826 22455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2241) took 2067 ms. Trace:
I20260709 12:10:58.151218 22531 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 8.
I20260709 12:10:58.154218 22422 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:58.155341 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:58.144829 25536 raft_consensus.cc:2804] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:58.155902 22531 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:58.154119 22455 rpcz_store.cc:276] 0709 12:10:56.086171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.089745 (+  3574us) service_pool.cc:224] Handling call
0709 12:10:56.090058 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:57.336445 (+1246387us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.153658 (+817213us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54002a5154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:58.153779 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2748899584}
I20260709 12:10:58.117910 25798 consensus_queue.cc:1059] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:10:58.158929 25798 raft_consensus.cc:3055] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:58.159269 25575 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:58.159319 25798 raft_consensus.cc:740] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:58.148386 25759 raft_consensus.cc:2804] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:58.117053 25231 consensus_queue.cc:1059] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:10:58.162928 22527 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 9.
I20260709 12:10:58.163968 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:58.166555 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:58.152379 25521 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:10:58.167564 22527 raft_consensus.cc:2393] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 8: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:58.145246 25792 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:58.172254 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:58.173593 25792 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:58.173662 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:58.174585 22526 raft_consensus.cc:2393] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 7: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
W20260709 12:10:58.175518 25838 log.cc:927] Time spent T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:10:58.162014 25536 raft_consensus.cc:697] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:58.177533 25536 consensus_queue.cc:237] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:58.181979 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:58.161522 25531 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:58.170063 25521 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.168999 25759 raft_consensus.cc:697] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:58.160421 25798 consensus_queue.cc:260] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:58.195356 25798 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:58.195891 25806 raft_consensus.cc:2243] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:58.183137 22527 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:58.183940 25788 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:58.185869 25737 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:58.189953 25759 consensus_queue.cc:237] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:58.185350 22531 raft_consensus.cc:2468] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 7.
W20260709 12:10:58.192853 22421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.194036 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:58.204561 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:58.204936 22527 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 7.
I20260709 12:10:58.205334 22531 raft_consensus.cc:3060] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:58.205885 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:58.206445 22527 raft_consensus.cc:2393] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 6: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:58.207402 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:58.208003 22527 raft_consensus.cc:2393] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 5: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:58.208833 22527 raft_consensus.cc:1240] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:58.209017 22526 raft_consensus.cc:2393] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 7: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:58.209929 22527 raft_consensus.cc:1240] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:58.211083 22527 raft_consensus.cc:1275] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:10:58.196764 25531 raft_consensus.cc:697] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:58.212224 22527 raft_consensus.cc:1240] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:58.210282 25400 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:58.219880 22531 raft_consensus.cc:2468] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 6.
I20260709 12:10:58.222291 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:58.223277 22602 raft_consensus.cc:2468] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5.
I20260709 12:10:58.224898 23119 raft_consensus.cc:3055] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:58.225245 23119 raft_consensus.cc:740] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:58.225926 23119 consensus_queue.cc:260] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:58.228345 22422 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:58.229293 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:58.229971 23120 raft_consensus.cc:2393] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 6: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:58.226811 23119 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.231142 25677 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:58.231688 25677 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:58.233726 25677 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:58.235679 22497 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:58.238070 25740 raft_consensus.cc:2804] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:58.238255 25542 consensus_queue.cc:1059] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:58.239394 25737 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.240720 25830 consensus_queue.cc:1059] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:58.241259 25565 consensus_queue.cc:1059] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:10:58.241523 25830 consensus_queue.cc:1059] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:10:58.242558 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.242719 23119 raft_consensus.cc:1275] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 12:10:58.243284 23119 pending_rounds.cc:85] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270: Aborting all ops after (but not including) 8
I20260709 12:10:58.244146 23119 pending_rounds.cc:107] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 12:10:58.244462 23119 raft_consensus.cc:2889] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:58.238523 25740 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:58.246409 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:58.214712 25806 pending_rounds.cc:70] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f: Trying to abort 1 pending ops.
I20260709 12:10:58.246840 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:58.254215 22449 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.250470 22454 raft_consensus.cc:2410] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:58.258150 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:58.259649 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:58.246933 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:58.251381 22526 raft_consensus.cc:1240] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:58.252897 22453 raft_consensus.cc:1275] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:58.261113 22599 raft_consensus.cc:2368] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 8. Current term is 9.
I20260709 12:10:58.262035 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:58.262733 22599 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.260406 22454 raft_consensus.cc:2393] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 5: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:58.264142 22454 raft_consensus.cc:1240] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:58.265581 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:58.265607 22527 raft_consensus.cc:1240] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 5. Current term is 6. Ops: [4.7-5.8]
I20260709 12:10:58.272531 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:58.273722 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:58.274660 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:58.275238 22452 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
I20260709 12:10:58.276010 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:58.278357 22449 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
I20260709 12:10:58.273177 22454 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.281394 22602 raft_consensus.cc:1275] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:58.282352 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:58.283245 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:58.252660 25740 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:58.242578 25542 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.284392 25542 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:58.285439 25743 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:58.286119 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:58.286410 22455 raft_consensus.cc:1275] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:58.287452 22606 raft_consensus.cc:1240] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:58.291220 22599 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
I20260709 12:10:58.222675 25762 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:58.310199 22599 raft_consensus.cc:1240] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:58.314117 22495 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:58.242652 25565 consensus_queue.cc:1059] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 12:10:58.260950 25806 pending_rounds.cc:77] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f: Aborting op as it isn't in flight: id { term: 3 index: 4 } timestamp: 7305621598776070144 op_type: NO_OP noop_request { }
I20260709 12:10:58.320466 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:58.323590 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:58.289099 25230 raft_consensus.cc:3055] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:58.324622 22599 raft_consensus.cc:2393] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 5: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:58.328859 22602 raft_consensus.cc:1240] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:58.329036 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:58.327111 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:58.270700 25575 consensus_queue.cc:1059] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
W20260709 12:10:58.335506 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 51710.1us
I20260709 12:10:58.339756 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:58.340541 22606 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7.
I20260709 12:10:58.312912 25776 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:58.320431 25806 raft_consensus.cc:2889] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:10:58.344624 22454 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
I20260709 12:10:58.345252 22597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2032) took 2698 ms. Trace:
I20260709 12:10:58.345620 22597 rpcz_store.cc:276] 0709 12:10:55.646406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.849186 (+202780us) service_pool.cc:224] Handling call
0709 12:10:55.849554 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:56.999621 (+1150067us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.345010 (+1345389us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54001c5cd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:58.345198 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2607703424}
I20260709 12:10:58.329895 25230 raft_consensus.cc:740] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:58.348618 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:58.348978 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 105769us
I20260709 12:10:58.343815 25743 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:58.344344 25806 raft_consensus.cc:2272] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:58.311638 25798 consensus_queue.cc:1048] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:10:58.331789 25565 consensus_queue.cc:1059] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:10:58.347155 25575 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:58.324738 25531 consensus_queue.cc:237] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:58.363857 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:58.355950 25542 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:58.362746 25575 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:58.374402 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 60323.8us
I20260709 12:10:58.375242 22497 leader_election.cc:400] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 8. Current term is 9.
I20260709 12:10:58.378405 22497 leader_election.cc:403] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 12:10:58.378727 22603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45562 (request call id 2034) took 2476 ms (client timeout 1579 ms). Trace:
W20260709 12:10:58.379207 22603 rpcz_store.cc:269] 0709 12:10:55.902769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.923979 (+ 21210us) service_pool.cc:224] Handling call
0709 12:10:58.378521 (+2454542us) spinlock_profiling.cc:243] Waited 655 ms on lock 0x7b54000c08d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:58.378657 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1505760512}
I20260709 12:10:58.355574 25743 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:58.367919 25737 raft_consensus.cc:2749] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:58.381660 25743 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:58.384924 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:58.385511 23119 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 6.
I20260709 12:10:58.386402 25521 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:58.364086 25812 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:58.388579 25521 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:58.388630 25812 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:58.390031 25845 raft_consensus.cc:3055] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:58.390465 25845 raft_consensus.cc:740] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:58.391300 25845 consensus_queue.cc:260] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:58.391811 25617 raft_consensus.cc:3055] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:58.392227 25617 raft_consensus.cc:740] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:58.392529 25845 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:58.393023 25617 consensus_queue.cc:260] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:58.377521 25849 raft_consensus.cc:3055] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:58.399569 25849 raft_consensus.cc:740] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:58.400404 25849 consensus_queue.cc:260] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:58.401604 25849 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:58.401898 25230 consensus_queue.cc:260] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:58.404328 22421 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:58.378839 25575 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:58.408213 25538 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:58.409446 23119 raft_consensus.cc:1275] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:58.411339 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:58.411878 23122 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.416227 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:58.417711 22421 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:58.419979 22421 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:58.424829 23122 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
I20260709 12:10:58.431433 25797 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:58.431496 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:58.432525 23122 raft_consensus.cc:2393] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 6: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:58.433249 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:58.433831 23122 raft_consensus.cc:2393] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 9: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:58.445080 22421 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:58.413165 25798 raft_consensus.cc:2749] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 8. Current term is 9.
I20260709 12:10:58.456423 22497 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:58.458416 25798 raft_consensus.cc:2749] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:58.459185 25521 consensus_queue.cc:1059] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:10:58.460269 25521 raft_consensus.cc:3055] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:58.460654 25521 raft_consensus.cc:740] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:58.461468 25521 consensus_queue.cc:260] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:58.462677 25521 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.456039 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:58.414178 25542 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:58.456640 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.464756 25740 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:58.454528 22421 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:58.472352 25806 ts_tablet_manager.cc:1916] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:58.475917 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:58.477211 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:58.479569 22453 raft_consensus.cc:1240] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:58.480113 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:58.480993 25412 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:58.478746 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:58.419108 25230 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.481926 22497 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
W20260709 12:10:58.484196 23087 leader_election.cc:336] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.589s (SENT)
I20260709 12:10:58.513413 23087 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:58.485105 25725 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:10:58.427876 25676 raft_consensus.cc:2749] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:58.490794 23119 raft_consensus.cc:2393] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 7: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:58.491658 22496 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:58.491606 23089 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:58.491590 22600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2438) took 2664 ms. Trace:
W20260709 12:10:58.498361 22569 connection.cc:256] RPC call timeout handler was delayed by -1.3182391759999064s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1831s for a response
W20260709 12:10:58.526175 22569 connection.cc:256] RPC call timeout handler was delayed by -1.0982677910001257s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1505s for a response
W20260709 12:10:58.498436 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 44018.2us
I20260709 12:10:58.527765 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:58.528841 22421 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:58.510790 22449 raft_consensus.cc:2393] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 5: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:58.511888 22603 raft_consensus.cc:1275] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:10:58.457095 25741 raft_consensus.cc:2749] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:58.514703 22454 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
W20260709 12:10:58.515427 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 56516.2us
I20260709 12:10:58.533331 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:58.517693 23087 leader_election.cc:336] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.624s (SENT)
I20260709 12:10:58.455291 25850 consensus_queue.cc:1048] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 12:10:58.523437 25419 raft_consensus.cc:2804] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:58.523883 25412 raft_consensus.cc:2749] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:58.525382 22600 rpcz_store.cc:276] 0709 12:10:55.827206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.893692 (+ 66486us) service_pool.cc:224] Handling call
0709 12:10:55.893965 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:56.572373 (+678408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.491394 (+1919021us) spinlock_profiling.cc:243] Waited 593 ms on lock 0x7b540039a3d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:58.491536 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1364587264}
I20260709 12:10:58.490334 25797 raft_consensus.cc:2749] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:58.534379 23087 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:58.561327 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 43670us
I20260709 12:10:58.536640 22496 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:58.527473 22569 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:58.544770 22448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1687) took 2521 ms. Trace:
I20260709 12:10:58.545017 25676 consensus_queue.cc:1059] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:58.562964 22569 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:58.565088 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:58.565255 22569 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:58.566390 22569 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:58.548179 22599 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
I20260709 12:10:58.550951 22497 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:58.570206 25538 raft_consensus.cc:2804] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:58.517539 25757 raft_consensus.cc:2804] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:58.496996 25738 consensus_queue.cc:1059] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:10:58.571470 25738 raft_consensus.cc:3055] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:58.571919 25738 raft_consensus.cc:740] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:58.573042 25738 consensus_queue.cc:260] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:58.556103 25741 consensus_queue.cc:1048] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:58.556529 25740 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:58.532567 25584 raft_consensus.cc:2804] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:58.497311 25678 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.574731 25738 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:58.576140 25678 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:58.557677 23117 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 9.
I20260709 12:10:58.536942 22421 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:58.564698 25419 raft_consensus.cc:697] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:58.580053 25801 raft_consensus.cc:2804] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:58.580308 25576 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:58.581039 25576 raft_consensus.cc:2804] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:58.580845 25419 consensus_queue.cc:237] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:58.581559 25576 raft_consensus.cc:697] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 8 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:58.583869 25563 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:58.539583 25776 raft_consensus.cc:2749] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:58.510675 25798 consensus_queue.cc:1048] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:10:58.537909 25725 raft_consensus.cc:2804] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:58.592907 25725 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:58.593327 25725 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:58.595495 25718 raft_consensus.cc:2804] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:58.596117 25718 raft_consensus.cc:697] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:58.597061 25718 consensus_queue.cc:237] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:58.563155 22448 rpcz_store.cc:276] 0709 12:10:56.023300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.027109 (+  3809us) service_pool.cc:224] Handling call
0709 12:10:56.027438 (+   329us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:56.027826 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:56.217331 (+189505us) log.cc:844] Serialized 14 byte log entry
0709 12:10:56.864378 (+647047us) spinlock_profiling.cc:243] Waited 6.74 ms on lock 0x7b180032c500. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cca4d64bc 00007f9cc782448b 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc7840c02 00007f9cca4c820b 00007f9cca4cdd23 00007f9cca4ce23a
0709 12:10:56.889313 (+ 24935us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:58.318701 (+1429388us) spinlock_profiling.cc:243] Waited 8.55 ms on lock 0x7b2c00033c98. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc9227a11 00007f9cc9237372 00007f9cca969a01 00007f9cca92e43a 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2
0709 12:10:58.328906 (+ 10205us) log.cc:844] Serialized 52 byte log entry
0709 12:10:58.363928 (+ 35022us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:58.363960 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.364701 (+   741us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:58.544530 (+179829us) raft_consensus.cc:1685] finished
0709 12:10:58.544552 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.544689 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53874,"prepare.queue_time_us":347399,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":27057,"raft.run_cpu_time_us":334,"raft.run_wall_time_us":65142,"spinlock_wait_cycles":35172992,"thread_start_us":331921,"threads_started":3,"wal-append.queue_time_us":356943,"wal-append.run_cpu_time_us":2726,"wal-append.run_wall_time_us":1155364}
I20260709 12:10:58.600528 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:58.601764 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:58.602519 22448 raft_consensus.cc:2393] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 8: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:58.606535 25845 raft_consensus.cc:2749] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:58.558213 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:10:58.562047 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.551846 25850 consensus_queue.cc:1059] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:58.607612 22454 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:58.607784 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.608011 25850 raft_consensus.cc:3055] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:58.609297 23087 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:58.609864 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:58.613009 22451 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
I20260709 12:10:58.608402 25850 raft_consensus.cc:740] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:58.618589 22454 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
I20260709 12:10:58.583899 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:58.619809 22453 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 10.
I20260709 12:10:58.582468 25576 consensus_queue.cc:237] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:58.620283 23121 raft_consensus.cc:2393] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 7: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:10:58.621228 23087 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:58.626314 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:58.626538 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 75720us
I20260709 12:10:58.617146 25584 raft_consensus.cc:697] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:58.620395 25412 raft_consensus.cc:2749] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:58.617493 25757 raft_consensus.cc:697] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:58.627106 25561 raft_consensus.cc:2749] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:58.629421 25796 raft_consensus.cc:2749] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:58.631731 25671 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.631376 25830 raft_consensus.cc:2749] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:58.649837 25805 raft_consensus.cc:3055] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:58.636683 25743 consensus_queue.cc:1059] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:10:58.638844 25850 consensus_queue.cc:260] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:58.653415 25678 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:58.638011 25575 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:58.662199 25805 raft_consensus.cc:740] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:58.683075 25558 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:58.684398 25732 raft_consensus.cc:3055] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:58.685026 25732 raft_consensus.cc:740] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:58.655885 25671 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:58.671587 25801 raft_consensus.cc:697] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:58.675441 25757 consensus_queue.cc:237] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:58.681211 25850 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:58.719904 25671 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:58.722641 25542 raft_consensus.cc:2749] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:58.723418 25805 consensus_queue.cc:260] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:58.727835 25805 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:58.728027 25725 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:58.730321 25725 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:58.732465 25801 consensus_queue.cc:237] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:58.736510 25575 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:58.671451 25584 consensus_queue.cc:237] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:58.686105 25732 consensus_queue.cc:260] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:58.486599 22341 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 263d51d0b43744d899e37466045af890 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 6)
W20260709 12:10:58.793071 22341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 306285us
W20260709 12:10:58.793179 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 256162us
I20260709 12:10:58.805253 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:58.808269 22453 raft_consensus.cc:1275] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:10:58.808928 22453 pending_rounds.cc:85] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f: Aborting all ops after (but not including) 5
I20260709 12:10:58.809217 22453 pending_rounds.cc:107] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:10:58.809548 22453 raft_consensus.cc:2889] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:58.812139 22454 raft_consensus.cc:1275] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:10:58.813205 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:58.814772 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:58.816798 22454 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 6.
I20260709 12:10:58.818528 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:58.819602 22454 raft_consensus.cc:2393] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 6: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:58.817464 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:10:58.820967 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 191067us
I20260709 12:10:58.822398 22497 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:58.824522 22497 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
W20260709 12:10:58.827772 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.829909 25759 raft_consensus.cc:2804] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:58.832800 25419 consensus_queue.cc:1059] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:10:58.839449 22453 raft_consensus.cc:2368] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 9. Current term is 10.
I20260709 12:10:58.831949 22421 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:58.854694 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:58.871095 25676 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:58.871413 22454 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 6.
I20260709 12:10:58.872830 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:58.872488 25676 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:58.874368 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:58.875636 22454 raft_consensus.cc:2410] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:58.876183 25531 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:58.876417 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:58.877009 22454 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:58.880259 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:58.881116 23121 raft_consensus.cc:3060] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:58.869309 25759 raft_consensus.cc:697] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:58.884582 25757 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:58.885663 25757 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:58.887255 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.887177 25538 raft_consensus.cc:697] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:58.889060 25671 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.889178 25538 consensus_queue.cc:237] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:58.889994 25671 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:58.891215 25755 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:58.892153 25755 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:58.892531 25670 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:58.899083 22454 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 7.
W20260709 12:10:58.901659 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 77428us
I20260709 12:10:58.901391 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:58.877024 25531 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:58.904126 22454 raft_consensus.cc:2410] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:10:58.905224 25531 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:58.907147 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:58.908143 22454 raft_consensus.cc:1275] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:10:58.892155 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 67702.8us
I20260709 12:10:58.870366 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:58.910357 22453 raft_consensus.cc:2393] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 6: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:10:58.913479 25575 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:58.913812 22453 raft_consensus.cc:1275] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:10:58.914034 25575 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:58.914624 25575 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.915230 25671 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:58.917881 25732 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.918082 25862 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.918578 22421 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:58.918887 25862 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:58.920794 22421 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:58.926494 25676 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:58.927083 22421 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:58.928311 25558 raft_consensus.cc:2749] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:58.928802 22421 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:58.930120 25676 raft_consensus.cc:2804] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:58.930619 25676 raft_consensus.cc:697] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:58.931814 25676 consensus_queue.cc:237] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:58.932358 25757 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:58.935212 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 324916us
I20260709 12:10:58.935990 25864 raft_consensus.cc:2804] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:58.936547 25864 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:58.936947 25864 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:58.937734 22457 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2244) took 2850 ms (client timeout 1525 ms). Trace:
W20260709 12:10:58.938210 22457 rpcz_store.cc:269] 0709 12:10:56.087206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.091049 (+  3843us) service_pool.cc:224] Handling call
0709 12:10:58.937270 (+2846221us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b54002a5b54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:58.937507 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3674563456}
I20260709 12:10:58.887279 25759 consensus_queue.cc:237] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:58.940116 25762 raft_consensus.cc:2749] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:58.941627 25849 raft_consensus.cc:2749] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:58.943114 22421 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
W20260709 12:10:58.947269 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 44625.3us
I20260709 12:10:58.948987 23121 raft_consensus.cc:2468] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 7.
I20260709 12:10:58.950862 25563 consensus_queue.cc:1059] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:58.957720 22604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:60938 (request call id 25) took 1193 ms. Trace:
I20260709 12:10:58.962388 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:58.963333 22600 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.967686 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:58.968659 23122 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:10:58.969880 22598 raft_consensus.cc:1240] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 8 LEADER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:58.971781 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:58.972677 25762 raft_consensus.cc:2804] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:58.973137 24970 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:58.973811 23123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 1050) took 1684 ms. Trace:
I20260709 12:10:58.974279 23123 rpcz_store.cc:276] 0709 12:10:57.289185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.335483 (+ 46298us) service_pool.cc:224] Handling call
0709 12:10:57.335899 (+   416us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:57.512976 (+177077us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:57.513009 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:57.523775 (+ 10766us) log.cc:844] Serialized 52 byte log entry
0709 12:10:57.692815 (+169040us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:57.712296 (+ 19481us) log.cc:844] Serialized 14 byte log entry
0709 12:10:57.713834 (+  1538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.972988 (+1259154us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b5400750154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:58.973084 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:58.973167 (+    83us) raft_consensus.cc:1685] finished
0709 12:10:58.973286 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.973594 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16503,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":506,"raft.queue_time_us":281,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":24551,"spinlock_wait_cycles":406258432,"thread_start_us":112719,"threads_started":1,"wal-append.queue_time_us":167982,"wal-append.run_cpu_time_us":2693,"wal-append.run_wall_time_us":1123612}
I20260709 12:10:58.973165 25762 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:58.981637 25762 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:58.981817 25415 raft_consensus.cc:3055] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:58.982406 25415 raft_consensus.cc:740] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:58.983745 25415 consensus_queue.cc:260] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:58.984552 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 418123us
I20260709 12:10:58.985316 25415 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.977633 25457 leader_election.cc:290] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:58.976086 25412 raft_consensus.cc:3055] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:58.988233 25412 raft_consensus.cc:740] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:58.990219 25874 consensus_queue.cc:1048] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:10:58.991500 25802 log.cc:927] Time spent T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 1.530s	user 0.004s	sys 0.003s
I20260709 12:10:58.991839 25670 raft_consensus.cc:2749] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:58.993458 22421 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:58.988258 25864 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:58.996310 25457 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:58.996423 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:58.997244 25864 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:58.997108 25457 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:58.995803 23123 raft_consensus.cc:1275] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:58.998037 25812 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:58.998236 25670 raft_consensus.cc:2749] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:58.999490 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:10:59.000741 25818 log.cc:927] Time spent T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 1.316s	user 0.000s	sys 0.002s
I20260709 12:10:58.989672 25412 consensus_queue.cc:260] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:58.958297 22604 rpcz_store.cc:276] 0709 12:10:57.763830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.764260 (+   430us) service_pool.cc:224] Handling call
0709 12:10:58.957241 (+1192981us) spinlock_profiling.cc:243] Waited 82.9 ms on lock 0x7b5400002154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca928853 00007f9ccf8f660a 00007f9cc8e7c7d4 00007f9cc8e7c762 00007f9cc8e7c691 00007f9cc8e7c60c 00007f9cc8e7b8c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:58.957419 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":190695680}
I20260709 12:10:59.009512 25670 consensus_queue.cc:1048] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:10:59.011034 25737 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:59.011775 25737 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:59.014410 25737 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:59.040194 22600 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
W20260709 12:10:59.043191 25873 log.cc:927] Time spent T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:10:59.043095 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:59.043646 23122 raft_consensus.cc:1240] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:59.045111 25457 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:59.052704 22569 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:59.053380 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.054188 25849 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:59.054759 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.055169 25849 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:59.041129 25412 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:59.060762 22421 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:59.061898 23118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 696) took 1533 ms. Trace:
I20260709 12:10:59.062304 23118 rpcz_store.cc:276] 0709 12:10:57.522243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.799016 (+276773us) service_pool.cc:224] Handling call
0709 12:10:57.799346 (+   330us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:57.851676 (+ 52330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:57.851710 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:57.852140 (+   430us) log.cc:844] Serialized 52 byte log entry
0709 12:10:57.870453 (+ 18313us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:57.916876 (+ 46423us) log.cc:844] Serialized 14 byte log entry
0709 12:10:57.931965 (+ 15089us) log.cc:844] Serialized 14 byte log entry
0709 12:10:57.932239 (+   274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.932334 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:58.038677 (+106343us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b18004959a0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc78413f3 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd 0000000000388634 0000000000388479 00007f9cc782483a
0709 12:10:58.561230 (+522553us) spinlock_profiling.cc:243] Waited 4.28 ms on lock 0x7b18004959a0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc78413f3 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd 0000000000388634 0000000000388479 00007f9cc782483a
0709 12:10:59.011862 (+450632us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b18004959a0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc78413f3 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd 0000000000388634 0000000000388479 00007f9cc782483a
0709 12:10:59.015454 (+  3592us) raft_consensus.cc:1685] finished
0709 12:10:59.015474 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:59.055227 (+ 39753us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37838,"prepare.queue_time_us":183021,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":77,"raft.queue_time_us":21267,"raft.run_cpu_time_us":382,"raft.run_wall_time_us":34270,"spinlock_wait_cycles":49252608,"thread_start_us":17209,"threads_started":1,"wal-append.queue_time_us":95078}
I20260709 12:10:59.064548 25536 raft_consensus.cc:2804] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:59.065016 25536 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.065393 25536 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:59.065623 25576 raft_consensus.cc:2749] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:59.041658 25755 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:59.058699 25849 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:59.038599 25575 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:59.091679 22605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "254fb9df2b39405996039a40091b4875"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:10:59.092540 22605 raft_consensus.cc:606] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Received request to transfer leadership to TS c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:59.093019 22605 raft_consensus.cc:614] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:59.093237 22496 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:59.095049 22532 raft_consensus.cc:3055] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:59.095429 22532 raft_consensus.cc:740] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:59.096601 22532 consensus_queue.cc:260] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:59.098045 22532 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:59.066453 25576 consensus_queue.cc:1059] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:10:59.090516 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:59.109691 22450 raft_consensus.cc:1240] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 LEADER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:59.110386 25805 consensus_queue.cc:1059] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:59.111351 22601 raft_consensus.cc:1275] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:59.111444 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:59.087354 25457 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:59.112565 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 483619us
I20260709 12:10:59.117794 22569 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:59.112564 25457 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:59.120643 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:59.121394 23122 raft_consensus.cc:2468] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5.
I20260709 12:10:59.122531 25457 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:59.122537 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:59.123667 23121 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 7.
I20260709 12:10:59.095044 25732 raft_consensus.cc:2749] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:59.083741 25762 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:59.122752 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 745339us
I20260709 12:10:59.132655 23118 raft_consensus.cc:1275] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:59.132762 22497 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
W20260709 12:10:59.131268 25799 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.233s	user 0.000s	sys 0.032s
I20260709 12:10:59.138645 22421 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:59.138259 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:59.142588 23122 raft_consensus.cc:1240] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:59.143345 25806 ts_tablet_manager.cc:1929] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 12:10:59.143913 25806 log.cc:1199] T 1ba02be77861491da7dbcfee1161e46c P c863116d91c14d1ca50d6e8a46a37a8f: Deleting WAL directory at /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-0-root/wals/1ba02be77861491da7dbcfee1161e46c
I20260709 12:10:59.144591 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:10:59.138209 25799 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.254s	user 0.000s	sys 0.033s
I20260709 12:10:59.146482 22602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:10:59.146857 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:59.150488 22454 raft_consensus.cc:1240] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 4. Current term is 6. Ops: []
I20260709 12:10:59.138913 25575 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:59.141134 25676 raft_consensus.cc:2804] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:59.156517 23087 leader_election.cc:400] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 election: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 9. Current term is 10.
I20260709 12:10:59.178933 23087 leader_election.cc:403] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:10:59.158654 25762 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:59.151942 22602 raft_consensus.cc:606] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Received request to transfer leadership to TS 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:59.160071 22569 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:59.146510 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:10:59.165011 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 55809.4us
W20260709 12:10:59.165728 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.167078 25675 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:59.167798 22601 raft_consensus.cc:1275] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:59.168542 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:59.170956 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:59.171502 25563 consensus_queue.cc:1048] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:59.174732 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:59.175575 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:10:59.177052 22457 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 8.
I20260709 12:10:59.180666 22448 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
I20260709 12:10:59.181222 25805 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:59.185292 22602 raft_consensus.cc:614] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:59.188799 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:59.184907 22452 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 7.
I20260709 12:10:59.190478 23118 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 8.
I20260709 12:10:59.191133 25565 consensus_queue.cc:1048] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
W20260709 12:10:59.192533 23124 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57328 (request call id 1046) took 1912 ms (client timeout 1882 ms). Trace:
W20260709 12:10:59.192915 23124 rpcz_store.cc:269] 0709 12:10:57.279726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.279871 (+   145us) service_pool.cc:224] Handling call
0709 12:10:59.192143 (+1912272us) spinlock_profiling.cc:243] Waited 467 ms on lock 0x7b54000a19d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:59.192350 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1074786688}
I20260709 12:10:59.193593 25732 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:59.194193 25732 raft_consensus.cc:697] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:59.194639 23124 raft_consensus.cc:1275] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:59.195611 22598 raft_consensus.cc:1240] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:59.195756 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:59.196056 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:59.204993 22597 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.197949 25806 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51832 (request call id 84) took 2408 ms. Trace:
I20260709 12:10:59.198177 23116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 1043) took 2742 ms. Trace:
I20260709 12:10:59.201200 25797 raft_consensus.cc:3055] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:59.202170 25536 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:59.179476 25676 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:59.206862 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 46947us
I20260709 12:10:59.206588 23116 rpcz_store.cc:276] 0709 12:10:56.455364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.455640 (+   276us) service_pool.cc:224] Handling call
0709 12:10:56.456028 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:58.073953 (+1617925us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.197686 (+1123733us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b5400787dd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:59.197995 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3719571840}
I20260709 12:10:59.210027 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:59.213820 22569 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:59.215545 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:59.216444 22526 raft_consensus.cc:2393] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 10: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:59.218533 25536 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:59.219739 22601 raft_consensus.cc:1275] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:59.219398 25732 consensus_queue.cc:237] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:59.203553 25675 raft_consensus.cc:697] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:59.206527 25806 rpcz_store.cc:276] 0709 12:10:56.797745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.853913 (+ 56168us) service_pool.cc:224] Handling call
0709 12:10:57.597244 (+743331us) ts_tablet_manager.cc:1151] Deleting tablet 1ba02be77861491da7dbcfee1161e46c
0709 12:10:57.608513 (+ 11269us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:10:58.725596 (+1117083us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:59.115084 (+389488us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:59.197826 (+ 82742us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":484343,"tablet-delete.queue_time_us":471079,"thread_start_us":259282,"threads_started":1}
W20260709 12:10:59.229902 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 73808us
I20260709 12:10:59.219967 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:59.240263 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:59.240527 25866 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:59.241290 22527 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:10:59.241381 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:59.250190 22523 raft_consensus.cc:2393] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 8: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:59.209834 25797 raft_consensus.cc:740] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:59.247818 23120 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
I20260709 12:10:59.251415 25801 raft_consensus.cc:2804] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:59.257426 22422 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:59.258852 25759 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:59.249680 25866 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:59.261420 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:10:59.259248 25457 raft_consensus.cc:2749] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 9. Current term is 10.
I20260709 12:10:59.259836 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:59.260556 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:59.261142 22531 raft_consensus.cc:1240] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:59.261420 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:59.261714 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:10:59.248317 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 68326.3us
I20260709 12:10:59.263861 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:59.235275 25676 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:59.263368 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:59.209693 25805 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:59.280195 25759 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:59.281133 23087 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:59.275964 25866 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:59.282835 23087 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:59.283850 23087 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:59.288085 25412 raft_consensus.cc:2804] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:59.242220 24970 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.279601 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:59.287577 25675 consensus_queue.cc:237] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:59.288456 22602 raft_consensus.cc:2393] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 7: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:59.286713 22601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74d6480c61e542d583f6f89899989553"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:10:59.280251 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:59.295533 24970 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:59.296440 25457 raft_consensus.cc:2749] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:59.296883 25671 raft_consensus.cc:2804] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:59.298125 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:10:59.298875 25868 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:10:59.302845 22523 raft_consensus.cc:1275] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 12:10:59.331880 22601 raft_consensus.cc:606] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Received request to transfer leadership to TS 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:59.332973 22523 pending_rounds.cc:85] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting all ops after (but not including) 6
I20260709 12:10:59.333611 22601 raft_consensus.cc:614] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:59.333797 22523 pending_rounds.cc:107] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 12:10:59.334055 22523 raft_consensus.cc:2889] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:59.331264 22530 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:10:59.269433 25670 consensus_queue.cc:1048] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:10:59.280284 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:59.304656 25797 consensus_queue.cc:260] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:59.335618 25797 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:59.305452 23087 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:59.306282 25805 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:10:59.345546 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.306299 22525 raft_consensus.cc:2393] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 8: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:59.357712 25801 raft_consensus.cc:697] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
W20260709 12:10:59.359819 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 66249.7us
W20260709 12:10:59.363353 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 120779us
I20260709 12:10:59.365062 22597 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
W20260709 12:10:59.366696 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:59.374118 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.376260 22497 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:59.361554 25536 raft_consensus.cc:2749] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:10:59.389539 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 58480.8us
I20260709 12:10:59.377904 25412 raft_consensus.cc:697] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 7 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:59.384989 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:59.385839 25558 raft_consensus.cc:3055] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:59.393705 25805 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:59.410629 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 79148us
I20260709 12:10:59.412850 25231 consensus_queue.cc:1048] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:10:59.413970 22599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45576 (request call id 2469) took 1085 ms. Trace:
I20260709 12:10:59.414340 22599 rpcz_store.cc:276] 0709 12:10:58.328618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.328834 (+   216us) service_pool.cc:224] Handling call
0709 12:10:59.413650 (+1084816us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b54000e9054. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:59.413795 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":501924736}
I20260709 12:10:59.422642 25628 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:59.423385 25628 raft_consensus.cc:697] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:59.423609 25897 consensus_queue.cc:1048] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:59.424563 25628 consensus_queue.cc:237] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:10:59.425724 25858 log.cc:927] Time spent T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:10:59.426098 25718 consensus_queue.cc:1048] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:10:59.427053 25561 raft_consensus.cc:2804] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:59.427662 25561 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.428136 25561 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.428421 22606 raft_consensus.cc:1217] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Deduplicated request from leader. Original: 5.8->[7.9-7.9]   Dedup: 7.9->[]
I20260709 12:10:59.428536 25718 consensus_queue.cc:1048] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:59.429131 22606 raft_consensus.cc:1240] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:10:59.430506 25740 consensus_queue.cc:1048] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 12:10:59.432157 22606 raft_consensus.cc:1240] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:59.424670 25801 consensus_queue.cc:237] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:59.407085 25576 consensus_queue.cc:1048] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:10:59.427093 22602 raft_consensus.cc:1240] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:59.403817 25558 raft_consensus.cc:740] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:59.446645 22570 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:59.453276 22597 raft_consensus.cc:1217] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Deduplicated request from leader. Original: 5.6->[7.7-7.7]   Dedup: 7.7->[]
I20260709 12:10:59.453930 22597 raft_consensus.cc:1240] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:10:59.463001 22497 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:10:59.463793 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:59.465427 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:10:59.467132 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 62920us
W20260709 12:10:59.461884 25894 log.cc:927] Time spent T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:10:59.470660 22599 raft_consensus.cc:1240] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:10:59.471513 22601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb7fd922979743428612619e8de33af1"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:10:59.472139 22601 raft_consensus.cc:606] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Received request to transfer leadership to TS 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:10:59.472581 22601 raft_consensus.cc:614] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:59.472198 25412 consensus_queue.cc:237] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:59.472738 24970 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:59.475476 22597 raft_consensus.cc:2393] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 8: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:59.475667 25558 consensus_queue.cc:260] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:59.476871 25558 raft_consensus.cc:3060] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:59.480368 23088 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:59.481966 23088 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:59.446223 25805 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:59.483033 25457 raft_consensus.cc:2804] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:59.483630 25457 raft_consensus.cc:697] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 6 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:59.484697 25805 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:59.484628 25457 consensus_queue.cc:237] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:59.486043 22452 raft_consensus.cc:1240] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 9 LEADER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:59.486116 25862 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:59.486354 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:59.486460 25725 raft_consensus.cc:2804] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:59.489014 25849 raft_consensus.cc:2804] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:59.489488 25849 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:59.489959 25849 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:59.490058 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:59.490288 25830 raft_consensus.cc:3055] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:59.490732 25830 raft_consensus.cc:740] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:59.501305 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:59.502002 25874 consensus_queue.cc:1059] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:59.502765 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:59.502947 25874 raft_consensus.cc:3055] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:59.503327 22451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1700) took 1026 ms. Trace:
I20260709 12:10:59.503456 25874 raft_consensus.cc:740] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:10:59.503712 22451 rpcz_store.cc:276] 0709 12:10:58.477074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.479879 (+  2805us) service_pool.cc:224] Handling call
0709 12:10:59.502945 (+1023066us) spinlock_profiling.cc:243] Waited 89 ms on lock 0x7b540016b2d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:59.503150 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":204697856}
I20260709 12:10:59.504447 25874 consensus_queue.cc:260] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:59.456562 25866 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:59.491868 25830 consensus_queue.cc:260] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:59.508016 25866 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:59.508663 25896 raft_consensus.cc:2804] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:59.509148 25896 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.509524 25896 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.511945 22570 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:59.513345 22570 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:59.514125 24970 consensus_queue.cc:1048] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:59.515628 22599 raft_consensus.cc:1275] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:10:59.515888 23088 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:59.515813 25865 raft_consensus.cc:2804] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:59.515661 24970 raft_consensus.cc:2804] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:59.517064 24970 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:59.517527 24970 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.517912 25895 raft_consensus.cc:2804] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:59.518468 25895 raft_consensus.cc:697] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 6 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:59.519515 25895 consensus_queue.cc:237] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:59.520166 25875 consensus_queue.cc:1048] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:10:59.531870 22602 raft_consensus.cc:1275] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:59.533823 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:10:59.538218 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.539031 22604 raft_consensus.cc:3055] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:10:59.539315 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.539382 22604 raft_consensus.cc:740] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:10:59.540330 22604 consensus_queue.cc:260] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:59.540680 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:59.542405 22604 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:59.541675 22453 raft_consensus.cc:1240] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:10:59.542898 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:59.543597 22454 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7.
I20260709 12:10:59.543696 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:59.544287 22453 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:59.544627 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:10:59.545281 22454 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
I20260709 12:10:59.546319 22454 raft_consensus.cc:1240] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:59.553166 25671 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:10:59.553705 25671 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:59.557018 22421 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:59.558233 25740 raft_consensus.cc:2804] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:59.558667 25740 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:59.561205 25740 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:59.561772 25888 log.cc:927] Time spent T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 12:10:59.558915 22421 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:59.565303 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:59.518199 25849 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:10:59.572867 25854 log.cc:927] Time spent T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.886s	user 0.000s	sys 0.002s
I20260709 12:10:59.573276 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:10:59.579211 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.574213 22453 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 10.
I20260709 12:10:59.582610 25565 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.590827 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:59.588313 22606 raft_consensus.cc:1275] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:59.591974 25565 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:10:59.591559 22532 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 8.
I20260709 12:10:59.591432 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:10:59.581573 22450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2258) took 1337 ms. Trace:
I20260709 12:10:59.596688 22598 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
I20260709 12:10:59.598279 22451 raft_consensus.cc:2468] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7.
I20260709 12:10:59.603948 22497 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:59.592767 22570 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:10:59.610788 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 51949.8us
I20260709 12:10:59.611111 22604 raft_consensus.cc:1275] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:59.601718 22450 rpcz_store.cc:276] 0709 12:10:58.244747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.244894 (+   147us) service_pool.cc:224] Handling call
0709 12:10:58.245250 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.110187 (+864937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.581262 (+471075us) spinlock_profiling.cc:243] Waited 821 ms on lock 0x7b5400379e54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:59.581498 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1888920320}
I20260709 12:10:59.591485 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:59.516616 25865 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:10:59.583631 25871 log.cc:927] Time spent T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.641s	user 0.000s	sys 0.003s
I20260709 12:10:59.632723 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:59.576630 25561 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:59.636562 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:59.637395 23088 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:59.638875 22531 raft_consensus.cc:2393] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 8: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:59.641415 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:59.641903 22526 raft_consensus.cc:2393] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 7: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
W20260709 12:10:59.642334 25538 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:10:59.642832 25824 consensus_queue.cc:1048] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:10:59.643247 22339 catalog_manager.cc:5028] TS c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): tablet 1ba02be77861491da7dbcfee1161e46c (table test-workload [id=1e73b97ba677488c8829a696096f4885]) successfully deleted
I20260709 12:10:59.644336 23125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 690) took 2775 ms. Trace:
I20260709 12:10:59.644706 23125 rpcz_store.cc:276] 0709 12:10:56.868660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.960273 (+ 91613us) service_pool.cc:224] Handling call
0709 12:10:57.275901 (+315628us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:57.584824 (+308923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.196143 (+1611319us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b5400135e54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:10:59.643968 (+447825us) spinlock_profiling.cc:243] Waited 315 ms on lock 0x7b5400135e50. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:59.644163 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1432113408}
I20260709 12:10:59.647183 25795 raft_consensus.cc:2804] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:59.652671 23123 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:10:59.657871 22495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.637102 25805 consensus_queue.cc:1048] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:10:59.663496 25585 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.664108 25585 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:59.664542 22527 raft_consensus.cc:1275] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:10:59.667227 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 137191us
I20260709 12:10:59.626240 25797 raft_consensus.cc:2804] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:59.629047 25830 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:59.677626 22532 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 6.
W20260709 12:10:59.678022 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.628815 25866 raft_consensus.cc:2749] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:59.629948 25865 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.675866 22527 raft_consensus.cc:1240] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:59.685839 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:59.675627 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:10:59.694121 22421 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:59.666301 25585 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:59.682148 25412 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:10:59.687812 22451 raft_consensus.cc:1240] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:10:59.669341 25795 raft_consensus.cc:697] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:59.705258 22421 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:59.709039 22421 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:10:59.672158 25797 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:59.711190 22421 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:59.715874 22421 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:59.717590 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:10:59.723821 22531 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 8.
I20260709 12:10:59.725756 22421 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:10:59.726519 22530 raft_consensus.cc:1275] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:59.728883 22454 raft_consensus.cc:1275] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:59.709805 25670 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:59.709580 25536 raft_consensus.cc:2749] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:59.739905 22526 raft_consensus.cc:1240] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 5. Current term is 6. Ops: [4.7-5.8]
I20260709 12:10:59.741776 22602 raft_consensus.cc:2393] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 8: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:10:59.718326 25797 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:59.685148 25741 consensus_queue.cc:1048] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 12:10:59.717434 25762 raft_consensus.cc:2749] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:59.708966 25849 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:59.729564 25862 raft_consensus.cc:2749] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:59.711719 25864 consensus_queue.cc:1048] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:10:59.741576 25457 raft_consensus.cc:2804] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:59.740732 25805 raft_consensus.cc:2749] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:59.762259 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:59.760020 22529 raft_consensus.cc:1275] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:59.765869 22495 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:10:59.767231 23117 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57318 (request call id 874) took 1967 ms (client timeout 2181 ms). Trace:
I20260709 12:10:59.769979 25776 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.770525 25585 consensus_queue.cc:1059] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:10:59.771996 25900 log.cc:927] Time spent T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.267s	user 0.002s	sys 0.000s
I20260709 12:10:59.772507 25795 consensus_queue.cc:237] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:59.773978 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:59.775184 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:59.775719 25565 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:59.776221 22600 raft_consensus.cc:2410] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:10:59.777390 22600 raft_consensus.cc:1275] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:59.779796 22448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1709) took 1253 ms. Trace:
I20260709 12:10:59.780165 22448 rpcz_store.cc:276] 0709 12:10:58.526097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.611374 (+ 85277us) service_pool.cc:224] Handling call
0709 12:10:59.779588 (+1168214us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b54003f48d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:59.779711 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":583906048}
I20260709 12:10:59.781008 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:10:59.785319 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.753161 25412 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:59.791672 25412 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:59.767638 22570 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:10:59.764715 25896 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:59.808773 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:59.809532 25671 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:59.809963 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:59.810364 25896 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:59.810600 22603 raft_consensus.cc:2368] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 7. Current term is 8.
I20260709 12:10:59.811654 25676 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:59.812180 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:59.812366 25671 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:59.813344 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:59.813905 25676 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:59.806931 22525 raft_consensus.cc:1240] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:59.813966 22598 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7.
I20260709 12:10:59.818097 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:59.819217 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:59.821199 22497 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:10:59.822082 25868 raft_consensus.cc:2804] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:59.822671 25868 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.823125 25868 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.831984 22528 raft_consensus.cc:1275] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:59.834585 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:59.848242 25776 raft_consensus.cc:2749] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:59.794736 25902 log.cc:927] Time spent T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.311s	user 0.002s	sys 0.000s
I20260709 12:10:59.775099 22449 raft_consensus.cc:1275] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:59.797194 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:59.858835 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:10:59.799422 22602 raft_consensus.cc:2393] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 9: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:10:59.799542 22495 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:10:59.801007 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 44762.4us
I20260709 12:10:59.763921 25457 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.802317 25866 raft_consensus.cc:2804] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:59.803128 25585 raft_consensus.cc:2804] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:59.803650 25553 raft_consensus.cc:3055] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:59.804455 25759 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:59.806349 25670 raft_consensus.cc:2749] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:59.769116 23117 rpcz_store.cc:269] 0709 12:10:57.665246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.734334 (+ 69088us) service_pool.cc:224] Handling call
0709 12:10:59.599499 (+1865165us) spinlock_profiling.cc:243] Waited 791 ms on lock 0x7b54000a0d54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:10:59.632959 (+ 33460us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1819826432}
W20260709 12:10:59.877458 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 285146us
I20260709 12:10:59.807224 25740 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:59.807703 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:10:59.742125 25755 consensus_queue.cc:1048] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:10:59.808210 25732 consensus_queue.cc:1048] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:10:59.851963 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.794835 25561 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:10:59.851759 25865 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:59.854466 24970 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:59.869366 23123 raft_consensus.cc:1275] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 12:10:59.879082 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 79657.6us
W20260709 12:10:59.882050 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.883659 22448 raft_consensus.cc:1240] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 7. Current term is 8. Ops: []
W20260709 12:10:59.892778 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.876507 25457 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:59.878582 25412 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.876703 25866 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.879621 25553 raft_consensus.cc:740] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:10:59.921274 22449 raft_consensus.cc:1240] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 7. Current term is 8. Ops: []
W20260709 12:10:59.923532 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:59.923990 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 286664us
I20260709 12:10:59.927241 22452 raft_consensus.cc:1240] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:10:59.879832 25585 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:10:59.877197 25725 raft_consensus.cc:697] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 8 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:10:59.932060 22598 raft_consensus.cc:1240] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:59.932132 22599 raft_consensus.cc:1240] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:59.950122 25760 raft_consensus.cc:2804] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:59.950754 25760 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.951200 25760 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:59.954811 25412 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:10:59.957578 25412 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:10:59.960211 25865 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:59.968475 24970 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:10:59.939769 22569 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:10:59.994850 22495 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:10:59.926751 25866 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:59.931491 25585 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:00.005707 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.008968 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:11:00.038810 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 103934us
I20260709 12:10:59.934661 25675 consensus_queue.cc:1048] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.110s
I20260709 12:11:00.074723 23120 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 5.
I20260709 12:11:00.039278 25561 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:00.153738 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:00.137506 25553 consensus_queue.cc:260] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:00.056003 25852 raft_consensus.cc:2749] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:00.139298 25898 raft_consensus.cc:2804] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:00.059355 25874 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:00.148136 23118 raft_consensus.cc:1275] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:11:00.151675 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:00.152853 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 179565us
I20260709 12:11:00.155547 23116 raft_consensus.cc:2393] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 9: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
W20260709 12:11:00.138440 25917 log.cc:927] Time spent T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 12:11:00.189838 22495 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:00.151628 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:00.071218 25895 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:00.189865 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.142794 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:00.196604 23124 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:00.191706 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:00.203217 23122 raft_consensus.cc:2410] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 11 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 12:11:00.204856 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 64586.9us
I20260709 12:11:00.209342 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:11:00.204432 25830 consensus_meta.cc:287] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.513s	user 0.010s	sys 0.000s
I20260709 12:11:00.143164 25675 consensus_queue.cc:1048] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 12:11:00.151930 25798 consensus_queue.cc:1059] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.216s
I20260709 12:11:00.227762 23125 raft_consensus.cc:1275] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:00.209455 25898 raft_consensus.cc:697] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:00.143782 25868 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:00.224000 25553 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:00.226895 25824 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.252014 25824 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:00.254204 25824 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:00.220788 25895 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:00.257421 25895 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:00.203575 25561 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:00.227070 25852 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:00.260007 25797 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:00.263584 25561 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:00.260007 25898 consensus_queue.cc:237] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:00.277290 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 388487us
I20260709 12:11:00.277808 23124 raft_consensus.cc:2468] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 6.
I20260709 12:11:00.285511 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:00.286300 22452 raft_consensus.cc:2393] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 7: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:00.287109 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:00.287817 22452 raft_consensus.cc:2393] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 7: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:00.288169 22421 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:00.288558 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:00.289223 22452 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 9.
I20260709 12:11:00.289888 25542 raft_consensus.cc:2804] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:00.290189 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:00.290560 25542 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:00.303012 25542 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:00.306749 22451 raft_consensus.cc:1240] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:00.231988 25795 consensus_queue.cc:1048] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 12:11:00.216023 25457 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:00.303328 25852 raft_consensus.cc:697] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:00.315918 23087 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:00.210726 25725 consensus_queue.cc:237] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:00.316708 22570 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:00.319540 25561 raft_consensus.cc:2804] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:00.320070 25561 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.310298 25670 consensus_queue.cc:1048] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:11:00.318236 25759 consensus_queue.cc:1048] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:11:00.310140 25675 consensus_queue.cc:1059] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:11:00.324678 25675 raft_consensus.cc:3055] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:00.322827 22456 raft_consensus.cc:1275] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:11:00.325027 25675 raft_consensus.cc:740] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:00.325977 25675 consensus_queue.cc:260] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:00.326427 22456 raft_consensus.cc:1275] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:00.326203 25852 consensus_queue.cc:237] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:00.311276 25776 consensus_queue.cc:1048] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:11:00.327889 22456 raft_consensus.cc:1275] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:11:00.328748 25561 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:00.330055 25776 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.334084 25865 raft_consensus.cc:2749] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:00.330627 25776 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:00.340533 22450 raft_consensus.cc:2410] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:00.319119 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:00.341702 22452 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:00.350296 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.344022 25919 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.346751 25558 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.355677 25776 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:00.358450 25916 log.cc:927] Time spent T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.418s	user 0.002s	sys 0.000s
I20260709 12:11:00.360677 25585 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:00.361508 25231 raft_consensus.cc:3055] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:11:00.362756 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.353434 22421 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:00.347227 25895 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.380664 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:00.369369 25919 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:00.383030 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:00.383662 23119 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 10.
I20260709 12:11:00.383867 25919 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:00.381628 25920 consensus_queue.cc:1048] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:00.384486 25558 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:00.386708 25558 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:00.394644 22570 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:00.368474 25675 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:00.390548 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:00.358892 25457 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:00.345603 25760 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:00.371480 25231 raft_consensus.cc:740] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:00.369020 25864 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:00.400260 22449 raft_consensus.cc:2393] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 6: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:00.421285 23089 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:00.423240 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 44476us
I20260709 12:11:00.423918 25801 raft_consensus.cc:2749] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:11:00.425230 25929 log.cc:927] Time spent T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 12:11:00.426367 22570 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
W20260709 12:11:00.427075 25927 log.cc:927] Time spent T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 12:11:00.427398 25864 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:00.387135 25671 consensus_queue.cc:1048] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:11:00.399873 25920 consensus_queue.cc:1059] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:11:00.398592 25919 consensus_queue.cc:1048] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:11:00.396955 25895 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:00.439198 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 249432us
I20260709 12:11:00.442667 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:00.443176 23119 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:00.456272 22495 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:00.455909 23119 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 9.
W20260709 12:11:00.457201 25924 log.cc:927] Time spent T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.124s	user 0.001s	sys 0.001s
I20260709 12:11:00.459581 22570 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:00.461676 25896 raft_consensus.cc:2749] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:00.462931 22570 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:00.464094 25906 consensus_queue.cc:1048] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:00.465975 25906 raft_consensus.cc:2749] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:00.468850 22570 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:00.469895 25906 raft_consensus.cc:2804] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:11:00.469702 25866 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:00.470863 25906 raft_consensus.cc:697] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
W20260709 12:11:00.471576 25932 log.cc:927] Time spent T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:11:00.472337 25906 consensus_queue.cc:237] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:00.476729 25864 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:00.477993 22570 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:00.479666 25801 raft_consensus.cc:2749] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:00.480340 25760 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:00.481171 25895 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:00.481076 25231 consensus_queue.cc:260] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:00.457861 25759 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.438174 25776 raft_consensus.cc:2749] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:00.437806 25865 raft_consensus.cc:2749] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:00.483848 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 262085us
W20260709 12:11:00.484803 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 63601us
I20260709 12:11:00.447674 25797 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:00.504935 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:00.478483 25542 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:00.509903 22453 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 8.
I20260709 12:11:00.432158 25457 raft_consensus.cc:2749] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:00.515200 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:00.517012 23119 raft_consensus.cc:1813] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Handling vote request from an unknown peer c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:00.517669 23119 raft_consensus.cc:2410] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:11:00.483353 25760 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.437424 25868 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:00.485620 25231 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:00.520749 23087 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:00.518424 25801 consensus_queue.cc:1048] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
W20260709 12:11:00.555270 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 99085.4us
I20260709 12:11:00.517625 25795 raft_consensus.cc:2804] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:00.564917 23089 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:00.514212 25896 consensus_queue.cc:1059] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:11:00.509647 25759 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:00.572490 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:00.557935 25895 raft_consensus.cc:2804] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:00.575102 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:00.575853 22523 raft_consensus.cc:2410] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:11:00.583078 25919 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.583683 25919 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:00.585763 25919 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:00.587280 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:00.587904 22524 raft_consensus.cc:1813] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Handling vote request from an unknown peer c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:00.588476 22524 raft_consensus.cc:2410] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:11:00.576745 25585 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:00.544457 25561 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:00.595813 22570 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:00.597752 22532 raft_consensus.cc:2410] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:11:00.599882 25542 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:00.556075 25760 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:00.604423 22452 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 8.
I20260709 12:11:00.576778 25895 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.578203 25671 raft_consensus.cc:2749] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:00.611243 25895 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:00.614478 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 49665.2us
I20260709 12:11:00.615796 25866 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:00.617509 22569 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 2.134s (SENT) [suppressed 17 similar messages]
I20260709 12:11:00.617692 25561 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:00.619730 25759 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:00.621361 22570 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:00.611413 25906 raft_consensus.cc:2749] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:00.629114 25801 raft_consensus.cc:2749] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:00.632097 22570 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:00.636795 23089 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:00.637008 22525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 668) took 1046 ms. Trace:
I20260709 12:11:00.639179 25671 raft_consensus.cc:2749] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:00.624545 25919 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:00.638929 22525 rpcz_store.cc:276] 0709 12:10:59.593968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.610374 (+ 16406us) service_pool.cc:224] Handling call
0709 12:10:59.806538 (+196164us) spinlock_profiling.cc:243] Waited 6.07 ms on lock 0x7b5800037898. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf907fc0 00007f9ccf8f2929 00007f9ccf8f23d2 00007f9cc8e69bd4
0709 12:10:59.806770 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.816991 (+ 10221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.636746 (+819755us) spinlock_profiling.cc:243] Waited 75.9 ms on lock 0x7b5400384b20. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca8a5dc0 00007f9cca931a02 00007f9cca92ddd6 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2
0709 12:11:00.636930 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":188613888}
I20260709 12:11:00.638489 25801 raft_consensus.cc:2749] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:00.643662 25760 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:00.644465 25919 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:00.646345 25617 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:00.649150 22570 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:00.639462 25759 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.634593 25895 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:00.647935 25865 raft_consensus.cc:3055] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:00.657591 23089 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:00.660562 25671 raft_consensus.cc:2749] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:00.661960 23089 leader_election.cc:400] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 election: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 7. Current term is 8.
I20260709 12:11:00.662309 23089 leader_election.cc:403] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:11:00.659837 25865 raft_consensus.cc:740] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:00.662902 25671 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:00.646952 25919 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:00.656558 25801 raft_consensus.cc:2804] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:00.672713 23122 raft_consensus.cc:1275] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:11:00.676517 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:00.676733 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:00.677218 22601 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 9.
I20260709 12:11:00.677524 23121 raft_consensus.cc:2393] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 10: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:00.678331 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:00.679399 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:00.679775 23124 raft_consensus.cc:1240] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:00.676532 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:00.680924 22604 raft_consensus.cc:2393] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 8: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:00.681915 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:00.682878 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:11:00.683115 25913 log.cc:927] Time spent T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.740s	user 0.013s	sys 0.004s
I20260709 12:11:00.683409 23122 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:00.683364 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:00.684894 23117 raft_consensus.cc:1240] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 12:11:00.685814 25928 log.cc:927] Time spent T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.301s	user 0.001s	sys 0.000s
I20260709 12:11:00.686131 23117 raft_consensus.cc:1240] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:11:00.663565 25865 consensus_queue.cc:260] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:00.687624 25865 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:00.688097 23116 raft_consensus.cc:1275] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:00.688411 25740 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:00.680716 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:00.652926 25759 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:00.692250 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:00.693959 23124 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 9: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:00.693307 23089 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:00.692996 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:00.697160 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:00.698328 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:00.699113 22601 raft_consensus.cc:2393] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 7: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:00.695376 25561 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:00.699736 25795 raft_consensus.cc:697] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:00.700839 25795 consensus_queue.cc:237] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:00.701501 22450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2282) took 1075 ms. Trace:
I20260709 12:11:00.701892 22450 rpcz_store.cc:276] 0709 12:10:59.625675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.655716 (+ 30041us) service_pool.cc:224] Handling call
0709 12:11:00.701306 (+1045590us) spinlock_profiling.cc:243] Waited 642 ms on lock 0x7b540038a4d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:00.701441 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1476547328}
I20260709 12:11:00.703363 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:00.704464 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:00.705605 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:00.706313 22532 raft_consensus.cc:2393] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 10: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:00.706636 22525 raft_consensus.cc:1275] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:00.707437 23121 raft_consensus.cc:1240] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:11:00.693259 25801 raft_consensus.cc:697] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:00.708094 23123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 897) took 1447 ms. Trace:
I20260709 12:11:00.709182 25801 consensus_queue.cc:237] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:00.714174 22599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2486) took 1193 ms. Trace:
I20260709 12:11:00.714670 22599 rpcz_store.cc:276] 0709 12:10:59.520775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.520988 (+   213us) service_pool.cc:224] Handling call
0709 12:10:59.521306 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.934641 (+413335us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.713866 (+779225us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b54003aedd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:00.714072 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":944394112}
I20260709 12:11:00.716387 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:00.716981 22605 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:00.713452 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:00.718658 22523 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:00.708714 23123 rpcz_store.cc:276] 0709 12:10:59.260684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.264190 (+  3506us) service_pool.cc:224] Handling call
0709 12:10:59.614647 (+350457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.904622 (+289975us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.707868 (+803246us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b54000a0d50. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:00.708026 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":805293952}
I20260709 12:11:00.695354 23089 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:00.721104 22532 raft_consensus.cc:1240] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:11:00.736496 22455 raft_consensus.cc:1240] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 7. Current term is 8. Ops: [5.7-7.8]
W20260709 12:11:00.740171 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 44887.9us
I20260709 12:11:00.742249 23122 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
I20260709 12:11:00.745869 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:00.746486 22532 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:00.747140 25725 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:00.747655 22455 raft_consensus.cc:1240] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 9. Current term is 10. Ops: [7.6-9.7]
I20260709 12:11:00.748908 25759 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:00.749547 25740 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.749660 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:00.750146 25740 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:00.751543 22454 raft_consensus.cc:1240] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:00.752194 25740 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:00.753013 22449 raft_consensus.cc:1275] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:00.753492 25895 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:00.754544 22528 raft_consensus.cc:1275] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 12:11:00.754971 22528 pending_rounds.cc:85] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting all ops after (but not including) 5
I20260709 12:11:00.755223 25671 raft_consensus.cc:2749] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 7. Current term is 8.
I20260709 12:11:00.755237 22528 pending_rounds.cc:107] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 12:11:00.755667 22456 raft_consensus.cc:1275] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:00.755779 22528 raft_consensus.cc:2889] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:00.759743 22452 raft_consensus.cc:1275] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:11:00.759917 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:00.761085 22524 raft_consensus.cc:1240] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 LEADER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:11:00.761546 22598 raft_consensus.cc:1275] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:00.762954 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:00.741364 23089 leader_election.cc:304] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:00.748835 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:00.764150 22450 raft_consensus.cc:2410] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:11:00.765303 22532 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
I20260709 12:11:00.766019 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:00.766489 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:00.765938 22451 raft_consensus.cc:1240] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 LEADER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:00.775300 23119 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:11:00.786222 22457 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 10.
I20260709 12:11:00.787698 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:00.788358 23123 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 9.
W20260709 12:11:00.795527 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.793732 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:00.791250 25675 consensus_queue.cc:1059] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.013s
W20260709 12:11:00.803892 25942 log.cc:927] Time spent T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:11:00.766064 25538 consensus_queue.cc:1059] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:11:00.794162 25457 raft_consensus.cc:2749] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:00.821779 25740 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.822567 25740 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:00.825448 25740 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:00.830240 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 88966.5us
I20260709 12:11:00.832978 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:00.834144 22525 raft_consensus.cc:1275] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:11:00.833564 23123 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7.
I20260709 12:11:00.795717 25896 consensus_queue.cc:1059] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:11:00.797904 25906 consensus_queue.cc:1059] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:11:00.834438 25671 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:00.863258 22605 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 10.
I20260709 12:11:00.831880 25866 consensus_queue.cc:1059] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:11:00.865674 25412 raft_consensus.cc:3055] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:00.869439 25906 raft_consensus.cc:3055] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:00.880681 25801 raft_consensus.cc:3055] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:11:00.909796 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:00.912998 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.886698 25561 raft_consensus.cc:2749] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:00.914338 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:00.917620 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:00.889106 25412 raft_consensus.cc:740] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:00.868932 25671 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:00.888973 25906 raft_consensus.cc:740] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:00.897569 25538 raft_consensus.cc:3055] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:00.923599 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:00.923771 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:00.911806 25915 log.cc:927] Time spent T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.971s	user 0.002s	sys 0.008s
I20260709 12:11:00.920730 22604 raft_consensus.cc:2410] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:00.894501 25801 raft_consensus.cc:740] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
W20260709 12:11:00.888964 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 96086us
I20260709 12:11:00.927459 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:00.928903 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:00.929814 22598 raft_consensus.cc:2393] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 8: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:00.930646 23125 raft_consensus.cc:1275] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:11:00.923239 25538 raft_consensus.cc:740] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:00.933980 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:00.940375 25865 consensus_queue.cc:1059] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:00.940671 25538 consensus_queue.cc:260] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:00.941710 25538 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:00.943296 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:00.944427 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:00.945943 22422 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:00.946005 25801 consensus_queue.cc:260] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:00.947556 25801 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:00.949080 25906 consensus_queue.cc:260] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:00.946882 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:00.951375 22601 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 10.
I20260709 12:11:00.959811 22569 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:00.954166 22422 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:00.962095 22523 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:11:00.959702 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:00.971110 25906 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:00.974182 25948 log.cc:927] Time spent T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:11:00.976087 25864 raft_consensus.cc:2749] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:00.933980 25919 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.982769 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:00.990033 22457 raft_consensus.cc:2410] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 10 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
W20260709 12:11:01.043174 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.064895 22448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1713) took 1203 ms. Trace:
I20260709 12:11:01.065744 22448 rpcz_store.cc:276] 0709 12:10:59.861618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.864606 (+  2988us) service_pool.cc:224] Handling call
0709 12:10:59.864895 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.923341 (+ 58446us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.063520 (+1140179us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b5400379954. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:01.064809 (+  1289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42719488}
I20260709 12:11:00.981477 23087 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:11:01.067687 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 86279.2us
I20260709 12:11:01.079088 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:01.080224 22457 raft_consensus.cc:2393] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 7: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:01.085724 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:01.085999 23087 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:01.086328 22457 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:01.110924 22421 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:01.121371 22457 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 9.
I20260709 12:11:01.123255 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:01.124126 22452 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:01.106822 25457 raft_consensus.cc:2804] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:01.106819 25558 raft_consensus.cc:2749] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:01.131659 23087 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:00.984356 25952 consensus_queue.cc:1048] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.160s
W20260709 12:11:01.147976 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:01.148470 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.984207 25955 consensus_queue.cc:1048] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.159s
I20260709 12:11:01.084219 25919 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:01.145397 25951 log.cc:927] Time spent T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.290s	user 0.001s	sys 0.000s
I20260709 12:11:01.174018 22452 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 10.
I20260709 12:11:01.113404 25865 consensus_queue.cc:1048] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:11:01.138262 25957 raft_consensus.cc:3055] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:01.137373 25675 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:11:01.175868 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 198007us
I20260709 12:11:00.983927 25412 consensus_queue.cc:260] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:01.184511 22422 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:01.186343 22422 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:01.198586 25457 raft_consensus.cc:697] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 8 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:01.200340 25457 consensus_queue.cc:237] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:01.163499 25755 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:01.169739 25561 raft_consensus.cc:2749] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:01.182359 25957 raft_consensus.cc:740] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
W20260709 12:11:01.224133 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 113398us
W20260709 12:11:01.225492 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 94796.5us
I20260709 12:11:01.225049 25412 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:01.235643 22421 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:11:01.251187 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:01.253648 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:01.255654 25953 log.cc:927] Time spent T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:11:01.233979 25967 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:01.223191 25755 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:01.257571 25967 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:01.259541 25967 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:01.261404 25755 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:01.265403 25967 raft_consensus.cc:2749] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:01.236042 25561 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:01.292817 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 106563us
I20260709 12:11:01.265810 25671 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:01.265405 25963 raft_consensus.cc:2749] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:01.287598 25755 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:01.313628 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:01.314811 22601 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 10.
I20260709 12:11:01.313366 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:01.316120 22422 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:11:01.316725 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 81165.1us
W20260709 12:11:01.318677 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 365857us
W20260709 12:11:01.313012 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 360688us
I20260709 12:11:01.307776 25967 raft_consensus.cc:2804] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:01.299765 25675 raft_consensus.cc:697] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 10 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
W20260709 12:11:01.316279 25956 log.cc:927] Time spent T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 12:11:01.338788 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:01.339483 22452 raft_consensus.cc:2376] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7. Re-sending same reply.
I20260709 12:11:01.340792 22450 raft_consensus.cc:1275] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:01.344022 22448 raft_consensus.cc:1275] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:01.313094 25671 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:01.313974 25755 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.294700 25966 consensus_queue.cc:1048] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:11:01.354992 23089 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:01.319165 25797 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.345170 25671 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:01.362425 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 44327.3us
I20260709 12:11:01.365059 22421 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:01.357683 25457 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.353822 25755 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:01.399513 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.401793 22569 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:01.361750 25969 raft_consensus.cc:2804] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:11:01.412261 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 96216us
I20260709 12:11:01.295890 25957 consensus_queue.cc:260] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:01.415722 22604 raft_consensus.cc:1217] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Deduplicated request from leader. Original: 6.7->[7.8-7.8]   Dedup: 7.8->[]
I20260709 12:11:01.416364 22604 raft_consensus.cc:1240] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:11:01.370437 25797 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:01.468031 23116 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:01.468353 22570 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:01.419445 25969 raft_consensus.cc:697] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 10 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:01.475898 25969 consensus_queue.cc:237] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:01.411681 25457 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:01.496609 23116 raft_consensus.cc:1275] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:01.461539 25979 raft_consensus.cc:2804] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:01.470014 25985 raft_consensus.cc:2804] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:01.471280 25974 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:01.491238 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 70975.8us
I20260709 12:11:01.455457 25975 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:01.516674 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 151892us
I20260709 12:11:01.504779 25985 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:01.465130 25675 consensus_queue.cc:237] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:01.523592 22421 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:01.525488 22421 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:01.526795 22453 raft_consensus.cc:1275] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:11:01.530148 22456 raft_consensus.cc:1240] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:01.515906 25966 raft_consensus.cc:2804] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:01.538847 25671 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:11:01.541252 25983 log.cc:927] Time spent T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 12:11:01.541793 25992 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:01.542320 25457 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:01.542743 25961 raft_consensus.cc:2749] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:01.542387 25992 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:01.544991 25991 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.545374 25992 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:01.545502 25991 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:01.545953 25992 consensus_queue.cc:1048] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:01.517477 25964 consensus_queue.cc:1048] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:11:01.547734 25776 raft_consensus.cc:2749] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:01.534677 25972 consensus_queue.cc:1048] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 12:11:01.533398 25898 raft_consensus.cc:3055] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:01.549674 25797 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:01.549839 25898 raft_consensus.cc:740] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:01.550397 25797 raft_consensus.cc:2804] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:01.550789 25797 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:01.551173 25797 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:01.552521 25991 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:01.542637 25561 raft_consensus.cc:2749] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:01.516083 25801 consensus_queue.cc:1048] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:11:01.520911 25985 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:01.523969 25967 raft_consensus.cc:697] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:01.559106 22602 raft_consensus.cc:1275] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:01.510465 25974 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:01.570420 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:01.531395 25955 consensus_queue.cc:1059] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:11:01.514657 25975 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:01.563182 25896 raft_consensus.cc:3055] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:01.564409 25966 raft_consensus.cc:697] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 9 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:01.564672 25972 consensus_queue.cc:1059] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:11:01.585331 23087 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:11:01.721650 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 136438us
I20260709 12:11:01.728178 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:11:01.729653 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 1.12386e+06us
I20260709 12:11:01.732741 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:01.735060 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.728998 23118 raft_consensus.cc:2468] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 6.
I20260709 12:11:01.743841 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:01.744742 23119 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 9: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
W20260709 12:11:01.727270 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 154948us
I20260709 12:11:01.726123 25671 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:01.579617 25896 raft_consensus.cc:740] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
W20260709 12:11:01.745891 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 237851us
I20260709 12:11:01.752074 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:01.753234 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 126318us
W20260709 12:11:01.755122 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 1.00869e+06us
I20260709 12:11:01.594244 25974 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:01.757318 22455 raft_consensus.cc:1275] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:11:01.576941 25561 consensus_queue.cc:1048] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.170s
I20260709 12:11:01.759442 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:01.760133 22454 raft_consensus.cc:2393] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 8: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:01.723860 25979 raft_consensus.cc:697] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:01.596128 25975 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:01.743640 25986 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.593190 25864 consensus_queue.cc:1048] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.159s
I20260709 12:11:01.757716 22455 pending_rounds.cc:85] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f: Aborting all ops after (but not including) 4
I20260709 12:11:01.765017 22455 pending_rounds.cc:107] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:11:01.765305 22455 raft_consensus.cc:2889] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:01.729416 25585 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:01.745536 25997 raft_consensus.cc:2804] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:01.756207 22496 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:01.663760 25967 consensus_queue.cc:237] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:01.762956 22570 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:01.762928 25801 consensus_queue.cc:1059] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:01.763413 25986 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:01.739375 25963 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:01.767611 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:01.751451 25868 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.663491 25966 consensus_queue.cc:237] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:01.783393 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:01.786293 23120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 1073) took 1106 ms. Trace:
I20260709 12:11:01.788777 22570 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:01.790961 22451 raft_consensus.cc:2393] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 7: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:01.764114 25733 consensus_queue.cc:1059] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:11:01.752985 25671 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:01.804844 22457 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 6.
I20260709 12:11:01.788707 25997 raft_consensus.cc:697] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 9 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:01.790690 23120 rpcz_store.cc:276] 0709 12:11:00.679836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.687099 (+  7263us) service_pool.cc:224] Handling call
0709 12:11:00.687354 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:00.747998 (+ 60644us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:00.792759 (+ 44761us) log.cc:844] Serialized 14 byte log entry
0709 12:11:00.888684 (+ 95925us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:00.888731 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:00.888776 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.785258 (+896482us) spinlock_profiling.cc:243] Waited 60.4 ms on lock 0x7b5400750154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:01.786121 (+   863us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:01.786238 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8441,"prepare.queue_time_us":61309,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":75,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":6643,"spinlock_wait_cycles":138859776,"thread_start_us":127814,"threads_started":2,"wal-append.queue_time_us":136782}
I20260709 12:11:01.809424 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:01.806097 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 49969.4us
I20260709 12:11:01.814272 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:01.791720 25617 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.815080 22451 raft_consensus.cc:2410] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:01.811388 22454 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 10.
I20260709 12:11:01.804257 26009 raft_consensus.cc:2804] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:01.807994 25896 consensus_queue.cc:260] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:01.818599 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:01.810603 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:01.795928 25852 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.819060 25896 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:01.819257 25933 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.819741 25935 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.819979 25830 raft_consensus.cc:3055] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:01.820566 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:01.820708 22529 raft_consensus.cc:1275] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:11:01.820794 25997 consensus_queue.cc:237] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:01.815546 23120 raft_consensus.cc:1275] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:01.819828 25733 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.821630 25231 consensus_queue.cc:1048] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:01.822289 25988 raft_consensus.cc:2804] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:01.823307 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:01.823161 22496 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:01.824075 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:01.789781 25585 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:01.798471 25972 consensus_queue.cc:1048] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 12:11:01.791965 25868 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:01.798779 25963 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:01.825634 22532 raft_consensus.cc:1275] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:01.825387 22524 raft_consensus.cc:1275] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:11:02.609835 22597 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.000s	sys 0.018s
W20260709 12:11:02.662595 22597 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.000s	sys 0.020s
I20260709 12:11:01.919759 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:02.662998 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:02.624523 25640 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:02.663388 23118 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 7.
I20260709 12:11:02.598999 25986 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:02.663981 22529 raft_consensus.cc:2393] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 8: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:02.665030 25852 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:02.538722 25538 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:02.355332 23125 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.010s	sys 0.020s
I20260709 12:11:02.666186 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:02.663992 25640 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:02.666895 23125 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.875s	user 0.015s	sys 0.023s
I20260709 12:11:02.667522 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:02.666565 25538 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:02.679538 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:02.679805 25640 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:02.680531 22523 raft_consensus.cc:2368] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 7. Current term is 8.
W20260709 12:11:01.838629 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.680486 25538 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:02.683915 23118 raft_consensus.cc:1240] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:11:01.804345 25991 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.687170 25991 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:02.689800 25991 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:02.160890 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 187695us
I20260709 12:11:02.705230 25933 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:02.708400 25933 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:02.669867 25585 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:01.826006 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:02.710791 22528 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 9: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:02.711580 25868 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:02.711776 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:02.712116 22572 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.006s	sys 0.002s
W20260709 12:11:02.712492 22572 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.006s	sys 0.002s
I20260709 12:11:02.713368 22528 raft_consensus.cc:1275] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:01.815867 25964 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:02.714340 25964 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:01.927832 25755 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:01.826134 22421 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:11:02.675681 25985 consensus_meta.cc:287] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 1.110s	user 0.013s	sys 0.000s
I20260709 12:11:02.716975 25986 raft_consensus.cc:2804] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:02.716879 25985 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:02.717718 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 899625us
I20260709 12:11:02.719132 25985 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:02.680480 25640 raft_consensus.cc:2804] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:02.719901 25640 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:02.720355 25640 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:01.906809 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.717375 25986 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.722920 23087 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:02.723035 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:02.574908 26005 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:02.723312 25986 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:02.724202 23122 raft_consensus.cc:2410] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:11:02.662599 25671 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:02.724972 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:02.725750 23121 raft_consensus.cc:2468] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 6.
I20260709 12:11:02.726109 26005 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:02.726706 25671 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.727324 25671 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:02.003326 25979 consensus_queue.cc:237] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:02.729800 25671 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:02.667495 25852 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:02.730760 25671 raft_consensus.cc:2804] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:02.223963 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:02.731284 25671 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.731801 25671 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:02.732034 25852 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.732658 25852 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:02.224329 25760 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:02.733700 25760 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:02.736264 25760 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:02.736876 25760 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.737389 25760 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:02.171343 25561 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.739742 25561 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:02.741079 25991 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.741590 25991 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:01.990677 25400 raft_consensus.cc:2804] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:02.742465 25400 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.742899 25400 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:02.743830 25991 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:02.744603 25991 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.745040 25991 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:02.746075 25935 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:02.747337 22527 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 8.
I20260709 12:11:02.246592 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:02.764335 22451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2295) took 1029 ms. Trace:
I20260709 12:11:02.764786 22451 rpcz_store.cc:276] 0709 12:11:01.734446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.156680 (+422234us) service_pool.cc:224] Handling call
0709 12:11:02.764256 (+607576us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:02.277117 25895 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:02.769274 25895 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:02.771965 25733 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:02.774621 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:02.774899 22455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2291) took 1041 ms. Trace:
I20260709 12:11:02.775456 22455 rpcz_store.cc:276] 0709 12:11:01.733317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.798352 (+ 65035us) service_pool.cc:224] Handling call
0709 12:11:02.774819 (+976467us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:01.819828 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:01.808069 25965 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:01.867436 26009 raft_consensus.cc:697] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:02.818796 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:02.819893 23121 raft_consensus.cc:2410] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:11:02.818646 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:02.827886 22455 raft_consensus.cc:1275] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:02.827649 22524 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 8.
I20260709 12:11:01.990973 25984 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.867518 22524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38310 (request call id 684) took 1044 ms. Trace:
W20260709 12:11:02.812786 26010 log.cc:927] Time spent T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.485s	user 0.001s	sys 0.000s
I20260709 12:11:02.775894 25830 raft_consensus.cc:740] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:01.816352 25801 consensus_queue.cc:1048] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 1.053s
I20260709 12:11:02.799489 25868 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.828441 22455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 683) took 1024 ms. Trace:
I20260709 12:11:02.930647 23118 raft_consensus.cc:1240] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 12:11:02.931311 23089 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.025s	sys 0.056s
W20260709 12:11:02.937412 23089 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.025s	sys 0.056s
I20260709 12:11:02.874826 22524 rpcz_store.cc:276] 0709 12:11:01.822648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.776022 (+953374us) service_pool.cc:224] Handling call
0709 12:11:02.867462 (+ 91440us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:02.937603 22455 rpcz_store.cc:276] 0709 12:11:01.803911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.798784 (+994873us) service_pool.cc:224] Handling call
0709 12:11:02.827577 (+ 28793us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:02.828211 (+   634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.828391 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:02.023353 25797 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:01.874858 25617 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:02.941598 25984 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:02.814190 25824 consensus_queue.cc:1048] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.129s
I20260709 12:11:02.932343 25964 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:02.946727 25852 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:02.827394 25965 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:02.187669 25628 consensus_queue.cc:1048] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.599s
I20260709 12:11:02.943553 25868 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:02.983745 23116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 914) took 1262 ms. Trace:
I20260709 12:11:02.953837 25991 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:02.959120 25755 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:02.956120 25985 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:02.985261 23116 rpcz_store.cc:276] 0709 12:11:01.721795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.722827 (+  1032us) service_pool.cc:224] Handling call
0709 12:11:01.744322 (+ 21495us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:01.744685 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.744703 (+    18us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:01.749402 (+  4699us) log.cc:844] Serialized 52 byte log entry
0709 12:11:01.860130 (+110728us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:01.860190 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.860290 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:02.983523 (+1123233us) raft_consensus.cc:1685] finished
0709 12:11:02.983547 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:02.983684 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3005,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":3300,"thread_start_us":96139,"threads_started":1,"wal-append.queue_time_us":1223104}
I20260709 12:11:02.964489 25895 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:02.978036 26016 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:02.996776 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 305616us
I20260709 12:11:02.960546 25733 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:02.998663 22448 raft_consensus.cc:1240] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 LEADER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:11:02.965507 25561 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:02.990338 25801 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:02.995566 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 272712us
I20260709 12:11:02.980935 25935 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:03.006002 22497 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:02.962416 25830 consensus_queue.cc:260] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:03.020071 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 1.19689e+06us
I20260709 12:11:03.007026 25760 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:02.997257 25985 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:03.002213 25933 consensus_queue.cc:1059] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:11:03.010792 25561 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:03.005800 25733 consensus_queue.cc:1059] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:11:03.024274 25988 raft_consensus.cc:697] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:03.060983 22449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 680) took 1308 ms. Trace:
I20260709 12:11:03.002028 26016 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:03.020054 25671 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:03.034637 25830 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:03.037878 26017 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.019675 25935 consensus_queue.cc:1048] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:11:03.068560 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:11:03.070382 22569 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.002s	sys 0.005s
I20260709 12:11:02.998831 26009 consensus_queue.cc:237] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:03.014920 25801 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:03.069545 22449 rpcz_store.cc:276] 0709 12:11:01.752285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.732079 (+979794us) service_pool.cc:224] Handling call
0709 12:11:02.732449 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:02.732653 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:03.001604 (+268951us) log.cc:844] Serialized 14 byte log entry
0709 12:11:03.060639 (+ 59035us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:03.060696 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:03.060746 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.060811 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:03.060929 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4951,"thread_start_us":321800,"threads_started":2}
I20260709 12:11:03.075515 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:03.081079 23116 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 6.
W20260709 12:11:03.081089 22569 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.002s	sys 0.005s
W20260709 12:11:03.092247 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.097769 26025 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:03.098409 26011 log.cc:927] Time spent T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 12:11:03.100025 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 75666.4us
I20260709 12:11:03.098330 26025 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:03.070883 25967 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:03.060216 25561 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:03.107430 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:03.108035 22525 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 5.
W20260709 12:11:03.111193 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 64750.6us
I20260709 12:11:03.086138 25933 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:03.092235 25797 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:02.356346 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:03.145309 22497 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:03.145972 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:03.149864 23116 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:03.144505 22524 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 8.
I20260709 12:11:03.101902 25760 consensus_queue.cc:1048] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
W20260709 12:11:03.137789 26014 log.cc:927] Time spent T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 12:11:03.136802 26031 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:03.107223 25967 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:03.095542 26017 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:03.296296 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:03.228106 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:03.223806 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:03.280959 23122 raft_consensus.cc:1275] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:03.224156 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:03.226817 22451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1740) took 1472 ms. Trace:
I20260709 12:11:03.224521 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:03.182462 22597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43070 (request call id 553) took 1253 ms. Trace:
I20260709 12:11:03.269477 23120 raft_consensus.cc:1275] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:03.280630 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:03.172967 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:03.323366 22524 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 10.
I20260709 12:11:03.324826 23118 raft_consensus.cc:1240] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:03.190634 23116 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 10.
W20260709 12:11:03.231055 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 46216.8us
I20260709 12:11:03.224985 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:03.327736 22529 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 9: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:03.321445 22597 rpcz_store.cc:276] 0709 12:11:01.929402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.929513 (+   111us) service_pool.cc:224] Handling call
0709 12:11:01.936565 (+  7052us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:02.663144 (+726579us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:02.663176 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:02.663665 (+   489us) log.cc:844] Serialized 26 byte log entry
0709 12:11:03.023393 (+359728us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:03.023417 (+    24us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.023464 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:03.182258 (+158794us) raft_consensus.cc:1685] finished
0709 12:11:03.182278 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:03.182407 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":62741,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"thread_start_us":1085489,"threads_started":2,"wal-append.queue_time_us":443986}
I20260709 12:11:03.321141 22451 rpcz_store.cc:276] 0709 12:11:01.754274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.766099 (+1011825us) service_pool.cc:224] Handling call
0709 12:11:02.766697 (+   598us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:02.767161 (+   464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:02.767198 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:02.767940 (+   742us) log.cc:844] Serialized 52 byte log entry
0709 12:11:03.036227 (+268287us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:03.103973 (+ 67746us) log.cc:844] Serialized 14 byte log entry
0709 12:11:03.104175 (+   202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.104255 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:03.226588 (+122333us) raft_consensus.cc:1685] finished
0709 12:11:03.226614 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:03.226765 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":144045,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":31918,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":14742,"thread_start_us":311182,"threads_started":2,"wal-append.queue_time_us":456044}
I20260709 12:11:03.331005 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:03.332000 22451 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 8.
I20260709 12:11:03.210913 22455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 684) took 1395 ms. Trace:
I20260709 12:11:03.219708 26038 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.339811 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:03.328326 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:11:03.181490 26024 log.cc:927] Time spent T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:11:03.351315 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:03.352655 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:11:03.223326 26004 log.cc:927] Time spent T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 1.504s	user 0.003s	sys 0.010s
W20260709 12:11:03.291107 26021 log.cc:927] Time spent T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
W20260709 12:11:03.183988 26015 log.cc:927] Time spent T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 12:11:03.357206 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:03.155126 25984 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:03.357857 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:03.137094 26040 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:11:03.375710 25400 consensus_meta.cc:287] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.632s	user 0.009s	sys 0.002s
I20260709 12:11:03.138213 26028 consensus_queue.cc:1048] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.293s
I20260709 12:11:03.227411 25988 consensus_queue.cc:237] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:03.319137 23117 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 6.
I20260709 12:11:03.371021 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:03.368580 25906 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:03.449702 25906 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:03.453087 26059 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.453624 26059 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:03.455598 26042 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.455813 25628 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.408784 26036 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:11:03.324702 25986 consensus_meta.cc:287] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.600s	user 0.006s	sys 0.004s
I20260709 12:11:03.134526 26026 raft_consensus.cc:3055] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:03.219898 25561 leader_election.cc:290] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:03.275931 25933 raft_consensus.cc:2749] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:03.363353 22531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 2035) took 2802 ms. Trace:
I20260709 12:11:03.275322 25868 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:03.398430 22455 rpcz_store.cc:276] 0709 12:11:01.815973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.952380 (+1136407us) service_pool.cc:224] Handling call
0709 12:11:02.961655 (+  9275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:02.961862 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:03.068098 (+106236us) log.cc:844] Serialized 14 byte log entry
0709 12:11:03.210414 (+142316us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:03.210488 (+    74us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:03.210558 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.210648 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:03.210829 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":172330,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":11708,"raft.queue_time_us":116,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":45715,"thread_start_us":221726,"threads_started":2}
I20260709 12:11:03.359010 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:03.574927 23118 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7.
I20260709 12:11:03.594694 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:03.598476 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:03.599287 22598 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
I20260709 12:11:03.518782 22531 rpcz_store.cc:276] 0709 12:11:00.561354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.562196 (+   842us) service_pool.cc:224] Handling call
0709 12:11:00.573429 (+ 11233us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:01.725153 (+1151724us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:01.725197 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:01.744169 (+ 18972us) log.cc:844] Serialized 26 byte log entry
0709 12:11:02.149887 (+405718us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:02.149970 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.150161 (+   191us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:03.363129 (+1212968us) raft_consensus.cc:1685] finished
0709 12:11:03.363152 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:03.363274 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1189600,"raft.queue_time_us":1168405,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":3515,"thread_start_us":385601,"threads_started":1,"wal-append.queue_time_us":1229754}
I20260709 12:11:03.375628 22456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1738) took 1820 ms. Trace:
I20260709 12:11:03.234439 25896 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:03.172938 25965 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:03.471290 26026 raft_consensus.cc:740] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:03.359032 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:03.279632 25979 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:03.325758 26025 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:03.338027 26031 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:03.384116 25733 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.392067 22421 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:11:03.360881 25640 consensus_meta.cc:287] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.640s	user 0.009s	sys 0.001s
I20260709 12:11:03.224776 25898 consensus_queue.cc:260] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:03.417727 22528 raft_consensus.cc:2410] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:11:03.379654 26017 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:03.427472 23116 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
I20260709 12:11:03.428805 25985 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:03.691696 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:03.436359 22526 raft_consensus.cc:2393] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 8: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:03.436235 25400 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:03.436204 26040 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:03.449030 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:03.219408 25671 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:03.466850 25984 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:03.449335 26006 log.cc:927] Time spent T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 1.639s	user 0.008s	sys 0.025s
I20260709 12:11:03.468324 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:11:03.495146 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.642184 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:03.763271 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:03.656416 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:03.655200 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:03.654851 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:03.671270 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:03.764453 23122 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
I20260709 12:11:03.672310 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:03.639647 22456 rpcz_store.cc:276] 0709 12:11:01.555104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.555238 (+   134us) service_pool.cc:224] Handling call
0709 12:11:01.564418 (+  9180us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:01.637080 (+ 72662us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:11:01.637127 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:01.720421 (+ 83294us) log.cc:844] Serialized 26 byte log entry
0709 12:11:01.813267 (+ 92846us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:11:01.813326 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.375232 (+1561906us) spinlock_profiling.cc:243] Waited 27.4 ms on lock 0x7b540016b2d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:03.375289 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:03.375334 (+    45us) raft_consensus.cc:1685] finished
0709 12:11:03.375351 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:03.375568 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40370,"raft.queue_time_us":50304,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":36265,"spinlock_wait_cycles":63062272,"thread_start_us":50808,"threads_started":1,"wal-append.queue_time_us":1203478}
I20260709 12:11:03.432083 22523 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:03.764232 23118 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:11:03.766527 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:03.693073 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 301059us
I20260709 12:11:03.687714 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:03.691347 26049 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:03.756335 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:03.755937 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:03.759125 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:03.759469 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.468174 25628 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:03.654593 25906 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:03.759977 22524 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
I20260709 12:11:03.519054 25986 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:03.761169 22532 raft_consensus.cc:2393] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 7: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:03.687300 26009 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:03.762210 23125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 917) took 2039 ms. Trace:
I20260709 12:11:03.763370 22601 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7.
I20260709 12:11:03.654197 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:03.768913 22421 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:11:03.772023 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:03.815802 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 46949.4us
I20260709 12:11:03.717180 25961 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:03.433029 26038 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:03.689273 26016 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:03.771956 22526 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:11:03.775406 25898 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:03.822885 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:03.524319 26036 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:03.456300 26042 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:03.756861 26062 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.720829 25640 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:03.801987 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.806104 25865 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:11:03.811861 26045 log.cc:927] Time spent T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:11:03.812243 25919 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:03.814116 22523 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
W20260709 12:11:03.820139 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 240022us
I20260709 12:11:03.762190 26025 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:03.766571 26017 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:03.765486 23120 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
I20260709 12:11:03.691526 25979 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:03.824955 22529 raft_consensus.cc:1240] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:03.822240 23087 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:03.842630 22454 raft_consensus.cc:1240] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:03.824642 22524 raft_consensus.cc:1275] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:03.829474 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:03.844110 22597 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
I20260709 12:11:03.813901 23125 rpcz_store.cc:276] 0709 12:11:01.722696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.722957 (+   261us) service_pool.cc:224] Handling call
0709 12:11:01.746951 (+ 23994us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:01.754817 (+  7866us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.754872 (+    55us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:01.765392 (+ 10520us) log.cc:844] Serialized 52 byte log entry
0709 12:11:02.678435 (+913043us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:03.011331 (+332896us) log.cc:844] Serialized 14 byte log entry
0709 12:11:03.011759 (+   428us) log.cc:844] Serialized 14 byte log entry
0709 12:11:03.012284 (+   525us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.012361 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:03.455628 (+443267us) spinlock_profiling.cc:243] Waited 3.53 ms on lock 0x7b180042e9e0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc78413f3 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd 0000000000388634 0000000000388479 00007f9cc782483a
0709 12:11:03.761984 (+306356us) raft_consensus.cc:1685] finished
0709 12:11:03.762013 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:03.762155 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1851,"prepare.queue_time_us":721180,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":6754,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":9134,"spinlock_wait_cycles":12763264,"thread_start_us":1217982,"threads_started":2,"wal-append.queue_time_us":1167034}
I20260709 12:11:03.687218 25896 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:03.834858 25906 raft_consensus.cc:3055] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:03.723783 25733 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:03.834668 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 120941us
I20260709 12:11:03.834097 22526 raft_consensus.cc:1240] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:03.836088 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:03.836619 22451 raft_consensus.cc:1275] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:11:03.819753 25967 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:03.821398 25755 raft_consensus.cc:2749] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:03.838714 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:03.837761 26032 raft_consensus.cc:2804] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:03.841252 22531 raft_consensus.cc:1240] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:03.843714 22528 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 7.
I20260709 12:11:03.849012 22452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1731) took 2507 ms. Trace:
I20260709 12:11:03.774010 25984 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:03.821354 26009 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:03.854432 22452 rpcz_store.cc:276] 0709 12:11:01.340177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.341630 (+  1453us) service_pool.cc:224] Handling call
0709 12:11:01.341887 (+   257us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:01.413200 (+ 71313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.413240 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:01.418950 (+  5710us) log.cc:844] Serialized 26 byte log entry
0709 12:11:01.739206 (+320256us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:01.739234 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.743077 (+  3843us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:03.448792 (+1705715us) spinlock_profiling.cc:243] Waited 2.18 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:11:03.842217 (+393425us) raft_consensus.cc:1685] finished
0709 12:11:03.842256 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:03.847450 (+  5194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19552,"raft.queue_time_us":169358,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":10389,"spinlock_wait_cycles":5005696,"thread_start_us":278703,"threads_started":2,"wal-append.queue_time_us":297125}
I20260709 12:11:03.861368 22600 raft_consensus.cc:1275] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:03.860357 25967 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.865624 25967 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:03.847551 26028 raft_consensus.cc:2804] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:03.802419 26049 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:03.822481 25961 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:03.849326 25906 raft_consensus.cc:740] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:03.839612 25865 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:03.853969 26032 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:03.883358 22497 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:03.845829 26017 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:03.822969 26026 consensus_queue.cc:260] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:03.851924 26025 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:03.840142 26062 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:03.869891 25919 consensus_queue.cc:1048] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:11:03.885146 22599 raft_consensus.cc:1275] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:11:03.951354 22599 pending_rounds.cc:85] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting all ops after (but not including) 6
I20260709 12:11:03.915961 22603 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
I20260709 12:11:03.951735 22599 pending_rounds.cc:107] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:11:03.952028 22599 raft_consensus.cc:2889] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:03.939739 26064 log.cc:927] Time spent T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 12:11:03.950179 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.891116 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:03.953557 23123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 921) took 1232 ms. Trace:
I20260709 12:11:03.886965 22602 raft_consensus.cc:2468] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7.
I20260709 12:11:03.870683 26028 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:11:03.962071 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 78787.8us
I20260709 12:11:03.955899 23123 rpcz_store.cc:276] 0709 12:11:02.720762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.720911 (+   149us) service_pool.cc:224] Handling call
0709 12:11:02.721215 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:03.036263 (+315048us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:03.036291 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:03.061062 (+ 24771us) log.cc:844] Serialized 26 byte log entry
0709 12:11:03.317758 (+256696us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:03.317796 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.317862 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:03.953346 (+635484us) raft_consensus.cc:1685] finished
0709 12:11:03.953368 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:03.953492 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8946,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"thread_start_us":355103,"threads_started":2,"wal-append.queue_time_us":619198}
I20260709 12:11:03.964008 22497 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:03.936081 26063 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:03.970929 22497 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:03.953001 25640 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:03.974239 25906 consensus_queue.cc:260] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:03.977813 25986 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:03.978439 25906 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:03.978551 26040 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:03.979271 26040 consensus_queue.cc:1048] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:11:03.980157 26056 raft_consensus.cc:2804] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:03.980597 26056 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:03.980937 26056 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:03.983129 26002 consensus_queue.cc:1048] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:11:03.984454 26002 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:03.984935 26002 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:03.986869 26046 log.cc:927] Time spent T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
W20260709 12:11:03.966751 25740 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.858s	user 0.007s	sys 0.023s
I20260709 12:11:03.962208 26028 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:03.997838 26059 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:03.999786 25967 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:04.000602 26036 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:03.968302 26058 raft_consensus.cc:2804] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:04.032205 25957 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:04.032577 26058 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:04.033177 26058 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:03.988605 26053 raft_consensus.cc:2804] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:11:04.003499 26075 consensus_queue.cc:1175] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" responder_term: 9 status { last_received { term: 6 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 8. Current term is 9. Ops: [8.7-8.7]" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:11:03.974383 25830 consensus_meta.cc:287] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.886s	user 0.008s	sys 0.016s
I20260709 12:11:04.035197 26053 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:03.975299 26063 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:04.035631 26053 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:04.037323 26063 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:04.006186 26072 consensus_queue.cc:1048] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:04.008252 26055 consensus_queue.cc:1048] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:11:04.042680 22457 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2287) took 2310 ms (client timeout 2212 ms). Trace:
W20260709 12:11:04.043212 22457 rpcz_store.cc:269] 0709 12:11:01.731875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.732680 (+   805us) service_pool.cc:224] Handling call
0709 12:11:04.042449 (+2309769us) spinlock_profiling.cc:243] Waited 52.1 ms on lock 0x7b54002a5154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:04.042587 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":119867136}
I20260709 12:11:04.050239 25801 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:04.063671 26026 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:04.010079 26042 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:04.012157 25740 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.905s	user 0.008s	sys 0.023s
I20260709 12:11:04.085421 26066 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.085999 26066 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:04.089962 26066 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:04.090585 26038 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:04.025050 25628 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:04.092180 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:04.093127 26031 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:04.093446 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:04.093873 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:04.094179 26049 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:04.094623 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:04.094956 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:04.096179 25797 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.096750 25797 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:04.025759 26007 log.cc:927] Time spent T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 2.307s	user 0.017s	sys 0.021s
I20260709 12:11:04.098469 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:04.011024 25733 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:03.953299 26032 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:04.106828 22449 raft_consensus.cc:2393] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 8: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:04.104710 25985 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.155663 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:04.156391 22531 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 6.
I20260709 12:11:04.115278 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:04.156502 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:04.157248 22523 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 6.
I20260709 12:11:04.104477 25628 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.159037 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:04.159669 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:04.050581 26056 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:04.163859 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:04.162117 22526 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 7.
I20260709 12:11:04.169070 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:04.174008 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:04.174712 25797 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:04.175346 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:04.174094 26017 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:04.176687 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.160876 25985 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:04.175411 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:04.179280 22525 raft_consensus.cc:2376] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11. Re-sending same reply.
I20260709 12:11:04.179533 25985 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:04.197427 23122 raft_consensus.cc:1240] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 9 LEADER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:11:04.186069 26017 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:04.208812 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:04.209043 26017 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:04.210022 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:04.209522 23125 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 6.
I20260709 12:11:04.210824 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:04.211400 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:04.212026 22600 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 9.
I20260709 12:11:04.213865 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:04.221870 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:04.222575 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:04.220434 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 256934us
I20260709 12:11:04.228762 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:04.230937 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 223863us
I20260709 12:11:04.168083 25628 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:04.233271 22450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1732) took 2891 ms. Trace:
I20260709 12:11:04.234488 25952 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:04.234899 22527 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38310 (request call id 676) took 2414 ms (client timeout 1633 ms). Trace:
W20260709 12:11:04.235515 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:04.236789 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 137554us
W20260709 12:11:04.237917 22527 rpcz_store.cc:269] 0709 12:11:01.820334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.823793 (+  3459us) service_pool.cc:224] Handling call
0709 12:11:04.234702 (+2410909us) spinlock_profiling.cc:243] Waited 85.7 ms on lock 0x7b54001f3e54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:04.234810 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":197154688}
I20260709 12:11:04.242625 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:04.236384 22450 rpcz_store.cc:276] 0709 12:11:01.341605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.342236 (+   631us) service_pool.cc:224] Handling call
0709 12:11:01.342533 (+   297us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:01.570029 (+227496us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.570418 (+   389us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:01.575614 (+  5196us) log.cc:844] Serialized 52 byte log entry
0709 12:11:01.723672 (+148058us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:01.723708 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.811358 (+ 87650us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b4800130d58. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9ccf857aa1 00007f9ccf84eb37 00007f9ccf84e9ca 00007f9ccf94626f 00007f9ccf945f37 00007f9ccf95a55c 00007f9ccf95a508 00007f9ccf95a488 00007f9ccf95a443 00007f9ccf9596ec 00007f9cce883a96
0709 12:11:03.372006 (+1560648us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b540019fd54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:03.372065 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:04.024933 (+652868us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:11:04.233064 (+208131us) raft_consensus.cc:1685] finished
0709 12:11:04.233084 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:04.233211 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23391,"raft.queue_time_us":24438,"raft.run_cpu_time_us":8256,"raft.run_wall_time_us":243815,"spinlock_wait_cycles":470812160,"thread_start_us":126770,"threads_started":1,"wal-append.queue_time_us":121926}
I20260709 12:11:04.243353 22599 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:04.239372 23088 connection.cc:256] RPC call timeout handler was delayed by -2.4092698479998944s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1946s for a response
W20260709 12:11:04.245358 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:04.254526 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:04.254944 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.255005 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:04.253762 22570 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
W20260709 12:11:04.255311 23088 connection.cc:256] RPC call timeout handler was delayed by -2.2555059009998786s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1633s for a response
I20260709 12:11:04.260578 25935 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.260963 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:04.264003 23088 connection.cc:256] RPC call timeout handler was delayed by -2.04738708900004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18380000000000002s for a response
W20260709 12:11:04.264544 23088 connection.cc:256] RPC call timeout handler was delayed by -2.0266870890000064s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18610000000000002s for a response
W20260709 12:11:04.264881 23088 connection.cc:256] RPC call timeout handler was delayed by -1.7034683580000092s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1804s for a response
W20260709 12:11:04.265149 23088 connection.cc:256] RPC call timeout handler was delayed by -1.5847597770000448s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2796s for a response
W20260709 12:11:04.265400 23088 connection.cc:256] RPC call timeout handler was delayed by -1.429305900999907s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25510000000000005s for a response
W20260709 12:11:04.265636 23088 connection.cc:256] RPC call timeout handler was delayed by -1.3413963799998783s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15860000000000002s for a response
I20260709 12:11:04.267639 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:04.268373 26009 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:04.268680 25969 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:04.268750 25966 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:04.258028 25919 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.240975 25952 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:04.269423 25966 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:04.269469 25969 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:04.270447 22605 raft_consensus.cc:2410] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:11:04.269505 25919 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:04.271945 25966 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:04.273175 25919 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:04.277329 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.277782 25919 consensus_queue.cc:1048] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:04.278708 25671 consensus_queue.cc:1048] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:04.280756 25963 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:04.281361 22532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56940 (request call id 2050) took 1060 ms. Trace:
I20260709 12:11:04.281761 25969 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:04.284121 26029 raft_consensus.cc:3055] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:04.284545 26029 raft_consensus.cc:740] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:04.244783 26017 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:04.274452 26058 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:04.285363 26029 consensus_queue.cc:260] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:04.286463 26029 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:04.261065 25965 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.288023 25965 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:04.288625 22448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1734) took 2940 ms. Trace:
I20260709 12:11:04.289000 22448 rpcz_store.cc:276] 0709 12:11:01.347937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.348113 (+   176us) service_pool.cc:224] Handling call
0709 12:11:01.370958 (+ 22845us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:03.000131 (+1629173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:04.288380 (+1288249us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b54003cad54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:04.288568 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3742701440}
I20260709 12:11:04.290597 25965 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:04.280761 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:04.279649 25561 consensus_queue.cc:1048] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:04.292140 26053 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:04.292683 26005 leader_election.cc:290] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:04.295913 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:04.295913 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:04.297662 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:04.298740 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.298894 22599 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
I20260709 12:11:04.309196 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:04.257439 25895 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:04.301499 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:04.280404 23088 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:04.302627 22600 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 8.
I20260709 12:11:04.309284 22525 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 8.
I20260709 12:11:04.310110 23117 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 7.
I20260709 12:11:04.310173 22421 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:04.281786 22532 rpcz_store.cc:276] 0709 12:11:03.220938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.339516 (+118578us) service_pool.cc:224] Handling call
0709 12:11:04.281186 (+941670us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b540014fd54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:04.281305 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":796802304}
I20260709 12:11:04.311906 22497 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:04.312584 23120 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 9: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:04.313000 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:04.313560 22600 pending_rounds.cc:85] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting all ops after (but not including) 5
I20260709 12:11:04.313824 22600 pending_rounds.cc:107] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:11:04.313977 22600 raft_consensus.cc:2889] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:04.313127 22421 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:04.317662 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:04.318434 25979 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:04.317744 26074 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:04.319106 26074 raft_consensus.cc:697] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 11 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:04.319701 25896 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:04.320053 26074 consensus_queue.cc:237] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:04.321481 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:04.322299 23118 raft_consensus.cc:2410] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:11:04.323097 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:04.323839 23122 raft_consensus.cc:2393] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 11: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:04.324807 25963 raft_consensus.cc:2804] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:04.325174 25963 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:04.325512 25963 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:04.326390 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:04.327920 22421 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:04.313913 23117 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:11:04.312856 22422 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:04.330766 22422 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:11:04.332571 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 78920.4us
I20260709 12:11:04.334311 22570 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:04.361801 25985 raft_consensus.cc:2749] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:04.335777 25561 raft_consensus.cc:2749] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:04.399713 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:04.401328 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:04.402918 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:04.404625 22528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56940 (request call id 2053) took 1183 ms. Trace:
I20260709 12:11:04.405061 23122 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
I20260709 12:11:04.344208 22421 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:04.363770 25801 raft_consensus.cc:2804] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:04.308197 26066 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.416883 26066 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:04.364173 26009 raft_consensus.cc:2804] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:04.419165 26009 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:04.419564 26009 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:04.424355 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.335646 25797 raft_consensus.cc:2804] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:04.426393 25797 raft_consensus.cc:697] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:04.405187 22528 rpcz_store.cc:276] 0709 12:11:03.221583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.766309 (+544726us) service_pool.cc:224] Handling call
0709 12:11:04.404394 (+638085us) spinlock_profiling.cc:243] Waited 76.5 ms on lock 0x7b54000d52d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:04.404535 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":175858048}
I20260709 12:11:04.364365 25776 raft_consensus.cc:2804] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:04.364655 26081 consensus_queue.cc:1059] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:04.364566 26063 consensus_queue.cc:1048] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:04.259797 25957 consensus_queue.cc:1048] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 12:11:04.262588 25935 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:04.366480 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:04.367312 26073 log.cc:927] Time spent T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 12:11:04.367559 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:04.368026 26031 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:04.333827 25895 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:04.369110 26090 log.cc:927] Time spent T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:11:04.370316 26082 consensus_queue.cc:1059] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:04.371156 26056 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:04.371410 26079 consensus_queue.cc:1059] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:04.371495 26025 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:11:04.372915 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 92575.5us
W20260709 12:11:04.374028 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.375577 22453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1736) took 2848 ms. Trace:
W20260709 12:11:04.376351 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 45697.4us
I20260709 12:11:04.377177 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:04.381322 26028 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:04.382469 22526 raft_consensus.cc:2368] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 8. Current term is 9.
I20260709 12:11:04.384517 26053 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:04.387128 26058 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:04.391119 26032 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:04.438071 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 93992us
I20260709 12:11:04.435451 25801 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:04.444183 26066 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:04.446123 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:04.448734 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:04.452353 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:04.453823 22524 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 7.
I20260709 12:11:04.447346 25776 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:04.464390 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:04.466611 22531 raft_consensus.cc:2410] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:11:04.463107 26031 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:04.447913 25875 raft_consensus.cc:2804] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:05.018929 22605 raft_consensus.cc:1240] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:05.130165 23122 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:11:04.627372 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:04.489167 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:05.131492 23118 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
W20260709 12:11:04.563166 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:04.867666 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:04.684062 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:05.053112 22529 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.046s	sys 0.063s
I20260709 12:11:04.708824 26038 raft_consensus.cc:3055] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:11:05.133924 22529 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.048s	sys 0.065s
I20260709 12:11:05.134155 26038 raft_consensus.cc:740] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:04.749439 25628 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:05.134685 23088 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:04.494292 22530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 2034) took 3933 ms. Trace:
I20260709 12:11:05.135524 25457 raft_consensus.cc:2749] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:05.135959 23088 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:04.580963 26017 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.136799 25457 raft_consensus.cc:2749] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:04.699553 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:05.136968 26017 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:05.137609 22532 raft_consensus.cc:2376] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9. Re-sending same reply.
I20260709 12:11:05.135607 22530 rpcz_store.cc:276] 0709 12:11:00.560969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.561114 (+   145us) service_pool.cc:224] Handling call
0709 12:11:00.561477 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:01.745267 (+1183790us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.745306 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:01.750073 (+  4767us) log.cc:844] Serialized 26 byte log entry
0709 12:11:01.813777 (+ 63704us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:01.813844 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:04.485908 (+2672064us) spinlock_profiling.cc:243] Waited 62.8 ms on lock 0x7b54004015d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:04.485962 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:04.493659 (+  7697us) raft_consensus.cc:1685] finished
0709 12:11:04.493797 (+   138us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:04.494237 (+   440us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1161360,"raft.queue_time_us":1117433,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":5743,"spinlock_wait_cycles":144422144,"thread_start_us":49964,"threads_started":1,"wal-append.queue_time_us":1190203,"wal-append.run_cpu_time_us":1778,"wal-append.run_wall_time_us":1049143}
I20260709 12:11:05.122476 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:05.138458 25457 consensus_queue.cc:1048] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:05.138607 23088 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:05.138883 25875 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:11:05.125571 22523 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.011s	sys 0.027s
W20260709 12:11:05.134245 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.153873 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:11:05.153892 22523 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.012s	sys 0.027s
I20260709 12:11:05.154429 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:04.714231 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:05.133066 22597 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:05.158304 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:05.185240 22524 raft_consensus.cc:2376] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8. Re-sending same reply.
I20260709 12:11:05.136332 25776 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:05.141374 26031 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:05.141494 22496 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:05.124043 22454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2294) took 3389 ms. Trace:
W20260709 12:11:04.713145 22449 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 686) took 1599 ms (client timeout 1534 ms). Trace:
I20260709 12:11:05.132035 23120 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:11:05.136081 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:05.142068 22453 rpcz_store.cc:276] 0709 12:11:01.527679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.527780 (+   101us) service_pool.cc:224] Handling call
0709 12:11:01.528036 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.554797 (+ 26761us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:01.554826 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:01.554866 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:01.554898 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:04.375220 (+2820322us) spinlock_profiling.cc:243] Waited 26.5 ms on lock 0x7b54003f25d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:04.375332 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:04.375491 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61047040}
I20260709 12:11:04.973337 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:05.151655 23124 raft_consensus.cc:2468] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
W20260709 12:11:05.154469 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:04.490825 26083 log.cc:927] Time spent T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.258s	user 0.003s	sys 0.000s
I20260709 12:11:04.627602 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:11:05.106482 25987 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.018s	sys 0.028s
I20260709 12:11:05.185755 22523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 2059) took 1025 ms. Trace:
I20260709 12:11:04.455699 26062 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:05.186487 22605 raft_consensus.cc:1240] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:04.665570 25966 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.481429 26082 raft_consensus.cc:3055] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:05.188180 23119 raft_consensus.cc:1275] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:05.259831 22523 rpcz_store.cc:276] 0709 12:11:04.162692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.167390 (+  4698us) service_pool.cc:224] Handling call
0709 12:11:04.167707 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:04.167918 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:04.454423 (+286505us) log.cc:844] Serialized 14 byte log entry
0709 12:11:05.185429 (+731006us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:05.185478 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:05.185528 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.185588 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:05.185689 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49338,"prepare.queue_time_us":78431,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"thread_start_us":940502,"threads_started":2}
I20260709 12:11:05.263650 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:05.264721 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:05.265707 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:04.808252 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.700917 25400 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:05.190479 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:05.265885 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 124439us
I20260709 12:11:05.268651 22496 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:05.191186 23122 raft_consensus.cc:1275] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:05.021106 25895 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:04.682729 25935 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:05.136080 25801 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:05.143772 25985 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:05.142344 26074 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:05.195288 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:11:05.259560 25987 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.022s	sys 0.032s
I20260709 12:11:05.186177 26056 consensus_queue.cc:1048] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 12:11:05.197144 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:05.123699 26057 consensus_queue.cc:1048] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 12:11:05.185542 25875 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:05.240077 22532 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:11:05.283105 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:05.284248 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:05.259380 22597 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
I20260709 12:11:05.259477 23116 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:11:05.259770 23121 raft_consensus.cc:2468] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:11:05.273046 25400 raft_consensus.cc:2804] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:05.286638 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:05.199662 26017 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:05.290051 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:05.286964 25400 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:05.292296 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:05.281517 25985 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:05.188463 23123 raft_consensus.cc:1240] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:05.262923 26082 raft_consensus.cc:740] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:05.284420 25457 raft_consensus.cc:2749] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:05.272579 25865 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:11:05.260545 22449 rpcz_store.cc:269] 0709 12:11:03.113825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.280326 (+166501us) service_pool.cc:224] Handling call
0709 12:11:04.712892 (+1432566us) spinlock_profiling.cc:243] Waited 778 ms on lock 0x7b54003f39d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:04.713053 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1788496768}
I20260709 12:11:05.156075 23118 raft_consensus.cc:1240] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 9. Current term is 10. Ops: [7.9-9.10]
I20260709 12:11:04.562418 25797 consensus_queue.cc:237] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:05.319387 26002 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:05.325487 22531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56940 (request call id 2070) took 1028 ms. Trace:
I20260709 12:11:05.326004 22531 rpcz_store.cc:276] 0709 12:11:04.296807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.401016 (+104209us) service_pool.cc:224] Handling call
0709 12:11:05.325218 (+924202us) spinlock_profiling.cc:243] Waited 64.3 ms on lock 0x7b54004001d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:05.325410 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":147987712}
I20260709 12:11:05.283123 26074 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:05.332180 26074 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:05.335884 26028 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:05.337334 25985 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:05.337177 26082 consensus_queue.cc:260] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:05.338035 25985 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.339766 26032 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:05.338529 26082 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:05.279137 22527 raft_consensus.cc:2368] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 10. Current term is 11.
I20260709 12:11:05.279810 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:05.135088 26038 consensus_queue.cc:260] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:05.280509 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:05.357257 22523 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:11:05.281256 22524 raft_consensus.cc:2393] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 9: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:05.144623 25952 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:05.272871 25617 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:05.277948 25961 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:11:05.262145 23117 consensus_meta.cc:287] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.927s	user 0.009s	sys 0.002s
I20260709 12:11:05.360488 23117 raft_consensus.cc:2468] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 8.
I20260709 12:11:05.361006 23117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57318 (request call id 930) took 1048 ms. Trace:
I20260709 12:11:05.361302 23117 rpcz_store.cc:276] 0709 12:11:04.312212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.312703 (+   491us) service_pool.cc:224] Handling call
0709 12:11:05.360950 (+1048247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:05.272344 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:05.293416 25400 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:05.274883 25966 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:05.298339 26009 consensus_meta.cc:287] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.878s	user 0.009s	sys 0.000s
I20260709 12:11:05.283931 26053 raft_consensus.cc:2749] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:05.308332 22601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2520) took 1443 ms. Trace:
I20260709 12:11:05.258674 22454 rpcz_store.cc:276] 0709 12:11:01.734202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.668664 (+934462us) service_pool.cc:224] Handling call
0709 12:11:03.842456 (+1173792us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:03.844104 (+  1648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.123793 (+1279689us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54003f3ed0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:05.123968 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2698751744}
I20260709 12:11:05.352382 22528 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:11:05.302620 25776 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:05.357919 22531 raft_consensus.cc:1275] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:05.380067 26040 raft_consensus.cc:3055] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:05.380529 26040 raft_consensus.cc:740] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:05.381446 26040 consensus_queue.cc:260] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:05.384511 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:05.384850 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:05.385622 23122 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 10.
I20260709 12:11:05.382714 26040 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:05.355564 25963 consensus_meta.cc:287] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 1.030s	user 0.013s	sys 0.000s
I20260709 12:11:05.370460 22601 rpcz_store.cc:276] 0709 12:11:03.865315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.866971 (+  1656us) service_pool.cc:224] Handling call
0709 12:11:03.867290 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:03.872309 (+  5019us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:03.872340 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:03.952881 (+ 80541us) log.cc:844] Serialized 26 byte log entry
0709 12:11:04.158914 (+206033us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:04.158953 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:04.159039 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:04.490262 (+331223us) spinlock_profiling.cc:243] Waited 2.53 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:11:05.307943 (+817681us) raft_consensus.cc:1685] finished
0709 12:11:05.307975 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:05.308267 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":64,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":29929,"spinlock_wait_cycles":5813120,"thread_start_us":184329,"threads_started":1,"wal-append.queue_time_us":236349}
I20260709 12:11:05.400315 22601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0da3e85670e74df8af94383289960785"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:11:05.373402 25966 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:05.369002 26009 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:05.338604 25985 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:05.387274 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:11:05.389133 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.368424 22530 raft_consensus.cc:1275] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:05.390277 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:05.390842 22526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56940 (request call id 2061) took 1215 ms. Trace:
W20260709 12:11:05.414079 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.391047 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:05.414582 23122 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
I20260709 12:11:05.414912 23125 raft_consensus.cc:2468] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:11:05.400848 22601 raft_consensus.cc:606] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Received request to transfer leadership to TS 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:05.414462 22526 rpcz_store.cc:276] 0709 12:11:04.168650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.168803 (+   153us) service_pool.cc:224] Handling call
0709 12:11:05.383771 (+1214968us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b540030ded4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:05.383933 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":466024192}
I20260709 12:11:05.392968 25776 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:05.394495 25400 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:05.395794 23116 raft_consensus.cc:1275] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:11:05.412477 22603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45576 (request call id 2508) took 1819 ms (client timeout 2138 ms). Trace:
I20260709 12:11:05.419371 22570 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:05.472649 22527 raft_consensus.cc:1240] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 6. Current term is 7. Ops: []
W20260709 12:11:05.472802 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 53507.6us
I20260709 12:11:05.470625 22598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2516) took 1700 ms. Trace:
I20260709 12:11:05.473506 22570 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:05.474452 22570 leader_election.cc:304] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:05.444195 22601 raft_consensus.cc:1275] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:11:05.472172 22603 rpcz_store.cc:269] 0709 12:11:03.593074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.593179 (+   105us) service_pool.cc:224] Handling call
0709 12:11:05.412242 (+1819063us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54003b3154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:05.412404 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":348408704}
I20260709 12:11:05.461128 22597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "272afea078f74bf19baefd3c1300644d"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:11:05.462735 23123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 748) took 1302 ms. Trace:
I20260709 12:11:05.476326 23123 rpcz_store.cc:276] 0709 12:11:04.160480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.160965 (+   485us) service_pool.cc:224] Handling call
0709 12:11:04.161328 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.295031 (+1133703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.462494 (+167463us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54000a00d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:05.462671 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2359076096}
I20260709 12:11:05.477427 22570 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:11:05.478046 22600 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.971s	user 0.006s	sys 0.055s
W20260709 12:11:05.478332 22600 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.971s	user 0.006s	sys 0.055s
I20260709 12:11:05.487629 22604 raft_consensus.cc:2393] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 8: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:05.473439 22598 rpcz_store.cc:276] 0709 12:11:03.769949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.770103 (+   154us) service_pool.cc:224] Handling call
0709 12:11:03.770455 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:03.852247 (+ 81792us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:04.156546 (+304299us) log.cc:844] Serialized 14 byte log entry
0709 12:11:04.228486 (+ 71940us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:04.228555 (+    69us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:04.228609 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:04.384293 (+155684us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b180045a480. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc78413f3 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd 0000000000388634 0000000000388479 00007f9cc782483a
0709 12:11:04.385376 (+  1083us) spinlock_profiling.cc:243] Waited 4.83 ms on lock 0x7b180045a480. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc780f2a6 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc780f2a6 00007f9cc780f240
0709 12:11:04.385822 (+   446us) spinlock_profiling.cc:243] Waited 4.22 ms on lock 0x7b180045a480. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc780f2a6 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419
0709 12:11:05.361143 (+975321us) spinlock_profiling.cc:243] Waited 4.01 ms on lock 0x7b180045a480. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc77bbc0a 00007f9cd0efb219 00007f9cce80258f 00007f9cc7841571 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd
0709 12:11:05.450921 (+ 89778us) spinlock_profiling.cc:243] Waited 81.6 ms on lock 0x7b5400044054. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:05.450977 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:05.470558 (+ 19581us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11747,"prepare.queue_time_us":362343,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":3790,"raft.queue_time_us":104,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"spinlock_wait_cycles":222743680,"thread_start_us":359258,"threads_started":2,"wal-append.queue_time_us":96856}
I20260709 12:11:05.490711 22570 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:05.493925 24970 raft_consensus.cc:2804] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:05.494441 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:05.494408 24970 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.497537 24970 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:05.505409 22527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1714) took 1060 ms. Trace:
I20260709 12:11:05.502538 22570 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:05.505822 22527 rpcz_store.cc:276] 0709 12:11:04.444950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.355768 (+910818us) service_pool.cc:224] Handling call
0709 12:11:05.370189 (+ 14421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.473080 (+102891us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.505156 (+ 32076us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b540010c7d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:05.505331 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":235219200}
I20260709 12:11:05.404070 25963 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:05.507444 23118 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
I20260709 12:11:05.510603 22570 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:05.511723 22570 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:05.513689 22570 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:05.516987 22597 raft_consensus.cc:606] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Received request to transfer leadership to TS 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:05.517514 22597 raft_consensus.cc:614] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:05.525697 22570 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:05.496457 26025 raft_consensus.cc:2804] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:05.532054 22570 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:05.471520 25957 consensus_queue.cc:1048] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:11:05.505144 25675 raft_consensus.cc:2804] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:05.508150 26016 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:05.527933 25988 raft_consensus.cc:2804] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:05.528483 26002 raft_consensus.cc:2804] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:05.528787 25952 raft_consensus.cc:2804] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:05.553738 22570 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:05.537137 26017 raft_consensus.cc:2804] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:05.559566 26079 raft_consensus.cc:2804] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:05.537523 26025 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:05.574671 22604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45576 (request call id 2535) took 1180 ms. Trace:
I20260709 12:11:05.632320 22604 rpcz_store.cc:276] 0709 12:11:04.394225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.488880 (+ 94655us) service_pool.cc:224] Handling call
0709 12:11:05.574390 (+1085510us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b540039a3d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:05.574589 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":784367872}
I20260709 12:11:05.528650 25961 raft_consensus.cc:2804] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:11:05.622277 22495 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.621s (SENT) [suppressed 34 similar messages]
I20260709 12:11:05.619943 26002 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:05.623421 25952 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:05.628158 25400 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:05.601147 24970 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:05.530382 26075 consensus_queue.cc:1048] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 12:11:05.558590 25675 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:05.528092 25865 consensus_queue.cc:1048] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.094s
I20260709 12:11:05.563059 26031 consensus_queue.cc:1059] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 12:11:05.569584 26016 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:05.641634 25963 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:05.567894 26042 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.636988 26025 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:05.639560 26002 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:05.629719 26017 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:05.643154 25952 raft_consensus.cc:3060] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:05.637202 25961 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:05.629614 26079 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:05.650430 24970 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:05.648432 26016 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:05.646226 25675 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:05.663374 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.658164 26017 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:05.660199 25961 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:05.661522 26079 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:05.659868 25984 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:05.675473 24970 raft_consensus.cc:2804] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:05.691951 24970 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.692389 24970 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:05.661106 25985 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:05.691388 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.694540 22606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2528) took 1328 ms. Trace:
W20260709 12:11:05.703953 22421 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.015s	sys 0.012s
W20260709 12:11:05.706064 22421 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.015s	sys 0.013s
I20260709 12:11:05.708711 24970 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:05.710332 23089 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.000s	sys 0.016s
W20260709 12:11:05.710707 23089 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.000s	sys 0.016s
I20260709 12:11:05.652536 26042 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:05.702059 22606 rpcz_store.cc:276] 0709 12:11:04.366246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.942443 (+576197us) service_pool.cc:224] Handling call
0709 12:11:04.942896 (+   453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:05.027505 (+ 84609us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:05.027552 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:05.028153 (+   601us) log.cc:844] Serialized 26 byte log entry
0709 12:11:05.516321 (+488168us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:05.516377 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.516479 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:05.689904 (+173425us) raft_consensus.cc:1685] finished
0709 12:11:05.689932 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:05.694456 (+  4524us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62173,"raft.queue_time_us":70497,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":2177,"thread_start_us":487697,"threads_started":1,"wal-append.queue_time_us":633688}
W20260709 12:11:05.713263 23088 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.007s	sys 0.007s
W20260709 12:11:05.709209 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 574809us
W20260709 12:11:05.713653 23088 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.007s	sys 0.007s
W20260709 12:11:05.716341 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 447745us
I20260709 12:11:05.715134 22600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2134) took 1403 ms. Trace:
I20260709 12:11:05.717602 22600 rpcz_store.cc:276] 0709 12:11:04.312205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.313080 (+   875us) service_pool.cc:224] Handling call
0709 12:11:04.313397 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:04.315276 (+  1879us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:04.315324 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:04.406465 (+ 91141us) spinlock_profiling.cc:243] Waited 8.67 ms on lock 0x7b2c000fd4f8. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc9227a11 00007f9cc9237372 00007f9cca969a01 00007f9cca92e43a 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2
0709 12:11:04.406828 (+   363us) log.cc:844] Serialized 26 byte log entry
0709 12:11:05.478618 (+1071790us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:05.478652 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.478708 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:05.705453 (+226745us) raft_consensus.cc:1685] finished
0709 12:11:05.705472 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:05.715057 (+  9585us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19992704,"thread_start_us":971477,"threads_started":1,"wal-append.queue_time_us":1209322}
I20260709 12:11:05.686514 26009 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:05.724639 24970 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:05.725186 22420 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.012s	sys 0.003s
W20260709 12:11:05.734035 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 595447us
I20260709 12:11:05.735042 23088 leader_election.cc:400] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 election: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 7. Current term is 8.
I20260709 12:11:05.735924 23088 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:05.736852 22449 raft_consensus.cc:1240] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:05.699908 25628 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:11:05.738500 22497 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.013s	sys 0.022s
I20260709 12:11:05.738036 23088 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:05.736032 22420 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.012s	sys 0.003s
I20260709 12:11:05.741050 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:05.742470 22529 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.013s	sys 0.003s
W20260709 12:11:05.745008 22529 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.013s	sys 0.003s
I20260709 12:11:05.745394 22600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:11:05.746119 22496 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:11:05.738904 22497 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.013s	sys 0.022s
I20260709 12:11:05.748842 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:05.749037 22449 raft_consensus.cc:2393] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 6: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:05.751626 22602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2131) took 1477 ms. Trace:
W20260709 12:11:05.753285 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.714800 25875 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:05.738263 26028 raft_consensus.cc:2749] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:05.757588 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:05.770005 22453 raft_consensus.cc:2410] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:11:05.770335 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:05.770774 22449 raft_consensus.cc:1240] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 11 LEADER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:05.773325 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:05.773638 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:05.774231 22452 raft_consensus.cc:2393] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 9: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:05.774442 22449 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:11:05.752175 22602 rpcz_store.cc:276] 0709 12:11:04.273868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.273989 (+   121us) service_pool.cc:224] Handling call
0709 12:11:04.274311 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:04.274507 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:11:05.363324 (+1088817us) log.cc:844] Serialized 14 byte log entry
0709 12:11:05.751215 (+387891us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:05.751278 (+    63us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:05.751345 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.751431 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:05.751560 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1090430,"prepare.queue_time_us":1091681,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"thread_start_us":379634,"threads_started":1}
I20260709 12:11:05.778649 22497 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
W20260709 12:11:05.779490 22422 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.010s	sys 0.031s
W20260709 12:11:05.779973 22422 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.010s	sys 0.031s
I20260709 12:11:05.764856 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:05.780546 23118 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:11:05.770922 22450 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:11:05.781399 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:05.781952 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:05.781975 23123 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
I20260709 12:11:05.782596 23117 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:11:05.784376 22457 raft_consensus.cc:1240] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:05.785494 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:05.788441 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:05.761193 23088 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:05.792932 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:05.793138 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:05.793524 22456 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
I20260709 12:11:05.794507 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:05.763162 25957 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:05.799499 22455 raft_consensus.cc:1240] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:05.798700 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:05.801604 23121 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7.
I20260709 12:11:05.796636 23116 raft_consensus.cc:1240] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:05.802397 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:05.757838 26053 raft_consensus.cc:2804] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:05.803761 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:05.742036 25628 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:05.808168 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:05.803431 22449 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:05.779834 25457 raft_consensus.cc:2804] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:05.783787 25963 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:11:05.783300 25852 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.004s	sys 0.018s
I20260709 12:11:05.809756 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:05.811450 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:05.816397 22523 raft_consensus.cc:1240] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:05.783370 25966 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.811831 22526 raft_consensus.cc:1275] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:11:05.763150 25617 consensus_queue.cc:1059] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:11:05.813535 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:05.758620 25400 consensus_queue.cc:1059] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:11:05.814597 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:05.817839 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:05.824925 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:05.797207 26058 raft_consensus.cc:2804] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:05.812453 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:05.828449 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:05.828461 22531 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:11:05.819564 23125 raft_consensus.cc:1275] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:05.820433 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:05.818418 22422 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:05.821590 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:05.831300 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:05.825256 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:05.832412 22457 raft_consensus.cc:2410] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:11:05.825518 22603 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:05.824925 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:05.833220 22453 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 10.
I20260709 12:11:05.807736 23088 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:05.826207 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:05.800478 25988 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:05.798745 26028 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:05.834990 22601 raft_consensus.cc:2393] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 8: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
W20260709 12:11:05.820830 25852 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.005s	sys 0.018s
I20260709 12:11:05.804659 26053 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.793682 26060 consensus_queue.cc:1059] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:11:05.815922 25457 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:11:05.848927 22495 leader_election.cc:336] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.849s (SENT)
I20260709 12:11:05.849402 22495 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:05.858374 22569 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.014s	sys 0.021s
W20260709 12:11:05.858815 22569 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.014s	sys 0.021s
I20260709 12:11:05.842064 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:05.828665 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:05.843704 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:05.863476 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 676649us
I20260709 12:11:05.863786 22524 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
I20260709 12:11:05.836576 23088 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:11:05.860658 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 307011us
W20260709 12:11:05.860905 22421 connection.cc:256] RPC call timeout handler was delayed by -1.2730020259998582s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19430000000000003s for a response
I20260709 12:11:05.882509 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:05.883973 22421 connection.cc:256] RPC call timeout handler was delayed by -1.2691825409999637s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2015s for a response
W20260709 12:11:05.884373 22421 connection.cc:256] RPC call timeout handler was delayed by -1.2691825409999637s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2015s for a response
I20260709 12:11:05.887844 22604 raft_consensus.cc:1275] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:11:05.888278 22604 pending_rounds.cc:85] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting all ops after (but not including) 7
I20260709 12:11:05.888556 22604 pending_rounds.cc:107] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:11:05.888803 22604 raft_consensus.cc:2889] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:05.883672 22570 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:05.891521 22570 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:05.892208 24970 raft_consensus.cc:2764] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:11:05.859655 23117 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7.
W20260709 12:11:05.898646 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 49758.3us
I20260709 12:11:05.839804 25988 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:05.899971 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:05.844579 26053 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:05.903646 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:05.904269 22570 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:05.904597 22604 raft_consensus.cc:2368] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 8. Current term is 9.
I20260709 12:11:05.905035 24970 raft_consensus.cc:2804] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:05.905459 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:05.905503 24970 raft_consensus.cc:697] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 8 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:05.906735 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:05.843111 25400 consensus_queue.cc:1243] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer 8701cd5186a949538d8efafb5f987270 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:05.910851 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:05.824606 25966 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:05.868970 25457 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:05.907482 22455 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:11:05.848169 26058 raft_consensus.cc:697] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:05.822396 25963 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:05.916756 22570 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:05.915151 24970 consensus_queue.cc:237] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:05.924674 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:05.921196 26101 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:05.901219 25865 consensus_queue.cc:1048] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:11:05.940995 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:11:05.941677 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 125908us
I20260709 12:11:05.946377 22570 leader_election.cc:400] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 election: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 10. Current term is 11.
I20260709 12:11:05.947647 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:05.902156 25964 raft_consensus.cc:2804] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:05.948207 22570 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:05.949174 22497 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:05.918665 26104 raft_consensus.cc:3055] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:05.956244 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:05.960278 22450 raft_consensus.cc:2393] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 8: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:05.961301 22570 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:05.971339 22455 raft_consensus.cc:2468] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
I20260709 12:11:05.962598 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:05.981460 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:05.938035 25400 raft_consensus.cc:2749] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:05.986371 22598 raft_consensus.cc:2410] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:11:05.937700 25797 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:05.994047 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:05.951462 25964 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.984287 25585 raft_consensus.cc:2804] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:05.956744 25984 raft_consensus.cc:2749] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:11:05.998708 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 160937us
I20260709 12:11:06.003685 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:05.976998 26057 raft_consensus.cc:3055] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:05.962174 26104 raft_consensus.cc:740] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:05.998039 25964 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:06.011751 25400 raft_consensus.cc:2804] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:06.005216 25797 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:06.016582 22532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1698) took 1603 ms. Trace:
I20260709 12:11:06.020064 26038 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:06.022441 22598 raft_consensus.cc:1275] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:06.034492 23118 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
I20260709 12:11:06.041056 22532 rpcz_store.cc:276] 0709 12:11:04.412800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.285102 (+872302us) service_pool.cc:224] Handling call
0709 12:11:05.285400 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:05.292942 (+  7542us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:05.292968 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:05.295535 (+  2567us) log.cc:844] Serialized 26 byte log entry
0709 12:11:05.739720 (+444185us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:05.739756 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.739811 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:06.016346 (+276535us) raft_consensus.cc:1685] finished
0709 12:11:06.016372 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:06.016519 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6853,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":1736,"thread_start_us":442818,"threads_started":1,"wal-append.queue_time_us":605155}
W20260709 12:11:06.020109 26116 log.cc:927] Time spent T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:11:06.048282 22457 raft_consensus.cc:1275] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:05.992720 22529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 2055) took 1818 ms. Trace:
W20260709 12:11:06.046259 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 188711us
I20260709 12:11:05.950660 26101 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:05.996474 26105 raft_consensus.cc:2749] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:06.024444 26057 raft_consensus.cc:740] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:06.042856 25400 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:06.041682 25875 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:06.059974 25801 consensus_meta.cc:287] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.775s	user 0.006s	sys 0.007s
I20260709 12:11:06.041093 26119 raft_consensus.cc:2804] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:06.021016 26079 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:06.115425 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:06.125270 26119 raft_consensus.cc:697] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:06.126271 22455 raft_consensus.cc:2410] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:11:06.131386 22449 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 9.
W20260709 12:11:06.147727 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 311224us
I20260709 12:11:06.056048 26103 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:06.111555 22529 rpcz_store.cc:276] 0709 12:11:04.154895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.155374 (+   479us) service_pool.cc:224] Handling call
0709 12:11:04.166683 (+ 11309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:04.166929 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:04.240888 (+ 73959us) log.cc:844] Serialized 14 byte log entry
0709 12:11:04.431441 (+190553us) spinlock_profiling.cc:243] Waited 3.28 ms on lock 0x7b18003f7f60. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc7823e07 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc7840c02 00007f9cca4c820b 00007f9cca4cdd23 00007f9cca4ce23a 00007f9cca938a2a
0709 12:11:05.941073 (+1509632us) log.cc:844] Serialized 14 byte log entry
0709 12:11:05.972503 (+ 31430us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:05.972558 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:05.972598 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.972723 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:05.972830 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30660,"prepare.queue_time_us":54211,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":1865,"raft.queue_time_us":63919,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":37214,"spinlock_wait_cycles":7550720,"thread_start_us":1566223,"threads_started":4,"wal-append.queue_time_us":1030698}
W20260709 12:11:06.118873 26040 consensus_meta.cc:287] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.718s	user 0.004s	sys 0.007s
W20260709 12:11:06.161051 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 268859us
W20260709 12:11:06.159588 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 183082us
I20260709 12:11:06.170482 22421 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:06.171185 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:06.172049 22449 raft_consensus.cc:2468] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:11:06.179080 22600 raft_consensus.cc:606] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Received request to transfer leadership to TS c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:06.179641 22600 raft_consensus.cc:614] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:06.119009 25400 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:06.113236 26108 raft_consensus.cc:2804] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:06.050621 25984 consensus_queue.cc:1048] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.118s
I20260709 12:11:06.112653 26062 consensus_queue.cc:1059] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
W20260709 12:11:06.197209 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 143783us
I20260709 12:11:06.098671 25865 consensus_queue.cc:1048] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:11:06.197196 22421 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
W20260709 12:11:06.183125 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 116173us
I20260709 12:11:06.190125 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:06.198263 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 190243us
I20260709 12:11:06.118714 25628 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:06.206502 23089 leader_election.cc:400] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 8. Current term is 9.
I20260709 12:11:06.205680 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:06.215989 23089 leader_election.cc:403] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:11:06.220664 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.221153 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:06.222406 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:06.085929 26058 consensus_queue.cc:237] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:06.139494 25801 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:06.227802 22604 raft_consensus.cc:2393] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 9: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:06.232113 25797 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:06.235394 26117 log.cc:927] Time spent T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.230s	user 0.000s	sys 0.000s
I20260709 12:11:06.235170 26119 consensus_queue.cc:237] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:06.189975 26104 consensus_queue.cc:260] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:06.238281 26120 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.245368 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:11:06.267765 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.267843 22456 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:06.268287 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.245985 26126 consensus_queue.cc:1048] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:06.246387 25963 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:06.247046 25966 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:06.270391 25865 raft_consensus.cc:3055] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:06.270817 25865 raft_consensus.cc:740] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:06.247591 22451 raft_consensus.cc:1240] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:06.248217 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:06.200228 26057 consensus_queue.cc:260] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:06.248934 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:11:06.249682 26123 log.cc:927] Time spent T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:11:06.225871 22421 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:06.281734 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:06.282281 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 56501.6us
I20260709 12:11:06.282766 22525 raft_consensus.cc:2393] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 8: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:06.283154 22421 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:11:06.283226 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 167116us
I20260709 12:11:06.224917 23089 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:11:06.284247 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 59451.5us
I20260709 12:11:06.285051 23089 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:11:06.255362 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 49207us
I20260709 12:11:06.204001 26112 raft_consensus.cc:2804] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:06.138857 26106 consensus_queue.cc:1048] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.086s
I20260709 12:11:06.291782 25963 raft_consensus.cc:2804] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:06.292316 25963 raft_consensus.cc:697] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:06.261059 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:06.293566 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:06.203876 26130 raft_consensus.cc:2764] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:11:06.296797 25801 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:06.298916 26032 raft_consensus.cc:2804] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:06.299353 26032 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:06.299675 26032 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:06.193075 26108 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:11:06.245630 26002 consensus_meta.cc:287] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.582s	user 0.008s	sys 0.001s
I20260709 12:11:06.307566 22421 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:06.178637 26103 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:06.279536 22605 raft_consensus.cc:2393] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 9: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:06.251603 26105 raft_consensus.cc:2749] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:06.265909 26118 log.cc:927] Time spent T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.289s	user 0.001s	sys 0.000s
I20260709 12:11:06.288622 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:06.289166 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:06.321836 22455 raft_consensus.cc:2410] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:11:06.293215 25963 consensus_queue.cc:237] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:06.264770 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:06.302371 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 91838.9us
I20260709 12:11:06.310544 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:06.326128 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:06.275893 22603 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 9.
I20260709 12:11:06.329918 22449 raft_consensus.cc:2410] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:11:06.287638 26112 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:06.324409 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:06.336575 22529 raft_consensus.cc:1813] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Handling vote request from an unknown peer c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:06.337163 22529 raft_consensus.cc:2393] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 7: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:06.324456 22525 raft_consensus.cc:1275] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:06.322767 22456 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:11:06.328408 22421 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
W20260709 12:11:06.310860 25952 consensus_meta.cc:287] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.648s	user 0.002s	sys 0.009s
W20260709 12:11:06.309976 25675 consensus_meta.cc:287] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.638s	user 0.011s	sys 0.000s
I20260709 12:11:06.332020 22451 raft_consensus.cc:2393] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 8: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:06.310456 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:06.339653 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 55385.1us
I20260709 12:11:06.306459 26130 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:06.342842 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:06.350126 22455 raft_consensus.cc:2393] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 8: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
W20260709 12:11:06.325372 25961 consensus_meta.cc:287] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.621s	user 0.011s	sys 0.000s
I20260709 12:11:06.309193 26108 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:06.351163 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:06.352806 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:06.419512 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.419732 22529 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 7.
I20260709 12:11:06.324950 26057 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:06.420549 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.337755 25875 raft_consensus.cc:2804] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:06.331584 26028 raft_consensus.cc:2749] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:06.334928 26031 raft_consensus.cc:2764] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:11:06.432130 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:06.440716 22529 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:06.435163 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:06.437166 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 109031us
I20260709 12:11:06.310220 26002 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:06.341741 26112 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:06.448169 22421 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:06.276876 26120 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:06.439963 25875 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:06.461750 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:06.464411 22603 raft_consensus.cc:1240] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:06.320737 25865 consensus_queue.cc:260] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:06.462477 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:11:06.448268 26016 consensus_meta.cc:287] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.777s	user 0.011s	sys 0.000s
I20260709 12:11:06.353768 25952 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:06.466212 22532 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:06.467037 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:06.443856 26137 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:11:06.354172 25675 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:06.469901 22456 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
I20260709 12:11:06.422813 25961 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:06.480141 26103 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:06.461222 26028 raft_consensus.cc:2749] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:06.485590 22454 raft_consensus.cc:1275] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:06.460032 26101 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:06.490165 22532 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 9.
I20260709 12:11:06.499828 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:06.501264 22496 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:06.505102 22525 raft_consensus.cc:2393] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 8: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:06.500941 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:06.506394 22526 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:06.465497 25875 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:06.509528 22597 raft_consensus.cc:1240] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:06.512408 22496 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:06.485239 26105 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:06.517886 26120 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:06.519340 25957 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:11:06.519814 26128 log.cc:927] Time spent T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 12:11:06.522562 26017 consensus_meta.cc:287] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.822s	user 0.008s	sys 0.000s
I20260709 12:11:06.525918 25617 raft_consensus.cc:3055] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:06.526067 26002 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:06.526423 25617 raft_consensus.cc:740] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:06.527436 25617 consensus_queue.cc:260] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:06.530838 22605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45576 (request call id 2536) took 1268 ms (client timeout 1592 ms). Trace:
I20260709 12:11:06.472079 26016 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:06.531268 22605 rpcz_store.cc:269] 0709 12:11:05.263810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.263925 (+   115us) service_pool.cc:224] Handling call
0709 12:11:06.530621 (+1266696us) spinlock_profiling.cc:243] Waited 915 ms on lock 0x7b54000e8654. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:06.530772 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2104776576}
I20260709 12:11:06.532855 26016 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:06.533830 22605 raft_consensus.cc:1240] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:11:06.533953 26104 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:06.534693 25457 consensus_meta.cc:287] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.583s	user 0.008s	sys 0.001s
I20260709 12:11:06.535126 25457 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:06.536681 22606 raft_consensus.cc:1240] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:06.543507 22496 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:06.440379 26130 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:06.526353 26053 consensus_meta.cc:287] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.605s	user 0.010s	sys 0.000s
I20260709 12:11:06.503885 26079 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:06.558926 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:06.559569 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:11:06.550211 26082 consensus_meta.cc:287] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 1.182s	user 0.013s	sys 0.009s
W20260709 12:11:06.509953 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 224993us
I20260709 12:11:06.546788 26103 raft_consensus.cc:2804] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:06.573524 22605 raft_consensus.cc:1240] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:06.519855 25957 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:06.550642 25988 consensus_meta.cc:287] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.631s	user 0.003s	sys 0.007s
I20260709 12:11:06.577944 22456 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:06.552605 22496 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:06.577907 22453 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:06.581142 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:06.536254 25952 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:06.550781 25852 raft_consensus.cc:2804] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:06.581166 22454 raft_consensus.cc:1240] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:06.572938 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:06.572726 25617 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:06.558493 26111 raft_consensus.cc:2749] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:06.585464 22604 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 8.
I20260709 12:11:06.590092 23089 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:11:06.614449 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.594383 23118 raft_consensus.cc:1240] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:11:06.615607 22570 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:06.601156 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:06.602172 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.602346 23122 raft_consensus.cc:1240] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 9. Current term is 10. Ops: [7.9-9.10]
I20260709 12:11:06.605043 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:06.638958 22523 raft_consensus.cc:2393] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 8: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:06.550628 26028 consensus_queue.cc:1059] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:11:06.547343 26017 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:06.557510 26032 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:06.653297 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 63271.2us
I20260709 12:11:06.654963 26032 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:06.634727 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:06.655648 23121 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:06.582592 26103 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:06.659025 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:06.647765 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:06.649300 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:06.647555 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:06.638082 22570 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:06.654595 23089 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:06.558118 26057 consensus_queue.cc:1059] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:11:06.603325 25852 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:06.647727 26082 raft_consensus.cc:2804] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:06.662389 22524 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 9.
I20260709 12:11:06.579646 26053 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:06.663419 23122 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
I20260709 12:11:06.607319 25628 raft_consensus.cc:2804] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:06.665165 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:06.666168 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:06.667205 26115 log.cc:927] Time spent T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.662s	user 0.004s	sys 0.000s
I20260709 12:11:06.653182 22456 raft_consensus.cc:2410] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:06.667973 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:06.672230 25852 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:06.674930 25675 leader_election.cc:290] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:06.678426 26057 raft_consensus.cc:3055] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:06.662781 26058 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.601107 25988 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:06.670608 26016 raft_consensus.cc:2804] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:06.662174 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:06.744462 22454 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:06.686127 22569 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:06.691699 23124 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:06.691852 22453 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7.
I20260709 12:11:06.641640 25952 consensus_queue.cc:1048] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:11:06.699590 23121 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 10.
W20260709 12:11:06.745501 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 59443.6us
I20260709 12:11:06.746847 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:06.748142 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:06.663885 26103 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:06.729226 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:11:06.737589 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 43757.5us
I20260709 12:11:06.751569 22569 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:06.752460 23122 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:06.753688 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:06.744308 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 89783.6us
I20260709 12:11:06.728858 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:06.749286 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:06.751493 22495 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:06.685086 22451 raft_consensus.cc:2393] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 8: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:06.673164 26082 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:06.758242 23089 leader_election.cc:304] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:11:06.759699 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 316769us
I20260709 12:11:06.764027 22529 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 6.
I20260709 12:11:06.728197 25628 raft_consensus.cc:697] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:06.761806 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:06.692858 26161 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.778693 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:06.781798 22451 raft_consensus.cc:2410] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:11:06.782586 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:06.783345 22456 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 10.
I20260709 12:11:06.771212 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:06.772948 22421 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:06.785225 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:06.774696 23124 raft_consensus.cc:2468] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
I20260709 12:11:06.779874 22601 raft_consensus.cc:1240] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:06.730233 26032 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.785218 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:06.791864 22421 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:06.738101 25457 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:06.785391 23089 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:06.778733 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:06.786331 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:06.729908 26057 raft_consensus.cc:740] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:06.789912 22526 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 7.
I20260709 12:11:06.795535 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:06.773494 26107 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.776s	user 0.009s	sys 0.004s
I20260709 12:11:06.756341 26016 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:11:06.779830 26156 log.cc:927] Time spent T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:11:06.832950 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:06.758641 26038 consensus_queue.cc:1059] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.092s
I20260709 12:11:06.766883 26082 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:06.762229 26111 raft_consensus.cc:2749] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:06.757154 26133 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:06.851431 23124 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:06.893573 22457 raft_consensus.cc:2393] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 8: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:06.852334 23122 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
I20260709 12:11:06.767161 26146 consensus_queue.cc:1059] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.100s
I20260709 12:11:06.757390 26125 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:06.854856 22421 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:06.778477 25675 raft_consensus.cc:2804] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:11:06.792071 26115 log.cc:927] Time spent T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:11:06.860183 22456 raft_consensus.cc:2393] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 9: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:06.861827 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:06.927367 22451 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7.
I20260709 12:11:06.928642 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:06.860146 22532 raft_consensus.cc:1240] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 6. Current term is 7. Ops: [4.7-6.8]
I20260709 12:11:06.860747 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:06.789448 26137 raft_consensus.cc:2749] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 8. Current term is 9.
I20260709 12:11:06.750262 26058 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:06.834092 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:06.761757 26002 consensus_queue.cc:1059] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 7, Time since last communication: 0.098s
I20260709 12:11:06.880645 22569 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:06.880429 22495 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:06.771202 26120 consensus_queue.cc:1048] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.093s
W20260709 12:11:06.867616 26107 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.869s	user 0.009s	sys 0.004s
I20260709 12:11:06.850512 26053 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:06.920498 26133 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:06.856602 26140 raft_consensus.cc:2749] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:06.793382 26150 consensus_queue.cc:1048] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 12:11:06.858206 26074 raft_consensus.cc:2749] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:06.862929 25961 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:06.925778 22454 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
W20260709 12:11:06.921485 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 126786us
I20260709 12:11:06.929905 22526 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
W20260709 12:11:06.934250 25964 consensus_meta.cc:287] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.885s	user 0.006s	sys 0.002s
I20260709 12:11:06.934686 26129 raft_consensus.cc:2749] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:06.873605 26016 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:06.860674 26032 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:06.940454 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 85684us
I20260709 12:11:06.975416 22421 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:06.944895 26176 raft_consensus.cc:2749] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:06.920678 26171 raft_consensus.cc:2749] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:06.914331 26157 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:06.946846 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:06.945664 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:07.056974 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:06.943780 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:06.913144 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:11:06.944128 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 63786.5us
I20260709 12:11:06.867708 25776 consensus_queue.cc:1048] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 12:11:06.935182 26028 raft_consensus.cc:2749] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:06.950273 26159 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:06.798563 26161 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:06.943281 25675 raft_consensus.cc:697] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:06.943218 26178 raft_consensus.cc:3055] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:06.867825 26183 consensus_queue.cc:1059] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.098s
I20260709 12:11:06.971455 22527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1716) took 1170 ms. Trace:
I20260709 12:11:06.962457 22529 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 8.
I20260709 12:11:06.951690 26134 raft_consensus.cc:2749] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:06.859793 26166 raft_consensus.cc:2804] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:11:07.155726 22452 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.000s	sys 0.014s
I20260709 12:11:06.977909 25988 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:06.978431 26164 log.cc:927] Time spent T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:11:06.960489 26079 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:11:06.979229 26151 log.cc:927] Time spent T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 12:11:06.979417 26032 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:06.973222 25964 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:07.176105 25964 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:06.980566 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:06.980851 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:06.982544 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:07.178745 23122 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:06.983338 26179 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:11:06.986392 25400 consensus_meta.cc:287] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.782s	user 0.004s	sys 0.003s
I20260709 12:11:07.198086 25400 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:07.200312 25400 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:06.987401 26106 raft_consensus.cc:2749] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:06.988209 22421 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:11:07.201584 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 213428us
W20260709 12:11:06.973711 26112 consensus_meta.cc:287] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.508s	user 0.009s	sys 0.000s
W20260709 12:11:07.202193 26108 consensus_meta.cc:287] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.760s	user 0.007s	sys 0.000s
I20260709 12:11:06.989602 22599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2534) took 2595 ms. Trace:
I20260709 12:11:06.990037 25875 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:06.949455 25628 consensus_queue.cc:237] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:06.991864 26025 consensus_meta.cc:287] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 1.331s	user 0.012s	sys 0.000s
W20260709 12:11:06.992766 26160 log.cc:927] Time spent T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:11:06.994112 26042 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:06.994689 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:07.209838 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:06.951923 26133 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:06.959738 26172 consensus_queue.cc:1048] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:11:06.999836 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:07.004107 26154 log.cc:927] Time spent T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.335s	user 0.000s	sys 0.001s
W20260709 12:11:07.004520 26158 log.cc:927] Time spent T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.340s	user 0.000s	sys 0.001s
I20260709 12:11:07.005031 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:07.005376 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:07.008316 23119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 761) took 1168 ms. Trace:
I20260709 12:11:07.012307 24970 raft_consensus.cc:3055] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:07.011756 22353 catalog_manager.cc:5697] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 5 to 6, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 6 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:07.015851 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:07.006366 22597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2142) took 1199 ms. Trace:
I20260709 12:11:06.975926 26017 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:07.017637 26082 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:07.022922 26114 log.cc:927] Time spent T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 1.014s	user 0.000s	sys 0.002s
I20260709 12:11:07.023334 25852 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:07.024538 22606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2541) took 1271 ms. Trace:
I20260709 12:11:07.024770 26058 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:07.025367 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:07.029250 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.033674 22523 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 9.
I20260709 12:11:07.006336 25957 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:07.080859 23088 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:11:07.090312 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.098785 22495 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:07.136772 22453 raft_consensus.cc:2376] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7. Re-sending same reply.
I20260709 12:11:07.137405 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:07.138587 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:07.142251 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:07.143280 22598 raft_consensus.cc:1275] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:06.948868 26130 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:07.157896 22450 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 700) took 1377 ms (client timeout 1534 ms). Trace:
I20260709 12:11:07.139858 26126 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:11:07.163419 22452 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.000s	sys 0.015s
I20260709 12:11:07.151710 22527 rpcz_store.cc:276] 0709 12:11:05.800600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.800717 (+   117us) service_pool.cc:224] Handling call
0709 12:11:05.815111 (+ 14394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:05.815482 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:05.998430 (+182948us) log.cc:844] Serialized 14 byte log entry
0709 12:11:06.317888 (+319458us) log.cc:844] Serialized 14 byte log entry
0709 12:11:06.318028 (+   140us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:06.318453 (+   425us) log.cc:844] Serialized 26 byte log entry
0709 12:11:06.318635 (+   182us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:06.318686 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.318777 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:06.971280 (+652503us) raft_consensus.cc:1685] finished
0709 12:11:06.971298 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:06.971404 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32744,"prepare.queue_time_us":434896,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":11170,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":13459,"spinlock_wait_cycles":5512576,"thread_start_us":452376,"threads_started":2,"wal-append.queue_time_us":529042}
I20260709 12:11:07.151288 26178 raft_consensus.cc:740] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:07.203361 22599 rpcz_store.cc:276] 0709 12:11:04.393937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.148011 (+754074us) service_pool.cc:224] Handling call
0709 12:11:05.148282 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:05.169298 (+ 21016us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:05.364791 (+195493us) log.cc:844] Serialized 14 byte log entry
0709 12:11:05.784124 (+419333us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:05.789662 (+  5538us) log.cc:844] Serialized 26 byte log entry
0709 12:11:05.789807 (+   145us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:05.789840 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.789901 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:06.510308 (+720407us) spinlock_profiling.cc:243] Waited 3.49 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:11:06.989323 (+479015us) raft_consensus.cc:1685] finished
0709 12:11:06.989420 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:06.989545 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":215690,"prepare.queue_time_us":197189,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":38377,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":15037,"spinlock_wait_cycles":8029952,"thread_start_us":418207,"threads_started":1,"wal-append.queue_time_us":581439}
W20260709 12:11:07.171597 26105 consensus_meta.cc:287] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.657s	user 0.010s	sys 0.000s
I20260709 12:11:07.202448 26112 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:07.380990 26161 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:07.381136 26112 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:07.164829 26166 raft_consensus.cc:697] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 8 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:07.150101 26157 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:07.202687 26108 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:07.362870 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 282136us
I20260709 12:11:07.363406 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:07.363762 22450 rpcz_store.cc:269] 0709 12:11:05.780426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.790510 (+ 10084us) service_pool.cc:224] Handling call
0709 12:11:07.157714 (+1367204us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54003f39d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:07.157840 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":347473792}
I20260709 12:11:07.362673 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:07.364946 22455 raft_consensus.cc:2393] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 9: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:07.365134 22457 raft_consensus.cc:2410] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 12:11:07.300626 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 420012us
I20260709 12:11:07.365283 24970 raft_consensus.cc:740] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:07.365834 22606 rpcz_store.cc:276] 0709 12:11:05.753393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.753560 (+   167us) service_pool.cc:224] Handling call
0709 12:11:05.753887 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.537057 (+783170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.024246 (+487189us) spinlock_profiling.cc:243] Waited 783 ms on lock 0x7b5400042254. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:07.024463 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1799845120}
I20260709 12:11:07.367740 23122 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
W20260709 12:11:07.353116 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 45521.7us
I20260709 12:11:07.434386 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:07.435021 22421 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:07.435563 22448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1744) took 1665 ms. Trace:
I20260709 12:11:07.436239 22421 leader_election.cc:400] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 election: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 8. Current term is 9.
I20260709 12:11:07.436545 22421 leader_election.cc:403] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:11:07.436628 22569 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:07.437765 22421 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:07.365159 23119 rpcz_store.cc:276] 0709 12:11:05.840311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.840452 (+   141us) service_pool.cc:224] Handling call
0709 12:11:05.840730 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:05.988986 (+148256us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:06.112148 (+123162us) log.cc:844] Serialized 14 byte log entry
0709 12:11:06.518685 (+406537us) spinlock_profiling.cc:243] Waited 4.4 ms on lock 0x7b18004830a0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc7823e07 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc7840c02 00007f9cca4c820b 00007f9cca4cdd23 00007f9cca4ce23a 00007f9cca938a2a
0709 12:11:06.607254 (+ 88569us) log.cc:844] Serialized 14 byte log entry
0709 12:11:06.793213 (+185959us) log.cc:844] Serialized 14 byte log entry
0709 12:11:06.793367 (+   154us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:06.833535 (+ 40168us) log.cc:844] Serialized 26 byte log entry
0709 12:11:06.854089 (+ 20554us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:06.854129 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.869215 (+ 15086us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:07.008117 (+138902us) raft_consensus.cc:1685] finished
0709 12:11:07.008137 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:07.008261 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85256,"prepare.queue_time_us":266148,"prepare.run_cpu_time_us":130,"prepare.run_wall_time_us":135,"raft.queue_time_us":869041,"raft.run_cpu_time_us":726,"raft.run_wall_time_us":125891,"spinlock_wait_cycles":10127232,"thread_start_us":483940,"threads_started":4,"wal-append.queue_time_us":824816}
I20260709 12:11:07.369057 22532 raft_consensus.cc:1275] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:11:07.367457 22597 rpcz_store.cc:276] 0709 12:11:05.807214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.807866 (+   652us) service_pool.cc:224] Handling call
0709 12:11:05.819230 (+ 11364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.509982 (+690752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.006070 (+496088us) spinlock_profiling.cc:243] Waited 690 ms on lock 0x7b54002df854. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:07.006294 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1587049216}
I20260709 12:11:07.217787 22525 raft_consensus.cc:2393] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 8: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:07.373708 26125 raft_consensus.cc:2749] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:07.375208 25875 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:07.377336 26178 consensus_queue.cc:260] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:07.382903 22452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1773) took 1138 ms. Trace:
I20260709 12:11:07.213908 26106 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:07.421957 22449 raft_consensus.cc:2393] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 7: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:07.210971 26025 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:07.450318 26106 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:07.450225 26104 consensus_queue.cc:1048] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:07.450953 26106 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.451196 22602 raft_consensus.cc:1240] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:07.452880 26025 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:07.405628 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 306934us
I20260709 12:11:07.381955 26126 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:07.244303 25964 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.253106 25675 consensus_queue.cc:237] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:07.431294 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:07.420955 26105 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:07.435920 22448 rpcz_store.cc:276] 0709 12:11:05.769667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.769773 (+   106us) service_pool.cc:224] Handling call
0709 12:11:05.796040 (+ 26267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.961868 (+165828us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:05.961897 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:05.961934 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:05.961963 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.435367 (+1473404us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b54003895d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:07.435410 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:07.435513 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":380966912}
I20260709 12:11:07.438681 22532 pending_rounds.cc:85] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting all ops after (but not including) 7
I20260709 12:11:07.462821 22569 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:07.463152 22532 pending_rounds.cc:107] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:11:07.463544 22532 raft_consensus.cc:2889] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:07.440461 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:07.442035 23088 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:07.443326 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:07.434660 24970 consensus_queue.cc:260] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:07.465516 24970 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:07.447293 22452 rpcz_store.cc:276] 0709 12:11:06.244911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.334124 (+ 89213us) service_pool.cc:224] Handling call
0709 12:11:06.334409 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.334595 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:06.614396 (+279801us) log.cc:844] Serialized 14 byte log entry
0709 12:11:07.382409 (+768013us) log.cc:844] Serialized 14 byte log entry
0709 12:11:07.382602 (+   193us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:07.382647 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:07.382699 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.382757 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:07.382859 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19280,"prepare.queue_time_us":192405,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":90,"raft.queue_time_us":17588,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":11908,"thread_start_us":929923,"threads_started":2}
I20260709 12:11:07.449360 22421 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:07.466862 22569 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:07.383541 25733 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.384479 25585 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:07.469521 26197 raft_consensus.cc:2749] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:07.445902 26161 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:07.438706 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:07.474936 23124 raft_consensus.cc:2468] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7.
I20260709 12:11:07.455775 25776 raft_consensus.cc:2749] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:07.382663 26129 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.468133 22569 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:07.463879 22497 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:07.445397 26074 raft_consensus.cc:2749] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:07.447503 26150 consensus_queue.cc:1059] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:11:07.461405 26066 raft_consensus.cc:2749] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:07.469297 26130 raft_consensus.cc:2749] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:07.472800 22451 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
I20260709 12:11:07.422562 26042 raft_consensus.cc:2749] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:07.471412 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:07.471376 25585 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.462885 22526 raft_consensus.cc:2393] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 9: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:07.467589 22421 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:07.206710 26179 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:07.461617 26178 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:07.472956 25875 raft_consensus.cc:2804] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:07.444864 26199 raft_consensus.cc:2749] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 8. Current term is 9.
I20260709 12:11:07.486691 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:07.475219 22527 raft_consensus.cc:2393] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 8: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:07.473625 26025 raft_consensus.cc:2749] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:07.487279 22569 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:07.457628 26112 consensus_queue.cc:1048] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:11:07.490639 22421 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:07.504798 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:07.504892 22421 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:07.505733 22454 raft_consensus.cc:2393] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 8: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:07.459415 25964 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:07.479321 26171 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:07.485462 26196 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:07.508541 24970 raft_consensus.cc:2749] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:07.454504 26166 consensus_queue.cc:237] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:07.518728 22421 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:07.520303 22421 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:07.470440 26134 consensus_queue.cc:1059] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:11:07.514216 22450 raft_consensus.cc:2376] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9. Re-sending same reply.
I20260709 12:11:07.522182 22569 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:07.522394 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:07.524982 22569 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:07.529798 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:07.530483 23122 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 9.
I20260709 12:11:07.530817 23120 raft_consensus.cc:1240] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:07.531683 23123 raft_consensus.cc:1240] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:07.532198 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:07.479377 26161 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:07.498426 25776 raft_consensus.cc:2749] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:07.536851 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.537328 24970 raft_consensus.cc:2749] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:07.537827 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:07.538898 23116 raft_consensus.cc:1240] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:11:07.539547 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:07.495258 25875 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:07.552083 23123 raft_consensus.cc:2393] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 8: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:07.546957 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:07.477214 25733 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:07.557097 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:07.513286 26074 raft_consensus.cc:2804] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:07.516686 26196 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:07.524799 26066 raft_consensus.cc:2749] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:07.562300 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:07.566258 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:07.562479 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:07.563445 23123 raft_consensus.cc:1275] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:07.562148 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:07.533943 26105 raft_consensus.cc:2749] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:07.567533 23116 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:07.566495 22454 raft_consensus.cc:2393] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 8: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
W20260709 12:11:07.557044 26103 consensus_meta.cc:287] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.776s	user 0.008s	sys 0.002s
I20260709 12:11:07.542559 26198 raft_consensus.cc:2804] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:07.571519 26108 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:07.546377 26058 raft_consensus.cc:2749] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:07.547663 26199 raft_consensus.cc:2804] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:07.561694 25875 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.585251 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:07.524335 26171 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:07.611816 26171 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:07.589138 26199 raft_consensus.cc:697] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 7 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:07.613466 26199 consensus_queue.cc:237] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:07.595291 26082 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:07.596091 26152 log.cc:927] Time spent T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.933s	user 0.002s	sys 0.001s
I20260709 12:11:07.598351 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:07.616366 22451 raft_consensus.cc:2393] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 8: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:07.617005 26179 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:07.617373 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:07.578737 26103 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:07.619961 26103 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:07.618767 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:07.621181 26133 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:07.622078 22451 raft_consensus.cc:2393] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 8: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:07.578517 25957 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:07.623107 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:07.624492 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:07.625150 22451 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
I20260709 12:11:07.626120 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:07.627822 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:07.629177 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:07.629957 22454 raft_consensus.cc:2393] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 8: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:07.636160 23116 raft_consensus.cc:2468] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 7.
I20260709 12:11:07.638473 25875 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:07.588821 25852 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:07.639936 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 179106us
I20260709 12:11:07.623200 22600 raft_consensus.cc:1240] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:07.568041 26196 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:07.604347 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:11:07.600083 26192 log.cc:927] Time spent T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
W20260709 12:11:07.606576 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.606843 26126 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:07.572410 25628 raft_consensus.cc:3055] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:07.587147 26198 raft_consensus.cc:697] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 6 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:07.607386 26075 raft_consensus.cc:3055] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:07.626765 22451 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7.
I20260709 12:11:07.642290 22530 raft_consensus.cc:2393] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 10: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:07.605976 26161 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:07.630826 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:07.670585 26056 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.671551 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:07.672006 22495 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:07.675429 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.679991 26075 raft_consensus.cc:740] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:07.683362 26149 raft_consensus.cc:2749] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:07.683904 26189 log.cc:927] Time spent T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.378s	user 0.001s	sys 0.000s
I20260709 12:11:07.683992 22570 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:07.684883 26056 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:07.685195 22570 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:07.686300 23117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 1112) took 1088 ms. Trace:
I20260709 12:11:07.680759 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:07.687314 26063 consensus_queue.cc:1059] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:07.687695 22451 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:07.688135 22602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2149) took 1468 ms. Trace:
I20260709 12:11:07.688498 22602 rpcz_store.cc:276] 0709 12:11:06.219763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.521282 (+301519us) service_pool.cc:224] Handling call
0709 12:11:06.521592 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:07.451578 (+929986us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.687936 (+236358us) spinlock_profiling.cc:243] Waited 913 ms on lock 0x7b5400449654. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:07.688084 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2099384064}
I20260709 12:11:07.689841 22570 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:07.690363 26038 raft_consensus.cc:3055] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:07.690539 24970 raft_consensus.cc:2804] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:07.690761 26038 raft_consensus.cc:740] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:07.691110 22597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:11:07.682374 22527 raft_consensus.cc:2393] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 7: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:07.683735 26075 consensus_queue.cc:260] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:07.691788 22597 raft_consensus.cc:606] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Received request to transfer leadership to TS c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:07.686231 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:07.706552 22597 raft_consensus.cc:614] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:07.706746 22448 raft_consensus.cc:2376] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8. Re-sending same reply.
I20260709 12:11:07.692945 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:07.704856 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:07.709564 22527 raft_consensus.cc:2468] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 7.
I20260709 12:11:07.709771 22451 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
I20260709 12:11:07.711970 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:07.686780 23117 rpcz_store.cc:276] 0709 12:11:06.598289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.598421 (+   132us) service_pool.cc:224] Handling call
0709 12:11:06.598833 (+   412us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:06.779519 (+180686us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:06.779540 (+    21us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:06.785570 (+  6030us) log.cc:844] Serialized 52 byte log entry
0709 12:11:06.971330 (+185760us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:06.971363 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.971424 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:07.683340 (+711916us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:11:07.686031 (+  2691us) raft_consensus.cc:1685] finished
0709 12:11:07.686051 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:07.686243 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65544,"raft.queue_time_us":193246,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":41664,"spinlock_wait_cycles":2595200,"thread_start_us":268810,"threads_started":2,"wal-append.queue_time_us":334151}
I20260709 12:11:07.676347 26111 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.742208 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:07.744766 22448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2325) took 1067 ms. Trace:
I20260709 12:11:07.676456 25628 raft_consensus.cc:740] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:07.691169 26146 raft_consensus.cc:2804] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:07.745211 23088 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:07.745678 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:07.745214 22448 rpcz_store.cc:276] 0709 12:11:06.677414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.707561 (+1030147us) service_pool.cc:224] Handling call
0709 12:11:07.744690 (+ 37129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.749636 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:07.676220 26159 consensus_queue.cc:1048] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 12:11:07.708204 26009 raft_consensus.cc:2804] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:11:07.740811 26192 log.cc:927] Time spent T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:11:07.691704 26038 consensus_queue.cc:260] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:07.762379 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:07.762497 23125 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
I20260709 12:11:07.739249 26056 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:07.770458 25875 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:07.751746 26161 raft_consensus.cc:2804] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:07.772688 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:07.798439 23125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57328 (request call id 1113) took 1199 ms. Trace:
I20260709 12:11:07.774174 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:07.767827 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:07.776050 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:07.802189 22454 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.802373 22456 raft_consensus.cc:2410] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:07.775151 22597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:60938
W20260709 12:11:07.794513 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 330691us
I20260709 12:11:07.803292 22597 raft_consensus.cc:606] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Received request to transfer leadership to TS 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:07.802914 23125 rpcz_store.cc:276] 0709 12:11:06.598484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.598608 (+   124us) service_pool.cc:224] Handling call
0709 12:11:07.604202 (+1005594us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b5800110198. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf8f40a0 00007f9ccf8f3984 00007f9cc8e6e6d4 00007f9cc8e6e662
0709 12:11:07.798380 (+194178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28908416}
I20260709 12:11:07.803809 22597 raft_consensus.cc:614] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:07.802654 22448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2313) took 1281 ms. Trace:
I20260709 12:11:07.804534 22448 rpcz_store.cc:276] 0709 12:11:06.521101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.751573 (+1230472us) service_pool.cc:224] Handling call
0709 12:11:07.802575 (+ 51002us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.796558 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:07.805241 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:07.798621 22457 raft_consensus.cc:2393] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 8: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:07.780787 22603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2148) took 1561 ms. Trace:
I20260709 12:11:07.801301 22421 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:07.806259 22603 rpcz_store.cc:276] 0709 12:11:06.219416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.330340 (+110924us) service_pool.cc:224] Handling call
0709 12:11:06.330636 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.464793 (+134157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.777491 (+1312698us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b54002de454. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:07.780735 (+  3244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":307198720}
I20260709 12:11:07.753021 26133 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:07.812960 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:07.816586 22456 raft_consensus.cc:2410] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 7 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:11:07.691778 26198 consensus_queue.cc:237] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:07.822427 22451 raft_consensus.cc:1240] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 LEADER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:07.760072 26146 raft_consensus.cc:697] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:07.823199 22451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2312) took 1302 ms. Trace:
I20260709 12:11:07.821204 22456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2314) took 1299 ms. Trace:
I20260709 12:11:07.819706 25776 consensus_queue.cc:1048] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:07.820396 22421 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:07.813617 24970 raft_consensus.cc:697] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 10 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:07.821235 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:07.814363 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:07.827876 22457 raft_consensus.cc:2393] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 8: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:07.752863 26111 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:07.824221 22456 rpcz_store.cc:276] 0709 12:11:06.521366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.812725 (+1291359us) service_pool.cc:224] Handling call
0709 12:11:07.821145 (+  8420us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.823554 22451 rpcz_store.cc:276] 0709 12:11:06.520854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.821964 (+1301110us) service_pool.cc:224] Handling call
0709 12:11:07.822262 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:07.822903 (+   641us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.823115 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.825973 22602 raft_consensus.cc:1240] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:07.826040 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:07.811702 26056 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.829315 24970 consensus_queue.cc:237] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:07.798189 26009 raft_consensus.cc:697] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:07.812419 26038 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.839502 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:07.840433 22597 raft_consensus.cc:2410] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:07.811666 26074 raft_consensus.cc:697] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:07.851660 22457 raft_consensus.cc:1240] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:11:07.852363 22457 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2318) took 1330 ms. Trace:
I20260709 12:11:07.852659 22457 rpcz_store.cc:276] 0709 12:11:06.522346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.851035 (+1328689us) service_pool.cc:224] Handling call
0709 12:11:07.851393 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:07.852119 (+   726us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.852312 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.853829 22457 raft_consensus.cc:1217] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Deduplicated request from leader. Original: 3.6->[6.7-8.8]   Dedup: 6.7->[8.8-8.8]
W20260709 12:11:07.854267 26016 consensus_meta.cc:287] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.712s	user 0.005s	sys 0.003s
I20260709 12:11:07.840345 22456 raft_consensus.cc:1240] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:07.815671 26177 raft_consensus.cc:2804] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:07.840915 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:07.824333 26032 consensus_queue.cc:1059] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:11:07.824484 26105 consensus_queue.cc:1059] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:11:07.847327 26146 consensus_queue.cc:237] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:07.835585 26166 raft_consensus.cc:2804] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:07.887323 26166 raft_consensus.cc:697] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 7 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
W20260709 12:11:07.890507 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.849365 26106 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:07.828346 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:07.854357 22457 raft_consensus.cc:1240] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 12:11:07.892817 22457 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2320) took 1369 ms. Trace:
I20260709 12:11:07.893262 22457 rpcz_store.cc:276] 0709 12:11:06.522963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.853356 (+1330393us) service_pool.cc:224] Handling call
0709 12:11:07.853673 (+   317us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:07.892490 (+ 38817us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.892752 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.859153 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:07.860380 23118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57328 (request call id 1121) took 1260 ms. Trace:
W20260709 12:11:07.860829 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 166410us
I20260709 12:11:07.860759 22456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2317) took 1338 ms. Trace:
I20260709 12:11:07.894686 22456 rpcz_store.cc:276] 0709 12:11:06.522086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.839935 (+1317849us) service_pool.cc:224] Handling call
0709 12:11:07.840201 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:07.858357 (+ 18156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.860680 (+  2323us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.823948 25875 consensus_queue.cc:1059] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:11:07.815505 25628 consensus_queue.cc:260] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:07.875788 26201 log.cc:927] Time spent T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 12:11:07.876667 26202 log.cc:927] Time spent T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:11:07.878866 26009 consensus_queue.cc:237] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:07.855183 26056 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:07.817466 25585 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:07.881197 26129 raft_consensus.cc:2749] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:07.883571 26161 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:07.884691 26074 consensus_queue.cc:237] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:07.894523 23118 rpcz_store.cc:276] 0709 12:11:06.600437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.642308 (+ 41871us) service_pool.cc:224] Handling call
0709 12:11:07.840774 (+1198466us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b5800110198. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf8f40a0 00007f9ccf8f3984 00007f9cc8e6e6d4 00007f9cc8e6e662
0709 12:11:07.860296 (+ 19522us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30193408}
I20260709 12:11:07.896131 22456 raft_consensus.cc:1240] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:11:07.917188 22456 raft_consensus.cc:1240] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:07.862144 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:07.903877 22454 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
I20260709 12:11:07.905112 22570 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:07.862131 26177 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:07.931191 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 75327.3us
W20260709 12:11:07.931805 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.864457 26016 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:07.888897 26103 consensus_queue.cc:1059] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:11:07.945497 26106 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:07.947366 26056 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:07.920259 25628 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:07.949302 22495 leader_election.cc:336] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 2.212s (SENT)
I20260709 12:11:07.949683 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:07.950289 22598 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
I20260709 12:11:07.918100 26161 raft_consensus.cc:3060] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.915230 26199 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:07.950647 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:07.920074 26208 raft_consensus.cc:3055] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:07.926398 26177 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:07.951936 22497 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:07.958433 22606 raft_consensus.cc:2393] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 10: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:07.956125 26208 raft_consensus.cc:740] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:07.973824 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:07.974409 23118 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.974231 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:07.975121 23124 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:07.976351 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:07.976894 23117 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:07.978098 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:07.979063 23116 raft_consensus.cc:2393] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 7: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:07.980432 23116 raft_consensus.cc:1275] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:07.981961 23118 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:11:07.982877 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:07.983597 23121 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:07.984594 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:07.985292 23122 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:07.986389 23117 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 10.
I20260709 12:11:07.962281 26146 raft_consensus.cc:2804] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:07.995707 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:07.969035 26181 raft_consensus.cc:2804] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:08.001289 23122 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11.
I20260709 12:11:08.002396 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:08.003733 23125 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:07.915164 26166 consensus_queue.cc:237] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:08.011634 23125 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
W20260709 12:11:07.996773 26178 consensus_meta.cc:287] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.501s	user 0.010s	sys 0.000s
I20260709 12:11:07.987381 26082 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.023499 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:08.024258 26223 log.cc:927] Time spent T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 12:11:08.027755 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:08.031821 26217 log.cc:927] Time spent T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:11:07.962834 26199 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:08.003288 26181 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:08.040314 26208 consensus_queue.cc:260] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:08.043922 26181 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:08.061453 23121 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
I20260709 12:11:08.032018 26161 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:08.070253 26111 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:08.076721 22570 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:08.078083 23124 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
I20260709 12:11:08.069206 26196 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:08.086133 22599 raft_consensus.cc:1240] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:08.036701 26082 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:08.082077 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:08.087918 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:08.088217 26082 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:08.088848 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:08.089273 23088 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:08.089478 22456 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:11:08.090051 26129 raft_consensus.cc:2749] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:08.047637 26146 raft_consensus.cc:697] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:08.091171 26146 consensus_queue.cc:237] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:08.093784 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.094761 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:08.096073 26196 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:08.100708 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:08.077865 26208 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:08.102046 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.127771 22570 leader_election.cc:304] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:08.133409 22570 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:08.134553 22570 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:08.131600 26213 raft_consensus.cc:2749] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:08.137898 26129 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:08.153616 25865 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:08.143330 26199 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:08.142247 26228 raft_consensus.cc:2804] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:08.136857 26082 consensus_queue.cc:1048] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 12:11:08.152715 26016 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:08.152491 26227 raft_consensus.cc:2804] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:08.178479 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:11:08.181216 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.165876 26213 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:08.169018 26228 raft_consensus.cc:697] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:08.160275 26129 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:08.199929 22495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:08.243132 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 108654us
I20260709 12:11:08.245406 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:08.248651 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:08.249249 22603 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 10.
I20260709 12:11:08.254153 22598 raft_consensus.cc:1240] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:08.254730 22603 raft_consensus.cc:1275] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:11:08.257644 26232 log.cc:927] Time spent T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:11:08.257512 26228 consensus_queue.cc:237] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:08.258998 26176 raft_consensus.cc:3055] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:08.259367 26176 raft_consensus.cc:740] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:08.260121 26176 consensus_queue.cc:260] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:08.263833 25985 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:08.264400 25985 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:08.265089 26157 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:08.266247 26198 consensus_queue.cc:1059] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:08.267416 25875 raft_consensus.cc:3055] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:08.267851 25875 raft_consensus.cc:740] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:08.271575 22570 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:08.186211 26227 raft_consensus.cc:697] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 10 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:08.276216 26038 raft_consensus.cc:2804] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:08.279908 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:08.282076 22597 raft_consensus.cc:1275] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 12:11:08.282392 22597 pending_rounds.cc:85] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc: Aborting all ops after (but not including) 7
I20260709 12:11:08.282601 22597 pending_rounds.cc:107] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 12:11:08.283775 26129 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:08.276737 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:08.282824 22597 raft_consensus.cc:2889] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:08.235625 26213 raft_consensus.cc:697] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:08.291523 22602 raft_consensus.cc:2393] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 7: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:08.261260 26176 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:08.275995 26230 log.cc:927] Time spent T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:11:08.292871 22422 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:08.296015 22570 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:08.296380 22531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 699) took 1692 ms. Trace:
I20260709 12:11:08.297427 22422 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:08.273020 25985 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:08.298810 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:08.310323 22570 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:08.296726 22531 rpcz_store.cc:276] 0709 12:11:06.604423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.604515 (+    92us) service_pool.cc:224] Handling call
0709 12:11:06.606944 (+  2429us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:11:06.796406 (+189462us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:06.882087 (+ 85681us) log.cc:844] Serialized 14 byte log entry
0709 12:11:07.116254 (+234167us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:11:07.144242 (+ 27988us) log.cc:844] Serialized 78 byte log entry
0709 12:11:07.144431 (+   189us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:07.144793 (+   362us) log.cc:844] Serialized 14 byte log entry
0709 12:11:07.145247 (+   454us) log.cc:844] Serialized 14 byte log entry
0709 12:11:07.614340 (+469093us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b18002c3980. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc78413f3 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd 0000000000388634 0000000000388479 00007f9cc782483a
0709 12:11:07.683064 (+ 68724us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b4800250158. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9ccf857aa1 00007f9ccf84eb37 00007f9ccf84e9ca 00007f9ccf94626f 00007f9ccf945f37 00007f9ccf95a55c 00007f9ccf95a508 00007f9ccf95a488 00007f9ccf95a443 00007f9ccf9596ec 00007f9cce883a96
0709 12:11:07.891384 (+208320us) spinlock_profiling.cc:243] Waited 5.04 ms on lock 0x7b18002c3980. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc780f2a6 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc78413f3 00007f9cc78437c1
0709 12:11:08.293770 (+402386us) spinlock_profiling.cc:243] Waited 1.12 ms on lock 0x7b18002c3980. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc77bbc0a 00007f9cd0efb219 00007f9cc7843a40 00007f9cc783e4e4 00007f9cc783e455 00007f9cce3263c7 00007f9cca9389a7 00007f9cca9480bf 00007f9cca948038
0709 12:11:08.295890 (+  2120us) log.cc:844] Serialized 14 byte log entry
0709 12:11:08.296088 (+   198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.296166 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:08.296205 (+    39us) raft_consensus.cc:1685] finished
0709 12:11:08.296216 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:08.296333 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82189,"prepare.queue_time_us":79830,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":108618,"raft.run_cpu_time_us":1931,"raft.run_wall_time_us":562581,"spinlock_wait_cycles":29386496,"thread_start_us":242821,"threads_started":2,"wal-append.queue_time_us":330783}
I20260709 12:11:08.295709 26106 consensus_queue.cc:1059] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 12:11:08.290306 26038 raft_consensus.cc:697] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:08.318089 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:08.318748 22422 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:08.310464 26105 raft_consensus.cc:2749] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:08.311826 25776 raft_consensus.cc:2804] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:08.322661 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:08.314220 26009 raft_consensus.cc:2804] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:08.331149 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:08.295902 26125 consensus_queue.cc:1059] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:11:08.333402 22531 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 8.
I20260709 12:11:08.340221 23088 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:08.329097 26166 consensus_queue.cc:1048] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:11:08.347437 24970 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.347962 24970 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:08.333174 26082 raft_consensus.cc:2804] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:08.330387 25776 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:08.332991 25985 raft_consensus.cc:2749] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:08.347877 26159 raft_consensus.cc:2804] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:08.346354 26009 raft_consensus.cc:697] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:08.353171 25776 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:08.366094 22450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2340) took 1038 ms. Trace:
I20260709 12:11:08.366460 22450 rpcz_store.cc:276] 0709 12:11:07.328181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.439885 (+111704us) service_pool.cc:224] Handling call
0709 12:11:08.365929 (+926044us) spinlock_profiling.cc:243] Waited 49 ms on lock 0x7b54002a4c54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:08.366036 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112690432}
W20260709 12:11:08.367596 22604 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45562 (request call id 2154) took 2101 ms (client timeout 1745 ms). Trace:
W20260709 12:11:08.368007 22604 rpcz_store.cc:269] 0709 12:11:06.266579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.293338 (+ 26759us) service_pool.cc:224] Handling call
0709 12:11:08.367395 (+2074057us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b54002de954. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:08.367495 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":669896576}
I20260709 12:11:08.330410 25875 consensus_queue.cc:260] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:08.375590 26233 log.cc:927] Time spent T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:11:08.377174 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 53714.9us
I20260709 12:11:08.363608 26082 raft_consensus.cc:697] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:08.351691 26181 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:08.393359 22422 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:08.364696 26159 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:11:08.450783 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 57491.9us
I20260709 12:11:08.451501 22601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2544) took 2341 ms. Trace:
I20260709 12:11:08.451283 26009 consensus_queue.cc:237] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:08.451867 22601 rpcz_store.cc:276] 0709 12:11:06.110435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.210670 (+100235us) service_pool.cc:224] Handling call
0709 12:11:06.211051 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.791227 (+580176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.451251 (+1660024us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b54000e9054. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:08.451421 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1307768064}
W20260709 12:11:08.454034 22529 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38310 (request call id 705) took 1690 ms (client timeout 1766 ms). Trace:
W20260709 12:11:08.443260 26240 log.cc:927] Time spent T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:11:08.339178 26227 consensus_queue.cc:237] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:08.466496 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.351507 26213 consensus_queue.cc:237] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:08.417786 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.489660 22450 raft_consensus.cc:1240] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:08.455767 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:08.364517 26125 consensus_queue.cc:1048] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
W20260709 12:11:08.489111 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:08.454409 22529 rpcz_store.cc:269] 0709 12:11:06.763754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.785001 (+ 21247us) service_pool.cc:224] Handling call
0709 12:11:08.453887 (+1668886us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b54001f2054. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:08.453981 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":381555584}
W20260709 12:11:08.536705 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:08.514232 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.490521 22448 raft_consensus.cc:1275] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:08.490722 22456 raft_consensus.cc:3055] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:08.541639 22456 raft_consensus.cc:740] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
W20260709 12:11:08.544651 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.367867 26038 consensus_queue.cc:237] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:08.456208 26159 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:08.535447 26189 log.cc:927] Time spent T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 12:11:08.495040 25875 raft_consensus.cc:3060] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:08.495298 26132 consensus_queue.cc:1059] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.089s
I20260709 12:11:08.495456 26082 consensus_queue.cc:237] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:08.487717 26249 raft_consensus.cc:2804] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:08.550374 22456 consensus_queue.cc:260] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:08.605155 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 264995us
I20260709 12:11:08.605756 22456 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:08.606333 23088 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:08.617113 22600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2549) took 1588 ms. Trace:
I20260709 12:11:08.618602 22600 rpcz_store.cc:276] 0709 12:11:07.028704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.029172 (+   468us) service_pool.cc:224] Handling call
0709 12:11:07.147256 (+118084us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:07.640787 (+493531us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.616866 (+976079us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b5400041d54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:08.617037 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1094061440}
W20260709 12:11:08.621860 23087 leader_election.cc:336] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.534s (SENT)
W20260709 12:11:08.623466 23087 connection.cc:256] RPC call timeout handler was delayed by -1.4967132320000474s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19770000000000001s for a response
W20260709 12:11:08.625174 23087 connection.cc:256] RPC call timeout handler was delayed by -1.3257132319999982s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2167s for a response
W20260709 12:11:08.656138 22495 leader_election.cc:336] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.592s (SENT)
I20260709 12:11:08.656790 22495 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:08.600345 26249 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:08.669862 26132 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:08.670365 26249 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:08.670444 26132 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:08.608564 25776 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:08.672714 26132 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:08.638126 22569 leader_election.cc:336] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 2.098s (SENT)
I20260709 12:11:08.673518 25776 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:08.675120 22495 leader_election.cc:336] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.608s (SENT)
I20260709 12:11:08.677064 26056 raft_consensus.cc:2749] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:08.679499 22451 raft_consensus.cc:1275] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:11:08.681388 22456 raft_consensus.cc:1275] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:11:08.683466 22495 leader_election.cc:336] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.621s (SENT)
I20260709 12:11:08.689821 22495 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:08.698086 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.704756 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:08.609395 26129 raft_consensus.cc:2804] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:11:08.736333 22495 leader_election.cc:336] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.675s (SENT)
W20260709 12:11:08.738005 26251 log.cc:927] Time spent T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 12:11:08.716276 26132 raft_consensus.cc:2749] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:08.737926 26105 raft_consensus.cc:3055] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:08.748996 26056 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:08.761116 22453 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2324) took 2084 ms (client timeout 2212 ms). Trace:
I20260709 12:11:08.761548 22454 raft_consensus.cc:1275] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:11:08.761762 22569 leader_election.cc:336] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 2.185s (SENT)
W20260709 12:11:08.766161 22453 rpcz_store.cc:269] 0709 12:11:06.677034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.056629 (+379595us) service_pool.cc:224] Handling call
0709 12:11:08.760940 (+1704311us) spinlock_profiling.cc:243] Waited 79 ms on lock 0x7b54002a5154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:08.761058 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":181691136}
I20260709 12:11:08.763641 26181 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:08.768812 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:08.769641 22453 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
W20260709 12:11:08.770991 22495 leader_election.cc:336] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 2.958s (SENT)
W20260709 12:11:08.772946 22495 leader_election.cc:336] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.711s (SENT)
I20260709 12:11:08.778082 23087 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:08.788059 26197 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:08.790241 22569 leader_election.cc:336] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 2.132s (SENT)
I20260709 12:11:08.790819 22569 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:08.749264 26157 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.768289 26105 raft_consensus.cc:740] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:08.800633 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:08.806329 22598 raft_consensus.cc:1240] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:08.802260 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:08.809106 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:08.820945 22495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:08.833190 26214 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.792s	user 0.018s	sys 0.023s
I20260709 12:11:08.799327 26235 raft_consensus.cc:2749] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:08.774559 26056 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:08.838106 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 60104.7us
I20260709 12:11:08.827126 26183 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.829988 26106 consensus_queue.cc:1059] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:11:08.828488 26159 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:08.788731 26197 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:08.803426 26157 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:08.845016 22604 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:08.836072 26214 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.018s	sys 0.023s
I20260709 12:11:08.843869 23087 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:08.855365 26106 consensus_queue.cc:1243] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer 6c6fa11e8ee34711b3551f0c670442bc log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:11:08.840030 26161 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:08.874818 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:08.875452 22526 raft_consensus.cc:3060] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:08.868005 26177 consensus_meta.cc:287] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.893s	user 0.011s	sys 0.000s
I20260709 12:11:08.879459 22604 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
I20260709 12:11:08.862392 26235 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:08.886665 22569 leader_election.cc:336] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 2.090s (SENT)
I20260709 12:11:08.868116 26258 raft_consensus.cc:2749] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:08.896836 26157 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:08.902290 22528 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38310 (request call id 695) took 2301 ms (client timeout 1740 ms). Trace:
W20260709 12:11:08.908142 22528 rpcz_store.cc:269] 0709 12:11:06.600810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.600934 (+   124us) service_pool.cc:224] Handling call
0709 12:11:08.902101 (+2301167us) spinlock_profiling.cc:243] Waited 912 ms on lock 0x7b540014fd54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:08.902221 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2096952192}
I20260709 12:11:08.868259 26259 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:08.901212 26235 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:08.846019 26183 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:08.901154 26129 raft_consensus.cc:697] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 8 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:08.909556 26161 raft_consensus.cc:2804] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:08.943581 22496 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:08.888612 26177 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:08.950872 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.960680 23119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 939) took 1433 ms. Trace:
I20260709 12:11:08.947929 26132 raft_consensus.cc:2749] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:08.961105 23119 rpcz_store.cc:276] 0709 12:11:07.527452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.527614 (+   162us) service_pool.cc:224] Handling call
0709 12:11:07.780937 (+253323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:07.798146 (+ 17209us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:07.841606 (+ 43460us) log.cc:844] Serialized 14 byte log entry
0709 12:11:07.865902 (+ 24296us) log.cc:844] Serialized 14 byte log entry
0709 12:11:07.879801 (+ 13899us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:07.879856 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:07.879906 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.266150 (+386244us) spinlock_profiling.cc:243] Waited 2.16 ms on lock 0x7b1800483a00. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc78413f3 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd 0000000000388634 0000000000388479 00007f9cc782483a
0709 12:11:08.502428 (+236278us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b54006f1154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:08.502502 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:08.960486 (+457984us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b54006f1150. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:08.960604 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13446,"prepare.queue_time_us":21164,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":13644,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":167,"spinlock_wait_cycles":625713152,"thread_start_us":48232,"threads_started":2,"wal-append.queue_time_us":65457}
I20260709 12:11:08.994477 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:08.985816 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:08.983659 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:08.956946 26208 consensus_meta.cc:287] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.818s	user 0.008s	sys 0.004s
I20260709 12:11:08.952819 25585 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:08.956790 26227 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.957520 26161 raft_consensus.cc:697] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 9 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:09.013775 22457 raft_consensus.cc:1275] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:11:09.014247 22457 pending_rounds.cc:85] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f: Aborting all ops after (but not including) 8
I20260709 12:11:09.014546 22457 pending_rounds.cc:107] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:11:09.014745 22457 raft_consensus.cc:2889] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:09.013125 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 106542us
I20260709 12:11:09.019829 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:09.021090 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:09.021956 22529 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:08.936721 26259 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:09.018371 26260 log.cc:927] Time spent T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
W20260709 12:11:09.022336 26254 log.cc:927] Time spent T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 12:11:09.017829 26056 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:09.031797 22526 raft_consensus.cc:2468] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 8.
I20260709 12:11:09.032505 22529 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 9.
I20260709 12:11:09.023597 26159 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:09.023743 26197 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:09.018628 26227 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:09.043550 26235 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:11:09.046600 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 171973us
I20260709 12:11:09.047945 23087 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:09.051659 26259 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:09.052017 26267 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.053480 26267 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:09.055552 26249 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:09.055828 26057 consensus_queue.cc:260] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:09.056510 26183 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:09.057299 26057 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:09.057101 26161 consensus_queue.cc:237] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:09.057881 26249 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:09.020596 26129 consensus_queue.cc:237] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:09.052636 26126 raft_consensus.cc:2749] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:09.055634 26177 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:09.053488 26025 raft_consensus.cc:3055] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:09.076315 26025 raft_consensus.cc:740] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:09.077497 26025 consensus_queue.cc:260] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:09.078517 25733 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:09.081238 26126 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:09.083729 26159 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:09.089140 26200 log.cc:927] Time spent T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 1.543s	user 0.000s	sys 0.003s
I20260709 12:11:09.088553 26159 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:09.083765 26178 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.090939 26126 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:09.097102 26227 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:09.098603 26159 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:09.093017 26178 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:09.100222 26267 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:09.104779 26206 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:11:09.104952 26178 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:09.094867 26150 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.552s	user 0.011s	sys 0.016s
W20260709 12:11:09.106566 26191 log.cc:927] Time spent T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 1.622s	user 0.004s	sys 0.000s
I20260709 12:11:09.154762 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:09.155953 22452 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:11:09.161561 22448 raft_consensus.cc:1240] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 8 LEADER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:11:09.163102 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:09.163565 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:09.164017 22495 leader_election.cc:336] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.910s (SENT)
I20260709 12:11:09.164501 22456 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
I20260709 12:11:09.164937 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:09.165100 22495 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:09.168004 22495 leader_election.cc:336] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.955s (SENT)
I20260709 12:11:09.168681 22495 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:09.177101 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.180243 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:09.182379 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:09.183848 22524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 702) took 2578 ms. Trace:
I20260709 12:11:09.186201 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:09.187672 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:09.187772 22526 raft_consensus.cc:1240] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:09.189556 22529 raft_consensus.cc:1275] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:11:09.195223 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:09.195477 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:09.196496 22529 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:11:09.190310 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:09.197579 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:09.198158 23089 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:09.198761 22526 raft_consensus.cc:2393] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 10: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:09.200146 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:09.205633 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:09.206061 23088 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:09.193104 22601 raft_consensus.cc:1240] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:09.206568 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:09.207635 23088 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:09.190409 22605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2555) took 1385 ms. Trace:
I20260709 12:11:09.208472 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:09.210073 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:09.190667 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:09.184412 22524 rpcz_store.cc:276] 0709 12:11:06.605232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.684709 (+ 79477us) service_pool.cc:224] Handling call
0709 12:11:06.742907 (+ 58198us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:06.743261 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:06.770744 (+ 27483us) log.cc:844] Serialized 14 byte log entry
0709 12:11:07.209281 (+438537us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:07.387125 (+177844us) log.cc:844] Serialized 26 byte log entry
0709 12:11:07.387337 (+   212us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:08.294480 (+907143us) log.cc:844] Serialized 14 byte log entry
0709 12:11:08.294725 (+   245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.294831 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:09.105934 (+811103us) spinlock_profiling.cc:243] Waited 95.7 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:11:09.183315 (+ 77381us) raft_consensus.cc:1685] finished
0709 12:11:09.183352 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:09.183628 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1012141,"prepare.queue_time_us":953562,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":4790,"raft.queue_time_us":26290,"raft.run_cpu_time_us":372,"raft.run_wall_time_us":16680,"spinlock_wait_cycles":220017920,"thread_start_us":334857,"threads_started":1,"wal-append.queue_time_us":643292}
I20260709 12:11:09.211678 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:09.212054 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:09.212572 22524 raft_consensus.cc:1240] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:11:09.205830 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:09.213176 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:09.213351 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:09.214392 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:09.205502 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:09.215538 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:09.215832 23116 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:09.216835 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:09.217885 22601 raft_consensus.cc:2393] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 9: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:09.208802 22605 rpcz_store.cc:276] 0709 12:11:07.804511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.804635 (+   124us) service_pool.cc:224] Handling call
0709 12:11:07.812083 (+  7448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:07.823589 (+ 11506us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:07.823630 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:07.824060 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 12:11:08.941812 (+1117752us) spinlock_profiling.cc:243] Waited 2.95 ms on lock 0x7b1800488f20. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc7823e07 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc7840c02 00007f9cca4c820b 00007f9cca4cdd23 00007f9cca4ce0d1 00007f9cca8e9a0f
0709 12:11:09.035132 (+ 93320us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:09.035193 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.035299 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:09.189609 (+154310us) raft_consensus.cc:1685] finished
0709 12:11:09.189656 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:09.190123 (+   467us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11162,"raft.queue_time_us":16038,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":7065,"spinlock_wait_cycles":6778624,"thread_start_us":91949,"threads_started":1,"wal-append.queue_time_us":1246059}
I20260709 12:11:09.219935 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:09.191669 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:09.221438 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.221323 22453 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:11:09.214771 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:09.223920 23124 raft_consensus.cc:1240] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:09.224294 23125 raft_consensus.cc:1240] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:09.224431 23122 raft_consensus.cc:1275] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:09.226513 23123 raft_consensus.cc:1275] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:09.099802 26126 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:09.231487 26159 raft_consensus.cc:2749] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:09.106276 26150 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.572s	user 0.012s	sys 0.016s
I20260709 12:11:09.218710 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:09.226699 25733 raft_consensus.cc:2749] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:09.243036 26227 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:09.243058 26172 raft_consensus.cc:2804] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:09.244300 26172 raft_consensus.cc:697] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 9 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:09.244261 26227 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:09.242667 26273 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.247897 26273 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:09.249102 26161 raft_consensus.cc:2804] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:09.249773 26161 raft_consensus.cc:697] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 8 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:09.244390 22524 raft_consensus.cc:1275] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:09.239835 22529 raft_consensus.cc:1275] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:09.246393 26172 consensus_queue.cc:237] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:09.274904 22597 raft_consensus.cc:1240] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:09.279289 22569 leader_election.cc:336] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 2.691s (SENT)
I20260709 12:11:09.240053 26159 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.283571 26159 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:09.287137 26159 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:11:09.272704 22495 leader_election.cc:336] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.957s (SENT)
I20260709 12:11:09.287887 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:09.288720 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 117745us
I20260709 12:11:09.289160 22601 raft_consensus.cc:2410] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:11:09.290529 22601 raft_consensus.cc:1240] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:09.291657 23089 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:09.303360 26267 consensus_queue.cc:1059] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:09.304598 26129 raft_consensus.cc:2749] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:09.304668 26267 raft_consensus.cc:3055] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:09.305265 26267 raft_consensus.cc:740] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:09.308517 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:09.319190 22526 raft_consensus.cc:2393] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 8: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:09.319480 25585 raft_consensus.cc:2749] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:09.320371 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:09.321450 22526 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
I20260709 12:11:09.322561 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:09.327812 22526 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:09.325729 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:09.328862 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:09.334667 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:09.335991 22531 raft_consensus.cc:2393] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 8: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:09.337136 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:09.337976 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:09.339593 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:09.340454 22450 raft_consensus.cc:2393] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 8: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:09.343847 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:09.344723 22450 raft_consensus.cc:2410] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 7 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:11:09.345362 22526 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 8.
I20260709 12:11:09.346627 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:09.350694 22526 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 7.
I20260709 12:11:09.363881 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:09.366451 22528 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 9.
I20260709 12:11:09.366565 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:09.367313 22526 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 9.
I20260709 12:11:09.367878 22528 raft_consensus.cc:1240] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:09.369047 23088 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:09.370117 26126 raft_consensus.cc:2804] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:09.390836 26126 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.329198 26273 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:09.306705 26267 consensus_queue.cc:260] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:09.429455 22598 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 8.
I20260709 12:11:09.395334 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:09.431404 22600 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 7.
I20260709 12:11:09.391463 26126 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:09.450400 23116 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
I20260709 12:11:09.453102 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:09.458739 25675 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:11:09.459228 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.459470 25675 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:09.462060 25675 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:09.448935 26227 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:09.463603 26206 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.462682 22457 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1809) took 1096 ms. Trace:
W20260709 12:11:09.465507 22523 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38310 (request call id 703) took 2859 ms (client timeout 1977 ms). Trace:
W20260709 12:11:09.468236 22523 rpcz_store.cc:269] 0709 12:11:06.605469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.664916 (+ 59447us) service_pool.cc:224] Handling call
0709 12:11:09.464315 (+2799399us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b54001f1b54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:09.464535 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":680613248}
I20260709 12:11:09.469735 22523 raft_consensus.cc:1240] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:08.544046 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:09.472091 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:09.473029 22528 raft_consensus.cc:2393] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 8: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:09.473711 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:09.474241 22528 raft_consensus.cc:1240] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:09.475203 26249 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:11:09.476137 22530 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38310 (request call id 694) took 2895 ms (client timeout 1704 ms). Trace:
I20260709 12:11:09.476006 26249 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:09.476895 22525 raft_consensus.cc:1240] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:11:09.479012 26111 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.479570 26159 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:09.480530 26159 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:09.491789 22599 raft_consensus.cc:1240] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 10. Current term is 11. Ops: [8.8-10.9]
I20260709 12:11:09.479664 26111 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:09.493321 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 198984us
I20260709 12:11:09.464624 26206 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:09.466413 22457 rpcz_store.cc:276] 0709 12:11:08.366346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.366508 (+   162us) service_pool.cc:224] Handling call
0709 12:11:08.366797 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:09.015412 (+648615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.462132 (+446720us) spinlock_profiling.cc:243] Waited 638 ms on lock 0x7b5400240c54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:09.462471 (+   339us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1467454720}
W20260709 12:11:09.476606 22530 rpcz_store.cc:269] 0709 12:11:06.580755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.580902 (+   147us) service_pool.cc:224] Handling call
0709 12:11:09.475670 (+2894768us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54000d48d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:09.475965 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2417104768}
I20260709 12:11:09.514828 25987 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:11:09.515414 22606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45576 (request call id 2554) took 1711 ms (client timeout 2185 ms). Trace:
I20260709 12:11:09.516477 22603 raft_consensus.cc:1240] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:09.526886 22606 rpcz_store.cc:269] 0709 12:11:07.804220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.805049 (+   829us) service_pool.cc:224] Handling call
0709 12:11:09.492902 (+1687853us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b54003b3154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:09.515120 (+ 22218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":350273792}
I20260709 12:11:09.516826 23089 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:09.410872 26161 consensus_queue.cc:237] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:09.528009 22527 raft_consensus.cc:1240] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:09.470830 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:09.517212 26227 consensus_queue.cc:1048] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:11:09.536445 22529 raft_consensus.cc:2393] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 8: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
W20260709 12:11:09.537309 22495 leader_election.cc:336] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 2.061s (SENT)
I20260709 12:11:09.543565 22528 raft_consensus.cc:1240] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:09.545547 25675 consensus_queue.cc:1059] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:09.546329 23088 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:09.546795 25675 raft_consensus.cc:3055] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:09.547240 25675 raft_consensus.cc:740] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:09.547291 26178 raft_consensus.cc:2749] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:09.548435 25675 consensus_queue.cc:260] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:09.551993 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 57695.1us
W20260709 12:11:09.552397 22495 leader_election.cc:336] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 2.063s (SENT)
I20260709 12:11:09.552611 26140 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:09.553113 26140 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:09.553603 26140 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:09.538321 26172 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.554649 26172 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:09.553478 23089 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:09.462466 22353 catalog_manager.cc:5697] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 3 to 5, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 5 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
W20260709 12:11:09.553947 22495 leader_election.cc:336] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 2.124s (SENT)
I20260709 12:11:09.541164 26249 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:09.559408 22495 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:09.561177 25675 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:09.562614 25987 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:09.563217 26249 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.563293 26247 raft_consensus.cc:2749] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:09.564229 26205 raft_consensus.cc:3055] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:09.563905 26249 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:09.565661 25987 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:09.566713 26249 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:09.567313 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.567384 26206 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:09.571362 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:09.571604 26247 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.572314 22455 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:11:09.564711 26205 raft_consensus.cc:740] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:09.587781 23089 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:09.599035 23123 raft_consensus.cc:1275] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:09.599802 22496 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:09.600361 23125 raft_consensus.cc:1275] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:11:09.601496 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 47700.4us
W20260709 12:11:09.602298 22495 leader_election.cc:336] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 2.138s (SENT)
I20260709 12:11:09.606168 26150 raft_consensus.cc:2749] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:09.607530 26150 consensus_queue.cc:1059] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:09.609407 22528 raft_consensus.cc:1275] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:09.609859 26057 consensus_queue.cc:1059] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:09.611393 26273 raft_consensus.cc:3055] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:09.611851 26273 raft_consensus.cc:740] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:09.613157 26273 consensus_queue.cc:260] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:09.618481 26277 raft_consensus.cc:2749] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:09.619421 26277 consensus_queue.cc:1048] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:09.623826 22570 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:09.625888 22570 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:09.627398 26197 raft_consensus.cc:2749] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:09.629051 26159 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:09.628530 26197 raft_consensus.cc:2804] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:09.631464 26197 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.631965 26197 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:09.635681 26205 consensus_queue.cc:260] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:09.637501 26205 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:09.581456 26247 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:09.643426 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.645037 23122 raft_consensus.cc:1275] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:11:09.653854 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:09.657503 22449 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1798) took 2779 ms (client timeout 2090 ms). Trace:
I20260709 12:11:09.659797 26150 consensus_queue.cc:1048] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:11:09.658097 22449 rpcz_store.cc:269] 0709 12:11:06.878057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.137087 (+259030us) service_pool.cc:224] Handling call
0709 12:11:09.657031 (+2519944us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b5400378a54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:09.657286 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47707904}
I20260709 12:11:09.675338 26227 consensus_queue.cc:1048] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:09.680385 26111 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:09.685246 25964 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:09.674782 26009 consensus_queue.cc:1048] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:11:09.690025 26172 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317)
I20260709 12:11:09.690865 26172 raft_consensus.cc:2749] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:09.692534 26105 consensus_queue.cc:260] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:09.693282 26247 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:09.693679 26105 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:09.700817 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:09.704809 22597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2169) took 1387 ms. Trace:
I20260709 12:11:09.705189 22597 rpcz_store.cc:276] 0709 12:11:08.317678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.339628 (+ 21950us) service_pool.cc:224] Handling call
0709 12:11:08.349431 (+  9803us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:09.296238 (+946807us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.704532 (+408294us) spinlock_profiling.cc:243] Waited 901 ms on lock 0x7b5400043654. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:09.704727 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2073070464}
I20260709 12:11:09.708532 22456 raft_consensus.cc:1275] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:09.710158 26197 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:09.712617 26197 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:09.715581 23121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 1134) took 1392 ms. Trace:
I20260709 12:11:09.716010 26042 raft_consensus.cc:3055] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:09.716428 26042 raft_consensus.cc:740] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:09.716150 23121 rpcz_store.cc:276] 0709 12:11:08.323368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.324742 (+  1374us) service_pool.cc:224] Handling call
0709 12:11:08.324972 (+   230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:08.325147 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:09.489949 (+1164802us) spinlock_profiling.cc:243] Waited 6.28 ms on lock 0x7b1800483c40. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cca4d64bc 00007f9cc782448b 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc783e455 00007f9cce3263c7 00007f9cca9389a7 00007f9cca9480bf
0709 12:11:09.490218 (+   269us) log.cc:844] Serialized 14 byte log entry
0709 12:11:09.714318 (+224100us) log.cc:844] Serialized 14 byte log entry
0709 12:11:09.715033 (+   715us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:09.715096 (+    63us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:09.715182 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.715264 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:09.715396 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13542,"prepare.queue_time_us":32307,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":79,"spinlock_wait_cycles":14452608,"thread_start_us":260473,"threads_started":2,"wal-append.queue_time_us":222236}
I20260709 12:11:09.717597 26042 consensus_queue.cc:260] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:09.723691 26042 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:09.730001 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 150812us
I20260709 12:11:09.732926 22451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1813) took 1237 ms. Trace:
W20260709 12:11:09.734222 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 119076us
I20260709 12:11:09.740147 26126 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:09.733327 22451 rpcz_store.cc:276] 0709 12:11:08.495815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.495994 (+   179us) service_pool.cc:224] Handling call
0709 12:11:08.496265 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:08.679930 (+183665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.732461 (+1052531us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b54003cad54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:09.732722 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":420622208}
W20260709 12:11:09.751555 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 78071.2us
I20260709 12:11:09.733649 23089 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:09.730865 22422 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:09.755352 22570 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:11:09.765565 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 160092us
I20260709 12:11:09.768914 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:09.769865 22531 raft_consensus.cc:2393] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 8: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:09.770434 26213 raft_consensus.cc:2804] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:09.770954 26213 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.771396 26213 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:09.772066 26025 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:09.752588 26140 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:09.783119 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:09.785092 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:09.785005 26291 consensus_queue.cc:1048] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:11:09.786707 22606 raft_consensus.cc:2393] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 11: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:09.787025 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:09.787711 22604 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 9.
I20260709 12:11:09.788507 26198 raft_consensus.cc:2804] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:09.789121 26198 raft_consensus.cc:697] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:09.791158 22422 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:09.792109 26105 raft_consensus.cc:2804] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:09.792649 25875 consensus_queue.cc:1059] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:09.793195 22422 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:09.793602 25875 consensus_queue.cc:1243] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer 6c6fa11e8ee34711b3551f0c670442bc log is divergent from this leader: its last log entry 11.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:11:09.792625 26105 raft_consensus.cc:697] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 11 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:09.794308 26166 raft_consensus.cc:3055] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:09.794759 26166 raft_consensus.cc:740] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:09.795394 26105 consensus_queue.cc:237] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:09.795789 26166 consensus_queue.cc:260] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:09.797299 26166 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:09.799397 23122 raft_consensus.cc:1240] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:09.799557 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:09.799840 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:09.800797 23121 raft_consensus.cc:1240] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:09.801441 23116 raft_consensus.cc:1240] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:09.794312 26032 raft_consensus.cc:2804] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:09.802151 26032 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.802531 26032 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:09.799433 22531 raft_consensus.cc:1275] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:11:09.803156 22531 pending_rounds.cc:85] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting all ops after (but not including) 7
I20260709 12:11:09.803440 22531 pending_rounds.cc:107] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:11:09.803774 22531 raft_consensus.cc:2889] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:09.806035 25875 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.784078 26161 raft_consensus.cc:2804] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:09.806783 25875 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:09.807618 26161 raft_consensus.cc:697] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 7 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:09.808605 22454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2352) took 1957 ms. Trace:
I20260709 12:11:09.809223 25875 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:09.808768 26161 consensus_queue.cc:237] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:09.808995 22454 rpcz_store.cc:276] 0709 12:11:07.850652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.918831 (+ 68179us) service_pool.cc:224] Handling call
0709 12:11:08.761091 (+842260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:08.766311 (+  5220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.808259 (+1041948us) spinlock_profiling.cc:243] Waited 842 ms on lock 0x7b54002a5150. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:09.808439 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1936270592}
I20260709 12:11:09.810202 26273 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:09.806898 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:09.812646 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.813512 26124 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:09.813783 26053 raft_consensus.cc:3055] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:09.814265 26053 raft_consensus.cc:740] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:09.814162 26124 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:09.814575 26126 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:09.815475 26053 consensus_queue.cc:260] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:09.816634 26053 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:09.790261 26198 consensus_queue.cc:237] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:09.818133 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:09.826174 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 43516.6us
I20260709 12:11:09.831297 25988 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:09.832944 25988 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:09.834156 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:09.835656 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:09.836229 26124 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:09.836374 22598 raft_consensus.cc:2468] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 7.
I20260709 12:11:09.828655 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:09.837044 22526 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:09.838675 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:09.839143 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:09.843008 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.839905 22422 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:11:09.844038 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 110545us
I20260709 12:11:09.845554 23116 raft_consensus.cc:1275] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:11:09.846112 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:09.846676 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:09.847018 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.845499 25988 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:09.854135 22529 raft_consensus.cc:1275] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:11:09.854053 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:09.859000 26177 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.860180 22524 raft_consensus.cc:1275] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:09.866119 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:09.866695 23121 raft_consensus.cc:1275] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:09.877158 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:09.863359 22496 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:09.886668 22526 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 8.
I20260709 12:11:09.872462 24970 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:09.867093 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:09.892729 22531 raft_consensus.cc:1240] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:09.865662 26283 log.cc:927] Time spent T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.329s	user 0.003s	sys 0.001s
I20260709 12:11:09.895557 23088 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:09.899537 22495 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:09.899611 26147 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.865410 26291 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.863349 26245 raft_consensus.cc:2804] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:09.864990 26129 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:09.914261 25628 consensus_queue.cc:1059] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:09.915444 23122 raft_consensus.cc:2393] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 9: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
W20260709 12:11:09.915607 26256 log.cc:927] Time spent T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 1.079s	user 0.002s	sys 0.002s
I20260709 12:11:09.909729 26245 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.916536 26245 raft_consensus.cc:3060] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:09.917651 25628 raft_consensus.cc:2804] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:09.918841 26124 raft_consensus.cc:3055] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:09.919225 26124 raft_consensus.cc:740] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:09.920264 26291 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:09.920324 26124 consensus_queue.cc:260] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:09.921888 26124 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:09.922520 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:09.923743 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:09.924402 22599 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7.
I20260709 12:11:09.924412 26057 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:09.924719 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:09.906844 26147 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:09.925297 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:09.925585 23125 raft_consensus.cc:2468] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 6.
I20260709 12:11:09.926151 22599 raft_consensus.cc:2410] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:11:09.914350 26129 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:09.904664 26288 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:09.927430 26288 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:09.911705 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 48620.4us
I20260709 12:11:09.930075 22598 raft_consensus.cc:1240] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 LEADER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:09.859678 26032 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:09.931095 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:09.931783 22531 raft_consensus.cc:2393] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 8: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
W20260709 12:11:09.913403 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 58273.7us
I20260709 12:11:09.932175 22497 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:09.932655 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:09.934255 22599 raft_consensus.cc:1240] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:09.934531 26140 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:09.935535 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:09.859793 26177 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:09.938504 26017 consensus_queue.cc:1175] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8701cd5186a949538d8efafb5f987270" responder_term: 10 status { last_received { term: 6 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 9. Current term is 10. Ops: [7.9-9.10]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:11:09.947719 23124 raft_consensus.cc:1275] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:09.951370 22525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1726) took 3209 ms. Trace:
I20260709 12:11:09.951757 22525 rpcz_store.cc:276] 0709 12:11:06.742042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.439259 (+697217us) service_pool.cc:224] Handling call
0709 12:11:09.476442 (+2037183us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:09.477392 (+   950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.951160 (+473768us) spinlock_profiling.cc:243] Waited 2.04 s on lock 0x7b54000d48d0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:09.951306 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4684055808}
I20260709 12:11:09.911134 26038 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:09.953004 26038 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:09.953464 26245 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:09.912020 22603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2162) took 1656 ms. Trace:
I20260709 12:11:09.912406 26289 consensus_queue.cc:1059] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:09.955121 22603 rpcz_store.cc:276] 0709 12:11:08.256026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.256225 (+   199us) service_pool.cc:224] Handling call
0709 12:11:09.515942 (+1259717us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:09.527493 (+ 11551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.911836 (+384343us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54003b3150. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:09.911970 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2896133504}
I20260709 12:11:09.955839 26289 raft_consensus.cc:3055] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:09.956043 26147 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:09.956317 26289 raft_consensus.cc:740] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:09.957283 26289 consensus_queue.cc:260] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:09.957815 26129 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:09.933207 25733 raft_consensus.cc:2804] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:09.958559 25733 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.912788 22601 raft_consensus.cc:1240] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:09.958890 25733 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:09.913064 26126 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.959959 26126 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:09.961977 26126 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:09.913470 26247 raft_consensus.cc:2804] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:09.913385 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:09.962913 22597 raft_consensus.cc:2393] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 9: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:09.962742 26247 raft_consensus.cc:697] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 8 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:09.911795 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:09.964236 26247 consensus_queue.cc:237] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:09.964460 25797 consensus_queue.cc:1059] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:09.965735 26075 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:09.965885 25797 raft_consensus.cc:3055] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:09.966339 25797 raft_consensus.cc:740] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:09.923096 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:09.924986 23121 raft_consensus.cc:1240] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:09.973395 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:11:09.973920 22351 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48412 (request call id 240) took 24457 ms (client timeout 15000 ms). Trace:
I20260709 12:11:09.974195 23120 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
I20260709 12:11:09.975292 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:09.975713 26234 consensus_queue.cc:1059] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:09.976137 22525 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 9.
I20260709 12:11:09.976682 26234 raft_consensus.cc:3055] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:09.977058 26234 raft_consensus.cc:740] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:09.977893 26177 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:09.958532 26032 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:09.982262 26057 raft_consensus.cc:2749] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:09.933153 22353 catalog_manager.cc:5697] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 4 to 7, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 7 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:09.984270 26291 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:09.923087 25628 raft_consensus.cc:697] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:09.985383 22353 catalog_manager.cc:5697] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 3 to 5, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 5 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:11:09.988168 22532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1728) took 3245 ms. Trace:
I20260709 12:11:09.990195 26032 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.986929 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:09.983099 26267 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:09.987427 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 88010.8us
I20260709 12:11:09.986658 26288 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:09.988433 22353 catalog_manager.cc:5697] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 4 to 8, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 8 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:09.989288 26199 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:09.990203 26038 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:09.990664 26132 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:09.988682 22421 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:09.986615 25628 consensus_queue.cc:237] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:10.003780 22597 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:10.009433 22497 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:10.011207 26205 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:10.015352 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:10.016933 22598 raft_consensus.cc:1240] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 10 LEADER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:10.023435 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.027773 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:09.958544 26289 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:09.978374 26234 consensus_queue.cc:260] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:10.028590 23117 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
I20260709 12:11:10.032353 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:10.034909 22598 raft_consensus.cc:3060] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:10.031850 26132 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:10.038554 23120 raft_consensus.cc:1275] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:09.991168 22532 rpcz_store.cc:276] 0709 12:11:06.742556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.464315 (+721759us) service_pool.cc:224] Handling call
0709 12:11:07.476938 (+ 12623us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:07.482254 (+  5316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:07.482273 (+    19us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:07.486813 (+  4540us) log.cc:844] Serialized 52 byte log entry
0709 12:11:07.678431 (+191618us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:09.812191 (+2133760us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b1800285640. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cca4d64bc 00007f9cc782448b 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc783e455 00007f9cce3263c7 00007f9cca9389a7 00007f9cca9480bf
0709 12:11:09.812343 (+   152us) log.cc:844] Serialized 14 byte log entry
0709 12:11:09.987456 (+175113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.987582 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:09.987660 (+    78us) raft_consensus.cc:1685] finished
0709 12:11:09.987798 (+   138us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:09.987966 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":675840,"prepare.queue_time_us":642082,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":4449,"raft.queue_time_us":68969,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":18171,"spinlock_wait_cycles":41437056,"thread_start_us":216513,"threads_started":3,"wal-append.queue_time_us":430366,"wal-append.run_cpu_time_us":1866,"wal-append.run_wall_time_us":1062025}
I20260709 12:11:10.037470 22496 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
W20260709 12:11:10.087725 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.089541 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:10.080493 22495 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:10.058807 22569 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:10.036396 26166 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.099129 22605 raft_consensus.cc:2410] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:11:10.098362 22353 catalog_manager.cc:5697] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 1 to 4, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 4 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:11:10.103520 23122 raft_consensus.cc:1275] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:11:10.111289 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 103561us
W20260709 12:11:10.113970 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.077689 26245 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:10.105645 26038 consensus_queue.cc:1048] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 12:11:10.119168 26025 consensus_queue.cc:1048] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:10.119942 26124 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.119951 22523 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
I20260709 12:11:10.120643 26124 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:10.122046 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:10.122592 26124 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:10.125506 26132 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:10.126194 22598 raft_consensus.cc:2468] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 8.
W20260709 12:11:10.127120 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 138678us
W20260709 12:11:09.974324 22351 rpcz_store.cc:269] 0709 12:10:45.516060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.516235 (+   175us) service_pool.cc:224] Handling call
0709 12:11:09.973643 (+24457408us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:57.572797 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:57.668070 (+ 95273us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:57.668107 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:10:57.668127 (+    20us) tablet.cc:662] Decoding operations
0709 12:10:57.709718 (+ 41591us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:57.710906 (+  1188us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:57.716222 (+  5316us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:10:57.760481 (+ 44259us) tablet.cc:701] Row locks acquired
0709 12:10:57.763274 (+  2793us) write_op.cc:260] PREPARE: finished
0709 12:10:57.770293 (+  7019us) write_op.cc:270] Start()
0709 12:10:57.812704 (+ 42411us) write_op.cc:276] Timestamp: P: 1783599057768924 usec, L: 0
0709 12:10:57.819185 (+  6481us) op_driver.cc:348] REPLICATION: starting
0709 12:10:57.883826 (+ 64641us) log.cc:844] Serialized 5198 byte log entry
0709 12:10:58.922956 (+1039130us) spinlock_profiling.cc:243] Waited 4.28 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cc78240ac 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc7840c02 00007f9cca4c820b
0709 12:10:59.456170 (+533214us) op_driver.cc:464] REPLICATION: finished
0709 12:10:59.941368 (+485198us) write_op.cc:301] APPLY: starting
0709 12:10:59.941537 (+   169us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:59.941988 (+   451us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:59.942036 (+    48us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:59.944109 (+  2073us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:59.944559 (+   450us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 12:10:59.944628 (+    69us) write_op.cc:312] APPLY: finished
0709 12:10:59.945187 (+   559us) log.cc:844] Serialized 95 byte log entry
0709 12:10:59.945380 (+   193us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:59.945581 (+   201us) write_op.cc:454] Released schema lock
0709 12:10:59.945643 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:59.946186 (+   543us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:59.946227 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":39450,"reported_tablets":35,"child_traces":[["op",{"apply.queue_time_us":435911,"apply.run_cpu_time_us":4860,"apply.run_wall_time_us":21921,"num_ops":13,"prepare.queue_time_us":880183,"prepare.run_cpu_time_us":39841,"prepare.run_wall_time_us":1672110,"raft.queue_time_us":260486,"raft.run_cpu_time_us":36505,"raft.run_wall_time_us":314522,"replication_time_us":1632538,"spinlock_wait_cycles":9847680,"thread_start_us":2893722,"threads_started":4,"wal-append.queue_time_us":1262812,"wal-append.run_cpu_time_us":20155,"wal-append.run_wall_time_us":1802633}]]}
W20260709 12:11:10.130148 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.127878 22421 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:10.133422 22597 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 10.
I20260709 12:11:10.137015 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:10.137243 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:10.138547 23123 raft_consensus.cc:1275] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:10.089169 26198 raft_consensus.cc:2749] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:10.101004 26111 raft_consensus.cc:2749] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:10.143191 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:10.144738 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:10.037235 26032 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:10.145187 22598 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
I20260709 12:11:10.144090 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:10.147133 22532 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:11:10.142884 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:10.142509 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:10.160019 22523 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:11:10.155987 22422 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:10.134500 26234 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:10.159950 22497 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
W20260709 12:11:10.161443 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 117381us
I20260709 12:11:10.161573 22422 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:10.159561 22529 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:11:10.145779 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:10.152161 22353 catalog_manager.cc:5697] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 4 to 5, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 5 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:10.163148 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:10.036537 26199 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:10.146566 26245 raft_consensus.cc:2804] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:10.186232 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:10.163079 25400 raft_consensus.cc:2749] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:10.187402 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:10.187067 26166 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:10.187963 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:10.188144 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:10.147553 26038 raft_consensus.cc:2749] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:10.184515 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:10.189741 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:10.187104 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:10.195168 26025 consensus_queue.cc:1048] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:11:10.192240 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:10.193111 26245 raft_consensus.cc:697] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:10.194314 22570 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:11:10.198397 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 164048us
I20260709 12:11:10.199389 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:10.199740 23123 raft_consensus.cc:1240] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:10.194926 26017 consensus_queue.cc:1048] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:11:10.204437 22454 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
I20260709 12:11:10.203773 22353 catalog_manager.cc:5697] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:11:10.205250 26038 raft_consensus.cc:2804] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:10.205698 26038 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:10.205407 22353 catalog_manager.cc:5697] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:11:10.206094 26038 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:10.208372 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:10.211201 22569 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:10.212806 26066 raft_consensus.cc:2749] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:10.213495 26066 consensus_queue.cc:1059] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:10.214687 26147 raft_consensus.cc:3055] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:10.145171 25797 consensus_queue.cc:260] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:10.215653 22525 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
W20260709 12:11:10.215723 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 87951us
W20260709 12:11:10.216318 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.197733 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:10.219427 22528 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:10.219642 22455 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
I20260709 12:11:10.189402 26105 raft_consensus.cc:2804] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:11:10.220786 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.215086 26147 raft_consensus.cc:740] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:10.147666 25733 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:10.188542 26060 raft_consensus.cc:2804] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:10.195679 26177 raft_consensus.cc:2804] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:10.231020 26016 consensus_queue.cc:1048] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:11:10.231122 26009 consensus_queue.cc:1048] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:10.231909 25988 consensus_queue.cc:1048] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:10.232422 25797 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:10.227594 24970 consensus_queue.cc:1048] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
W20260709 12:11:10.234146 26296 log.cc:927] Time spent T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:11:10.234305 26166 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:10.220937 22449 raft_consensus.cc:2376] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8. Re-sending same reply.
I20260709 12:11:10.230324 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:10.251564 23121 raft_consensus.cc:1275] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 12:11:10.250720 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.243549 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:10.220350 26205 raft_consensus.cc:2749] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:10.247730 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:10.236442 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:10.248926 22605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43070 (request call id 581) took 1045 ms. Trace:
I20260709 12:11:10.249974 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:10.215488 22353 catalog_manager.cc:5697] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 4 to 5, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 5 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:10.255477 22605 rpcz_store.cc:276] 0709 12:11:09.203763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.219559 (+ 15796us) service_pool.cc:224] Handling call
0709 12:11:10.245011 (+1025452us) spinlock_profiling.cc:243] Waited 878 ms on lock 0x7b54000ea454. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:10.248866 (+  3855us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2019707776}
I20260709 12:11:10.256496 22529 raft_consensus.cc:2393] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 8: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
W20260709 12:11:10.257061 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.259532 22602 raft_consensus.cc:1275] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:10.237851 26060 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:10.257793 23117 raft_consensus.cc:2376] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8. Re-sending same reply.
I20260709 12:11:10.260437 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:10.263476 22523 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:11:10.222489 26017 consensus_queue.cc:1048] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:11:10.246891 26161 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.237287 26105 raft_consensus.cc:697] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 8 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
W20260709 12:11:10.278718 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:10.280375 26303 log.cc:927] Time spent T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:11:10.283037 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:10.284578 23121 raft_consensus.cc:1240] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:10.285640 26245 consensus_queue.cc:237] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:10.287324 24970 consensus_queue.cc:1048] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:10.289153 22496 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:10.290557 26032 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:10.290373 26105 consensus_queue.cc:237] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:10.292155 26297 log.cc:927] Time spent T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.143s	user 0.002s	sys 0.000s
I20260709 12:11:10.296718 26147 consensus_queue.cc:260] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:10.296254 22353 catalog_manager.cc:5697] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: leader changed from <none> to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 6 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:11:10.298415 26147 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:10.299831 22353 catalog_manager.cc:5697] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 4 to 6, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 6 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:11:10.275056 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:11:10.303902 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 65539.7us
I20260709 12:11:10.248771 26177 raft_consensus.cc:697] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 10 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:10.301795 23119 raft_consensus.cc:2468] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
I20260709 12:11:10.269572 26060 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:10.262967 25675 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.314139 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:11:10.305735 26213 consensus_meta.cc:287] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.534s	user 0.007s	sys 0.005s
I20260709 12:11:10.364015 22527 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
I20260709 12:11:10.369632 22569 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:11:10.377867 26299 log.cc:927] Time spent T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:11:10.316926 25675 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:10.384380 26177 consensus_queue.cc:237] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:10.387200 26074 consensus_queue.cc:1059] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.115s
I20260709 12:11:10.424314 26166 consensus_queue.cc:1059] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:11:10.435202 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 165376us
I20260709 12:11:10.440521 26140 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:10.441296 26140 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:10.462122 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 106439us
I20260709 12:11:10.311246 26161 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:10.470423 22528 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
I20260709 12:11:10.473093 25733 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:10.477432 25675 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:10.460706 26199 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:10.480132 26227 raft_consensus.cc:2804] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:10.480687 26227 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:10.481143 26227 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:10.486642 26161 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:10.487329 26301 log.cc:927] Time spent T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 12:11:10.353814 26213 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:10.497701 26213 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:10.499023 26074 raft_consensus.cc:3055] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:10.499600 26074 raft_consensus.cc:740] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:10.500406 22602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2167) took 2190 ms. Trace:
I20260709 12:11:10.500906 22602 rpcz_store.cc:276] 0709 12:11:08.310285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.312212 (+  1927us) service_pool.cc:224] Handling call
0709 12:11:08.312572 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.262421 (+1949849us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.500008 (+237587us) spinlock_profiling.cc:243] Waited 1.92 s on lock 0x7b5400448754. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:10.500316 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4421993216}
W20260709 12:11:10.503739 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 270409us
I20260709 12:11:10.504168 26267 consensus_queue.cc:1059] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:10.504673 22495 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:10.505311 26291 raft_consensus.cc:3055] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:10.505735 26291 raft_consensus.cc:740] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:10.506644 26291 consensus_queue.cc:260] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:10.507817 26291 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:10.508818 26038 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:10.509491 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 237924us
W20260709 12:11:10.509919 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 220842us
I20260709 12:11:10.511456 25400 raft_consensus.cc:2749] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:10.500765 26074 consensus_queue.cc:260] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:10.523706 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 265931us
I20260709 12:11:10.519308 22495 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:10.523733 22496 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:10.463743 26245 raft_consensus.cc:3055] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:11:10.567371 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 43729us
I20260709 12:11:10.568203 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:11:10.569814 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.571420 22604 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:10.572327 22496 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:10.585420 22603 raft_consensus.cc:1240] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:10.587841 22569 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:10.591624 22496 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:10.589969 25733 raft_consensus.cc:2749] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:10.592730 25628 raft_consensus.cc:2749] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:10.597798 26199 consensus_queue.cc:1048] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:10.573242 26245 raft_consensus.cc:740] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
W20260709 12:11:10.600116 26298 log.cc:927] Time spent T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.460s	user 0.002s	sys 0.000s
I20260709 12:11:10.604112 26074 raft_consensus.cc:3060] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:10.606383 26289 consensus_meta.cc:287] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.572s	user 0.010s	sys 0.000s
I20260709 12:11:10.610636 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:11:10.612773 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 93583.8us
I20260709 12:11:10.588543 26053 raft_consensus.cc:2804] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:11:10.654641 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.612528 26213 raft_consensus.cc:2804] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:10.671937 22495 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:10.678455 26140 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:10.679095 26309 consensus_queue.cc:1048] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.086s
I20260709 12:11:10.679654 26247 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:10.679105 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.634382 26126 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:10.671984 22569 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:10.626031 25733 raft_consensus.cc:2804] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:10.608163 26161 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:10.690510 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 333238us
I20260709 12:11:10.645502 26111 consensus_queue.cc:1059] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 12:11:10.639807 26075 consensus_queue.cc:1048] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:11:10.593262 26016 consensus_queue.cc:1059] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.095s
I20260709 12:11:10.634769 26009 consensus_queue.cc:1048] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:11:10.684060 25628 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.690222 26213 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:10.721421 22604 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
I20260709 12:11:10.721575 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:10.718618 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 74572.5us
W20260709 12:11:10.718900 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 47042us
I20260709 12:11:10.722915 22497 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:10.723543 22495 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:10.724625 22495 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:10.732697 23123 raft_consensus.cc:1275] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:10.712541 25733 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:10.714506 26124 raft_consensus.cc:2749] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:10.712375 26053 raft_consensus.cc:697] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:10.719322 26057 raft_consensus.cc:3055] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:10.716315 26147 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:10.748574 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:10.751932 22421 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:10.729629 26213 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:10.754896 22495 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:10.712984 26126 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:10.764343 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:10.764882 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:10.742170 26277 raft_consensus.cc:2804] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:10.741088 26066 raft_consensus.cc:2804] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:10.763132 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:10.741739 25733 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:10.767655 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:10.766139 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:10.773308 22603 raft_consensus.cc:1275] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:11:10.742487 26273 raft_consensus.cc:2749] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:10.717846 26161 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:10.751376 26289 raft_consensus.cc:2749] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:10.779165 22605 raft_consensus.cc:2393] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 9: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:10.713347 26247 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:10.778921 22601 raft_consensus.cc:2410] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:11:10.780930 26311 log.cc:927] Time spent T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 12:11:10.780761 26053 consensus_queue.cc:237] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:10.778357 26066 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:10.728595 25628 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:10.751320 26057 raft_consensus.cc:740] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:10.753218 26205 raft_consensus.cc:2804] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:11:10.773293 25797 consensus_meta.cc:287] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.514s	user 0.009s	sys 0.001s
I20260709 12:11:10.808167 22495 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:10.805052 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 216162us
I20260709 12:11:10.772467 26277 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:10.778687 26124 raft_consensus.cc:2749] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:10.764220 26042 consensus_queue.cc:1048] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:11:10.768744 26147 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:10.826565 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.829164 26310 raft_consensus.cc:3055] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:10.830837 26111 raft_consensus.cc:2749] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:10.833730 26161 leader_election.cc:290] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:10.834729 26060 consensus_meta.cc:287] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.512s	user 0.009s	sys 0.002s
I20260709 12:11:10.837106 26038 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:10.840760 25628 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:10.841077 26323 raft_consensus.cc:2749] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:10.823452 26277 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:10.842116 22495 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:10.947597 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:10.845623 26126 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:10.847078 26205 raft_consensus.cc:697] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
W20260709 12:11:10.847528 26308 log.cc:927] Time spent T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.380s	user 0.003s	sys 0.001s
I20260709 12:11:10.810190 26066 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:10.856426 26313 log.cc:927] Time spent T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:11:10.857291 26057 consensus_queue.cc:260] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:10.863109 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:10.863322 26147 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:11:10.863894 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 189944us
I20260709 12:11:10.864416 22606 raft_consensus.cc:1240] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:10.864964 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:10.742048 26245 consensus_queue.cc:260] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:10.915254 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:10.957701 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.959350 22570 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:10.960783 22570 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:10.960903 26309 raft_consensus.cc:2804] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:10.961457 26309 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:10.922319 22600 raft_consensus.cc:1275] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:10.923427 26227 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:10.962270 22570 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:10.962496 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:11:10.918216 23087 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.720s (SENT) [suppressed 55 similar messages]
W20260709 12:11:10.928270 26234 consensus_meta.cc:287] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.736s	user 0.007s	sys 0.003s
I20260709 12:11:10.963416 26147 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:10.964040 22597 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 8.
I20260709 12:11:10.964119 26147 raft_consensus.cc:697] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:10.937733 26213 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:10.965070 26205 consensus_queue.cc:237] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:10.966701 26213 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:10.967448 22602 raft_consensus.cc:1240] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:10.967653 26227 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:10.966593 26177 consensus_queue.cc:1048] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
W20260709 12:11:10.968705 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 50540.9us
I20260709 12:11:10.953684 25628 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:10.969342 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:10.951670 26074 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.970039 22454 raft_consensus.cc:2376] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9. Re-sending same reply.
I20260709 12:11:10.970594 26126 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.970408 26074 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:10.971238 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 129190us
I20260709 12:11:10.971079 26126 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:10.972188 25628 consensus_queue.cc:1048] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:10.973896 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:10.974261 22531 raft_consensus.cc:1275] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:10.974587 22523 raft_consensus.cc:2393] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 10: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:10.974423 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:10.975096 22529 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 10.
I20260709 12:11:10.975292 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:10.942301 26060 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:10.976795 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:10.977541 22532 raft_consensus.cc:2393] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 9: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:10.977795 26060 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:10.978266 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:10.979756 26057 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:10.911264 22601 raft_consensus.cc:1275] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
W20260709 12:11:10.940308 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 193854us
I20260709 12:11:10.982367 22455 raft_consensus.cc:1275] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:11:10.961925 26309 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:10.928938 26247 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:10.985677 22526 raft_consensus.cc:1275] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:10.973240 26126 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:10.981676 22597 raft_consensus.cc:1275] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:11:10.919929 22452 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 10.
I20260709 12:11:10.992316 22597 pending_rounds.cc:85] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc: Aborting all ops after (but not including) 6
I20260709 12:11:10.940428 26310 raft_consensus.cc:740] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:10.984416 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:10.984424 23089 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:10.982034 22601 pending_rounds.cc:85] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc: Aborting all ops after (but not including) 3
I20260709 12:11:10.994473 22601 pending_rounds.cc:107] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:11:10.994761 22601 raft_consensus.cc:2889] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:10.992605 22597 pending_rounds.cc:107] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:11:10.995230 22597 raft_consensus.cc:2889] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:10.995265 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 266760us
I20260709 12:11:10.979803 22527 raft_consensus.cc:1275] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:10.997603 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:10.999459 22602 raft_consensus.cc:1275] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:11.000098 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:11.001736 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:11.002174 26025 raft_consensus.cc:2804] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:10.989809 26161 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.004717 26161 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:11.005060 26310 consensus_queue.cc:260] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:11.006117 26310 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:11.000669 23116 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7.
I20260709 12:11:11.011273 26126 raft_consensus.cc:2804] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:11.011701 26126 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:11.012072 26126 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:11.012410 25733 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:11.014433 25733 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:11.014223 26247 consensus_queue.cc:1059] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:11.015161 26129 consensus_queue.cc:1059] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:11.015220 26291 consensus_queue.cc:1048] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:11.016181 26129 raft_consensus.cc:3055] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:11.016537 26129 raft_consensus.cc:740] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:11.017365 26129 consensus_queue.cc:260] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:11.018539 26129 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:11.021477 22448 raft_consensus.cc:1275] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:11.022610 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:11.023824 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:11.020217 26316 consensus_queue.cc:1048] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:11:11.015619 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:11.025346 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:11.025900 23122 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:11.026108 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:11.026691 22454 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:11.027981 26198 consensus_queue.cc:1048] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:11.029680 26245 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:11.020196 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:11.020748 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:10.965070 26147 consensus_queue.cc:237] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:11.020931 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:11.031767 22448 raft_consensus.cc:1240] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 LEADER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:11.023769 22496 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:11.019703 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:11.004181 22570 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:11.020089 26247 raft_consensus.cc:3055] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:11.018580 22527 raft_consensus.cc:1240] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:11.019531 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:11.034240 22570 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:11.010849 22449 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11.
I20260709 12:11:11.041569 22421 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:11.050168 23122 raft_consensus.cc:2468] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
I20260709 12:11:11.033671 22451 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:11.054234 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:11.060032 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:11.061898 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:11.035354 26277 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:11.078485 22527 raft_consensus.cc:1275] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:11:11.052716 26227 raft_consensus.cc:2804] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:10.997413 26060 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:11.066896 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.067091 22529 raft_consensus.cc:1275] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:11.067670 22526 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:11.080231 22570 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:11.095335 22524 raft_consensus.cc:1240] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:11:11.087785 23117 raft_consensus.cc:1275] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:11:11.088455 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 86976us
I20260709 12:11:11.091043 23121 raft_consensus.cc:1275] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:11:11.093751 25988 consensus_queue.cc:1048] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:11:11.103268 22569 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:11.104449 22528 raft_consensus.cc:1275] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:11.105832 22528 raft_consensus.cc:1275] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:11.047858 26247 raft_consensus.cc:740] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:11.108083 22455 raft_consensus.cc:1240] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:11.053315 25733 raft_consensus.cc:2804] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:11.094192 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:11.103447 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:11.126008 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:11.142338 22527 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:11.135864 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 55748.2us
I20260709 12:11:11.141888 22523 raft_consensus.cc:2393] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 12: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:11.130039 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:11.138512 22451 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
I20260709 12:11:11.144069 22528 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 9.
I20260709 12:11:11.132949 22526 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 10.
I20260709 12:11:11.079244 26038 raft_consensus.cc:2749] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:11.132189 23088 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:11.154557 23088 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:11.168627 23117 raft_consensus.cc:2410] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:11:11.168910 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:11.169698 22451 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:11.172066 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:11.172868 22529 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 7.
I20260709 12:11:11.176391 23088 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:11.178580 22600 raft_consensus.cc:1275] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:11.187495 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:11.189002 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:11.122076 26227 raft_consensus.cc:697] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:11.122179 26326 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.090135 26161 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:11.127586 26025 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:11.179901 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:11.151751 25733 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:11.139024 26323 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.145177 25988 raft_consensus.cc:2749] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:11.200534 23122 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:11.139956 26177 consensus_queue.cc:1048] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 12:11:11.203969 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:11.131295 26316 raft_consensus.cc:2749] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:11:11.207216 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 63630.4us
I20260709 12:11:11.207759 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:11.175650 26291 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:11.213371 22531 raft_consensus.cc:1240] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:11.180497 26292 raft_consensus.cc:2749] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:11.126269 26277 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:11.108832 26060 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:11.224805 22496 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:11:11.232785 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 129628us
I20260709 12:11:11.202346 26042 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:11.199739 26124 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.176038 26032 consensus_queue.cc:1059] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:11:11.199739 25400 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:11.259061 22451 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
I20260709 12:11:11.213055 26161 raft_consensus.cc:2749] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:11.233520 22569 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:11.244360 22527 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
W20260709 12:11:11.245672 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.249722 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:11.213400 25733 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:11.253607 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 57664.8us
I20260709 12:11:11.256058 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:11.268179 22600 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 10: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:11.268451 22495 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:11.256922 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:11.210038 26025 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:11.272328 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:11.276221 22421 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:11.254287 26277 raft_consensus.cc:2804] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:11.289178 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:11.296635 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:11:11.298345 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 64894.8us
I20260709 12:11:11.298823 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:11.298897 26066 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:11.299443 22455 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:11.300096 26147 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:11.300184 22569 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:11.300591 25675 consensus_queue.cc:1048] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:11.300874 26009 consensus_queue.cc:1048] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:11.301622 22569 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:11.302042 26009 raft_consensus.cc:2749] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:11.302898 22599 raft_consensus.cc:2393] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 9: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:11.299897 26016 consensus_queue.cc:1048] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:11.233424 25797 consensus_queue.cc:1048] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:11:11.275807 26074 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:11.312175 23122 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 10.
W20260709 12:11:11.355717 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 51386.5us
I20260709 12:11:11.315388 22455 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 10.
I20260709 12:11:11.233098 26326 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:11.362489 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 58174.1us
I20260709 12:11:11.363336 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:11.302717 22569 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:11.258036 26042 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:11.302713 26009 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:11.300662 26147 raft_consensus.cc:697] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:11.371905 22570 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:11.340646 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.262858 26124 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:11.304693 26300 raft_consensus.cc:2804] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:11.376103 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.310268 26277 raft_consensus.cc:697] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:11.272925 25400 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:11.370160 26314 log.cc:927] Time spent T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:11:11.237991 26323 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:11.383741 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 118147us
I20260709 12:11:11.295995 26289 raft_consensus.cc:2804] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:11.392230 22495 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:11.260921 26247 consensus_queue.cc:260] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:11.310968 26322 raft_consensus.cc:2749] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:11.397809 22495 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:11:11.399261 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 96615.6us
I20260709 12:11:11.399402 26126 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:11.399885 26042 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:11.355717 25988 consensus_queue.cc:1048] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
W20260709 12:11:11.393978 26346 log.cc:927] Time spent T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 12:11:11.402308 22569 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:11.401983 26277 consensus_queue.cc:237] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:11.404995 26124 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:11.406579 25400 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:11.394150 26009 raft_consensus.cc:2749] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:11.453516 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:11.408313 26325 raft_consensus.cc:2804] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:11.409307 26344 log.cc:927] Time spent T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:11:11.411654 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:11.412583 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:11.413231 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:11.427484 26147 consensus_queue.cc:237] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:11.429391 26326 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:11.361905 26227 consensus_queue.cc:237] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:11.432361 26323 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:11.359346 26309 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:11.448987 22454 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 10.
I20260709 12:11:11.449965 22457 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
I20260709 12:11:11.452353 22530 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 10.
W20260709 12:11:11.464072 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.469028 22606 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
I20260709 12:11:11.472297 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:11.392802 26289 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:11.473428 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 75717us
I20260709 12:11:11.478190 22603 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 9.
I20260709 12:11:11.469652 22597 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
I20260709 12:11:11.454205 23123 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7.
I20260709 12:11:11.485834 22495 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:11.488073 23118 raft_consensus.cc:1275] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:11.447906 26075 raft_consensus.cc:2749] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:11.497860 26132 raft_consensus.cc:2804] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:11.498766 26132 raft_consensus.cc:697] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:11.499888 26132 consensus_queue.cc:237] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:11.452975 26016 raft_consensus.cc:2804] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:11.477039 26124 raft_consensus.cc:2804] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:11.494182 26025 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:11.500336 25733 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:11.501933 22600 raft_consensus.cc:1240] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:11.502714 23089 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:11.469599 26325 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
W20260709 12:11:11.512259 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 63141.4us
I20260709 12:11:11.514715 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:11.487128 26247 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:11.516073 22601 raft_consensus.cc:2410] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:11:11.488945 26289 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:11.520445 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 148615us
I20260709 12:11:11.526829 22604 raft_consensus.cc:1240] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:11:11.501365 26016 raft_consensus.cc:697] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:11.501436 26124 raft_consensus.cc:697] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:11.514940 26325 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:11.540370 22421 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:11.533288 26129 raft_consensus.cc:2804] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:11.556831 26129 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:11.557432 26129 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:11.577446 23121 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
W20260709 12:11:11.549227 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 372912us
I20260709 12:11:11.540222 26316 consensus_queue.cc:1059] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:11:11.611287 23088 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:11.623153 25957 consensus_queue.cc:1048] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:11:11.606804 25675 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.603077 26327 raft_consensus.cc:2749] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:11.628921 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 99434.2us
I20260709 12:11:11.634394 25675 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:11.716678 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 65096.7us
I20260709 12:11:11.620748 25988 consensus_queue.cc:1048] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:11:11.610673 26124 consensus_queue.cc:237] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:11.716943 26320 log.cc:927] Time spent T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:11:11.671655 26140 raft_consensus.cc:2749] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:11:11.771629 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 44709.4us
I20260709 12:11:11.804462 22421 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:11:11.722127 26346 log.cc:927] Time spent T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:11:11.770790 26323 consensus_queue.cc:1059] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.031s
W20260709 12:11:11.802582 26356 log.cc:927] Time spent T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 12:11:11.769182 26308 log.cc:927] Time spent T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:11:11.806520 22421 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:11.646166 26357 consensus_queue.cc:1048] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.172s
I20260709 12:11:11.671554 25797 consensus_queue.cc:1048] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.140s
I20260709 12:11:11.625432 26016 consensus_queue.cc:237] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:11.772392 26132 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:11.841702 25675 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:11.849807 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.810889 26025 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:11.723289 26327 consensus_queue.cc:1048] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.104s
I20260709 12:11:11.813745 26322 raft_consensus.cc:2749] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:11.930159 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.838595 26074 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:11.846124 25733 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:11.941985 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 296994us
W20260709 12:11:11.901645 26245 consensus_meta.cc:287] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.870s	user 0.013s	sys 0.000s
W20260709 12:11:11.946040 22569 leader_election.cc:336] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 2.174s (SENT)
W20260709 12:11:11.943289 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 330410us
I20260709 12:11:12.042431 22449 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
W20260709 12:11:12.046348 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 91446.4us
I20260709 12:11:12.047662 22570 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:11.832779 25957 consensus_queue.cc:1048] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.102s
W20260709 12:11:12.050518 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 104504us
I20260709 12:11:11.946445 26074 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:12.049510 26032 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.898648 26132 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:12.035840 25988 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.157356 22450 raft_consensus.cc:1240] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 11 LEADER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:12.158167 22453 raft_consensus.cc:1240] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:12.156438 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:12.041718 26322 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:12.172197 23124 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.033s	sys 0.096s
W20260709 12:11:12.172693 23124 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.034s	sys 0.096s
I20260709 12:11:12.100481 26025 raft_consensus.cc:2804] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:12.151602 26074 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:12.181829 26334 log.cc:927] Time spent T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:11:12.186079 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:12.182113 26360 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:12.182384 26132 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:12.099316 26032 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:12.246910 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:12.203594 22570 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:11.819031 26355 consensus_queue.cc:1048] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.125s
W20260709 12:11:12.255393 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 146491us
I20260709 12:11:12.255030 25733 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.260943 25733 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:12.263078 26066 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:12.180584 26357 consensus_queue.cc:1048] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 12:11:12.169075 25988 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:12.231335 26025 raft_consensus.cc:697] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
W20260709 12:11:12.267346 23119 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.009s	sys 0.008s
W20260709 12:11:12.270049 23122 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.004s	sys 0.002s
W20260709 12:11:12.271291 23119 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.009s	sys 0.008s
I20260709 12:11:12.187567 26322 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:12.255542 26277 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:12.271250 23122 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.004s	sys 0.002s
W20260709 12:11:12.285216 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.289397 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:12.290093 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 202387us
I20260709 12:11:12.233500 26360 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:12.287201 26198 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.000s	sys 0.009s
I20260709 12:11:12.291229 23088 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:12.298110 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:12.316787 23088 leader_election.cc:304] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:12.317533 22530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56942 (request call id 1770) took 1237 ms. Trace:
I20260709 12:11:12.326663 22530 rpcz_store.cc:276] 0709 12:11:11.061499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.061612 (+   113us) service_pool.cc:224] Handling call
0709 12:11:12.298640 (+1237028us) spinlock_profiling.cc:243] Waited 355 ms on lock 0x7b54001f3e54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:12.298745 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":817243904}
I20260709 12:11:12.294422 22453 raft_consensus.cc:2468] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 8.
W20260709 12:11:12.323669 22601 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.007s	sys 0.016s
W20260709 12:11:12.328950 22601 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.008s	sys 0.016s
I20260709 12:11:12.288552 26277 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:12.333503 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:12.374054 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.335830 22527 raft_consensus.cc:1240] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 LEADER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:12.410517 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 153819us
W20260709 12:11:12.328351 26366 log.cc:927] Time spent T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.500s	user 0.001s	sys 0.000s
I20260709 12:11:12.359640 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:11:12.358952 22449 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1841) took 1335 ms (client timeout 1724 ms). Trace:
I20260709 12:11:12.334355 22450 raft_consensus.cc:1240] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:12.328701 26371 log.cc:927] Time spent T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
W20260709 12:11:12.329233 26362 log.cc:927] Time spent T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.558s	user 0.000s	sys 0.001s
W20260709 12:11:12.328594 26358 log.cc:927] Time spent T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.579s	user 0.001s	sys 0.000s
W20260709 12:11:12.334614 26364 log.cc:927] Time spent T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.457s	user 0.001s	sys 0.000s
I20260709 12:11:12.416558 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:11:12.324692 26009 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.012s	sys 0.012s
I20260709 12:11:12.437229 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:11:12.401716 26375 log.cc:927] Time spent T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:11:12.326054 26355 raft_consensus.cc:2804] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:11:12.334796 26372 log.cc:927] Time spent T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
W20260709 12:11:12.355697 26369 log.cc:927] Time spent T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260709 12:11:12.400832 26379 log.cc:927] Time spent T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 12:11:12.360276 26374 log.cc:927] Time spent T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:11:12.349967 23121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57328 (request call id 1169) took 1115 ms. Trace:
I20260709 12:11:12.463207 23121 rpcz_store.cc:276] 0709 12:11:11.234123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.234503 (+   380us) service_pool.cc:224] Handling call
0709 12:11:12.349770 (+1115267us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b540018c4d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:12.349878 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":529016704}
W20260709 12:11:12.441884 26009 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.012s	sys 0.017s
I20260709 12:11:12.402335 26357 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:12.465461 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:12.466302 22453 raft_consensus.cc:2393] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 8: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:12.334224 26380 raft_consensus.cc:2804] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:11:12.333793 26368 log.cc:927] Time spent T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.368s	user 0.000s	sys 0.001s
I20260709 12:11:12.435809 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:12.491685 22450 raft_consensus.cc:2410] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
W20260709 12:11:12.348937 26367 log.cc:927] Time spent T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.397s	user 0.000s	sys 0.001s
I20260709 12:11:12.330550 25733 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:12.402740 26198 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.001s	sys 0.009s
W20260709 12:11:12.443713 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.493726 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:12.334023 26363 log.cc:927] Time spent T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.445s	user 0.000s	sys 0.001s
I20260709 12:11:12.359905 25988 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:12.349356 26126 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:12.353555 26132 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.353518 25628 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:12.438145 23123 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11.
I20260709 12:11:12.354156 26300 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:12.353652 26042 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.358786 26382 raft_consensus.cc:2749] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:12.447216 26060 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:12.454741 22451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2373) took 1323 ms. Trace:
I20260709 12:11:12.455274 26322 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:12.460216 26310 consensus_meta.cc:287] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 1.454s	user 0.012s	sys 0.001s
W20260709 12:11:12.487195 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:12.433028 22449 rpcz_store.cc:269] 0709 12:11:11.036749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.053869 (+ 17120us) service_pool.cc:224] Handling call
0709 12:11:12.358755 (+1304886us) spinlock_profiling.cc:243] Waited 987 ms on lock 0x7b5400241154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:12.358869 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2270478592}
I20260709 12:11:12.495612 22453 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 8.
W20260709 12:11:12.464746 26289 consensus_meta.cc:287] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.928s	user 0.010s	sys 0.000s
I20260709 12:11:12.448834 26355 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:12.335409 26377 consensus_queue.cc:1048] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.209s
I20260709 12:11:12.497162 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:12.505229 26384 log.cc:927] Time spent T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:11:12.491905 26387 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:12.510893 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 153305us
I20260709 12:11:12.501853 22601 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 8.
I20260709 12:11:12.510463 22451 rpcz_store.cc:276] 0709 12:11:11.131217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.431183 (+299966us) service_pool.cc:224] Handling call
0709 12:11:11.431496 (+   313us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:11.445633 (+ 14137us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:11.445677 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:11.477713 (+ 32036us) log.cc:844] Serialized 52 byte log entry
0709 12:11:11.556182 (+ 78469us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:11.556238 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.556321 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:12.454505 (+898184us) raft_consensus.cc:1685] finished
0709 12:11:12.454524 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:12.454685 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":102,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":21495,"thread_start_us":38441,"threads_started":1,"wal-append.queue_time_us":216010}
I20260709 12:11:12.495314 26380 raft_consensus.cc:697] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
W20260709 12:11:12.513701 26247 consensus_meta.cc:287] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.985s	user 0.009s	sys 0.003s
I20260709 12:11:12.335179 26378 consensus_queue.cc:1059] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.238s
W20260709 12:11:12.528818 23087 leader_election.cc:336] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.515s (SENT)
I20260709 12:11:12.507444 26300 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:12.494270 26357 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:12.557807 22456 raft_consensus.cc:2468] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 8.
I20260709 12:11:12.415869 26025 consensus_queue.cc:237] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:12.533046 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:12.583279 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:12.560540 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:12.584641 22453 raft_consensus.cc:2393] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 8: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:12.533151 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:12.586265 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:12.589339 23120 raft_consensus.cc:1275] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:11:12.589748 23120 pending_rounds.cc:85] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270: Aborting all ops after (but not including) 7
I20260709 12:11:12.590040 23120 pending_rounds.cc:107] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:11:12.590524 23120 raft_consensus.cc:2889] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:12.507553 26132 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:12.583706 23087 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:12.598995 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:12.587950 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 173521us
I20260709 12:11:12.599852 22451 raft_consensus.cc:2410] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:11:12.520853 26355 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:12.600306 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:12.600484 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:12.507071 25628 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:12.510453 26042 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:12.587983 26358 log.cc:927] Time spent T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:11:12.557518 26387 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:12.519739 26105 raft_consensus.cc:3055] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:12.613724 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:12.620421 22449 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 10: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:12.597512 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:12.585970 26009 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.617594 23119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 1166) took 1438 ms. Trace:
I20260709 12:11:12.622349 22450 raft_consensus.cc:1240] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:12.527221 26289 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:12.623410 22451 raft_consensus.cc:1275] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:12.623577 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:12.624861 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 96070.5us
W20260709 12:11:12.626179 23087 leader_election.cc:336] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.610s (SENT)
I20260709 12:11:12.626631 23087 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:12.619171 26291 consensus_meta.cc:287] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 1.381s	user 0.014s	sys 0.000s
I20260709 12:11:12.621536 23119 rpcz_store.cc:276] 0709 12:11:11.179258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.181723 (+  2465us) service_pool.cc:224] Handling call
0709 12:11:11.202859 (+ 21136us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:11.516697 (+313838us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:11.516745 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:11.573853 (+ 57108us) log.cc:844] Serialized 26 byte log entry
0709 12:11:12.272094 (+698241us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:12.272144 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.272242 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:12.617408 (+345166us) raft_consensus.cc:1685] finished
0709 12:11:12.617425 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:12.617540 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":57435,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":26610,"thread_start_us":981937,"threads_started":2,"wal-append.queue_time_us":796990}
I20260709 12:11:12.632297 22454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1846) took 1190 ms. Trace:
W20260709 12:11:12.635512 26347 log.cc:927] Time spent T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 1.057s	user 0.004s	sys 0.010s
I20260709 12:11:12.620741 26247 raft_consensus.cc:2749] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:12.625118 26378 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:12.627609 26382 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.646298 22529 raft_consensus.cc:1240] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 12:11:12.651430 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 61762.7us
W20260709 12:11:16.296463 22569 connection.cc:256] RPC call timeout handler was delayed by -3.6842221499998686s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2094s for a response
I20260709 12:11:12.674398 23122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 1173) took 1090 ms. Trace:
W20260709 12:11:15.228974 26408 log.cc:927] Time spent T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.478s	user 0.000s	sys 0.001s
W20260709 12:11:15.229826 26406 log.cc:927] Time spent T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 12:11:16.375792 26432 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.376528 26432 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:15.974364 26404 log.cc:927] Time spent T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 3.327s	user 0.020s	sys 0.030s
I20260709 12:11:16.007763 22452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1842) took 4924 ms. Trace:
I20260709 12:11:16.380069 22452 rpcz_store.cc:276] 0709 12:11:11.083571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.385875 (+302304us) service_pool.cc:224] Handling call
0709 12:11:11.386221 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:11.409824 (+ 23603us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:11.410188 (+   364us) log.cc:844] Serialized 14 byte log entry
0709 12:11:11.592682 (+182494us) log.cc:844] Serialized 14 byte log entry
0709 12:11:11.607954 (+ 15272us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:11.626755 (+ 18801us) log.cc:844] Serialized 26 byte log entry
0709 12:11:11.626919 (+   164us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:11.626951 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.631552 (+  4601us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:15.940834 (+4309282us) spinlock_profiling.cc:243] Waited 4.67 ms on lock 0x7b1800214180. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc7841522 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd 0000000000388634 0000000000388479 00007f9cc782483a
0709 12:11:16.007515 (+ 66681us) raft_consensus.cc:1685] finished
0709 12:11:16.007537 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:16.007680 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65885,"prepare.queue_time_us":82035,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":9617,"raft.queue_time_us":28611,"raft.run_cpu_time_us":382,"raft.run_wall_time_us":3866,"spinlock_wait_cycles":10737408,"thread_start_us":166126,"threads_started":2,"wal-append.queue_time_us":185489,"wal-append.run_cpu_time_us":14677,"wal-append.run_wall_time_us":2090837}
I20260709 12:11:12.650549 22454 rpcz_store.cc:276] 0709 12:11:11.442087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.495513 (+ 53426us) service_pool.cc:224] Handling call
0709 12:11:11.495798 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:11.519714 (+ 23916us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:11.537385 (+ 17671us) log.cc:844] Serialized 14 byte log entry
0709 12:11:11.609211 (+ 71826us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:11.609791 (+   580us) log.cc:844] Serialized 26 byte log entry
0709 12:11:11.609951 (+   160us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:11.609988 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.610054 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:11.841878 (+231824us) spinlock_profiling.cc:243] Waited 5.66 ms on lock 0x7b18003b26c0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc7841522 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd 0000000000388634 0000000000388479 00007f9cc782483a
0709 12:11:12.632011 (+790133us) raft_consensus.cc:1685] finished
0709 12:11:12.632115 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:12.632241 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70795,"prepare.queue_time_us":14728,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":4010,"raft.queue_time_us":29648,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":5258,"spinlock_wait_cycles":13026688,"thread_start_us":25342,"threads_started":1,"wal-append.queue_time_us":193913}
I20260709 12:11:16.383230 26433 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:16.026439 22572 connection.cc:256] RPC call timeout handler was delayed by -3.407943418000059s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:11:16.383853 26433 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:16.384656 22344 maintenance_manager.cc:419] P 136fd3da76544029a815aef59e698e17: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033400
I20260709 12:11:16.026942 26410 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:16.386229 26410 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:16.388252 26410 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:16.388753 26410 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:16.389204 26410 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:16.392359 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:16.393605 22600 raft_consensus.cc:1275] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:16.394477 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:16.395788 26432 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:16.057282 22497 connection.cc:256] RPC call timeout handler was delayed by -2.9487353950000852s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1886s for a response
I20260709 12:11:16.057369 26412 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:11:16.396448 22497 connection.cc:256] RPC call timeout handler was delayed by -2.9451353950000794s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.189s for a response
I20260709 12:11:16.396631 26412 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:16.056432 26411 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:16.107735 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:16.081038 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 3.4546e+06us
I20260709 12:11:16.399255 22450 raft_consensus.cc:2410] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:11:16.398901 26411 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:16.399456 23087 leader_election.cc:336] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.837s (SENT)
I20260709 12:11:16.400151 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:16.117542 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.400929 26411 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:16.401226 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:16.156527 26402 log.cc:927] Time spent T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 1.122s	user 0.009s	sys 0.015s
I20260709 12:11:16.159725 26415 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.161504 22525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1772) took 5095 ms. Trace:
I20260709 12:11:16.164366 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:16.170001 22604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2212) took 4702 ms. Trace:
W20260709 12:11:16.173251 22524 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 3.575s	user 0.022s	sys 0.071s
I20260709 12:11:16.210150 26418 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.209384 22531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 752) took 3795 ms. Trace:
I20260709 12:11:16.207008 26414 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.403640 26418 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:16.402285 26415 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:16.219756 26417 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.222842 22451 raft_consensus.cc:1275] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:16.405403 22451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 725) took 3946 ms. Trace:
I20260709 12:11:16.405171 26417 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:16.405969 26418 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:16.227883 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.406380 26415 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:16.072551 26032 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:16.026201 26038 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.424975 26038 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:16.005470 22421 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
W20260709 12:11:13.420271 24970 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.811s	user 0.019s	sys 0.043s
I20260709 12:11:12.627406 26009 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:16.433607 26009 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:12.642938 25628 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:12.685750 26042 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:16.442464 26042 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:16.442966 26042 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:16.445149 26042 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:16.025939 25675 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:11:13.686666 26025 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.989s	user 0.048s	sys 0.060s
I20260709 12:11:12.619627 26105 raft_consensus.cc:740] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:16.456081 26105 consensus_queue.cc:260] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:16.457149 26105 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:16.456593 26445 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:12.656865 26126 raft_consensus.cc:2749] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:16.461584 26126 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:12.662489 26132 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:16.463778 26132 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:16.464407 26132 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:16.004547 26177 consensus_queue.cc:1059] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:16.026922 26213 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:13.116847 26289 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:16.470778 26213 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:16.473809 26213 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:16.477094 22453 raft_consensus.cc:3055] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:16.477600 22453 raft_consensus.cc:740] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
W20260709 12:11:12.704941 26325 consensus_meta.cc:287] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 1.131s	user 0.007s	sys 0.005s
I20260709 12:11:15.443347 26326 raft_consensus.cc:3055] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:16.481904 26326 raft_consensus.cc:740] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:16.481993 22603 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
W20260709 12:11:15.230334 26353 log.cc:927] Time spent T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 3.618s	user 0.003s	sys 0.021s
W20260709 12:11:16.015218 26354 log.cc:927] Time spent T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 4.479s	user 0.027s	sys 0.044s
W20260709 12:11:13.297967 26355 consensus_meta.cc:287] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.681s	user 0.009s	sys 0.001s
I20260709 12:11:16.493016 22602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2208) took 5441 ms. Trace:
W20260709 12:11:12.674086 26129 consensus_meta.cc:287] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 1.116s	user 0.007s	sys 0.004s
I20260709 12:11:16.496186 26129 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:16.109732 26140 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:16.117903 26245 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.501439 26140 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:16.502238 26245 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:16.504362 26245 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:12.659175 26291 raft_consensus.cc:2749] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:13.294016 26300 consensus_meta.cc:287] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.708s	user 0.007s	sys 0.002s
I20260709 12:11:16.513762 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:16.513861 26300 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:12.685401 26357 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:16.478561 22453 consensus_queue.cc:260] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:16.516875 23123 raft_consensus.cc:1240] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:16.143791 26316 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.618705 26360 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:12.645814 26380 consensus_queue.cc:237] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:16.218973 26388 log.cc:927] Time spent T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 3.864s	user 0.025s	sys 0.058s
W20260709 12:11:16.084851 26392 log.cc:927] Time spent T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 3.453s	user 0.029s	sys 0.035s
I20260709 12:11:16.130453 26377 raft_consensus.cc:3055] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:16.537635 26377 raft_consensus.cc:740] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:12.679745 26378 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:16.541692 26378 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:12.686044 26382 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:12.665746 26387 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:16.249861 26422 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.545580 26422 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:16.547951 26422 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:16.254700 26420 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:16.548776 26420 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:16.262625 22495 connection.cc:256] RPC call timeout handler was delayed by -2.9435640710000825s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1886s for a response
W20260709 12:11:16.551280 22495 connection.cc:256] RPC call timeout handler was delayed by -2.7814045459999761s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1897s for a response
W20260709 12:11:16.551633 23088 connection.cc:256] RPC call timeout handler was delayed by -1.9665113160001511s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18460000000000001s for a response
W20260709 12:11:16.289449 22570 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 1.655s (SENT) [suppressed 11 similar messages]
I20260709 12:11:16.552199 26042 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.289960 26409 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.552695 26042 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:16.553207 26409 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:16.555611 26382 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:16.555680 26409 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:16.292773 26423 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:16.556396 26420 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:16.556907 26420 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.556586 26423 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:16.557335 26420 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:16.554782 26042 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:16.305864 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:16.538618 26377 consensus_queue.cc:260] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:16.307126 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:16.308228 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:16.313027 26424 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.318778 26427 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:16.320868 26425 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:16.558957 26423 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:16.559894 22597 raft_consensus.cc:2393] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 10: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:16.561305 26425 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:16.562554 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:16.563153 22597 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 10.
I20260709 12:11:16.564217 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:16.319998 26426 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.335660 26430 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.564857 26426 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:16.565013 26430 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:16.560483 22606 raft_consensus.cc:2410] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:11:16.348580 26428 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:16.567057 26426 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:16.567252 26428 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:16.365163 22529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 750) took 4031 ms. Trace:
I20260709 12:11:16.560398 26377 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:16.568480 22529 rpcz_store.cc:276] 0709 12:11:12.333727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.346099 (+ 12372us) service_pool.cc:224] Handling call
0709 12:11:12.346501 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:16.291939 (+3945438us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.364884 (+ 72945us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b54001f2054. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:16.365096 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":688633728}
I20260709 12:11:16.366232 23117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 1167) took 5171 ms. Trace:
I20260709 12:11:16.569510 26428 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:16.350306 26431 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:16.569753 23117 rpcz_store.cc:276] 0709 12:11:11.194920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.195136 (+   216us) service_pool.cc:224] Handling call
0709 12:11:11.211731 (+ 16595us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:11.360120 (+148389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:11.360225 (+   105us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:11.360286 (+    61us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:11.360331 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.366024 (+5005693us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b540069ffd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:16.366067 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:16.366178 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":340608384}
I20260709 12:11:16.367815 22598 raft_consensus.cc:1240] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 8. Current term is 9. Ops: [8.7-8.7]
W20260709 12:11:16.367688 22599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45576 (request call id 2585) took 5385 ms (client timeout 3462 ms). Trace:
I20260709 12:11:16.395730 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:16.571345 22599 rpcz_store.cc:269] 0709 12:11:10.982225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.982359 (+   134us) service_pool.cc:224] Handling call
0709 12:11:16.367426 (+5385067us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b54002de954. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:16.367575 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":700393856}
I20260709 12:11:16.560983 26424 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:16.573004 22598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2204) took 5592 ms. Trace:
I20260709 12:11:16.570312 26431 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:16.573369 22598 rpcz_store.cc:276] 0709 12:11:10.980481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.991710 (+ 11229us) service_pool.cc:224] Handling call
0709 12:11:16.367559 (+5375849us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:16.571185 (+203626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.572830 (+  1645us) spinlock_profiling.cc:243] Waited 5.34 s on lock 0x7b54002de950. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:16.572948 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12281417472}
I20260709 12:11:16.574630 26424 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:16.400048 23087 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:16.575229 26431 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:16.575634 26382 raft_consensus.cc:2749] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:16.575852 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 176430us
I20260709 12:11:16.576460 26430 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:16.560798 26420 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:16.577979 26382 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:11:16.578133 23087 leader_election.cc:336] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.720s (SENT)
I20260709 12:11:16.401750 22450 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11.
I20260709 12:11:16.578552 26382 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:16.579857 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:16.109675 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:16.581094 23089 connection.cc:256] RPC call timeout handler was delayed by -2.29361049299996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16240000000000002s for a response
W20260709 12:11:16.581434 23089 connection.cc:256] RPC call timeout handler was delayed by -2.0161444440000196s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1585s for a response
I20260709 12:11:16.581517 26382 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:16.581738 23089 connection.cc:256] RPC call timeout handler was delayed by -1.8314335040001879s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18460000000000001s for a response
I20260709 12:11:16.582091 26382 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:16.118706 23120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 802) took 4576 ms. Trace:
I20260709 12:11:16.216737 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:16.405781 22451 rpcz_store.cc:276] 0709 12:11:12.465788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.629080 (+163292us) service_pool.cc:224] Handling call
0709 12:11:16.222540 (+3593460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:16.405132 (+182592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.405316 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:16.406730 26418 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:16.402015 26411 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:16.583877 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:16.584064 26411 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:16.584479 22451 raft_consensus.cc:2468] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
I20260709 12:11:16.584682 26449 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:16.585041 26377 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.585330 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:16.585242 26449 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:16.585518 26377 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:16.586033 22451 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
I20260709 12:11:16.586196 26418 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:16.403275 22524 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.807s	user 0.023s	sys 0.072s
I20260709 12:11:16.586051 26411 leader_election.cc:290] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:16.404124 26414 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:16.588248 26418 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:16.369814 23122 rpcz_store.cc:276] 0709 12:11:11.584438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.596150 (+ 11712us) service_pool.cc:224] Handling call
0709 12:11:11.612097 (+ 15947us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:12.284278 (+672181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:12.284335 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:12.288095 (+  3760us) log.cc:844] Serialized 26 byte log entry
0709 12:11:12.510155 (+222060us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:12.510669 (+   514us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.510745 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:12.674174 (+163429us) raft_consensus.cc:1685] finished
0709 12:11:12.674196 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:12.674337 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":56504,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":51063,"thread_start_us":849067,"threads_started":2,"wal-append.queue_time_us":296570,"wal-append.run_cpu_time_us":1994,"wal-append.run_wall_time_us":1074611}
I20260709 12:11:16.382766 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:16.582599 26382 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:16.383524 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:16.589663 22452 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 8.
I20260709 12:11:16.590322 22454 raft_consensus.cc:2393] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 8: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:16.590610 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:16.591095 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:16.591805 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:16.592113 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:16.592374 22452 raft_consensus.cc:2376] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 8. Re-sending same reply.
I20260709 12:11:16.592774 22454 raft_consensus.cc:2393] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 8: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:16.593143 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:16.593501 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:16.593655 22452 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:16.594506 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:16.407092 22455 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 8.
I20260709 12:11:16.595063 26382 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:16.595654 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:16.561034 26427 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:16.596220 22455 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:16.403165 22604 rpcz_store.cc:276] 0709 12:11:11.468070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.472009 (+  3939us) service_pool.cc:224] Handling call
0709 12:11:11.490736 (+ 18727us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:11.527400 (+ 36664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.169722 (+4642322us) spinlock_profiling.cc:243] Waited 35.8 ms on lock 0x7b54003ae3d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:16.169916 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82303232}
I20260709 12:11:16.403589 22531 rpcz_store.cc:276] 0709 12:11:12.413808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.413982 (+   174us) service_pool.cc:224] Handling call
0709 12:11:12.439276 (+ 25294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:12.439663 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:12.439699 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:12.453219 (+ 13520us) log.cc:844] Serialized 26 byte log entry
0709 12:11:12.614521 (+161302us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:12.614579 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.614671 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:16.209108 (+3594437us) raft_consensus.cc:1685] finished
0709 12:11:16.209129 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:16.209325 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2969,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":40008,"thread_start_us":113138,"threads_started":1,"wal-append.queue_time_us":204994,"wal-append.run_cpu_time_us":1923,"wal-append.run_wall_time_us":1007155}
I20260709 12:11:16.406971 26415 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.408394 26417 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:16.402271 22525 rpcz_store.cc:276] 0709 12:11:11.065914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.066027 (+   113us) service_pool.cc:224] Handling call
0709 12:11:11.096229 (+ 30202us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:11.106772 (+ 10543us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:11.106807 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:11.107259 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 12:11:11.253330 (+146071us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:11.253370 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.253467 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:12.600732 (+1347265us) spinlock_profiling.cc:243] Waited 6.19 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:11:16.161057 (+3560325us) raft_consensus.cc:1685] finished
0709 12:11:16.161094 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:16.161391 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":115,"raft.queue_time_us":2647,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":22691,"spinlock_wait_cycles":14231936,"thread_start_us":145686,"threads_started":1,"wal-append.queue_time_us":399740,"wal-append.run_cpu_time_us":15498,"wal-append.run_wall_time_us":2156971}
I20260709 12:11:16.414834 26432 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.416847 22605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:11:16.606890 22605 raft_consensus.cc:606] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 LEADER]: Received request to transfer leadership to TS 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:16.419155 26410 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:16.423594 26437 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:16.429360 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 423944us
I20260709 12:11:16.626248 22421 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:11:16.431377 24970 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 3.823s	user 0.022s	sys 0.043s
I20260709 12:11:16.436301 26444 raft_consensus.cc:2749] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:16.438699 26032 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.439719 26038 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:16.440946 22448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1838) took 5418 ms. Trace:
I20260709 12:11:16.441063 25628 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.441426 26436 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.446728 25675 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:16.448163 26025 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.750s	user 0.050s	sys 0.060s
I20260709 12:11:16.652427 23125 raft_consensus.cc:1275] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:16.448103 26433 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:16.450919 26439 consensus_queue.cc:1059] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:16.664952 26439 raft_consensus.cc:3055] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:16.665400 26439 raft_consensus.cc:740] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:16.665623 25675 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:16.666499 26439 consensus_queue.cc:260] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:16.652988 25628 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:16.668243 26439 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:16.669634 25628 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:16.670589 22353 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55962 (request call id 343) took 23337 ms (client timeout 15000 ms). Trace:
W20260709 12:11:16.451591 22496 connection.cc:256] RPC call timeout handler was delayed by -3.0199825880001754s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.189s for a response
W20260709 12:11:16.454342 22497 connection.cc:256] RPC call timeout handler was delayed by -2.1317120109999905s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17450000000000002s for a response
W20260709 12:11:16.671351 22497 connection.cc:256] RPC call timeout handler was delayed by -1.959614270999964s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.34620000000000006s for a response
W20260709 12:11:16.671693 22497 connection.cc:256] RPC call timeout handler was delayed by -1.6988120109999727s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22260000000000002s for a response
W20260709 12:11:16.672103 22497 connection.cc:256] RPC call timeout handler was delayed by -1.6905353950000972s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3284s for a response
W20260709 12:11:16.672536 22497 connection.cc:256] RPC call timeout handler was delayed by -1.4369891540000026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21930000000000002s for a response
I20260709 12:11:16.673707 22496 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:11:16.671003 22353 rpcz_store.cc:269] 0709 12:10:53.420775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.433723 (+ 12948us) service_pool.cc:224] Handling call
0709 12:11:16.670511 (+23236788us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:10.835109 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:10.835802 (+   693us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:10.835867 (+    65us) write_op.cc:435] Acquired schema lock
0709 12:11:10.835903 (+    36us) tablet.cc:662] Decoding operations
0709 12:11:10.837094 (+  1191us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:10.837178 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:10.837204 (+    26us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:11:10.838375 (+  1171us) tablet.cc:701] Row locks acquired
0709 12:11:10.838420 (+    45us) write_op.cc:260] PREPARE: finished
0709 12:11:10.838596 (+   176us) write_op.cc:270] Start()
0709 12:11:10.838753 (+   157us) write_op.cc:276] Timestamp: P: 1783599070838530 usec, L: 0
0709 12:11:10.838771 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:11:10.927424 (+ 88653us) log.cc:844] Serialized 4934 byte log entry
0709 12:11:11.435644 (+508220us) op_driver.cc:464] REPLICATION: finished
0709 12:11:11.647963 (+212319us) write_op.cc:301] APPLY: starting
0709 12:11:11.718344 (+ 70381us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:12.271140 (+552796us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:12.294059 (+ 22919us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:12.460509 (+166450us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:12.460849 (+   340us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 12:11:12.460907 (+    58us) write_op.cc:312] APPLY: finished
0709 12:11:12.461273 (+   366us) log.cc:844] Serialized 89 byte log entry
0709 12:11:12.600103 (+138830us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:12.616507 (+ 16404us) write_op.cc:454] Released schema lock
0709 12:11:12.624684 (+  8177us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:12.662865 (+ 38181us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:12.662901 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4514624,"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":178871,"apply.run_cpu_time_us":16937,"apply.run_wall_time_us":1037389,"num_ops":12,"prepare.queue_time_us":341424,"prepare.run_cpu_time_us":30451,"prepare.run_wall_time_us":166965,"raft.queue_time_us":347531,"raft.run_cpu_time_us":12278,"raft.run_wall_time_us":120401,"replication_time_us":596723,"thread_start_us":627514,"threads_started":5,"wal-append.queue_time_us":301708,"wal-append.run_cpu_time_us":19573,"wal-append.run_wall_time_us":2227880}]]}
I20260709 12:11:16.454761 26443 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.675333 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:16.675217 26443 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:16.676060 22527 raft_consensus.cc:2393] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 9: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:16.458215 26445 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:15.936254 26309 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:16.480973 26325 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:16.482719 26326 consensus_queue.cc:260] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:16.492899 26355 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:16.828581 26326 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:16.829574 26325 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:16.829665 26355 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:12.669607 26074 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:16.831818 22450 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
I20260709 12:11:16.832858 26074 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:12.662489 26277 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:16.493626 22602 rpcz_store.cc:276] 0709 12:11:11.051509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.051992 (+   483us) service_pool.cc:224] Handling call
0709 12:11:11.083931 (+ 31939us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:11.182488 (+ 98557us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:11.182516 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:11.192855 (+ 10339us) log.cc:844] Serialized 26 byte log entry
0709 12:11:11.439264 (+246409us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:11.439321 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.439468 (+   147us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:14.957562 (+3518094us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:11:16.492612 (+1535050us) raft_consensus.cc:1685] finished
0709 12:11:16.492643 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:16.492936 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82181,"raft.queue_time_us":89608,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":25216,"spinlock_wait_cycles":2819328,"thread_start_us":202614,"threads_started":1,"wal-append.queue_time_us":359659}
I20260709 12:11:16.839377 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:16.840456 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:16.841528 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:16.842458 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:16.462255 26126 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:16.844704 26126 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:16.507675 22456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 715) took 4051 ms. Trace:
I20260709 12:11:16.845921 22456 rpcz_store.cc:276] 0709 12:11:12.456193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.601734 (+145541us) service_pool.cc:224] Handling call
0709 12:11:12.616337 (+ 14603us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:12.623183 (+  6846us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:16.332613 (+3709430us) log.cc:844] Serialized 14 byte log entry
0709 12:11:16.507157 (+174544us) log.cc:844] Serialized 14 byte log entry
0709 12:11:16.507342 (+   185us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:16.507389 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:16.507440 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.507505 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:16.507618 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":126785,"prepare.queue_time_us":3827538,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":55,"raft.queue_time_us":11626,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":202,"thread_start_us":58518,"threads_started":3,"wal-append.queue_time_us":37070}
I20260709 12:11:16.847942 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:16.848482 22456 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
I20260709 12:11:16.849256 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:16.511343 26129 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:16.512760 26140 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:16.514742 22603 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
I20260709 12:11:16.852097 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:16.852911 22603 raft_consensus.cc:2410] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:11:16.853621 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:16.767087 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 83840.2us
I20260709 12:11:16.515554 26132 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:16.519062 26300 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:16.523978 26316 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:16.856859 26316 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:16.526181 22453 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:16.535523 23123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 1178) took 3949 ms. Trace:
W20260709 12:11:16.551759 22495 connection.cc:256] RPC call timeout handler was delayed by -2.3845680169999923s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17450000000000002s for a response
W20260709 12:11:16.858394 22495 connection.cc:256] RPC call timeout handler was delayed by -1.8490221889999248s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22260000000000002s for a response
W20260709 12:11:16.858709 22495 connection.cc:256] RPC call timeout handler was delayed by -1.6853640710000946s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3284s for a response
I20260709 12:11:16.860271 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:16.860777 22528 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:16.271224 22457 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1845) took 4829 ms. Trace:
I20260709 12:11:16.863118 22457 rpcz_store.cc:276] 0709 12:11:11.441759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.476554 (+ 34795us) service_pool.cc:224] Handling call
0709 12:11:11.476975 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:11.488521 (+ 11546us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:11.488557 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:11.497823 (+  9266us) log.cc:844] Serialized 26 byte log entry
0709 12:11:16.230505 (+4732682us) spinlock_profiling.cc:243] Waited 6.23 ms on lock 0x7b18003f7d80. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc7823e07 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc7840c02 00007f9cca4c820b 00007f9cca4cdd23 00007f9cca4ce0d1 00007f9cca8e9a0f
0709 12:11:16.268026 (+ 37521us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:16.268065 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.268140 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:16.270903 (+  2763us) raft_consensus.cc:1685] finished
0709 12:11:16.270924 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:16.271159 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22269,"raft.queue_time_us":13743,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":11108,"spinlock_wait_cycles":14338304,"thread_start_us":37318,"threads_started":1,"wal-append.queue_time_us":4770883}
I20260709 12:11:16.864862 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:16.865458 22526 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 8.
I20260709 12:11:16.866207 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:16.866466 22602 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
I20260709 12:11:16.567741 22606 raft_consensus.cc:1275] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:16.572702 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:16.583153 23120 rpcz_store.cc:276] 0709 12:11:11.542220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.544115 (+  1895us) service_pool.cc:224] Handling call
0709 12:11:11.575076 (+ 30961us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:12.591650 (+1016574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.118421 (+3526771us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540017e654. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:16.118622 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2331781504}
I20260709 12:11:16.228061 26419 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.586910 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:16.407457 26412 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:16.598412 22422 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:16.854838 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:16.871872 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 273537us
I20260709 12:11:16.598661 22601 raft_consensus.cc:2368] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 7. Current term is 8.
I20260709 12:11:16.872190 22603 raft_consensus.cc:2393] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 10: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:16.600878 22524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 751) took 4266 ms. Trace:
I20260709 12:11:16.872735 22524 rpcz_store.cc:276] 0709 12:11:12.334037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.335725 (+  1688us) service_pool.cc:224] Handling call
0709 12:11:12.349380 (+ 13655us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:12.349812 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:12.509869 (+160057us) log.cc:844] Serialized 14 byte log entry
0709 12:11:16.587268 (+4077399us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:16.587746 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 12:11:16.587896 (+   150us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:16.587929 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.587991 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:16.600610 (+ 12619us) raft_consensus.cc:1685] finished
0709 12:11:16.600637 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:16.600806 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":269134,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":827,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":211,"thread_start_us":4148680,"threads_started":2,"wal-append.queue_time_us":2189563}
I20260709 12:11:16.578578 23087 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:16.604382 22454 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:11:16.623234 22452 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
I20260709 12:11:16.627475 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:16.629643 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:16.629710 22455 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
I20260709 12:11:16.636677 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:16.876516 23122 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:11:16.647825 22421 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:16.648524 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:16.649747 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:11:16.651484 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 362049us
I20260709 12:11:16.878854 23121 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
I20260709 12:11:16.589701 26414 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:16.623811 26415 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:16.884537 26415 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:16.656849 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:16.885705 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:16.886366 23118 raft_consensus.cc:2393] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 10: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:16.887200 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:16.887816 23118 raft_consensus.cc:2393] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 11: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:16.888547 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:16.889590 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:16.890112 23118 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
I20260709 12:11:16.637784 26437 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:16.892361 26437 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:16.657819 22355 catalog_manager.cc:5697] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:16.892551 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:16.893275 23119 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
I20260709 12:11:16.894145 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:16.893630 22355 catalog_manager.cc:5697] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 4 to 7, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 7 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:16.635740 26446 consensus_queue.cc:1048] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:11:16.647066 26431 raft_consensus.cc:2804] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:16.895910 26431 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:16.896291 26431 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:16.898326 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 267372us
I20260709 12:11:16.638151 22448 rpcz_store.cc:276] 0709 12:11:11.022212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.071431 (+ 49219us) service_pool.cc:224] Handling call
0709 12:11:11.477544 (+406113us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:11.511968 (+ 34424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:11.512003 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:11.512447 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 12:11:11.610131 (+ 97684us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:11.610167 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.610221 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:12.496808 (+886587us) raft_consensus.cc:1685] finished
0709 12:11:12.496827 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:16.440681 (+3943854us) spinlock_profiling.cc:243] Waited 368 ms on lock 0x7b54002206d0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:16.440885 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32199,"raft.queue_time_us":20033,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":8389,"spinlock_wait_cycles":847177600,"thread_start_us":36457,"threads_started":1,"wal-append.queue_time_us":145085,"wal-append.run_cpu_time_us":12616,"wal-append.run_wall_time_us":1910470}
I20260709 12:11:16.899149 26326 raft_consensus.cc:2749] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:16.899557 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:16.659401 26449 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:16.628715 26432 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:16.655143 26436 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:16.650962 26032 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:16.679824 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:16.680703 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:16.653673 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:16.929350 22599 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
I20260709 12:11:16.929733 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:16.929924 22532 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11.
I20260709 12:11:16.930465 22457 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 10: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:16.635879 26418 consensus_queue.cc:1048] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:11:16.791442 26377 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:16.930051 22422 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:16.681344 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:16.738269 26427 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:16.760303 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.737660 23125 raft_consensus.cc:3055] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:16.947151 23125 raft_consensus.cc:740] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:16.796702 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:16.792452 26445 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:16.681234 26417 consensus_queue.cc:1048] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.128s
I20260709 12:11:16.808553 26443 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:16.678464 26425 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:16.816741 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:16.732271 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 144556us
I20260709 12:11:16.686661 26426 consensus_queue.cc:1048] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.131s
I20260709 12:11:16.826749 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:16.834532 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:16.762007 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:16.954197 23116 raft_consensus.cc:2410] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:11:16.857713 23123 rpcz_store.cc:276] 0709 12:11:12.585709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.586204 (+   495us) service_pool.cc:224] Handling call
0709 12:11:12.599253 (+ 13049us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:16.517322 (+3918069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.535172 (+ 17850us) spinlock_profiling.cc:243] Waited 3.92 s on lock 0x7b54001acf54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:16.535417 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9009222016}
I20260709 12:11:16.866729 22526 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 8.
I20260709 12:11:16.600162 22569 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:16.882434 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:11:16.900768 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 322645us
I20260709 12:11:16.955381 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:16.956048 22526 raft_consensus.cc:2393] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 10: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:16.901357 22600 raft_consensus.cc:1813] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Handling vote request from an unknown peer c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:16.956641 22600 raft_consensus.cc:2368] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 7. Current term is 8.
I20260709 12:11:16.901927 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:16.882884 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:16.957774 23120 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
I20260709 12:11:16.958184 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:16.958715 22532 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:16.894747 23119 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
I20260709 12:11:16.959656 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:16.960392 23119 raft_consensus.cc:2410] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:11:16.910957 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:16.953095 23117 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 10.
I20260709 12:11:16.911585 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:16.907871 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:16.961361 22455 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
I20260709 12:11:16.960888 22355 catalog_manager.cc:5697] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 4 to 7, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 7 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:16.912182 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:16.962388 22452 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11.
I20260709 12:11:16.927207 22456 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 10.
I20260709 12:11:16.928190 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:16.928232 22570 connection.cc:256] RPC call timeout handler was delayed by -2.4454468410001482s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1587s for a response
W20260709 12:11:16.963436 22570 connection.cc:256] RPC call timeout handler was delayed by -2.2906468410001253s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1759s for a response
W20260709 12:11:16.963721 22570 connection.cc:256] RPC call timeout handler was delayed by -2.0998468410002715s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19710000000000003s for a response
I20260709 12:11:16.963754 22530 raft_consensus.cc:2393] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 10: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
W20260709 12:11:16.963915 22570 connection.cc:256] RPC call timeout handler was delayed by -1.4599468410001464s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2682s for a response
W20260709 12:11:16.956112 23087 connection.cc:256] RPC call timeout handler was delayed by -3.7098419489998378s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22360000000000002s for a response
W20260709 12:11:16.966264 23087 connection.cc:256] RPC call timeout handler was delayed by -3.6962549849999959s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15680000000000002s for a response
I20260709 12:11:16.933079 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:16.929481 23124 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
I20260709 12:11:16.935496 24970 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:16.936182 22525 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:16.968152 24970 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:16.935294 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:16.969457 22524 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 8.
I20260709 12:11:16.936928 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:16.938128 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:16.938304 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:16.971906 22601 raft_consensus.cc:2410] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:11:16.938484 26432 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:16.903049 26316 raft_consensus.cc:2804] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:16.934917 26415 consensus_queue.cc:1059] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:11:16.938669 26437 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:16.938649 22449 raft_consensus.cc:2393] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 8: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:16.940411 26436 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:16.911123 26300 raft_consensus.cc:2749] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:16.956113 26444 raft_consensus.cc:2804] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:16.944676 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:16.986178 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:16.949225 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.986816 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:16.987635 23116 raft_consensus.cc:2410] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:11:16.988422 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:16.988472 26437 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:16.989025 23116 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
I20260709 12:11:16.989827 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:16.990569 26437 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:16.991016 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:16.991758 22457 raft_consensus.cc:2410] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 11 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:11:16.991961 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:16.992455 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:16.992547 22449 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
W20260709 12:11:16.950872 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.949631 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:16.956707 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:16.994004 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.994062 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:16.994881 22598 raft_consensus.cc:2393] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 11: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:16.995414 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:16.995568 22598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:11:16.995839 23088 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:16.996042 22422 leader_election.cc:400] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 7. Current term is 8.
I20260709 12:11:16.996143 22598 raft_consensus.cc:606] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Received request to transfer leadership to TS 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:16.996430 22422 leader_election.cc:403] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:16.996490 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:16.996919 23088 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:16.997169 22530 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 12.
I20260709 12:11:16.910568 26420 raft_consensus.cc:2804] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:16.997990 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:16.998770 22530 raft_consensus.cc:2410] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:11:16.998957 26420 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:16.999084 26427 raft_consensus.cc:2804] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:16.999439 26420 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:16.999619 26427 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:17.000154 26427 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:17.001564 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:17.002111 22457 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:16.961615 22603 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 10.
I20260709 12:11:16.918932 22528 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 10.
I20260709 12:11:17.002785 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:16.932051 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:17.003999 22530 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 9.
I20260709 12:11:17.004453 23121 raft_consensus.cc:2410] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 12:11:16.966703 23087 connection.cc:256] RPC call timeout handler was delayed by -3.6458549849999144s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16240000000000002s for a response
W20260709 12:11:17.005563 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.005493 22495 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:16.973130 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:17.005756 22421 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:16.958623 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:17.006834 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:16.951517 22497 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:16.974814 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:16.953543 22450 raft_consensus.cc:2376] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 8. Re-sending same reply.
I20260709 12:11:17.007864 22450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 736) took 1008 ms. Trace:
I20260709 12:11:16.973677 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:11:16.975440 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 375329us
I20260709 12:11:16.981644 22532 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 10.
I20260709 12:11:17.008880 22569 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:16.981743 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:17.009310 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:17.009855 22452 raft_consensus.cc:2410] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:11:16.981899 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:17.010159 22526 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 10: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:17.010416 23117 raft_consensus.cc:3060] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:11:17.010584 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:16.974720 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:16.948844 23125 consensus_queue.cc:260] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:16.993460 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:17.010926 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:16.984488 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:17.011466 22449 raft_consensus.cc:2468] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
I20260709 12:11:16.985617 26444 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:17.012190 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:17.006536 22495 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:16.985679 22355 catalog_manager.cc:5697] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:17.011427 23125 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:17.013124 23123 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
I20260709 12:11:17.018803 23120 raft_consensus.cc:2410] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:11:17.017571 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:17.045564 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:17.046298 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:17.036521 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:17.047194 23120 raft_consensus.cc:2410] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:11:17.047237 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:17.047796 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:17.048038 22456 raft_consensus.cc:2468] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
I20260709 12:11:17.034291 22525 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
I20260709 12:11:17.048830 22526 raft_consensus.cc:1240] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:17.016144 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:17.046361 22532 raft_consensus.cc:2393] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 10: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:17.049126 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:17.049510 22528 raft_consensus.cc:2393] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 9: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:17.050112 22456 raft_consensus.cc:2410] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:17.008469 23119 raft_consensus.cc:2376] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9. Re-sending same reply.
I20260709 12:11:17.050880 22532 raft_consensus.cc:1240] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 7. Current term is 9. Ops: []
I20260709 12:11:17.051712 22525 raft_consensus.cc:1275] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:17.050498 22528 raft_consensus.cc:1240] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:17.051942 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:17.053298 22528 raft_consensus.cc:1240] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:11:17.053834 22452 raft_consensus.cc:1275] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:17.036481 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:17.054813 22455 raft_consensus.cc:2468] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 6.
I20260709 12:11:17.055387 22452 raft_consensus.cc:1275] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:17.036482 26377 raft_consensus.cc:2804] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:17.048743 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:17.017647 26140 consensus_queue.cc:1175] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" responder_term: 10 status { last_received { term: 10 index: 11 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:11:17.003152 26378 consensus_queue.cc:1059] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:11:17.056885 26377 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:11:17.057454 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.057747 26377 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:16.979624 26316 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:17.008170 22450 rpcz_store.cc:276] 0709 12:11:15.999917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.834291 (+834374us) service_pool.cc:224] Handling call
0709 12:11:17.007810 (+173519us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:17.058230 26444 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:17.017619 23087 connection.cc:256] RPC call timeout handler was delayed by -3.5340510859998631s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1547s for a response
W20260709 12:11:17.060453 23087 connection.cc:256] RPC call timeout handler was delayed by -3.3956549849999647s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1902s for a response
W20260709 12:11:17.060822 23087 connection.cc:256] RPC call timeout handler was delayed by -3.1859549850000803s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2135s for a response
W20260709 12:11:17.061101 23087 connection.cc:256] RPC call timeout handler was delayed by -2.8070549849999225s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2556s for a response
W20260709 12:11:17.061412 23087 connection.cc:256] RPC call timeout handler was delayed by -2.7868106819998957s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3134s for a response
W20260709 12:11:17.061697 23087 connection.cc:256] RPC call timeout handler was delayed by -2.4267781050000394s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2602s for a response
W20260709 12:11:17.061975 23087 connection.cc:256] RPC call timeout handler was delayed by -2.4267781050000394s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2602s for a response
I20260709 12:11:17.062621 22526 raft_consensus.cc:1240] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:17.055663 22355 catalog_manager.cc:5697] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 7 to 8, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 8 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:17.064862 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:17.083209 23121 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 10.
W20260709 12:11:17.067469 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 58651.4us
I20260709 12:11:17.084225 22569 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:17.068547 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:17.046516 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:17.069861 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 133965us
I20260709 12:11:17.085594 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:16.928062 26277 consensus_queue.cc:1048] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 12:11:17.016211 26289 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:17.094059 26289 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:17.094460 26289 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:17.097528 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:17.098721 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:17.099231 22598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1143406a95dd472688b2fe621abd815f"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:11:17.099800 22598 raft_consensus.cc:606] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Received request to transfer leadership to TS c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:17.099833 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:17.100135 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:17.100685 23118 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 10: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:16.932579 26074 consensus_queue.cc:1059] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 12:11:17.065361 26387 raft_consensus.cc:2804] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:17.102656 22497 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:17.103221 26387 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:17.103662 26387 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:17.105948 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:17.108531 23118 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:11:17.065340 26326 consensus_queue.cc:1048] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:11:17.092929 25675 raft_consensus.cc:2804] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:17.134470 22602 raft_consensus.cc:1275] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:17.068220 26415 raft_consensus.cc:3055] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:17.071954 26132 raft_consensus.cc:2764] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:11:17.101289 23117 raft_consensus.cc:2468] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 8.
I20260709 12:11:17.100239 22598 raft_consensus.cc:614] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:17.101629 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:17.150400 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:17.150605 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:17.150952 23121 raft_consensus.cc:2468] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:11:17.102721 26177 raft_consensus.cc:3055] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:17.106799 26417 raft_consensus.cc:2804] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:17.166706 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:17.167503 23121 raft_consensus.cc:1813] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Handling vote request from an unknown peer c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:17.168089 23121 raft_consensus.cc:2368] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 7. Current term is 8.
I20260709 12:11:17.107267 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:17.090195 22569 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:11:17.170818 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 80681.3us
I20260709 12:11:17.109861 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:17.112236 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:17.173005 22603 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
I20260709 12:11:17.174196 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:17.113904 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:17.015419 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.115921 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:17.175515 22606 raft_consensus.cc:2393] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 7: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:17.176054 23123 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 9.
I20260709 12:11:17.054734 22528 raft_consensus.cc:1240] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 LEADER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:11:17.089571 24970 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:17.119582 22496 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:17.064956 26448 raft_consensus.cc:2749] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:17.064819 26446 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:11:17.092398 23122 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
I20260709 12:11:17.123678 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:17.187475 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:17.169898 22531 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 8.
I20260709 12:11:17.188091 22456 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 7.
I20260709 12:11:17.124531 22452 raft_consensus.cc:1275] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:17.188889 23119 raft_consensus.cc:1240] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 7. Current term is 9. Ops: []
I20260709 12:11:17.127967 22453 raft_consensus.cc:1275] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 12:11:17.189643 22453 pending_rounds.cc:85] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f: Aborting all ops after (but not including) 8
I20260709 12:11:17.190346 22453 pending_rounds.cc:107] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 12:11:17.190624 22453 raft_consensus.cc:2889] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:17.191560 22453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 727) took 4689 ms. Trace:
I20260709 12:11:17.091692 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:17.131944 22421 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:17.134717 22355 catalog_manager.cc:5697] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 1 to 7, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 7 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:11:17.071664 26437 raft_consensus.cc:2804] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:16.911017 26419 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:17.144220 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:17.146234 23087 leader_election.cc:336] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.547s (SENT)
I20260709 12:11:17.194785 23087 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:17.058416 26316 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:17.096657 26420 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:17.148386 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 141914us
I20260709 12:11:17.148756 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:17.148478 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:17.153309 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:17.153879 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:17.153935 22457 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 10.
I20260709 12:11:17.156208 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:17.165077 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:17.110800 26289 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:17.177431 22497 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:17.208375 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:17.177539 24970 raft_consensus.cc:2804] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:17.178474 22603 raft_consensus.cc:2393] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 9: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:17.179179 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:17.179535 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:11:17.227027 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 49719us
I20260709 12:11:17.209313 22599 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
I20260709 12:11:17.180119 26417 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:17.183714 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:17.185954 23121 raft_consensus.cc:1275] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:11:17.235186 23121 pending_rounds.cc:85] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270: Aborting all ops after (but not including) 8
I20260709 12:11:17.235517 23121 pending_rounds.cc:107] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:11:17.235790 23121 raft_consensus.cc:2889] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:17.237419 23117 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:11:17.195281 23123 raft_consensus.cc:1275] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:17.144162 25675 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:17.191956 22453 rpcz_store.cc:276] 0709 12:11:12.502219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.102838 (+3600619us) service_pool.cc:224] Handling call
0709 12:11:16.103223 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:16.476966 (+373743us) spinlock_profiling.cc:243] Waited 371 ms on lock 0x7b540031cf20. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca8a5dc0 00007f9cca9301c0 00007f9cca931231 00007f9cca92dd8f 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c
0709 12:11:17.191181 (+714215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.191492 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":853400448}
I20260709 12:11:17.241003 22457 raft_consensus.cc:2393] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 8: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
W20260709 12:11:17.175549 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.165629 26412 raft_consensus.cc:2804] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:17.208145 22495 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:11:17.208093 26353 log.cc:927] Time spent T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:11:17.182291 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 62734.3us
I20260709 12:11:17.246217 22530 raft_consensus.cc:2368] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 11. Current term is 12.
I20260709 12:11:17.246395 22355 catalog_manager.cc:5697] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 4 to 7, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 7 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:11:17.246685 22496 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:17.248291 22496 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:17.210512 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:17.199262 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:17.230863 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:17.152339 26177 raft_consensus.cc:740] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:17.137408 26414 consensus_queue.cc:1048] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 12:11:17.196668 26437 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:17.242555 22523 raft_consensus.cc:1275] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:17.209496 23116 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 8.
I20260709 12:11:17.138114 26431 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:17.191123 26436 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:17.243640 22495 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:17.239900 26129 raft_consensus.cc:2749] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:17.247325 23146 debug-util.cc:398] Leaking SignalData structure 0x7b08002e8a40 after lost signal to thread 21269
W20260709 12:11:17.211258 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 65034.2us
W20260709 12:11:17.283761 23087 leader_election.cc:336] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.568s (SENT)
I20260709 12:11:17.284191 23087 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:17.209336 24970 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:17.284896 24970 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:17.249614 22605 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
I20260709 12:11:17.242484 25675 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:17.145059 26415 raft_consensus.cc:740] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:17.233804 26439 raft_consensus.cc:2749] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:17.289826 22496 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:17.291428 22496 leader_election.cc:304] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:17.293444 22496 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:17.256239 22452 raft_consensus.cc:3055] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:17.295274 22452 raft_consensus.cc:740] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
W20260709 12:11:17.207803 26328 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:11:17.241314 26417 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:17.253029 26132 raft_consensus.cc:2804] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:17.244594 23120 raft_consensus.cc:1275] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:17.285435 22355 catalog_manager.cc:5697] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 3 to 6, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 6 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:17.302726 22495 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:17.286656 22601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "254fb9df2b39405996039a40091b4875"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:11:17.304672 22601 raft_consensus.cc:606] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Received request to transfer leadership to TS 1676e7af5e4a47cb86ee7db83e3d4881
W20260709 12:11:17.304761 23087 leader_election.cc:336] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.902s (SENT)
I20260709 12:11:17.305020 22601 raft_consensus.cc:614] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:11:17.305581 23087 leader_election.cc:336] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 2.135s (SENT)
I20260709 12:11:17.288245 22451 raft_consensus.cc:2393] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 12: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
W20260709 12:11:17.295395 23146 debug-util.cc:398] Leaking SignalData structure 0x7b08002e87c0 after lost signal to thread 22389
W20260709 12:11:17.307523 23146 debug-util.cc:398] Leaking SignalData structure 0x7b08002e8dc0 after lost signal to thread 22481
I20260709 12:11:17.196677 26032 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:17.187829 26432 consensus_queue.cc:1048] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 12:11:17.256024 26441 raft_consensus.cc:2804] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:17.315573 26441 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:17.316123 26441 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:17.316396 26432 raft_consensus.cc:2749] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:17.258320 26437 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:17.255123 26412 raft_consensus.cc:697] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:17.260708 26423 raft_consensus.cc:2749] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:17.318102 26432 raft_consensus.cc:2804] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:11:17.308612 23146 debug-util.cc:398] Leaking SignalData structure 0x7b080038d400 after lost signal to thread 22556
I20260709 12:11:17.318467 26432 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:11:17.318708 23146 debug-util.cc:398] Leaking SignalData structure 0x7b08003d5200 after lost signal to thread 22557
I20260709 12:11:17.319034 26432 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:17.285964 26411 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:17.318375 26412 consensus_queue.cc:237] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:17.320466 23146 debug-util.cc:398] Leaking SignalData structure 0x7b08003e7880 after lost signal to thread 22630
W20260709 12:11:17.320838 23146 debug-util.cc:398] Leaking SignalData structure 0x7b0800130f60 after lost signal to thread 22631
W20260709 12:11:17.322213 23146 debug-util.cc:398] Leaking SignalData structure 0x7b0800425760 after lost signal to thread 23149
W20260709 12:11:17.322548 23146 debug-util.cc:398] Leaking SignalData structure 0x7b08002a3c80 after lost signal to thread 23150
I20260709 12:11:17.302608 22452 consensus_queue.cc:260] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:17.313205 22355 catalog_manager.cc:5697] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 3 to 7, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 7 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:17.326627 23087 leader_election.cc:336] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 2.556s (SENT)
I20260709 12:11:17.302162 26325 raft_consensus.cc:2804] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:17.301944 25628 raft_consensus.cc:2804] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:17.327299 22452 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:17.328707 23087 leader_election.cc:336] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 2.602s (SENT)
I20260709 12:11:17.286132 26377 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:17.303666 26300 raft_consensus.cc:2749] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:17.303324 26132 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:17.328893 22355 catalog_manager.cc:5697] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 5 to 6, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 6 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:17.340996 23087 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:17.380438 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 243352us
I20260709 12:11:17.339493 26325 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:11:17.394280 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 65586.2us
I20260709 12:11:17.340114 25628 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:11:17.401510 23087 leader_election.cc:336] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 2.602s (SENT)
I20260709 12:11:17.407060 23087 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:17.404072 22355 catalog_manager.cc:5697] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:17.404660 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 237065us
I20260709 12:11:17.413707 22452 raft_consensus.cc:1275] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:11:17.385443 26132 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:17.414206 22452 pending_rounds.cc:85] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f: Aborting all ops after (but not including) 7
I20260709 12:11:17.416798 22452 pending_rounds.cc:107] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:11:17.417279 22452 raft_consensus.cc:2889] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:17.414381 23125 raft_consensus.cc:1275] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:17.429499 26300 raft_consensus.cc:2749] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:17.435514 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 263914us
I20260709 12:11:17.436373 22569 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:17.439836 22605 raft_consensus.cc:1240] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:11:17.308853 26177 consensus_queue.cc:260] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:17.449851 22600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:11:17.454844 22600 raft_consensus.cc:606] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 10 LEADER]: Received request to transfer leadership to TS c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:17.406332 26325 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:17.401005 26445 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:17.441661 22355 catalog_manager.cc:5697] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 4 to 7, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 7 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:17.415400 25628 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:17.346046 26415 consensus_queue.cc:260] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:17.459731 26177 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:17.462422 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:17.463343 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 331521us
I20260709 12:11:17.466562 22421 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:17.469681 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:17.472714 22421 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:17.471426 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:11:17.495138 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.476027 22355 catalog_manager.cc:5697] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:17.478729 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:17.499881 22421 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:11:17.503373 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.465324 26289 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:17.505669 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 212285us
I20260709 12:11:17.470825 26446 raft_consensus.cc:2749] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 7. Current term is 8.
W20260709 12:11:17.509230 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.512367 22496 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:17.479002 26418 raft_consensus.cc:2749] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:17.520684 22421 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:17.555022 22421 leader_election.cc:400] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Vote denied by peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353) with higher term. Message: Invalid argument: T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 7. Current term is 8.
I20260709 12:11:17.555677 22421 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:17.522225 23087 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:17.523303 22355 catalog_manager.cc:5697] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:17.530501 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 266824us
I20260709 12:11:17.530563 22496 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:17.559662 22495 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:17.504019 26420 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:17.560598 22496 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:17.561262 22495 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:17.524901 26326 raft_consensus.cc:2749] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:17.581319 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:17.586357 22495 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:17.587100 23120 raft_consensus.cc:2393] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 8: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:17.526844 26448 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:17.595166 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:17.596501 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:17.599138 23117 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:17.556896 26289 raft_consensus.cc:2804] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:17.595156 22355 catalog_manager.cc:5697] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 4 to 6, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 6 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:17.587771 22495 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:11:17.601920 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:17.672533 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.666941 22355 catalog_manager.cc:5697] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:17.582902 26423 raft_consensus.cc:2804] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:17.529299 26129 consensus_queue.cc:1048] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 12:11:17.529029 26445 consensus_queue.cc:1048] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 12:11:17.673981 22355 catalog_manager.cc:5697] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 2 to 6, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 6 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:11:17.675272 22450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1858) took 1219 ms. Trace:
I20260709 12:11:17.585233 26032 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:17.562942 26449 raft_consensus.cc:2749] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:17.566428 26411 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:17.562798 26412 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:17.641688 26420 consensus_queue.cc:1048] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.116s
I20260709 12:11:17.556785 26431 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:17.662622 22496 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
W20260709 12:11:17.666337 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 230043us
W20260709 12:11:17.683763 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 286650us
I20260709 12:11:17.713557 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:17.676923 22450 rpcz_store.cc:276] 0709 12:11:16.450855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.059008 (+608153us) service_pool.cc:224] Handling call
0709 12:11:17.059286 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:17.059480 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:17.330628 (+271148us) log.cc:844] Serialized 14 byte log entry
0709 12:11:17.670362 (+339734us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:17.670419 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:17.670472 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.670544 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:17.670661 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":187,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":25,"raft.queue_time_us":1654,"thread_start_us":607754,"threads_started":2}
W20260709 12:11:17.714030 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.595280 26419 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:17.752885 22569 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:11:17.666922 26425 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.009s	sys 0.021s
I20260709 12:11:17.602573 26289 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:17.597047 26418 raft_consensus.cc:2804] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:17.727366 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:11:17.743595 26464 log.cc:927] Time spent T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.280s	user 0.000s	sys 0.001s
I20260709 12:11:17.726480 26411 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:17.735491 26412 raft_consensus.cc:2804] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:11:17.736357 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:17.750069 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 194460us
W20260709 12:11:17.776923 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:17.758671 26425 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.010s	sys 0.022s
I20260709 12:11:17.596673 26448 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:11:17.731339 26467 log.cc:927] Time spent T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.327s	user 0.001s	sys 0.000s
W20260709 12:11:17.756448 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 93939.4us
W20260709 12:11:17.597209 26462 log.cc:927] Time spent T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.303s	user 0.000s	sys 0.001s
I20260709 12:11:17.761596 26289 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:17.760273 26418 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:17.737656 26481 raft_consensus.cc:2749] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:17.718906 26025 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:17.817431 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:17.818148 22528 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 10.
I20260709 12:11:17.775997 26411 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:17.760140 26357 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.003s	sys 0.033s
W20260709 12:11:17.878711 26387 consensus_meta.cc:287] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.775s	user 0.011s	sys 0.000s
W20260709 12:11:17.773314 26476 log.cc:927] Time spent T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:11:17.764556 23117 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
I20260709 12:11:17.812690 26472 consensus_queue.cc:1048] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:11:17.812007 22497 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
W20260709 12:11:17.902124 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 90199.7us
I20260709 12:11:17.903456 22497 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:17.760464 26419 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:17.787694 22421 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:17.788607 26431 consensus_queue.cc:1048] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:11:17.776223 26412 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:17.844321 26410 raft_consensus.cc:2804] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:17.863303 26480 raft_consensus.cc:2804] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:17.807498 26448 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:17.867302 26420 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:17.912137 22532 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.009s	sys 0.003s
W20260709 12:11:17.912469 22532 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.009s	sys 0.003s
W20260709 12:11:17.873108 26465 log.cc:927] Time spent T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.368s	user 0.000s	sys 0.001s
W20260709 12:11:17.874053 26482 log.cc:927] Time spent T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
W20260709 12:11:17.875841 26474 log.cc:927] Time spent T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:11:17.877045 22453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1859) took 1339 ms. Trace:
I20260709 12:11:17.923625 22453 rpcz_store.cc:276] 0709 12:11:16.539276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.240865 (+701589us) service_pool.cc:224] Handling call
0709 12:11:17.241120 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:17.309296 (+ 68176us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:17.309544 (+   248us) log.cc:844] Serialized 14 byte log entry
0709 12:11:17.474078 (+164534us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:17.474146 (+    68us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:17.474214 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.876799 (+402585us) spinlock_profiling.cc:243] Waited 67.9 ms on lock 0x7b5400240c54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:17.876849 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:17.876984 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15612,"prepare.queue_time_us":101,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":1761,"raft.queue_time_us":2158,"raft.run_cpu_time_us":406,"raft.run_wall_time_us":2282,"spinlock_wait_cycles":156273408,"thread_start_us":162042,"threads_started":1,"wal-append.queue_time_us":292762}
I20260709 12:11:17.821054 26418 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:17.880924 22527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 754) took 1021 ms. Trace:
I20260709 12:11:17.881415 22525 raft_consensus.cc:1217] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 3.6->[4.7-7.9]   Dedup: 6.8->[7.9-7.9]
I20260709 12:11:17.909412 26412 raft_consensus.cc:3060] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:17.884296 26444 consensus_meta.cc:287] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.825s	user 0.007s	sys 0.004s
I20260709 12:11:17.855484 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:17.874856 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:17.798457 24970 consensus_meta.cc:287] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.513s	user 0.009s	sys 0.004s
I20260709 12:11:17.978355 26426 raft_consensus.cc:2749] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:11:17.984956 26316 consensus_meta.cc:287] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.756s	user 0.007s	sys 0.013s
I20260709 12:11:17.985404 26316 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:17.923213 26436 consensus_meta.cc:287] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.635s	user 0.014s	sys 0.000s
I20260709 12:11:17.913250 26480 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:17.905870 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 318178us
I20260709 12:11:17.906185 22497 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:17.896111 26357 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.004s	sys 0.034s
W20260709 12:11:17.907387 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 119771us
I20260709 12:11:17.858898 26355 raft_consensus.cc:3055] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:11:17.913424 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 154287us
I20260709 12:11:17.928328 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:17.907014 26481 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:17.929570 22525 raft_consensus.cc:1240] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 7. Current term is 8. Ops: [4.7-7.9]
I20260709 12:11:18.017516 23087 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:17.817255 26025 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:17.910842 26074 raft_consensus.cc:2804] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:17.991565 22448 raft_consensus.cc:2393] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 11: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:17.926548 22527 rpcz_store.cc:276] 0709 12:11:16.859603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.859723 (+   120us) service_pool.cc:224] Handling call
0709 12:11:16.860091 (+   368us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:11:16.860494 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:16.860522 (+    28us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:11:16.861176 (+   654us) log.cc:844] Serialized 78 byte log entry
0709 12:11:17.121974 (+260798us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:17.152397 (+ 30423us) log.cc:844] Serialized 14 byte log entry
0709 12:11:17.152729 (+   332us) log.cc:844] Serialized 14 byte log entry
0709 12:11:17.152903 (+   174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.152968 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:17.880706 (+727738us) raft_consensus.cc:1685] finished
0709 12:11:17.880727 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:17.880869 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5422,"prepare.queue_time_us":124759,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":41,"raft.queue_time_us":55377,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":11617,"spinlock_wait_cycles":45379712,"thread_start_us":260449,"threads_started":1,"wal-append.queue_time_us":371878}
W20260709 12:11:18.024981 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.986770 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:17.904985 26387 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:18.033001 26387 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:18.020439 26481 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:18.033825 26289 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:18.034360 26481 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:18.035161 22531 raft_consensus.cc:1240] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:18.036283 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:11:18.037560 26432 consensus_meta.cc:287] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.718s	user 0.010s	sys 0.002s
I20260709 12:11:18.037955 26432 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:18.038897 22526 raft_consensus.cc:1240] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:18.014846 26425 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.045328 26425 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:18.046950 22451 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 742) took 2045 ms (client timeout 2602 ms). Trace:
W20260709 12:11:18.053296 22451 rpcz_store.cc:269] 0709 12:11:16.001632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.901700 (+900068us) service_pool.cc:224] Handling call
0709 12:11:18.046772 (+1145072us) spinlock_profiling.cc:243] Waited 330 ms on lock 0x7b5400241b54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:18.046889 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":759937792}
W20260709 12:11:18.054890 26177 consensus_meta.cc:287] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.583s	user 0.005s	sys 0.004s
I20260709 12:11:17.971187 26132 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:18.055946 26497 raft_consensus.cc:2749] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:18.016048 26355 raft_consensus.cc:740] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:18.058094 26355 consensus_queue.cc:260] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:18.059116 26355 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:18.059573 25628 consensus_meta.cc:287] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.584s	user 0.008s	sys 0.004s
I20260709 12:11:18.060134 25628 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:17.930802 26417 consensus_meta.cc:287] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.617s	user 0.011s	sys 0.000s
I20260709 12:11:17.995035 24970 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:17.905467 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 121609us
I20260709 12:11:17.909693 26325 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:17.919272 26410 raft_consensus.cc:697] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
W20260709 12:11:17.987390 26427 consensus_meta.cc:287] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.987s	user 0.012s	sys 0.003s
I20260709 12:11:17.908551 26419 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:18.017215 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 111089us
I20260709 12:11:18.017323 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:18.018028 22495 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:18.019521 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:18.090677 22497 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:18.027050 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:18.092484 23121 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:17.994104 26316 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:18.028157 26126 raft_consensus.cc:2804] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:11:18.028436 25675 consensus_meta.cc:287] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.726s	user 0.016s	sys 0.005s
I20260709 12:11:18.096032 26126 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:18.096521 26126 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:18.096195 25675 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:18.097702 26419 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:18.028716 26378 consensus_queue.cc:1048] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:18.058343 26132 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:18.047484 22523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 2105) took 1141 ms. Trace:
W20260709 12:11:18.050297 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.052142 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:17.918311 26443 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:18.109162 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 45830.6us
I20260709 12:11:18.065126 22570 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:18.069882 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:18.052326 26437 consensus_meta.cc:287] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.735s	user 0.009s	sys 0.004s
I20260709 12:11:18.067047 26074 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:18.063651 26025 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:18.088305 24970 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:18.089268 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 50457.8us
I20260709 12:11:18.115993 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:17.991335 26436 raft_consensus.cc:2749] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:18.098892 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 80946.5us
I20260709 12:11:18.121753 22495 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:18.101121 22421 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
W20260709 12:11:18.122249 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 57188.6us
I20260709 12:11:17.987484 26444 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:18.106001 25675 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:18.020021 26480 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:18.107759 22523 rpcz_store.cc:276] 0709 12:11:16.906288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.987019 (+ 80731us) service_pool.cc:224] Handling call
0709 12:11:16.987289 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:17.255480 (+268191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.047245 (+791765us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b54001f2a54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:18.047398 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":581742976}
W20260709 12:11:18.086860 26441 consensus_meta.cc:287] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.770s	user 0.009s	sys 0.000s
I20260709 12:11:18.209820 26441 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:18.047435 26425 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:18.114379 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:11:18.120111 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.212463 22523 raft_consensus.cc:1240] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:18.106709 26177 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:18.132236 26309 raft_consensus.cc:2804] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:18.117257 26074 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:18.132884 26443 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:18.230463 26480 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:18.231165 26443 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:18.231637 22530 raft_consensus.cc:2368] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 8. Current term is 9.
I20260709 12:11:18.234076 22530 raft_consensus.cc:1240] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:18.235281 22530 raft_consensus.cc:1275] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:11:18.236430 22530 raft_consensus.cc:1275] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:18.239006 26480 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:18.243234 26425 raft_consensus.cc:2749] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:18.243391 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 142389us
I20260709 12:11:18.244212 22421 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:18.248836 22525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 2117) took 1259 ms. Trace:
I20260709 12:11:18.249293 22525 rpcz_store.cc:276] 0709 12:11:16.989231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.055666 (+ 66435us) service_pool.cc:224] Handling call
0709 12:11:17.881250 (+825584us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:11:18.020590 (+139340us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.248594 (+228004us) spinlock_profiling.cc:243] Waited 825 ms on lock 0x7b54001f2550. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:18.248769 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1897855360}
I20260709 12:11:18.118953 26437 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:18.133703 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:18.137189 26463 log.cc:927] Time spent T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.744s	user 0.002s	sys 0.000s
I20260709 12:11:18.137761 22601 raft_consensus.cc:1240] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:18.251865 26437 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:18.251907 22605 raft_consensus.cc:1240] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:18.139101 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:18.252779 26472 raft_consensus.cc:2749] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:18.254472 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:18.139775 22448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1856) took 1690 ms. Trace:
I20260709 12:11:18.255040 22601 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:18.255196 22448 rpcz_store.cc:276] 0709 12:11:16.448974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.899322 (+450348us) service_pool.cc:224] Handling call
0709 12:11:18.139581 (+1240259us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54003f43d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:18.139714 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2509638912}
I20260709 12:11:18.140241 22456 raft_consensus.cc:1240] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:18.111012 26419 raft_consensus.cc:2749] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:18.140741 23123 raft_consensus.cc:1240] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:11:18.141017 26410 consensus_queue.cc:237] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:18.259572 26326 consensus_queue.cc:1059] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:18.260219 26326 consensus_queue.cc:1243] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer 6c6fa11e8ee34711b3551f0c670442bc log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:18.104319 26427 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:18.260694 26326 raft_consensus.cc:3055] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:18.261041 26326 raft_consensus.cc:740] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:18.261816 26326 consensus_queue.cc:260] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:18.262513 26427 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:18.123930 22570 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:18.148286 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:18.271612 22532 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 10.
I20260709 12:11:18.178200 23121 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 12.
I20260709 12:11:18.246618 22421 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:18.178609 26433 raft_consensus.cc:993] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc: : Instructing follower c863116d91c14d1ca50d6e8a46a37a8f to start an election
I20260709 12:11:18.207192 22454 raft_consensus.cc:2393] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 13: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:18.208161 26444 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:18.129033 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:18.216112 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:18.073395 26417 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:18.294178 26126 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:18.295056 26417 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:18.295903 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:18.296504 22597 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:11:18.222414 26436 raft_consensus.cc:2749] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:18.300603 22528 raft_consensus.cc:2368] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 10. Current term is 11.
I20260709 12:11:18.147593 25628 leader_election.cc:290] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:18.224923 26415 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:18.117623 26500 consensus_queue.cc:1059] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.193s
I20260709 12:11:18.303879 26325 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:18.225735 26414 consensus_queue.cc:1048] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:18.226155 26177 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:18.309082 26177 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:18.106392 26426 raft_consensus.cc:2804] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:18.309641 26426 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:18.310056 26426 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.263569 22600 raft_consensus.cc:2393] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 12: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:18.263757 22530 raft_consensus.cc:1275] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:18.316660 26441 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:18.190393 26411 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:18.262902 26326 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:18.318871 26411 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:18.320101 26432 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:18.322762 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.217993 26309 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:18.268712 22601 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 13.
W20260709 12:11:18.269899 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.323567 26289 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:18.274892 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:18.264890 22529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1782) took 1592 ms. Trace:
I20260709 12:11:18.324800 22529 rpcz_store.cc:276] 0709 12:11:16.672378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.677047 (+  4669us) service_pool.cc:224] Handling call
0709 12:11:16.677421 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:16.945360 (+267939us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:16.945402 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:16.945827 (+   425us) log.cc:844] Serialized 26 byte log entry
0709 12:11:17.256836 (+311009us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:17.256870 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.877696 (+620826us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b540038fed4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:17.877754 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:18.136613 (+258859us) spinlock_profiling.cc:243] Waited 4.51 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:11:18.264687 (+128074us) raft_consensus.cc:1685] finished
0709 12:11:18.264708 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:18.264834 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36113,"raft.queue_time_us":9701,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":43328,"spinlock_wait_cycles":625783808,"thread_start_us":310658,"threads_started":1,"wal-append.queue_time_us":367572}
I20260709 12:11:18.326442 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:18.327768 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:18.328311 22598 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:18.328658 26025 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:18.331393 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:18.332538 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:18.333413 26481 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:18.339977 22597 raft_consensus.cc:2468] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
I20260709 12:11:18.341171 22602 raft_consensus.cc:2393] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 12: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:18.341786 26448 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:18.343799 26420 raft_consensus.cc:2749] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:18.344233 26425 raft_consensus.cc:2749] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:18.345192 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 98657.7us
I20260709 12:11:18.357661 22421 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:18.358772 22598 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
I20260709 12:11:18.346472 22524 raft_consensus.cc:1240] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:18.346948 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 223086us
W20260709 12:11:18.348009 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:18.349460 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.350351 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:18.338430 26443 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:18.330826 26025 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:18.323601 26309 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:18.366621 22421 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:18.368081 22422 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:18.361784 26427 raft_consensus.cc:1081] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 10 LEADER]: Signalling peer c863116d91c14d1ca50d6e8a46a37a8f to start an election
I20260709 12:11:18.370543 22570 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:18.374831 22497 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:18.394431 22497 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
W20260709 12:11:18.381462 23089 leader_election.cc:336] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Timed out: RequestConsensusVote RPC to 127.20.196.131:37785 timed out after 1.585s (SENT)
I20260709 12:11:18.396256 23089 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:18.389444 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.357970 26433 raft_consensus.cc:2804] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:11:18.403213 26423 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.019s	sys 0.019s
W20260709 12:11:18.369935 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 314411us
I20260709 12:11:18.364475 26444 raft_consensus.cc:2804] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:18.410163 22570 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:18.417799 24970 consensus_queue.cc:1048] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:18.415194 22496 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:18.393517 26425 raft_consensus.cc:2804] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:18.424641 22421 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:18.428598 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:18.392110 26177 raft_consensus.cc:2749] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:18.432876 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:18.437779 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:18.438444 23120 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:18.438874 23118 raft_consensus.cc:2393] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 12: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:18.440245 23118 raft_consensus.cc:1240] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:18.440495 23124 raft_consensus.cc:1240] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:18.441908 23124 raft_consensus.cc:1240] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:18.445696 23120 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
I20260709 12:11:18.455860 23125 raft_consensus.cc:1240] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:18.459399 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 44424.3us
I20260709 12:11:18.460218 26126 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:18.460887 25628 raft_consensus.cc:2804] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:18.461565 25628 raft_consensus.cc:697] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:18.412598 26444 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:18.464665 26444 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.462615 25628 consensus_queue.cc:237] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:18.473222 23089 leader_election.cc:336] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Timed out: RequestConsensusVote RPC to 127.20.196.131:37785 timed out after 1.624s (SENT)
I20260709 12:11:18.409220 26420 raft_consensus.cc:2804] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:18.480521 26481 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:18.482718 26472 raft_consensus.cc:2749] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:18.483323 26443 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:18.483438 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:18.409358 26411 raft_consensus.cc:2804] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:18.405666 26433 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:18.484387 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:18.516810 23121 raft_consensus.cc:2393] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 12: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:18.501694 22421 leader_election.cc:400] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 election: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 11. Current term is 12.
I20260709 12:11:18.517333 22421 leader_election.cc:403] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:11:18.418601 26484 raft_consensus.cc:2804] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:18.509176 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:18.509984 26444 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:18.421886 26025 raft_consensus.cc:2749] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:18.522238 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:18.540225 23125 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:18.540673 22570 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
W20260709 12:11:18.420354 26423 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.019s	sys 0.019s
I20260709 12:11:18.525677 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:18.411823 26432 consensus_queue.cc:1059] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 12:11:18.527503 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:18.527231 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:18.532964 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:18.533725 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:18.533939 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:18.536010 22452 raft_consensus.cc:1240] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 8. Current term is 9. Ops: [7.7-8.8]
I20260709 12:11:18.529556 22523 raft_consensus.cc:1275] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:11:18.542951 22525 raft_consensus.cc:2393] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 12: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
W20260709 12:11:18.518800 26508 log.cc:927] Time spent T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.062s	user 0.000s	sys 0.004s
I20260709 12:11:18.533751 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:18.584852 22457 raft_consensus.cc:2393] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 8: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:18.539623 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:18.585939 23123 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:18.518603 26510 log.cc:927] Time spent T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.055s	user 0.000s	sys 0.004s
I20260709 12:11:18.544737 22451 raft_consensus.cc:1240] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:18.530759 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:18.545432 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:18.599359 23121 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Advancing to term 11
W20260709 12:11:18.527745 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 374798us
I20260709 12:11:18.582451 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:18.601655 22530 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
I20260709 12:11:18.582788 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:18.603057 22532 raft_consensus.cc:2393] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 12: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:18.517768 26420 raft_consensus.cc:697] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:18.501957 26425 raft_consensus.cc:697] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
W20260709 12:11:18.523093 26503 log.cc:927] Time spent T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.119s	user 0.003s	sys 0.001s
W20260709 12:11:18.523221 26504 log.cc:927] Time spent T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.065s	user 0.001s	sys 0.003s
I20260709 12:11:18.587568 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:18.589793 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:18.614631 22527 raft_consensus.cc:2393] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 12: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:18.594115 23087 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:18.590375 22570 leader_election.cc:400] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 8. Current term is 9.
I20260709 12:11:18.616295 23087 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:18.616683 22570 leader_election.cc:403] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:18.520916 26433 raft_consensus.cc:3060] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:18.542654 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 404033us
I20260709 12:11:18.519842 26484 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:18.638389 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:18.621311 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:18.637391 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:18.639303 22530 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:18.639760 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:18.605794 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 454461us
I20260709 12:11:18.587929 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:18.537169 26177 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:18.642767 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:18.647599 26501 raft_consensus.cc:2749] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 8. Current term is 9.
I20260709 12:11:18.647832 26316 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.648334 26316 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:18.648789 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:18.649371 22602 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.650372 26316 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:18.433259 26328 consensus_queue.cc:1048] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.105s
I20260709 12:11:18.526623 26411 raft_consensus.cc:697] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:18.614442 22528 raft_consensus.cc:2376] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7. Re-sending same reply.
I20260709 12:11:18.661263 22531 raft_consensus.cc:2393] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 9: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:18.617869 23087 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:18.547811 26423 raft_consensus.cc:697] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:18.595709 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:18.663808 22450 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:18.588368 26431 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:18.669875 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:18.603708 26410 raft_consensus.cc:2749] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:18.629364 23125 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
I20260709 12:11:18.673790 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:18.621572 22496 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:18.635540 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:18.636001 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:18.641815 26484 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:18.641906 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:18.642622 26444 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:18.656723 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:18.658298 22495 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:18.659296 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:18.664285 22527 raft_consensus.cc:1240] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:18.665119 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:18.711488 22598 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 8.
I20260709 12:11:18.608043 26025 consensus_queue.cc:1059] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:11:18.675148 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:11:18.663756 26412 consensus_meta.cc:287] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.671s	user 0.008s	sys 0.001s
I20260709 12:11:18.724489 23125 raft_consensus.cc:2393] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 9: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:18.633704 23121 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
I20260709 12:11:18.628599 26357 raft_consensus.cc:2749] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:18.660724 26418 consensus_meta.cc:287] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.671s	user 0.009s	sys 0.001s
I20260709 12:11:18.681136 22530 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 13.
W20260709 12:11:18.684207 23089 leader_election.cc:336] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Timed out: RequestConsensusVote RPC to 127.20.196.131:37785 timed out after 1.846s (SENT)
W20260709 12:11:18.730850 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 46689.7us
I20260709 12:11:18.637369 26449 raft_consensus.cc:2749] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:18.726454 22456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2403) took 1733 ms. Trace:
W20260709 12:11:18.732762 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 111287us
I20260709 12:11:18.733213 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:18.732340 22456 rpcz_store.cc:276] 0709 12:11:16.992717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.259642 (+266925us) service_pool.cc:224] Handling call
0709 12:11:18.140092 (+880450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:18.256619 (+116527us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.726193 (+469574us) spinlock_profiling.cc:243] Waited 880 ms on lock 0x7b54003f43d0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:18.726382 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2024141696}
I20260709 12:11:18.735849 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:18.745971 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:11:18.750949 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 92726.5us
I20260709 12:11:18.758642 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:18.760076 22605 raft_consensus.cc:2368] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 8. Current term is 9.
I20260709 12:11:18.738282 26418 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:18.679818 26431 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:18.733070 26126 raft_consensus.cc:2749] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:18.763332 22495 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:18.763590 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:18.740087 26448 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:18.754457 26074 consensus_meta.cc:287] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.525s	user 0.008s	sys 0.000s
I20260709 12:11:18.771507 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:18.776018 23116 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:18.777873 22496 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:18.772648 22603 raft_consensus.cc:2368] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 10. Current term is 11.
W20260709 12:11:18.774139 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 156344us
I20260709 12:11:18.782680 23087 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:18.753147 26512 raft_consensus.cc:2749] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:18.764142 26436 raft_consensus.cc:2804] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:11:18.844633 23088 leader_election.cc:336] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 1.846s (SENT)
I20260709 12:11:18.868608 23088 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:18.733618 26412 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:18.870826 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:18.947484 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.732674 26420 consensus_queue.cc:237] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:18.966622 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 188860us
I20260709 12:11:18.868256 26436 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:18.740147 26425 consensus_queue.cc:237] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:18.767815 26480 consensus_queue.cc:1048] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.159s
I20260709 12:11:18.867951 26449 raft_consensus.cc:2749] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:18.971233 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:18.909636 26126 raft_consensus.cc:2749] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:18.866811 26426 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:18.980223 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.966552 26439 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:11:18.987346 26521 log.cc:927] Time spent T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:11:18.989542 26418 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:18.990149 26177 raft_consensus.cc:2749] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 11. Current term is 12.
W20260709 12:11:18.990324 26516 log.cc:927] Time spent T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.241s	user 0.000s	sys 0.000s
I20260709 12:11:19.029348 26439 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:18.869830 26074 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:18.991528 26519 log.cc:927] Time spent T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.228s	user 0.000s	sys 0.000s
I20260709 12:11:18.991801 26132 raft_consensus.cc:2804] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:11:18.995909 26309 consensus_meta.cc:287] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.608s	user 0.007s	sys 0.002s
I20260709 12:11:19.014364 22602 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 10.
I20260709 12:11:19.023779 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:19.032665 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:19.033478 23120 raft_consensus.cc:2393] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 9: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:18.971956 26523 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.034384 26523 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:18.979339 26436 raft_consensus.cc:3060] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:18.987466 26505 log.cc:927] Time spent T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.333s	user 0.000s	sys 0.001s
I20260709 12:11:19.028726 26426 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:19.031488 26132 raft_consensus.cc:697] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:19.031952 26439 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:19.031498 26309 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:18.966429 26470 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.098301 23116 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
I20260709 12:11:19.100247 22524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1788) took 1510 ms. Trace:
I20260709 12:11:19.100633 22524 rpcz_store.cc:276] 0709 12:11:17.589469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.589578 (+   109us) service_pool.cc:224] Handling call
0709 12:11:17.589842 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:18.360118 (+770276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:19.100041 (+739923us) spinlock_profiling.cc:243] Waited 756 ms on lock 0x7b540030fcd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:19.100193 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1739674880}
I20260709 12:11:19.040792 22450 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 8.
W20260709 12:11:19.043885 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 74482.1us
I20260709 12:11:19.045588 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:19.049139 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:19.113197 22496 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:19.050055 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:18.770337 26411 consensus_queue.cc:237] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:19.051326 22452 raft_consensus.cc:1275] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 12:11:19.125077 22452 pending_rounds.cc:85] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f: Aborting all ops after (but not including) 6
I20260709 12:11:19.125370 22452 pending_rounds.cc:107] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 12:11:19.125619 22452 raft_consensus.cc:2889] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:19.126183 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:19.126704 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:19.127652 22452 raft_consensus.cc:2393] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 12: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:19.128486 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:19.126726 22450 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:19.053707 23089 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:18.976613 26512 raft_consensus.cc:2749] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:19.063503 22453 raft_consensus.cc:1240] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:19.064163 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:19.133054 22451 raft_consensus.cc:2468] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:11:19.070642 26074 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:19.071020 22448 raft_consensus.cc:1240] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:19.056138 26126 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.115873 22496 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:19.116458 26426 raft_consensus.cc:2749] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:19.116830 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:11:19.154277 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 100639us
I20260709 12:11:19.117318 26412 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:18.867241 26423 consensus_queue.cc:237] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:19.117489 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:19.160516 22457 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:19.120333 26309 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:19.121351 22604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2629) took 1206 ms. Trace:
I20260709 12:11:19.163945 22604 rpcz_store.cc:276] 0709 12:11:17.914555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.916257 (+  1702us) service_pool.cc:224] Handling call
0709 12:11:17.974673 (+ 58416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:17.975170 (+   497us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:17.975212 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:17.991014 (+ 15802us) log.cc:844] Serialized 26 byte log entry
0709 12:11:18.365370 (+374356us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:18.365423 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.365510 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:19.121151 (+755641us) raft_consensus.cc:1685] finished
0709 12:11:19.121173 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:19.121297 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13019,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":4960,"thread_start_us":372140,"threads_started":1,"wal-append.queue_time_us":554835}
W20260709 12:11:19.147708 23123 consensus_meta.cc:287] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.561s	user 0.011s	sys 0.000s
I20260709 12:11:19.166942 23123 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
I20260709 12:11:19.176878 22450 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
I20260709 12:11:19.123437 26439 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:19.184141 22421 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.006s	sys 0.022s
W20260709 12:11:19.191876 22421 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.006s	sys 0.022s
I20260709 12:11:19.185716 22496 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:19.116470 26431 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:19.190470 22570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.000s	sys 0.021s
I20260709 12:11:19.142414 26377 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:19.192976 22570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.000s	sys 0.021s
I20260709 12:11:19.143317 26177 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:19.152060 26418 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.196266 22496 leader_election.cc:304] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:19.142297 26470 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:19.201030 23122 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.014s	sys 0.020s
W20260709 12:11:19.197079 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 579500us
I20260709 12:11:19.177374 22456 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
 from {username='slave'} at 127.0.0.1:51836
I20260709 12:11:19.210683 22456 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:19.211184 22456 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:19.209498 23122 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.014s	sys 0.021s
I20260709 12:11:19.224609 23122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 987) took 1196 ms. Trace:
I20260709 12:11:19.225762 22421 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:19.227036 22421 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:19.225099 23122 rpcz_store.cc:276] 0709 12:11:18.027844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.047518 (+ 19674us) service_pool.cc:224] Handling call
0709 12:11:18.047865 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:18.048201 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:18.048227 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:18.048660 (+   433us) log.cc:844] Serialized 26 byte log entry
0709 12:11:18.367804 (+319144us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:18.620665 (+252861us) log.cc:844] Serialized 14 byte log entry
0709 12:11:19.224239 (+603574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:19.224326 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:19.224377 (+    51us) raft_consensus.cc:1685] finished
0709 12:11:19.224394 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:19.224544 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20572,"prepare.queue_time_us":390423,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":69979,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":50038,"thread_start_us":1117878,"threads_started":3,"wal-append.queue_time_us":408123}
I20260709 12:11:19.228446 22457 raft_consensus.cc:2468] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:11:19.241936 22452 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
I20260709 12:11:19.240455 22421 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:19.200549 26325 raft_consensus.cc:2804] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:19.159677 26126 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:19.253962 22421 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:19.166447 26433 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:19.201013 26534 raft_consensus.cc:2749] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:19.270129 26410 consensus_queue.cc:1059] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:19.224503 26426 raft_consensus.cc:2804] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:19.236817 26074 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.224833 26355 raft_consensus.cc:2749] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:19.208468 26177 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:19.252488 26446 raft_consensus.cc:2749] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:19.282994 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 72056.3us
I20260709 12:11:19.239183 26328 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:19.283833 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:19.275665 22456 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:19.315603 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 552349us
I20260709 12:11:19.223696 26418 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:19.200811 26439 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:19.276435 26377 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.319259 23118 raft_consensus.cc:1240] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:19.268328 26431 raft_consensus.cc:2804] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:19.274490 26325 raft_consensus.cc:697] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:19.324627 22495 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:19.327687 22456 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:19.332587 22570 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:19.333952 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 60097.2us
I20260709 12:11:19.320951 26539 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.353277 22570 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:19.335602 26534 consensus_queue.cc:1059] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:19.337054 26448 raft_consensus.cc:2749] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:11:19.338654 26524 log.cc:927] Time spent T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 12:11:19.340031 26526 log.cc:927] Time spent T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 12:11:19.343477 26523 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:19.276302 26544 consensus_queue.cc:1048] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:11:19.346520 26485 consensus_queue.cc:1059] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:19.337667 26309 consensus_queue.cc:1048] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:11:19.287595 26426 raft_consensus.cc:697] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:19.322671 26025 consensus_queue.cc:1059] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:11:19.354815 22569 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:11:19.340428 22454 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2388) took 2990 ms (client timeout 2385 ms). Trace:
W20260709 12:11:19.487305 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 132392us
W20260709 12:11:19.487373 22454 rpcz_store.cc:269] 0709 12:11:16.349488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.911268 (+561780us) service_pool.cc:224] Handling call
0709 12:11:19.340149 (+2428881us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400241154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:19.340332 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2843596672}
I20260709 12:11:19.494043 22569 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:19.357210 22570 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:19.495486 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 232967us
I20260709 12:11:19.286614 26074 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:19.272135 26132 consensus_queue.cc:237] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:19.429071 26309 raft_consensus.cc:3055] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:19.503058 26309 raft_consensus.cc:740] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:19.319645 26328 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:19.330052 26377 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:19.418197 26410 raft_consensus.cc:2804] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:19.529498 26410 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:19.530310 26410 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:19.363754 26412 raft_consensus.cc:2804] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:19.432062 26418 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:19.533762 26552 raft_consensus.cc:2804] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:19.332782 26420 consensus_queue.cc:1048] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:11:19.437450 26426 consensus_queue.cc:237] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:19.373435 26431 raft_consensus.cc:697] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:19.539992 22421 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:19.541623 26418 raft_consensus.cc:2749] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:19.412504 26433 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:19.432538 26470 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:19.414479 26485 consensus_queue.cc:1059] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 12:11:19.357475 26501 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:19.543577 26544 raft_consensus.cc:2804] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:11:19.436844 26525 log.cc:927] Time spent T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 12:11:19.544725 26425 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.008s	sys 0.008s
I20260709 12:11:19.359838 26539 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:19.359046 26543 raft_consensus.cc:3055] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:19.547438 26543 raft_consensus.cc:740] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
W20260709 12:11:19.513128 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 155817us
I20260709 12:11:19.507814 22569 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:19.524199 26328 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:19.505199 26309 consensus_queue.cc:260] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:19.528194 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 203702us
W20260709 12:11:19.533915 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.541158 26431 consensus_queue.cc:237] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:19.441111 26436 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:19.418406 26484 consensus_meta.cc:287] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.688s	user 0.005s	sys 0.006s
I20260709 12:11:19.564200 26484 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:19.565618 26436 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:19.429936 26325 consensus_queue.cc:237] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:19.566922 26484 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:19.543500 26412 raft_consensus.cc:697] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:19.323596 26511 consensus_queue.cc:1048] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:11:19.558444 26485 raft_consensus.cc:3055] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:19.569808 26377 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:19.570107 26485 raft_consensus.cc:740] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:19.517127 26548 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.569833 26412 consensus_queue.cc:237] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:19.571563 26485 consensus_queue.cc:260] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:19.572310 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:19.572458 26543 consensus_queue.cc:260] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:19.573662 26485 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:19.571074 26548 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:19.559669 26544 raft_consensus.cc:697] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:19.576690 26539 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:19.576556 26544 consensus_queue.cc:237] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:19.582120 26562 raft_consensus.cc:2749] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:19.574959 26543 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:19.585258 26512 consensus_queue.cc:1048] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:19.585973 26423 consensus_queue.cc:1059] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:19.584401 22495 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:19.588764 26480 raft_consensus.cc:2749] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:19.589788 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:19.590590 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:19.591205 26512 raft_consensus.cc:3055] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:19.591753 26512 raft_consensus.cc:740] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:19.591712 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:19.592792 22527 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 8.
I20260709 12:11:19.566781 22456 raft_consensus.cc:1275] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:19.591663 22524 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:19.597193 26512 consensus_queue.cc:260] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:19.597949 22454 raft_consensus.cc:1240] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:19.598623 23116 raft_consensus.cc:1275] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:19.599026 26512 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:19.600337 24970 raft_consensus.cc:993] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc: : Instructing follower 1676e7af5e4a47cb86ee7db83e3d4881 to start an election
W20260709 12:11:19.603778 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 107142us
I20260709 12:11:19.618718 26562 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:19.630246 22455 raft_consensus.cc:1275] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:11:19.631819 23087 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:19.632750 26289 raft_consensus.cc:3055] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:19.633291 26289 raft_consensus.cc:740] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:19.633848 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:19.634438 26377 raft_consensus.cc:2749] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:19.635136 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:19.636060 26309 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:19.644852 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:19.645089 26355 consensus_queue.cc:1059] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:19.645419 23088 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:19.634613 26289 consensus_queue.cc:260] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:19.647543 26537 raft_consensus.cc:3055] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:19.658963 26537 raft_consensus.cc:740] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:19.659684 22526 raft_consensus.cc:1240] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:19.660684 26537 consensus_queue.cc:260] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:19.661646 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:19.662156 26537 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:19.662695 22532 raft_consensus.cc:1240] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:19.648000 22570 leader_election.cc:400] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 election: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 10. Current term is 11.
I20260709 12:11:19.663522 22570 leader_election.cc:403] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:11:19.666075 26038 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:19.666846 26038 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:19.667423 26500 raft_consensus.cc:2749] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 10. Current term is 11.
I20260709 12:11:19.669459 26038 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:19.669627 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:19.650420 26511 raft_consensus.cc:1081] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Signalling peer 1676e7af5e4a47cb86ee7db83e3d4881 to start an election
I20260709 12:11:19.670655 23122 raft_consensus.cc:2393] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 9: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:19.650586 26562 raft_consensus.cc:697] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:19.671293 24970 consensus_queue.cc:1059] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:19.671636 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:19.672659 24970 raft_consensus.cc:3055] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:19.672716 26562 consensus_queue.cc:237] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:19.673300 24970 raft_consensus.cc:740] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:19.673238 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:19.674260 23120 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:19.677007 26548 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:19.677850 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:19.679283 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:19.680080 22457 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:11:19.682823 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:19.683197 26544 consensus_queue.cc:1048] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:19.685559 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:19.686040 22569 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:19.686682 22457 raft_consensus.cc:2393] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 8: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:19.687808 26433 raft_consensus.cc:2804] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:19.688275 26433 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:19.688748 26433 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:19.688321 26410 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:19.690913 26538 raft_consensus.cc:3055] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:19.691395 26538 raft_consensus.cc:740] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:19.692538 26538 consensus_queue.cc:260] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:19.694098 26538 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:19.674788 24970 consensus_queue.cc:260] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:19.696436 24970 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:19.703038 22604 raft_consensus.cc:3055] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:19.703475 22604 raft_consensus.cc:740] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:19.704514 22604 consensus_queue.cc:260] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:19.705761 22604 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:19.703444 26410 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:19.706578 23123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 990) took 1114 ms. Trace:
I20260709 12:11:19.634660 23116 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:19.707471 23123 rpcz_store.cc:276] 0709 12:11:18.592035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.167782 (+575747us) service_pool.cc:224] Handling call
0709 12:11:19.168133 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:19.168373 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:19.197586 (+ 29213us) log.cc:844] Serialized 14 byte log entry
0709 12:11:19.594407 (+396821us) spinlock_profiling.cc:243] Waited 6.02 ms on lock 0x7b18003eef00. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc7823e07 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc7840c02 00007f9cca4c820b 00007f9cca4cdd23 00007f9cca4ce23a 00007f9cca938a2a
0709 12:11:19.618307 (+ 23900us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:19.618401 (+    94us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:19.618482 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:19.618592 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:19.706391 (+ 87799us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":28269,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":131,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":161,"spinlock_wait_cycles":13856512,"thread_start_us":23440,"threads_started":1}
W20260709 12:11:19.709721 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:19.710146 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.712555 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:19.687608 26468 consensus_queue.cc:1048] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:11:19.650792 26484 consensus_queue.cc:1059] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 12:11:19.707870 22602 raft_consensus.cc:1275] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:19.718092 26484 raft_consensus.cc:3055] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:19.718488 26484 raft_consensus.cc:740] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:19.653965 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:19.719849 22597 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:19.657666 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:19.666648 22570 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:19.738440 22524 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 10.
I20260709 12:11:19.658288 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:19.656395 26495 raft_consensus.cc:3055] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:19.799201 26495 raft_consensus.cc:740] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:19.800534 26495 consensus_queue.cc:260] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:19.801903 26495 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:19.654868 26289 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:19.805523 23116 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 10.
I20260709 12:11:19.811329 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:19.811892 22527 raft_consensus.cc:1275] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:19.812103 22530 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 7.
I20260709 12:11:19.753350 23120 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
I20260709 12:11:19.753727 26446 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.754382 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:11:19.755848 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 89348.8us
W20260709 12:11:19.759130 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.763594 26437 raft_consensus.cc:3055] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:19.767601 22602 raft_consensus.cc:1240] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:19.740662 26377 raft_consensus.cc:2749] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:19.741518 26411 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:19.772603 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:19.773139 22422 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:19.790702 26501 raft_consensus.cc:2749] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:19.773900 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:19.652007 26473 raft_consensus.cc:3055] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:19.743897 26500 consensus_queue.cc:1048] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:11:19.791538 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:19.792934 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:19.795332 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 51391.2us
I20260709 12:11:19.796195 22421 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:19.774858 26543 raft_consensus.cc:2749] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:19.686851 26177 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:19.825412 22604 raft_consensus.cc:1275] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:11:19.771278 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:19.770696 26415 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.830940 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:19.847095 23120 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 9.
I20260709 12:11:19.778075 26433 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:19.849342 22598 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
I20260709 12:11:19.850634 23087 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:19.825445 26437 raft_consensus.cc:740] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:19.854120 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:19.855039 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:11:19.857012 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.855228 26411 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:19.857836 22454 raft_consensus.cc:2393] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 10: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:19.859205 26411 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:19.860257 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:19.861657 26533 log.cc:927] Time spent T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.588s	user 0.001s	sys 0.001s
I20260709 12:11:19.862349 22451 raft_consensus.cc:1240] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:19.832548 26473 raft_consensus.cc:740] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
W20260709 12:11:19.884075 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 53135.8us
I20260709 12:11:19.857319 22605 raft_consensus.cc:2410] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 12:11:19.890026 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 64635.9us
W20260709 12:11:19.892237 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 119379us
W20260709 12:11:19.893606 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.832695 26512 consensus_queue.cc:1048] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:11:19.896027 22597 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 12.
I20260709 12:11:19.896595 22524 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 8.
I20260709 12:11:19.828341 26552 raft_consensus.cc:697] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:19.905352 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:19.908529 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:19.910637 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 114840us
I20260709 12:11:19.832315 26446 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:19.914465 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:19.908200 22449 raft_consensus.cc:2376] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9. Re-sending same reply.
I20260709 12:11:19.919889 26563 consensus_queue.cc:1048] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:11:19.920276 22603 raft_consensus.cc:1240] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:19.921108 26444 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:19.921548 26444 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:19.916957 26415 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:19.922122 26444 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:19.922708 23117 raft_consensus.cc:1240] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:19.923393 23117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 1191) took 1493 ms. Trace:
I20260709 12:11:19.923738 23117 rpcz_store.cc:276] 0709 12:11:18.430029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.430132 (+   103us) service_pool.cc:224] Handling call
0709 12:11:19.922082 (+1491950us) spinlock_profiling.cc:243] Waited 1.29 ms on lock 0x7b54004e62a8. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9ccf857aa1 00007f9ccf8d2ebc 00007f9ccf90808c 00007f9ccf8f293b 00007f9ccf8f23d2 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c
0709 12:11:19.922301 (+   219us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:19.923087 (+   786us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:19.923312 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2978048}
I20260709 12:11:19.925499 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:19.929703 22448 raft_consensus.cc:1240] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:19.905256 26431 raft_consensus.cc:2749] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:19.933035 23123 raft_consensus.cc:1240] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:19.935406 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:19.936354 22451 raft_consensus.cc:2393] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 10: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:19.920461 26433 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:11:19.938755 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 49776.6us
I20260709 12:11:19.940327 22570 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:19.941200 26433 raft_consensus.cc:2804] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:19.941614 26433 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:19.942045 26433 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:19.942155 22570 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:19.944770 26473 consensus_queue.cc:260] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:19.945928 26473 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:19.949501 26126 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:19.951210 26126 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:19.951766 26126 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:19.952932 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:19.954694 22451 raft_consensus.cc:1275] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:19.955606 26485 raft_consensus.cc:2749] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:19.955722 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:19.956506 26126 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:19.957019 22454 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:19.957087 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:19.958722 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:19.959059 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:19.959326 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:19.960009 22604 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 7.
I20260709 12:11:19.960099 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:19.961139 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:19.961238 22604 raft_consensus.cc:1275] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:19.962042 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:19.962255 22606 raft_consensus.cc:1240] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:19.963157 26074 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:19.963994 26415 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:19.964648 26355 raft_consensus.cc:2804] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:19.965224 26355 raft_consensus.cc:697] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 8 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:19.965493 26446 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:19.967857 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:19.968318 22570 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:19.968791 22448 raft_consensus.cc:2393] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 9: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:19.969364 26309 raft_consensus.cc:2804] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:19.969892 26309 raft_consensus.cc:697] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:19.970885 26309 consensus_queue.cc:237] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:19.971426 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:19.971313 26437 consensus_queue.cc:260] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:19.971293 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:19.973542 22598 raft_consensus.cc:2393] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 9: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
W20260709 12:11:19.979553 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 60271.7us
I20260709 12:11:20.002238 22454 raft_consensus.cc:2468] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
I20260709 12:11:19.966316 26355 consensus_queue.cc:237] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:20.009311 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:20.010074 22451 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:20.010850 22455 raft_consensus.cc:2393] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 12: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:20.021206 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:20.027261 22455 raft_consensus.cc:1240] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:11:20.027994 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:20.028800 22597 raft_consensus.cc:2410] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:11:20.008663 26548 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.036255 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:20.047869 22605 raft_consensus.cc:1240] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:20.050191 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:20.025626 26439 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:20.047324 26377 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:20.061106 26377 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:20.064004 26377 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:20.064906 22528 raft_consensus.cc:1240] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:20.065548 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:20.066516 22525 raft_consensus.cc:2393] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 9: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:20.067441 22524 raft_consensus.cc:1240] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:20.067750 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:20.068622 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:20.069398 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:20.070849 22530 raft_consensus.cc:1240] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 LEADER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:11:20.071854 26431 consensus_queue.cc:1059] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:20.072772 26431 raft_consensus.cc:3055] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:20.073104 26431 raft_consensus.cc:740] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:20.073966 26431 consensus_queue.cc:260] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:20.061106 22606 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 9.
I20260709 12:11:20.079851 26433 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:20.082111 26433 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:20.042790 26411 consensus_queue.cc:1048] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:11:20.053826 26548 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:20.088889 26548 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:20.044831 26552 consensus_queue.cc:237] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:20.068555 22526 raft_consensus.cc:2393] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 9: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
W20260709 12:11:20.099475 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 131245us
I20260709 12:11:20.100508 22570 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:20.101512 26427 raft_consensus.cc:2749] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:20.102217 26427 consensus_queue.cc:1059] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:20.060197 22497 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:20.075124 26472 raft_consensus.cc:2749] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:20.066294 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:20.057576 22421 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:20.102783 22602 raft_consensus.cc:3055] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:11:20.108968 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 181924us
I20260709 12:11:20.115141 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:20.112603 22602 raft_consensus.cc:740] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:20.070888 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:20.118198 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 71398.6us
W20260709 12:11:20.126188 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 90873us
W20260709 12:11:20.127226 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.130028 22421 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:20.131894 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:20.134058 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.132761 22606 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 9.
I20260709 12:11:20.117985 26562 raft_consensus.cc:3055] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:20.136654 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:20.141232 22421 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:20.124940 26425 raft_consensus.cc:2804] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:20.108702 26427 consensus_queue.cc:1059] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:11:20.146508 26548 raft_consensus.cc:2804] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:20.136866 26495 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:20.140270 26126 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:11:20.151110 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:20.166327 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:20.166818 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.131266 26431 raft_consensus.cc:3060] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:20.164538 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:20.168866 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:20.140620 26562 raft_consensus.cc:740] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
W20260709 12:11:20.174899 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.173465 22605 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 9.
I20260709 12:11:20.183109 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:20.184084 26548 raft_consensus.cc:697] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 11 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:20.184298 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:20.185222 26548 consensus_queue.cc:237] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:20.185884 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:20.186578 22457 raft_consensus.cc:3060] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:20.187120 26126 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:20.188172 26425 raft_consensus.cc:697] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:20.189288 26126 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317)
I20260709 12:11:20.189188 26425 consensus_queue.cc:237] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:20.190012 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.190824 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:20.191758 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.194077 23116 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 9.
I20260709 12:11:20.181401 22602 consensus_queue.cc:260] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:20.212677 22457 raft_consensus.cc:2468] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
I20260709 12:11:20.195708 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:20.232000 22449 raft_consensus.cc:1275] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:20.236780 22451 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
I20260709 12:11:20.237736 22453 raft_consensus.cc:1240] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:20.232255 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:20.235770 22422 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:20.196141 26439 raft_consensus.cc:2804] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:20.249402 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:20.258464 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:20.258967 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:20.165964 26377 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:20.196425 26495 raft_consensus.cc:697] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:20.253540 22497 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:20.240934 22529 raft_consensus.cc:2376] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 10. Re-sending same reply.
I20260709 12:11:20.266633 22602 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:20.261530 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:20.268585 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:11:20.270602 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 54595.2us
I20260709 12:11:20.275236 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:20.260533 26439 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:20.278043 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 68794us
I20260709 12:11:20.278669 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:20.279348 22422 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:20.280128 22524 raft_consensus.cc:2393] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 9: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:20.281066 22526 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 9.
I20260709 12:11:20.281320 26357 raft_consensus.cc:2749] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:20.281258 26562 consensus_queue.cc:260] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:20.282212 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:20.282723 26562 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:20.282827 23121 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 10.
I20260709 12:11:20.284016 23119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 977) took 3336 ms. Trace:
I20260709 12:11:20.284355 23119 rpcz_store.cc:276] 0709 12:11:16.941929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.194597 (+252668us) service_pool.cc:224] Handling call
0709 12:11:17.194864 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:17.195088 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:11:17.232444 (+ 37356us) log.cc:844] Serialized 14 byte log entry
0709 12:11:17.982059 (+749615us) spinlock_profiling.cc:243] Waited 5.33 ms on lock 0x7b1800432b80. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc7823e07 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc7840c02 00007f9cca4c820b 00007f9cca4cdd23 00007f9cca4ce23a 00007f9cca938a2a
0709 12:11:19.716477 (+1734418us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b1800432b80. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc7823e07 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc783e455 00007f9cce3263c7 00007f9cca9389a7 00007f9cca9480bf 00007f9cca948038
0709 12:11:19.901257 (+184780us) log.cc:844] Serialized 14 byte log entry
0709 12:11:20.208173 (+306916us) log.cc:844] Serialized 14 byte log entry
0709 12:11:20.224414 (+ 16241us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:20.240029 (+ 15615us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:20.252519 (+ 12490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.269230 (+ 16711us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:20.277867 (+  8637us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6611,"prepare.queue_time_us":470566,"prepare.run_cpu_time_us":143,"prepare.run_wall_time_us":9666,"raft.queue_time_us":6348,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":9142,"spinlock_wait_cycles":15649536,"thread_start_us":753880,"threads_started":3,"wal-append.queue_time_us":1215698,"wal-append.run_cpu_time_us":4862,"wal-append.run_wall_time_us":1171156}
W20260709 12:11:20.287082 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 149687us
I20260709 12:11:20.289598 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:20.273509 22525 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 9.
I20260709 12:11:20.290251 22602 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
W20260709 12:11:20.291191 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.289430 22523 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 9.
I20260709 12:11:20.245610 26444 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:20.304185 22456 raft_consensus.cc:1275] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:11:20.289994 26439 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:20.307960 22569 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:20.308871 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:20.294425 26289 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:20.312556 22530 raft_consensus.cc:2393] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 9: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:20.315182 22450 raft_consensus.cc:2368] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 8. Current term is 9.
I20260709 12:11:20.279424 26427 consensus_queue.cc:1059] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:11:20.322424 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:20.323935 26579 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.325659 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:20.332465 22605 raft_consensus.cc:2393] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 9: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:20.325973 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:20.326684 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:20.326772 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:20.295217 25628 consensus_queue.cc:1048] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.184s
I20260709 12:11:20.328485 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:20.328873 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:20.329344 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:20.333652 22603 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 8.
I20260709 12:11:20.327574 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:20.342749 22606 raft_consensus.cc:2368] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 7. Current term is 9.
I20260709 12:11:20.294909 26377 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:20.339522 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:20.354377 22599 raft_consensus.cc:1240] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 LEADER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:20.355654 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:20.356437 22604 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 12.
I20260709 12:11:20.299245 26433 consensus_queue.cc:1059] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:11:20.363559 22603 raft_consensus.cc:1240] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:20.363790 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:20.366755 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 60917.1us
I20260709 12:11:20.315368 26512 consensus_queue.cc:1059] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:11:20.309085 26500 consensus_queue.cc:1048] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:11:20.335187 26289 raft_consensus.cc:697] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:20.355261 26579 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:20.389072 22456 raft_consensus.cc:1275] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:20.393347 22597 raft_consensus.cc:2376] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 10. Re-sending same reply.
I20260709 12:11:20.386026 25675 raft_consensus.cc:2804] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:20.383249 26587 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:20.411461 26580 log.cc:927] Time spent T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:11:20.411625 26588 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.412210 26588 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:20.415969 26377 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:20.416371 26579 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:20.405460 22570 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:20.423156 22531 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 8.
I20260709 12:11:20.432005 22456 raft_consensus.cc:1275] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:11:20.438207 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.473004 26588 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:20.478359 24970 raft_consensus.cc:3055] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:20.478839 24970 raft_consensus.cc:740] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:20.479876 24970 consensus_queue.cc:260] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:20.481251 24970 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:20.490506 26588 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:20.491180 26588 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:20.493573 26588 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:20.418617 26495 consensus_queue.cc:237] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:20.498348 26588 consensus_queue.cc:1059] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:20.499688 26126 raft_consensus.cc:3055] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:20.500142 26126 raft_consensus.cc:740] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
W20260709 12:11:20.501511 26585 log.cc:927] Time spent T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:11:20.501210 26126 consensus_queue.cc:260] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:20.503281 26126 raft_consensus.cc:3060] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:20.507620 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 110718us
I20260709 12:11:20.512732 26543 raft_consensus.cc:2749] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:20.515115 26543 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.515762 26543 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:20.517813 26289 consensus_queue.cc:237] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:20.518707 26377 consensus_queue.cc:1059] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:20.519251 26543 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:20.520426 26377 raft_consensus.cc:3055] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:20.520824 26377 raft_consensus.cc:740] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:20.521649 26377 consensus_queue.cc:260] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:20.524477 26473 consensus_meta.cc:287] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.578s	user 0.010s	sys 0.002s
I20260709 12:11:20.525106 22602 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 9.
W20260709 12:11:20.530791 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.531512 26444 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:20.467291 26587 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:20.537536 26587 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:20.427194 25675 raft_consensus.cc:697] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:20.522775 26377 raft_consensus.cc:3060] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:20.548321 23088 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:20.552821 22528 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 8.
W20260709 12:11:20.569051 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.571623 22597 raft_consensus.cc:1275] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:20.571643 22603 raft_consensus.cc:1275] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:11:20.572992 26411 consensus_queue.cc:1059] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:20.573982 26411 raft_consensus.cc:3055] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:20.574290 26411 raft_consensus.cc:740] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:20.575176 26411 consensus_queue.cc:260] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:20.576125 26411 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:20.584242 26412 consensus_queue.cc:1048] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:20.586134 26412 consensus_queue.cc:1048] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:11:20.592440 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 77719.5us
W20260709 12:11:20.609722 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:20.662700 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.655939 26587 raft_consensus.cc:2804] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:11:20.671027 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 75621.2us
I20260709 12:11:20.595479 26484 consensus_queue.cc:260] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:20.690469 23089 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:20.670215 26579 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.692348 22495 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:20.707106 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.673622 26357 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:20.715591 23089 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:20.686045 26587 raft_consensus.cc:697] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 10 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:20.726488 22495 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:20.727455 26596 raft_consensus.cc:2749] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:20.728894 26443 raft_consensus.cc:3055] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:20.729399 26443 raft_consensus.cc:740] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
W20260709 12:11:20.733158 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 457061us
I20260709 12:11:20.734230 26590 raft_consensus.cc:2749] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:20.735147 22421 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:20.739970 23089 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:20.720628 26484 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:20.747352 26599 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:20.749657 22495 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:20.750533 26596 consensus_queue.cc:1048] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:20.782786 26596 raft_consensus.cc:2749] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:20.784663 22495 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:20.787014 26596 raft_consensus.cc:2749] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:20.789580 22495 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:20.790619 26596 raft_consensus.cc:2749] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:20.792815 26439 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:20.794189 22451 raft_consensus.cc:1240] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:20.742482 26357 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:20.755075 26472 consensus_queue.cc:1059] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:20.756013 26446 raft_consensus.cc:2749] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:20.756888 26415 raft_consensus.cc:2804] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:11:20.759500 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.764313 26437 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:20.765841 26582 log.cc:927] Time spent T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.262s	user 0.002s	sys 0.000s
I20260709 12:11:20.766440 26590 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:20.767604 26587 consensus_queue.cc:237] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:20.768591 26032 consensus_queue.cc:1059] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:20.771725 23087 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:20.773751 26581 log.cc:927] Time spent T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.446s	user 0.001s	sys 0.001s
I20260709 12:11:20.772559 23089 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:11:20.779084 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.730576 26443 consensus_queue.cc:260] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:20.713436 26579 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:20.699752 25675 consensus_queue.cc:237] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:20.801288 22495 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:20.723526 26126 raft_consensus.cc:2764] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 12:11:20.807945 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:20.809855 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:20.810322 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.815413 23089 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:20.802410 26415 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:20.815312 26414 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:20.844628 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 166849us
I20260709 12:11:20.890623 23087 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:20.897924 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:20.898689 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.898007 23120 raft_consensus.cc:1275] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:11:20.904417 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 95046.5us
I20260709 12:11:20.906438 23089 leader_election.cc:400] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 7. Current term is 9.
I20260709 12:11:20.906819 23089 leader_election.cc:403] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:20.907433 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:20.909920 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 108720us
I20260709 12:11:20.910593 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:20.910691 22495 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:20.838032 26415 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:20.905351 26582 log.cc:927] Time spent T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:11:20.835160 26593 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:20.914294 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:20.919611 22604 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 10.
W20260709 12:11:20.911337 26581 log.cc:927] Time spent T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:11:20.911067 26596 raft_consensus.cc:2749] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:20.914933 26443 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:20.929981 22495 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:20.945669 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.914218 26537 raft_consensus.cc:2749] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:20.918895 26126 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.931334 23089 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:11:20.932425 26600 log.cc:927] Time spent T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:11:20.932706 26592 raft_consensus.cc:2749] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:20.933235 26601 log.cc:927] Time spent T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:11:20.943019 26595 raft_consensus.cc:2804] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:20.919284 26593 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:20.957594 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:20.904206 26414 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:20.955219 26412 raft_consensus.cc:2749] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:11:20.968237 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:20.968504 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 233450us
I20260709 12:11:20.968559 22599 raft_consensus.cc:1275] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:11:20.971014 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 697381us
I20260709 12:11:20.964913 26593 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:20.965327 26537 raft_consensus.cc:2749] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:20.978096 22421 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:20.960793 26126 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:21.006515 22422 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:21.026346 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:21.031919 26596 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.982530 26439 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:21.032560 22422 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:20.995699 26412 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.025409 26431 raft_consensus.cc:2804] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:21.037374 26596 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:21.049467 26439 consensus_queue.cc:1059] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:21.049612 22422 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:21.050156 26431 raft_consensus.cc:697] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 10 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:21.051169 26431 consensus_queue.cc:237] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:21.054155 23088 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:21.032306 26177 raft_consensus.cc:2749] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:21.059748 26177 raft_consensus.cc:2804] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:21.060204 26177 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.060577 26177 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:21.061182 26588 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:21.061686 26588 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:21.062131 26588 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:21.067150 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:21.067276 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 89367.8us
W20260709 12:11:21.023617 26495 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.016s	sys 0.018s
I20260709 12:11:20.995940 26444 consensus_queue.cc:1048] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:11:21.070948 26541 consensus_queue.cc:1048] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.115s
I20260709 12:11:21.077190 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:21.088127 22604 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:21.042210 26411 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.063167 26561 consensus_queue.cc:1059] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:11:21.083364 22603 raft_consensus.cc:1275] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:21.090050 22602 raft_consensus.cc:2393] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 11: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:21.044137 26537 raft_consensus.cc:3060] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:21.044896 26472 raft_consensus.cc:2749] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.096154 26472 consensus_queue.cc:1048] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:21.102875 26126 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:21.109627 26415 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:21.094337 26596 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:21.095029 26609 consensus_queue.cc:1048] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:11:21.090579 26495 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.016s	sys 0.018s
W20260709 12:11:21.115345 26594 log.cc:927] Time spent T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 12:11:21.086010 26357 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:21.145756 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 214491us
I20260709 12:11:21.092515 22421 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
W20260709 12:11:21.125392 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 234885us
W20260709 12:11:21.127424 26377 consensus_meta.cc:287] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.535s	user 0.011s	sys 0.000s
W20260709 12:11:21.123960 26548 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.796s	user 0.011s	sys 0.021s
I20260709 12:11:21.164506 26357 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:21.119567 22600 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 11.
I20260709 12:11:21.157152 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:21.070266 26412 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:21.139104 26437 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.165376 22450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2419) took 1209 ms. Trace:
I20260709 12:11:21.125293 26411 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:21.166245 22495 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:21.170099 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:21.170718 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:21.168370 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:21.172026 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:21.160605 26444 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.177567 22604 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 9.
W20260709 12:11:21.225464 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:21.224134 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 58034.2us
I20260709 12:11:21.222995 22532 raft_consensus.cc:2376] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 8. Re-sending same reply.
I20260709 12:11:21.168354 26615 raft_consensus.cc:2749] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:21.202491 22450 rpcz_store.cc:276] 0709 12:11:19.953160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.960917 (+  7757us) service_pool.cc:224] Handling call
0709 12:11:21.152205 (+1191288us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b54003f3ed4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:21.162786 (+ 10581us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":811361536}
W20260709 12:11:21.183315 26548 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.855s	user 0.011s	sys 0.021s
I20260709 12:11:21.239837 22528 raft_consensus.cc:2393] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 10: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:21.228852 26484 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.222007 26414 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:21.246307 22527 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 10.
I20260709 12:11:21.242429 26484 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:21.221128 26377 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:21.257817 23123 raft_consensus.cc:1275] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:21.238914 26177 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:21.242838 26357 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:21.244724 26588 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:21.251202 26431 raft_consensus.cc:2749] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.255290 22531 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 10.
I20260709 12:11:21.262993 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:21.257782 23089 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:21.257990 23125 raft_consensus.cc:1275] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:11:21.264261 23125 pending_rounds.cc:85] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270: Aborting all ops after (but not including) 7
I20260709 12:11:21.258522 23117 raft_consensus.cc:1275] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:21.234207 26596 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:11:21.242736 26605 log.cc:927] Time spent T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 12:11:21.262518 22454 raft_consensus.cc:1240] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 11 LEADER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:21.266579 23119 raft_consensus.cc:1275] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:21.223403 26437 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:21.268918 23121 raft_consensus.cc:1275] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:11:21.264576 23125 pending_rounds.cc:107] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:11:21.269475 23116 raft_consensus.cc:1275] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:21.273732 23125 raft_consensus.cc:2889] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:21.236199 26443 consensus_queue.cc:1048] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:11:21.279103 22455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2423) took 1092 ms. Trace:
I20260709 12:11:21.240353 26444 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:21.279515 22455 rpcz_store.cc:276] 0709 12:11:20.180239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.180375 (+   136us) service_pool.cc:224] Handling call
0709 12:11:20.183673 (+  3298us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:20.223302 (+ 39629us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:20.223350 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:20.296227 (+ 72877us) log.cc:844] Serialized 52 byte log entry
0709 12:11:20.706773 (+410546us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:20.970232 (+263459us) log.cc:844] Serialized 14 byte log entry
0709 12:11:20.970575 (+   343us) log.cc:844] Serialized 14 byte log entry
0709 12:11:20.970774 (+   199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.970840 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:21.272453 (+301613us) raft_consensus.cc:1685] finished
0709 12:11:21.272482 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:21.272634 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8693,"prepare.queue_time_us":468303,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":56,"raft.queue_time_us":35156,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":20170,"spinlock_wait_cycles":7308288,"thread_start_us":623426,"threads_started":2,"wal-append.queue_time_us":502806}
I20260709 12:11:21.263398 26618 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.310593 23122 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
W20260709 12:11:21.315104 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.278635 26590 raft_consensus.cc:2749] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:21.318676 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 264574us
I20260709 12:11:21.274399 26595 raft_consensus.cc:697] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:21.274838 26472 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:21.307004 26615 raft_consensus.cc:2764] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:11:21.264092 26619 consensus_queue.cc:1048] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
W20260709 12:11:21.323689 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:21.324851 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 67131.4us
I20260709 12:11:21.326865 23088 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:11:21.334018 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 241597us
I20260709 12:11:21.334867 22421 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:21.273977 26377 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:21.339919 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:21.342303 22532 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:21.340564 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:21.342973 22450 raft_consensus.cc:2468] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
I20260709 12:11:21.317497 26411 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:21.325598 26289 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.805s	user 0.004s	sys 0.017s
I20260709 12:11:21.346755 22605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2656) took 1009 ms. Trace:
I20260709 12:11:21.350917 22527 raft_consensus.cc:1240] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:21.350931 22531 raft_consensus.cc:1240] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:21.350800 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.332441 26415 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:21.354620 22523 raft_consensus.cc:1240] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 LEADER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:21.355038 22422 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:21.356760 22456 raft_consensus.cc:1275] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:21.335323 26596 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:11:21.463331 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 136568us
W20260709 12:11:21.348295 26289 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.004s	sys 0.017s
I20260709 12:11:21.336664 26472 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:21.337041 26414 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:21.351502 26604 log.cc:927] Time spent T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.205s	user 0.001s	sys 0.001s
I20260709 12:11:21.348356 26593 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:21.383455 26607 log.cc:927] Time spent T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260709 12:11:21.480935 22457 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2426) took 1268 ms. Trace:
I20260709 12:11:21.385399 26326 raft_consensus.cc:2749] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 11 LEADER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:21.481810 26595 consensus_queue.cc:237] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:21.482251 26472 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:21.481375 22457 rpcz_store.cc:276] 0709 12:11:20.224282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.238612 (+ 14330us) service_pool.cc:224] Handling call
0709 12:11:20.238962 (+   350us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:20.731605 (+492643us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:20.731650 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:20.732403 (+   753us) log.cc:844] Serialized 52 byte log entry
0709 12:11:20.983569 (+251166us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:21.261730 (+278161us) log.cc:844] Serialized 14 byte log entry
0709 12:11:21.270520 (+  8790us) log.cc:844] Serialized 14 byte log entry
0709 12:11:21.317002 (+ 46482us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.317096 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:21.480708 (+163612us) raft_consensus.cc:1685] finished
0709 12:11:21.480730 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:21.480873 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":551970,"prepare.queue_time_us":92157,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":2840,"raft.queue_time_us":523450,"raft.run_cpu_time_us":401,"raft.run_wall_time_us":12467,"thread_start_us":499214,"threads_started":2,"wal-append.queue_time_us":406682}
W20260709 12:11:21.483290 26617 log.cc:927] Time spent T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.229s	user 0.003s	sys 0.002s
I20260709 12:11:21.483431 26437 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:21.484187 22457 raft_consensus.cc:1240] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:21.484427 26579 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:21.485457 26579 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.485880 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:21.486236 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:21.486368 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:21.486815 23116 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:21.486970 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:21.487185 26587 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:21.487473 23118 raft_consensus.cc:1240] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:21.487871 26587 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:21.490021 26587 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:21.490314 23119 raft_consensus.cc:1240] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:21.491070 23125 raft_consensus.cc:1275] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:11:21.491304 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:21.492022 22529 raft_consensus.cc:1240] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:21.472905 26613 log.cc:927] Time spent T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.291s	user 0.000s	sys 0.005s
I20260709 12:11:21.495275 26357 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:11:21.496222 26627 log.cc:927] Time spent T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.142s	user 0.004s	sys 0.000s
W20260709 12:11:21.473112 26625 log.cc:927] Time spent T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.089s	user 0.003s	sys 0.001s
I20260709 12:11:21.500396 23122 raft_consensus.cc:1240] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:21.502013 23123 raft_consensus.cc:1275] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:21.318426 26618 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:21.514372 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 159437us
I20260709 12:11:21.347146 22605 rpcz_store.cc:276] 0709 12:11:20.337543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.342478 (+  4935us) service_pool.cc:224] Handling call
0709 12:11:20.368154 (+ 25676us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:20.600962 (+232808us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:20.641158 (+ 40196us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:20.665917 (+ 24759us) log.cc:844] Serialized 26 byte log entry
0709 12:11:20.966470 (+300553us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:20.966529 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.966619 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:21.346542 (+379923us) raft_consensus.cc:1685] finished
0709 12:11:21.346569 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:21.346698 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4615,"raft.queue_time_us":30209,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":8349,"thread_start_us":488960,"threads_started":2,"wal-append.queue_time_us":396573}
I20260709 12:11:21.515108 23117 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
W20260709 12:11:21.435375 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.517838 23088 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:11:21.521361 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.370901 26590 raft_consensus.cc:2749] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:21.348351 26609 raft_consensus.cc:2804] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:21.384960 22452 raft_consensus.cc:1240] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 10 LEADER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:11:21.458563 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:11:21.460773 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 103242us
I20260709 12:11:21.467883 22532 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11.
W20260709 12:11:21.525790 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.474102 26414 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:21.475258 26177 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:21.458529 26074 raft_consensus.cc:3055] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:21.506915 22449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2428) took 1263 ms. Trace:
I20260709 12:11:21.531608 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:21.532481 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:21.532815 26074 raft_consensus.cc:740] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:21.533061 22603 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:21.533739 26414 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:21.533712 26074 consensus_queue.cc:260] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:21.535137 26587 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:21.535712 26587 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:21.536633 26593 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:21.537599 26587 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:21.538576 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:21.538841 26074 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:21.539295 22531 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
I20260709 12:11:21.540271 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:21.541512 22603 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 10.
I20260709 12:11:21.542007 22598 raft_consensus.cc:1275] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:11:21.542624 22598 pending_rounds.cc:85] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc: Aborting all ops after (but not including) 5
I20260709 12:11:21.543129 22598 pending_rounds.cc:107] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:11:21.543398 22598 raft_consensus.cc:2889] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:21.531093 22449 rpcz_store.cc:276] 0709 12:11:20.243557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.243695 (+   138us) service_pool.cc:224] Handling call
0709 12:11:20.272594 (+ 28899us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:20.969574 (+696980us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:20.969617 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:20.979999 (+ 10382us) log.cc:844] Serialized 26 byte log entry
0709 12:11:21.178158 (+198159us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:21.236489 (+ 58331us) log.cc:844] Serialized 14 byte log entry
0709 12:11:21.236670 (+   181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.236750 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:21.506664 (+269914us) raft_consensus.cc:1685] finished
0709 12:11:21.506690 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:21.506847 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":442082,"prepare.queue_time_us":60593,"prepare.run_wall_time_us":34,"raft.queue_time_us":487674,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":4285,"spinlock_wait_cycles":6376832,"thread_start_us":374122,"threads_started":2,"wal-append.queue_time_us":299243}
I20260709 12:11:21.545548 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:21.551527 23118 raft_consensus.cc:1240] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:21.510293 23116 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11.
W20260709 12:11:21.495081 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.514369 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:21.462893 25628 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.555256 26484 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:21.527817 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:21.555342 25628 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:21.568174 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.568094 26377 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:21.569382 26444 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:21.528412 26431 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:21.570809 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:21.572484 26599 consensus_meta.cc:287] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.792s	user 0.011s	sys 0.003s
I20260709 12:11:21.572983 26599 raft_consensus.cc:2749] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.576313 26537 raft_consensus.cc:2749] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 7. Current term is 9.
I20260709 12:11:21.577692 26357 raft_consensus.cc:2764] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:11:21.578156 22526 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
I20260709 12:11:21.580613 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:21.582062 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:21.593523 26548 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.594151 26548 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:21.596556 26548 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:21.597731 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 69574.8us
W20260709 12:11:21.598687 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 66655.8us
I20260709 12:11:21.599292 22422 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:21.599736 22452 raft_consensus.cc:1275] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:21.600025 22421 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:21.523630 26596 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:21.601397 22421 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:21.601970 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:21.603133 22525 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:21.603538 26618 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:21.603546 22605 raft_consensus.cc:1275] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:21.604801 26415 consensus_queue.cc:1048] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:11:21.605269 22527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:56942
I20260709 12:11:21.605978 22527 raft_consensus.cc:476] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Not starting forced leader election -- already a leader
I20260709 12:11:21.613911 22523 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
I20260709 12:11:21.618697 22449 raft_consensus.cc:1275] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 12:11:21.618851 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 92682.2us
I20260709 12:11:21.621490 23121 raft_consensus.cc:2468] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
I20260709 12:11:21.606882 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:21.629297 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:21.522626 26412 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:21.630388 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:21.632520 22527 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 10.
I20260709 12:11:21.528753 26609 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:21.626972 26501 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.642581 26501 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:21.644302 26583 log.cc:927] Time spent T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 1.140s	user 0.001s	sys 0.003s
I20260709 12:11:21.622481 26074 raft_consensus.cc:2804] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:21.626602 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:21.641817 26414 consensus_queue.cc:1048] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:21.634585 26630 consensus_queue.cc:1048] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:21.656270 22496 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:21.642557 26417 consensus_queue.cc:1048] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:21.646047 26609 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:21.485916 26579 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:21.645138 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:21.622552 26588 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:21.653075 26439 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.683166 22525 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11.
I20260709 12:11:21.688151 26437 consensus_queue.cc:1048] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:21.711253 26439 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:21.712574 22452 raft_consensus.cc:2393] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 12: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:21.713696 26439 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:21.713898 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:21.660519 26289 consensus_queue.cc:1048] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:11:21.689016 22570 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:21.652822 26484 consensus_queue.cc:1048] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:11:21.695151 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:21.667519 26074 raft_consensus.cc:697] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:21.680210 26443 raft_consensus.cc:2804] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:21.681418 26626 consensus_queue.cc:1048] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:11:21.680063 26495 consensus_queue.cc:1048] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
W20260709 12:11:21.701442 26628 log.cc:927] Time spent T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
W20260709 12:11:21.702198 26623 log.cc:927] Time spent T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.137s	user 0.000s	sys 0.004s
I20260709 12:11:21.704190 26579 leader_election.cc:290] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:21.705489 22528 raft_consensus.cc:1240] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 9. Current term is 10. Ops: [7.5-9.6]
W20260709 12:11:21.708069 26614 log.cc:927] Time spent T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.241s	user 0.000s	sys 0.004s
I20260709 12:11:21.708633 22603 raft_consensus.cc:1240] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:21.710915 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.651094 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:21.764420 22529 raft_consensus.cc:1275] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:21.747720 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:21.752044 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:11:21.765537 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.765808 23123 raft_consensus.cc:2410] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:11:21.752622 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:21.765451 23117 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
I20260709 12:11:21.668656 26412 consensus_queue.cc:1048] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:11:21.766487 23122 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
I20260709 12:11:21.740804 26443 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.740517 26289 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.747864 26437 raft_consensus.cc:2804] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:21.751905 26629 raft_consensus.cc:2804] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:21.772017 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:21.776047 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:21.776719 22603 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 12.
I20260709 12:11:21.776862 22529 raft_consensus.cc:1275] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:11:21.771572 26443 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:21.778154 22529 raft_consensus.cc:1275] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:21.779331 26074 consensus_queue.cc:237] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:21.782812 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:21.783429 23117 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 10.
I20260709 12:11:21.783245 26439 consensus_queue.cc:1059] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:21.786227 22523 raft_consensus.cc:1275] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:21.788087 26484 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.788630 22451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2430) took 1495 ms. Trace:
I20260709 12:11:21.788582 26484 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:21.789062 22451 rpcz_store.cc:276] 0709 12:11:20.293035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.293171 (+   136us) service_pool.cc:224] Handling call
0709 12:11:20.305885 (+ 12714us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:20.794636 (+488751us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.788410 (+993774us) spinlock_profiling.cc:243] Waited 488 ms on lock 0x7b54002a5b54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:21.788574 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1122484608}
I20260709 12:11:21.790290 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:21.774586 22496 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:21.790566 26443 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:21.794704 26443 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:21.796180 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:21.799444 22448 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 8.
I20260709 12:11:21.800621 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:21.767385 25675 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:21.801505 25675 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:21.801999 25628 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:21.802211 26443 raft_consensus.cc:2804] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:21.802860 26443 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.803596 25675 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:21.803906 26443 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:21.804407 26289 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:21.807525 26289 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:21.808917 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:21.809458 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:21.810473 22529 raft_consensus.cc:1275] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:21.810750 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:21.811769 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:21.812731 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:21.801518 22448 raft_consensus.cc:2393] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 12: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:21.817365 23087 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:21.818800 23087 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:21.819721 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:21.791311 22422 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:21.821995 22495 leader_election.cc:400] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 8. Current term is 9.
I20260709 12:11:21.823225 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:21.823897 22529 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:21.823961 23087 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:21.825384 23089 leader_election.cc:336] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Timed out: RequestConsensusVote RPC to 127.20.196.131:37785 timed out after 1.838s (SENT)
I20260709 12:11:21.826159 23087 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:21.827832 26472 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:21.827997 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:21.828337 26472 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:21.829586 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:21.830319 26472 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:21.836927 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 65694.6us
I20260709 12:11:21.830381 22455 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 9.
I20260709 12:11:21.844404 23089 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:21.850879 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:21.770262 26431 raft_consensus.cc:697] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:21.790699 26484 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:21.791571 26437 raft_consensus.cc:697] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:21.854736 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:21.855074 22523 raft_consensus.cc:1275] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:21.862931 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:21.863898 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:21.822765 26289 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:21.865412 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:21.876906 22421 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:21.855674 22495 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:21.824442 26126 raft_consensus.cc:2749] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.825270 26579 raft_consensus.cc:2749] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.883765 22421 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:21.874868 22448 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
I20260709 12:11:21.875221 22601 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 9.
I20260709 12:11:21.855360 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:21.849710 26444 raft_consensus.cc:2804] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:21.850062 26032 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:21.849723 26592 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:21.876641 26590 raft_consensus.cc:2749] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:21.885914 22455 raft_consensus.cc:1275] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:11:21.850226 26501 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:21.889098 22450 raft_consensus.cc:1275] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:21.854619 26624 raft_consensus.cc:2749] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.885694 22453 raft_consensus.cc:1240] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:21.893502 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:21.897998 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:21.903378 22601 raft_consensus.cc:1240] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:21.906867 22523 raft_consensus.cc:2393] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 7: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:21.907434 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:21.892021 26412 raft_consensus.cc:2804] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:21.890993 26032 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.897486 22495 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:21.885149 26548 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.909466 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:11:21.911882 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 96743.7us
I20260709 12:11:21.911931 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:21.912716 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:21.905463 22421 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:21.917441 22421 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:21.914830 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:21.918550 22531 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:21.894601 26642 raft_consensus.cc:2749] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:21.901953 26472 raft_consensus.cc:2804] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:21.884369 26289 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:21.939402 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:21.940168 22523 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 8.
I20260709 12:11:21.940780 26289 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:21.941219 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:21.941485 23087 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:21.942126 22523 raft_consensus.cc:2393] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 9: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:21.942273 26579 raft_consensus.cc:2804] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:21.942719 26579 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:21.942884 23087 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:21.943176 26579 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:21.944320 23087 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:21.945070 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:21.945370 23087 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:21.945104 26537 raft_consensus.cc:2749] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.948105 22421 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:21.895527 26484 consensus_queue.cc:1059] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:11:21.926667 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:21.892810 26414 consensus_queue.cc:1059] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:11:21.911370 26412 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.932723 26437 consensus_queue.cc:237] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:21.934065 23120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 853) took 1266 ms. Trace:
I20260709 12:11:21.936053 26629 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:21.961856 26629 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:21.948961 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.971727 22603 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 12.
I20260709 12:11:21.949303 22531 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 8.
I20260709 12:11:21.950330 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:21.974380 22523 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 12.
I20260709 12:11:21.950574 23087 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:21.957770 22599 raft_consensus.cc:1275] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:21.958033 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:21.919653 26032 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:21.904202 26618 consensus_queue.cc:1048] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:11:21.960506 26326 raft_consensus.cc:2804] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:21.924569 26548 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:21.932287 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:21.960484 23120 rpcz_store.cc:276] 0709 12:11:20.668555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.668689 (+   134us) service_pool.cc:224] Handling call
0709 12:11:20.677565 (+  8876us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:20.899368 (+221803us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.933853 (+1034485us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b54006dfbd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:21.934007 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":484043008}
I20260709 12:11:21.947250 26425 raft_consensus.cc:2749] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:21.908136 26355 consensus_queue.cc:1048] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 12:11:21.951632 26615 raft_consensus.cc:2749] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:22.004914 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 107503us
W20260709 12:11:22.014034 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 76097.7us
I20260709 12:11:21.960565 26412 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:22.043227 26537 raft_consensus.cc:2804] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:22.044502 26537 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:22.045061 26537 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:22.045392 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:22.046516 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:22.047899 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:22.048465 23117 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:22.051028 26643 log.cc:927] Time spent T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.272s	user 0.000s	sys 0.001s
I20260709 12:11:22.053781 26032 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:22.042762 22529 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 10.
I20260709 12:11:21.955893 26074 raft_consensus.cc:2804] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:22.022957 23121 raft_consensus.cc:2468] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 7.
I20260709 12:11:22.056082 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:22.025014 22421 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:21.972378 26289 raft_consensus.cc:2804] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:22.031605 26636 log.cc:927] Time spent T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:11:22.032666 26446 raft_consensus.cc:3055] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:22.039966 22530 raft_consensus.cc:1240] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:22.040103 22528 raft_consensus.cc:1275] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:11:22.024271 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 155625us
W20260709 12:11:22.056571 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.027215 26126 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.057056 23118 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 12.
I20260709 12:11:22.094812 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:22.099515 22570 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:22.092381 22523 raft_consensus.cc:1240] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:22.092712 23117 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 12.
I20260709 12:11:22.092947 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:22.024004 26326 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.021409 26590 raft_consensus.cc:2749] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:22.109753 26579 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:22.108052 26032 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:22.099754 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 127854us
I20260709 12:11:22.108155 26417 consensus_queue.cc:1048] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:21.955086 26431 consensus_queue.cc:237] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:22.094480 26446 raft_consensus.cc:740] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:22.127321 26326 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:22.057588 22605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:60938
W20260709 12:11:22.111593 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 55995us
I20260709 12:11:22.121424 23124 raft_consensus.cc:1275] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:22.139678 22605 raft_consensus.cc:606] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
W20260709 12:11:22.122933 26648 log.cc:927] Time spent T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:11:22.109776 22570 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
W20260709 12:11:22.124228 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.123167 26427 raft_consensus.cc:3055] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:22.096235 26425 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:22.093585 26074 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:22.064043 26652 consensus_queue.cc:1048] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 12:11:22.101723 26126 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:22.123629 25675 raft_consensus.cc:2804] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:22.135957 23117 raft_consensus.cc:1275] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:22.065889 26289 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.148864 26289 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:22.149374 26653 log.cc:927] Time spent T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 12:11:22.151049 26586 log.cc:927] Time spent T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 1.664s	user 0.010s	sys 0.016s
I20260709 12:11:22.140079 22605 raft_consensus.cc:614] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:22.154254 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:22.155011 23120 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:22.136883 26661 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:11:22.168980 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 59268.1us
I20260709 12:11:22.165514 26412 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:22.174968 26412 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:22.175720 26667 consensus_queue.cc:1059] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:11:22.158619 26590 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.177515 26590 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:22.182125 26590 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:22.182674 26661 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:22.143748 26427 raft_consensus.cc:740] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:22.145720 26425 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.146008 26074 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:22.186221 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 47657.9us
I20260709 12:11:22.185578 22601 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 10.
W20260709 12:11:22.192305 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 45526.8us
I20260709 12:11:22.171346 22570 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:22.192359 23120 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 13.
I20260709 12:11:22.212312 22529 raft_consensus.cc:1240] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:22.218101 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 189448us
I20260709 12:11:22.196434 26425 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:22.165311 26619 consensus_queue.cc:1048] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:11:22.153746 26443 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:22.242245 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:22.245312 26672 raft_consensus.cc:2749] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:22.233510 26326 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:22.247974 26326 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:22.248109 22605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:11:22.248673 22605 raft_consensus.cc:606] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:11:22.249339 26629 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:22.253226 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:22.234329 26671 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:22.264596 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 93332.9us
I20260709 12:11:22.265854 22601 raft_consensus.cc:1240] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:22.235323 26661 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:22.213732 26446 consensus_queue.cc:260] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:22.284755 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:22.293335 22602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74d6480c61e542d583f6f89899989553"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:11:22.293989 22602 raft_consensus.cc:606] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Received request to transfer leadership to TS 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:22.289657 22598 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
I20260709 12:11:22.296231 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:22.298355 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:22.299364 22598 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
I20260709 12:11:22.300566 22601 raft_consensus.cc:2410] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:11:22.302380 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:22.303315 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:22.307869 26680 raft_consensus.cc:2804] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:22.308524 26680 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:22.308965 26680 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:22.309579 26444 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:22.310082 26444 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:22.303821 22598 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 10.
I20260709 12:11:22.296092 25675 raft_consensus.cc:697] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:22.295244 26579 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:11:22.329995 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 54235.1us
I20260709 12:11:22.332297 22601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:11:22.332738 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:22.333102 22601 raft_consensus.cc:606] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:11:22.304136 26446 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:22.244168 26427 consensus_queue.cc:260] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:22.332623 26609 consensus_meta.cc:287] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.615s	user 0.008s	sys 0.003s
I20260709 12:11:22.316187 26629 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:22.353314 22601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:11:22.355254 22601 raft_consensus.cc:606] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:11:22.355557 22601 raft_consensus.cc:614] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:11:22.356107 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 163977us
I20260709 12:11:22.356873 22569 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:22.283391 26671 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:22.363162 22605 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
I20260709 12:11:22.352491 26537 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:22.365252 26472 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:22.365682 26472 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:22.368898 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:22.372124 26610 raft_consensus.cc:3055] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:22.372582 26610 raft_consensus.cc:740] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:22.372649 26495 consensus_queue.cc:1059] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:22.373659 26619 raft_consensus.cc:3055] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:22.373490 26610 consensus_queue.cc:260] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:22.374022 26619 raft_consensus.cc:740] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:22.374922 22497 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
W20260709 12:11:22.351641 26670 log.cc:927] Time spent T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:11:22.389053 26689 consensus_queue.cc:1048] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:22.390961 26689 consensus_queue.cc:1048] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:22.345309 26126 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:22.397766 26596 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:22.398500 22497 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:22.409878 26443 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:22.377259 26537 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:22.357668 25675 consensus_queue.cc:237] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:22.360441 26671 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:22.344247 26684 consensus_queue.cc:1048] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 12:11:22.372113 26074 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:22.407226 26610 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:22.344439 26609 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:22.431793 26537 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:22.421972 26289 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:22.451646 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 76015.9us
I20260709 12:11:22.454949 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:22.447248 26414 raft_consensus.cc:2804] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:22.459869 22525 raft_consensus.cc:1275] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:11:22.458735 22600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43070 (request call id 625) took 2129 ms (client timeout 1838 ms). Trace:
I20260709 12:11:22.461694 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:22.461315 22454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1897) took 2280 ms. Trace:
I20260709 12:11:22.463686 22454 rpcz_store.cc:276] 0709 12:11:20.178674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.195082 (+ 16408us) service_pool.cc:224] Handling call
0709 12:11:20.212790 (+ 17708us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:21.266648 (+1053858us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.458653 (+1192005us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400240c54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:22.458848 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2413609728}
W20260709 12:11:22.461752 22600 rpcz_store.cc:269] 0709 12:11:20.324917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.328168 (+  3251us) service_pool.cc:224] Handling call
0709 12:11:22.454184 (+2126016us) spinlock_profiling.cc:243] Waited 772 ms on lock 0x7b54000e9054. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:22.454289 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1775268608}
I20260709 12:11:22.465354 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:22.466305 22529 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
I20260709 12:11:22.432739 26619 consensus_queue.cc:260] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:22.467808 26619 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:22.461301 26444 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:22.469816 26444 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:22.471294 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:22.472203 22532 raft_consensus.cc:2393] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 10: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:22.472796 26663 raft_consensus.cc:3055] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:22.473299 26663 raft_consensus.cc:740] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:22.479678 26680 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:22.481117 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:22.481805 26680 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:22.482213 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:22.482785 23120 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
I20260709 12:11:22.460348 26414 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.483289 26414 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:22.483497 26592 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:22.483580 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:22.484472 22604 raft_consensus.cc:2393] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 11: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:22.484077 26592 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:22.472817 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:22.486253 26592 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:11:22.486754 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:22.487562 26679 log.cc:927] Time spent T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:11:22.489910 22524 raft_consensus.cc:2393] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 12: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:22.491226 22527 raft_consensus.cc:1240] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:11:22.495581 22497 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:22.502560 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:22.503183 22529 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:22.503358 26685 raft_consensus.cc:2804] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:22.503818 26685 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.504141 26685 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:22.501482 26472 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:22.507853 26681 log.cc:927] Time spent T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:11:22.508486 26472 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:22.509239 26677 log.cc:927] Time spent T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 12:11:22.510875 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:22.511160 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.511060 22449 raft_consensus.cc:1240] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 LEADER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:22.498833 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:22.511477 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:22.523149 22457 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:22.453806 26537 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:22.520751 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:22.516738 22529 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11.
I20260709 12:11:22.474355 26663 consensus_queue.cc:260] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:22.549584 22456 raft_consensus.cc:1275] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:11:22.566227 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.566787 23121 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 10.
W20260709 12:11:22.568912 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:22.559024 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 202211us
I20260709 12:11:22.572069 26074 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:22.564162 26609 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:22.587430 26412 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.587991 26412 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:22.577736 26663 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:22.597632 22457 raft_consensus.cc:2468] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
I20260709 12:11:22.585861 22529 raft_consensus.cc:1275] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:22.652866 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:22.652454 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 82038.1us
I20260709 12:11:22.653606 22456 raft_consensus.cc:2468] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 6.
I20260709 12:11:22.658545 26652 consensus_queue.cc:1048] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:11:22.657878 22570 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.196.132:44353 timed out after 1.627s (SENT) [suppressed 46 similar messages]
I20260709 12:11:22.595512 26673 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.590953 26411 consensus_queue.cc:1048] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 12:11:22.687575 26689 raft_consensus.cc:2749] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:22.688730 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:22.653156 25675 consensus_queue.cc:1048] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:11:22.595192 26688 raft_consensus.cc:2749] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:22.714994 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:22.715624 22598 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:22.717964 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:22.718709 22457 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:11:22.585022 26425 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:22.709995 22456 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11.
I20260709 12:11:22.662583 26667 consensus_queue.cc:1243] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer c863116d91c14d1ca50d6e8a46a37a8f log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 12:11:22.716794 26700 log.cc:927] Time spent T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:11:22.715605 26289 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:22.715473 26412 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:22.745805 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 90798.3us
W20260709 12:11:22.738646 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.711505 26673 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:22.743685 26074 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.709157 26686 consensus_queue.cc:1048] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:11:22.763908 23089 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:22.766239 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:22.771350 23089 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:22.775825 23089 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:22.777252 23089 leader_election.cc:304] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:22.783264 22450 raft_consensus.cc:1240] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:22.786671 22598 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 12.
I20260709 12:11:22.744673 26690 consensus_queue.cc:1048] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:11:22.790172 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:11:22.765460 26696 log.cc:927] Time spent T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 12:11:22.787091 26357 raft_consensus.cc:2749] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:22.800838 26357 raft_consensus.cc:2749] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:22.765614 26537 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:22.802253 26425 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:22.803403 26699 log.cc:927] Time spent T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 12:11:22.772307 22569 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:22.782290 26579 raft_consensus.cc:2749] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:22.813323 22450 raft_consensus.cc:1240] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:22.784150 26592 raft_consensus.cc:2749] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:22.813607 22454 raft_consensus.cc:1240] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:11:22.814236 22456 raft_consensus.cc:1240] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:22.765751 26074 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:22.812271 22569 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:22.772466 26126 consensus_queue.cc:1059] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
W20260709 12:11:22.831868 26655 log.cc:927] Time spent T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.688s	user 0.000s	sys 0.003s
W20260709 12:11:22.832542 26703 log.cc:927] Time spent T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 12:11:22.833148 26701 log.cc:927] Time spent T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:11:22.817910 26484 raft_consensus.cc:2804] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:22.841152 22454 raft_consensus.cc:1240] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:11:22.846968 26693 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:11:22.848456 26707 log.cc:927] Time spent T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 12:11:22.866916 22343 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.206s	user 0.018s	sys 0.041s
I20260709 12:11:22.865964 26357 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.871984 26357 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:22.874286 26357 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:22.875573 26709 log.cc:927] Time spent T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 12:11:22.879496 26702 log.cc:927] Time spent T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:11:22.881026 23125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 868) took 1138 ms. Trace:
I20260709 12:11:22.881465 23125 rpcz_store.cc:276] 0709 12:11:21.743012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.795593 (+ 52581us) service_pool.cc:224] Handling call
0709 12:11:21.795935 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:21.796298 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:21.796326 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:21.796788 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 12:11:21.950042 (+153254us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:21.950076 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.950132 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:22.831326 (+881194us) spinlock_profiling.cc:243] Waited 42.1 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:11:22.880712 (+ 49386us) raft_consensus.cc:1685] finished
0709 12:11:22.880738 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:22.880964 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9154,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":73,"spinlock_wait_cycles":96830336,"thread_start_us":152931,"threads_started":1,"wal-append.queue_time_us":326692}
W20260709 12:11:22.885074 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.887995 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:22.888622 23125 raft_consensus.cc:2376] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11. Re-sending same reply.
I20260709 12:11:22.889097 26537 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:22.889662 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:22.890081 26673 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:22.890321 22529 raft_consensus.cc:2376] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11. Re-sending same reply.
I20260709 12:11:22.887881 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:22.891464 23122 raft_consensus.cc:2376] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9. Re-sending same reply.
I20260709 12:11:22.889693 26537 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:22.893401 26537 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:22.897951 26414 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:22.863159 26484 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.899344 26484 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:22.888129 26708 log.cc:927] Time spent T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:11:22.857117 25675 raft_consensus.cc:2764] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:11:22.902290 26693 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:22.914557 22529 raft_consensus.cc:1240] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:11:22.868278 26686 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:22.869622 26579 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:11:22.920676 26715 log.cc:927] Time spent T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:11:22.922439 26548 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:22.922575 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 145412us
I20260709 12:11:22.924269 23089 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:22.926848 26685 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:22.927348 26616 raft_consensus.cc:2764] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 12:11:22.928646 23089 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:22.930546 26616 raft_consensus.cc:2749] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:22.931761 26592 raft_consensus.cc:3055] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:22.932157 26592 raft_consensus.cc:740] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:22.932466 26616 consensus_queue.cc:1048] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:22.933394 23089 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
W20260709 12:11:22.917858 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 55489.9us
I20260709 12:11:22.938228 22570 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:22.944617 23125 raft_consensus.cc:1240] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:22.937192 26624 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:22.947429 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:22.948559 23125 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:22.959204 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:22.959836 23119 raft_consensus.cc:2468] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7.
I20260709 12:11:22.961298 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:22.961831 23119 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
W20260709 12:11:22.938966 26666 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.007s	sys 0.002s
I20260709 12:11:22.947506 26624 raft_consensus.cc:697] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 10 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:22.979666 26652 consensus_queue.cc:1048] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:22.986402 26660 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:22.988570 26705 consensus_queue.cc:1059] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:11:22.947811 25675 consensus_queue.cc:1059] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:11:22.992095 26685 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:22.938752 26667 consensus_queue.cc:1048] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
W20260709 12:11:23.005717 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.938045 26579 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:22.933290 26686 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:23.016710 22422 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
W20260709 12:11:22.964831 26666 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.007s	sys 0.002s
I20260709 12:11:23.013175 23125 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 10.
I20260709 12:11:23.018776 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:23.019358 22601 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:22.970896 26694 raft_consensus.cc:2804] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:23.015874 26610 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.023125 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:23.023505 26610 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:23.021679 26425 raft_consensus.cc:2804] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:23.024478 26425 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:23.024837 26425 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:23.025555 26610 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:23.015724 26444 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.026294 26484 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:23.026759 26444 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:23.027257 26693 leader_election.cc:290] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:23.027360 26624 consensus_queue.cc:237] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:23.027876 26693 consensus_queue.cc:1059] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:23.028461 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:23.028712 26693 consensus_queue.cc:1059] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:23.028079 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:23.020678 22598 raft_consensus.cc:1275] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:11:23.029469 22598 pending_rounds.cc:85] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting all ops after (but not including) 8
I20260709 12:11:22.933008 26592 consensus_queue.cc:260] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:23.029726 22598 pending_rounds.cc:107] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:11:23.030061 22598 raft_consensus.cc:2889] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:23.030548 26592 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:23.028892 26444 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:23.031167 22421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.034343 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:23.029759 26693 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.037041 26693 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:23.040052 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:23.048307 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:23.048497 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:23.052698 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:23.054744 22597 raft_consensus.cc:2393] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 12: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:23.055969 22601 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 13.
I20260709 12:11:23.034621 26694 raft_consensus.cc:697] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:23.059082 22421 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:23.049229 26597 raft_consensus.cc:3055] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:23.065668 22597 raft_consensus.cc:1275] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:11:23.066223 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 48397.9us
I20260709 12:11:23.014205 26660 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:23.072594 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 94805.4us
I20260709 12:11:23.074216 22570 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:23.079902 26694 consensus_queue.cc:237] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:23.066929 26431 raft_consensus.cc:2804] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:23.067417 26444 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:23.066998 26597 raft_consensus.cc:740] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:23.061939 26652 raft_consensus.cc:3055] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:23.080806 26484 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:23.102973 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:23.103483 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:23.104689 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:23.111609 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:23.112454 22455 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 8.
I20260709 12:11:23.095394 26652 raft_consensus.cc:740] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:23.114543 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:23.116184 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:23.117226 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:23.122004 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:23.122164 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:23.120203 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:23.097383 26610 consensus_queue.cc:1048] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:11:23.124619 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:23.124480 26652 consensus_queue.cc:260] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:23.125913 26652 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:23.127066 26597 consensus_queue.cc:260] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:23.128321 26597 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:23.131345 26579 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:23.133139 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:23.118933 26619 consensus_meta.cc:287] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.651s	user 0.009s	sys 0.002s
I20260709 12:11:23.111632 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:23.140179 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:11:23.140743 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 72885.4us
I20260709 12:11:23.129210 22343 maintenance_manager.cc:643] P 136fd3da76544029a815aef59e698e17: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 6.743s	user 0.175s	sys 0.104s Metrics: {"bytes_written":30440,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":381543,"dirs.run_cpu_time_us":572,"dirs.run_wall_time_us":46192,"drs_written":1,"lbm_read_time_us":70522,"lbm_reads_10-100_ms":4,"lbm_write_time_us":184316,"lbm_writes_1-10_ms":2,"lbm_writes_10-100_ms":7,"lbm_writes_lt_1ms":25,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":409355,"threads_started":2,"update_count":17,"wal-append.queue_time_us":183986}
I20260709 12:11:23.141531 22527 raft_consensus.cc:1275] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:23.093214 26444 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:23.098793 26695 raft_consensus.cc:2804] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:23.140244 22452 raft_consensus.cc:2468] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 9.
I20260709 12:11:23.148429 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:23.149973 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:23.150568 23123 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:23.098799 26674 consensus_queue.cc:1059] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:11:23.150640 23087 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:23.153559 22496 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:23.157503 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:23.162684 23125 raft_consensus.cc:2468] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 9.
I20260709 12:11:23.158591 26727 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:23.164346 22421 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:23.164568 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:23.165210 23124 raft_consensus.cc:2468] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 9.
I20260709 12:11:23.165381 22456 raft_consensus.cc:1240] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:23.167557 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:23.168308 22526 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:23.170331 26666 consensus_queue.cc:1048] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:23.171053 26616 raft_consensus.cc:2804] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:23.171465 26616 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:23.171838 26616 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:23.171902 22344 maintenance_manager.cc:419] P 136fd3da76544029a815aef59e698e17: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10554 bytes on disk
I20260709 12:11:23.175320 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:23.176514 26727 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:23.179118 26620 raft_consensus.cc:2749] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:23.184248 26686 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:23.186203 22343 maintenance_manager.cc:643] P 136fd3da76544029a815aef59e698e17: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.006s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":323,"lbm_reads_lt_1ms":4}
W20260709 12:11:23.175513 26724 log.cc:927] Time spent T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:11:23.181324 22496 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:23.163709 26431 raft_consensus.cc:697] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 8 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
W20260709 12:11:23.208069 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 54049.6us
W20260709 12:11:23.206578 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 62854.8us
I20260709 12:11:23.209729 22421 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:23.212419 22496 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:23.221130 22526 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 10.
I20260709 12:11:23.222097 26596 raft_consensus.cc:2749] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:23.219084 26688 raft_consensus.cc:2804] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:23.231510 26688 raft_consensus.cc:697] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:23.232435 26688 consensus_queue.cc:237] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:23.219630 26727 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:23.234638 26727 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:23.235425 26727 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:23.238842 22496 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:23.246752 22496 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:23.247617 22496 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:23.249135 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:23.249686 22526 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:23.254246 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:23.225955 26733 raft_consensus.cc:2749] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:23.261646 22526 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 9.
I20260709 12:11:23.263677 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:23.263571 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:23.264787 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:23.265452 22528 raft_consensus.cc:2393] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 12: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:23.252043 26443 raft_consensus.cc:2804] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:23.268630 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:23.252801 26619 raft_consensus.cc:2804] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:23.268383 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:23.273010 26616 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:23.275022 26443 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:23.275497 26443 raft_consensus.cc:3060] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:23.276304 26425 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:23.278266 26425 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:23.278751 22457 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:23.252754 26411 raft_consensus.cc:2804] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:23.284482 23123 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 10.
I20260709 12:11:23.285527 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:23.246073 26666 consensus_queue.cc:1059] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:11:23.265458 26611 raft_consensus.cc:2804] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:23.287820 22530 raft_consensus.cc:1275] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:11:23.297338 26616 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:23.253726 26431 consensus_queue.cc:237] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:23.302057 26698 log.cc:927] Time spent T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.729s	user 0.003s	sys 0.000s
I20260709 12:11:23.279862 26619 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:23.258747 26734 consensus_queue.cc:1048] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:11:23.304947 22457 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 10.
I20260709 12:11:23.288188 26444 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:23.296736 26611 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:23.294806 26411 raft_consensus.cc:697] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:23.297441 26727 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:23.336099 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:23.339805 22524 raft_consensus.cc:1275] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 12:11:23.340533 22524 pending_rounds.cc:85] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting all ops after (but not including) 6
I20260709 12:11:23.340840 22524 pending_rounds.cc:107] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 12:11:23.341161 22524 raft_consensus.cc:2889] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:23.307334 26619 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:23.352804 22421 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:23.354133 22523 raft_consensus.cc:1240] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 10. Current term is 11. Ops: [7.5-10.6]
W20260709 12:11:23.352435 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 70814.7us
I20260709 12:11:23.361253 22421 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:23.368669 26729 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:23.369570 22421 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:23.372829 23124 raft_consensus.cc:1275] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:11:23.375473 26737 log.cc:927] Time spent T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:11:23.310946 26596 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:23.338610 26611 raft_consensus.cc:3060] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:23.385637 22496 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:23.391014 26693 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:23.394884 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:23.400323 26414 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:23.400800 26740 raft_consensus.cc:2804] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:23.401263 26740 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:23.401700 26740 raft_consensus.cc:3060] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:23.358162 26444 consensus_queue.cc:1048] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.045s
W20260709 12:11:23.404222 22495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.404913 26074 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:23.405674 26411 consensus_queue.cc:237] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:23.406214 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:23.409232 23089 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:23.436316 23089 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:23.414258 26669 raft_consensus.cc:2804] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:23.407425 26733 raft_consensus.cc:2804] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:23.414040 22452 raft_consensus.cc:1240] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:23.414423 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.414883 22497 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:23.414678 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:23.463013 22454 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:23.467902 23118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 869) took 1670 ms. Trace:
I20260709 12:11:23.468315 23118 rpcz_store.cc:276] 0709 12:11:21.797511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.101028 (+303517us) service_pool.cc:224] Handling call
0709 12:11:22.101355 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:22.185111 (+ 83756us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:22.185153 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:22.185676 (+   523us) log.cc:844] Serialized 26 byte log entry
0709 12:11:22.299064 (+113388us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:22.299123 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.467513 (+1168390us) spinlock_profiling.cc:243] Waited 83.4 ms on lock 0x7b54005f2654. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:23.467560 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:23.467619 (+    59us) raft_consensus.cc:1685] finished
0709 12:11:23.467638 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:23.467844 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6128,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":7056,"spinlock_wait_cycles":191705856,"thread_start_us":72791,"threads_started":1,"wal-append.queue_time_us":151779}
I20260709 12:11:23.413559 26443 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:23.470176 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:23.473235 22454 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 12.
I20260709 12:11:23.475598 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:23.479405 22452 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 10.
I20260709 12:11:23.479833 26501 raft_consensus.cc:3055] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:23.458848 26660 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:23.480278 26501 raft_consensus.cc:740] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:23.481137 26501 consensus_queue.cc:260] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:23.482352 26501 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:23.484200 22449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2441) took 1666 ms. Trace:
I20260709 12:11:23.484629 22449 rpcz_store.cc:276] 0709 12:11:21.817592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.863651 (+ 46059us) service_pool.cc:224] Handling call
0709 12:11:21.864029 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:22.522763 (+658734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.483988 (+961225us) spinlock_profiling.cc:243] Waited 647 ms on lock 0x7b54003f3ed4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:23.484139 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1487581440}
I20260709 12:11:23.357678 26727 consensus_queue.cc:1048] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 12:11:23.501132 26443 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:23.502081 26443 raft_consensus.cc:2804] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:23.502625 26443 raft_consensus.cc:697] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:23.454900 26733 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:23.446866 26616 raft_consensus.cc:2749] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:23.503626 26733 raft_consensus.cc:3060] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:23.493974 26669 raft_consensus.cc:697] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:23.443789 26592 raft_consensus.cc:2749] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:23.409875 26596 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:23.491204 26676 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:23.495497 26414 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.534438 26427 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:23.453290 26417 consensus_queue.cc:1048] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 12:11:23.536176 26414 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:23.551594 26414 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:23.552917 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 183416us
I20260709 12:11:23.557497 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:23.563061 22421 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:23.554113 23087 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:23.568199 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:23.569147 23087 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:23.558403 23118 raft_consensus.cc:2468] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 7.
I20260709 12:11:23.573823 22421 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:23.577996 22421 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:23.537046 26676 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:23.573175 26592 raft_consensus.cc:2804] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:23.577020 26727 raft_consensus.cc:2749] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:23.590521 22421 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:23.591109 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:23.577684 26439 raft_consensus.cc:2804] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:23.574926 26588 raft_consensus.cc:2749] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:23.594393 22421 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:23.601233 22421 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:23.602548 22421 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:23.591806 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:23.595671 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:23.596467 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:23.596679 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:23.597082 22495 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:23.606568 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:23.606683 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:23.607918 22525 raft_consensus.cc:1240] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:11:23.598196 22529 raft_consensus.cc:1240] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:11:23.584578 26672 raft_consensus.cc:3055] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:23.572899 26616 consensus_queue.cc:1059] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:11:23.612881 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:23.592725 26592 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:23.622107 26592 raft_consensus.cc:3060] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:22.984652 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:23.604626 26735 raft_consensus.cc:2749] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:23.578665 26443 consensus_queue.cc:237] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:23.598598 26610 raft_consensus.cc:2749] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:23.573704 26669 consensus_queue.cc:237] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:23.663786 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:23.613173 26672 raft_consensus.cc:740] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:23.666004 23088 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:23.631506 26417 raft_consensus.cc:2804] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:23.605064 26444 raft_consensus.cc:2749] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:23.605391 26731 raft_consensus.cc:2749] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:11:23.655089 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 161144us
I20260709 12:11:23.657295 23120 raft_consensus.cc:1275] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:11:23.650774 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:23.675923 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.587006 26729 raft_consensus.cc:697] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:23.631857 26439 raft_consensus.cc:697] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:23.664446 22449 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 10.
I20260709 12:11:23.674399 23088 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:11:23.641993 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 227177us
I20260709 12:11:23.631740 26742 raft_consensus.cc:2749] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:23.685577 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:23.687623 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:23.688369 22531 raft_consensus.cc:2368] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 9. Current term is 10.
W20260709 12:11:23.686407 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 200049us
I20260709 12:11:23.659533 26579 raft_consensus.cc:3055] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:23.690096 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:23.695658 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:23.673379 26588 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.650022 26727 consensus_queue.cc:1048] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:11:23.650499 26685 consensus_queue.cc:1059] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:11:23.676110 26695 raft_consensus.cc:697] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:23.695248 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:23.725752 23122 raft_consensus.cc:3060] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:23.727869 22598 raft_consensus.cc:1240] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:23.730244 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:23.736613 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:23.737572 22602 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:23.684931 26417 raft_consensus.cc:697] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:23.768774 22598 raft_consensus.cc:1275] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:11:23.769230 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:23.693934 26579 raft_consensus.cc:740] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:23.778899 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:23.779377 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:23.779565 22601 raft_consensus.cc:2468] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 9.
I20260709 12:11:23.780066 22603 raft_consensus.cc:2368] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 9. Current term is 10.
I20260709 12:11:23.780460 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:23.788622 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 99543.2us
I20260709 12:11:23.795544 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:23.796700 22602 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 10.
I20260709 12:11:23.799894 22569 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:23.801791 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:23.802388 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:23.804289 22602 raft_consensus.cc:2393] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 10: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:23.687356 26736 consensus_queue.cc:1048] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
W20260709 12:11:23.804816 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 171785us
I20260709 12:11:23.692564 26735 consensus_queue.cc:1059] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.109s
I20260709 12:11:23.816149 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:23.771401 26693 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:11:23.827188 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.845176 22570 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:23.847898 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 164465us
I20260709 12:11:23.700941 26667 consensus_queue.cc:1059] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.100s
W20260709 12:11:23.858866 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 46283.7us
I20260709 12:11:23.726374 26588 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:23.797868 26596 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:23.865796 22569 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:23.877848 22570 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:23.838969 26684 raft_consensus.cc:2804] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:23.804425 26694 consensus_queue.cc:1059] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 12:11:23.865517 26624 raft_consensus.cc:2749] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:23.875514 26439 consensus_queue.cc:237] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:23.912880 26769 consensus_queue.cc:1059] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:11:23.864342 26431 consensus_queue.cc:1048] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:11:23.866135 26693 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:23.777513 26672 consensus_queue.cc:260] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:23.899487 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 172720us
I20260709 12:11:23.920432 26676 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:23.964351 26759 log.cc:927] Time spent T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 12:11:23.965049 26745 log.cc:927] Time spent T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.348s	user 0.000s	sys 0.001s
I20260709 12:11:23.972630 26652 raft_consensus.cc:3055] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:11:23.973254 26754 log.cc:927] Time spent T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.283s	user 0.001s	sys 0.000s
I20260709 12:11:23.811074 26695 consensus_queue.cc:237] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:23.973191 26652 raft_consensus.cc:740] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:23.977589 23122 raft_consensus.cc:2468] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
I20260709 12:11:23.917155 26766 raft_consensus.cc:2749] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:23.936138 26597 raft_consensus.cc:2804] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:23.937738 26769 consensus_queue.cc:1243] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer 6c6fa11e8ee34711b3551f0c670442bc log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:11:23.863554 26729 consensus_queue.cc:237] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:24.073212 26750 log.cc:927] Time spent T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.418s	user 0.001s	sys 0.000s
I20260709 12:11:23.991428 26690 raft_consensus.cc:2749] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:23.902392 26417 consensus_queue.cc:237] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:23.921674 26579 consensus_queue.cc:260] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:24.052031 26597 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:11:24.113811 26751 log.cc:927] Time spent T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.393s	user 0.000s	sys 0.001s
I20260709 12:11:24.097427 26484 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:24.090143 26772 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:11:24.113684 26733 consensus_meta.cc:287] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.609s	user 0.007s	sys 0.006s
I20260709 12:11:24.098382 26766 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:11:24.151415 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.123346 26667 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.133769 26597 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:24.178951 22421 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.000s	sys 0.012s
W20260709 12:11:24.169155 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 468284us
W20260709 12:11:24.168915 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 291077us
I20260709 12:11:24.182240 22570 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:24.147415 26676 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:24.174605 26765 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:24.175565 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 501214us
I20260709 12:11:24.143875 26596 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.159791 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:24.180562 22452 raft_consensus.cc:3055] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:24.153777 26674 raft_consensus.cc:2804] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:24.166884 26592 consensus_meta.cc:287] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.544s	user 0.009s	sys 0.002s
I20260709 12:11:24.155129 26579 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:24.184269 22570 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:24.181461 22495 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:11:24.142297 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 267978us
I20260709 12:11:24.216557 22422 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:24.216843 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:24.185194 22421 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.000s	sys 0.012s
I20260709 12:11:24.187318 22599 raft_consensus.cc:1275] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:24.196736 22452 raft_consensus.cc:740] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
W20260709 12:11:24.218011 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 545608us
I20260709 12:11:24.176820 26774 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.219659 22421 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:24.130581 26652 consensus_queue.cc:260] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:24.218704 22452 consensus_queue.cc:260] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:24.229035 22422 leader_election.cc:400] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 election: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 9. Current term is 10.
I20260709 12:11:24.229328 22422 leader_election.cc:403] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:11:24.229950 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:24.207016 23088 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:24.229344 22452 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:24.153271 26484 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:24.182896 26775 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:24.183215 26770 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:24.228255 22351 catalog_manager.cc:5697] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 3 to 9. New cstate: current_term: 9 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:11:24.158550 26733 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:24.230674 22421 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:24.232947 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:24.246783 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:24.211608 26697 raft_consensus.cc:3055] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:11:24.257704 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:24.249193 26723 log.cc:927] Time spent T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 1.182s	user 0.007s	sys 0.006s
W20260709 12:11:24.266065 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 81874.6us
I20260709 12:11:24.250766 26775 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:24.246650 26588 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:24.248799 26610 raft_consensus.cc:2749] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 9. Current term is 10.
I20260709 12:11:24.286849 26693 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:24.159102 26772 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:24.215894 26596 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:24.239759 26727 consensus_queue.cc:1048] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:11:24.181747 26667 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:24.207883 26676 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:24.260044 26697 raft_consensus.cc:740] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:24.223529 26592 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:24.188097 26766 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:24.254132 26770 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:24.213296 26765 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:24.308743 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 158879us
I20260709 12:11:24.418352 22497 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:24.292853 26652 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:24.240324 26769 raft_consensus.cc:2749] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:24.256444 26684 raft_consensus.cc:697] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:24.303990 26694 raft_consensus.cc:2804] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:24.240231 26774 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:24.320719 22570 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:24.328476 26685 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.005s	sys 0.028s
I20260709 12:11:24.293169 26771 consensus_queue.cc:1059] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:11:24.341467 26588 raft_consensus.cc:2749] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:24.337244 26783 raft_consensus.cc:2804] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:11:24.432010 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 225081us
I20260709 12:11:24.433166 23116 raft_consensus.cc:1240] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:11:24.466004 23088 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:24.464497 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 223280us
I20260709 12:11:24.425863 26609 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:24.473342 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:24.474181 22450 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
W20260709 12:11:24.433591 26685 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.005s	sys 0.028s
I20260709 12:11:24.491956 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:24.428709 26782 raft_consensus.cc:2804] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:24.495047 23117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 873) took 2569 ms. Trace:
I20260709 12:11:24.427433 26694 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.495611 23117 rpcz_store.cc:276] 0709 12:11:21.925383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.148086 (+222703us) service_pool.cc:224] Handling call
0709 12:11:22.148474 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:22.909489 (+761015us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:22.909518 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:22.909926 (+   408us) log.cc:844] Serialized 26 byte log entry
0709 12:11:23.475780 (+565854us) spinlock_profiling.cc:243] Waited 1 ms on lock 0x7b1800419560. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc7823e07 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc7840c02 00007f9cca4c820b 00007f9cca4cdd23 00007f9cca4ce0d1 00007f9cca8e9a0f
0709 12:11:23.575099 (+ 99319us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:23.575135 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.494588 (+919453us) spinlock_profiling.cc:243] Waited 761 ms on lock 0x7b54004e6454. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:24.494668 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:24.494739 (+    71us) raft_consensus.cc:1685] finished
0709 12:11:24.494761 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:24.494938 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2363,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":2845,"spinlock_wait_cycles":1751604992,"thread_start_us":98576,"threads_started":1,"wal-append.queue_time_us":719810}
I20260709 12:11:24.502234 22456 raft_consensus.cc:1240] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:11:24.494473 26771 raft_consensus.cc:2749] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:24.522117 26662 raft_consensus.cc:3055] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:24.522822 26787 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.524072 26596 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:24.501897 26685 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:24.554760 22351 catalog_manager.cc:5697] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
W20260709 12:11:24.526403 26776 log.cc:927] Time spent T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.182s	user 0.000s	sys 0.000s
I20260709 12:11:24.499423 26588 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:11:24.510517 26767 log.cc:927] Time spent T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.366s	user 0.001s	sys 0.000s
W20260709 12:11:24.532794 26740 consensus_meta.cc:287] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 1.131s	user 0.013s	sys 0.000s
I20260709 12:11:24.546200 26775 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:11:24.549243 26427 consensus_meta.cc:287] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 1.014s	user 0.010s	sys 0.000s
I20260709 12:11:24.512473 26694 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.590122 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:24.598130 22452 raft_consensus.cc:1275] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:24.495466 26782 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:24.532231 26780 log.cc:927] Time spent T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 12:11:24.507771 26790 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:24.531163 26797 raft_consensus.cc:2749] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:24.630458 22597 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
I20260709 12:11:24.556185 26484 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:24.526954 26779 raft_consensus.cc:2749] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:24.632723 22524 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 10.
I20260709 12:11:24.544080 26662 raft_consensus.cc:740] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
W20260709 12:11:24.634423 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 216189us
I20260709 12:11:24.634248 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:24.644969 22456 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 10.
I20260709 12:11:24.646993 23088 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:24.636524 26786 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.619573 26733 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:24.626260 26769 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:24.494185 26697 consensus_queue.cc:260] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:24.631032 26771 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.637132 26782 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:24.637300 26411 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.580253 26685 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:24.637003 25675 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:24.667243 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 436620us
I20260709 12:11:24.648854 26792 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:24.625407 26588 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:24.669873 22604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43070 (request call id 652) took 1563 ms. Trace:
I20260709 12:11:24.672706 26805 raft_consensus.cc:2804] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:24.683372 22604 rpcz_store.cc:276] 0709 12:11:23.103431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.104438 (+  1007us) service_pool.cc:224] Handling call
0709 12:11:23.119732 (+ 15294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:23.768946 (+649214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:23.768991 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:23.769452 (+   461us) log.cc:844] Serialized 26 byte log entry
0709 12:11:24.082199 (+312747us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:24.082236 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.082303 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:24.666266 (+583963us) raft_consensus.cc:1685] finished
0709 12:11:24.666294 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:24.666495 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":508766,"raft.queue_time_us":534075,"spinlock_wait_cycles":5500160,"thread_start_us":345421,"threads_started":2,"wal-append.queue_time_us":481734}
I20260709 12:11:24.673723 26765 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:24.674274 23087 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:24.675000 26804 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:24.578900 26787 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:24.675594 26667 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:24.536837 26684 consensus_queue.cc:237] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:24.677238 22421 leader_election.cc:400] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 election: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 9. Current term is 10.
I20260709 12:11:24.678411 26766 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:24.656991 26786 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:24.680902 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:24.707741 23122 raft_consensus.cc:3060] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.681980 22531 raft_consensus.cc:1275] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:24.629448 26740 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:24.694561 22451 raft_consensus.cc:1240] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:24.700505 22604 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:24.665807 26592 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:24.668982 26697 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:24.669905 25675 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:24.696525 26619 consensus_meta.cc:287] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 1.303s	user 0.013s	sys 0.009s
I20260709 12:11:24.687623 26805 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:24.715265 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:24.646112 26790 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:24.714614 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:24.669162 26411 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:24.725378 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:24.736968 22452 raft_consensus.cc:2393] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 10: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:24.725963 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:24.725225 22604 raft_consensus.cc:1275] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:24.727893 23122 raft_consensus.cc:2468] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 10.
I20260709 12:11:24.732309 26805 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.732873 26733 consensus_queue.cc:1048] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:11:24.735304 22455 raft_consensus.cc:1240] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:11:24.698315 26414 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:24.739696 22456 raft_consensus.cc:2393] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 13: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:24.662500 26769 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:24.740022 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:24.716288 26611 consensus_meta.cc:287] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 1.300s	user 0.009s	sys 0.005s
I20260709 12:11:24.761152 26611 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:24.763368 26411 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:24.666352 26771 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:24.752254 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:24.766412 22448 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 9.
I20260709 12:11:24.687702 26792 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:24.759744 26786 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:24.711905 26804 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:24.740221 26772 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:24.784715 26804 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:24.786600 26792 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:24.766873 23125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 1022) took 1206 ms. Trace:
I20260709 12:11:24.787557 23125 rpcz_store.cc:276] 0709 12:11:23.560145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.588021 (+ 27876us) service_pool.cc:224] Handling call
0709 12:11:23.588461 (+   440us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:23.588977 (+   516us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:23.589019 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:23.612542 (+ 23523us) log.cc:844] Serialized 52 byte log entry
0709 12:11:23.770313 (+157771us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:23.805132 (+ 34819us) log.cc:844] Serialized 14 byte log entry
0709 12:11:23.953950 (+148818us) log.cc:844] Serialized 14 byte log entry
0709 12:11:23.954191 (+   241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.954296 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:24.766653 (+812357us) raft_consensus.cc:1685] finished
0709 12:11:24.766674 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:24.766804 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5785,"prepare.queue_time_us":45211,"prepare.run_cpu_time_us":146,"prepare.run_wall_time_us":15499,"raft.queue_time_us":164408,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":13042,"spinlock_wait_cycles":212169344,"thread_start_us":253966,"threads_started":2,"wal-append.queue_time_us":217798}
I20260709 12:11:24.766886 22457 raft_consensus.cc:3060] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:24.715854 26770 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:24.791800 26685 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:24.796689 22604 raft_consensus.cc:1275] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:24.798136 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:24.780583 26787 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:24.787138 26800 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:11:24.744551 26597 consensus_meta.cc:287] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.556s	user 0.011s	sys 0.000s
I20260709 12:11:24.723317 26795 raft_consensus.cc:2749] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:24.834273 26740 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:24.835836 26749 log.cc:927] Time spent T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 1.213s	user 0.009s	sys 0.014s
I20260709 12:11:24.838444 26597 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:24.812052 22457 raft_consensus.cc:2468] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
I20260709 12:11:24.730563 26417 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:24.843366 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:24.723483 26619 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:24.840812 26597 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:24.854300 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:24.855224 22604 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
I20260709 12:11:24.856428 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:24.857949 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 115208us
I20260709 12:11:24.696070 26662 consensus_queue.cc:260] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:24.862490 26662 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:24.822587 26772 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:24.865105 26772 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:24.869285 26619 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:24.775097 26414 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:24.872869 26414 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:24.879530 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:24.884307 22604 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 13.
I20260709 12:11:24.896824 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:24.875617 26694 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:24.902637 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 44029.6us
I20260709 12:11:24.887564 26579 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.903641 26579 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:24.904066 22495 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:24.908280 26620 raft_consensus.cc:2804] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:24.908686 26620 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.909056 26620 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:24.877597 26795 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:24.887552 26766 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.912256 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:24.912875 26766 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:24.916724 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:24.917327 22454 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
I20260709 12:11:24.918115 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:24.918738 22454 raft_consensus.cc:2393] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 9: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:24.918725 22495 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:24.919606 26787 raft_consensus.cc:2804] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:24.919716 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:24.919975 26787 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.920318 26787 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:24.920310 22454 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 10.
I20260709 12:11:24.853509 26417 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:24.921451 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:24.922922 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:24.923686 22454 raft_consensus.cc:2393] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 11: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:24.925951 22454 raft_consensus.cc:1275] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:24.927647 26787 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:24.929044 26620 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:24.930505 26787 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:24.930393 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 51586.7us
I20260709 12:11:24.933507 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:24.938966 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:24.939400 22524 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 10.
I20260709 12:11:24.923501 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:24.937559 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:24.940449 22450 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:24.941109 22496 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:24.941402 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:24.946540 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:24.947257 26795 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:24.949666 26795 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:24.952025 23116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 895) took 1269 ms. Trace:
I20260709 12:11:24.952545 23116 rpcz_store.cc:276] 0709 12:11:23.683057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.886699 (+203642us) service_pool.cc:224] Handling call
0709 12:11:23.923421 (+ 36722us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:24.465134 (+541713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.951728 (+486594us) spinlock_profiling.cc:243] Waited 509 ms on lock 0x7b54006f1154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:24.951949 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1171347712}
W20260709 12:11:24.957931 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 637263us
I20260709 12:11:24.958143 26771 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:24.959832 26732 log.cc:927] Time spent T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 1.723s	user 0.003s	sys 0.000s
I20260709 12:11:24.961885 26783 raft_consensus.cc:697] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:24.962849 26414 consensus_queue.cc:1048] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:24.963011 26783 consensus_queue.cc:237] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:24.964525 26414 raft_consensus.cc:2804] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:24.965055 26414 raft_consensus.cc:697] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:24.965866 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:24.965966 26414 consensus_queue.cc:237] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:24.966547 22527 raft_consensus.cc:1275] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:24.968294 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:24.969290 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:24.970906 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:24.971871 22421 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:24.971156 23122 raft_consensus.cc:1240] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:24.975554 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:24.978012 22454 raft_consensus.cc:1275] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:24.912245 26775 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:11:24.981261 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.981695 22421 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:24.968884 22524 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
I20260709 12:11:24.993424 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:24.798146 26782 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:24.890389 26676 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:25.013931 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:25.015038 23121 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 10.
I20260709 12:11:25.017483 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:25.018656 22529 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
I20260709 12:11:25.016217 22606 raft_consensus.cc:1275] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:24.997980 23125 raft_consensus.cc:1275] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:11:25.020056 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.000583 26616 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:24.846033 26800 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:25.021685 26616 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:25.001621 26775 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:25.024253 26616 leader_election.cc:290] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:25.025190 26775 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317)
I20260709 12:11:25.028983 26811 consensus_queue.cc:1048] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:25.031250 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:25.031791 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:25.031957 23123 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11.
I20260709 12:11:25.032622 23124 raft_consensus.cc:2393] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 12: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:24.922959 26417 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:25.039157 22523 raft_consensus.cc:1240] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 LEADER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:11:25.038594 22532 raft_consensus.cc:2368] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 10. Current term is 11.
I20260709 12:11:24.998888 22456 raft_consensus.cc:1240] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:25.003268 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:25.007400 23116 raft_consensus.cc:1275] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:25.043938 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:24.939823 26810 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:25.049491 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:25.049732 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:25.050194 22456 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:25.001317 26788 raft_consensus.cc:2804] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:24.997426 26795 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:25.002663 26425 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:11:25.047725 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:25.067577 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:25.052335 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 52209.2us
I20260709 12:11:25.006371 26431 raft_consensus.cc:2749] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:25.056233 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:25.034907 26774 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:25.035773 26766 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:25.076251 22452 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 10.
I20260709 12:11:25.056098 26775 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.054940 26810 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:25.057966 26652 consensus_meta.cc:287] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.629s	user 0.007s	sys 0.004s
I20260709 12:11:25.078130 26736 consensus_queue.cc:1048] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:11:25.075099 22421 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:25.084579 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:25.054543 26788 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:25.057197 26616 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:25.058003 26074 raft_consensus.cc:476] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 11 LEADER]: Not starting pre-election -- already a leader
I20260709 12:11:25.066699 26684 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.087152 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:25.089839 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:25.077105 26782 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:25.111925 22453 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:25.111830 22570 leader_election.cc:304] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:25.076587 26694 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:25.077649 26798 raft_consensus.cc:2804] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:25.071755 26425 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:25.084810 26427 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.115629 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:25.086297 26766 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.067250 26787 consensus_queue.cc:1059] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:11:25.084877 26765 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:25.092672 26788 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:25.088435 26771 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.097307 26800 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:25.067902 26795 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:25.097685 26680 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:25.118947 26652 consensus_queue.cc:1048] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:11:25.139575 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:25.141801 26425 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:25.124504 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:25.077626 26775 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:25.181941 22603 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
I20260709 12:11:25.147984 22570 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:25.128248 26431 raft_consensus.cc:2804] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:25.111459 26616 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:25.117726 26798 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:25.195797 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:25.149470 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.201589 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:25.203207 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:25.203315 22450 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 12.
I20260709 12:11:25.115475 26684 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:25.205750 22495 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:11:25.208455 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 60557.5us
I20260709 12:11:25.128058 26821 raft_consensus.cc:2749] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:25.183202 26740 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:25.209343 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:25.207804 22569 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:25.205433 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:25.210839 22601 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
I20260709 12:11:25.127149 26427 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:25.212613 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:25.213090 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:25.214943 26775 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:25.215386 26772 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:25.215979 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:25.217221 26671 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:25.224542 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:25.225443 22603 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:25.142866 26765 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:25.206578 26431 raft_consensus.cc:697] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 10 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:25.186467 26783 consensus_queue.cc:1048] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:11:25.195509 26798 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:25.220988 26782 raft_consensus.cc:2804] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:25.147812 26771 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:25.236733 22570 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:25.235951 22569 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:25.201081 26680 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:25.163712 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 108231us
I20260709 12:11:25.258334 22601 raft_consensus.cc:1275] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:11:25.165432 26819 consensus_queue.cc:1048] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.086s
I20260709 12:11:25.226966 26671 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:25.261018 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 186002us
I20260709 12:11:25.262112 23125 raft_consensus.cc:1240] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:25.273268 23117 raft_consensus.cc:1240] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:25.238111 26784 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:25.281687 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:25.299827 23121 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 10.
I20260709 12:11:25.222329 26740 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:25.287693 26705 raft_consensus.cc:2804] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:25.230921 26821 consensus_queue.cc:1059] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 12:11:25.292079 26427 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:25.293319 26444 consensus_queue.cc:1048] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:11:25.296563 26579 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:25.257462 26774 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.283023 22603 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
I20260709 12:11:25.257462 26597 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:25.260479 26782 raft_consensus.cc:697] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:25.267474 26671 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.312186 22603 raft_consensus.cc:1275] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
W20260709 12:11:25.282851 26805 consensus_meta.cc:287] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.515s	user 0.004s	sys 0.011s
I20260709 12:11:25.312706 22603 pending_rounds.cc:85] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting all ops after (but not including) 5
I20260709 12:11:25.142787 26766 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:25.315693 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:25.316197 26597 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:25.324028 23116 raft_consensus.cc:2393] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 10: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:25.315280 22603 pending_rounds.cc:107] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:11:25.299335 26784 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:25.305045 26705 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:25.329104 22456 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
I20260709 12:11:25.325023 22603 raft_consensus.cc:2889] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:25.312034 26693 raft_consensus.cc:2764] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 12:11:25.359068 22495 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:25.366142 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:25.367159 23117 raft_consensus.cc:2410] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 12 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 12:11:25.367589 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 130932us
I20260709 12:11:25.346830 26784 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:25.370934 22570 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:25.360960 26705 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.360561 26425 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.374807 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:11:25.374490 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 116606us
I20260709 12:11:25.282407 26829 consensus_queue.cc:1048] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 12:11:25.375386 23125 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:25.316421 26805 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:25.367044 26417 raft_consensus.cc:2804] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:25.316598 26774 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:25.381543 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:25.376132 26427 raft_consensus.cc:2749] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:25.394680 23121 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 10.
I20260709 12:11:25.395934 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:25.396587 23119 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
I20260709 12:11:25.324258 26431 consensus_queue.cc:237] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:25.374142 22570 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:25.384621 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 148726us
I20260709 12:11:25.405442 22453 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
W20260709 12:11:25.406574 26826 log.cc:927] Time spent T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 12:11:25.411999 23089 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:25.414306 26579 raft_consensus.cc:2749] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:25.385037 26795 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:25.390790 26616 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:25.391326 26444 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.378041 26425 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:25.397639 26597 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:25.393020 26417 raft_consensus.cc:697] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:25.435084 22495 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:25.428637 23125 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
I20260709 12:11:25.444105 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:25.442384 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:25.448521 22453 raft_consensus.cc:1240] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:25.423789 26823 raft_consensus.cc:2749] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:25.451869 26805 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:25.393328 26782 consensus_queue.cc:237] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:25.445936 26800 raft_consensus.cc:2804] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:25.442847 26771 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:25.424829 26444 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:25.444145 26676 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.490685 26766 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:25.455170 26427 consensus_queue.cc:1048] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:11:25.491622 26680 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:25.500690 26740 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:25.492573 26800 raft_consensus.cc:697] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:25.499439 26805 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.514590 22455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2458) took 2101 ms. Trace:
I20260709 12:11:25.519606 22455 rpcz_store.cc:276] 0709 12:11:23.412973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.441326 (+ 28353us) service_pool.cc:224] Handling call
0709 12:11:23.445308 (+  3982us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:24.742216 (+1296908us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:25.514313 (+772097us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b5400242a54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:25.514521 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2966157184}
I20260709 12:11:25.515981 26425 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:25.522886 26444 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:25.523409 26774 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:25.505951 26676 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:25.537104 26676 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:25.537845 26784 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:25.524765 26805 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:25.541033 26805 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:25.502355 26417 consensus_queue.cc:237] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:25.514850 26671 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:25.561200 22601 raft_consensus.cc:1240] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:11:25.541195 26784 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:11:25.575332 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 159626us
I20260709 12:11:25.578518 22570 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:11:25.587814 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 325753us
I20260709 12:11:25.561653 26800 consensus_queue.cc:237] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:25.616937 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:25.618656 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:25.619350 22455 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:25.623993 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:25.624641 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:25.623559 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:25.625401 22454 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 9.
I20260709 12:11:25.608637 26676 consensus_queue.cc:1059] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:11:25.627209 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:25.627648 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:25.627928 22456 raft_consensus.cc:2368] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 10. Current term is 11.
I20260709 12:11:25.626854 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:25.628222 22450 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 9.
I20260709 12:11:25.604630 26832 raft_consensus.cc:2804] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:25.632097 26832 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:25.632423 26832 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:25.600128 26805 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.637034 22455 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:11:25.585886 26798 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:25.640872 22569 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:25.641727 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:25.643195 22453 raft_consensus.cc:2393] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 10: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:25.611147 26414 consensus_queue.cc:1059] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:11:25.629474 26766 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:25.646132 26766 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:25.646823 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:25.648357 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:25.649613 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:25.630247 26728 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.644729 26805 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:25.650735 26728 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:25.651670 26689 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:25.652233 26689 raft_consensus.cc:697] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 13 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:25.653152 26805 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:25.653098 26689 consensus_queue.cc:237] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:25.660156 26769 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:25.637424 26705 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:25.661110 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:25.661684 22457 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2461) took 1999 ms. Trace:
I20260709 12:11:25.662071 22457 rpcz_store.cc:276] 0709 12:11:23.662832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.664005 (+  1173us) service_pool.cc:224] Handling call
0709 12:11:25.661524 (+1997519us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b540019b4d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:25.661619 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2482859776}
I20260709 12:11:25.612931 26788 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:25.663111 26721 raft_consensus.cc:3055] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:25.710831 26721 raft_consensus.cc:740] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:25.711091 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:25.711755 26721 consensus_queue.cc:260] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:25.654399 26728 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:25.668514 26798 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:25.588577 26784 consensus_queue.cc:1048] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 12:11:25.669116 26660 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:25.714848 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:25.725571 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:25.732218 23124 raft_consensus.cc:2393] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 10: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:25.721989 23125 raft_consensus.cc:1275] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:11:25.723400 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:25.715287 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:25.733927 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:25.734072 22421 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
W20260709 12:11:25.730046 26778 log.cc:927] Time spent T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 1.433s	user 0.004s	sys 0.006s
I20260709 12:11:25.731139 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:25.734555 23125 raft_consensus.cc:1813] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Handling vote request from an unknown peer c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:25.733577 23123 raft_consensus.cc:2393] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 9: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:25.736833 23117 raft_consensus.cc:2393] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 10: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:25.733572 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:25.736836 23125 raft_consensus.cc:2393] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 9: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:25.734122 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:25.713407 23087 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:25.735414 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:25.737856 22454 raft_consensus.cc:2393] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 11: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:25.669966 26805 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:25.738564 23087 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:25.724242 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:25.741050 22421 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:25.728587 26832 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:25.730548 22599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45562 (request call id 2322) took 1235 ms. Trace:
I20260709 12:11:25.743026 23087 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:25.744047 23087 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:25.741801 26771 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:25.748258 26819 raft_consensus.cc:2804] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:25.748714 26819 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:25.749114 26819 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.726274 26766 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:25.742205 22599 rpcz_store.cc:276] 0709 12:11:24.491249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.491667 (+   418us) service_pool.cc:224] Handling call
0709 12:11:25.724566 (+1232899us) spinlock_profiling.cc:243] Waited 651 ms on lock 0x7b54002df854. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:25.726176 (+  1610us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1497945472}
I20260709 12:11:25.752935 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:25.753265 23087 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:25.753539 22599 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 9.
I20260709 12:11:25.724503 26705 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:25.756664 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:25.713009 26721 raft_consensus.cc:3060] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.761790 26771 raft_consensus.cc:2804] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:25.762169 26771 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:25.751895 26579 raft_consensus.cc:2749] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:25.762516 26771 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.754570 26728 raft_consensus.cc:2749] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:25.763149 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.767670 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:25.755112 26828 raft_consensus.cc:2749] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:25.754132 26769 consensus_queue.cc:1048] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 12:11:25.769439 22605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2318) took 2040 ms. Trace:
I20260709 12:11:25.770346 26765 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:25.777758 26771 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:25.769845 22605 rpcz_store.cc:276] 0709 12:11:23.729350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.731752 (+  2402us) service_pool.cc:224] Handling call
0709 12:11:23.732062 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:23.807470 (+ 75408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:23.807514 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:23.808107 (+   593us) log.cc:844] Serialized 26 byte log entry
0709 12:11:24.145022 (+336915us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:24.145091 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.145198 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:25.729486 (+1584288us) spinlock_profiling.cc:243] Waited 4.02 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:11:25.769150 (+ 39664us) raft_consensus.cc:1685] finished
0709 12:11:25.769171 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:25.769374 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":86184,"raft.queue_time_us":79120,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":23298,"spinlock_wait_cycles":10905600,"thread_start_us":267930,"threads_started":1,"wal-append.queue_time_us":388102}
I20260709 12:11:25.784286 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:25.784825 22605 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 9.
I20260709 12:11:25.774415 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:25.775617 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:25.785790 23123 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:11:25.773233 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:25.781279 22606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2697) took 1119 ms. Trace:
I20260709 12:11:25.786795 22599 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 8.
I20260709 12:11:25.786787 22606 rpcz_store.cc:276] 0709 12:11:24.661760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.662475 (+   715us) service_pool.cc:224] Handling call
0709 12:11:24.670042 (+  7567us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:25.019787 (+349745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:25.781035 (+761248us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b540013c754. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:25.781215 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":763503360}
I20260709 12:11:25.796512 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:25.788360 22603 raft_consensus.cc:2393] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 11: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:25.797559 23124 raft_consensus.cc:1240] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:25.802707 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:25.752326 26798 raft_consensus.cc:2749] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:25.791293 23087 leader_election.cc:400] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 election: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 10. Current term is 11.
I20260709 12:11:25.803567 23087 leader_election.cc:403] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:11:25.804296 22422 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:25.805055 26839 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.805510 26839 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:25.805943 26771 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:25.806268 26728 raft_consensus.cc:2804] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:25.806681 26728 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:25.807039 26728 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.807220 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:25.807706 26839 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:25.807879 22606 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 10.
I20260709 12:11:25.808848 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:25.810132 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 49420us
I20260709 12:11:25.787958 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:25.811041 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:25.811872 22599 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
I20260709 12:11:25.812000 22605 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 12.
I20260709 12:11:25.812546 23124 raft_consensus.cc:1240] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:25.811084 23087 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:25.797209 25675 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:25.800200 26769 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:25.752391 26660 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:25.753489 26805 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:25.813120 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:25.940873 26667 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.941414 26667 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:25.815397 26771 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:25.826124 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:25.943766 23124 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 10.
I20260709 12:11:25.944703 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:25.944989 26686 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.802052 26788 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:25.945369 26810 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:25.945590 26686 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:25.822691 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:25.859340 26828 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:25.947965 26828 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:25.950587 22497 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:25.950752 22600 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 9.
I20260709 12:11:25.952467 26782 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:25.953172 22600 raft_consensus.cc:1240] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:25.953125 22497 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:25.953579 26782 consensus_queue.cc:1048] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:25.954533 22600 raft_consensus.cc:1240] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:25.955130 26752 raft_consensus.cc:2749] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:25.954435 22497 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:25.956233 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 145245us
I20260709 12:11:25.813087 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:25.957625 22497 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:25.957876 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:25.958424 23123 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:25.959728 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:25.961257 26672 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:25.961412 26810 raft_consensus.cc:2804] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:25.961805 26810 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:25.961186 26685 raft_consensus.cc:2749] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:25.963645 22497 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:25.945389 23124 raft_consensus.cc:2393] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 9: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
W20260709 12:11:25.968204 22597 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45576 (request call id 2687) took 2237 ms (client timeout 2536 ms). Trace:
I20260709 12:11:25.968408 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:25.969276 23124 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:25.817808 22422 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:11:25.969678 22597 rpcz_store.cc:269] 0709 12:11:23.730480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.780175 (+ 49695us) service_pool.cc:224] Handling call
0709 12:11:25.968052 (+2187877us) spinlock_profiling.cc:243] Waited 849 ms on lock 0x7b54000e9f54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:25.968149 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1953325568}
I20260709 12:11:25.972257 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:25.962342 26810 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:25.996091 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:25.837306 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:25.969185 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:25.933252 26793 log.cc:927] Time spent T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 1.299s	user 0.000s	sys 0.003s
I20260709 12:11:25.906313 26798 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.000599 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:25.929999 26832 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:25.970376 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 152678us
I20260709 12:11:26.003244 22497 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:26.006518 22497 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:25.842685 26431 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.001586 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:26.003504 22601 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
I20260709 12:11:25.967511 26624 raft_consensus.cc:2804] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:26.010228 22497 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:25.955708 26782 consensus_queue.cc:1048] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.049s
W20260709 12:11:26.146500 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 138431us
I20260709 12:11:25.960189 26828 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:25.998370 26685 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:25.997632 26074 raft_consensus.cc:2804] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:25.935204 26684 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:25.963896 26769 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:26.008734 26752 raft_consensus.cc:2749] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:25.921268 26819 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:26.122941 26734 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.123414 26766 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:26.163139 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 153014us
I20260709 12:11:26.163540 23123 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11.
I20260709 12:11:26.122371 26764 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:26.123137 26825 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:26.130203 26669 raft_consensus.cc:2804] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:26.148969 26850 log.cc:927] Time spent T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.413s	user 0.001s	sys 0.000s
W20260709 12:11:26.181072 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.257423 26823 raft_consensus.cc:3055] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:26.146858 26624 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.042050 26798 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:26.288703 26798 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:26.233177 26734 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:26.243014 26760 log.cc:927] Time spent T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 2.329s	user 0.000s	sys 0.003s
I20260709 12:11:26.297508 26734 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:26.298295 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:26.298923 22453 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:26.129976 26431 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:26.301462 26431 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:26.303381 22451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 1935) took 2425 ms. Trace:
I20260709 12:11:26.303906 22451 rpcz_store.cc:276] 0709 12:11:23.878012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.878151 (+   139us) service_pool.cc:224] Handling call
0709 12:11:23.915621 (+ 37470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:24.709093 (+793472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:26.303135 (+1594042us) spinlock_profiling.cc:243] Waited 779 ms on lock 0x7b5400199954. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:26.303317 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1790872320}
I20260709 12:11:26.306080 26624 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:26.251418 26671 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:26.307307 22604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2324) took 1327 ms. Trace:
I20260709 12:11:26.251487 26728 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:26.252300 26588 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:26.166821 26417 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:26.309324 26417 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.309690 26417 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:26.310456 26728 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:26.236244 26839 consensus_queue.cc:1059] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 12:11:26.312920 22530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 2180) took 1632 ms. Trace:
I20260709 12:11:26.313376 26839 raft_consensus.cc:3055] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:26.313930 26839 raft_consensus.cc:740] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:26.314410 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:26.233490 26825 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:26.237478 26766 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:26.159827 26074 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.164335 26667 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:26.232236 26669 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:26.276329 26823 raft_consensus.cc:740] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:26.160071 26685 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:26.280630 26660 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:26.283811 26819 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:26.231323 26764 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:26.307866 22604 rpcz_store.cc:276] 0709 12:11:24.979662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.228155 (+248493us) service_pool.cc:224] Handling call
0709 12:11:25.228500 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:25.271198 (+ 42698us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:25.271226 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:25.271266 (+    40us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:25.271304 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:26.307004 (+1035700us) spinlock_profiling.cc:243] Waited 34.9 ms on lock 0x7b54000e9a54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:26.307073 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:26.307234 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":80208768}
I20260709 12:11:26.314605 22448 raft_consensus.cc:1240] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:26.265400 26842 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:26.161032 26743 consensus_queue.cc:1059] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.110s
I20260709 12:11:26.226410 22497 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:26.265296 26742 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:26.322597 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:26.317610 22455 raft_consensus.cc:1240] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:26.319766 22453 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 10.
I20260709 12:11:26.310871 26790 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:26.263468 26733 consensus_queue.cc:1059] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 12:11:26.319566 26074 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:26.488337 22421 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
W20260709 12:11:26.489959 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 263736us
W20260709 12:11:26.491103 23124 consensus_meta.cc:287] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.521s	user 0.009s	sys 0.000s
I20260709 12:11:26.491565 23124 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11.
I20260709 12:11:26.493182 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:26.494087 23124 raft_consensus.cc:2368] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 7. Current term is 8.
I20260709 12:11:26.313455 22530 rpcz_store.cc:276] 0709 12:11:24.680210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.681101 (+   891us) service_pool.cc:224] Handling call
0709 12:11:24.701993 (+ 20892us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:24.730694 (+ 28701us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:24.730745 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:24.765617 (+ 34872us) log.cc:844] Serialized 52 byte log entry
0709 12:11:24.876994 (+111377us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:24.877033 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:26.312361 (+1435328us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b5400261e54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:26.312443 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:26.312508 (+    65us) raft_consensus.cc:1685] finished
0709 12:11:26.312526 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:26.312813 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6069,"raft.queue_time_us":39916,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":104,"spinlock_wait_cycles":50931072,"thread_start_us":110977,"threads_started":1,"wal-append.queue_time_us":93007,"wal-append.run_cpu_time_us":2796,"wal-append.run_wall_time_us":1009338}
I20260709 12:11:26.476060 23122 raft_consensus.cc:1240] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:26.445258 26731 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 12:11:26.503963 26800 consensus_queue.cc:1059] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:26.499343 26611 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:26.505532 26791 raft_consensus.cc:3055] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:26.505970 26791 raft_consensus.cc:740] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:26.506861 26805 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:26.508005 26752 raft_consensus.cc:2749] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:26.321244 26823 consensus_queue.cc:260] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:26.475483 26721 consensus_meta.cc:287] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.675s	user 0.009s	sys 0.001s
W20260709 12:11:26.475680 26853 log.cc:927] Time spent T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:11:26.513585 22421 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:26.319922 26669 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:26.449934 26778 log.cc:927] Time spent T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:11:26.324150 26674 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:26.526893 26611 raft_consensus.cc:2749] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:11:26.527413 26855 log.cc:927] Time spent T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:11:26.326933 26685 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:26.484900 26686 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:26.319902 26769 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:26.318773 26766 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:26.332345 26801 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.323390 26771 raft_consensus.cc:2749] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 10. Current term is 11.
I20260709 12:11:26.316984 26825 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:26.537293 26688 consensus_queue.cc:1059] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 12:11:26.541887 26674 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:26.553200 23116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57328 (request call id 1236) took 1341 ms. Trace:
I20260709 12:11:26.620600 23116 rpcz_store.cc:276] 0709 12:11:25.212200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.215736 (+  3536us) service_pool.cc:224] Handling call
0709 12:11:26.552841 (+1337105us) spinlock_profiling.cc:243] Waited 98.9 ms on lock 0x7b540069ffd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:26.553075 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":227365120}
W20260709 12:11:26.555516 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 817014us
I20260709 12:11:26.555575 23120 raft_consensus.cc:1275] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:26.534417 26695 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:26.534703 26787 consensus_queue.cc:1048] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
W20260709 12:11:26.574174 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 60692.2us
I20260709 12:11:26.314957 26839 consensus_queue.cc:260] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:26.576056 22497 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:26.536572 26823 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:26.579519 26769 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:26.586898 26620 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:26.591110 22496 connection.cc:256] RPC call timeout handler was delayed by -1.1904973230000451s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1567s for a response
I20260709 12:11:26.591137 26411 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
W20260709 12:11:26.592883 26672 consensus_meta.cc:287] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.631s	user 0.010s	sys 0.000s
I20260709 12:11:26.593612 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:26.651028 23122 raft_consensus.cc:2410] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:11:26.510015 26842 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:26.510362 26742 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:26.620347 26686 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.610966 26804 consensus_queue.cc:1048] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:11:26.619854 22570 leader_election.cc:400] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 10. Current term is 11.
I20260709 12:11:26.626937 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:26.628190 22448 raft_consensus.cc:1240] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:26.633141 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:26.631546 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 399735us
I20260709 12:11:26.660297 22570 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:26.623840 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:26.633615 23089 leader_election.cc:304] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:26.662132 22448 raft_consensus.cc:1275] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:26.662446 23121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57332 (request call id 901) took 1354 ms. Trace:
I20260709 12:11:26.660519 22422 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:26.637871 22421 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:26.663412 23089 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:26.642097 22457 raft_consensus.cc:1275] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 12:11:26.643937 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 67976.8us
I20260709 12:11:26.664913 23089 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:25.208745 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:26.613442 26801 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:26.728804 26801 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:26.731905 26439 raft_consensus.cc:2804] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:26.733139 26439 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.733589 26439 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:26.741750 26624 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:26.742084 26669 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:26.609146 26074 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:26.658659 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:26.846242 22523 raft_consensus.cc:2410] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:11:26.679231 22570 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:26.659467 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:26.671387 22351 catalog_manager.cc:5697] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:11:26.662863 23121 rpcz_store.cc:276] 0709 12:11:25.307710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.307858 (+   148us) service_pool.cc:224] Handling call
0709 12:11:26.662298 (+1354440us) spinlock_profiling.cc:243] Waited 77.9 ms on lock 0x7b5400670f54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:26.662389 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":179179392}
I20260709 12:11:26.656697 26411 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:26.699563 26771 raft_consensus.cc:2804] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:26.699863 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:26.700752 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:26.701445 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:26.702883 23089 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:26.703269 26790 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:26.703984 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:26.862021 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 159231us
I20260709 12:11:26.705294 26766 raft_consensus.cc:2804] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:26.707770 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:26.708107 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:26.708249 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:11:26.863966 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 184803us
I20260709 12:11:26.864498 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:26.708813 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:26.709221 23125 raft_consensus.cc:1275] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:26.865649 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:26.709545 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:26.658478 26686 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:26.654871 26597 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.712466 22532 raft_consensus.cc:1275] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:26.872640 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:26.873353 22523 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 9.
I20260709 12:11:26.712785 26825 raft_consensus.cc:2804] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:11:26.713397 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 75594.8us
I20260709 12:11:26.845532 26805 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.877101 22421 leader_election.cc:400] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 election: Vote denied by peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353) with higher term. Message: Invalid argument: T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 7. Current term is 8.
I20260709 12:11:26.877575 22421 leader_election.cc:403] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:11:26.878458 22570 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:26.715608 26742 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:26.716799 26810 consensus_meta.cc:287] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.712s	user 0.009s	sys 0.000s
I20260709 12:11:26.717628 26764 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:26.718329 26769 raft_consensus.cc:2749] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:26.721342 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:26.707799 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:26.644318 26695 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:26.744576 26765 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:26.647202 22449 raft_consensus.cc:1240] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 10 LEADER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:26.751266 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:26.648352 26721 raft_consensus.cc:2749] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:26.754722 22598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2323) took 2238 ms. Trace:
I20260709 12:11:26.755290 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:26.757421 26770 raft_consensus.cc:3055] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:26.760875 22605 raft_consensus.cc:3055] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:26.764021 26757 raft_consensus.cc:3055] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:26.766044 26740 raft_consensus.cc:3055] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:26.776839 26842 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:26.779161 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:26.783470 23120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 904) took 1426 ms. Trace:
I20260709 12:11:26.790257 26619 consensus_queue.cc:1059] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:26.462452 26417 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:26.798305 26624 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:26.799539 22606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43070 (request call id 665) took 1220 ms. Trace:
I20260709 12:11:26.809496 26839 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:26.811205 22451 raft_consensus.cc:1275] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:26.812146 26768 raft_consensus.cc:3055] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:26.813870 22454 raft_consensus.cc:1275] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:11:26.822178 26795 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:26.822657 26797 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.823562 22452 raft_consensus.cc:1275] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:26.827548 26611 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:26.831504 26869 log.cc:927] Time spent T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.054s	user 0.008s	sys 0.004s
I20260709 12:11:26.834270 26827 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.834914 23119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 1039) took 1032 ms. Trace:
I20260709 12:11:26.837558 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:26.792016 22496 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:26.846143 23123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 1245) took 1069 ms. Trace:
I20260709 12:11:26.645675 26743 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:26.822395 26685 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:26.854586 22528 raft_consensus.cc:1813] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Handling vote request from an unknown peer c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:26.858484 22526 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
I20260709 12:11:26.861099 26669 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:26.862907 23089 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:26.868009 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:26.868978 23118 raft_consensus.cc:1275] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:26.871809 22600 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:26.874095 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:26.879211 23087 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:26.884603 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:26.861948 26771 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:26.818856 26674 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:27.045431 26790 raft_consensus.cc:2749] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:27.090087 26816 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.123405 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:27.123942 26816 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:27.125936 26616 raft_consensus.cc:2804] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:27.039530 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:26.920562 26805 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:27.126508 26616 raft_consensus.cc:697] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 10 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:27.127285 26740 raft_consensus.cc:740] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:27.127607 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:27.128516 22599 raft_consensus.cc:2393] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 11: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:27.128053 26616 consensus_queue.cc:237] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:27.128396 26740 consensus_queue.cc:260] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:27.130072 26740 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:26.995407 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:27.047722 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:27.023540 22351 catalog_manager.cc:5697] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:11:27.146181 22528 raft_consensus.cc:2393] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 9: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
W20260709 12:11:27.142217 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 350272us
W20260709 12:11:27.055482 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 177072us
I20260709 12:11:26.909401 26074 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:27.143481 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 280612us
I20260709 12:11:27.142761 22531 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 9.
I20260709 12:11:27.155938 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:27.156903 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:27.157794 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:26.911265 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:27.082947 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:27.158883 23125 raft_consensus.cc:2393] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 9: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
W20260709 12:11:27.052021 22355 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55980 (request call id 373) took 27908 ms (client timeout 15000 ms). Trace:
W20260709 12:11:27.145998 22450 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.008s	sys 0.034s
W20260709 12:11:27.160351 22450 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.009s	sys 0.034s
I20260709 12:11:27.144536 23119 rpcz_store.cc:276] 0709 12:11:25.802400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.331699 (+529299us) service_pool.cc:224] Handling call
0709 12:11:26.332161 (+   462us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:26.332618 (+   457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:26.332663 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:26.483282 (+150619us) log.cc:844] Serialized 26 byte log entry
0709 12:11:26.773849 (+290567us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:11:26.775646 (+  1797us) log.cc:844] Serialized 14 byte log entry
0709 12:11:26.775864 (+   218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:26.775938 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:26.834721 (+ 58783us) raft_consensus.cc:1685] finished
0709 12:11:26.834740 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:26.834864 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":653,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":56461,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":9479,"thread_start_us":240130,"threads_started":1,"wal-append.queue_time_us":288319}
I20260709 12:11:27.148015 22605 raft_consensus.cc:740] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:26.984432 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:27.143007 23123 rpcz_store.cc:276] 0709 12:11:25.776874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.233285 (+456411us) service_pool.cc:224] Handling call
0709 12:11:26.233616 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:26.234148 (+   532us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:26.234178 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:26.234672 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 12:11:26.646810 (+412138us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:26.647170 (+   360us) log.cc:844] Serialized 14 byte log entry
0709 12:11:26.650074 (+  2904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:26.650150 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:26.845875 (+195725us) raft_consensus.cc:1685] finished
0709 12:11:26.845904 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:26.846069 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":145,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":4625,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":26428,"thread_start_us":411765,"threads_started":1,"wal-append.queue_time_us":540194}
I20260709 12:11:27.162005 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:27.144062 23120 rpcz_store.cc:276] 0709 12:11:25.356917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.357115 (+   198us) service_pool.cc:224] Handling call
0709 12:11:26.555097 (+1197982us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:26.622484 (+ 67387us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:26.783263 (+160779us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b540069ffd0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:26.783403 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2737427840}
I20260709 12:11:27.151644 22570 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:27.143668 22606 rpcz_store.cc:276] 0709 12:11:25.578977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.947167 (+368190us) service_pool.cc:224] Handling call
0709 12:11:25.996992 (+ 49825us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:26.145501 (+148509us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:26.145532 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:26.148472 (+  2940us) log.cc:844] Serialized 26 byte log entry
0709 12:11:26.279489 (+131017us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b1800144d60. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc7823e07 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc7840c02 00007f9cca4c820b 00007f9cca4cdd23 00007f9cca4ce0d1 00007f9cca8e9a0f
0709 12:11:26.774719 (+495230us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:26.774761 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:26.774821 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:26.774875 (+    54us) raft_consensus.cc:1685] finished
0709 12:11:26.774887 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:26.799480 (+ 24593us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":137042,"raft.queue_time_us":151363,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":63251,"spinlock_wait_cycles":2691328,"thread_start_us":495053,"threads_started":1,"wal-append.queue_time_us":604641}
I20260709 12:11:27.141276 22457 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
I20260709 12:11:26.969209 26833 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:26.883852 26825 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:27.152904 26764 raft_consensus.cc:2804] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:27.148408 22598 rpcz_store.cc:276] 0709 12:11:24.516518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.517333 (+   815us) service_pool.cc:224] Handling call
0709 12:11:24.518552 (+  1219us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:26.244700 (+1726148us) spinlock_profiling.cc:243] Waited 2.38 ms on lock 0x7b180046a200. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cca4d64bc 00007f9cc782448b 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc783e455 00007f9cca926060 00007f9cca926bfb 00007f9cca93164b
0709 12:11:26.244849 (+   149us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:26.244879 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:26.245521 (+   642us) log.cc:844] Serialized 52 byte log entry
0709 12:11:26.532096 (+286575us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:26.532121 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:26.532213 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:26.754276 (+222063us) raft_consensus.cc:1685] finished
0709 12:11:26.754304 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:26.754621 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":470105,"raft.queue_time_us":499834,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":5888,"spinlock_wait_cycles":5485312,"thread_start_us":359868,"threads_started":2,"wal-append.queue_time_us":415726}
I20260709 12:11:27.147424 23088 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:26.875901 26690 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:27.143224 22530 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
W20260709 12:11:27.131471 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 252307us
I20260709 12:11:26.869724 26766 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:27.163007 22450 raft_consensus.cc:2368] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 11. Current term is 12.
I20260709 12:11:26.914901 26667 consensus_queue.cc:1048] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.247s
I20260709 12:11:27.168394 22601 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
I20260709 12:11:26.869247 26823 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.200275 22351 catalog_manager.cc:5697] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:11:27.176872 22457 raft_consensus.cc:1240] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:27.153954 26768 raft_consensus.cc:740] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:27.183315 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:27.219483 23122 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
I20260709 12:11:27.183712 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:26.875811 26427 raft_consensus.cc:2749] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:27.188295 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:26.871704 26592 raft_consensus.cc:2804] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:27.188848 22496 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:26.912392 26821 consensus_queue.cc:1048] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.285s
I20260709 12:11:27.182940 26819 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.192905 22529 raft_consensus.cc:1240] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:11:27.131300 26800 raft_consensus.cc:3055] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:27.075052 26672 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.130791 22599 raft_consensus.cc:1240] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:11:27.196514 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:27.187933 26764 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:27.246050 22523 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 9.
I20260709 12:11:26.995546 26729 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:27.197623 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:27.153741 26771 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:27.199563 22600 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 10.
I20260709 12:11:27.023566 26411 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:27.025017 26686 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:27.261858 22497 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:27.200366 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:27.163369 26816 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:27.192220 26619 consensus_queue.cc:1048] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:11:27.163875 26611 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:27.163764 26827 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:27.203603 26417 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:27.244788 26800 raft_consensus.cc:740] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:27.252748 26764 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:27.153613 26733 raft_consensus.cc:2749] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353) with higher term. Message: Invalid argument: T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 7. Current term is 8.
I20260709 12:11:27.154243 26770 raft_consensus.cc:740] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
W20260709 12:11:27.332403 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 142543us
I20260709 12:11:27.176589 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:27.162360 26802 raft_consensus.cc:2804] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:27.178850 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:27.219612 22531 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 11.
I20260709 12:11:27.259828 26616 raft_consensus.cc:2764] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:11:26.920077 26810 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:27.169380 26805 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:26.885731 26652 consensus_queue.cc:1059] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.310s
I20260709 12:11:26.883402 26597 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:27.187773 26825 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:27.189553 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:27.223423 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:11:27.227639 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 80292.7us
I20260709 12:11:27.229535 23124 raft_consensus.cc:1275] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:27.232983 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:27.234038 22495 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:27.164039 26797 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:27.214807 22351 catalog_manager.cc:5697] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 3 to 8, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 8 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:11:26.910346 26684 consensus_queue.cc:1059] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.297s
I20260709 12:11:26.969612 26742 consensus_queue.cc:1048] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.238s
W20260709 12:11:27.242419 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.336022 26868 raft_consensus.cc:2749] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:26.912604 26694 consensus_queue.cc:1059] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.300s
I20260709 12:11:26.915719 26661 raft_consensus.cc:2749] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:27.209165 26766 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:27.197521 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:27.162643 26743 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:27.253556 22601 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:27.163555 26795 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:27.146811 26765 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:27.269085 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:27.207077 26801 consensus_queue.cc:1048] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
W20260709 12:11:27.296911 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 131802us
I20260709 12:11:27.303370 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:27.144770 26757 raft_consensus.cc:740] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:27.301429 26752 raft_consensus.cc:2804] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:27.002017 26791 consensus_queue.cc:260] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:27.221416 26823 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:27.248709 26819 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:27.208305 26690 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:27.313657 26800 consensus_queue.cc:260] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:27.251849 26672 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:27.271298 26729 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:27.189188 26833 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:27.318342 22422 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:27.319942 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:27.320236 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:27.405042 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 86801.4us
I20260709 12:11:27.223443 26666 consensus_queue.cc:1048] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
W20260709 12:11:27.329612 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 139772us
I20260709 12:11:27.330454 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:26.830274 26439 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:27.334265 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:27.183987 22456 raft_consensus.cc:1240] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:27.338155 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:27.338183 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:27.335379 22570 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:27.340345 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:27.410228 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 74957.9us
I20260709 12:11:27.410523 22529 raft_consensus.cc:2393] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 9: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:27.341256 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:27.410808 22452 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
W20260709 12:11:27.159658 22355 rpcz_store.cc:269] 0709 12:10:59.143078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.147109 (+  4031us) service_pool.cc:224] Handling call
0709 12:11:27.051558 (+27904449us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:18.637548 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:18.652836 (+ 15288us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:18.652873 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:11:18.652893 (+    20us) tablet.cc:662] Decoding operations
0709 12:11:18.764059 (+111166us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:18.770689 (+  6630us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:18.773376 (+  2687us) tablet.cc:685] Acquiring locks for 17 operations
0709 12:11:19.118639 (+345263us) tablet.cc:701] Row locks acquired
0709 12:11:19.118666 (+    27us) write_op.cc:260] PREPARE: finished
0709 12:11:19.118836 (+   170us) write_op.cc:270] Start()
0709 12:11:19.118954 (+   118us) write_op.cc:276] Timestamp: P: 1783599079118788 usec, L: 0
0709 12:11:19.119001 (+    47us) op_driver.cc:348] REPLICATION: starting
0709 12:11:19.323398 (+204397us) log.cc:844] Serialized 6747 byte log entry
0709 12:11:19.448170 (+124772us) op_driver.cc:464] REPLICATION: finished
0709 12:11:19.619145 (+170975us) write_op.cc:301] APPLY: starting
0709 12:11:19.619364 (+   219us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:19.622068 (+  2704us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:19.622938 (+   870us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:19.656639 (+ 33701us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:19.657373 (+   734us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=34
0709 12:11:19.657638 (+   265us) write_op.cc:312] APPLY: finished
0709 12:11:19.661324 (+  3686us) spinlock_profiling.cc:243] Waited 29.2 ms on lock 0x7b5400198a54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca929e28 00007f9cce364581 00007f9cce363d58 00007f9cce3689f1 00007f9cce3689a9 00007f9cce368939 00007f9cce368901 00007f9cce367b2d 0000000000388634 0000000000388479
0709 12:11:19.663490 (+  2166us) log.cc:844] Serialized 119 byte log entry
0709 12:11:19.665443 (+  1953us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:19.666886 (+  1443us) write_op.cc:454] Released schema lock
0709 12:11:19.667022 (+   136us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:19.668165 (+  1143us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:19.668195 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":238216,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":170577,"apply.run_cpu_time_us":7831,"apply.run_wall_time_us":48933,"num_ops":17,"prepare.queue_time_us":568088,"prepare.run_cpu_time_us":27129,"prepare.run_wall_time_us":1047984,"raft.queue_time_us":1837,"raft.run_cpu_time_us":18591,"raft.run_wall_time_us":171365,"replication_time_us":328977,"spinlock_wait_cycles":67120896,"thread_start_us":569285,"threads_started":4,"wal-append.queue_time_us":116211,"wal-append.run_cpu_time_us":4876,"wal-append.run_wall_time_us":1223017}]]}
W20260709 12:11:27.348551 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 114595us
I20260709 12:11:27.407697 22496 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:27.413906 22495 leader_election.cc:400] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 election: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 11. Current term is 12.
I20260709 12:11:27.414783 22457 raft_consensus.cc:1240] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 10. Current term is 12. Ops: []
I20260709 12:11:27.330965 26685 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:27.349809 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:27.329155 26695 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:27.352388 22527 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 9.
I20260709 12:11:27.353618 22528 raft_consensus.cc:1275] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:27.243546 23122 raft_consensus.cc:1275] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:11:27.351533 26816 raft_consensus.cc:2804] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:27.357961 22351 catalog_manager.cc:5697] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:27.358832 26797 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:27.424345 26816 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:27.426877 26816 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:27.427397 26695 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:27.427946 26695 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:27.432624 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:27.432904 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:27.433365 22600 raft_consensus.cc:2368] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 9. Current term is 10.
I20260709 12:11:27.435071 26816 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:27.436681 26439 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:27.437237 26816 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:27.436779 22605 consensus_queue.cc:260] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:27.438148 22605 raft_consensus.cc:3060] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:27.440759 26729 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:27.335842 26802 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:27.441311 26802 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:27.442735 26672 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:27.352335 26877 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:27.447257 26877 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:27.448086 26690 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:27.422318 26757 consensus_queue.cc:260] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:27.449360 26877 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:27.449530 26757 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:27.368921 22597 raft_consensus.cc:1275] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:27.450533 23088 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:27.450958 22597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2342) took 1442 ms. Trace:
I20260709 12:11:27.451362 22597 rpcz_store.cc:276] 0709 12:11:26.009131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.009282 (+   151us) service_pool.cc:224] Handling call
0709 12:11:26.009603 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:27.450049 (+1440446us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:27.450711 (+   662us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54003ae3d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:27.450887 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3117633280}
I20260709 12:11:27.452453 26805 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.452976 26805 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:27.453673 22351 catalog_manager.cc:5697] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 7 to 8, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 8 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:11:27.454555 26667 raft_consensus.cc:3055] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:27.347877 26592 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:27.378790 22598 raft_consensus.cc:1240] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:27.380659 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 150406us
I20260709 12:11:27.412137 26742 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.415180 26694 raft_consensus.cc:2804] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:27.372084 26770 consensus_queue.cc:260] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:27.418025 26721 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:27.358959 26810 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:27.393961 23089 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:27.395576 22532 raft_consensus.cc:1240] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:11:27.396977 22453 raft_consensus.cc:2410] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 12:11:27.463594 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.376288 22599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1143406a95dd472688b2fe621abd815f"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:11:27.383371 26765 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:27.401458 22451 raft_consensus.cc:1240] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:27.470929 22497 leader_election.cc:400] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 election: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 9. Current term is 10.
I20260709 12:11:27.471308 22497 leader_election.cc:403] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:11:27.249749 26875 raft_consensus.cc:2804] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:27.405473 22526 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 9.
I20260709 12:11:27.409438 22450 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 8.
I20260709 12:11:27.411345 22523 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 10.
I20260709 12:11:27.291479 26790 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.419154 23123 raft_consensus.cc:1240] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:27.422073 23122 pending_rounds.cc:85] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270: Aborting all ops after (but not including) 8
I20260709 12:11:27.479621 23122 pending_rounds.cc:107] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:11:27.479998 23122 raft_consensus.cc:2889] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:27.400840 26752 raft_consensus.cc:697] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:27.404778 26791 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:27.416695 22496 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:11:27.405754 26624 consensus_queue.cc:1175] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6c6fa11e8ee34711b3551f0c670442bc" responder_term: 10 status { last_received { term: 10 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 10 index: 10 } }
I20260709 12:11:27.359905 26876 raft_consensus.cc:3055] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:27.459316 26770 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:27.455334 26592 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:27.409706 26842 raft_consensus.cc:2804] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:11:27.457408 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.465941 22599 raft_consensus.cc:606] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Received request to transfer leadership to TS c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:27.505752 22599 raft_consensus.cc:614] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:27.459280 22525 raft_consensus.cc:2393] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 10: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:27.459563 22454 raft_consensus.cc:2410] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 12:11:27.463145 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 69313.7us
I20260709 12:11:27.466431 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:27.458050 26694 raft_consensus.cc:697] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:27.327346 26768 consensus_queue.cc:260] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:27.393623 22601 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 12.
I20260709 12:11:27.473397 22606 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 13.
I20260709 12:11:27.489878 22603 raft_consensus.cc:1240] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 13 LEADER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:27.490257 22351 catalog_manager.cc:5697] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: config changed from index 5 to 7, term changed from 6 to 7, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to <none>, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New cstate: current_term: 7 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
W20260709 12:11:27.489580 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.452214 23088 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:27.494175 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:27.498703 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 82320.7us
I20260709 12:11:27.516568 22496 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:27.488754 26779 consensus_queue.cc:1048] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:11:27.483223 26877 raft_consensus.cc:2749] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:27.510702 22569 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:27.501067 26802 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:27.454962 26805 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:27.455600 26611 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:27.385435 22602 raft_consensus.cc:2393] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 10: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:27.452256 26819 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:27.472559 26616 raft_consensus.cc:2749] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:27.458926 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:27.455152 26667 raft_consensus.cc:740] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:27.507484 23124 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:11:27.494814 26876 raft_consensus.cc:740] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
W20260709 12:11:27.521296 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 105468us
I20260709 12:11:27.536561 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:27.559355 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.488912 26790 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:27.572335 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 47479us
I20260709 12:11:27.457046 26742 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:27.423882 26878 consensus_queue.cc:1059] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.114s
I20260709 12:11:27.602066 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:27.490061 26810 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:27.894126 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:27.685997 22421 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 1.715s (SENT) [suppressed 5 similar messages]
I20260709 12:11:27.746281 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:27.503424 26801 raft_consensus.cc:2804] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:27.600782 22351 catalog_manager.cc:5697] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:27.841692 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:28.051529 23125 raft_consensus.cc:2410] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 12 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:11:28.040112 23122 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:11:27.685711 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:28.056207 23119 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 10.
W20260709 12:11:28.035323 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 518787us
I20260709 12:11:28.040870 22599 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 12.
I20260709 12:11:27.457758 26743 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:27.863667 23087 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.003s	sys 0.012s
I20260709 12:11:28.046177 23089 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:28.090955 23087 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.856s	user 0.011s	sys 0.012s
W20260709 12:11:28.046907 22451 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.004s	sys 0.022s
W20260709 12:11:28.091555 22451 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.004s	sys 0.022s
W20260709 12:11:28.047539 22600 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.011s	sys 0.015s
W20260709 12:11:28.092355 22600 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.011s	sys 0.015s
W20260709 12:11:28.092752 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.458640 26827 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:28.051564 22351 catalog_manager.cc:5697] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 5 to 6, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 6 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:11:27.574097 26797 raft_consensus.cc:2804] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:11:27.905441 26873 log.cc:927] Time spent T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.505s	user 0.000s	sys 0.001s
W20260709 12:11:27.747890 26864 log.cc:927] Time spent T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
W20260709 12:11:27.765800 26874 log.cc:927] Time spent T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.405s	user 0.001s	sys 0.000s
W20260709 12:11:28.112488 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 71900.7us
I20260709 12:11:27.569195 26779 consensus_queue.cc:1243] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer 6c6fa11e8ee34711b3551f0c670442bc log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:11:27.524364 26842 raft_consensus.cc:697] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 10 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:27.571955 26821 consensus_queue.cc:1059] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.583s
I20260709 12:11:27.569798 26879 consensus_queue.cc:1059] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.701s
I20260709 12:11:27.603060 26733 consensus_queue.cc:1059] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.574s
I20260709 12:11:27.820442 26752 consensus_queue.cc:237] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:27.981892 26694 consensus_queue.cc:237] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:28.428172 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:28.289928 23088 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.012s	sys 0.009s
I20260709 12:11:28.269645 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:28.401170 22600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2727) took 1570 ms. Trace:
W20260709 12:11:28.432008 23088 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.917s	user 0.013s	sys 0.010s
I20260709 12:11:28.276211 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:28.226014 23122 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 12.
I20260709 12:11:28.433233 22528 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 10.
I20260709 12:11:28.323285 22524 raft_consensus.cc:1275] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:28.327462 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:28.130442 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:28.295140 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:28.434664 22530 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
W20260709 12:11:28.293370 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 247244us
I20260709 12:11:28.434886 22455 raft_consensus.cc:2468] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
W20260709 12:11:28.252957 22605 consensus_meta.cc:287] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.814s	user 0.010s	sys 0.000s
I20260709 12:11:28.435817 23089 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:28.094893 23087 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:28.436744 22605 raft_consensus.cc:1275] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 12:11:28.437165 22605 pending_rounds.cc:85] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc: Aborting all ops after (but not including) 9
I20260709 12:11:28.437429 22605 pending_rounds.cc:107] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 12:11:28.437717 22605 raft_consensus.cc:2889] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:28.438516 22605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2351) took 1680 ms. Trace:
W20260709 12:11:28.308333 22570 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.010s	sys 0.046s
W20260709 12:11:28.439383 22570 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.012s	sys 0.048s
W20260709 12:11:28.439723 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 865743us
I20260709 12:11:28.165163 22351 catalog_manager.cc:5697] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:11:28.432319 22600 rpcz_store.cc:276] 0709 12:11:26.831220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.433988 (+602768us) service_pool.cc:224] Handling call
0709 12:11:27.434380 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:27.434722 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:27.434757 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:27.481846 (+ 47089us) log.cc:844] Serialized 26 byte log entry
0709 12:11:28.092770 (+610924us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:28.092822 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.092897 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:28.400921 (+308024us) raft_consensus.cc:1685] finished
0709 12:11:28.400944 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:28.401103 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":448,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"spinlock_wait_cycles":45184,"thread_start_us":577781,"threads_started":1,"wal-append.queue_time_us":900052}
I20260709 12:11:27.783859 26819 raft_consensus.cc:2749] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:28.432833 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 980645us
I20260709 12:11:28.533857 22600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2733) took 1700 ms. Trace:
W20260709 12:11:28.498134 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.937610 26795 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:28.532900 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 438067us
W20260709 12:11:28.533376 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 96063.1us
I20260709 12:11:28.167879 26805 raft_consensus.cc:2749] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:28.382965 26757 consensus_meta.cc:287] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.933s	user 0.007s	sys 0.000s
I20260709 12:11:28.537189 22600 rpcz_store.cc:276] 0709 12:11:26.833072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.532913 (+1699841us) service_pool.cc:224] Handling call
0709 12:11:28.533280 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:28.533482 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.533505 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:28.533550 (+    45us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:28.533590 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.533650 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:28.533790 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:28.396318 26771 consensus_meta.cc:287] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 1.104s	user 0.007s	sys 0.003s
I20260709 12:11:28.448885 22605 rpcz_store.cc:276] 0709 12:11:26.757984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.760493 (+  2509us) service_pool.cc:224] Handling call
0709 12:11:26.760767 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:27.436440 (+675673us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b540014a620. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca8ac06f 00007f9cca924f60 00007f9cca9267de 00007f9cca930b49 00007f9cca931416 00007f9cca92dd8f 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62
0709 12:11:28.438241 (+1001801us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.438454 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":444353792}
I20260709 12:11:28.587136 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:28.596304 22600 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:28.447408 23088 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:28.599720 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 152377us
I20260709 12:11:28.601758 23088 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:28.409801 26765 consensus_meta.cc:287] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.921s	user 0.003s	sys 0.009s
W20260709 12:11:28.585225 26825 consensus_meta.cc:287] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 1.226s	user 0.004s	sys 0.008s
W20260709 12:11:28.384337 26839 consensus_meta.cc:287] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 1.220s	user 0.007s	sys 0.003s
I20260709 12:11:28.446023 26885 raft_consensus.cc:2749] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:28.458659 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 772623us
I20260709 12:11:28.049973 26801 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:28.153203 22450 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11.
W20260709 12:11:28.663338 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 220573us
I20260709 12:11:28.384814 26802 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:28.367008 26790 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:28.295814 26865 log.cc:927] Time spent T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:11:27.765386 26611 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.619271 26686 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:28.610045 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:28.614408 22600 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 11.
I20260709 12:11:28.649422 26771 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:28.689384 22600 raft_consensus.cc:1275] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:28.690029 22600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2735) took 1856 ms. Trace:
I20260709 12:11:28.690068 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:28.690621 26771 leader_election.cc:290] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:28.687283 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:28.030936 26823 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:28.594065 22531 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
W20260709 12:11:28.594413 26764 consensus_meta.cc:287] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 1.254s	user 0.004s	sys 0.006s
I20260709 12:11:28.646489 22351 catalog_manager.cc:5697] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 6 to 8, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 8 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:28.636432 22606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2734) took 1803 ms. Trace:
I20260709 12:11:28.696900 22606 rpcz_store.cc:276] 0709 12:11:26.833336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.635361 (+1802025us) service_pool.cc:224] Handling call
0709 12:11:28.635730 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:28.635955 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.635991 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:28.636059 (+    68us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:28.636128 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.636198 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:28.636358 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:28.673926 26805 raft_consensus.cc:2749] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:28.386226 26742 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:28.059194 26684 consensus_queue.cc:1059] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.538s
W20260709 12:11:28.656651 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 213749us
I20260709 12:11:28.703315 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:11:28.413578 26770 consensus_meta.cc:287] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.904s	user 0.007s	sys 0.001s
I20260709 12:11:28.538858 26797 raft_consensus.cc:697] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:28.583935 26889 raft_consensus.cc:2804] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:28.660094 22421 connection.cc:256] RPC call timeout handler was delayed by -1.0604650660000061s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21530000000000002s for a response
W20260709 12:11:28.711380 22421 connection.cc:256] RPC call timeout handler was delayed by -1.0307650659999581s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21860000000000002s for a response
I20260709 12:11:28.295377 22452 raft_consensus.cc:1240] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:28.660864 22448 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.013s	sys 0.016s
W20260709 12:11:28.615624 26652 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.044s	user 0.007s	sys 0.007s
W20260709 12:11:28.713603 26652 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.155s	user 0.007s	sys 0.007s
W20260709 12:11:28.321451 26875 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.008s	sys 0.011s
I20260709 12:11:28.146907 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:28.671139 22599 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.035s	sys 0.075s
W20260709 12:11:28.719301 22599 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.035s	sys 0.075s
I20260709 12:11:28.724236 22531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56940 (request call id 2192) took 2026 ms. Trace:
I20260709 12:11:28.724659 22531 rpcz_store.cc:276] 0709 12:11:26.698113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.333970 (+635857us) service_pool.cc:224] Handling call
0709 12:11:28.724048 (+1390078us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54001f2f54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:28.724152 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2725305728}
I20260709 12:11:28.725926 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:28.724669 26684 raft_consensus.cc:3055] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:28.384678 26878 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:28.727399 26597 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:28.727705 26878 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:28.729857 26597 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.729938 26878 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:28.727439 26684 raft_consensus.cc:740] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:28.731940 26684 consensus_queue.cc:260] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:28.746410 26684 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:28.645141 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.650487 26795 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.609755 26894 raft_consensus.cc:2749] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:28.655171 26821 raft_consensus.cc:3055] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:28.642071 26674 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:28.660481 26731 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.629637 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:28.692131 22455 raft_consensus.cc:2393] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 13: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:28.753562 22602 raft_consensus.cc:2393] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 12: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:28.667356 26801 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:28.690559 22600 rpcz_store.cc:276] 0709 12:11:26.833602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.688828 (+1855226us) service_pool.cc:224] Handling call
0709 12:11:28.689092 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:28.689759 (+   667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.689964 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:28.751011 26766 consensus_meta.cc:287] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 1.376s	user 0.011s	sys 0.001s
I20260709 12:11:28.643671 23116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 1051) took 1154 ms. Trace:
I20260709 12:11:28.645444 26765 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:28.699587 22351 catalog_manager.cc:5697] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 6 to 7, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 7 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:11:28.656052 26825 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:28.704648 22496 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:28.687218 26686 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:28.712901 22448 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.013s	sys 0.016s
W20260709 12:11:28.704870 26791 consensus_meta.cc:287] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 1.211s	user 0.012s	sys 0.000s
I20260709 12:11:28.351900 26876 consensus_queue.cc:260] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:28.714875 22421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.701308 26690 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.731251 26797 consensus_queue.cc:237] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:28.735322 22603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45562 (request call id 2362) took 1270 ms. Trace:
I20260709 12:11:28.114993 26616 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:28.725193 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:28.712260 26842 consensus_queue.cc:237] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:28.746502 26592 consensus_meta.cc:287] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 1.223s	user 0.010s	sys 0.000s
I20260709 12:11:28.609809 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:28.692299 26611 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:28.718994 26875 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.037s	user 0.013s	sys 0.013s
I20260709 12:11:28.711257 26889 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:28.814754 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:28.755465 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:28.815447 23125 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11.
I20260709 12:11:28.730625 26878 consensus_queue.cc:1048] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:11:28.691664 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:28.757931 22497 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:28.752590 26795 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:28.764209 26870 log.cc:927] Time spent T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.988s	user 0.007s	sys 0.018s
I20260709 12:11:28.736510 26779 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:28.788156 22600 raft_consensus.cc:1240] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:28.829878 22600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2357) took 1584 ms. Trace:
I20260709 12:11:28.830302 22600 rpcz_store.cc:276] 0709 12:11:27.245547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.787605 (+1542058us) service_pool.cc:224] Handling call
0709 12:11:28.787963 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:28.829570 (+ 41607us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.829811 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:28.831503 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:28.833088 22600 raft_consensus.cc:1240] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:28.730458 26597 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:28.788446 23116 rpcz_store.cc:276] 0709 12:11:27.489228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.489398 (+   170us) service_pool.cc:224] Handling call
0709 12:11:27.500102 (+ 10704us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:27.500473 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:27.500507 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:27.501045 (+   538us) log.cc:844] Serialized 26 byte log entry
0709 12:11:28.643105 (+1142060us) spinlock_profiling.cc:243] Waited 4.51 ms on lock 0x7b1800408e80. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cca4d64bc 00007f9cc782448b 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc7840c02 00007f9cca4c820b 00007f9cca4cdd23 00007f9cca4ce0d1
0709 12:11:28.643259 (+   154us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:28.643297 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.643361 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:28.643405 (+    44us) raft_consensus.cc:1685] finished
0709 12:11:28.643417 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:28.643616 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8143,"raft.queue_time_us":100670,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":7062,"spinlock_wait_cycles":10362112,"thread_start_us":174655,"threads_started":1,"wal-append.queue_time_us":824873}
I20260709 12:11:28.791055 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:11:28.791391 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 86822.6us
I20260709 12:11:28.752722 26821 raft_consensus.cc:740] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:28.772441 22531 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:11:28.751731 26721 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:28.644953 26695 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:28.796914 22421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.798700 22603 rpcz_store.cc:276] 0709 12:11:27.465238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.059250 (+594012us) service_pool.cc:224] Handling call
0709 12:11:28.735238 (+675988us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:28.701279 26764 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:28.799494 22351 catalog_manager.cc:5697] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 6 to 8, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 8 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:28.801017 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 199321us
I20260709 12:11:28.849380 23088 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:28.805680 22453 raft_consensus.cc:1240] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:11:28.794309 26686 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:28.808486 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 90667.4us
I20260709 12:11:28.794312 26802 raft_consensus.cc:2749] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:28.797842 26810 consensus_meta.cc:287] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.737s	user 0.006s	sys 0.003s
I20260709 12:11:28.813776 23124 raft_consensus.cc:1240] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 10. Current term is 12. Ops: []
I20260709 12:11:28.816318 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:28.819279 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:28.758060 26731 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:28.820415 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:28.910326 22528 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:11:28.911548 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:28.820896 23120 raft_consensus.cc:1275] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:11:28.798249 26742 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:28.823912 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:28.924450 22451 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:11:28.805374 26876 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:28.837109 26779 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:28.827900 23089 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:28.931216 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:28.931890 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 104055us
I20260709 12:11:28.793015 26766 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:28.801030 26790 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:28.833999 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:28.833770 22600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2358) took 1516 ms. Trace:
I20260709 12:11:28.837769 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:28.910265 26894 raft_consensus.cc:2749] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:28.819504 26889 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:28.840862 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:11:28.958369 22527 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56940 (request call id 2189) took 2246 ms (client timeout 2153 ms). Trace:
I20260709 12:11:28.959288 23122 raft_consensus.cc:2410] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:11:28.841796 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:28.800640 26690 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:28.849483 22421 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
W20260709 12:11:28.963865 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 114491us
W20260709 12:11:28.964315 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.852526 23088 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:28.880708 22603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2359) took 1563 ms. Trace:
W20260709 12:11:28.965233 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.965071 22603 rpcz_store.cc:276] 0709 12:11:27.317591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.845649 (+1528058us) service_pool.cc:224] Handling call
0709 12:11:28.880174 (+ 34525us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:28.880371 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.880393 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:28.880429 (+    36us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:28.880468 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.880523 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:28.880653 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:28.835144 26417 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:28.835448 26757 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.815860 26592 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:28.894102 22604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2724) took 2223 ms. Trace:
I20260709 12:11:28.972034 22604 rpcz_store.cc:276] 0709 12:11:26.670395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.671928 (+  1533us) service_pool.cc:224] Handling call
0709 12:11:26.672322 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:26.777539 (+105217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:26.777571 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:26.778027 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 12:11:27.222320 (+444293us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:27.222377 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:27.222469 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:28.757130 (+1534661us) spinlock_profiling.cc:243] Waited 8 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:11:28.892429 (+135299us) raft_consensus.cc:1685] finished
0709 12:11:28.892461 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:28.894018 (+  1557us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":104730,"raft.queue_time_us":104994,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"spinlock_wait_cycles":18394496,"thread_start_us":443855,"threads_started":1,"wal-append.queue_time_us":625442}
I20260709 12:11:28.806747 26616 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:28.844612 26915 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:28.903822 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:28.905001 22570 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:28.850703 26074 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:28.984285 26074 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:28.986163 26915 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:28.952828 26752 consensus_queue.cc:1048] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.034s
W20260709 12:11:28.915138 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.983300 23116 raft_consensus.cc:2368] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 10. Current term is 11.
I20260709 12:11:28.850646 26630 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:28.926004 22601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2360) took 1519 ms. Trace:
W20260709 12:11:28.824692 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 66828.7us
I20260709 12:11:28.991019 22601 rpcz_store.cc:276] 0709 12:11:27.406749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.925141 (+1518392us) service_pool.cc:224] Handling call
0709 12:11:28.925458 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:28.925658 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.925689 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:28.925734 (+    45us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:28.925773 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.925832 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:28.925949 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:28.994024 22457 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2516) took 1805 ms. Trace:
I20260709 12:11:28.994441 22457 rpcz_store.cc:276] 0709 12:11:27.188681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.213498 (+ 24817us) service_pool.cc:224] Handling call
0709 12:11:27.213796 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:27.417708 (+203912us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.993776 (+1576068us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b540038a9d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:28.993964 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":461786368}
I20260709 12:11:28.995108 26919 consensus_queue.cc:1048] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:11:28.922958 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 82235.8us
I20260709 12:11:28.995648 26878 raft_consensus.cc:2804] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:28.996155 26878 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:28.996564 26878 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:28.847261 26721 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:28.944339 22600 rpcz_store.cc:276] 0709 12:11:27.317219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.832568 (+1515349us) service_pool.cc:224] Handling call
0709 12:11:28.832866 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:28.833511 (+   645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.833712 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:28.816155 26875 raft_consensus.cc:697] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
W20260709 12:11:28.947034 26909 log.cc:927] Time spent T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
W20260709 12:11:28.947826 26911 log.cc:927] Time spent T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:11:28.948412 26765 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:28.950577 26914 raft_consensus.cc:2804] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:28.951103 26790 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:28.911697 26810 raft_consensus.cc:2749] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 9. Current term is 10.
I20260709 12:11:28.953794 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:28.957093 22451 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 10.
W20260709 12:11:28.959049 22527 rpcz_store.cc:269] 0709 12:11:26.697258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.699623 (+  2365us) service_pool.cc:224] Handling call
0709 12:11:28.943559 (+2243936us) spinlock_profiling.cc:243] Waited 503 ms on lock 0x7b54002ec554. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:28.943668 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1157433216}
I20260709 12:11:28.998896 26825 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:28.987727 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 82812.5us
I20260709 12:11:28.989090 22604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2363) took 1515 ms. Trace:
I20260709 12:11:28.928815 26742 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:28.995432 26611 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:28.999111 22454 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2518) took 1767 ms (client timeout 2210 ms). Trace:
W20260709 12:11:29.037724 22454 rpcz_store.cc:269] 0709 12:11:27.232049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.335900 (+103851us) service_pool.cc:224] Handling call
0709 12:11:28.998897 (+1662997us) spinlock_profiling.cc:243] Waited 49 ms on lock 0x7b54003f3ed4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:28.999050 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112724352}
I20260709 12:11:28.945014 22531 raft_consensus.cc:2393] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 10: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
W20260709 12:11:29.002902 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.971346 26791 raft_consensus.cc:2804] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:29.040050 26791 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:29.040602 26791 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:29.041009 22603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2361) took 1614 ms. Trace:
I20260709 12:11:29.041502 22603 rpcz_store.cc:276] 0709 12:11:27.427020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.966236 (+1539216us) service_pool.cc:224] Handling call
0709 12:11:28.977511 (+ 11275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:28.977741 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:28.999915 (+ 22174us) log.cc:844] Serialized 14 byte log entry
0709 12:11:29.040519 (+ 40604us) log.cc:844] Serialized 14 byte log entry
0709 12:11:29.040694 (+   175us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:29.040737 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:29.040785 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.040847 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.040956 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":25583,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":692,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":121,"thread_start_us":40122,"threads_started":1}
I20260709 12:11:28.986956 26074 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:29.016155 22529 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 10.
I20260709 12:11:28.989858 26417 raft_consensus.cc:697] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
W20260709 12:11:29.012243 26896 log.cc:927] Time spent T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 12:11:28.998373 26695 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:29.044705 26695 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:29.044896 26417 consensus_queue.cc:237] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:29.015561 26764 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:29.020826 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:29.048342 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:29.021034 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:29.049575 26795 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:29.050168 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:29.051362 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:29.052663 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:29.053872 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:28.967760 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 115327us
W20260709 12:11:29.021813 22525 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38310 (request call id 832) took 1796 ms (client timeout 1835 ms). Trace:
I20260709 12:11:29.055557 23088 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:11:29.056205 26916 log.cc:927] Time spent T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 12:11:29.056807 23088 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:29.058132 23088 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:29.059062 26920 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:29.055310 22525 rpcz_store.cc:269] 0709 12:11:27.225039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.267660 (+ 42621us) service_pool.cc:224] Handling call
0709 12:11:29.021623 (+1753963us) spinlock_profiling.cc:243] Waited 53.6 ms on lock 0x7b54004001d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:29.021755 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":123320576}
I20260709 12:11:29.022703 22604 rpcz_store.cc:276] 0709 12:11:27.465557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.974386 (+1508829us) service_pool.cc:224] Handling call
0709 12:11:28.980087 (+  5701us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:28.980414 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.980458 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:28.980521 (+    63us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:28.980576 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.980650 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:28.980786 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:29.064252 23088 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:29.023465 22570 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:29.064987 22602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2739) took 2142 ms. Trace:
I20260709 12:11:29.024118 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:28.978818 26757 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:28.944316 26821 consensus_queue.cc:260] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:29.013391 26839 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.065560 22602 rpcz_store.cc:276] 0709 12:11:26.922358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.754276 (+1831918us) service_pool.cc:224] Handling call
0709 12:11:28.754745 (+   469us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:28.755088 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.755118 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:28.755533 (+   415us) log.cc:844] Serialized 26 byte log entry
0709 12:11:28.848055 (+ 92522us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:28.848092 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.848151 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:29.064712 (+216561us) raft_consensus.cc:1685] finished
0709 12:11:29.064742 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.064897 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":50597,"threads_started":1,"wal-append.queue_time_us":179988}
W20260709 12:11:29.067780 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 69920.9us
I20260709 12:11:29.067041 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:29.071949 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:29.076215 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.086670 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:29.072944 22496 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:29.090209 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:29.091090 22526 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:29.007125 26868 consensus_queue.cc:1048] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 12:11:29.033587 26914 raft_consensus.cc:697] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 11 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:29.087378 22454 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 10.
I20260709 12:11:29.095395 22451 raft_consensus.cc:1275] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:29.012912 26619 consensus_queue.cc:1048] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 12:11:29.085765 26839 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:29.537585 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:29.567092 22456 raft_consensus.cc:2410] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:11:29.142308 26875 consensus_queue.cc:237] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:29.155002 26797 raft_consensus.cc:2749] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:29.545540 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:29.062455 26889 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:29.089147 26795 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:29.461861 26800 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:29.068733 26611 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:29.505110 26592 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:29.099862 26905 raft_consensus.cc:2804] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:29.492357 26731 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:29.464399 22599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2732) took 2631 ms. Trace:
I20260709 12:11:29.584587 23119 raft_consensus.cc:2393] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 10: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:29.475100 26766 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317)
W20260709 12:11:29.215649 26917 log.cc:927] Time spent T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 12:11:29.212205 26779 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:29.530746 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:29.599819 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:11:29.378113 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 374383us
I20260709 12:11:29.459322 26833 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:11:29.556136 22600 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.019s	sys 0.004s
W20260709 12:11:29.601073 22600 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.019s	sys 0.004s
I20260709 12:11:29.499482 26695 leader_election.cc:290] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:29.229547 26616 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:29.469794 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:29.212971 26914 consensus_queue.cc:237] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:29.503770 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.103542 26923 consensus_queue.cc:1048] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.149s
I20260709 12:11:29.219389 26915 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:29.270591 26721 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:29.473242 26876 consensus_meta.cc:287] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.533s	user 0.006s	sys 0.002s
I20260709 12:11:29.070681 26597 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:29.468691 26878 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:29.009557 26630 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:29.488692 26892 raft_consensus.cc:3055] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:29.484232 26897 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:29.580899 26611 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:29.268457 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:29.132640 26911 log.cc:927] Time spent T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:11:29.215286 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:29.084852 26771 consensus_queue.cc:1048] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 12:11:29.618408 26915 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.643115 26915 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:29.646138 26915 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:29.699887 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 322495us
I20260709 12:11:29.487581 22597 pending_rounds.cc:85] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc: Aborting all ops after (but not including) 3
I20260709 12:11:29.493464 26920 raft_consensus.cc:2749] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:29.703657 22597 pending_rounds.cc:107] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:11:29.703981 22597 raft_consensus.cc:2889] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:29.068743 26764 raft_consensus.cc:2749] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:29.070602 26805 raft_consensus.cc:2749] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:29.069043 26819 raft_consensus.cc:2749] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:29.447944 26791 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:29.501322 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:29.331192 26906 raft_consensus.cc:2804] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:29.225637 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:29.375262 26801 consensus_meta.cc:287] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.585s	user 0.008s	sys 0.003s
I20260709 12:11:29.401453 26768 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:29.266451 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:29.530117 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:29.133675 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 60823.3us
I20260709 12:11:29.718976 22496 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:29.379202 26074 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.720988 26074 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:29.484977 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:29.724216 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:29.725696 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:29.381072 26825 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:29.727330 26825 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:29.728276 26791 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:29.730345 26825 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:29.171767 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:29.732132 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:29.732666 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:29.733791 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.217525 26667 consensus_queue.cc:260] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:29.269204 26742 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:29.259526 26887 log.cc:927] Time spent T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:11:29.709285 26766 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.735741 26766 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:29.270028 26790 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:29.219614 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:29.267445 26690 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:29.389259 23116 raft_consensus.cc:1240] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 10 LEADER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:29.419595 26686 consensus_meta.cc:287] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.528s	user 0.010s	sys 0.000s
I20260709 12:11:29.739570 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:29.739723 26686 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:29.740263 22523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56940 (request call id 2201) took 1072 ms. Trace:
I20260709 12:11:29.740598 22523 rpcz_store.cc:276] 0709 12:11:28.667767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.739316 (+1071549us) service_pool.cc:224] Handling call
0709 12:11:29.740211 (+   895us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:29.741488 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:29.741717 26686 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:29.331241 23121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 1257) took 1865 ms. Trace:
I20260709 12:11:29.743300 22598 raft_consensus.cc:2393] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 14: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:29.411237 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:11:29.385627 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.744918 26906 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:29.745329 26906 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:29.746452 26667 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:29.338479 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:29.705475 26731 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.747269 22531 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:29.747310 26731 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:29.416237 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:29.749274 23117 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11.
I20260709 12:11:29.397923 22526 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 12.
I20260709 12:11:29.568851 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:29.750202 22526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56940 (request call id 2204) took 1081 ms. Trace:
I20260709 12:11:29.750412 23122 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 10.
I20260709 12:11:29.750550 22526 rpcz_store.cc:276] 0709 12:11:28.668485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.067435 (+398950us) service_pool.cc:224] Handling call
0709 12:11:29.750125 (+682690us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:29.570606 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:29.572415 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:29.691303 26630 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:29.583643 22599 rpcz_store.cc:276] 0709 12:11:26.832833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.057584 (+1224751us) service_pool.cc:224] Handling call
0709 12:11:28.058028 (+   444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:28.719673 (+661645us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.719700 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:28.720203 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 12:11:28.886711 (+166508us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:28.909613 (+ 22902us) log.cc:844] Serialized 14 byte log entry
0709 12:11:28.909882 (+   269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.909994 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:29.337199 (+427205us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b1800397b40. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc78413f3 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd 0000000000388634 0000000000388479 00007f9cc782483a
0709 12:11:29.420019 (+ 82820us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b1800397b40. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc78413f3 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd 0000000000388634 0000000000388479 00007f9cc782483a
0709 12:11:29.464174 (+ 44155us) raft_consensus.cc:1685] finished
0709 12:11:29.464195 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.464340 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":25033,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":1728,"raft.queue_time_us":587201,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":15641,"spinlock_wait_cycles":48879872,"thread_start_us":813577,"threads_started":2,"wal-append.queue_time_us":230113}
I20260709 12:11:29.759320 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:29.605481 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:29.586189 26672 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.819s	user 0.020s	sys 0.014s
W20260709 12:11:29.764197 26672 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.016s	user 0.020s	sys 0.014s
I20260709 12:11:29.764039 26074 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:29.618453 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:29.576479 26795 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:29.625844 22525 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 10.
I20260709 12:11:29.771420 22525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56940 (request call id 2205) took 1102 ms. Trace:
I20260709 12:11:29.771736 22525 rpcz_store.cc:276] 0709 12:11:28.668717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.060334 (+391617us) service_pool.cc:224] Handling call
0709 12:11:29.268313 (+207979us) spinlock_profiling.cc:243] Waited 6.72 ms on lock 0x7b5800037898. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf8f40a0 00007f9ccf8f3984 00007f9cc8e6e6d4 00007f9cc8e6e662
0709 12:11:29.771364 (+503051us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15456000}
I20260709 12:11:29.772984 22525 raft_consensus.cc:1275] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:29.773476 22525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1885) took 1395 ms. Trace:
I20260709 12:11:29.773759 22525 rpcz_store.cc:276] 0709 12:11:28.378466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.772438 (+1393972us) service_pool.cc:224] Handling call
0709 12:11:29.772708 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:29.773282 (+   574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.773427 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:29.628618 26897 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:29.623693 26892 raft_consensus.cc:740] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:29.630232 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:29.760020 22599 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 10.
I20260709 12:11:29.775669 22525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1886) took 1397 ms. Trace:
I20260709 12:11:29.775910 22530 raft_consensus.cc:2410] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:11:29.494774 26624 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:29.633239 22601 raft_consensus.cc:1240] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:29.640687 26878 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:29.098235 26821 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:29.647882 22605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2737) took 2813 ms. Trace:
I20260709 12:11:29.682348 26839 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:29.677776 26611 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:29.660983 26889 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:29.705608 22569 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:11:29.711233 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 78828.9us
I20260709 12:11:29.715312 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:29.476357 26757 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:29.576505 23124 raft_consensus.cc:1240] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:29.742349 23121 rpcz_store.cc:276] 0709 12:11:27.465970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.466119 (+   149us) service_pool.cc:224] Handling call
0709 12:11:27.489100 (+ 22981us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:27.489306 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:11:27.505803 (+ 16497us) log.cc:844] Serialized 14 byte log entry
0709 12:11:29.330589 (+1824786us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b1800408f40. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cca4d64bc 00007f9cc782448b 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc783e455 00007f9cca926060 00007f9cca938716 00007f9cca949287
0709 12:11:29.330719 (+   130us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:29.330792 (+    73us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:29.330864 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.330999 (+   135us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.331163 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":19830,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":112976,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":17322,"spinlock_wait_cycles":310978432,"thread_start_us":143640,"threads_started":1}
W20260709 12:11:29.753068 22598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45562 (request call id 2364) took 2276 ms (client timeout 1712 ms). Trace:
W20260709 12:11:29.789605 22598 rpcz_store.cc:269] 0709 12:11:27.476414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.503994 (+ 27580us) service_pool.cc:224] Handling call
0709 12:11:29.752847 (+2248853us) spinlock_profiling.cc:243] Waited 1.7 s on lock 0x7b54002dee54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:29.752977 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3915671808}
I20260709 12:11:29.749640 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:29.756811 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:29.757388 23120 raft_consensus.cc:2393] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 10: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:29.757382 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:29.757987 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:29.762184 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:29.791887 23116 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11.
I20260709 12:11:29.711512 26616 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.751448 26801 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:29.763727 26879 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.581281 26905 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:29.768147 23117 raft_consensus.cc:1275] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:29.738148 26766 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:29.776463 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:29.779884 22605 rpcz_store.cc:276] 0709 12:11:26.834080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.712708 (+1878628us) service_pool.cc:224] Handling call
0709 12:11:28.747254 (+ 34546us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:28.752919 (+  5665us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:28.752950 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:28.788278 (+ 35328us) log.cc:844] Serialized 26 byte log entry
0709 12:11:28.925679 (+137401us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:28.925739 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.925832 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:29.647668 (+721836us) raft_consensus.cc:1685] finished
0709 12:11:29.647687 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.647825 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3672,"raft.queue_time_us":9300,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":12012,"thread_start_us":125856,"threads_started":1,"wal-append.queue_time_us":168062}
I20260709 12:11:29.793536 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:29.780885 26944 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.804621 22601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2747) took 1151 ms. Trace:
I20260709 12:11:29.790725 26764 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.807199 26905 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:29.813884 26947 log.cc:927] Time spent T 00000000000000000000000000000000 P 136fd3da76544029a815aef59e698e17: Append to log took a long time: real 0.154s	user 0.005s	sys 0.000s
I20260709 12:11:29.816371 26801 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:29.807044 26879 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:29.818953 26879 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:29.819466 26944 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:29.821533 26944 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:29.822297 26906 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:29.795775 26731 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:29.807422 26616 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:29.825261 26616 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:29.797626 26878 raft_consensus.cc:2804] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:29.784080 26624 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:29.828397 26878 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:29.842634 26878 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:29.851894 26905 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:29.854023 26905 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:29.827014 26892 consensus_queue.cc:260] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:29.847488 26897 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:29.854959 26892 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:29.860558 26906 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:29.336181 22450 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 1973) took 1878 ms (client timeout 1916 ms). Trace:
W20260709 12:11:29.894515 22450 rpcz_store.cc:269] 0709 12:11:27.457723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.477610 (+ 19887us) service_pool.cc:224] Handling call
0709 12:11:29.335933 (+1858323us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b54004051d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:29.336083 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1465772288}
W20260709 12:11:29.577307 22421 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.003s	sys 0.026s
W20260709 12:11:29.897609 22421 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.933s	user 0.003s	sys 0.027s
I20260709 12:11:29.569190 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:29.567481 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:29.900200 22456 raft_consensus.cc:2468] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 10.
W20260709 12:11:29.586694 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 113353us
W20260709 12:11:29.901351 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 182304us
I20260709 12:11:29.903364 22496 leader_election.cc:400] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 election: Vote denied by peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353) with higher term. Message: Invalid argument: T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 10. Current term is 11.
I20260709 12:11:29.903883 22496 leader_election.cc:403] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:11:29.903501 22495 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:29.707630 22422 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:29.582221 22449 raft_consensus.cc:1240] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:29.908430 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 200714us
I20260709 12:11:29.473934 22448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2508) took 2649 ms. Trace:
W20260709 12:11:29.898376 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 933739us
I20260709 12:11:29.912029 22421 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:29.909605 22448 rpcz_store.cc:276] 0709 12:11:26.824958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.825095 (+   137us) service_pool.cc:224] Handling call
0709 12:11:27.514009 (+688914us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:27.514205 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:28.054209 (+540004us) log.cc:844] Serialized 14 byte log entry
0709 12:11:28.794111 (+739902us) log.cc:844] Serialized 14 byte log entry
0709 12:11:29.463254 (+669143us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b18003c8680. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc77bbc0a 00007f9cd0efb219 00007f9cca4e4d70 00007f9cca4d8293 00007f9cca4cdcea 00007f9cca4ce23a 00007f9cca938a2a 00007f9cca9480bf 00007f9cca948038
0709 12:11:29.463476 (+   222us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:29.463529 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:29.463593 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.463663 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.473756 (+ 10093us) spinlock_profiling.cc:243] Waited 689 ms on lock 0x7b54003f43d0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:29.473877 (+   121us) inbound_call.cc:177] Queueing success response
0709 12:11:29.509934 (+ 36057us) spinlock_profiling.cc:243] Waited 42.9 ms on lock 0x7b18003c8680. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc78413f3 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd 0000000000388634 0000000000388479 00007f9cc782483a
Metrics: {"mutex_wait_us":426738,"prepare.queue_time_us":1078038,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":70,"raft.queue_time_us":2290,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":2297,"spinlock_wait_cycles":1685775232,"thread_start_us":1192384,"threads_started":2,"wal-append.queue_time_us":737957}
W20260709 12:11:29.651541 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.915256 22532 raft_consensus.cc:1240] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:29.919293 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:29.742139 22523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56940 (request call id 2203) took 1073 ms. Trace:
I20260709 12:11:29.921742 22523 rpcz_store.cc:276] 0709 12:11:28.668243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.741248 (+1073005us) service_pool.cc:224] Handling call
0709 12:11:29.742090 (+   842us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:29.923246 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:29.924808 22529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1883) took 1546 ms. Trace:
I20260709 12:11:29.925493 22523 raft_consensus.cc:1240] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:29.925362 22529 rpcz_store.cc:276] 0709 12:11:28.377822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.768361 (+1390539us) service_pool.cc:224] Handling call
0709 12:11:29.923673 (+155312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:29.924193 (+   520us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:29.924223 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:29.924292 (+    69us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:29.924353 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.924422 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.924582 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:29.767359 22526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1878) took 1391 ms. Trace:
I20260709 12:11:29.269444 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:29.927412 22528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56940 (request call id 2199) took 1260 ms. Trace:
I20260709 12:11:29.927547 22527 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 9.
I20260709 12:11:29.927886 22528 rpcz_store.cc:276] 0709 12:11:28.667269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.049302 (+382033us) service_pool.cc:224] Handling call
0709 12:11:29.269300 (+219998us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b5800037898. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf8f40a0 00007f9ccf8f3984 00007f9cc8e6e6d4 00007f9cc8e6e662
0709 12:11:29.927175 (+657875us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2797824}
I20260709 12:11:29.930042 22529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 2198) took 1263 ms. Trace:
I20260709 12:11:29.780377 22531 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11.
I20260709 12:11:29.781842 22570 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:29.938405 22531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56942 (request call id 1879) took 1561 ms. Trace:
I20260709 12:11:29.938925 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:29.939641 22599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:11:29.940691 22599 raft_consensus.cc:606] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 13 LEADER]: Received request to transfer leadership to TS c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:29.940104 26731 consensus_queue.cc:1048] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:29.775980 22525 rpcz_store.cc:276] 0709 12:11:28.378714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.774549 (+1395835us) service_pool.cc:224] Handling call
0709 12:11:29.774789 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:29.774974 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:29.775273 (+   299us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:29.775414 (+   141us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:29.775466 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.775518 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.775618 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:29.787091 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 81535.8us
I20260709 12:11:29.926376 22523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1887) took 1547 ms. Trace:
I20260709 12:11:29.930500 22529 rpcz_store.cc:276] 0709 12:11:28.666971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.928654 (+1261683us) service_pool.cc:224] Handling call
0709 12:11:29.929141 (+   487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:29.929616 (+   475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:29.929651 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:29.929725 (+    74us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:29.929786 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.929863 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.929985 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:29.926648 22526 rpcz_store.cc:276] 0709 12:11:28.376127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.766592 (+1390465us) service_pool.cc:224] Handling call
0709 12:11:29.766872 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:29.767064 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:29.767088 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:29.767127 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:29.767162 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.767212 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.767307 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:29.949003 26795 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:29.828632 26764 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:29.810355 22601 rpcz_store.cc:276] 0709 12:11:28.653376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.993313 (+339937us) service_pool.cc:224] Handling call
0709 12:11:28.993582 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:29.776995 (+783413us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.804325 (+ 27330us) spinlock_profiling.cc:243] Waited 639 ms on lock 0x7b54002dfd54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:29.804534 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1470458752}
I20260709 12:11:29.963876 23119 raft_consensus.cc:2410] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:11:29.964032 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:29.966215 22601 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:29.955188 26611 raft_consensus.cc:2804] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:29.961004 22523 rpcz_store.cc:276] 0709 12:11:28.410239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.924573 (+1514334us) service_pool.cc:224] Handling call
0709 12:11:29.925131 (+   558us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:29.926001 (+   870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.926279 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:29.938961 22531 rpcz_store.cc:276] 0709 12:11:28.376425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.059353 (+682928us) service_pool.cc:224] Handling call
0709 12:11:29.338291 (+278938us) spinlock_profiling.cc:243] Waited 7.42 ms on lock 0x7b5800037898. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf8f40a0 00007f9ccf8f3984 00007f9cc8e6e6d4 00007f9cc8e6e662
0709 12:11:29.938164 (+599873us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17068288}
I20260709 12:11:29.969338 26074 consensus_queue.cc:1059] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:11:29.971545 26666 raft_consensus.cc:2749] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:29.971930 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 190048us
I20260709 12:11:29.972041 26669 raft_consensus.cc:2749] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353) with higher term. Message: Invalid argument: T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 10. Current term is 11.
I20260709 12:11:29.969444 26619 consensus_queue.cc:1048] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:11:29.966741 26624 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:29.980031 22597 raft_consensus.cc:1240] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:29.972911 26685 raft_consensus.cc:2749] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:29.981985 26906 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:29.982793 26906 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:29.972504 26695 raft_consensus.cc:2804] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:29.987277 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:29.987726 26695 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:29.988372 26695 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:29.990777 22569 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:29.991971 26892 raft_consensus.cc:2749] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:29.993227 26619 consensus_queue.cc:1059] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:29.993912 26939 consensus_queue.cc:1059] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:29.996165 26685 raft_consensus.cc:3055] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:29.996249 26839 consensus_queue.cc:1059] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:11:29.996810 26685 raft_consensus.cc:740] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:29.997643 26839 raft_consensus.cc:3055] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:29.998189 26839 raft_consensus.cc:740] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:29.999441 26611 raft_consensus.cc:697] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:29.999156 26685 consensus_queue.cc:260] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:29.858836 26878 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:30.000939 26611 consensus_queue.cc:237] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:30.002167 26074 raft_consensus.cc:3055] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:30.002705 26074 raft_consensus.cc:740] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:30.005090 26074 consensus_queue.cc:260] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:30.007682 22453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2525) took 1159 ms. Trace:
I20260709 12:11:30.008246 26074 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:30.012411 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 77199.6us
I20260709 12:11:30.019675 22570 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:30.021385 26878 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:11:30.007057 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 95499us
I20260709 12:11:29.980811 26731 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:30.024389 26731 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:30.024902 26731 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:30.027117 26906 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:30.028126 26892 consensus_queue.cc:1048] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:30.031553 26764 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:30.006714 26839 consensus_queue.cc:260] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:30.038592 26839 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:30.043113 26919 raft_consensus.cc:3055] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:30.046271 22600 raft_consensus.cc:1240] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:30.046907 22603 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 10.
I20260709 12:11:30.048238 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:30.049615 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:30.050721 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:30.052709 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:30.059994 26919 raft_consensus.cc:740] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:30.075608 22421 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:30.077034 22599 raft_consensus.cc:1240] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:30.080356 22525 raft_consensus.cc:2393] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 10: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:30.083174 22523 raft_consensus.cc:2376] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13. Re-sending same reply.
I20260709 12:11:30.084731 26897 raft_consensus.cc:2804] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:30.086350 26897 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.086411 26919 consensus_queue.cc:260] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:30.087618 22569 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:30.088016 26919 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:30.091320 22527 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:11:30.092212 26940 raft_consensus.cc:2804] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:30.092698 26940 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:30.093082 26940 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:30.095439 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:30.096256 22530 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 10.
I20260709 12:11:30.096845 22421 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:30.098745 26742 raft_consensus.cc:2804] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:30.099261 26742 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.099735 26742 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:30.103415 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:30.072602 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:30.008352 22453 rpcz_store.cc:276] 0709 12:11:28.847683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.850616 (+  2933us) service_pool.cc:224] Handling call
0709 12:11:29.340229 (+489613us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:29.372270 (+ 32041us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:29.372318 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:29.375995 (+  3677us) log.cc:844] Serialized 26 byte log entry
0709 12:11:29.607481 (+231486us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:29.607563 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.607672 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:29.901081 (+293409us) raft_consensus.cc:1685] finished
0709 12:11:29.901137 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.969363 (+ 68226us) spinlock_profiling.cc:243] Waited 489 ms on lock 0x7b54004051d0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:30.007458 (+ 38095us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":33750,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":5039,"spinlock_wait_cycles":1125251328,"thread_start_us":207128,"threads_started":1,"wal-append.queue_time_us":390154}
W20260709 12:11:30.106115 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 51964us
I20260709 12:11:30.107172 22422 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:30.108546 26630 raft_consensus.cc:2804] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:30.109066 26630 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.109710 26630 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:30.099583 22421 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:30.109107 26742 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:30.116489 22597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:11:30.117364 22597 raft_consensus.cc:606] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Received request to transfer leadership to TS c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:30.118474 26742 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:30.122018 22597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:11:30.141697 26940 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:30.124106 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:30.142176 22597 raft_consensus.cc:606] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Received request to transfer leadership to TS 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:30.142853 22597 raft_consensus.cc:614] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:30.143051 22600 raft_consensus.cc:2393] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 14: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:30.143543 26597 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.125491 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:30.144122 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:30.143993 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:30.144970 22495 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:30.128409 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:30.145354 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:30.145608 22597 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 10.
I20260709 12:11:30.145795 26879 raft_consensus.cc:2749] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:30.146019 22448 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 9.
I20260709 12:11:30.146274 22598 raft_consensus.cc:2393] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 11: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:30.086829 26897 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:30.124792 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:30.131560 22456 raft_consensus.cc:1275] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:30.132774 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:30.149029 22451 raft_consensus.cc:2468] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 10.
I20260709 12:11:30.129724 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:30.137046 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:30.135911 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:30.138391 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:30.150072 22450 raft_consensus.cc:2393] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 10: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:30.128757 22599 raft_consensus.cc:1275] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:30.139868 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:30.123345 26779 raft_consensus.cc:2804] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:30.151115 26779 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:30.141233 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:30.151551 26779 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:30.144174 26597 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:30.151733 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:30.152657 22604 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 10.
I20260709 12:11:30.154109 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:30.143460 22569 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:30.156072 26427 raft_consensus.cc:2749] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:30.157589 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:30.158772 26790 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:30.159572 26790 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:30.160154 22598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:11:30.145053 22600 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:30.162292 26790 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:30.162227 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:30.162917 26764 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:30.174721 22421 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:30.163383 26868 raft_consensus.cc:2804] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:30.163496 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:30.164143 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:30.164278 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:30.164846 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:30.165084 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:30.165572 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:30.165809 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:30.165987 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:30.166253 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:30.169767 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:30.171159 26742 consensus_queue.cc:1048] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:30.185913 26906 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:30.172721 26779 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:30.186539 26906 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:30.187790 22605 raft_consensus.cc:1275] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:30.188344 26779 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:30.189496 26906 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:30.190544 22451 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:30.185271 22448 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 9.
I20260709 12:11:30.183593 22457 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 9.
I20260709 12:11:30.141929 26731 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:30.176791 22600 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
I20260709 12:11:30.137924 26630 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:30.180680 22601 raft_consensus.cc:1275] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:11:30.182101 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.196468 22528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 2202) took 1523 ms. Trace:
I20260709 12:11:30.195834 26669 consensus_queue.cc:1059] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:11:30.202718 26779 raft_consensus.cc:2804] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:30.202306 26764 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:30.209605 22531 raft_consensus.cc:2393] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 11: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:30.207603 26779 raft_consensus.cc:697] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:30.203284 22450 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 11.
I20260709 12:11:30.215464 22454 raft_consensus.cc:2368] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 10. Current term is 11.
I20260709 12:11:30.214618 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:30.215008 22530 raft_consensus.cc:2376] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11. Re-sending same reply.
I20260709 12:11:30.201437 22528 rpcz_store.cc:276] 0709 12:11:28.668005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.928944 (+1260939us) service_pool.cc:224] Handling call
0709 12:11:29.929441 (+   497us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:29.929925 (+   484us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:29.930519 (+   594us) log.cc:844] Serialized 14 byte log entry
0709 12:11:30.067052 (+136533us) log.cc:844] Serialized 14 byte log entry
0709 12:11:30.191110 (+124058us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:30.191173 (+    63us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:30.191255 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.191483 (+   228us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.191639 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":123517,"prepare.queue_time_us":12987,"prepare.run_cpu_time_us":132,"prepare.run_wall_time_us":1890,"raft.queue_time_us":134199,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":14008,"thread_start_us":128867,"threads_started":1}
I20260709 12:11:30.237310 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:30.240164 22527 raft_consensus.cc:2410] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:11:30.242767 22452 raft_consensus.cc:2393] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 8: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:30.244026 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:30.208772 26906 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.245257 26906 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:30.245504 26721 consensus_queue.cc:1059] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:30.216499 26868 raft_consensus.cc:697] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
W20260709 12:11:30.247364 26914 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.012s	sys 0.007s
I20260709 12:11:30.255573 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:30.255105 22495 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:30.262352 22528 raft_consensus.cc:1275] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:30.266328 22457 raft_consensus.cc:1240] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:30.263739 22422 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:11:30.258636 26914 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.013s	sys 0.008s
I20260709 12:11:30.269731 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:30.276365 26800 raft_consensus.cc:2749] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:30.278805 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:30.282014 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:30.276325 26667 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.286517 23119 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11.
I20260709 12:11:30.263923 26695 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:30.300698 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:30.306708 26742 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:30.317289 22606 raft_consensus.cc:1275] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:11:30.317816 22606 pending_rounds.cc:85] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc: Aborting all ops after (but not including) 6
I20260709 12:11:30.318075 22606 pending_rounds.cc:107] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:11:30.318444 22606 raft_consensus.cc:2889] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:30.320303 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:30.321017 22600 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 10.
I20260709 12:11:30.321774 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:30.322204 26801 raft_consensus.cc:3055] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:30.322587 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:30.318216 26669 raft_consensus.cc:3055] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:11:30.323132 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 72451.1us
I20260709 12:11:30.323623 26669 raft_consensus.cc:740] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:30.323691 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:30.324625 26624 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:30.325356 26624 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:30.323648 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:30.324936 26669 consensus_queue.cc:260] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:30.325614 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:30.318493 26768 consensus_meta.cc:287] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.589s	user 0.014s	sys 0.004s
I20260709 12:11:30.310751 26742 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.324975 22601 raft_consensus.cc:2393] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 11: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:30.323204 22604 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 11.
I20260709 12:11:30.276521 26752 consensus_queue.cc:1048] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.097s
I20260709 12:11:30.283831 26721 consensus_queue.cc:1048] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:11:30.309514 26779 consensus_queue.cc:237] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:30.298822 26611 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.378834 22524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1884) took 2000 ms. Trace:
I20260709 12:11:30.468073 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:30.375914 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.334372 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:30.379209 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 63588.7us
I20260709 12:11:30.309275 26879 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:11:30.384761 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.383111 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:30.375157 22450 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:30.383795 22455 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 11.
I20260709 12:11:30.469026 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:30.560204 22495 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:11:30.388480 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 75188.9us
I20260709 12:11:30.591095 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:30.592751 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:30.593094 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.315793 26940 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:30.364147 22602 raft_consensus.cc:2468] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 8.
W20260709 12:11:30.379123 26960 log.cc:927] Time spent T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 12:11:30.599645 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 129113us
W20260709 12:11:30.364919 26959 log.cc:927] Time spent T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 12:11:30.374239 26917 log.cc:927] Time spent T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:11:30.380828 26695 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:30.602779 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:30.379163 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:30.608009 22422 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:30.608289 26624 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:30.626319 22422 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:30.609350 26879 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:30.524101 26630 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:30.326853 26897 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:30.375715 26868 consensus_queue.cc:237] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:30.541862 26795 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:30.612933 22600 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 10.
I20260709 12:11:30.613837 22526 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 10.
I20260709 12:11:30.364363 26669 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:30.372107 26731 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:30.388772 26923 consensus_queue.cc:1048] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.241s
I20260709 12:11:30.563294 26906 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:30.482880 26892 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.590663 26742 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:30.375834 26842 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.581247 22524 rpcz_store.cc:276] 0709 12:11:28.378158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.768994 (+1390836us) service_pool.cc:224] Handling call
0709 12:11:29.769302 (+   308us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:11:29.915326 (+146024us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:29.915424 (+    98us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:11:29.917198 (+  1774us) log.cc:844] Serialized 78 byte log entry
0709 12:11:30.059543 (+142345us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:11:30.059592 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.070655 (+ 11063us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:30.378268 (+307613us) raft_consensus.cc:1685] finished
0709 12:11:30.378300 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.378580 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":145077,"raft.queue_time_us":207098,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":234,"thread_start_us":141680,"threads_started":1,"wal-append.queue_time_us":272685}
I20260709 12:11:30.658000 23124 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:30.632791 26940 raft_consensus.cc:2804] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:30.322618 26801 raft_consensus.cc:740] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:30.370261 26764 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:30.589664 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:30.621114 22603 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 12.
I20260709 12:11:30.637982 26624 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:30.639521 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.639901 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:30.640492 26839 raft_consensus.cc:2804] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:30.617177 26685 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:30.646021 22422 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:30.351637 26667 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:30.655987 22598 raft_consensus.cc:606] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:11:30.679562 22598 raft_consensus.cc:614] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:30.380227 26914 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:30.621592 26611 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:30.653033 26919 consensus_meta.cc:287] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.564s	user 0.014s	sys 0.001s
I20260709 12:11:30.660211 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:30.661253 26940 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.688133 26770 raft_consensus.cc:2804] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:30.687634 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:30.712945 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:30.711931 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:30.710181 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:30.716012 23119 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 9.
W20260709 12:11:30.717525 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 47237.5us
I20260709 12:11:30.724207 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:30.681716 26839 raft_consensus.cc:697] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:30.709652 26768 raft_consensus.cc:2804] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:30.660050 26892 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:30.730507 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:30.714828 26940 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:30.712945 26770 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.735069 23123 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 10.
I20260709 12:11:30.735918 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:30.742620 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:30.681439 26795 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:30.765359 26795 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:30.750586 23124 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
I20260709 12:11:30.675699 26801 consensus_queue.cc:260] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:30.751685 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:30.752213 23089 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:30.757647 26611 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:30.759732 26897 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:30.759964 26667 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:30.762483 26597 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:30.745703 26770 raft_consensus.cc:3060] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:30.737260 26768 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:30.771051 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:30.676247 26842 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:30.767275 23116 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 9.
I20260709 12:11:30.779917 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:30.783811 26892 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:30.783509 26839 consensus_queue.cc:237] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:30.783876 22455 raft_consensus.cc:1275] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:11:30.784600 22532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1869) took 2569 ms. Trace:
W20260709 12:11:30.785506 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 49076.9us
I20260709 12:11:30.786072 26795 raft_consensus.cc:2804] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:30.787807 26879 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:30.721000 26914 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:30.793246 26801 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:30.802541 22527 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
I20260709 12:11:30.723148 26624 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:30.804569 22451 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:30.816150 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:30.810380 22532 rpcz_store.cc:276] 0709 12:11:28.215542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.215732 (+   190us) service_pool.cc:224] Handling call
0709 12:11:28.292540 (+ 76808us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:29.915903 (+1623363us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.784292 (+868389us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b540010c7d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:30.784508 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3730361728}
I20260709 12:11:30.808946 26768 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:30.824388 22453 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 12.
I20260709 12:11:30.829559 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:30.830952 23119 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
I20260709 12:11:30.832892 23124 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 10.
I20260709 12:11:30.811659 26742 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:30.836361 26742 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:30.837947 26940 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:30.840785 26914 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:30.827327 26795 raft_consensus.cc:697] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 10 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:30.841607 22450 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
W20260709 12:11:30.844839 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.847669 22529 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
I20260709 12:11:30.863181 23087 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:30.863081 26764 consensus_queue.cc:1048] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:30.865738 26764 consensus_queue.cc:1048] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:30.869076 26764 raft_consensus.cc:2804] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:30.877679 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:30.878741 22570 leader_election.cc:336] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 1.540s (SENT)
I20260709 12:11:30.879333 22570 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:30.881325 22570 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:30.872341 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:30.874215 23117 raft_consensus.cc:1240] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 12:11:30.876034 26962 log.cc:927] Time spent T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.143s	user 0.003s	sys 0.000s
I20260709 12:11:30.876160 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:30.866753 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:11:30.885095 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.842677 26795 consensus_queue.cc:237] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:30.893893 23125 raft_consensus.cc:2393] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 10: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:30.902500 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:30.902944 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:30.903283 22528 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:30.903712 22529 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 11.
I20260709 12:11:30.905078 23087 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:30.905973 26906 raft_consensus.cc:2749] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:30.906428 23087 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:30.907724 26821 raft_consensus.cc:2804] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:30.908171 26821 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.908550 26821 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:30.911337 22528 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 10.
I20260709 12:11:30.917218 26906 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:30.917788 26906 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:30.918124 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:30.918954 22597 raft_consensus.cc:2393] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 11: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:30.920146 26906 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:30.920725 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:30.921113 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:30.921479 23118 raft_consensus.cc:2376] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11. Re-sending same reply.
I20260709 12:11:30.921931 23122 raft_consensus.cc:2393] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 10: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:30.923746 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:30.925050 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:30.920177 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:30.927927 23121 raft_consensus.cc:2376] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11. Re-sending same reply.
I20260709 12:11:30.928403 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:30.926532 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:30.929593 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:30.930404 23118 raft_consensus.cc:1240] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:30.931736 26624 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:30.931991 22606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2736) took 4098 ms. Trace:
I20260709 12:11:30.932394 22606 rpcz_store.cc:276] 0709 12:11:26.833854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.701096 (+1867242us) service_pool.cc:224] Handling call
0709 12:11:28.701426 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:30.468172 (+1766746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.931704 (+463532us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b54000e8654. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:30.931924 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3588017920}
I20260709 12:11:30.886549 26764 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.935669 26764 raft_consensus.cc:3060] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:30.950438 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 57032.4us
I20260709 12:11:30.952975 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:30.956518 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:30.977278 22527 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:30.968227 23087 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:30.981086 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:30.964470 26074 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:30.977674 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:30.997008 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:30.997732 22602 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:30.957615 26624 raft_consensus.cc:2804] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:31.000425 23087 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:30.982522 22606 raft_consensus.cc:2468] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 8.
I20260709 12:11:31.007932 23119 raft_consensus.cc:1240] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:31.010682 22570 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:31.007097 26624 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:31.012043 26624 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.014083 26970 raft_consensus.cc:2804] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:31.014623 26970 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:31.015312 26906 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:31.016042 23087 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:31.017769 23087 leader_election.cc:400] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 election: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 10. Current term is 11.
I20260709 12:11:31.018491 26969 raft_consensus.cc:2804] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:31.023751 22530 raft_consensus.cc:2410] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:11:31.025326 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:31.026185 22528 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 11.
W20260709 12:11:31.028818 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.025322 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:31.061666 26821 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:31.014935 26970 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:31.065864 22525 raft_consensus.cc:2410] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:11:31.067734 22527 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 12.
I20260709 12:11:31.069965 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:31.067960 22422 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:31.072039 26731 raft_consensus.cc:2804] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:31.072505 26731 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:31.072942 26731 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:31.047768 26667 raft_consensus.cc:2749] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:31.076817 26821 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:31.079178 23124 raft_consensus.cc:1240] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:31.080451 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 69925.1us
I20260709 12:11:31.080524 26983 raft_consensus.cc:2749] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:31.081254 22570 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:31.082144 22570 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:31.082182 26684 raft_consensus.cc:2804] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:31.082952 26684 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:31.083554 26684 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:31.088654 26821 raft_consensus.cc:2804] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:31.089371 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:31.090090 22450 raft_consensus.cc:2368] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 10. Current term is 11.
I20260709 12:11:31.092206 26821 raft_consensus.cc:697] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:31.094507 22605 raft_consensus.cc:1275] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:31.094637 26731 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:31.093699 26821 consensus_queue.cc:237] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:31.099228 26074 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:31.100092 26624 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:31.101642 26074 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:31.106776 26731 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:31.018918 26969 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:31.107404 26969 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:31.107493 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:31.108181 22601 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.112278 26684 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:31.151755 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:31.132983 22451 raft_consensus.cc:2468] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 10.
I20260709 12:11:31.157181 22604 raft_consensus.cc:2393] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 13: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
W20260709 12:11:31.158118 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 215027us
W20260709 12:11:31.133347 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 50370.5us
W20260709 12:11:31.163067 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.172279 22601 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
I20260709 12:11:31.173472 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:31.174278 22600 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:31.114928 26684 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:31.151485 26940 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:31.189689 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:31.193470 22422 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:11:31.196969 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.185324 26630 consensus_queue.cc:1048] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:11:31.204107 26074 raft_consensus.cc:2804] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:31.204761 26074 raft_consensus.cc:697] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:31.205924 26074 consensus_queue.cc:237] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:31.116554 26969 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:31.227244 23124 raft_consensus.cc:1240] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:11:31.228441 26906 raft_consensus.cc:2749] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:31.230826 22605 raft_consensus.cc:1240] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:31.232175 26969 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:31.232336 26940 consensus_queue.cc:1059] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:31.232841 26684 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:31.233489 26940 raft_consensus.cc:3055] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:31.233884 26940 raft_consensus.cc:740] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:31.233366 26684 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:31.234871 26940 consensus_queue.cc:260] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:31.236234 26940 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:31.237044 26669 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.237550 26669 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:31.201623 22570 leader_election.cc:336] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 1.590s (SENT)
I20260709 12:11:31.217444 22495 leader_election.cc:400] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 election: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 10. Current term is 11.
I20260709 12:11:31.219695 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:31.241047 22495 leader_election.cc:403] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:11:31.224418 26970 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:31.241430 22602 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
I20260709 12:11:31.287272 22600 raft_consensus.cc:2468] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 9.
W20260709 12:11:31.289433 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 47964.8us
I20260709 12:11:31.315172 23122 raft_consensus.cc:1240] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 8. Current term is 10. Ops: []
W20260709 12:11:31.327510 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:31.289960 22421 connection.cc:256] RPC call timeout handler was delayed by -1.3615032349998728s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17120000000000002s for a response
W20260709 12:11:31.328313 22421 connection.cc:256] RPC call timeout handler was delayed by -1.0564032349998342s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20510000000000003s for a response
W20260709 12:11:31.328998 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 46794.6us
I20260709 12:11:31.289108 26619 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.331149 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:31.332823 23118 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:31.289558 26624 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:31.342957 22421 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:31.327103 26685 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.331640 26669 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:31.347126 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 151639us
I20260709 12:11:31.342540 26801 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:31.337098 26939 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:31.371073 26980 consensus_queue.cc:1048] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:31.361181 26684 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:31.373667 26983 raft_consensus.cc:993] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc: : Instructing follower c863116d91c14d1ca50d6e8a46a37a8f to start an election
I20260709 12:11:31.374205 26983 raft_consensus.cc:1081] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 13 LEADER]: Signalling peer c863116d91c14d1ca50d6e8a46a37a8f to start an election
W20260709 12:11:31.375794 26984 log.cc:927] Time spent T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:11:31.377620 22496 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:31.380371 22422 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:31.381215 22422 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:11:31.381964 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 182076us
I20260709 12:11:31.382350 26731 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:31.382762 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:31.383376 26630 raft_consensus.cc:2804] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:31.383862 26630 raft_consensus.cc:697] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:31.384845 26630 consensus_queue.cc:237] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:31.386128 26990 log.cc:927] Time spent T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:11:31.382851 26731 raft_consensus.cc:697] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:31.388325 26731 consensus_queue.cc:237] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:31.356323 26619 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:31.391674 26619 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:31.348662 26800 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:31.392428 26800 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:31.392792 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:31.339684 26821 consensus_queue.cc:1059] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:11:31.383981 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:31.451303 23124 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:31.394001 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:31.441836 26939 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:31.443059 26669 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:11:31.443187 26770 consensus_meta.cc:287] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.633s	user 0.002s	sys 0.009s
W20260709 12:11:31.443549 22570 leader_election.cc:336] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 1.657s (SENT)
I20260709 12:11:31.457439 22570 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:31.443949 26764 consensus_meta.cc:287] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.508s	user 0.010s	sys 0.000s
I20260709 12:11:31.445005 26970 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:11:31.445119 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 67590us
I20260709 12:11:31.446282 26868 raft_consensus.cc:2749] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:31.447700 26800 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:31.439826 22569 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:11:31.449632 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:31.395292 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 54522.9us
I20260709 12:11:31.455657 23118 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
I20260709 12:11:31.467916 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:31.468641 23118 raft_consensus.cc:2393] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 9: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:31.469651 23118 raft_consensus.cc:1240] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:31.460155 26770 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:31.472297 26770 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:31.460868 26764 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:31.474663 26764 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:31.475492 23121 raft_consensus.cc:2393] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 11: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:31.477352 26800 consensus_queue.cc:1059] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:31.356280 26801 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:31.492003 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 131155us
I20260709 12:11:31.492946 22569 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:31.481083 26839 raft_consensus.cc:2749] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:31.499119 23122 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11.
W20260709 12:11:31.503770 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 120442us
I20260709 12:11:31.509116 22421 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:31.487286 26669 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:31.501034 26821 raft_consensus.cc:2749] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:31.485908 26868 consensus_queue.cc:1059] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:11:31.585225 23122 raft_consensus.cc:1240] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260709 12:11:31.594956 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 85348.8us
I20260709 12:11:31.502127 26980 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:31.585721 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:31.493916 26619 consensus_queue.cc:1059] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
W20260709 12:11:31.587397 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 225808us
I20260709 12:11:31.502332 26979 raft_consensus.cc:3055] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:31.614811 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:31.591638 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:31.590621 23089 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:31.589627 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:31.594496 23124 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:11:31.600425 22451 raft_consensus.cc:1240] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:31.618696 22450 raft_consensus.cc:2393] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 11: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:31.605846 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:31.552765 26695 raft_consensus.cc:2804] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:31.586591 26731 raft_consensus.cc:2749] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:31.614786 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:31.603421 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 125705us
I20260709 12:11:31.623696 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:31.624019 22496 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
W20260709 12:11:31.611753 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 111665us
I20260709 12:11:31.625437 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:31.621835 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:31.633299 22454 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:31.633471 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 47872.1us
I20260709 12:11:31.616820 26979 raft_consensus.cc:740] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:31.639194 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:31.639917 22421 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:31.640321 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:31.643793 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.648427 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:31.647516 22601 raft_consensus.cc:2393] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 14: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:31.655601 22603 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.621002 26980 raft_consensus.cc:697] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:31.656971 23089 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:31.638010 26624 raft_consensus.cc:2804] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:31.658754 23124 raft_consensus.cc:1240] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:31.650471 26768 consensus_meta.cc:287] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.815s	user 0.011s	sys 0.000s
I20260709 12:11:31.635535 26695 raft_consensus.cc:697] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:31.667466 22457 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
 from {username='slave'} at 127.0.0.1:51836
I20260709 12:11:31.677544 23120 raft_consensus.cc:1275] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:11:31.677728 22457 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:31.678092 22457 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:31.674443 26801 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:31.683827 26980 consensus_queue.cc:237] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:31.686828 22451 raft_consensus.cc:1240] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:31.687521 23089 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:31.688234 22454 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:11:31.688346 22605 raft_consensus.cc:2393] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 7: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:31.666715 26731 raft_consensus.cc:2749] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:31.639038 27000 consensus_queue.cc:1059] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:11:31.670342 26624 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:31.704829 22421 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:31.708750 22605 raft_consensus.cc:1240] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:11:31.707675 22451 raft_consensus.cc:1240] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:31.709520 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:31.672513 26970 raft_consensus.cc:2804] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:31.710490 22454 raft_consensus.cc:1240] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:31.706836 26764 raft_consensus.cc:2804] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:31.756333 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:31.758936 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 67378.8us
I20260709 12:11:31.755963 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:31.757207 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:31.718737 22569 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:11:31.761145 27002 log.cc:927] Time spent T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
W20260709 12:11:31.762557 26996 log.cc:927] Time spent T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 12:11:31.763500 27001 log.cc:927] Time spent T 00000000000000000000000000000000 P 136fd3da76544029a815aef59e698e17: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:11:31.763402 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:31.764083 22454 raft_consensus.cc:3060] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:31.764407 26992 log.cc:927] Time spent T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 12:11:31.767573 26842 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:31.768236 26770 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:31.768810 26770 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:31.775517 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:31.776671 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:31.777937 22450 raft_consensus.cc:1275] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:31.718583 22605 raft_consensus.cc:1240] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:31.778805 26979 consensus_queue.cc:260] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:31.779191 26695 consensus_queue.cc:237] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:31.779886 26979 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.780040 26427 raft_consensus.cc:2804] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:31.780792 26427 raft_consensus.cc:697] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 13 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
W20260709 12:11:31.782649 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 147244us
W20260709 12:11:31.782696 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 64064.4us
I20260709 12:11:31.711544 26624 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:31.788533 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 83827.7us
I20260709 12:11:31.711093 26742 raft_consensus.cc:2749] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:31.788281 22457 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:31.674878 26768 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:31.796677 22454 raft_consensus.cc:2468] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
I20260709 12:11:31.714658 26970 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:31.799996 22603 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 11.
I20260709 12:11:31.714844 26939 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:31.770920 26770 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:31.802035 22455 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
I20260709 12:11:31.758639 26764 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:31.756501 26800 raft_consensus.cc:2749] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:31.806404 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:31.717315 26669 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:31.813337 22457 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:31.782012 26427 consensus_queue.cc:237] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:31.812827 26764 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:31.798466 26684 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.820386 26684 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:31.816119 26878 consensus_queue.cc:1059] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:31.817296 26768 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:31.822546 26684 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:31.823079 22450 raft_consensus.cc:2393] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 12: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:31.756503 26821 consensus_queue.cc:1059] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:11:31.824509 26821 raft_consensus.cc:3055] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:31.824865 26821 raft_consensus.cc:740] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:31.825790 26821 consensus_queue.cc:260] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:31.807155 26970 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:31.830706 26993 log.cc:927] Time spent T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.542s	user 0.002s	sys 0.000s
I20260709 12:11:31.829581 26684 raft_consensus.cc:3055] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:31.831346 26685 raft_consensus.cc:2749] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 10. Current term is 11.
I20260709 12:11:31.854262 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:31.855533 22421 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:11:31.857998 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 56160.3us
I20260709 12:11:31.858279 22457 raft_consensus.cc:2393] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 10: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:31.870970 22569 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:31.876091 27008 consensus_queue.cc:1059] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:31.877619 27010 raft_consensus.cc:3055] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:31.878002 27010 raft_consensus.cc:740] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:31.878866 27010 consensus_queue.cc:260] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:31.879635 22525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56942 (request call id 1918) took 1498 ms. Trace:
I20260709 12:11:31.880018 22525 rpcz_store.cc:276] 0709 12:11:30.380719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.380822 (+   103us) service_pool.cc:224] Handling call
0709 12:11:31.879395 (+1498573us) spinlock_profiling.cc:243] Waited 391 ms on lock 0x7b54000d39d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:31.879535 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":900306688}
W20260709 12:11:31.887364 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:31.891623 27012 log.cc:927] Time spent T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:11:31.870888 26842 raft_consensus.cc:2804] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:31.893276 26842 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:31.893672 26842 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.899310 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:31.900379 27011 raft_consensus.cc:3055] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:31.900784 27011 raft_consensus.cc:740] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:31.901643 27011 consensus_queue.cc:260] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:31.903532 27003 raft_consensus.cc:3055] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:31.903915 27003 raft_consensus.cc:740] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:31.904841 27003 consensus_queue.cc:260] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:31.906087 27003 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:31.906734 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:31.856096 26684 raft_consensus.cc:740] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:31.905753 26764 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:31.908126 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:31.909015 22605 raft_consensus.cc:2368] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 10. Current term is 11.
I20260709 12:11:31.857527 27004 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:31.902773 27011 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:31.916374 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:31.916851 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 69179.7us
I20260709 12:11:31.852329 26801 consensus_queue.cc:1059] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:11:31.937490 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:31.856241 26980 consensus_queue.cc:1048] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 12:11:31.941636 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:31.943147 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 91141.1us
I20260709 12:11:31.945683 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:31.949520 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 83622.9us
I20260709 12:11:31.923149 26770 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:31.953104 22421 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:31.953614 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:11:31.953183 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 82344.1us
I20260709 12:11:31.959134 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:31.959668 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:31.960150 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:31.960408 22525 raft_consensus.cc:2393] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 11: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:31.961022 22523 raft_consensus.cc:2368] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 10. Current term is 11.
I20260709 12:11:31.960994 22605 raft_consensus.cc:1240] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 LEADER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:31.962037 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:11:31.967276 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 108501us
I20260709 12:11:31.963187 22599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43070 (request call id 694) took 1635 ms. Trace:
I20260709 12:11:31.968951 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:31.956879 26801 raft_consensus.cc:3055] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:31.959004 26695 raft_consensus.cc:2804] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:31.968093 22599 rpcz_store.cc:276] 0709 12:11:30.321963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.322759 (+   796us) service_pool.cc:224] Handling call
0709 12:11:30.323089 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:31.054711 (+731622us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:31.054752 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:31.054806 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:31.054872 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:31.957462 (+902590us) spinlock_profiling.cc:243] Waited 395 ms on lock 0x7b5400350cd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:31.957505 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:31.957619 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":164217,"raft.queue_time_us":182425,"raft.run_cpu_time_us":65,"raft.run_wall_time_us":65,"spinlock_wait_cycles":907726208,"thread_start_us":151383,"threads_started":1}
I20260709 12:11:31.962495 26940 raft_consensus.cc:2749] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:31.976025 26801 raft_consensus.cc:740] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:32.006605 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:31.963215 26770 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:31.947053 27004 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:31.979946 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.980605 26764 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:31.983343 26971 log.cc:927] Time spent T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.916s	user 0.000s	sys 0.004s
I20260709 12:11:31.957221 26800 consensus_queue.cc:1048] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:11:31.972111 26684 consensus_queue.cc:260] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:32.048506 22604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45562 (request call id 2398) took 1080 ms. Trace:
I20260709 12:11:31.976038 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:32.019192 23088 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.074s	user 0.015s	sys 0.010s
I20260709 12:11:31.976883 26669 consensus_queue.cc:1048] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:11:31.988371 26695 raft_consensus.cc:697] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 12 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:32.068967 26764 consensus_queue.cc:1059] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:32.069159 26695 consensus_queue.cc:237] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:32.070252 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:32.071033 22528 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 9.
I20260709 12:11:32.071288 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:32.051827 27004 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:32.071887 22523 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
I20260709 12:11:32.072319 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:32.052433 26770 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:32.053229 26821 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:32.073510 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:32.074136 22523 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:32.059409 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:32.077848 22602 raft_consensus.cc:3055] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:32.078194 22602 raft_consensus.cc:740] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:32.060106 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:32.079380 22605 raft_consensus.cc:2368] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 10. Current term is 11.
I20260709 12:11:32.065197 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:32.067811 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:32.068156 26920 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.080986 26920 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:32.082280 23088 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.137s	user 0.015s	sys 0.011s
W20260709 12:11:32.082635 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 1.2387e+06us
I20260709 12:11:32.048980 22604 rpcz_store.cc:276] 0709 12:11:30.963455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.964049 (+   594us) service_pool.cc:224] Handling call
0709 12:11:32.031027 (+1066978us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54000e8b54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:32.043751 (+ 12724us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":331763584}
I20260709 12:11:32.083616 22570 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:32.083832 22455 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11.
I20260709 12:11:32.073122 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:32.079984 22452 raft_consensus.cc:1240] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 13. Current term is 14. Ops: []
W20260709 12:11:32.090749 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 47139us
I20260709 12:11:32.067935 26684 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:32.096536 22526 raft_consensus.cc:1240] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:11:32.078925 22602 consensus_queue.cc:260] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:32.097312 22602 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:32.083240 26920 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:32.087631 27019 log.cc:927] Time spent T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.137s	user 0.000s	sys 0.004s
I20260709 12:11:32.112063 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:32.060461 26624 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:32.115451 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:32.115532 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:32.119118 27005 raft_consensus.cc:3055] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:32.136729 27005 raft_consensus.cc:740] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:32.138196 26975 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.138700 26975 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:32.139256 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:32.139586 22604 raft_consensus.cc:1275] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:32.140762 26975 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:32.119992 27010 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:32.141659 26970 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:32.126037 26801 consensus_queue.cc:260] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:32.145058 26624 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:32.145766 26624 raft_consensus.cc:3055] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:32.146121 26624 raft_consensus.cc:740] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:32.147320 22569 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:32.135587 27017 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.148123 22497 leader_election.cc:400] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 10. Current term is 11.
I20260709 12:11:32.148453 22497 leader_election.cc:403] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:32.123512 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:32.103827 26667 raft_consensus.cc:2749] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:32.149991 22497 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:32.148161 27017 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:32.152067 27022 raft_consensus.cc:2749] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:32.158421 27022 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:32.158931 27022 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:32.160637 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:32.124003 22453 raft_consensus.cc:1240] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 LEADER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:11:32.161845 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:32.162535 22448 raft_consensus.cc:2393] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 11: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
W20260709 12:11:32.162817 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 115435us
I20260709 12:11:32.163681 22570 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:32.163945 22422 leader_election.cc:400] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 10. Current term is 11.
I20260709 12:11:32.164256 22422 leader_election.cc:403] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:11:32.164999 22570 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:32.139881 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:32.165978 26742 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:32.166635 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.139832 22530 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:32.137694 27005 consensus_queue.cc:260] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:32.148380 26980 raft_consensus.cc:2804] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:32.119429 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:32.152585 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:32.188355 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:32.135663 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:32.153136 27017 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:32.153353 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:32.121558 26868 raft_consensus.cc:3055] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:32.137630 26878 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.095525 26842 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:32.161032 27022 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:32.136215 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:32.231959 22456 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:32.140723 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:32.170852 22523 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
I20260709 12:11:32.171156 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:32.232935 22526 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:32.171314 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:32.173012 22602 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 14.
I20260709 12:11:32.233464 22528 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:32.233652 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:11:32.184959 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 214797us
I20260709 12:11:32.188971 22451 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 14.
I20260709 12:11:32.203814 22600 raft_consensus.cc:1275] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:32.226497 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:32.228732 23119 raft_consensus.cc:1240] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:32.229533 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:32.237138 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:11:32.230360 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 167227us
I20260709 12:11:32.233083 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:32.145787 26801 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:32.234321 23118 raft_consensus.cc:2468] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 8.
I20260709 12:11:32.238792 22422 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:32.227324 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:32.244302 23121 raft_consensus.cc:2393] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 13: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:32.241043 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:32.245667 22495 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:32.177310 27010 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:32.246425 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 163271us
I20260709 12:11:32.247818 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:32.200176 26980 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:32.248950 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:32.283610 22457 raft_consensus.cc:1240] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:32.282488 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:32.284365 26074 consensus_queue.cc:1048] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:32.202666 26979 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:32.282867 23117 raft_consensus.cc:1275] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:32.202215 26669 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.253623 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:32.286491 26669 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:32.289227 26669 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:32.290055 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:32.166478 26976 consensus_queue.cc:1048] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 12:11:32.202513 26868 raft_consensus.cc:740] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:32.290858 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:32.291118 22421 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:32.292920 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:32.261862 22495 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:32.235328 27003 raft_consensus.cc:2749] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 10. Current term is 11.
I20260709 12:11:32.290623 22523 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 10.
I20260709 12:11:32.238479 27017 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:32.301344 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:32.296182 22528 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 12.
I20260709 12:11:32.315725 22604 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:32.300112 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:32.325452 23120 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 12.
I20260709 12:11:32.332423 26074 raft_consensus.cc:2804] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:32.333246 26074 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:32.333673 26074 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:32.335098 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 77072.7us
I20260709 12:11:32.318627 22531 raft_consensus.cc:2376] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 12. Re-sending same reply.
I20260709 12:11:32.338141 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:11:32.340884 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 79132.5us
I20260709 12:11:32.292754 26980 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:32.295806 26940 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:32.282191 26975 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:32.295629 27022 raft_consensus.cc:2749] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:32.343274 22495 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:32.237823 26878 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:32.252012 27010 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:32.187944 26624 consensus_queue.cc:260] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:32.372543 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:32.372912 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:32.373667 23118 raft_consensus.cc:2368] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 10. Current term is 11.
I20260709 12:11:32.356523 23119 raft_consensus.cc:1275] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:32.374619 22532 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:32.340782 26988 log.cc:927] Time spent T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:11:32.318005 26669 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
W20260709 12:11:32.351706 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 186775us
I20260709 12:11:32.346594 26970 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:32.367571 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:32.387071 23120 raft_consensus.cc:2393] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 11: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
W20260709 12:11:32.387636 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 83421us
W20260709 12:11:32.389417 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 103243us
I20260709 12:11:32.367228 22495 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:32.324100 27017 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:32.371248 23121 raft_consensus.cc:1240] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:11:32.350764 27008 raft_consensus.cc:2804] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:32.390321 23089 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:32.368224 22421 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:32.383476 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:32.364104 26940 raft_consensus.cc:697] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 14 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:32.399989 23119 raft_consensus.cc:1240] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:32.402817 23087 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:11:32.399865 23088 connection.cc:256] RPC call timeout handler was delayed by -1.425614004000181s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1814s for a response
I20260709 12:11:32.410012 22527 raft_consensus.cc:1275] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 12:11:32.411638 22527 pending_rounds.cc:85] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting all ops after (but not including) 7
I20260709 12:11:32.412197 22527 pending_rounds.cc:107] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:11:32.410089 22570 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:32.412708 22527 raft_consensus.cc:2889] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:32.411227 22421 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:32.421417 23121 raft_consensus.cc:1240] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:32.423811 23118 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 10.
I20260709 12:11:32.425045 26074 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:32.427868 26695 raft_consensus.cc:2749] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:32.428279 22570 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:32.429559 22570 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:32.429750 26667 raft_consensus.cc:2749] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:32.431767 27010 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:32.432076 26427 raft_consensus.cc:2749] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:32.433550 23088 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:11:32.435093 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.435395 23125 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:32.435786 27029 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.393921 26669 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:32.436347 27029 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:32.438264 26669 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:32.441676 22601 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 10.
I20260709 12:11:32.443259 26878 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:32.443446 22528 raft_consensus.cc:1275] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:32.399557 26800 raft_consensus.cc:2749] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:32.415021 27008 raft_consensus.cc:697] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:32.363786 26975 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:32.447908 27008 consensus_queue.cc:237] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:32.449036 26975 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:32.392966 27017 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:32.450505 27005 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:32.400445 26624 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:32.410502 26868 consensus_queue.cc:260] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:32.430740 22570 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:32.456640 22456 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 10.
W20260709 12:11:32.458045 22495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.438719 27029 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:32.469548 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:32.469810 22495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:32.469949 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 58882.4us
W20260709 12:11:32.479301 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 119988us
I20260709 12:11:32.460307 22530 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
I20260709 12:11:32.467428 22532 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 14.
I20260709 12:11:32.470224 23119 raft_consensus.cc:1240] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:32.462142 22526 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 10.
I20260709 12:11:32.478260 22421 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:11:32.442962 26998 log.cc:927] Time spent T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:11:32.491523 23125 raft_consensus.cc:1275] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:32.493985 22456 raft_consensus.cc:1275] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:11:32.494710 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:32.495028 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:32.495357 22526 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:32.495039 23120 raft_consensus.cc:1275] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:32.499651 22353 catalog_manager.cc:5697] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 8 to 11, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 11 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:32.501653 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 70970.1us
I20260709 12:11:32.501605 22353 catalog_manager.cc:5697] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 6 to 11, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 11 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:32.502800 26868 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:32.503132 27009 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.503809 22570 leader_election.cc:304] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:32.451637 26611 raft_consensus.cc:2804] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:32.504436 26611 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:32.504588 27016 raft_consensus.cc:2749] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:32.504858 26611 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:32.507128 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.503684 27009 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:32.511963 26940 consensus_queue.cc:237] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:32.520612 26940 raft_consensus.cc:2804] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:32.521868 26630 raft_consensus.cc:2804] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:32.524004 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:32.554167 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:32.524618 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:32.554848 22524 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:32.555049 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 47588.1us
I20260709 12:11:32.459551 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:32.540047 22604 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 12.
W20260709 12:11:32.537647 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 134910us
I20260709 12:11:32.465164 26074 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:32.556833 22421 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:32.557559 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:32.564419 22531 raft_consensus.cc:2393] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 7: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:32.568058 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:32.575522 22457 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
I20260709 12:11:32.579409 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:11:32.581336 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 77592.5us
W20260709 12:11:32.586359 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 197259us
W20260709 12:11:32.600916 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.553428 27029 raft_consensus.cc:2804] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:32.549201 26940 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:32.601393 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:32.601661 22497 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:32.441679 27035 consensus_queue.cc:1059] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.141s
I20260709 12:11:32.554308 26630 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:32.610903 22570 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:32.611445 22530 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 10.
I20260709 12:11:32.568122 26979 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:32.614029 23089 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:32.625824 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:32.626555 22421 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:32.628269 22526 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 12.
I20260709 12:11:32.633912 22602 raft_consensus.cc:1275] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:32.630561 22421 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:32.618207 26940 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:32.640848 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:32.613575 26970 raft_consensus.cc:2804] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:32.619426 27011 consensus_meta.cc:287] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.683s	user 0.015s	sys 0.001s
I20260709 12:11:32.617671 26764 raft_consensus.cc:2749] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:32.649488 26074 consensus_queue.cc:1048] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:32.568081 26976 consensus_queue.cc:1059] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 12:11:32.618207 26619 raft_consensus.cc:2764] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:11:32.567749 26695 consensus_queue.cc:1059] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 12:11:32.623104 27029 raft_consensus.cc:697] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 11 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:32.622493 26684 raft_consensus.cc:2749] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:32.663882 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:32.647807 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:32.707159 23125 raft_consensus.cc:2393] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 10: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:32.666191 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:32.656613 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 64944.6us
I20260709 12:11:32.667086 27044 raft_consensus.cc:2749] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:32.670169 27037 log.cc:927] Time spent T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:11:32.675555 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:32.677703 27009 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:32.679388 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.714246 22496 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:32.679415 27040 raft_consensus.cc:3055] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:32.682250 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:32.716106 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:32.691200 27026 raft_consensus.cc:2749] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:32.691841 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:32.694939 22353 catalog_manager.cc:5697] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
W20260709 12:11:32.698252 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 67790.2us
I20260709 12:11:32.703670 26074 raft_consensus.cc:2749] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:32.623405 26630 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:32.683338 27041 raft_consensus.cc:2804] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:32.728150 22353 catalog_manager.cc:5697] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:11:32.717118 22450 raft_consensus.cc:2393] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 10: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:32.729574 22353 catalog_manager.cc:5697] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:11:32.651458 26970 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:32.719718 22496 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
W20260709 12:11:32.722522 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 289047us
I20260709 12:11:32.739065 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:11:32.771023 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 49604.8us
W20260709 12:11:32.771618 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.715984 27040 raft_consensus.cc:740] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:32.728056 27009 raft_consensus.cc:2804] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:32.724442 22421 leader_election.cc:400] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Vote denied by peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353) with higher term. Message: Invalid argument: T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 10. Current term is 11.
I20260709 12:11:32.651787 27045 raft_consensus.cc:2749] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:32.770097 26685 consensus_queue.cc:1048] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:11:32.779871 27044 consensus_queue.cc:1048] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
W20260709 12:11:32.792591 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 71308.3us
I20260709 12:11:32.793325 22421 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:32.736340 26976 raft_consensus.cc:3055] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:32.793933 27009 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:32.794227 26976 raft_consensus.cc:740] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:32.794377 27009 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:32.795173 26976 consensus_queue.cc:260] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:32.796463 26976 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:32.738471 26970 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:32.797852 27040 consensus_queue.cc:260] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:32.799078 27040 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:32.802088 26742 consensus_meta.cc:287] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.636s	user 0.007s	sys 0.005s
I20260709 12:11:32.802529 26742 raft_consensus.cc:2749] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 10. Current term is 11.
I20260709 12:11:32.727067 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:32.784511 23122 raft_consensus.cc:2410] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:11:32.807670 22528 raft_consensus.cc:2410] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:11:32.811401 26768 raft_consensus.cc:2804] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:32.811959 26768 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:32.812392 26768 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:32.814247 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:32.814869 22448 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 14.
I20260709 12:11:32.815152 27044 consensus_queue.cc:1059] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:32.816291 27044 consensus_queue.cc:1048] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:32.818193 27044 raft_consensus.cc:3055] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:32.818558 27044 raft_consensus.cc:740] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:32.728370 26842 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:32.819610 22456 raft_consensus.cc:1240] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:32.820920 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:32.822125 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:32.824509 27016 consensus_queue.cc:1048] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:32.824738 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:32.824975 22569 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:32.826071 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:32.826210 26695 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:32.818745 26980 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:32.709836 26940 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:32.826700 26695 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:32.828032 26695 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:32.829384 26940 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:32.829696 27044 consensus_queue.cc:260] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:32.831131 23088 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:32.832196 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:32.833369 22453 raft_consensus.cc:1275] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:32.826766 27029 consensus_queue.cc:237] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:32.827311 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:32.853560 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 72457.2us
I20260709 12:11:32.854076 22456 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 14.
I20260709 12:11:32.834527 22455 raft_consensus.cc:1240] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:32.837473 22454 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 11.
W20260709 12:11:32.771975 23087 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.851s (SENT) [suppressed 40 similar messages]
I20260709 12:11:32.856120 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:11:32.855173 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 83213.4us
W20260709 12:11:32.861847 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:32.863189 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 66239.3us
W20260709 12:11:32.838586 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 60264us
W20260709 12:11:32.843317 22525 consensus_meta.cc:287] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.599s	user 0.004s	sys 0.008s
I20260709 12:11:32.864305 22525 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
I20260709 12:11:32.864455 22570 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:32.723551 22524 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 10.
I20260709 12:11:32.852819 22448 raft_consensus.cc:1275] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:32.827323 22605 raft_consensus.cc:2393] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 12: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:32.774101 27041 raft_consensus.cc:697] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 12 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:32.889463 27023 consensus_queue.cc:1048] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:11:32.890076 26427 raft_consensus.cc:2749] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:32.890974 26800 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.891516 26800 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:32.892611 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 111679us
W20260709 12:11:32.893669 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 67763.8us
I20260709 12:11:32.894933 22353 catalog_manager.cc:5697] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 8 to 12, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 12 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:32.853062 27044 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:32.872246 23125 raft_consensus.cc:1275] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:11:32.775705 27008 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:32.866916 26801 consensus_meta.cc:287] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.571s	user 0.010s	sys 0.000s
I20260709 12:11:32.902283 23125 pending_rounds.cc:85] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270: Aborting all ops after (but not including) 8
I20260709 12:11:32.909062 23125 pending_rounds.cc:107] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:11:32.908864 22496 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:32.909273 23125 raft_consensus.cc:2889] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:32.902153 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:32.913147 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:32.904749 22495 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:32.902756 23088 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:32.908201 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 43804.4us
I20260709 12:11:32.868319 27022 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.905860 23087 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:32.867012 27009 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:32.914180 22605 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7.
I20260709 12:11:32.920675 23087 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:32.936753 27022 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:32.941300 22495 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:32.867915 27016 consensus_queue.cc:1059] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
W20260709 12:11:32.951761 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:32.956591 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 123884us
I20260709 12:11:32.866612 26684 consensus_queue.cc:1048] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 12:11:32.911861 26624 raft_consensus.cc:2749] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:32.963640 22353 catalog_manager.cc:5697] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
W20260709 12:11:32.965763 22421 leader_election.cc:336] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 1.715s (SENT)
W20260709 12:11:32.970638 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 67955.9us
W20260709 12:11:32.991308 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 70727.9us
I20260709 12:11:32.939571 26868 raft_consensus.cc:2749] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:32.915365 26427 consensus_queue.cc:1048] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 12:11:32.915884 27004 consensus_queue.cc:1048] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:11:32.952108 27021 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:33.021960 23088 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:32.969942 27006 raft_consensus.cc:2749] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:33.003736 26878 raft_consensus.cc:3055] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:33.035604 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:33.036378 22525 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:33.033743 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:33.033932 22497 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:33.034813 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:32.979159 26800 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:33.053691 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 139086us
I20260709 12:11:33.054682 22570 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:33.018239 26619 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.027473 27046 raft_consensus.cc:2804] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:33.096725 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:33.107617 23125 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 6.
I20260709 12:11:32.952071 27048 raft_consensus.cc:2749] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:11:33.098352 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 43789.6us
I20260709 12:11:33.101691 22524 raft_consensus.cc:1275] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:33.044441 22353 catalog_manager.cc:5697] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:33.102504 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 142027us
I20260709 12:11:33.112123 27029 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:33.112773 27052 log.cc:927] Time spent T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:11:33.112723 27029 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:33.113286 22421 leader_election.cc:336] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 1.869s (SENT)
I20260709 12:11:33.113790 27054 raft_consensus.cc:2804] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:33.114497 27054 raft_consensus.cc:697] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 10 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:33.096439 27016 raft_consensus.cc:2804] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:33.115360 27056 log.cc:927] Time spent T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
W20260709 12:11:33.115607 27053 log.cc:927] Time spent T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
W20260709 12:11:33.119678 27058 log.cc:927] Time spent T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:11:33.122537 27009 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:33.115638 27016 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:33.123581 27016 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:33.113893 22421 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:33.096299 26667 raft_consensus.cc:3055] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:33.128494 26667 raft_consensus.cc:740] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:33.129630 26667 consensus_queue.cc:260] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:33.104138 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 162927us
W20260709 12:11:33.104818 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 82956.1us
I20260709 12:11:33.099849 26800 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.036110 26878 raft_consensus.cc:740] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:33.134204 22495 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:33.143013 26800 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:33.146052 26800 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:33.146234 26630 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:33.147724 26878 consensus_queue.cc:260] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:33.148811 26878 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:33.149900 27050 log.cc:927] Time spent T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 12:11:33.150164 26980 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:33.150681 22525 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
I20260709 12:11:33.151170 22457 raft_consensus.cc:1240] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:33.151331 27057 raft_consensus.cc:2749] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:33.105975 26619 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:33.155979 27022 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:33.157387 26619 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:33.111174 26695 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:33.160144 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:33.160533 26770 raft_consensus.cc:2749] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:33.160898 22495 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:33.162072 23088 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:33.163825 23088 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:33.165200 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.096105 27051 raft_consensus.cc:2749] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:33.167110 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:33.173378 23088 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:33.104697 26801 raft_consensus.cc:2804] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:11:33.131755 26979 consensus_meta.cc:287] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.504s	user 0.005s	sys 0.004s
I20260709 12:11:33.162060 22495 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:33.189246 23119 raft_consensus.cc:1275] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:33.186853 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:33.208933 23116 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 12.
I20260709 12:11:33.209164 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:11:33.187059 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 73833.9us
W20260709 12:11:33.203959 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.205554 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:33.169073 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:11:33.180410 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.159698 26695 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:33.211792 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:33.136509 27029 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:33.220182 27017 consensus_meta.cc:287] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.770s	user 0.003s	sys 0.011s
I20260709 12:11:33.220615 27017 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:33.221884 22597 raft_consensus.cc:1275] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:33.222640 27017 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:33.222911 22601 raft_consensus.cc:1240] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:33.211246 23120 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 12.
W20260709 12:11:33.192752 26611 consensus_meta.cc:287] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.687s	user 0.012s	sys 0.000s
I20260709 12:11:33.167999 26667 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:33.230032 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 55121.3us
I20260709 12:11:33.230870 22421 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:33.035490 27041 consensus_queue.cc:237] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:33.188757 26624 raft_consensus.cc:2804] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:33.191776 26801 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.108520 26970 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:33.238013 22496 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:33.174126 27046 raft_consensus.cc:697] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 10 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:33.207862 27035 raft_consensus.cc:2749] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:33.204041 27008 raft_consensus.cc:2749] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:33.204563 26979 raft_consensus.cc:2749] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:33.290472 22604 raft_consensus.cc:1275] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:33.236510 26800 raft_consensus.cc:2749] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:33.236994 27048 raft_consensus.cc:2804] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:33.297237 27048 raft_consensus.cc:697] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 12 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
W20260709 12:11:33.274716 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 101408us
I20260709 12:11:33.273711 27054 consensus_queue.cc:237] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:33.271216 27044 consensus_queue.cc:1048] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 12:11:33.241262 27010 raft_consensus.cc:2804] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:33.301894 27010 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.302296 27010 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:33.284122 27060 log.cc:927] Time spent T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:11:33.285008 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:33.287281 22453 raft_consensus.cc:1240] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:33.287328 22450 raft_consensus.cc:1240] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:33.287849 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:11:33.288218 27047 log.cc:927] Time spent T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.356s	user 0.001s	sys 0.000s
I20260709 12:11:33.236425 26624 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:33.239634 26801 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:33.322685 23088 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:33.326105 26630 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:33.327173 26768 consensus_meta.cc:287] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.514s	user 0.011s	sys 0.000s
I20260709 12:11:33.327886 26768 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:33.329412 22449 raft_consensus.cc:2393] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 12: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:33.321870 26624 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:33.314791 27040 consensus_meta.cc:287] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.515s	user 0.007s	sys 0.003s
I20260709 12:11:33.240528 22496 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:11:33.270845 27005 consensus_meta.cc:287] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.814s	user 0.014s	sys 0.000s
W20260709 12:11:33.245637 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 83571.7us
I20260709 12:11:33.336709 22495 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:33.289007 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 78083.7us
I20260709 12:11:33.299500 22570 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:33.308974 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:33.237255 26611 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:33.271034 26940 raft_consensus.cc:2749] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:33.314278 22456 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:33.337864 22421 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:11:33.340818 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 100420us
I20260709 12:11:33.341375 27071 raft_consensus.cc:2749] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:33.336895 27029 consensus_queue.cc:1059] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
W20260709 12:11:33.361959 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 62544.7us
I20260709 12:11:33.362385 27029 raft_consensus.cc:3055] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:33.362787 27029 raft_consensus.cc:740] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:33.364014 22570 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:33.363773 27029 consensus_queue.cc:260] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:33.365077 27029 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:33.365231 22570 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:33.352475 27008 raft_consensus.cc:2749] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:33.366750 26970 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:33.342672 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.339390 27023 raft_consensus.cc:2749] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:33.348490 22495 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:33.319034 26842 consensus_queue.cc:1048] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
W20260709 12:11:33.386543 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:33.387784 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.338487 27003 raft_consensus.cc:2804] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:33.407840 27003 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.317976 27016 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:33.427608 27003 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:33.429557 22600 raft_consensus.cc:1240] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:33.430682 27016 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:33.432957 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:11:33.410547 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 62174.9us
I20260709 12:11:33.440675 26800 consensus_queue.cc:1059] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:33.442471 27022 raft_consensus.cc:3055] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:33.442962 27022 raft_consensus.cc:740] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:33.444130 27022 consensus_queue.cc:260] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:33.445910 27022 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:33.452138 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:33.453472 22453 raft_consensus.cc:1240] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:33.455104 22455 raft_consensus.cc:1275] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:33.457477 22451 raft_consensus.cc:1240] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:33.468763 27016 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.469653 27016 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:33.473330 27003 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:33.489959 27069 log.cc:927] Time spent T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.185s	user 0.000s	sys 0.000s
I20260709 12:11:33.490463 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:33.491245 23116 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:33.369894 27005 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:33.423688 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:33.425472 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 60323.4us
I20260709 12:11:33.477407 27016 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:33.478549 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:33.512894 22451 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11.
I20260709 12:11:33.418588 22456 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 15.
W20260709 12:11:33.480365 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 142622us
I20260709 12:11:33.484805 26619 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.402875 26980 raft_consensus.cc:2804] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:33.367297 27046 consensus_queue.cc:237] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:33.481504 27008 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:33.360795 26630 raft_consensus.cc:2749] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:33.367661 27040 consensus_queue.cc:1175] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" responder_term: 10 status { last_received { term: 10 index: 11 } last_committed_idx: 11 last_received_current_leader { term: 10 index: 11 } }
I20260709 12:11:33.502202 22495 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:33.419921 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 97300.9us
I20260709 12:11:33.504540 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:33.553421 22598 raft_consensus.cc:2393] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 12: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:33.505220 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:33.402211 26979 raft_consensus.cc:2749] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:33.551437 22421 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:33.554697 23088 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:33.401690 26821 consensus_queue.cc:1059] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.117s
I20260709 12:11:33.519168 23116 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 13.
I20260709 12:11:33.561730 23088 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:33.542028 27003 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:33.572674 23088 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:33.543864 27008 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.556543 27016 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:33.576714 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 68577.7us
I20260709 12:11:33.584682 22570 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:33.559446 26940 raft_consensus.cc:2749] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:33.588606 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:33.517285 27005 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:33.593091 23121 raft_consensus.cc:2393] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 13: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
W20260709 12:11:33.590207 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 44476.1us
I20260709 12:11:33.596621 22421 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:33.565055 26768 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:33.559557 26980 raft_consensus.cc:697] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:33.517571 27010 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:33.601397 23088 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:33.551648 26619 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:33.587675 27041 raft_consensus.cc:2749] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:33.604400 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:33.611442 23117 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11.
I20260709 12:11:33.583245 27008 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:33.591297 26427 raft_consensus.cc:2749] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:33.480556 27048 consensus_queue.cc:237] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:33.600031 27003 raft_consensus.cc:2749] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:33.598057 27035 raft_consensus.cc:2804] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:33.627782 26980 consensus_queue.cc:237] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:33.619244 27071 raft_consensus.cc:2749] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:33.631219 26611 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:33.593370 27016 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:33.635459 27075 log.cc:927] Time spent T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
W20260709 12:11:33.647215 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.648411 22570 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:33.651194 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:33.651754 23118 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:11:33.652247 22570 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:33.623028 26940 raft_consensus.cc:2749] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:33.650451 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:33.656610 23121 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:33.657383 22570 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:33.657961 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:33.658774 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:33.659467 22570 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:33.668118 23117 raft_consensus.cc:1275] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:11:33.679207 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.652778 27035 raft_consensus.cc:697] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 10 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:33.689337 27035 consensus_queue.cc:237] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:33.682722 22421 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:33.655972 27003 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.655586 26427 raft_consensus.cc:2749] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:33.655748 26821 raft_consensus.cc:2749] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:33.685201 26619 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:33.685863 27078 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:33.688433 27016 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:11:33.693068 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 190956us
I20260709 12:11:33.699909 23118 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 15.
W20260709 12:11:33.727334 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.676489 26684 raft_consensus.cc:2749] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:33.681986 27041 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.680357 27051 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:33.730314 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:33.731591 22525 raft_consensus.cc:1240] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:33.732023 22523 raft_consensus.cc:1240] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 11. Current term is 13. Ops: []
I20260709 12:11:33.733526 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:33.734129 22531 raft_consensus.cc:1275] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:11:33.734318 22530 raft_consensus.cc:1240] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:33.735708 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 56658us
I20260709 12:11:33.741246 26801 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:33.743578 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 84178.4us
I20260709 12:11:33.773455 22570 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:33.773473 22421 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:33.774008 22532 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11.
I20260709 12:11:33.747653 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:33.775648 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:33.775533 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:33.776355 22528 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:33.778951 22603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:11:33.779546 22603 raft_consensus.cc:606] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:11:33.779711 22529 raft_consensus.cc:1240] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:11:33.779850 22603 raft_consensus.cc:614] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:33.700774 26940 raft_consensus.cc:2749] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:33.784703 22421 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:33.784885 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:33.785516 22532 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:33.748065 27016 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:33.729612 27022 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:33.789628 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:33.742731 27023 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:33.775307 26619 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.793267 23124 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11.
I20260709 12:11:33.700904 27003 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:33.798527 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.781749 27045 raft_consensus.cc:2804] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:33.803535 26074 consensus_queue.cc:1048] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:11:33.805469 26667 consensus_meta.cc:287] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.563s	user 0.008s	sys 0.000s
I20260709 12:11:33.789731 26742 consensus_queue.cc:1048] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:11:33.826773 22603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6334366811764682b0a491c130c68eed"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:11:33.776743 26669 consensus_queue.cc:1059] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 12:11:33.827513 22603 raft_consensus.cc:606] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:11:33.809706 26624 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:33.785821 26684 raft_consensus.cc:2764] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 12:11:33.811594 23087 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:33.829659 22453 raft_consensus.cc:1275] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:33.831287 23087 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:33.830188 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:33.747910 27041 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:33.815678 22523 raft_consensus.cc:1275] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:33.801380 22532 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11.
I20260709 12:11:33.816346 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:33.787525 26768 raft_consensus.cc:2804] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:33.802418 22570 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:33.819687 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:33.839344 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:33.820220 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:33.820351 27088 consensus_queue.cc:1059] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:11:33.820629 27045 raft_consensus.cc:697] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 12 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:33.821237 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:33.821722 27083 log.cc:927] Time spent T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:11:33.821892 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:33.822535 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:33.842808 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:33.844784 22451 raft_consensus.cc:2393] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 10: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:33.823145 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:11:33.825402 26878 consensus_meta.cc:287] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.676s	user 0.008s	sys 0.002s
I20260709 12:11:33.802310 26619 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:33.827967 22603 raft_consensus.cc:614] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:33.809648 27087 consensus_queue.cc:1048] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:33.855440 27003 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:33.833127 23087 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:33.833787 22524 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:11:33.827605 26821 consensus_queue.cc:1048] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 12:11:33.834928 27035 raft_consensus.cc:2749] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:33.836957 26669 raft_consensus.cc:3055] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:33.867688 26669 raft_consensus.cc:740] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:33.868577 26669 consensus_queue.cc:260] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:33.838068 22530 raft_consensus.cc:1240] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:33.840404 22454 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 13.
I20260709 12:11:33.839354 22531 raft_consensus.cc:2376] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11. Re-sending same reply.
I20260709 12:11:33.842327 26768 raft_consensus.cc:697] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:33.842837 27045 consensus_queue.cc:237] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:33.870905 26624 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:33.843380 26667 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:33.873636 26667 raft_consensus.cc:697] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:33.873839 27041 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:33.874550 26667 consensus_queue.cc:237] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:33.878345 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:33.878764 26768 consensus_queue.cc:237] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:33.797194 27022 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:33.834335 22421 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:33.851954 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:33.852342 23123 raft_consensus.cc:2393] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 12: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:33.853456 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:33.893270 22532 raft_consensus.cc:2376] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 10. Re-sending same reply.
I20260709 12:11:33.815143 22528 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11.
I20260709 12:11:33.855113 26801 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:33.856473 27046 raft_consensus.cc:2749] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:33.775537 27051 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:33.830071 27005 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:33.861910 27008 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:33.833890 27029 raft_consensus.cc:2764] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
W20260709 12:11:33.865998 27091 log.cc:927] Time spent T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:11:33.867035 22603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:11:33.963372 22603 raft_consensus.cc:606] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Received request to transfer leadership to TS c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:33.963739 22603 raft_consensus.cc:614] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:33.833019 27010 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:33.789870 27055 consensus_queue.cc:1048] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:11:33.882750 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:33.965628 22531 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11.
I20260709 12:11:33.885267 22496 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:33.886637 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:33.818894 27023 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:33.897012 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:33.907990 22529 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
I20260709 12:11:33.909085 23121 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
W20260709 12:11:33.916339 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 82111.3us
I20260709 12:11:33.954952 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:11:33.968050 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 82913.6us
I20260709 12:11:33.959388 27022 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:33.961320 27008 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:33.961730 26619 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:33.967168 22601 raft_consensus.cc:2368] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 11. Current term is 12.
W20260709 12:11:33.985319 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 207580us
I20260709 12:11:33.957921 27041 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:33.978565 22598 raft_consensus.cc:1275] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:33.981423 22421 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:33.896027 22569 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:11:33.986733 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 90830.9us
I20260709 12:11:33.926792 26976 raft_consensus.cc:2749] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:33.915422 27087 consensus_queue.cc:1048] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 12:11:33.997268 22529 raft_consensus.cc:1240] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:33.995558 26074 consensus_queue.cc:1048] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:33.967774 27029 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.983422 27010 raft_consensus.cc:2804] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:34.006284 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:34.008749 22454 raft_consensus.cc:2410] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 12:11:34.004103 27101 log.cc:927] Time spent T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:11:33.998459 26821 raft_consensus.cc:2804] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:33.997499 26842 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:34.024158 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:34.026665 22452 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:34.031610 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:34.032853 22597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:11:34.032732 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:33.994446 27041 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:34.037864 23089 leader_election.cc:400] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 election: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 11. Current term is 12.
I20260709 12:11:34.039142 23089 leader_election.cc:403] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:11:34.020651 26821 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:34.027587 27010 raft_consensus.cc:697] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:34.012537 27029 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:34.027232 27003 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.079538 27003 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:34.046281 27010 consensus_queue.cc:237] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:34.046782 22604 raft_consensus.cc:1275] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:34.045122 27046 consensus_queue.cc:1048] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:11:34.035003 27078 raft_consensus.cc:2749] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:34.042032 27054 raft_consensus.cc:2749] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 11. Current term is 12.
I20260709 12:11:34.065821 27051 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:34.100016 22495 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:34.068616 27029 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:34.042905 26821 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:34.100660 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:34.068647 27041 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:34.090624 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:34.091902 22452 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
I20260709 12:11:34.094493 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:34.106690 22529 raft_consensus.cc:2393] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 13: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:34.107905 22529 raft_consensus.cc:1275] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:34.108969 22529 raft_consensus.cc:1240] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:34.095314 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:34.112020 22531 raft_consensus.cc:2376] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 10. Re-sending same reply.
I20260709 12:11:34.116125 27016 raft_consensus.cc:2749] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:34.116607 27062 log.cc:927] Time spent T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.905s	user 0.000s	sys 0.004s
W20260709 12:11:34.118022 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.118216 27092 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.118743 27023 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:34.096591 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:34.097226 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:34.097944 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:34.098692 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:34.123067 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:34.098774 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:34.024922 27022 consensus_queue.cc:1059] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
W20260709 12:11:34.104164 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 113025us
I20260709 12:11:34.106540 22450 raft_consensus.cc:1240] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:34.094897 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:34.082212 27003 leader_election.cc:290] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:34.132097 23087 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:34.128873 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:34.133560 23087 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:34.211076 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:34.211517 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:34.212241 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:34.212482 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:34.101886 27035 consensus_queue.cc:1048] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.125s
I20260709 12:11:34.104043 27010 raft_consensus.cc:2749] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:34.272730 23116 raft_consensus.cc:1240] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:34.271777 23123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57332 (request call id 974) took 1100 ms. Trace:
I20260709 12:11:34.281119 22602 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 12.
W20260709 12:11:34.260792 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.255455 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:34.260051 22353 catalog_manager.cc:5697] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 5 to 11. New cstate: current_term: 11 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:34.235894 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:34.211030 26685 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.211179 26624 raft_consensus.cc:2749] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:34.284220 23124 raft_consensus.cc:1240] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:34.281178 23123 rpcz_store.cc:276] 0709 12:11:33.171070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.171847 (+   777us) service_pool.cc:224] Handling call
0709 12:11:34.271540 (+1099693us) spinlock_profiling.cc:243] Waited 635 ms on lock 0x7b54004d7e54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:34.271690 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1459395968}
I20260709 12:11:34.286854 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:34.260867 22570 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:34.222465 23122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 967) took 1308 ms. Trace:
I20260709 12:11:34.240020 22524 raft_consensus.cc:1240] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:11:34.216455 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:34.290570 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:34.291365 23118 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 13.
I20260709 12:11:34.233923 22598 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:34.292167 22528 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 10.
W20260709 12:11:34.293924 22351 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55978 (request call id 334) took 23694 ms (client timeout 15000 ms). Trace:
I20260709 12:11:34.294051 23119 raft_consensus.cc:1275] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:34.294864 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:34.295223 22353 catalog_manager.cc:5697] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:11:34.313300 23120 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:34.296248 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.284263 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:34.296598 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:34.290522 22570 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:34.305382 22449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 2027) took 1023 ms. Trace:
I20260709 12:11:34.316143 22449 rpcz_store.cc:276] 0709 12:11:33.281958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.284773 (+  2815us) service_pool.cc:224] Handling call
0709 12:11:34.305151 (+1020378us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b54004056d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:34.305313 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35307776}
I20260709 12:11:34.309792 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:34.317209 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:34.317579 22602 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 10.
I20260709 12:11:34.303725 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:34.322459 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:34.118762 27092 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:34.323179 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 310024us
I20260709 12:11:34.317823 22570 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:34.319612 22421 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:34.294131 27088 raft_consensus.cc:2804] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:34.281577 22532 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 9.
I20260709 12:11:34.289186 23122 rpcz_store.cc:276] 0709 12:11:32.913529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:32.913809 (+   280us) service_pool.cc:224] Handling call
0709 12:11:32.942758 (+ 28949us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:32.961828 (+ 19070us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:33.005294 (+ 43466us) log.cc:844] Serialized 14 byte log entry
0709 12:11:33.274636 (+269342us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:33.297904 (+ 23268us) log.cc:844] Serialized 26 byte log entry
0709 12:11:33.298070 (+   166us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:33.298277 (+   207us) log.cc:844] Serialized 14 byte log entry
0709 12:11:33.602093 (+303816us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:33.602170 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:34.072309 (+470139us) spinlock_profiling.cc:243] Waited 3.31 ms on lock 0x7b180049ed00. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc78413f3 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd 0000000000388634 0000000000388479 00007f9cc782483a
0709 12:11:34.217974 (+145665us) spinlock_profiling.cc:243] Waited 3.41 ms on lock 0x7b180049ed00. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc78413f3 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd 0000000000388634 0000000000388479 00007f9cc782483a
0709 12:11:34.222186 (+  4212us) raft_consensus.cc:1685] finished
0709 12:11:34.222214 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:34.222365 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6194,"prepare.queue_time_us":55032,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":3555,"raft.queue_time_us":48555,"raft.run_cpu_time_us":430,"raft.run_wall_time_us":66492,"spinlock_wait_cycles":15458560,"thread_start_us":531643,"threads_started":2,"wal-append.queue_time_us":293548}
W20260709 12:11:34.326768 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 193292us
I20260709 12:11:34.330832 23087 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:34.337845 22570 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:34.314152 27003 raft_consensus.cc:3055] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:34.185045 27054 consensus_queue.cc:1048] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.134s
I20260709 12:11:34.311931 26979 raft_consensus.cc:3055] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:34.361650 22353 catalog_manager.cc:5697] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 8 to 11, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 11 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:11:34.360210 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:11:34.399960 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 69212.7us
I20260709 12:11:34.307762 26685 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:34.406612 22353 catalog_manager.cc:5697] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 2 to 6, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 6 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:34.416585 23123 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 10.
I20260709 12:11:34.398591 22496 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:34.427714 22496 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:34.344048 27023 raft_consensus.cc:2804] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:34.328981 27096 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:34.328476 27045 consensus_queue.cc:1048] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 12:11:34.344723 26611 raft_consensus.cc:2749] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:34.344566 27051 raft_consensus.cc:2749] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:34.401723 22421 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:34.352084 27003 raft_consensus.cc:740] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:34.343655 27088 raft_consensus.cc:697] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:34.415875 27077 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:34.366375 26624 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:34.435475 22496 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:34.435846 22353 catalog_manager.cc:5697] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 4 to 7, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 7 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:34.398895 22531 raft_consensus.cc:1275] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:34.364408 26979 raft_consensus.cc:740] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
W20260709 12:11:34.420914 27060 log.cc:927] Time spent T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.084s	user 0.000s	sys 0.005s
I20260709 12:11:34.405584 27066 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.397552 27109 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:34.440210 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 110305us
W20260709 12:11:34.444401 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 316362us
I20260709 12:11:34.425612 23087 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:34.416679 26980 raft_consensus.cc:2749] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:34.447321 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 45787.6us
I20260709 12:11:34.457893 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:34.486024 23121 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:34.486271 22495 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:34.429162 27023 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:34.415948 27108 consensus_queue.cc:1059] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 12:11:34.469882 22353 catalog_manager.cc:5697] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 4 to 10, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 10 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:34.447882 27004 raft_consensus.cc:2804] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:34.432376 27057 consensus_queue.cc:1059] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:11:34.445380 27096 raft_consensus.cc:697] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:34.489179 22421 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:11:34.493444 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 67929.4us
I20260709 12:11:34.510082 23087 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:34.458745 27044 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:34.517860 23088 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:34.521685 23088 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:34.521926 22531 raft_consensus.cc:1275] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:34.522284 23121 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 12.
I20260709 12:11:34.484431 27119 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:34.496027 27023 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:34.497399 27004 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:34.504628 27010 raft_consensus.cc:2749] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:34.533172 22353 catalog_manager.cc:5697] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 7 to 10, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 10 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:34.509270 27051 raft_consensus.cc:2749] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:34.551798 22604 raft_consensus.cc:3055] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:34.554075 22604 raft_consensus.cc:740] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:34.464645 26624 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:34.520772 27048 raft_consensus.cc:2749] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:34.557528 22531 raft_consensus.cc:1275] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:34.520159 27054 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.465785 27066 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:34.528276 27029 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:34.558871 22604 consensus_queue.cc:260] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:34.548038 26979 consensus_queue.cc:260] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:34.562506 23088 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:34.550694 27004 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:34.551419 27009 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:34.537492 27044 raft_consensus.cc:697] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:34.471053 27109 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:34.574294 23088 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:34.588685 22604 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:34.578322 22601 raft_consensus.cc:1275] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:34.586722 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:34.606825 22598 raft_consensus.cc:1275] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:34.611148 22599 raft_consensus.cc:1275] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:34.504256 27003 consensus_queue.cc:260] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:34.601521 23120 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
W20260709 12:11:34.561544 27106 log.cc:927] Time spent T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:11:34.548396 27046 consensus_queue.cc:1048] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:11:34.649756 23122 raft_consensus.cc:1240] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:34.557220 22403 placement_policy_util.cc:248] tablet 263d51d0b43744d899e37466045af890: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
W20260709 12:11:34.316299 22351 rpcz_store.cc:269] 0709 12:11:10.599713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.599951 (+   238us) service_pool.cc:224] Handling call
0709 12:11:34.293696 (+23693745us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:29.210931 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:29.211599 (+   668us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:29.220118 (+  8519us) write_op.cc:435] Acquired schema lock
0709 12:11:29.220144 (+    26us) tablet.cc:662] Decoding operations
0709 12:11:29.221635 (+  1491us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:29.221727 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:29.221759 (+    32us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:11:29.300564 (+ 78805us) tablet.cc:701] Row locks acquired
0709 12:11:29.320506 (+ 19942us) write_op.cc:260] PREPARE: finished
0709 12:11:29.373214 (+ 52708us) write_op.cc:270] Start()
0709 12:11:29.385046 (+ 11832us) write_op.cc:276] Timestamp: P: 1783599089358126 usec, L: 0
0709 12:11:29.387811 (+  2765us) op_driver.cc:348] REPLICATION: starting
0709 12:11:29.486106 (+ 98295us) log.cc:844] Serialized 5941 byte log entry
0709 12:11:29.718793 (+232687us) spinlock_profiling.cc:243] Waited 27 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:11:29.861953 (+143160us) op_driver.cc:464] REPLICATION: finished
0709 12:11:29.863305 (+  1352us) write_op.cc:301] APPLY: starting
0709 12:11:29.863391 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:30.133448 (+270057us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:30.133507 (+    59us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:31.063915 (+930408us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:31.064347 (+   432us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 12:11:31.064414 (+    67us) write_op.cc:312] APPLY: finished
0709 12:11:31.065051 (+   637us) log.cc:844] Serialized 139 byte log entry
0709 12:11:31.386531 (+321480us) spinlock_profiling.cc:243] Waited 9.52 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cc78240ac 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc7840c02 00007f9cca4c820b
0709 12:11:31.510103 (+123572us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:31.632074 (+121971us) write_op.cc:454] Released schema lock
0709 12:11:31.642821 (+ 10747us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:31.694179 (+ 51358us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:31.694211 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3545555,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":1053,"apply.run_cpu_time_us":54025,"apply.run_wall_time_us":1811670,"cfile_cache_hit":58,"cfile_cache_hit_bytes":60610,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6217,"cfile_init":2,"lbm_read_time_us":6672,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":11,"num_ops":15,"prepare.queue_time_us":195097,"prepare.run_cpu_time_us":38971,"prepare.run_wall_time_us":406781,"raft.queue_time_us":46647,"raft.run_cpu_time_us":1369,"raft.run_wall_time_us":1377,"replication_time_us":473939,"spinlock_wait_cycles":84039808,"thread_start_us":752215,"threads_started":5,"wal-append.queue_time_us":739937,"wal-append.run_cpu_time_us":35100,"wal-append.run_wall_time_us":2339135}]]}
I20260709 12:11:34.653177 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:11:34.586398 27118 log.cc:927] Time spent T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:11:34.587872 26979 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:34.595396 27108 raft_consensus.cc:2804] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:34.684443 22532 raft_consensus.cc:1275] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:11:34.682130 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 107927us
I20260709 12:11:34.584797 27124 raft_consensus.cc:2749] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:34.598529 27092 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:11:34.692623 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 227882us
I20260709 12:11:34.685664 23088 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:34.648075 27010 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.692761 23120 raft_consensus.cc:2393] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 12: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:34.580302 26611 raft_consensus.cc:3055] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:34.585531 27122 raft_consensus.cc:2749] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:34.705574 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:11:34.693533 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 204461us
I20260709 12:11:34.653728 27009 raft_consensus.cc:697] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:34.696238 23088 leader_election.cc:304] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:34.654924 27048 raft_consensus.cc:2749] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:34.701370 22604 raft_consensus.cc:1275] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:34.572178 27054 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:34.704370 22570 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:34.697291 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 239974us
W20260709 12:11:34.693255 26667 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.009s	sys 0.000s
I20260709 12:11:34.702360 22353 catalog_manager.cc:5697] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 7 to 9, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 9 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:34.586840 27116 consensus_queue.cc:1048] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.172s
W20260709 12:11:34.717907 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 106156us
I20260709 12:11:34.719182 22570 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:34.722923 27125 raft_consensus.cc:2804] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:34.723033 22570 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:34.723436 27125 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:34.723846 27125 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:34.725803 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.727174 26695 consensus_queue.cc:1059] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:34.723846 26878 raft_consensus.cc:2804] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:34.729138 26878 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:34.729637 26878 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:34.731304 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.700696 27041 raft_consensus.cc:2749] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:34.695295 27108 raft_consensus.cc:697] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
W20260709 12:11:34.721450 26667 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.010s	sys 0.000s
I20260709 12:11:34.737398 27122 raft_consensus.cc:2804] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:11:34.738461 27117 log.cc:927] Time spent T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.182s	user 0.000s	sys 0.000s
I20260709 12:11:34.740348 22353 catalog_manager.cc:5697] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 4 to 7, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 7 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:34.702757 27003 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:34.738665 27044 consensus_queue.cc:237] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:34.560081 27088 consensus_queue.cc:237] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:34.757156 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:34.768898 23118 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 12.
I20260709 12:11:34.755776 22496 leader_election.cc:304] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:34.701977 26611 raft_consensus.cc:740] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:34.707880 26685 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:34.700300 26980 consensus_queue.cc:1059] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 12:11:34.771092 23087 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:34.721134 27092 raft_consensus.cc:2804] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:34.703084 27010 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:34.789325 27010 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:34.781989 27041 raft_consensus.cc:2749] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:34.782362 22353 catalog_manager.cc:5697] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 6 to 8, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 8 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
W20260709 12:11:34.785194 27129 log.cc:927] Time spent T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:11:34.785950 27021 raft_consensus.cc:2804] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:34.755679 27016 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:11:34.775019 27120 log.cc:927] Time spent T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
W20260709 12:11:34.812553 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 116428us
I20260709 12:11:34.814246 22353 catalog_manager.cc:5697] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 4 to 7, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 7 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:34.814931 23088 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:34.679471 27096 consensus_queue.cc:237] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:34.820251 22527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 1933) took 1078 ms. Trace:
I20260709 12:11:34.780386 26667 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:11:34.827131 26684 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 12:11:34.827230 27108 consensus_queue.cc:237] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:34.828691 27055 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:34.829059 27104 raft_consensus.cc:3055] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:34.829152 26839 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.778952 27127 consensus_queue.cc:1048] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:11:34.820801 22527 rpcz_store.cc:276] 0709 12:11:33.735445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.747398 (+ 11953us) service_pool.cc:224] Handling call
0709 12:11:33.783849 (+ 36451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:33.954366 (+170517us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:33.954397 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:33.965929 (+ 11532us) log.cc:844] Serialized 26 byte log entry
0709 12:11:34.029269 (+ 63340us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:34.351827 (+322558us) log.cc:844] Serialized 14 byte log entry
0709 12:11:34.403994 (+ 52167us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:34.404092 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:34.812349 (+408257us) raft_consensus.cc:1685] finished
0709 12:11:34.812373 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:34.812501 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51876,"prepare.queue_time_us":467927,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":104601,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":10597,"thread_start_us":489365,"threads_started":3,"wal-append.queue_time_us":341629}
I20260709 12:11:34.798784 27122 raft_consensus.cc:697] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 10 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:34.827307 22421 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:34.811462 27021 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:34.785954 22442 tablet_service.cc:1558] Processing DeleteTablet for tablet 263d51d0b43744d899e37466045af890 with delete_type TABLET_DATA_TOMBSTONED (TS c863116d91c14d1ca50d6e8a46a37a8f not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:51832
W20260709 12:11:34.834197 27117 log.cc:927] Time spent T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:11:34.890426 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 152535us
I20260709 12:11:34.829985 27130 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:11:34.898239 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 50470.3us
W20260709 12:11:34.898594 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 83776.3us
I20260709 12:11:34.960882 22570 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:34.776094 27057 consensus_queue.cc:1059] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:11:34.782768 27046 consensus_queue.cc:1048] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
W20260709 12:11:34.824143 26821 consensus_meta.cc:287] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.712s	user 0.010s	sys 0.002s
W20260709 12:11:34.955875 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 128656us
I20260709 12:11:34.957686 22496 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:11:34.968540 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 211457us
I20260709 12:11:34.817984 27016 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:34.978087 22421 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:34.892163 27048 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:34.998589 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:34.999228 22528 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 10.
I20260709 12:11:35.000835 22496 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:34.898473 27116 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.896999 27104 raft_consensus.cc:740] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:34.847071 26980 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.993623 22457 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2581) took 1541 ms. Trace:
W20260709 12:11:34.901232 27129 log.cc:927] Time spent T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:11:34.892310 27051 raft_consensus.cc:2804] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:35.002000 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:34.896239 26667 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:34.846038 26695 consensus_queue.cc:1243] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer 1676e7af5e4a47cb86ee7db83e3d4881 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:11:34.901528 26684 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:35.008240 23118 raft_consensus.cc:1275] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:34.964704 27021 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:35.011468 22457 rpcz_store.cc:276] 0709 12:11:33.452678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.453133 (+   455us) service_pool.cc:224] Handling call
0709 12:11:33.453362 (+   229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:34.077607 (+624245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:34.077643 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:34.077700 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:34.077745 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:34.993381 (+915636us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b540037a354. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:34.993428 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:34.993558 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1435130112}
I20260709 12:11:34.833345 27125 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:34.982529 27054 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317)
I20260709 12:11:35.048020 22570 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:35.002738 26685 raft_consensus.cc:2804] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:34.927260 27128 consensus_queue.cc:1048] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.196s
I20260709 12:11:34.994094 27040 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:34.903770 26839 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:35.053622 22604 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 11.
I20260709 12:11:34.991086 22421 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:35.011816 26619 raft_consensus.cc:2804] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:34.968981 26878 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:35.005196 27066 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:34.969501 27055 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:35.046903 27057 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.822887 27009 consensus_queue.cc:237] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:34.995726 26821 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:34.994757 27035 consensus_queue.cc:1048] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 12:11:35.009069 27041 consensus_queue.cc:1048] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 12:11:35.088466 26695 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:35.089039 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 98099.1us
I20260709 12:11:34.982733 27130 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:35.045118 27088 consensus_queue.cc:1059] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 12:11:35.004781 27092 raft_consensus.cc:697] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:35.091148 26619 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:35.044291 26980 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:35.115268 27146 log.cc:927] Time spent T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:11:35.115259 27092 consensus_queue.cc:237] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:35.116667 27141 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:35.117411 27141 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:35.119534 27055 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:35.123157 27134 raft_consensus.cc:2749] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:35.115087 26619 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:35.127056 27143 consensus_queue.cc:1048] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.144s
I20260709 12:11:35.094168 27040 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:35.129336 27133 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.130048 27040 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:35.079566 27142 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.010399 27116 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:35.006419 27048 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:35.113382 27140 raft_consensus.cc:2749] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:35.114181 27139 raft_consensus.cc:2749] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:35.114274 22528 raft_consensus.cc:1240] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:11:35.114522 26839 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:35.129868 27133 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:35.111732 26695 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:35.091756 23089 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:35.136320 22597 raft_consensus.cc:606] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:11:35.156024 22597 raft_consensus.cc:614] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:35.093868 27054 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:35.156816 22603 raft_consensus.cc:1240] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:11:35.095317 26685 raft_consensus.cc:697] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:35.140975 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:35.142096 22449 raft_consensus.cc:1275] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:11:35.158246 22449 pending_rounds.cc:85] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f: Aborting all ops after (but not including) 8
I20260709 12:11:35.158557 22449 pending_rounds.cc:107] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:11:35.158845 22449 raft_consensus.cc:2889] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:35.144665 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:35.146670 22457 raft_consensus.cc:1275] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:35.086838 26684 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:35.168807 26684 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:35.156700 26695 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:35.172288 27029 consensus_meta.cc:287] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.580s	user 0.011s	sys 0.000s
I20260709 12:11:35.172855 27029 raft_consensus.cc:2749] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:35.087544 27003 consensus_queue.cc:1048] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 12:11:35.130646 27111 raft_consensus.cc:2804] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:35.180644 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:35.181138 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:35.164371 27116 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:35.166460 27048 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:11:35.174890 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 83420.7us
I20260709 12:11:35.116801 26980 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:35.183308 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:35.186730 23118 raft_consensus.cc:2393] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 12: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:35.174255 26667 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:35.135550 27127 consensus_queue.cc:1048] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 12:11:35.191532 22523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 2250) took 1060 ms. Trace:
W20260709 12:11:35.199618 27136 log.cc:927] Time spent T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 12:11:35.104526 27057 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:35.200366 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:35.200680 26821 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:35.200989 22528 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 10.
I20260709 12:11:35.201910 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:35.202050 27057 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:35.188927 27023 consensus_meta.cc:287] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.631s	user 0.003s	sys 0.007s
I20260709 12:11:35.203251 27133 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:35.203531 27148 log.cc:927] Time spent T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
W20260709 12:11:35.203809 27113 log.cc:927] Time spent T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.783s	user 0.004s	sys 0.000s
I20260709 12:11:35.203297 27023 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:35.205111 22451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2585) took 1215 ms. Trace:
I20260709 12:11:35.205554 27023 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:35.205466 22451 rpcz_store.cc:276] 0709 12:11:33.989836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.990044 (+   208us) service_pool.cc:224] Handling call
0709 12:11:34.007777 (+ 17733us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:34.094320 (+ 86543us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:34.094348 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:34.095161 (+   813us) log.cc:844] Serialized 52 byte log entry
0709 12:11:34.100110 (+  4949us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:34.100142 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:34.100210 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:35.203252 (+1103042us) spinlock_profiling.cc:243] Waited 5.06 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:11:35.204816 (+  1564us) raft_consensus.cc:1685] finished
0709 12:11:35.204836 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:35.205053 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3200,"raft.queue_time_us":26481,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":3045,"spinlock_wait_cycles":11638656,"thread_start_us":87373,"threads_started":2,"wal-append.queue_time_us":222067}
I20260709 12:11:35.207165 22605 raft_consensus.cc:1240] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:35.211298 22530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 2252) took 1077 ms. Trace:
I20260709 12:11:35.211658 22530 rpcz_store.cc:276] 0709 12:11:34.134303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:34.211349 (+ 77046us) service_pool.cc:224] Handling call
0709 12:11:34.211705 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:34.693996 (+482291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:34.694025 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:34.709831 (+ 15806us) log.cc:844] Serialized 26 byte log entry
0709 12:11:34.794765 (+ 84934us) spinlock_profiling.cc:243] Waited 8.72 ms on lock 0x7b4800250158. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9ccf857aa1 00007f9ccf84eb37 00007f9ccf84e9ca 00007f9ccf94626f 00007f9ccf945f37 00007f9ccf95a55c 00007f9ccf95a508 00007f9ccf95a488 00007f9ccf95a443 00007f9ccf9596ec 00007f9cce883a96
0709 12:11:34.843455 (+ 48690us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:34.969319 (+125864us) log.cc:844] Serialized 14 byte log entry
0709 12:11:34.970207 (+   888us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:34.970275 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:35.196218 (+225943us) raft_consensus.cc:1685] finished
0709 12:11:35.211091 (+ 14873us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:35.211237 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97995,"prepare.queue_time_us":127503,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":126881,"raft.run_cpu_time_us":2835,"raft.run_wall_time_us":492692,"spinlock_wait_cycles":20056960,"thread_start_us":465771,"threads_started":2,"wal-append.queue_time_us":199175}
I20260709 12:11:35.213692 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:35.214255 22530 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11.
W20260709 12:11:35.215909 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 796741us
I20260709 12:11:35.217228 22497 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:35.218314 22497 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:35.089264 27122 consensus_queue.cc:237] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:35.219434 26685 consensus_queue.cc:237] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:35.220393 27132 raft_consensus.cc:3055] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:35.220775 27132 raft_consensus.cc:740] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:35.221552 27132 consensus_queue.cc:260] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:35.199568 27125 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:35.197597 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:35.199182 22523 rpcz_store.cc:276] 0709 12:11:34.131228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:34.131343 (+   115us) service_pool.cc:224] Handling call
0709 12:11:34.131630 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:34.326183 (+194553us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:34.483344 (+157161us) log.cc:844] Serialized 14 byte log entry
0709 12:11:34.553441 (+ 70097us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:34.555741 (+  2300us) log.cc:844] Serialized 26 byte log entry
0709 12:11:34.555878 (+   137us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:34.557734 (+  1856us) log.cc:844] Serialized 14 byte log entry
0709 12:11:34.557888 (+   154us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:34.557951 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:35.191260 (+633309us) raft_consensus.cc:1685] finished
0709 12:11:35.191289 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:35.191459 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":245439,"prepare.queue_time_us":289552,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":70,"raft.queue_time_us":199116,"raft.run_cpu_time_us":346,"raft.run_wall_time_us":22470,"thread_start_us":163769,"threads_started":2,"wal-append.queue_time_us":69406}
I20260709 12:11:35.225976 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:35.232023 22530 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
I20260709 12:11:35.229779 22570 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:35.231971 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:35.233232 22523 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:35.236035 23116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 1288) took 1649 ms. Trace:
I20260709 12:11:35.236510 23116 rpcz_store.cc:276] 0709 12:11:33.586823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.586989 (+   166us) service_pool.cc:224] Handling call
0709 12:11:34.272549 (+685560us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:34.280394 (+  7845us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:35.235807 (+955413us) spinlock_profiling.cc:243] Waited 685 ms on lock 0x7b54004d7e50. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:35.235966 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1575936896}
I20260709 12:11:35.237947 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:35.240096 22421 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:35.189157 27078 raft_consensus.cc:2804] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:35.240509 22570 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:35.241602 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:35.245102 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:35.251538 23122 raft_consensus.cc:2393] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 13: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:35.252774 23122 raft_consensus.cc:1240] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:35.252817 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:35.245579 27128 consensus_queue.cc:1059] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:11:35.245767 27149 log.cc:927] Time spent T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:11:35.258304 22497 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:35.192148 27111 raft_consensus.cc:697] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:35.266515 22570 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:35.270965 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:35.271785 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:35.232555 27132 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:35.184702 27054 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:35.242602 27011 raft_consensus.cc:2749] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:35.265744 26801 raft_consensus.cc:2749] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:35.249696 27078 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:35.263193 26920 raft_consensus.cc:2804] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:35.268149 27077 consensus_meta.cc:287] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.807s	user 0.009s	sys 0.002s
I20260709 12:11:35.232555 27109 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:35.266712 26878 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:35.270146 27016 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:35.140355 27142 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:35.269972 27004 consensus_meta.cc:287] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.651s	user 0.010s	sys 0.000s
I20260709 12:11:35.269375 26839 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:35.269430 27057 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:35.294112 22526 raft_consensus.cc:1240] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 12. Current term is 13. Ops: []
W20260709 12:11:35.338586 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.349370 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:11:35.364405 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.343289 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:35.286960 22523 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
I20260709 12:11:35.371721 23118 raft_consensus.cc:2393] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 13: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:35.368355 22570 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:35.293371 27078 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:35.338433 27077 raft_consensus.cc:2749] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:35.290796 26821 raft_consensus.cc:2804] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:35.298916 26920 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:35.329461 27051 raft_consensus.cc:697] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 9 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:35.395323 22531 raft_consensus.cc:1240] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:35.297785 26427 consensus_queue.cc:1059] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.096s
I20260709 12:11:35.345242 27004 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:35.298386 27125 consensus_queue.cc:1059] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.097s
W20260709 12:11:35.390424 27119 consensus_meta.cc:287] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.833s	user 0.011s	sys 0.000s
I20260709 12:11:35.287744 26940 consensus_queue.cc:1059] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.105s
I20260709 12:11:35.347499 27057 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:35.359148 26839 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:35.388868 26878 raft_consensus.cc:2804] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:35.359776 27021 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:35.392596 26821 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:35.394515 26920 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:35.400432 27126 raft_consensus.cc:2749] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:35.429591 27153 log.cc:927] Time spent T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:11:35.431488 27151 tablet_replica.cc:333] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:11:35.436987 27004 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:35.439340 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:35.440128 23122 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:35.400513 26619 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:35.423733 27147 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:35.444900 26619 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:35.446054 22525 raft_consensus.cc:2368] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 12. Current term is 13.
I20260709 12:11:35.452965 23088 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:11:35.453496 22495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.418730 27137 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:35.423245 27119 raft_consensus.cc:2749] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:35.464323 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:35.470304 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:35.471122 22451 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 11: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:35.455452 26878 raft_consensus.cc:697] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:35.472528 26878 consensus_queue.cc:237] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:35.474277 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:35.475051 22528 raft_consensus.cc:2368] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 13. Current term is 14.
I20260709 12:11:35.475267 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:35.475901 22454 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 11.
I20260709 12:11:35.476476 27029 consensus_queue.cc:1048] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:35.477939 27057 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:35.478611 27051 consensus_queue.cc:237] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:35.479841 26624 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:35.482193 26695 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:35.482566 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:35.483055 27021 leader_election.cc:290] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:35.483400 22532 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 11: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:35.486404 26839 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:35.488579 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:35.489123 23118 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:35.486836 23122 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 14.
I20260709 12:11:35.445354 27147 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:35.490599 22570 leader_election.cc:400] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 election: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 13. Current term is 14.
I20260709 12:11:35.491044 22570 leader_election.cc:403] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:11:35.469334 22448 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 10.
I20260709 12:11:35.492553 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:35.487941 27142 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:35.494131 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:35.494290 27125 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:35.494886 27156 log.cc:927] Time spent T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:11:35.427995 26821 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:35.369791 27111 consensus_queue.cc:237] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:35.493183 22496 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:35.515117 22532 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11.
I20260709 12:11:35.517709 23118 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 13.
I20260709 12:11:35.519381 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:35.522737 22496 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:35.462723 27077 raft_consensus.cc:2749] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:35.487000 27140 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:35.503877 27147 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:35.524268 26800 raft_consensus.cc:2804] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:35.531118 27119 raft_consensus.cc:2804] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:35.489590 27137 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:35.552680 27021 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.553431 26800 raft_consensus.cc:697] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:35.554750 27023 raft_consensus.cc:2749] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:35.578819 27021 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:35.581707 23124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 987) took 1250 ms. Trace:
I20260709 12:11:35.583396 27137 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:35.568652 27119 raft_consensus.cc:697] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
W20260709 12:11:35.587604 27168 log.cc:927] Time spent T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:11:35.587999 26800 consensus_queue.cc:237] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:35.595619 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:35.609443 22532 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:35.610466 27141 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:35.540678 27140 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:35.613426 27140 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:35.615171 23121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 1090) took 1088 ms. Trace:
I20260709 12:11:35.615640 23121 rpcz_store.cc:276] 0709 12:11:34.526601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:34.554276 (+ 27675us) service_pool.cc:224] Handling call
0709 12:11:34.554563 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:34.558206 (+  3643us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:34.558238 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:34.558279 (+    41us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:34.558316 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:35.614928 (+1056612us) spinlock_profiling.cc:243] Waited 3.46 ms on lock 0x7b54004b9e54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:35.614970 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:35.615111 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7947008}
I20260709 12:11:35.619762 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:35.593560 23124 rpcz_store.cc:276] 0709 12:11:34.331641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:34.335259 (+  3618us) service_pool.cc:224] Handling call
0709 12:11:34.335639 (+   380us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:34.400270 (+ 64631us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:34.400318 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:35.128523 (+728205us) spinlock_profiling.cc:243] Waited 5.88 ms on lock 0x7b1800206620. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc780f2a6 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc9227a11 00007f9cc9237372 00007f9cca969a01 00007f9cca92e43a
0709 12:11:35.129748 (+  1225us) spinlock_profiling.cc:243] Waited 5.56 ms on lock 0x7b2c000a5ff8. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc9227a11 00007f9cc9237372 00007f9cca969a01 00007f9cca92e43a 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2
0709 12:11:35.130427 (+   679us) log.cc:844] Serialized 52 byte log entry
0709 12:11:35.503966 (+373539us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:35.503990 (+    24us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:35.504037 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:35.581447 (+ 77410us) raft_consensus.cc:1685] finished
0709 12:11:35.581472 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:35.581643 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61687,"raft.queue_time_us":63601,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":17009,"spinlock_wait_cycles":26321664,"thread_start_us":373186,"threads_started":1,"wal-append.queue_time_us":441682}
I20260709 12:11:35.573038 27054 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:35.602733 27057 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:35.622295 27057 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:35.624352 27057 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:35.576203 26920 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:35.626616 26920 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:35.604908 22452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 862) took 1472 ms. Trace:
I20260709 12:11:35.628276 27021 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:35.627112 22452 rpcz_store.cc:276] 0709 12:11:34.132966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:34.133137 (+   171us) service_pool.cc:224] Handling call
0709 12:11:34.133447 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:34.143585 (+ 10138us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:11:34.315583 (+171998us) log.cc:844] Serialized 14 byte log entry
0709 12:11:34.831166 (+515583us) spinlock_profiling.cc:243] Waited 8.71 ms on lock 0x7b1800126640. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc78413f3 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd 0000000000388634 0000000000388479 00007f9cc782483a
0709 12:11:35.537994 (+706828us) spinlock_profiling.cc:243] Waited 9.28 ms on lock 0x7b1800126640. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc77bbc0a 00007f9cd0efb219 00007f9cc7843a40 00007f9cc783e4e4 00007f9cc783e455 00007f9cce3263c7 00007f9cca9389a7 00007f9cca9480bf 00007f9cca948038
0709 12:11:35.538366 (+   372us) log.cc:844] Serialized 14 byte log entry
0709 12:11:35.604526 (+ 66160us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:35.604595 (+    69us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:35.604648 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:35.604726 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:35.604850 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1123928,"prepare.queue_time_us":1242841,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":84,"raft.queue_time_us":1639,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":178,"spinlock_wait_cycles":41380352,"thread_start_us":63282,"threads_started":1,"wal-append.queue_time_us":63683}
I20260709 12:11:35.631269 22532 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11.
I20260709 12:11:35.636163 23124 raft_consensus.cc:1240] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 12:11:35.658883 23117 raft_consensus.cc:1240] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 12 LEADER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:35.659792 23117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 1303) took 1324 ms. Trace:
I20260709 12:11:35.665079 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:35.660179 23117 rpcz_store.cc:276] 0709 12:11:34.334936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:34.335149 (+   213us) service_pool.cc:224] Handling call
0709 12:11:34.362766 (+ 27617us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:35.658671 (+1295905us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b54005be120. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca8a5dc0 00007f9cca9301c0 00007f9cca931231 00007f9cca92dd8f 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c
0709 12:11:35.659447 (+   776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:35.659719 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27857792}
I20260709 12:11:35.598371 26695 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:35.676786 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:35.681550 23123 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 10.
I20260709 12:11:35.678714 26920 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:35.675320 27054 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.684065 27119 consensus_queue.cc:237] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:35.689967 26427 raft_consensus.cc:3055] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:35.690527 26427 raft_consensus.cc:740] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:35.626713 27078 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:35.693893 26920 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:35.696473 26920 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:35.696558 26074 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.697043 26074 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:35.699767 27125 raft_consensus.cc:2749] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 13. Current term is 14.
I20260709 12:11:35.700045 27054 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:35.658217 27140 consensus_queue.cc:1059] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:11:35.700739 27130 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:35.701020 26821 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:35.702513 27096 raft_consensus.cc:3055] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:35.702864 27096 raft_consensus.cc:740] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:35.691645 27057 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:35.704107 27096 consensus_queue.cc:260] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:35.704597 27057 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:35.705499 27096 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:35.706480 27057 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:35.707950 27135 log.cc:927] Time spent T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.740s	user 0.003s	sys 0.000s
I20260709 12:11:35.728072 22603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43070 (request call id 720) took 1456 ms. Trace:
I20260709 12:11:35.729420 23087 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:35.731946 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:35.732424 22531 raft_consensus.cc:1240] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:35.733659 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:35.735555 22532 raft_consensus.cc:1240] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:35.735877 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:35.737267 22526 raft_consensus.cc:1240] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:11:35.738958 22523 raft_consensus.cc:1240] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:11:35.740947 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:35.741727 22452 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 13.
I20260709 12:11:35.728574 22603 rpcz_store.cc:276] 0709 12:11:34.271637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:34.292726 (+ 21089us) service_pool.cc:224] Handling call
0709 12:11:34.292977 (+   251us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:35.157204 (+864227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:35.727800 (+570596us) spinlock_profiling.cc:243] Waited 864 ms on lock 0x7b5400042c54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:35.727989 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1986114432}
I20260709 12:11:35.745373 22602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43070 (request call id 721) took 1197 ms. Trace:
I20260709 12:11:35.745942 22602 rpcz_store.cc:276] 0709 12:11:34.548300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:34.549066 (+   766us) service_pool.cc:224] Handling call
0709 12:11:34.555910 (+  6844us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:34.560753 (+  4843us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:34.560784 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:34.561267 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 12:11:34.687808 (+126541us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:34.687850 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:34.687926 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:35.707336 (+1019410us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:11:35.715165 (+  7829us) raft_consensus.cc:1685] finished
0709 12:11:35.715194 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:35.745314 (+ 30120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1147,"raft.queue_time_us":1482,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":11515,"spinlock_wait_cycles":25419008,"thread_start_us":125747,"threads_started":1,"wal-append.queue_time_us":253859}
I20260709 12:11:35.750605 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:35.753044 23087 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:35.755187 22524 raft_consensus.cc:1275] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:35.761382 27147 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:35.752270 27144 consensus_queue.cc:1048] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:11:35.726961 26821 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:35.686710 26611 consensus_queue.cc:260] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:35.769702 26074 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:35.767505 27029 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:35.746425 27095 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:35.773155 27095 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:35.775559 27095 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:35.780017 27108 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:35.780094 26920 consensus_queue.cc:1059] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:35.780702 27108 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:35.781491 27045 consensus_queue.cc:1059] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:35.782269 27045 consensus_queue.cc:1059] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:35.783190 27138 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:35.783690 27138 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:35.785669 27138 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:35.752084 27122 consensus_queue.cc:1048] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:11:35.750257 27110 consensus_queue.cc:1059] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:11:35.787623 27104 consensus_queue.cc:260] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:35.788462 27110 raft_consensus.cc:3055] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:35.788794 27110 raft_consensus.cc:740] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:35.789729 27110 consensus_queue.cc:260] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:35.790045 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:35.792483 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:35.781039 26920 raft_consensus.cc:3055] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:35.793645 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:35.788880 22448 raft_consensus.cc:1275] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:11:35.819725 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:35.821868 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:35.833376 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:35.850174 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 218655us
W20260709 12:11:35.851723 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:35.852154 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.857273 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:35.858141 22456 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
I20260709 12:11:35.864198 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:35.866888 22603 raft_consensus.cc:1240] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 12. Current term is 13. Ops: [12.8-12.8]
W20260709 12:11:35.867878 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 44659us
I20260709 12:11:35.869093 22599 raft_consensus.cc:1240] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 LEADER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:11:35.866205 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:35.788831 27104 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:35.871264 22601 raft_consensus.cc:1240] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:35.869439 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:35.872315 22531 raft_consensus.cc:1813] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Handling vote request from an unknown peer c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:35.790064 27078 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317)
I20260709 12:11:35.870072 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:35.810375 27110 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:35.879216 22449 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:11:35.877018 22531 raft_consensus.cc:2393] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 10: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:35.882130 26074 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.882596 26074 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:35.855772 26669 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:35.809985 26920 raft_consensus.cc:740] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:35.883385 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:35.859228 27095 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.887022 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:35.875193 22452 consensus_queue.cc:237] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:11:35.891508 22601 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
I20260709 12:11:35.886734 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:35.995415 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:36.172894 22597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:60938 (request call id 53) took 2039 ms. Trace:
W20260709 12:11:36.022578 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 341841us
W20260709 12:11:35.934567 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 67443us
I20260709 12:11:36.320549 22524 raft_consensus.cc:1240] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:36.322394 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:35.995872 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:36.323539 22451 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:36.208891 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:36.315503 22449 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 10.
I20260709 12:11:35.916613 22605 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
I20260709 12:11:35.892861 22570 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:35.875080 27108 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:36.315459 22597 rpcz_store.cc:276] 0709 12:11:34.032583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:34.032725 (+   142us) service_pool.cc:224] Handling call
0709 12:11:36.071388 (+2038663us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400042c54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca928853 00007f9ccf8f660a 00007f9cc8e7c7d4 00007f9cc8e7c762 00007f9cc8e7c691 00007f9cc8e7c60c 00007f9cc8e7b8c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:36.071558 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2536196864}
I20260709 12:11:36.331009 26074 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:36.340751 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:36.151733 23119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 1300) took 1864 ms. Trace:
I20260709 12:11:36.343374 22457 raft_consensus.cc:1275] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:11:36.350299 22531 raft_consensus.cc:2393] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 11: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:36.341392 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:36.352128 22601 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:36.356616 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:36.357378 23117 raft_consensus.cc:1275] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:36.337364 22421 leader_election.cc:400] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 12. Current term is 13.
W20260709 12:11:36.359200 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 466455us
I20260709 12:11:36.359411 22421 leader_election.cc:403] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:36.349715 23119 rpcz_store.cc:276] 0709 12:11:34.287580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:34.287726 (+   146us) service_pool.cc:224] Handling call
0709 12:11:34.288037 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:34.312710 (+ 24673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:36.151377 (+1838667us) spinlock_profiling.cc:243] Waited 5.69 ms on lock 0x7b540018ef54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:36.151642 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13076352}
I20260709 12:11:35.892518 27023 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:35.893121 27140 consensus_queue.cc:1243] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer 1676e7af5e4a47cb86ee7db83e3d4881 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 12:11:35.990039 27170 log.cc:927] Time spent T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260709 12:11:35.880234 26695 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.115711 27045 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.319876 27147 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:35.888255 26768 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.006882 26976 raft_consensus.cc:3055] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:36.369853 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:36.366570 22570 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:11:36.423966 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 57476.9us
I20260709 12:11:36.369362 27088 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:35.893204 27142 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.151017 27054 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:35.990844 27051 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:36.372980 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:36.373215 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:36.326479 27004 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:36.373889 22528 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.028s	sys 0.066s
W20260709 12:11:36.433272 22528 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.028s	sys 0.066s
I20260709 12:11:35.893285 27125 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:35.891719 26742 consensus_queue.cc:1048] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 2, Time since last communication: 0.481s
I20260709 12:11:36.308857 27055 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:35.961315 26878 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:36.377136 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:35.887848 27138 consensus_queue.cc:1059] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.486s
I20260709 12:11:36.379316 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:36.355890 26821 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.474632 26821 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:36.477144 27138 raft_consensus.cc:3055] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:36.477558 27138 raft_consensus.cc:740] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:36.477825 26821 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:36.478433 27138 consensus_queue.cc:260] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:36.147677 27111 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.480083 26878 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:36.388558 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:36.167368 27122 consensus_queue.cc:1059] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.202s
I20260709 12:11:36.392606 27045 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:36.473361 27055 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:36.393774 27181 log.cc:927] Time spent T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:11:36.393703 27023 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:36.399468 22604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43070 (request call id 724) took 1311 ms. Trace:
I20260709 12:11:36.407150 22601 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
I20260709 12:11:36.487805 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:36.356128 27096 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:36.491217 27096 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:36.491745 27023 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:36.482486 26878 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:36.483234 27122 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.493487 27122 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:36.423756 27137 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.030s	sys 0.053s
W20260709 12:11:36.494558 27137 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.030s	sys 0.053s
I20260709 12:11:36.493860 27096 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:36.496357 27122 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:36.485095 27045 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:36.340967 27095 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:36.445926 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:36.446923 26669 consensus_meta.cc:287] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.553s	user 0.007s	sys 0.002s
I20260709 12:11:36.498422 27005 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.499373 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:36.498910 27005 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:36.500232 22605 raft_consensus.cc:2410] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 12:11:36.501358 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:36.446882 27125 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:36.451108 27004 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:36.423418 26976 raft_consensus.cc:740] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:36.460582 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:36.220418 26920 consensus_queue.cc:260] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:36.464864 22600 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 14.
W20260709 12:11:36.465519 23122 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.017s	sys 0.026s
W20260709 12:11:36.513520 23122 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.018s	sys 0.026s
I20260709 12:11:36.513938 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:36.427067 27147 raft_consensus.cc:2804] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:36.430167 27160 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:36.514356 23122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 1002) took 1022 ms. Trace:
I20260709 12:11:36.514392 22600 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 12.
I20260709 12:11:36.479904 27138 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.388000 22451 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 13.
I20260709 12:11:36.515465 23122 rpcz_store.cc:276] 0709 12:11:35.491992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.492191 (+   199us) service_pool.cc:224] Handling call
0709 12:11:35.492476 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:35.492672 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:35.528039 (+ 35367us) log.cc:844] Serialized 14 byte log entry
0709 12:11:36.513908 (+985869us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:36.513994 (+    86us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:36.514064 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:36.514150 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:36.514292 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":37511,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":2224,"raft.queue_time_us":112941,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":71,"thread_start_us":984689,"threads_started":2,"wal-append.queue_time_us":681646}
I20260709 12:11:36.472144 22523 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:36.479902 27111 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:36.487155 22604 rpcz_store.cc:276] 0709 12:11:35.088479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.090395 (+  1916us) service_pool.cc:224] Handling call
0709 12:11:35.090853 (+   458us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:35.390660 (+299807us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:35.390710 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:35.391322 (+   612us) log.cc:844] Serialized 26 byte log entry
0709 12:11:35.554110 (+162788us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:35.554155 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:35.693103 (+138948us) spinlock_profiling.cc:243] Waited 42.7 ms on lock 0x7b54003aedd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:35.693152 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:36.399091 (+705939us) raft_consensus.cc:1685] finished
0709 12:11:36.399119 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:36.399395 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4883,"raft.queue_time_us":11703,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":2301,"spinlock_wait_cycles":98097536,"thread_start_us":383243,"threads_started":2,"wal-append.queue_time_us":199702}
I20260709 12:11:36.506634 22605 raft_consensus.cc:2393] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 13: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
W20260709 12:11:36.507174 23087 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.031s	sys 0.064s
I20260709 12:11:36.507525 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:36.391080 26695 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:36.426160 26768 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:36.444236 27142 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:36.509868 23124 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.014s	sys 0.022s
I20260709 12:11:36.486464 27055 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:36.521770 23087 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.031s	sys 0.064s
I20260709 12:11:36.522001 22601 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
W20260709 12:11:36.545352 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 751836us
I20260709 12:11:36.545907 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:36.546562 22601 raft_consensus.cc:2468] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 9.
I20260709 12:11:36.547519 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:36.548684 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:36.463871 27051 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:36.466647 27141 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:36.518440 26074 raft_consensus.cc:2749] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 12. Current term is 13.
I20260709 12:11:36.546197 23087 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:11:36.502302 27078 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.012s	sys 0.023s
I20260709 12:11:36.531479 22523 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:11:36.560997 22451 raft_consensus.cc:1240] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 12:11:36.532207 23124 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.014s	sys 0.022s
W20260709 12:11:36.515121 27029 consensus_meta.cc:287] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.743s	user 0.011s	sys 0.000s
I20260709 12:11:36.533713 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:36.704720 22605 raft_consensus.cc:1813] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Handling vote request from an unknown peer c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:36.535763 27004 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:36.536648 26976 consensus_queue.cc:260] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:36.537670 26695 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:36.538115 27077 consensus_queue.cc:1059] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:11:36.538461 26768 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:36.540897 27125 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:36.517537 27144 raft_consensus.cc:2804] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:36.523968 27147 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.656292 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:36.735173 22457 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:36.566543 27078 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.012s	sys 0.023s
I20260709 12:11:36.545282 27111 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:36.568030 26611 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:36.737368 27147 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.740240 27142 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:36.663204 27096 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:36.741986 27096 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:36.707736 22605 raft_consensus.cc:2410] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 12:11:36.656769 26624 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.008s	sys 0.040s
I20260709 12:11:36.744372 27096 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:11:36.744613 26624 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.879s	user 0.008s	sys 0.040s
I20260709 12:11:36.746418 26624 raft_consensus.cc:3055] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:36.721743 27029 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:36.747007 26624 raft_consensus.cc:740] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:36.748011 27029 raft_consensus.cc:2804] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:36.748407 27029 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.748773 27029 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:36.748538 26624 consensus_queue.cc:260] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:36.749930 26624 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:36.737346 26976 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:36.753569 27192 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.754077 27192 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:36.725418 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:36.544102 27160 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:36.654520 27122 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:36.704301 26801 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.762259 22604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:11:36.645483 27141 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:36.762928 22604 raft_consensus.cc:606] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:11:36.786597 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:36.786835 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:36.764510 26801 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:36.721469 27139 consensus_queue.cc:1059] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 12:11:36.791441 22597 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 12.
I20260709 12:11:36.840237 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:36.841948 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:36.842679 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:36.844645 22604 raft_consensus.cc:1275] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:11:36.847086 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:36.789997 27171 log.cc:927] Time spent T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 12:11:36.773784 27155 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.018s	sys 0.041s
I20260709 12:11:36.860998 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:36.861501 22456 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.861196 22457 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 12.
I20260709 12:11:36.863193 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:36.876317 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:36.846376 27023 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:36.878545 22457 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11.
I20260709 12:11:36.848451 22454 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11.
I20260709 12:11:36.889632 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:36.890019 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:36.890520 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:36.896471 22603 raft_consensus.cc:1240] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:36.789057 27122 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:36.861524 27096 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.861534 27142 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.754882 27147 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:36.879813 27155 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.019s	sys 0.041s
I20260709 12:11:36.903936 27189 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:36.905902 27187 log.cc:927] Time spent T 00000000000000000000000000000000 P 136fd3da76544029a815aef59e698e17: Append to log took a long time: real 0.079s	user 0.001s	sys 0.001s
W20260709 12:11:36.906736 27184 log.cc:927] Time spent T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.262s	user 0.000s	sys 0.000s
I20260709 12:11:36.919920 27005 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:36.914124 23088 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.002s	sys 0.014s
W20260709 12:11:36.924717 23088 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.002s	sys 0.014s
W20260709 12:11:36.902200 27179 log.cc:927] Time spent T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.144s	user 0.001s	sys 0.001s
I20260709 12:11:36.929826 22601 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 12: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:36.938791 26801 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:36.939085 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.939260 27141 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:36.940157 27151 raft_consensus.cc:2243] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:36.941494 27160 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:36.909430 27096 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:36.945565 27096 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:36.902014 27095 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:36.948849 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 490993us
W20260709 12:11:36.954968 22528 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.012s	sys 0.026s
I20260709 12:11:36.900059 27023 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:36.955968 22528 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.012s	sys 0.026s
I20260709 12:11:36.875917 26427 consensus_queue.cc:260] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:36.915814 27142 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:36.961694 23089 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.006s	sys 0.012s
I20260709 12:11:36.965063 22456 raft_consensus.cc:2410] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:11:36.993296 22495 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
W20260709 12:11:37.001492 23089 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.006s	sys 0.012s
W20260709 12:11:37.001911 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 673484us
I20260709 12:11:36.950743 26611 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.957708 27155 raft_consensus.cc:3055] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:37.019160 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:37.018632 22526 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.006s	sys 0.025s
W20260709 12:11:37.022547 22526 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.006s	sys 0.025s
I20260709 12:11:36.922742 27189 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:37.027604 22450 raft_consensus.cc:1275] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:36.949733 27193 consensus_queue.cc:1059] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 12:11:37.031951 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:37.032645 22450 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 10.
I20260709 12:11:37.000473 27088 raft_consensus.cc:697] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:37.034861 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:37.029528 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:37.010426 27137 raft_consensus.cc:2804] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:37.039110 27182 log.cc:927] Time spent T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
W20260709 12:11:37.039769 27194 log.cc:927] Time spent T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 12:11:37.019975 26427 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:37.039851 27180 log.cc:927] Time spent T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 12:11:37.019236 27155 raft_consensus.cc:740] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:37.042626 27029 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:37.043992 27188 log.cc:927] Time spent T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
W20260709 12:11:37.044147 22421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.045513 27144 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:11:37.046207 27110 consensus_meta.cc:287] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 1.158s	user 0.010s	sys 0.000s
W20260709 12:11:37.049844 27138 consensus_meta.cc:287] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.526s	user 0.007s	sys 0.000s
I20260709 12:11:37.050426 27119 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.050701 27088 consensus_queue.cc:237] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:37.058419 27104 consensus_meta.cc:287] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 1.180s	user 0.007s	sys 0.002s
W20260709 12:11:37.058702 27190 log.cc:927] Time spent T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.212s	user 0.000s	sys 0.000s
I20260709 12:11:37.060717 27023 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:37.012795 27195 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:11:37.074116 22497 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.016s	sys 0.028s
W20260709 12:11:37.091933 22497 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.016s	sys 0.028s
W20260709 12:11:37.076680 22569 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.014s	sys 0.029s
I20260709 12:11:37.009891 27086 consensus_queue.cc:1048] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:11:37.014176 26611 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:37.081194 22496 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.013s	sys 0.029s
I20260709 12:11:37.067173 27137 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:37.064671 27191 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.073423 27151 raft_consensus.cc:2272] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:11:37.084070 22529 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.863s	user 0.006s	sys 0.032s
I20260709 12:11:37.064762 27192 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:37.089323 22600 raft_consensus.cc:1275] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
W20260709 12:11:37.138296 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.150153 22600 pending_rounds.cc:85] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting all ops after (but not including) 11
I20260709 12:11:37.150414 22600 pending_rounds.cc:107] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting uncommitted NO_OP operation due to leader change: 12.12
W20260709 12:11:37.094324 23090 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.005s	sys 0.013s
I20260709 12:11:37.150682 22600 raft_consensus.cc:2889] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:37.150928 23090 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.828s	user 0.005s	sys 0.013s
I20260709 12:11:37.082804 27144 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:37.092851 22569 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.015s	sys 0.030s
W20260709 12:11:37.156627 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 795969us
I20260709 12:11:37.123116 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:37.092958 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 385069us
I20260709 12:11:37.152031 22599 raft_consensus.cc:1275] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:37.100937 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:37.159899 22601 raft_consensus.cc:2376] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11. Re-sending same reply.
W20260709 12:11:37.149571 22529 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.928s	user 0.009s	sys 0.038s
W20260709 12:11:37.154239 22496 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.013s	sys 0.033s
W20260709 12:11:37.160979 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 783070us
W20260709 12:11:37.163316 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:37.082440 23118 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.015s	sys 0.027s
W20260709 12:11:37.171512 23118 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.019s	sys 0.027s
W20260709 12:11:37.149924 27054 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.012s	sys 0.036s
I20260709 12:11:37.182338 22570 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:37.183571 22529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 2270) took 1433 ms. Trace:
I20260709 12:11:37.123692 27201 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.130074 27095 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.152498 27125 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:37.160151 27182 log.cc:927] Time spent T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:11:37.195611 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:37.196218 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:37.155319 26624 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.197569 22569 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:37.184079 22529 rpcz_store.cc:276] 0709 12:11:35.750474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.750589 (+   115us) service_pool.cc:224] Handling call
0709 12:11:35.750870 (+   281us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:35.751261 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:35.751300 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:35.751858 (+   558us) log.cc:844] Serialized 52 byte log entry
0709 12:11:36.082380 (+330522us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:36.143482 (+ 61102us) log.cc:844] Serialized 14 byte log entry
0709 12:11:37.160717 (+1017235us) log.cc:844] Serialized 14 byte log entry
0709 12:11:37.183176 (+ 22459us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.183277 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:37.183330 (+    53us) raft_consensus.cc:1685] finished
0709 12:11:37.183348 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:37.183504 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":98384,"prepare.queue_time_us":330193,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":108,"raft.queue_time_us":41890,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":15396,"thread_start_us":1264059,"threads_started":2,"wal-append.queue_time_us":793512}
I20260709 12:11:37.153885 27137 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:37.189523 22451 raft_consensus.cc:2410] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:11:37.191057 22523 raft_consensus.cc:1240] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:11:37.159088 27193 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:37.191753 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:37.205539 22525 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 10.
I20260709 12:11:37.192430 27145 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:37.173859 27004 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:37.152872 26770 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.200189 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:37.187798 27192 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:11:37.175561 27054 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.013s	sys 0.036s
I20260709 12:11:37.203024 22524 raft_consensus.cc:1275] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:37.191603 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:37.203364 22569 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:37.203629 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:37.175006 27078 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:37.193374 22527 raft_consensus.cc:1275] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:11:37.087622 27119 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:37.179545 22497 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:37.212352 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:37.210767 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:37.239696 22525 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
I20260709 12:11:37.241369 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:37.241098 22531 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
I20260709 12:11:37.158617 27191 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:37.245105 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 65684us
I20260709 12:11:37.208863 27096 raft_consensus.cc:2804] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:37.247542 22497 leader_election.cc:304] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:37.095252 27195 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:37.246707 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.209103 27202 raft_consensus.cc:2749] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:37.236366 26770 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:37.202080 27125 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:37.209914 27193 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:37.286568 26770 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:37.214427 27004 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:37.286576 27195 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:37.288312 27195 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:37.288542 27004 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:37.250655 23118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 1009) took 1384 ms. Trace:
I20260709 12:11:37.288859 27195 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:37.289184 23118 rpcz_store.cc:276] 0709 12:11:35.866001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.867147 (+  1146us) service_pool.cc:224] Handling call
0709 12:11:35.885376 (+ 18229us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:36.378796 (+493420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:36.380985 (+  2189us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:36.400386 (+ 19401us) log.cc:844] Serialized 26 byte log entry
0709 12:11:37.172861 (+772475us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:37.172907 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.172973 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:37.250413 (+ 77440us) raft_consensus.cc:1685] finished
0709 12:11:37.250432 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:37.250590 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":106191,"raft.run_cpu_time_us":47,"raft.run_wall_time_us":47,"thread_start_us":1264970,"threads_started":2,"wal-append.queue_time_us":848182}
W20260709 12:11:37.255445 27196 log.cc:927] Time spent T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 12:11:37.278767 26695 raft_consensus.cc:2804] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:37.286911 27193 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:37.291405 26695 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:37.291922 26695 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:37.292018 26611 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:37.294935 27189 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:37.295632 27029 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:37.296243 27029 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.279042 27022 raft_consensus.cc:2804] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:37.297447 27022 raft_consensus.cc:697] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:37.298341 27022 consensus_queue.cc:237] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:37.201843 27095 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:37.263868 27147 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:37.244935 27078 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:37.096669 27155 consensus_queue.cc:260] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:37.270085 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 66796.2us
I20260709 12:11:37.269670 22449 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
I20260709 12:11:37.270959 22497 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:37.236822 27198 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.306409 22569 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:37.246475 27192 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:37.269202 26801 raft_consensus.cc:2749] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:37.303833 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:37.206902 27145 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:37.205660 27023 consensus_queue.cc:1048] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.074s
W20260709 12:11:37.307744 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 305136us
I20260709 12:11:37.309922 22569 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:37.280418 27142 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:37.255708 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:37.311661 22497 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:37.319025 22532 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
I20260709 12:11:37.320562 22497 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:37.283077 27096 raft_consensus.cc:697] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 13 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:37.202157 27201 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:37.207652 26624 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:37.314914 22525 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:37.311733 22495 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:37.324604 22569 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:37.291392 27195 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:37.305433 26770 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.296840 27029 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:37.313364 27206 raft_consensus.cc:2749] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:37.316025 27104 raft_consensus.cc:2749] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:37.338204 23124 raft_consensus.cc:1275] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:37.336400 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:37.343328 22523 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 11.
I20260709 12:11:37.341828 27145 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:37.332120 27142 raft_consensus.cc:2804] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:37.316047 27086 consensus_queue.cc:1048] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:11:37.339833 27147 raft_consensus.cc:2749] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:37.362607 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:37.367931 23118 raft_consensus.cc:1275] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:37.372432 22604 raft_consensus.cc:1275] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:11:37.374564 22604 pending_rounds.cc:85] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting all ops after (but not including) 7
I20260709 12:11:37.370707 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:37.374768 23124 raft_consensus.cc:2410] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:11:37.374805 22604 pending_rounds.cc:107] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:11:37.375422 22604 raft_consensus.cc:2889] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:37.369064 27192 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:11:37.368856 27203 log.cc:927] Time spent T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:11:37.394335 22525 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
I20260709 12:11:37.318655 27198 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:37.351732 27142 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:37.358883 26801 raft_consensus.cc:2749] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:37.363616 27145 raft_consensus.cc:2804] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:37.420605 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:37.426100 23124 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
I20260709 12:11:37.370399 27029 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:37.424288 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:37.368050 27078 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:37.381129 27204 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.426546 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:11:37.416481 26976 consensus_meta.cc:287] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.665s	user 0.009s	sys 0.001s
I20260709 12:11:37.342559 26770 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:37.380857 27197 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:37.441017 23119 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 13.
I20260709 12:11:37.429265 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:37.414419 26427 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:37.414098 27195 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:37.429636 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:37.448014 22454 raft_consensus.cc:2410] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:11:37.436312 22526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 885) took 1419 ms. Trace:
I20260709 12:11:37.457883 23116 raft_consensus.cc:1813] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Handling vote request from an unknown peer c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:37.459040 23116 raft_consensus.cc:2410] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:11:37.458181 22526 rpcz_store.cc:276] 0709 12:11:36.016606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.016805 (+   199us) service_pool.cc:224] Handling call
0709 12:11:36.323080 (+306275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:36.323279 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:11:37.024411 (+701132us) log.cc:844] Serialized 14 byte log entry
0709 12:11:37.319788 (+295377us) log.cc:844] Serialized 14 byte log entry
0709 12:11:37.429220 (+109432us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:37.435914 (+  6694us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:37.435995 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.436082 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:37.436239 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":131332,"prepare.run_cpu_time_us":109,"prepare.run_wall_time_us":2657,"raft.queue_time_us":20197,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":6492,"thread_start_us":1058534,"threads_started":3}
I20260709 12:11:37.451748 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:37.452008 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:37.385093 27202 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:11:37.436635 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 116172us
I20260709 12:11:37.368796 26695 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:37.456676 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:37.420959 27160 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:11:37.467056 22421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.472018 22523 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 10.
I20260709 12:11:37.472932 23087 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:37.473237 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:37.474006 22525 raft_consensus.cc:2393] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 13: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:37.466881 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:37.468111 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:37.468482 23118 raft_consensus.cc:2393] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 12: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:37.460894 23117 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
I20260709 12:11:37.426419 27142 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:37.469102 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 157465us
W20260709 12:11:37.471139 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 311479us
I20260709 12:11:37.427789 27145 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:37.475893 22497 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:37.477748 22422 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:37.482096 23088 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:37.422034 27144 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:37.488842 23088 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:37.418319 27096 consensus_queue.cc:237] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:37.495868 22525 raft_consensus.cc:1240] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:11:37.498440 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:37.505399 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:37.511251 23120 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 9.
I20260709 12:11:37.498832 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:11:37.513420 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.516225 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:37.516705 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:37.516861 23120 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 12.
I20260709 12:11:37.517300 23118 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 15.
I20260709 12:11:37.460548 26427 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:37.480611 27145 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:37.487821 27206 raft_consensus.cc:2749] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:37.470382 27195 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:37.492117 27221 raft_consensus.cc:2804] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:37.453438 27204 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:37.480382 27138 consensus_queue.cc:1059] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:11:37.513348 27045 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.504338 26976 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.478168 27160 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:37.456555 27197 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:37.480789 26801 consensus_queue.cc:1048] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:11:37.568223 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:37.570680 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:37.501008 27191 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:37.604604 22603 raft_consensus.cc:2393] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 12: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:37.519227 27104 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.472126 27202 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:37.507490 26839 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:37.582700 27022 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.585137 26770 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:37.507112 27137 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:37.587790 26695 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:37.588321 27221 raft_consensus.cc:697] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 12 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:37.589783 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:37.590572 23120 raft_consensus.cc:1275] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 12:11:37.559578 27189 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:11:37.593199 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.697172 22604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2826) took 1317 ms. Trace:
I20260709 12:11:37.697543 22604 rpcz_store.cc:276] 0709 12:11:36.379387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.870306 (+490919us) service_pool.cc:224] Handling call
0709 12:11:36.870919 (+   613us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:37.375970 (+505051us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.696908 (+320938us) spinlock_profiling.cc:243] Waited 501 ms on lock 0x7b54002dfd54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:37.697113 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1152317824}
I20260709 12:11:37.520689 27220 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:37.522804 27095 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:37.599706 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 122034us
I20260709 12:11:37.707074 22422 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:37.493688 27078 consensus_queue.cc:1059] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 12:11:37.492898 27215 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:37.602785 23118 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
I20260709 12:11:37.559387 27054 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:37.570196 27225 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:37.595346 27210 raft_consensus.cc:3055] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:37.611446 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:37.732601 22457 raft_consensus.cc:2393] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 12: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
W20260709 12:11:37.522676 27211 log.cc:927] Time spent T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.196s	user 0.001s	sys 0.001s
I20260709 12:11:37.613950 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:37.614522 23125 raft_consensus.cc:1275] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:11:37.615218 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:37.615736 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:37.741465 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:37.742187 22603 raft_consensus.cc:2368] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 11. Current term is 12.
I20260709 12:11:37.743088 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:37.598943 27226 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.618213 23124 raft_consensus.cc:1240] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:11:37.628089 27198 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:37.523082 27224 consensus_queue.cc:1048] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.115s
I20260709 12:11:37.619799 27022 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:37.616734 27029 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.757566 27226 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:37.758256 27029 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:37.759733 27226 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:37.760535 27029 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:37.761075 27206 consensus_queue.cc:1048] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:11:37.761880 22606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45576 (request call id 2814) took 1842 ms (client timeout 1652 ms). Trace:
I20260709 12:11:37.618515 26839 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:37.601398 26976 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:37.615123 27104 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:37.639622 27216 log.cc:927] Time spent T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
W20260709 12:11:37.640499 27213 log.cc:927] Time spent T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 12:11:37.642374 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:37.645156 22598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2812) took 1727 ms. Trace:
I20260709 12:11:37.645483 27137 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:37.647658 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:37.657721 27119 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:37.660233 27055 raft_consensus.cc:2804] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:37.668414 26427 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:37.671217 27202 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:37.600827 26624 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:37.675218 27144 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:37.675800 27201 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:37.677434 27195 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:37.679919 27197 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:37.605834 26801 consensus_queue.cc:1243] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer 6c6fa11e8ee34711b3551f0c670442bc log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:37.606906 27141 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:37.684739 27160 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:37.688103 27151 ts_tablet_manager.cc:1916] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:11:37.599466 27045 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:37.619256 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:37.824487 22598 rpcz_store.cc:276] 0709 12:11:35.918342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.918513 (+   171us) service_pool.cc:224] Handling call
0709 12:11:36.938672 (+1020159us) spinlock_profiling.cc:243] Waited 3.74 ms on lock 0x7b58001b3098. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf907fc0 00007f9ccf8f2929 00007f9ccf8f23d2 00007f9cc8e69bd4
0709 12:11:36.938876 (+   204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:37.011417 (+ 72541us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:37.011464 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:37.011524 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:37.011576 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.644838 (+633262us) spinlock_profiling.cc:243] Waited 72.3 ms on lock 0x7b54000e9f54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:37.644903 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:37.645072 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":174852096}
I20260709 12:11:37.708037 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:37.708199 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:37.712280 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:37.827440 23120 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 10.
I20260709 12:11:37.695297 27147 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:37.717805 22422 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:37.752420 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:37.752590 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:37.753161 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:37.752766 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:37.704264 27220 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:37.756613 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:37.756908 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:37.834204 23117 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
I20260709 12:11:37.758589 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:37.757748 27022 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:37.607265 27209 log.cc:927] Time spent T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.247s	user 0.001s	sys 0.001s
I20260709 12:11:37.814873 27055 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:37.845925 27055 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:37.846395 27122 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:37.838014 27220 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:37.814854 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:37.852552 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:37.818239 26976 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:37.765287 22602 raft_consensus.cc:1240] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:37.813611 27221 consensus_queue.cc:237] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:37.763790 23123 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 13.
I20260709 12:11:37.854650 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:37.821012 27104 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:37.822538 26839 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:37.823381 22449 raft_consensus.cc:2393] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 11: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:37.823774 22601 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
I20260709 12:11:37.762620 26074 raft_consensus.cc:2764] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:11:37.754935 27191 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:37.826614 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 326401us
I20260709 12:11:37.707312 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:37.827713 22604 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:37.523475 27110 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:37.732076 27210 raft_consensus.cc:740] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
W20260709 12:11:37.831607 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 113898us
I20260709 12:11:37.859691 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:37.862231 22601 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 13.
I20260709 12:11:37.862299 22422 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:37.832283 23124 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:37.834056 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:37.863185 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:37.704650 27023 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:37.835103 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:37.863776 23119 raft_consensus.cc:2410] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:11:37.834112 22448 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:37.838249 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:37.843542 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:37.865815 22452 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
I20260709 12:11:37.866101 22450 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
I20260709 12:11:37.866760 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:37.866882 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:37.867619 22450 raft_consensus.cc:2410] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:11:37.843626 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:37.867743 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.845299 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:37.868350 22451 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 10.
I20260709 12:11:37.863757 22601 raft_consensus.cc:2468] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 10.
I20260709 12:11:37.870272 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:37.857728 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:37.871906 22449 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 15.
I20260709 12:11:37.716648 27189 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:37.855724 22528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 2262) took 2123 ms. Trace:
I20260709 12:11:37.777206 26695 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:37.886440 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:37.880446 22528 rpcz_store.cc:276] 0709 12:11:35.732529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.732872 (+   343us) service_pool.cc:224] Handling call
0709 12:11:35.763328 (+ 30456us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:35.763711 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:35.763739 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:35.764321 (+   582us) log.cc:844] Serialized 52 byte log entry
0709 12:11:36.433796 (+669475us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:36.959904 (+526108us) log.cc:844] Serialized 14 byte log entry
0709 12:11:36.960532 (+   628us) log.cc:844] Serialized 14 byte log entry
0709 12:11:37.050103 (+ 89571us) spinlock_profiling.cc:243] Waited 41.6 ms on lock 0x7b18002db440. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc78413f3 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd 0000000000388634 0000000000388479 00007f9cc782483a
0709 12:11:37.845931 (+795828us) spinlock_profiling.cc:243] Waited 41.5 ms on lock 0x7b18002db440. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc77bbc0a 00007f9cd0efb219 00007f9cca4e4d70 00007f9cca4d8293 00007f9cca4cdcea 00007f9cca4ce23a 00007f9cca938a2a 00007f9cca9480bf 00007f9cca948038
0709 12:11:37.855420 (+  9489us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.855504 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:37.855544 (+    40us) raft_consensus.cc:1685] finished
0709 12:11:37.855556 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:37.855666 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":818409,"prepare.queue_time_us":22205,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":89,"raft.queue_time_us":11805,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":6592,"spinlock_wait_cycles":191095040,"thread_start_us":1181227,"threads_started":2,"wal-append.queue_time_us":986736}
I20260709 12:11:37.861344 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:37.887696 22598 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 10.
I20260709 12:11:37.860586 23116 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
I20260709 12:11:37.891148 23120 raft_consensus.cc:2368] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 13. Current term is 14.
I20260709 12:11:37.903293 23119 raft_consensus.cc:1275] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:37.907927 22421 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:37.909014 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:37.910041 22599 raft_consensus.cc:2410] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 13 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 12:11:37.910529 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:37.911129 23117 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
I20260709 12:11:37.858446 26742 raft_consensus.cc:3055] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:37.839046 27233 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.879537 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:37.917104 22601 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:37.855844 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:37.919991 22457 raft_consensus.cc:1275] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:37.739283 27054 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:37.911737 23124 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
I20260709 12:11:37.911789 22604 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 12.
I20260709 12:11:37.903709 22455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 877) took 1348 ms. Trace:
I20260709 12:11:37.913700 23122 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 10.
I20260709 12:11:37.838193 27147 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:37.922041 22497 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
W20260709 12:11:37.921600 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 59392.3us
I20260709 12:11:37.923205 26074 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.949054 26074 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:37.858089 27205 raft_consensus.cc:2749] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:37.917292 27216 log.cc:927] Time spent T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:11:37.856873 27138 raft_consensus.cc:2749] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:37.928135 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:37.938033 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:37.914916 26742 raft_consensus.cc:740] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:37.830994 27141 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:37.937580 22455 rpcz_store.cc:276] 0709 12:11:36.555050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.557208 (+  2158us) service_pool.cc:224] Handling call
0709 12:11:36.557544 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:36.653217 (+ 95673us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:36.653265 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:36.662275 (+  9010us) log.cc:844] Serialized 26 byte log entry
0709 12:11:37.148612 (+486337us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:37.148672 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.148771 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:37.903460 (+754689us) raft_consensus.cc:1685] finished
0709 12:11:37.903495 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:37.903646 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":127,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":45827,"thread_start_us":412478,"threads_started":1,"wal-append.queue_time_us":705676}
I20260709 12:11:37.909122 27197 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.948344 22422 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:11:37.924093 22597 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45562 (request call id 2474) took 1963 ms (client timeout 2226 ms). Trace:
W20260709 12:11:37.971004 22597 rpcz_store.cc:269] 0709 12:11:35.961022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.378950 (+417928us) service_pool.cc:224] Handling call
0709 12:11:37.923844 (+1544894us) spinlock_profiling.cc:243] Waited 318 ms on lock 0x7b54003b3154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:37.924012 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":731369216}
I20260709 12:11:37.971374 22422 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:37.972126 27240 raft_consensus.cc:2804] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:37.972259 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:37.972630 27240 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:37.972908 22597 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 12.
I20260709 12:11:37.972965 22422 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:37.862676 27191 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:37.969604 26800 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:37.973927 26074 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:37.974081 22597 raft_consensus.cc:1240] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:37.974318 26800 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:37.739568 27225 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:37.976570 26800 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:37.865638 27110 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:37.762320 22606 rpcz_store.cc:269] 0709 12:11:35.919474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.919607 (+   133us) service_pool.cc:224] Handling call
0709 12:11:36.460425 (+540818us) spinlock_profiling.cc:243] Waited 3.78 ms on lock 0x7b58001b3098. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf8f40a0 00007f9ccf8f3984 00007f9cc8e6e6d4 00007f9cc8e6e662
0709 12:11:37.761626 (+1301201us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400041d54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:37.761781 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2534298752}
I20260709 12:11:37.881102 27023 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:37.945395 26839 raft_consensus.cc:2804] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:37.973073 27240 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:37.971719 27138 raft_consensus.cc:2804] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:37.978855 22606 raft_consensus.cc:1275] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 12:11:37.983767 22497 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
W20260709 12:11:37.987617 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.966871 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:37.913116 26695 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:37.946542 26976 raft_consensus.cc:2804] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:38.011022 22422 raft_consensus.cc:2686] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 12:11:38.046595 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 73694.7us
I20260709 12:11:37.967276 27242 raft_consensus.cc:2804] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:37.927160 27233 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:38.057503 27233 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:38.014230 26839 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.064718 22422 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
W20260709 12:11:38.023890 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:38.030352 22606 raft_consensus.cc:1217] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Deduplicated request from leader. Original: 7.6->[10.7-15.10]   Dedup: 12.8->[13.9-15.10]
I20260709 12:11:38.111446 22606 pending_rounds.cc:85] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting all ops after (but not including) 8
I20260709 12:11:38.111775 22606 pending_rounds.cc:107] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 12:11:38.112083 22606 raft_consensus.cc:2889] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:38.028982 27138 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:38.002351 27197 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:38.029464 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 45762.4us
I20260709 12:11:38.030442 22604 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 10.
I20260709 12:11:38.062484 22603 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 11.
I20260709 12:11:38.051800 27242 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.115998 22497 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:38.117432 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:38.125582 22604 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 10.
I20260709 12:11:38.126768 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:38.113209 23089 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.002s	sys 0.038s
W20260709 12:11:38.129334 23089 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.002s	sys 0.038s
I20260709 12:11:37.997470 22601 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 14.
I20260709 12:11:38.133414 22497 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
W20260709 12:11:38.143627 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 629650us
W20260709 12:11:38.149425 22569 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.692s (SENT) [suppressed 10 similar messages]
I20260709 12:11:38.063148 26976 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:38.014640 27145 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:38.142671 22497 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
W20260709 12:11:38.123154 27234 log.cc:927] Time spent T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 12:11:38.178540 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:38.194453 22601 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 12.
I20260709 12:11:38.114351 26839 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:38.124660 27138 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:38.191443 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:38.060566 27240 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:38.200527 23089 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:38.039227 27238 raft_consensus.cc:2804] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:38.138720 27137 raft_consensus.cc:2749] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:37.969972 27210 consensus_queue.cc:260] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:38.215266 23089 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:38.133677 27242 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:38.204814 22448 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
I20260709 12:11:38.178541 27119 raft_consensus.cc:2804] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:38.196250 26801 raft_consensus.cc:2804] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:38.127525 27233 raft_consensus.cc:2804] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:38.140827 27045 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:38.194824 26976 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:38.207394 27142 consensus_meta.cc:287] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.719s	user 0.010s	sys 0.002s
I20260709 12:11:38.192325 27201 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:38.225287 26074 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.235643 26074 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:38.125164 27220 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:38.225430 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:38.245458 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:38.246289 22448 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 12.
I20260709 12:11:38.100572 26742 consensus_queue.cc:260] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:38.239156 22604 raft_consensus.cc:1275] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:11:38.274362 22604 raft_consensus.cc:1275] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 12:11:38.275509 27054 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:38.276962 27023 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:38.279768 26695 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:38.280864 27110 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:38.287429 27141 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:38.216670 27238 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.288300 27238 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:38.233131 27210 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:38.230638 26801 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:38.297439 26801 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:38.232872 27233 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:38.299817 27233 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:38.302943 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:38.304402 27225 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:38.305961 27147 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:38.306690 27201 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:38.221913 27119 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.309092 27119 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:38.227469 27195 raft_consensus.cc:2804] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:38.311141 27195 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:38.311642 27195 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:38.227872 26624 consensus_queue.cc:1059] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
I20260709 12:11:38.241114 27142 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:38.321930 22529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 887) took 1017 ms. Trace:
I20260709 12:11:38.322219 22598 raft_consensus.cc:1240] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:38.219367 27144 raft_consensus.cc:2804] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:38.247617 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:38.331954 22448 raft_consensus.cc:2410] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:11:38.296336 27145 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:38.321967 27142 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:38.344265 26074 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:38.227278 27189 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:38.347879 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 198477us
I20260709 12:11:38.352200 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:38.353116 22604 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 13.
I20260709 12:11:38.356580 22569 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:38.357399 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:38.334789 27144 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:38.232920 27029 consensus_queue.cc:1048] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.120s
I20260709 12:11:38.347788 27197 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:38.367530 22497 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:38.358088 22569 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:38.376633 22569 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:38.380409 22569 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:38.387400 22422 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:38.388551 23087 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:38.362597 27142 raft_consensus.cc:2749] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:38.383956 23089 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:38.393942 23087 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:38.370179 27144 raft_consensus.cc:3060] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:38.382930 27141 raft_consensus.cc:2804] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:38.400302 27141 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:38.400722 27141 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:38.396725 27250 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.403620 27125 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:38.405483 27054 raft_consensus.cc:2804] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:38.407413 27248 raft_consensus.cc:2804] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:38.407974 27248 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.408432 27248 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:38.410161 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:38.383412 27147 raft_consensus.cc:2804] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:38.411347 27147 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:38.411726 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:38.412667 22604 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 10.
I20260709 12:11:38.413743 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:38.414443 22604 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 12.
W20260709 12:11:38.420094 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:38.403687 27250 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:38.429338 22602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2473) took 2536 ms. Trace:
I20260709 12:11:38.429754 22602 rpcz_store.cc:276] 0709 12:11:35.893370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.893510 (+   140us) service_pool.cc:224] Handling call
0709 12:11:37.044597 (+1151087us) spinlock_profiling.cc:243] Waited 3.41 ms on lock 0x7b58001b3098. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf907fc0 00007f9ccf8f2929 00007f9ccf8f23d2 00007f9cc8e69bd4
0709 12:11:37.765036 (+720439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:37.855204 (+ 90168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:38.429147 (+573943us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x7b5400041d50. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:38.429278 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1664167424}
I20260709 12:11:38.431754 23087 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:38.381026 27225 raft_consensus.cc:2804] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:38.439026 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:38.439971 22602 raft_consensus.cc:2368] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 11. Current term is 12.
I20260709 12:11:38.441425 27077 raft_consensus.cc:2749] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:38.442569 27227 log.cc:927] Time spent T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.855s	user 0.007s	sys 0.015s
I20260709 12:11:38.446106 27238 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:38.437134 23089 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:38.458099 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:38.447465 27201 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:38.451795 27125 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.452282 22605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2822) took 2269 ms. Trace:
I20260709 12:11:38.453032 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:38.453773 27220 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:38.453860 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:38.456108 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:38.457309 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:38.459517 22605 rpcz_store.cc:276] 0709 12:11:36.182787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.743548 (+560761us) service_pool.cc:224] Handling call
0709 12:11:37.924582 (+1181034us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:37.924808 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:37.924847 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:37.924902 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:37.924947 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.925029 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:38.452069 (+527040us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54003b3150. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:38.452211 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2715295488}
I20260709 12:11:38.460989 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:38.411834 27147 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:38.465493 23116 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 10.
I20260709 12:11:38.469869 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:38.470572 22602 raft_consensus.cc:2376] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 12. Re-sending same reply.
I20260709 12:11:38.430884 27189 raft_consensus.cc:2749] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:38.466480 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:38.433215 26624 raft_consensus.cc:2804] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:38.465444 27215 consensus_meta.cc:287] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.711s	user 0.004s	sys 0.007s
I20260709 12:11:38.437914 27225 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:38.495003 27023 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:38.495668 27023 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:38.478790 27055 consensus_meta.cc:287] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.632s	user 0.011s	sys 0.000s
I20260709 12:11:38.493057 22570 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:38.478519 26624 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.515323 22570 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:38.491171 27225 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:38.468186 27125 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:38.494272 27215 raft_consensus.cc:2749] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:38.502830 27220 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:38.547132 23121 raft_consensus.cc:1275] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:11:38.529502 22570 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:38.519645 26624 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:38.525167 27096 raft_consensus.cc:2804] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:38.522524 27243 raft_consensus.cc:2749] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:38.506482 27247 consensus_queue.cc:1048] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:11:38.504622 27088 consensus_queue.cc:1048] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 12:11:38.508644 27055 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:38.542832 27029 raft_consensus.cc:2804] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:38.551874 27096 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:38.560127 27246 raft_consensus.cc:2804] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:38.585276 22526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 889) took 1276 ms. Trace:
I20260709 12:11:38.585850 22526 rpcz_store.cc:276] 0709 12:11:37.308598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.487362 (+178764us) service_pool.cc:224] Handling call
0709 12:11:37.487682 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:37.582529 (+ 94847us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:37.605105 (+ 22576us) log.cc:844] Serialized 14 byte log entry
0709 12:11:37.852598 (+247493us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:37.852674 (+    76us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:37.852749 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:38.584968 (+732219us) spinlock_profiling.cc:243] Waited 94.6 ms on lock 0x7b540030f7d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:38.585029 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:38.585202 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16485,"prepare.queue_time_us":23861,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":24308,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":4843,"spinlock_wait_cycles":217580928,"thread_start_us":225412,"threads_started":1,"wal-append.queue_time_us":309047}
W20260709 12:11:38.590696 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 192952us
I20260709 12:11:38.549151 27220 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:38.599745 22421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:38.600239 22421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:38.601809 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 164779us
I20260709 12:11:38.565850 27029 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:38.591882 27096 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:38.591718 27246 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.590469 27054 raft_consensus.cc:697] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 14 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:38.608965 22421 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:11:38.610530 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 88441.5us
I20260709 12:11:38.606710 23089 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:38.611399 22421 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:38.612025 26074 raft_consensus.cc:2804] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:38.612484 26074 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:38.613092 26074 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:38.612535 23089 leader_election.cc:400] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 11. Current term is 12.
I20260709 12:11:38.611797 27246 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:38.616421 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:38.617408 22570 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:38.620100 27108 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:38.620522 27108 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.620851 27108 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:38.608637 26695 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:38.622031 27055 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:38.602289 26801 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:38.607784 26839 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:38.624337 26801 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:38.625118 22448 raft_consensus.cc:2368] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 10. Current term is 11.
W20260709 12:11:38.629604 22523 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56942 (request call id 1964) took 1417 ms (client timeout 1800 ms). Trace:
W20260709 12:11:38.630055 22523 rpcz_store.cc:269] 0709 12:11:37.212094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.347533 (+135439us) service_pool.cc:224] Handling call
0709 12:11:38.629440 (+1281907us) spinlock_profiling.cc:243] Waited 96.9 ms on lock 0x7b540010c7d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:38.629543 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":222903552}
I20260709 12:11:38.615906 27189 raft_consensus.cc:2804] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:38.632588 27189 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.632941 27189 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:38.636309 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:38.637459 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:38.638049 26920 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:38.638415 22454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2609) took 1621 ms. Trace:
I20260709 12:11:38.638777 22454 rpcz_store.cc:276] 0709 12:11:37.017466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.018906 (+  1440us) service_pool.cc:224] Handling call
0709 12:11:38.638204 (+1619298us) spinlock_profiling.cc:243] Waited 428 ms on lock 0x7b540019fd54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:38.638337 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":984165120}
I20260709 12:11:38.639906 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:38.620971 22449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2618) took 1009 ms. Trace:
I20260709 12:11:38.641079 22457 raft_consensus.cc:1275] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:38.641244 22449 rpcz_store.cc:276] 0709 12:11:37.611645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.913675 (+302030us) service_pool.cc:224] Handling call
0709 12:11:37.945866 (+ 32191us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:38.211427 (+265561us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:38.211474 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:38.212052 (+   578us) log.cc:844] Serialized 26 byte log entry
0709 12:11:38.382082 (+170030us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:38.382132 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:38.382202 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:38.620763 (+238561us) raft_consensus.cc:1685] finished
0709 12:11:38.620785 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:38.620912 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23489,"raft.run_cpu_time_us":48,"raft.run_wall_time_us":48,"thread_start_us":434743,"threads_started":2,"wal-append.queue_time_us":367889}
I20260709 12:11:38.607901 27029 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:38.647171 27051 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:38.648967 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:38.655236 22450 raft_consensus.cc:2376] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12. Re-sending same reply.
I20260709 12:11:38.656558 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:38.649397 22599 raft_consensus.cc:1275] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:11:38.605067 27023 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:38.653833 22606 raft_consensus.cc:1240] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 12:11:38.655242 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:38.660231 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:38.662421 27242 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:38.659618 27147 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:38.665060 27204 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:38.692600 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:38.665848 26839 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:38.669471 27155 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:38.671903 27266 raft_consensus.cc:2804] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:38.652354 27238 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:38.673250 22569 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:38.673946 27125 leader_election.cc:290] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:38.673780 27088 consensus_queue.cc:1048] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:38.650898 27111 raft_consensus.cc:3055] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:11:38.674825 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 57479.6us
I20260709 12:11:38.675498 23121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 1108) took 1186 ms. Trace:
I20260709 12:11:38.716449 23121 rpcz_store.cc:276] 0709 12:11:37.489202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.489332 (+   130us) service_pool.cc:224] Handling call
0709 12:11:37.512738 (+ 23406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:38.547709 (+1034971us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:38.675294 (+127585us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54000a00d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:38.675443 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2377829760}
I20260709 12:11:38.715691 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:38.720350 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 109016us
I20260709 12:11:38.685441 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:38.697196 27147 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:38.697870 26801 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:38.724514 27263 consensus_queue.cc:1059] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:38.672776 27220 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:38.721782 27141 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:38.725423 27125 raft_consensus.cc:2804] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:38.725827 27210 consensus_queue.cc:1048] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:38.721233 27111 raft_consensus.cc:740] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:38.710613 27266 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.727396 27266 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:38.727775 22598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43070 (request call id 728) took 1381 ms. Trace:
I20260709 12:11:38.727487 27111 consensus_queue.cc:260] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:38.728120 22598 rpcz_store.cc:276] 0709 12:11:37.346802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.888471 (+541669us) service_pool.cc:224] Handling call
0709 12:11:37.916805 (+ 28334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:38.322845 (+406040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:38.727560 (+404715us) spinlock_profiling.cc:243] Waited 405 ms on lock 0x7b5400350cd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:38.727719 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":931788032}
I20260709 12:11:38.729506 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:38.729970 26624 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:38.731236 23118 raft_consensus.cc:2393] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 13: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:38.731629 22457 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 2059) took 1119 ms. Trace:
I20260709 12:11:38.694062 27233 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:38.731984 22457 rpcz_store.cc:276] 0709 12:11:37.612653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.920882 (+308229us) service_pool.cc:224] Handling call
0709 12:11:38.640779 (+719897us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:38.641494 (+   715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:38.731435 (+ 89941us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x7b540019fd50. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:38.731572 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1654994816}
I20260709 12:11:38.733108 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:38.733662 22457 raft_consensus.cc:2468] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 8.
I20260709 12:11:38.733742 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:38.733970 27233 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:38.734768 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:38.735086 27141 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:38.700359 27242 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:38.735858 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:38.736063 26624 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:38.721860 22421 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:38.724608 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:38.725983 27125 raft_consensus.cc:697] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:38.728559 27111 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:38.730688 27195 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:38.683068 27248 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:38.721376 22570 leader_election.cc:400] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 election: Vote denied by peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353) with higher term. Message: Invalid argument: T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 13. Current term is 14.
I20260709 12:11:38.755059 22570 leader_election.cc:403] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:11:38.713696 27222 raft_consensus.cc:3055] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:38.756032 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:38.711920 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:38.756783 22602 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:38.736961 23122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57328 (request call id 1320) took 1029 ms. Trace:
I20260709 12:11:38.690711 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:38.723682 26074 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:38.734490 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:38.757440 22570 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:38.730585 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:38.681277 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:38.757287 23122 rpcz_store.cc:276] 0709 12:11:37.707107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.707912 (+   805us) service_pool.cc:224] Handling call
0709 12:11:38.726933 (+1019021us) spinlock_profiling.cc:243] Waited 86.2 ms on lock 0x7b5400759754. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:38.736901 (+  9968us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":198154624}
I20260709 12:11:38.758320 22570 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:38.736444 22452 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 10.
I20260709 12:11:38.757752 22597 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:38.760129 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:38.760869 22454 raft_consensus.cc:2393] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 13: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
W20260709 12:11:38.761608 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:38.702143 27144 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:38.724797 26801 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:38.763497 22570 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:38.747033 26611 raft_consensus.cc:2749] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:38.764756 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:38.770816 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:38.760332 22421 consensus_peers.cc:597] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 82e7db06c6ff4d96853c60f0f42c09a8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:38.688921 27108 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:38.759469 27138 consensus_meta.cc:287] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.540s	user 0.007s	sys 0.003s
I20260709 12:11:38.784093 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:38.771436 22457 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 13.
I20260709 12:11:38.772872 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:38.765918 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:38.769122 23122 raft_consensus.cc:1240] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:38.770053 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:38.772467 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:38.787463 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:38.765370 26074 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:38.756292 27222 raft_consensus.cc:740] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:38.754812 27051 consensus_queue.cc:1059] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:11:38.722391 26976 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:38.747697 27141 consensus_queue.cc:1048] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:11:38.795687 22450 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:11:38.759130 27088 raft_consensus.cc:2749] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353) with higher term. Message: Invalid argument: T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 13. Current term is 14.
I20260709 12:11:38.803771 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:38.759263 27119 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:38.761897 27054 consensus_queue.cc:237] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:38.982790 22603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43070 (request call id 734) took 1500 ms. Trace:
I20260709 12:11:38.907889 26624 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:39.073119 22603 rpcz_store.cc:276] 0709 12:11:37.482619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.852271 (+369652us) service_pool.cc:224] Handling call
0709 12:11:38.982547 (+1130276us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b5400449654. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:38.982712 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":480923392}
I20260709 12:11:39.073959 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:39.074838 23119 raft_consensus.cc:2410] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:11:38.931954 22450 raft_consensus.cc:1240] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:39.028450 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:39.075924 22450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2620) took 1218 ms. Trace:
I20260709 12:11:39.076575 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:39.077186 23122 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 10.
I20260709 12:11:38.988718 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:39.078176 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:38.990471 22448 raft_consensus.cc:1240] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:39.079418 22448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2623) took 1220 ms. Trace:
I20260709 12:11:39.076375 22450 rpcz_store.cc:276] 0709 12:11:37.857623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.834310 (+976687us) service_pool.cc:224] Handling call
0709 12:11:38.931706 (+ 97396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:39.075694 (+143988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.075867 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:39.079886 22448 rpcz_store.cc:276] 0709 12:11:37.859362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.989890 (+1130528us) service_pool.cc:224] Handling call
0709 12:11:38.990232 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:39.079148 (+ 88916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.079354 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:38.974918 22453 raft_consensus.cc:2410] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:11:38.981124 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:39.083402 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:11:38.940930 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:38.847669 22457 raft_consensus.cc:1240] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 15. Current term is 16. Ops: [15.14-15.14]
I20260709 12:11:38.899995 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:39.087029 23121 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:11:38.322515 22529 rpcz_store.cc:276] 0709 12:11:37.304819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.487350 (+182531us) service_pool.cc:224] Handling call
0709 12:11:37.488213 (+   863us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:37.488425 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:37.510466 (+ 22041us) log.cc:844] Serialized 14 byte log entry
0709 12:11:38.321258 (+810792us) spinlock_profiling.cc:243] Waited 2.19 ms on lock 0x7b1800423700. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cca4d64bc 00007f9cc782448b 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc7840c02 00007f9cca4c820b 00007f9cca4cdd23 00007f9cca4ce23a
0709 12:11:38.321515 (+   257us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:38.321583 (+    68us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:38.321668 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:38.321755 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:38.321873 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":25164,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":29712,"raft.queue_time_us":2014,"spinlock_wait_cycles":6284032,"thread_start_us":7631,"threads_started":1,"wal-append.queue_time_us":244667}
I20260709 12:11:38.813282 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:39.087984 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 281596us
W20260709 12:11:38.901125 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:38.912143 22600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2817) took 2987 ms. Trace:
W20260709 12:11:38.826314 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.089079 22452 raft_consensus.cc:1240] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:38.900766 22449 raft_consensus.cc:2393] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 13: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:39.087443 23117 raft_consensus.cc:2410] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:11:38.813892 26074 consensus_queue.cc:1048] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.279s
I20260709 12:11:38.814280 22421 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:11:39.096031 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:38.794446 27219 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.307s	user 0.017s	sys 0.029s
W20260709 12:11:39.102018 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 287811us
I20260709 12:11:39.103291 22421 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:39.104568 22452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 2064) took 1487 ms. Trace:
I20260709 12:11:39.104986 22452 rpcz_store.cc:276] 0709 12:11:37.617353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.801350 (+1183997us) service_pool.cc:224] Handling call
0709 12:11:39.072277 (+270927us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:39.104352 (+ 32075us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.104519 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:39.106647 22602 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
I20260709 12:11:39.107232 22452 raft_consensus.cc:1240] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:11:39.071831 22454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 2070) took 1443 ms. Trace:
I20260709 12:11:39.108496 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:39.109017 22454 rpcz_store.cc:276] 0709 12:11:37.628140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.799629 (+1171489us) service_pool.cc:224] Handling call
0709 12:11:39.071326 (+271697us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:39.071507 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:39.071529 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:39.071572 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:39.071612 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.071676 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:39.071775 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:39.109859 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:39.094517 22600 rpcz_store.cc:276] 0709 12:11:35.924786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.523971 (+599185us) service_pool.cc:224] Handling call
0709 12:11:36.524294 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:37.151224 (+626930us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:38.911907 (+1760683us) spinlock_profiling.cc:243] Waited 565 ms on lock 0x7b5400043154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:38.912080 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1298576640}
I20260709 12:11:38.770737 27023 raft_consensus.cc:2804] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:11:39.008169 27268 log.cc:927] Time spent T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.285s	user 0.000s	sys 0.000s
W20260709 12:11:38.977382 27249 log.cc:927] Time spent T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.848s	user 0.003s	sys 0.000s
I20260709 12:11:39.112776 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:39.138041 22600 raft_consensus.cc:3060] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:39.140092 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:38.986924 27259 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.112704 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:39.141481 22606 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:39.142313 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:39.142881 23119 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:39.107841 22497 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
W20260709 12:11:39.012104 27270 log.cc:927] Time spent T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
W20260709 12:11:38.907564 27267 log.cc:927] Time spent T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 12:11:38.774952 26801 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:38.780524 27243 raft_consensus.cc:2804] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:39.114370 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:39.129940 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:39.124205 23087 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:39.126327 22450 raft_consensus.cc:1240] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 11. Current term is 13. Ops: []
I20260709 12:11:39.164992 22450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 880) took 1242 ms. Trace:
I20260709 12:11:39.165349 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:39.165432 22450 rpcz_store.cc:276] 0709 12:11:37.922493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.081012 (+1158519us) service_pool.cc:224] Handling call
0709 12:11:39.126139 (+ 45127us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:39.164755 (+ 38616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.164939 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:39.166046 23121 raft_consensus.cc:2468] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 8.
I20260709 12:11:39.167219 22422 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:39.120074 26611 raft_consensus.cc:2804] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:39.111435 27104 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:39.144460 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:39.144656 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:38.988319 26976 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:39.008385 26695 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:11:39.111742 27219 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.634s	user 0.024s	sys 0.039s
I20260709 12:11:38.949946 27029 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:38.839677 27220 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.046629 27155 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.089453 26742 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:39.075050 27195 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:39.031316 27240 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:39.013221 27248 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:39.101118 27237 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.073748 26624 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:39.112118 27238 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:39.169620 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 45504.7us
I20260709 12:11:39.196071 26695 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:39.172861 22600 raft_consensus.cc:2468] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 11.
I20260709 12:11:39.166733 23118 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 10.
I20260709 12:11:38.771093 27271 consensus_queue.cc:1048] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.380s
I20260709 12:11:39.121743 27242 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:39.138141 27110 raft_consensus.cc:2804] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:39.137917 27263 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:39.122956 27151 ts_tablet_manager.cc:1929] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.6
I20260709 12:11:39.042624 27246 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:39.163434 27265 consensus_queue.cc:1059] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.082s
I20260709 12:11:39.140928 27045 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:38.845171 27144 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:39.049661 27096 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:39.142992 27255 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:39.014724 27189 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:39.197531 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:39.011835 27225 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:39.198822 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:39.100821 26839 consensus_queue.cc:1048] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 12:11:39.111196 27212 consensus_queue.cc:1048] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
W20260709 12:11:39.204847 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 132869us
I20260709 12:11:39.262468 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:38.775250 27125 consensus_queue.cc:237] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:39.212718 22456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2605) took 2185 ms. Trace:
I20260709 12:11:39.030836 27266 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:39.215009 22450 raft_consensus.cc:1275] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:11:39.268985 22450 pending_rounds.cc:85] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f: Aborting all ops after (but not including) 6
I20260709 12:11:39.217125 26770 raft_consensus.cc:2804] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:39.140862 27055 consensus_queue.cc:1048] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 12:11:39.163525 27243 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:39.163694 26800 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:39.202618 27269 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:39.187124 26611 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:39.227043 22604 raft_consensus.cc:1240] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:39.191512 27051 raft_consensus.cc:2749] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:39.203181 27261 log.cc:927] Time spent T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:11:39.230685 22597 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 13.
I20260709 12:11:39.233337 23087 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:11:39.284808 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 51557.8us
I20260709 12:11:39.247920 27242 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:39.191375 27191 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:39.236445 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:39.236620 22600 raft_consensus.cc:1240] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:39.247846 27263 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:39.240541 23089 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:39.206310 26976 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:39.245996 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:39.247339 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:39.247618 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:38.803452 27138 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:39.151695 27259 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:39.249958 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:39.344159 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 62631.6us
W20260709 12:11:39.345990 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 105541us
I20260709 12:11:39.346297 22570 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:39.196249 27104 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:39.229558 27155 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:39.258750 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:39.207456 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:39.289009 27147 raft_consensus.cc:2764] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:11:39.397327 26624 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:39.398533 22451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2614) took 1787 ms. Trace:
I20260709 12:11:39.400309 27246 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:39.241607 27110 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:39.414245 27110 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:39.414860 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:39.269249 22602 raft_consensus.cc:2368] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 10. Current term is 11.
I20260709 12:11:39.416090 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:39.416774 23123 raft_consensus.cc:2393] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 13: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:39.269289 22450 pending_rounds.cc:107] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:11:39.417181 22450 raft_consensus.cc:2889] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:39.417511 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:39.417847 22450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 2078) took 1025 ms. Trace:
I20260709 12:11:39.418162 22450 rpcz_store.cc:276] 0709 12:11:38.392713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.214234 (+821521us) service_pool.cc:224] Handling call
0709 12:11:39.214584 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:39.417635 (+203051us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.417796 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:39.418530 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:39.419984 27029 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:39.268239 22456 rpcz_store.cc:276] 0709 12:11:37.016143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.017890 (+  1747us) service_pool.cc:224] Handling call
0709 12:11:37.036502 (+ 18612us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:37.036767 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:11:37.350398 (+313631us) log.cc:844] Serialized 14 byte log entry
0709 12:11:38.396828 (+1046430us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:11:38.978586 (+581758us) spinlock_profiling.cc:243] Waited 5.55 ms on lock 0x7b18003b51e0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cca4d64bc 00007f9cc782448b 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc7840c02 00007f9cca4c820b 00007f9cca4cdd23 00007f9cca4ce23a
0709 12:11:39.196641 (+218055us) log.cc:844] Serialized 14 byte log entry
0709 12:11:39.201431 (+  4790us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:39.201500 (+    69us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:39.201575 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.201731 (+   156us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:39.201876 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8811,"prepare.queue_time_us":636226,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":8399,"raft.queue_time_us":9959,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":10388,"spinlock_wait_cycles":35875328,"thread_start_us":573653,"threads_started":3,"wal-append.queue_time_us":161551}
I20260709 12:11:39.263744 27151 log.cc:1199] T 263d51d0b43744d899e37466045af890 P c863116d91c14d1ca50d6e8a46a37a8f: Deleting WAL directory at /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-0-root/wals/263d51d0b43744d899e37466045af890
I20260709 12:11:39.278209 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:39.422730 27151 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51832 (request call id 85) took 4706 ms. Trace:
I20260709 12:11:39.424607 27155 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:39.221050 27220 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:39.241462 27238 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:39.279551 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 136936us
I20260709 12:11:39.424106 27151 rpcz_store.cc:276] 0709 12:11:34.738121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:34.785623 (+ 47502us) service_pool.cc:224] Handling call
0709 12:11:35.328751 (+543128us) ts_tablet_manager.cc:1151] Deleting tablet 263d51d0b43744d899e37466045af890
0709 12:11:35.347037 (+ 18286us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:11:38.506295 (+3159258us) tablet_metadata.cc:665] Metadata flushed
0709 12:11:39.090489 (+584194us) tablet_metadata.cc:665] Metadata flushed
0709 12:11:39.422581 (+332092us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1339791,"tablet-delete.queue_time_us":283296,"thread_start_us":45836,"threads_started":1}
I20260709 12:11:39.426540 27220 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:39.426867 22530 raft_consensus.cc:1275] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:39.427220 23122 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
I20260709 12:11:39.231294 27237 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:39.429543 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:39.430147 22604 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 9.
I20260709 12:11:39.261483 27141 raft_consensus.cc:3055] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:39.286113 23087 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:39.102100 22448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 882) took 1149 ms. Trace:
I20260709 12:11:39.437700 22448 rpcz_store.cc:276] 0709 12:11:37.952533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.081036 (+1128503us) service_pool.cc:224] Handling call
0709 12:11:39.101614 (+ 20578us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:39.101799 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:39.101830 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:39.101868 (+    38us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:39.101895 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.101948 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:39.102046 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:39.267895 27137 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:39.237022 22598 raft_consensus.cc:1240] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:39.294191 22421 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:39.294926 27023 raft_consensus.cc:697] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:39.277683 27243 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:39.260991 27045 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:39.276481 27022 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:39.426553 27238 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:39.311028 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 203218us
I20260709 12:11:39.278930 26770 raft_consensus.cc:697] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:39.324482 22532 raft_consensus.cc:2393] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 14: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:39.447551 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:39.448603 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:39.301796 22524 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:11:39.221400 27108 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:39.256930 22529 raft_consensus.cc:1275] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:39.369206 27271 consensus_queue.cc:1048] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:39.377064 23124 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 13.
I20260709 12:11:39.377327 23121 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
I20260709 12:11:39.457525 23121 raft_consensus.cc:1240] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:39.263288 22525 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
I20260709 12:11:39.459846 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:39.461334 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:39.462558 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:39.379057 22570 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
W20260709 12:11:39.464216 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 85286.1us
I20260709 12:11:39.282382 26800 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:39.380018 27283 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:39.380806 27276 log.cc:927] Time spent T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:11:39.284567 27269 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:39.268774 27255 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:39.383224 23125 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 12.
I20260709 12:11:39.387925 27263 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:39.290512 27144 raft_consensus.cc:2804] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:11:39.391567 27278 log.cc:927] Time spent T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:11:39.392918 27266 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:39.394528 27189 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:39.395604 27111 consensus_meta.cc:287] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.644s	user 0.010s	sys 0.000s
I20260709 12:11:39.400794 27210 raft_consensus.cc:3055] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:39.503403 27210 raft_consensus.cc:740] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:39.504295 27210 consensus_queue.cc:260] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:39.505299 27210 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:39.324365 26630 consensus_queue.cc:1059] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 12:11:39.377723 27051 raft_consensus.cc:2804] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:39.507319 27051 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:39.507789 27051 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:39.375336 27119 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:39.402325 22457 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 2069) took 1774 ms. Trace:
I20260709 12:11:39.509181 22457 rpcz_store.cc:276] 0709 12:11:37.627884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.799667 (+1171783us) service_pool.cc:224] Handling call
0709 12:11:38.834260 (+ 34593us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:39.089887 (+255627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.402097 (+312210us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b540037b254. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:39.402271 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30156544}
I20260709 12:11:39.264194 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:39.510605 22528 raft_consensus.cc:2393] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 13: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:39.511556 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:39.512681 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:39.408392 27138 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:39.407002 22451 rpcz_store.cc:276] 0709 12:11:37.610660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.883889 (+273229us) service_pool.cc:224] Handling call
0709 12:11:37.916378 (+ 32489us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:11:37.923845 (+  7467us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:37.964180 (+ 40335us) log.cc:844] Serialized 14 byte log entry
0709 12:11:38.128627 (+164447us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:11:38.129323 (+   696us) log.cc:844] Serialized 78 byte log entry
0709 12:11:38.129561 (+   238us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:38.129611 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:38.129696 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:38.976714 (+847018us) spinlock_profiling.cc:243] Waited 70.7 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:11:39.377528 (+400814us) raft_consensus.cc:1685] finished
0709 12:11:39.398249 (+ 20721us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:39.398456 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6997,"prepare.queue_time_us":36498,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":2235,"raft.queue_time_us":48260,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":2238,"spinlock_wait_cycles":162687616,"thread_start_us":100005,"threads_started":1,"wal-append.queue_time_us":148802}
I20260709 12:11:39.516577 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:39.517719 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:39.518225 22528 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
I20260709 12:11:39.518334 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:39.409976 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:39.410593 22455 raft_consensus.cc:2393] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 12: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:39.412156 27225 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:39.271955 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:39.433704 22597 raft_consensus.cc:1240] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:39.432737 22600 raft_consensus.cc:1240] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 12:11:39.433912 23089 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:39.434195 23119 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
I20260709 12:11:39.434322 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:39.432641 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:39.432168 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:11:39.439949 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 145869us
I20260709 12:11:39.440343 23123 raft_consensus.cc:2393] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 13: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
W20260709 12:11:39.440768 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 154727us
I20260709 12:11:39.279371 26611 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:39.451723 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 61255us
I20260709 12:11:39.378001 22606 raft_consensus.cc:2468] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 10.
I20260709 12:11:39.443686 27137 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:39.458884 23121 raft_consensus.cc:1240] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:39.471176 22525 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 13.
I20260709 12:11:39.442642 27055 raft_consensus.cc:2764] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:11:39.446374 27029 raft_consensus.cc:2804] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:39.479264 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:39.479970 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:39.480643 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 146805us
I20260709 12:11:39.454159 27022 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:39.489108 27238 consensus_queue.cc:1048] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:11:39.490517 27088 consensus_queue.cc:1048] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.138s
W20260709 12:11:39.633075 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 94921.2us
I20260709 12:11:39.633810 22495 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:39.633862 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:39.439469 27141 raft_consensus.cc:740] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:39.490079 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:39.524122 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 74377.1us
I20260709 12:11:39.634739 22597 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:39.634860 22529 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 8.
I20260709 12:11:39.490422 22456 raft_consensus.cc:1275] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:11:39.635744 22456 pending_rounds.cc:85] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f: Aborting all ops after (but not including) 7
I20260709 12:11:39.635993 22456 pending_rounds.cc:107] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:11:39.636214 22456 raft_consensus.cc:2889] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:39.496176 22527 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
I20260709 12:11:39.501219 22452 raft_consensus.cc:1275] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:11:39.637014 22452 pending_rounds.cc:85] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f: Aborting all ops after (but not including) 6
I20260709 12:11:39.637269 22452 pending_rounds.cc:107] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:11:39.637480 22452 raft_consensus.cc:2889] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:39.489166 27246 raft_consensus.cc:2749] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:39.631953 22532 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 12.
W20260709 12:11:39.523140 22453 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 2054) took 2713 ms (client timeout 2049 ms). Trace:
W20260709 12:11:39.639199 22453 rpcz_store.cc:269] 0709 12:11:36.786457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.786570 (+   113us) service_pool.cc:224] Handling call
0709 12:11:39.499869 (+2713299us) spinlock_profiling.cc:243] Waited 2.13 s on lock 0x7b540038a4d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:39.500033 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4891068160}
I20260709 12:11:39.639829 22422 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:39.640697 22604 raft_consensus.cc:2393] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 13: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
W20260709 12:11:39.642549 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.643800 22597 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 14.
I20260709 12:11:39.486896 22570 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:39.641589 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:11:39.645037 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 158261us
I20260709 12:11:39.645922 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:39.646443 22570 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:11:39.607822 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:39.648262 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.649564 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:39.643927 22495 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:39.652393 22600 raft_consensus.cc:1275] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:39.652568 22602 raft_consensus.cc:2393] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 11: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:39.649212 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:39.538096 22601 raft_consensus.cc:2393] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 11: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:39.648664 23087 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:39.653708 23121 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:39.655190 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 221335us
I20260709 12:11:39.655567 23087 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:39.650849 22532 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 10.
I20260709 12:11:39.657040 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:39.657871 23117 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:39.658171 23087 leader_election.cc:400] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 10. Current term is 11.
I20260709 12:11:39.658515 23087 leader_election.cc:403] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:39.525477 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:39.658914 22450 raft_consensus.cc:1275] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:11:39.659266 23089 leader_election.cc:400] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 election: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 10. Current term is 11.
I20260709 12:11:39.659670 23089 leader_election.cc:403] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:11:39.660419 22600 raft_consensus.cc:1240] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:39.661083 22421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.661866 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:39.662684 22524 raft_consensus.cc:2393] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 11: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:39.662766 22523 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 10.
I20260709 12:11:39.663264 22604 raft_consensus.cc:1240] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:39.498194 27144 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:39.617409 26630 raft_consensus.cc:3055] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:39.616737 27237 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:39.667483 22532 raft_consensus.cc:1240] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:11:39.667964 22525 raft_consensus.cc:1275] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:39.618316 27255 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:39.622435 27045 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:39.632318 27029 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:39.498136 27142 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:39.628230 26800 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:39.670068 22495 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:39.675478 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:39.674122 22497 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:39.727982 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:39.742897 23121 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11.
I20260709 12:11:39.730851 22524 raft_consensus.cc:1240] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:39.669045 22603 raft_consensus.cc:1240] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:39.736642 22532 raft_consensus.cc:1275] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:11:39.730847 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:39.640151 26920 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.661968 27111 raft_consensus.cc:2804] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:11:39.727387 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 70972.3us
I20260709 12:11:39.616550 26770 consensus_queue.cc:237] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:39.621220 27110 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:39.797237 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:39.799149 22570 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:39.662731 27155 raft_consensus.cc:2804] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:39.712154 27144 raft_consensus.cc:3060] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:39.800624 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:39.724810 27286 raft_consensus.cc:2804] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:39.662171 27189 raft_consensus.cc:2804] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:39.661532 27125 raft_consensus.cc:2749] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:39.726054 27193 raft_consensus.cc:2749] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 10. Current term is 11.
I20260709 12:11:39.675966 27271 raft_consensus.cc:2804] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:39.805442 23121 raft_consensus.cc:2393] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 11: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:39.668772 27288 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:39.728704 26630 raft_consensus.cc:740] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:39.657037 27284 consensus_queue.cc:1059] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.141s
I20260709 12:11:39.810726 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:39.656637 26695 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:39.755591 27029 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:39.752666 27137 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:39.752916 22339 catalog_manager.cc:5028] TS c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): tablet 263d51d0b43744d899e37466045af890 (table test-workload [id=1e73b97ba677488c8829a696096f4885]) successfully deleted
I20260709 12:11:39.723668 27225 consensus_queue.cc:1048] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.083s
I20260709 12:11:39.797631 27119 raft_consensus.cc:2749] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:39.801522 27077 raft_consensus.cc:2749] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 10. Current term is 11.
I20260709 12:11:39.806407 27286 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:39.805387 26801 raft_consensus.cc:2804] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:39.803539 27155 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:39.812577 27271 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:11:39.820847 22339 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 153629us
I20260709 12:11:39.805045 27147 raft_consensus.cc:2804] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:39.622660 27023 consensus_queue.cc:237] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:39.804764 27111 raft_consensus.cc:697] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:39.802387 27243 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:39.826174 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:39.834630 23122 raft_consensus.cc:1240] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:11:39.828562 22599 raft_consensus.cc:1240] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:39.756366 27205 consensus_queue.cc:1048] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 12:11:39.792307 27222 consensus_queue.cc:260] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:39.801826 27142 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:39.801718 26920 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:39.815593 27189 raft_consensus.cc:697] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 11 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:39.825064 27125 raft_consensus.cc:3055] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:39.832607 26801 raft_consensus.cc:697] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:39.847151 27111 consensus_queue.cc:237] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:39.848162 27222 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:39.824689 27286 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:39.829245 27271 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:39.852697 22605 raft_consensus.cc:1240] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:39.854230 27110 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:39.854514 26695 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:39.854964 27022 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:39.858284 27283 raft_consensus.cc:2749] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:39.860139 26801 consensus_queue.cc:237] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:39.861253 27051 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:39.863337 26976 consensus_meta.cc:287] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.516s	user 0.010s	sys 0.001s
I20260709 12:11:39.863771 23117 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:11:39.870862 27096 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:39.916827 23119 raft_consensus.cc:1240] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 12. Current term is 13. Ops: [11.12-12.13]
I20260709 12:11:39.852584 27125 raft_consensus.cc:740] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:39.864852 26920 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:39.867709 26611 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:39.876114 27141 consensus_queue.cc:260] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:39.881807 27242 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:39.962801 26695 consensus_queue.cc:1048] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:39.964202 26695 consensus_queue.cc:1059] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:11:39.882589 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 204901us
I20260709 12:11:39.852264 27284 consensus_queue.cc:1059] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 12:11:39.967021 22496 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:39.967420 27284 raft_consensus.cc:3055] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:39.967756 27284 raft_consensus.cc:740] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:39.967818 27022 consensus_queue.cc:1048] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:39.968866 22496 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:39.969266 27022 raft_consensus.cc:2749] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:39.969367 27142 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:39.830598 27155 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:39.971221 26611 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:39.900362 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 226298us
I20260709 12:11:39.839661 27147 raft_consensus.cc:697] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:39.925024 23116 raft_consensus.cc:1240] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:39.930822 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:39.933766 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:39.980652 22450 raft_consensus.cc:2393] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 12: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:39.941264 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:39.944119 23121 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 12.
I20260709 12:11:39.851516 26630 consensus_queue.cc:260] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:39.961145 27297 log.cc:927] Time spent T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 12:11:39.961537 22451 raft_consensus.cc:1275] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:11:39.962219 22448 raft_consensus.cc:1240] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:39.968575 27284 consensus_queue.cc:260] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:39.896128 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:39.990202 23124 raft_consensus.cc:2393] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 11: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:39.917325 22570 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:11:39.990926 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 73677.7us
I20260709 12:11:39.994244 23125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57318 (request call id 1117) took 1542 ms. Trace:
W20260709 12:11:39.998718 22455 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 2081) took 1591 ms (client timeout 1630 ms). Trace:
W20260709 12:11:39.999293 22455 rpcz_store.cc:269] 0709 12:11:38.407166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.637245 (+230079us) service_pool.cc:224] Handling call
0709 12:11:39.998476 (+1361231us) spinlock_profiling.cc:243] Waited 772 ms on lock 0x7b54003f48d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:39.998645 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1776496512}
I20260709 12:11:39.927673 26976 raft_consensus.cc:2749] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:39.971292 27189 consensus_queue.cc:237] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:40.000531 22454 raft_consensus.cc:1240] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:40.109575 27051 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:40.102685 27288 raft_consensus.cc:2749] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:40.110270 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:40.102712 27147 consensus_queue.cc:237] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:39.994788 23125 rpcz_store.cc:276] 0709 12:11:38.452323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.453570 (+  1247us) service_pool.cc:224] Handling call
0709 12:11:39.994016 (+1540446us) spinlock_profiling.cc:243] Waited 918 ms on lock 0x7b5400750154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:39.994172 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2111604096}
W20260709 12:11:40.111827 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 143026us
W20260709 12:11:40.051626 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:40.051888 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.115770 22496 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:39.987238 27022 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:40.116921 27290 raft_consensus.cc:2749] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:40.117223 27022 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:40.117827 27141 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:39.925519 26624 raft_consensus.cc:2749] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:40.017452 27142 raft_consensus.cc:2804] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:40.008555 27250 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:40.119138 22449 raft_consensus.cc:1240] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:11:39.992336 22452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 2077) took 1602 ms. Trace:
I20260709 12:11:40.147778 22452 rpcz_store.cc:276] 0709 12:11:38.390348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.160224 (+769876us) service_pool.cc:224] Handling call
0709 12:11:39.500020 (+339796us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:39.637877 (+137857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.992148 (+354271us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b540038a4d0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:39.992281 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":780625792}
I20260709 12:11:40.120360 22496 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
W20260709 12:11:40.121809 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:40.149358 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:39.987993 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 195960us
W20260709 12:11:39.986135 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 316126us
I20260709 12:11:40.152413 22495 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:40.154228 22495 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:40.130564 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.114220 27284 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:40.117858 27022 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:40.151288 23089 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:40.008747 27005 consensus_queue.cc:1048] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.136s
I20260709 12:11:40.159358 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:40.146246 26630 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:40.175534 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.181388 22606 raft_consensus.cc:1240] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:40.178877 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:40.179327 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:40.181452 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:40.180646 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:40.186759 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:40.178915 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:40.183683 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:40.214210 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:40.216678 22598 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:40.214646 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:40.217928 22600 raft_consensus.cc:2393] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 13: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:40.181129 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:40.157344 27288 raft_consensus.cc:2749] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:40.218523 23125 raft_consensus.cc:2393] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 11: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:40.224658 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:40.181864 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:40.225150 22604 raft_consensus.cc:2393] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 12: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:40.174270 27119 raft_consensus.cc:2749] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:40.177654 27210 raft_consensus.cc:2804] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:40.112617 27125 consensus_queue.cc:260] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:40.157500 27301 raft_consensus.cc:2749] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:40.173019 27269 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:40.216123 27142 raft_consensus.cc:697] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
W20260709 12:11:40.267647 27302 log.cc:927] Time spent T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:11:40.267560 27029 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:40.272756 27144 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:40.274900 27144 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:40.264199 27210 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:40.279452 27210 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:40.279626 27286 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:40.281225 27286 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:40.228561 27266 raft_consensus.cc:3055] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:40.281787 27266 raft_consensus.cc:740] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:40.282426 27266 consensus_queue.cc:260] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:40.283243 27266 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:40.285279 27155 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:40.286381 27271 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:40.286947 27155 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:11:40.350601 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 172184us
W20260709 12:11:40.350669 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 175586us
I20260709 12:11:40.356129 22597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "272afea078f74bf19baefd3c1300644d"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:11:40.357710 22597 raft_consensus.cc:606] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:11:40.358475 22597 raft_consensus.cc:614] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:40.360146 22525 raft_consensus.cc:1240] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:40.361914 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:40.225101 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:40.375350 27054 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:40.376219 27054 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:40.376951 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:40.212077 26801 consensus_queue.cc:1059] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 12:11:40.367676 22603 raft_consensus.cc:2393] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 13: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:40.263236 23119 raft_consensus.cc:1275] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 12:11:40.379734 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:40.383016 22527 raft_consensus.cc:2368] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 10. Current term is 11.
I20260709 12:11:40.383406 23119 pending_rounds.cc:85] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270: Aborting all ops after (but not including) 10
I20260709 12:11:40.383769 22532 raft_consensus.cc:2393] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 11: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:40.384172 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:40.384850 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:40.372357 26800 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.382011 22523 raft_consensus.cc:1240] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:40.378943 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:40.380589 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:40.402280 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 271011us
W20260709 12:11:40.404178 27318 log.cc:927] Time spent T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:11:40.404397 26920 consensus_queue.cc:1059] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:40.405700 22421 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:40.406260 26920 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.407735 26074 raft_consensus.cc:3055] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:40.408130 26074 raft_consensus.cc:740] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:40.409020 26611 raft_consensus.cc:2804] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:40.409574 26611 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:40.410056 26611 raft_consensus.cc:3060] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:40.409521 26074 consensus_queue.cc:260] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:40.415529 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:40.416121 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.415731 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:40.417124 22530 raft_consensus.cc:2368] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 10. Current term is 11.
I20260709 12:11:40.383800 23119 pending_rounds.cc:107] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 12:11:40.418179 23119 raft_consensus.cc:2889] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:40.419943 27119 consensus_queue.cc:1059] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:40.422240 27145 raft_consensus.cc:3055] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:40.422251 27242 raft_consensus.cc:3055] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:40.423345 27242 raft_consensus.cc:740] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:40.424682 22454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 894) took 2088 ms. Trace:
I20260709 12:11:40.424762 27242 consensus_queue.cc:260] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:40.425279 22454 rpcz_store.cc:276] 0709 12:11:38.336153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.110069 (+773916us) service_pool.cc:224] Handling call
0709 12:11:40.000292 (+890223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:40.109744 (+109452us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:40.424146 (+314402us) spinlock_profiling.cc:243] Waited 890 ms on lock 0x7b54003f48d0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:40.424450 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2046647168}
I20260709 12:11:40.426614 27242 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:40.427325 27054 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:40.428095 27204 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.422808 27145 raft_consensus.cc:740] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:40.429387 22599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2854) took 1688 ms. Trace:
I20260709 12:11:40.429045 27204 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:40.429936 22599 rpcz_store.cc:276] 0709 12:11:38.740547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.078258 (+337711us) service_pool.cc:224] Handling call
0709 12:11:39.078504 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:39.837593 (+759089us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:40.428759 (+591166us) spinlock_profiling.cc:243] Waited 750 ms on lock 0x7b54002dee54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:40.429155 (+   396us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1724569344}
I20260709 12:11:40.431813 26920 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:40.290441 27125 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:40.444912 23120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57318 (request call id 1119) took 1991 ms (client timeout 2063 ms). Trace:
W20260709 12:11:40.445433 23120 rpcz_store.cc:269] 0709 12:11:38.452902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.455840 (+  2938us) service_pool.cc:224] Handling call
0709 12:11:40.444469 (+1988629us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54000a19d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:40.444696 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2725973248}
I20260709 12:11:40.448349 27250 consensus_queue.cc:1059] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:40.449067 27271 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:40.452354 27142 consensus_queue.cc:237] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:40.380826 26801 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:40.467866 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 114536us
I20260709 12:11:40.475680 26074 raft_consensus.cc:3060] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:40.477128 22605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2856) took 1374 ms. Trace:
I20260709 12:11:40.477530 22605 rpcz_store.cc:276] 0709 12:11:39.090249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.225515 (+135266us) service_pool.cc:224] Handling call
0709 12:11:39.225821 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:39.883079 (+657258us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:40.442734 (+559655us) spinlock_profiling.cc:243] Waited 627 ms on lock 0x7b540013b354. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:40.464992 (+ 22258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1441208704}
I20260709 12:11:40.480576 22421 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:40.480454 26801 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:40.487169 27269 raft_consensus.cc:3055] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:40.487838 27269 raft_consensus.cc:740] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:40.489241 27269 consensus_queue.cc:260] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:40.490651 27269 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:40.491261 26800 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:40.495772 27204 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:40.495689 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:40.497269 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:40.499579 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:40.500254 22570 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:40.500695 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:40.501204 27023 consensus_queue.cc:1048] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:11:40.502444 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:40.503152 27054 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.505940 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:40.519748 22597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:11:40.522254 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:40.525979 27111 raft_consensus.cc:2749] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:40.527285 22532 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 13.
I20260709 12:11:40.529804 27104 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:40.531186 27054 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:40.533730 26074 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:11:40.534092 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 53722.1us
I20260709 12:11:40.535073 26920 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:40.535691 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:40.535801 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 120660us
I20260709 12:11:40.536193 22530 raft_consensus.cc:1240] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 LEADER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 12:11:40.536631 22421 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:40.537786 22421 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:40.542297 27243 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:40.543738 22531 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 13.
I20260709 12:11:40.545434 27259 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:40.548290 27123 raft_consensus.cc:2804] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:40.548461 26920 raft_consensus.cc:2749] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:40.534500 26074 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:40.548947 27123 raft_consensus.cc:697] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 11 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:40.551052 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:40.551469 27123 consensus_queue.cc:237] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:40.552320 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:40.553445 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:40.555152 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:40.555351 22598 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 13.
I20260709 12:11:40.555467 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:40.556005 22523 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
I20260709 12:11:40.556205 22456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 2089) took 1458 ms. Trace:
I20260709 12:11:40.556797 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:40.557054 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:40.557833 22523 raft_consensus.cc:2393] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 11: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:40.558004 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:40.558965 22526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56942 (request call id 1973) took 1313 ms. Trace:
I20260709 12:11:40.554659 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:40.559368 22526 rpcz_store.cc:276] 0709 12:11:39.245643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.245759 (+   116us) service_pool.cc:224] Handling call
0709 12:11:40.558598 (+1312839us) spinlock_profiling.cc:243] Waited 909 ms on lock 0x7b5400261e54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:40.558785 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2089716992}
I20260709 12:11:40.556649 22456 rpcz_store.cc:276] 0709 12:11:39.097660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.420738 (+323078us) service_pool.cc:224] Handling call
0709 12:11:39.421097 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:39.636628 (+215531us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:40.555705 (+919077us) spinlock_profiling.cc:243] Waited 68.9 ms on lock 0x7b540016b2d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:40.556015 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":158371072}
I20260709 12:11:40.561050 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:40.563135 22524 raft_consensus.cc:2368] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 10. Current term is 11.
I20260709 12:11:40.525539 22597 raft_consensus.cc:606] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:11:40.562704 22528 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 13.
I20260709 12:11:40.566089 22597 raft_consensus.cc:614] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:40.429961 27145 consensus_queue.cc:260] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:40.534101 27054 leader_election.cc:290] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:40.570900 26074 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:40.570330 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:40.571518 27243 raft_consensus.cc:2749] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:40.572743 22422 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:40.574066 22529 raft_consensus.cc:1240] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 LEADER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:40.576354 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:40.576932 27029 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:40.576994 22526 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:11:40.578032 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:40.581248 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:40.582276 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:40.583627 22524 raft_consensus.cc:2368] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 10. Current term is 11.
I20260709 12:11:40.585041 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:40.564220 26801 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:40.587764 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 87724.7us
I20260709 12:11:40.589340 22528 raft_consensus.cc:2368] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 10. Current term is 11.
I20260709 12:11:40.599766 22602 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 13.
I20260709 12:11:40.607951 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:40.608814 26074 raft_consensus.cc:2804] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:40.607149 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:40.610035 22526 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:40.618937 26074 raft_consensus.cc:697] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:40.624466 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:40.629683 22524 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 10.
I20260709 12:11:40.630172 26611 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:40.630885 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:40.632125 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:40.632707 26611 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:40.633148 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:40.634281 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:11:40.636418 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.639864 27110 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:40.640652 27110 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:40.641541 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 658973us
I20260709 12:11:40.645612 27145 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:40.638803 22597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6334366811764682b0a491c130c68eed"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:11:40.647099 22456 raft_consensus.cc:1240] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 15. Current term is 16. Ops: [15.14-15.14]
I20260709 12:11:40.646919 22597 raft_consensus.cc:606] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:11:40.651895 22597 raft_consensus.cc:614] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:11:40.652588 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.653522 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:40.654424 22421 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:40.658172 22421 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:40.659883 26976 raft_consensus.cc:2804] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:40.660271 26976 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:40.660647 26976 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:40.661171 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:40.662273 22497 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:40.662901 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:40.663645 22457 raft_consensus.cc:1240] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:40.664187 27250 consensus_queue.cc:1059] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:40.664418 22570 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:40.664690 27111 consensus_queue.cc:1059] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:40.665416 27250 raft_consensus.cc:2804] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:40.665993 22456 raft_consensus.cc:1240] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:40.654496 22453 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
I20260709 12:11:40.668090 26800 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:40.665872 27055 raft_consensus.cc:3055] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:40.666278 27243 raft_consensus.cc:2749] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:40.668686 27055 raft_consensus.cc:740] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:40.669227 27110 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:40.669937 27055 consensus_queue.cc:260] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:40.666744 27284 consensus_queue.cc:1048] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:11:40.671598 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:40.672806 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:40.675611 27111 raft_consensus.cc:3055] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:40.668258 26074 consensus_queue.cc:237] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:40.653565 22529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 2300) took 1263 ms. Trace:
I20260709 12:11:40.666697 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:40.678386 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:40.666072 27250 raft_consensus.cc:697] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 12 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:40.676003 27111 raft_consensus.cc:740] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
W20260709 12:11:40.680609 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.680897 27111 consensus_queue.cc:260] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:40.681736 27055 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:40.682335 27111 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:40.680630 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:40.683308 27282 raft_consensus.cc:2804] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:40.683547 22598 raft_consensus.cc:2393] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 16: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:40.634435 27210 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:40.685156 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.685670 27210 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:40.686750 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:40.687604 22525 raft_consensus.cc:2393] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 11: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:40.688520 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:40.677801 22529 rpcz_store.cc:276] 0709 12:11:39.389953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.746010 (+356057us) service_pool.cc:224] Handling call
0709 12:11:40.561763 (+815753us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:40.574504 (+ 12741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:40.653289 (+ 78785us) spinlock_profiling.cc:243] Waited 813 ms on lock 0x7b5400261e50. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:40.653453 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1870908160}
I20260709 12:11:40.664844 27022 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:40.680727 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:40.690970 22454 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
I20260709 12:11:40.692310 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:40.693692 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:40.694162 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:40.696879 22523 raft_consensus.cc:2393] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 11: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:40.700529 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:40.705885 22527 raft_consensus.cc:2393] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 12: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:40.706069 22598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:11:40.706625 22598 raft_consensus.cc:606] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:11:40.706952 22598 raft_consensus.cc:614] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:40.704205 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:40.684849 27250 consensus_queue.cc:237] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:40.696679 27282 raft_consensus.cc:697] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:40.710932 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:40.715073 22529 raft_consensus.cc:2393] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 10: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:40.717962 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:40.727131 22570 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:40.736521 27022 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:40.739526 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:40.743407 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:40.743830 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:40.745326 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:40.746061 22457 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 13.
I20260709 12:11:40.746757 23116 raft_consensus.cc:1240] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:40.749437 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:40.749960 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:40.750417 22451 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
I20260709 12:11:40.746819 23120 raft_consensus.cc:1275] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 12:11:40.751106 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.751209 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:40.751829 22529 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
I20260709 12:11:40.752635 22598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:11:40.753219 22598 raft_consensus.cc:606] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Received request to transfer leadership to TS c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:40.747956 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:40.754490 22450 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 14.
I20260709 12:11:40.755215 23123 raft_consensus.cc:2393] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 11: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:40.755968 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:40.763221 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 61939.9us
I20260709 12:11:40.743423 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:40.729627 27123 raft_consensus.cc:2955] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 LEADER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:11:40.778137 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:40.784086 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:40.787271 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:40.789134 27217 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:40.789431 27051 consensus_queue.cc:1059] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:11:40.790450 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 132402us
I20260709 12:11:40.790495 27051 raft_consensus.cc:3055] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:40.791224 27051 raft_consensus.cc:740] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:40.791877 27284 raft_consensus.cc:2804] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:40.792402 27284 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:40.792842 27284 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:40.801429 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 99520.1us
I20260709 12:11:40.747205 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:40.789219 22598 raft_consensus.cc:2955] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:11:40.810420 22526 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 14.
I20260709 12:11:40.803530 22455 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 12.
I20260709 12:11:40.790056 27217 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:40.728767 27282 consensus_queue.cc:237] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:40.822057 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:40.832590 22421 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:40.830780 22570 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:40.836239 26976 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:40.840031 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:40.843521 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:40.850021 22495 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:40.850785 22600 raft_consensus.cc:1240] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 LEADER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 12. Current term is 13. Ops: [12.13-12.13]
I20260709 12:11:40.851751 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:40.853005 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:40.855746 23116 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
I20260709 12:11:40.864642 22452 raft_consensus.cc:1240] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 LEADER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:40.865855 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:40.868554 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:40.869428 22456 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
I20260709 12:11:40.869812 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:40.866622 22452 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 12.
W20260709 12:11:40.866899 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.873980 27282 consensus_queue.cc:1059] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:40.875173 27287 consensus_queue.cc:1059] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:40.875926 26800 consensus_queue.cc:1059] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:40.851007 27283 raft_consensus.cc:2749] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:40.871059 27210 consensus_queue.cc:1059] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 12:11:40.877548 27238 raft_consensus.cc:3055] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:40.878062 27238 raft_consensus.cc:740] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:40.878386 27077 raft_consensus.cc:3055] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:40.878547 27022 raft_consensus.cc:3055] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:40.878852 27077 raft_consensus.cc:740] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:40.879108 27022 raft_consensus.cc:740] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:40.879237 27238 consensus_queue.cc:260] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:40.875527 27282 raft_consensus.cc:3055] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:40.879926 27077 consensus_queue.cc:260] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:40.880801 27282 raft_consensus.cc:740] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:40.880373 27022 consensus_queue.cc:260] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:40.881623 27077 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:40.881767 27282 consensus_queue.cc:260] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:40.877251 26800 consensus_queue.cc:1059] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:40.883332 27282 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:40.883567 26800 raft_consensus.cc:3055] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:40.884037 26800 raft_consensus.cc:740] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:40.885099 26800 consensus_queue.cc:260] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:40.886111 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.886389 26800 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:40.897650 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.898492 22453 raft_consensus.cc:2393] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 11: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
W20260709 12:11:40.906291 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.954123 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:40.952299 23120 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 12.
W20260709 12:11:40.958514 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.959311 26976 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:40.964416 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.969511 22454 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
I20260709 12:11:40.968497 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:40.970924 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 81880.1us
I20260709 12:11:40.978330 27283 consensus_queue.cc:1048] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
W20260709 12:11:40.980800 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.963598 27029 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.983433 27029 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:40.984076 27217 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:40.987799 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 181408us
I20260709 12:11:40.990298 23087 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:40.991564 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 164567us
I20260709 12:11:40.991638 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:40.992609 22570 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:40.993233 23125 raft_consensus.cc:2393] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 12: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:40.993781 27263 consensus_queue.cc:1048] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:40.995256 27243 raft_consensus.cc:2749] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:40.995658 27263 raft_consensus.cc:2749] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:40.996093 27243 consensus_queue.cc:1048] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:40.991801 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:40.997715 23119 raft_consensus.cc:2393] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 14: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:40.965071 27242 raft_consensus.cc:2749] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:11:41.005889 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.006110 22601 raft_consensus.cc:1275] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:11:41.006727 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.007620 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:41.008577 22601 raft_consensus.cc:2393] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 13: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:41.011147 27142 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:41.011901 27142 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:41.014602 27142 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:41.015307 22451 raft_consensus.cc:1275] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:11:41.030910 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.016484 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:41.022094 27322 log.cc:927] Time spent T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.416s	user 0.000s	sys 0.005s
I20260709 12:11:41.024317 27023 consensus_queue.cc:1048] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:40.952648 27250 raft_consensus.cc:2749] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:41.009642 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:41.033061 22531 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
I20260709 12:11:40.994745 22570 leader_election.cc:304] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:41.022151 23088 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:41.026501 27243 consensus_queue.cc:1048] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:11:40.861717 27051 consensus_queue.cc:260] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:41.034547 27022 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:41.039567 22605 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 11.
I20260709 12:11:41.052161 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:41.053444 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:41.054591 22604 raft_consensus.cc:2410] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 12 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 12:11:41.061244 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:41.062291 22606 raft_consensus.cc:2393] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 12: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:41.057931 22496 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:41.063381 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:41.061416 27266 consensus_meta.cc:287] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.669s	user 0.018s	sys 0.001s
W20260709 12:11:41.065392 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:41.068013 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 218064us
I20260709 12:11:41.078712 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:41.081764 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:41.083617 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:41.084841 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 62881.7us
I20260709 12:11:41.070560 27259 raft_consensus.cc:2749] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:41.094409 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:41.102125 22606 raft_consensus.cc:1240] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:41.086102 27145 raft_consensus.cc:2749] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:11:41.109462 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 64613.8us
I20260709 12:11:41.093482 27283 raft_consensus.cc:2749] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:41.115486 22598 raft_consensus.cc:1275] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:41.120854 23088 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:41.132622 22605 raft_consensus.cc:1275] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:41.140691 22495 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:41.148816 22525 raft_consensus.cc:1240] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 11. Current term is 12. Ops: [11.12-11.12]
W20260709 12:11:41.149559 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 123441us
I20260709 12:11:41.124728 27051 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:41.153836 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:41.131381 22497 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:41.156459 23120 raft_consensus.cc:2393] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 11: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:41.153743 22495 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:41.145181 27259 raft_consensus.cc:2749] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:41.172688 22599 raft_consensus.cc:1240] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:41.174901 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:41.177214 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:41.187636 22569 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:11:41.187918 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 56667.8us
W20260709 12:11:41.190328 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 45870.1us
I20260709 12:11:41.190889 22495 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:41.189042 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.193324 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:41.193961 23120 raft_consensus.cc:2393] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 9: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:41.178498 27145 raft_consensus.cc:2804] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:41.197532 22454 raft_consensus.cc:1240] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:41.181839 27217 raft_consensus.cc:2804] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:41.198724 23122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 1136) took 1360 ms. Trace:
I20260709 12:11:41.199877 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:41.201911 27217 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:41.205687 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:41.205276 27217 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:41.201200 23122 rpcz_store.cc:276] 0709 12:11:39.742006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.839370 (+ 97364us) service_pool.cc:224] Handling call
0709 12:11:39.839707 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:39.840202 (+   495us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:39.840259 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:39.841055 (+   796us) log.cc:844] Serialized 26 byte log entry
0709 12:11:40.438973 (+597918us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b18003baee0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc7823e07 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc7840c02 00007f9cca4c820b 00007f9cca4cdd23 00007f9cca4ce0d1 00007f9cca8e9a0f
0709 12:11:40.625440 (+186467us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:40.627956 (+  2516us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:40.662320 (+ 34364us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:41.021114 (+358794us) spinlock_profiling.cc:243] Waited 3.3 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:11:41.088222 (+ 67108us) raft_consensus.cc:1685] finished
0709 12:11:41.088252 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:41.102430 (+ 14178us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":676,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":6906,"spinlock_wait_cycles":51341440,"thread_start_us":124777,"threads_started":1,"wal-append.queue_time_us":741876}
W20260709 12:11:41.211043 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 93499.7us
I20260709 12:11:41.221414 23088 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:41.198884 27145 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:41.194697 27242 raft_consensus.cc:2749] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:41.181948 27201 consensus_queue.cc:1059] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.117s
I20260709 12:11:41.200657 27023 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:41.228926 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 234328us
I20260709 12:11:41.198185 27341 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:41.227564 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 61007.2us
I20260709 12:11:41.227290 27145 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:41.198360 27119 consensus_queue.cc:1048] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
W20260709 12:11:41.233089 22421 connection.cc:256] RPC call timeout handler was delayed by -1.0811927429999741s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16920000000000002s for a response
W20260709 12:11:41.252947 22421 connection.cc:256] RPC call timeout handler was delayed by -1.0046927429998505s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1777s for a response
I20260709 12:11:41.227008 27266 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.233737 27341 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:41.255549 22570 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
W20260709 12:11:41.264248 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 73408.7us
I20260709 12:11:41.258402 27259 raft_consensus.cc:2804] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:11:41.275910 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 71896.8us
I20260709 12:11:41.252172 27242 raft_consensus.cc:2749] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:41.279084 22449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 2086) took 2451 ms. Trace:
I20260709 12:11:41.281473 22495 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:41.260761 27341 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:41.279611 22449 rpcz_store.cc:276] 0709 12:11:38.737837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.405177 (+667340us) service_pool.cc:224] Handling call
0709 12:11:39.405570 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:40.147475 (+741905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:41.151310 (+1003835us) spinlock_profiling.cc:243] Waited 713 ms on lock 0x7b54004056d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:41.189159 (+ 37849us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1640473472}
W20260709 12:11:41.284183 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 72313.6us
I20260709 12:11:41.293481 23088 leader_election.cc:400] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 election: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 10. Current term is 11.
I20260709 12:11:41.294698 23088 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:41.295818 27210 raft_consensus.cc:2749] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:41.298076 22421 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:41.298626 23088 leader_election.cc:400] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 10. Current term is 11.
I20260709 12:11:41.284632 27345 consensus_queue.cc:1059] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:41.302119 22496 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:41.249579 27023 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:41.278314 27259 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:41.318356 27284 consensus_meta.cc:287] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.525s	user 0.016s	sys 0.000s
W20260709 12:11:41.325299 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 90920.2us
I20260709 12:11:41.328128 22569 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:41.330307 23088 leader_election.cc:400] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 10. Current term is 11.
I20260709 12:11:41.331875 23088 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:41.332989 27210 raft_consensus.cc:2804] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:41.333110 23088 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:41.333638 27210 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:41.334164 27210 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:41.334290 27077 raft_consensus.cc:2749] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:41.334762 23088 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:41.335608 27077 raft_consensus.cc:2749] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:41.336584 27077 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:41.336762 23088 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:41.271188 27266 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:41.322489 27259 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:41.337109 27077 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:41.356971 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 120662us
I20260709 12:11:41.363629 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:41.325977 27242 consensus_queue.cc:1048] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:11:41.372583 27352 raft_consensus.cc:2749] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:41.374375 27225 raft_consensus.cc:2749] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:41.375427 27222 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:41.376085 27222 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:41.378108 26770 consensus_queue.cc:1059] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
W20260709 12:11:41.380788 27123 consensus_meta.cc:287] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.594s	user 0.007s	sys 0.007s
I20260709 12:11:41.382179 22570 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:41.383770 22570 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:41.385927 22570 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:41.387022 27104 raft_consensus.cc:3055] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:41.387461 27104 raft_consensus.cc:740] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:41.388444 27104 consensus_queue.cc:260] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:41.389717 27104 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:41.393289 27266 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:41.397343 27350 ts_tablet_manager.cc:933] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317)
I20260709 12:11:41.399677 27029 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:41.400133 27345 raft_consensus.cc:2804] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:41.400820 27345 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:41.401306 27345 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:41.374254 27355 raft_consensus.cc:2804] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:41.372804 27359 raft_consensus.cc:2749] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:41.340741 27284 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:41.422202 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:41.428223 27077 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:41.430512 27023 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:41.400243 27029 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:41.405530 27355 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:41.449025 22603 raft_consensus.cc:1240] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:41.447636 27355 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:41.478472 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 141790us
I20260709 12:11:41.479326 23088 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:41.450525 27222 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:41.482291 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.459973 27023 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:41.461838 27217 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:41.491875 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:41.492262 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 89737.4us
W20260709 12:11:41.488514 26800 consensus_meta.cc:287] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.531s	user 0.014s	sys 0.000s
W20260709 12:11:41.493628 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.462764 27029 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:41.495402 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 229846us
I20260709 12:11:41.495987 22495 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:41.503046 27362 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:41.503679 27362 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:41.504309 27362 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:41.507457 27284 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:41.498973 27361 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:41.512874 23089 leader_election.cc:304] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:41.514104 22598 raft_consensus.cc:1275] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:41.516796 27222 raft_consensus.cc:2749] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:41.518304 26800 consensus_queue.cc:1059] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:41.518669 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:41.519387 27225 consensus_queue.cc:1048] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:41.519729 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:41.523527 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 240576us
I20260709 12:11:41.494143 27350 tablet_copy_client.cc:323] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270: tablet copy: Beginning tablet copy session from remote peer at address 127.20.196.129:42317
I20260709 12:11:41.525528 27341 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:41.541656 27022 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:41.542107 27022 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:41.542273 27341 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:41.542505 27022 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:41.535285 27353 log.cc:927] Time spent T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:11:41.535213 27210 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:41.516433 27263 raft_consensus.cc:2749] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:41.535727 22495 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:41.537173 26800 raft_consensus.cc:3055] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:41.545347 26800 raft_consensus.cc:740] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:41.493896 27023 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:41.546696 26800 consensus_queue.cc:260] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:41.548414 26800 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:41.548851 27023 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:41.549454 27242 consensus_queue.cc:1175] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" responder_term: 10 status { last_received { term: 10 index: 7 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:11:41.537344 27217 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:41.551587 27217 consensus_queue.cc:1059] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:41.551875 23088 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:41.539397 22496 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:41.510725 27259 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:41.552989 27029 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:41.554278 27210 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:41.554319 27259 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:41.554908 27145 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:41.515045 27364 consensus_queue.cc:1048] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 12:11:41.557655 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:41.557773 27365 consensus_queue.cc:1048] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 12:11:41.558344 27054 raft_consensus.cc:2749] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:41.563122 27145 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:41.563872 27238 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:41.564579 27054 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.574215 27054 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:41.564651 27354 raft_consensus.cc:3055] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:41.575253 27354 raft_consensus.cc:740] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:41.576107 27354 consensus_queue.cc:260] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:41.577229 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:41.577523 27354 raft_consensus.cc:3060] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:41.559571 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 173703us
I20260709 12:11:41.519393 27222 raft_consensus.cc:2804] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:41.583415 27222 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:41.583803 27222 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:41.584820 26074 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:41.585340 26074 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:41.587736 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 402403us
I20260709 12:11:41.588488 22422 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
W20260709 12:11:41.590313 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:41.590708 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.591005 22598 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:41.591871 27250 raft_consensus.cc:2804] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:41.592715 27250 raft_consensus.cc:697] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 13 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:41.593850 27250 consensus_queue.cc:237] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:41.569656 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.570763 27352 consensus_queue.cc:1048] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:41.572110 27125 raft_consensus.cc:993] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc: : Instructing follower c863116d91c14d1ca50d6e8a46a37a8f to start an election
I20260709 12:11:41.572263 27366 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:41.572851 27087 raft_consensus.cc:2804] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:41.573048 22495 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:41.601902 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 324947us
W20260709 12:11:41.602550 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:41.604003 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.604511 26074 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:41.605818 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 81178.4us
W20260709 12:11:41.624141 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:41.609268 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.626597 26074 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.626833 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:41.627143 26074 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:41.633844 22421 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:41.634527 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:41.635602 22450 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:41.637665 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:41.639657 22570 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:41.641661 22496 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:41.585347 27054 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:41.606076 26920 raft_consensus.cc:2749] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:41.620677 27023 raft_consensus.cc:1081] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Signalling peer c863116d91c14d1ca50d6e8a46a37a8f to start an election
W20260709 12:11:41.650111 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 77132us
I20260709 12:11:41.638449 22457 raft_consensus.cc:2468] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11.
I20260709 12:11:41.617863 27366 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:41.622449 27087 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:41.644320 27217 raft_consensus.cc:2749] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:41.659300 26074 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:41.662726 22569 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:41.665403 22496 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
W20260709 12:11:41.666862 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 115081us
I20260709 12:11:41.652737 27242 raft_consensus.cc:2749] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:41.655880 27087 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:41.674124 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 48681.1us
I20260709 12:11:41.652594 27366 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:41.675545 22598 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 14.
W20260709 12:11:41.676179 27051 consensus_meta.cc:287] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.515s	user 0.011s	sys 0.000s
I20260709 12:11:41.679080 22496 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:41.661763 27125 raft_consensus.cc:2749] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:41.686136 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:41.661477 27123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:34440 (request call id 16) took 5868 ms. Trace:
I20260709 12:11:41.689915 22421 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:41.683504 27363 raft_consensus.cc:2749] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:41.673681 27341 raft_consensus.cc:2804] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:41.699280 27341 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:41.699659 27341 raft_consensus.cc:3060] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:41.703198 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 46905.4us
I20260709 12:11:41.707190 27362 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:41.688421 27054 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:41.708431 27054 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:41.709519 27362 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:41.669659 27111 raft_consensus.cc:2749] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:41.685894 27119 raft_consensus.cc:2804] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:41.711452 27119 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:41.711814 27119 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:41.714622 22570 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:41.717166 22528 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11.
I20260709 12:11:41.722095 23088 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:41.722862 22450 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:11:41.726797 23089 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:41.730563 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:41.731907 27104 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:41.721221 27363 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.741673 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:41.747005 23121 raft_consensus.cc:2393] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 13: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:41.748379 22454 raft_consensus.cc:1275] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:11:41.750973 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:41.751603 23123 raft_consensus.cc:1240] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:41.754132 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:41.742308 27365 consensus_queue.cc:1059] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 12:11:41.755275 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:41.756578 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:41.756747 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:11:41.756878 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 67036us
I20260709 12:11:41.757900 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:41.758121 23120 raft_consensus.cc:1240] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:41.758428 22421 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:41.758665 22531 raft_consensus.cc:2393] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 14: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:41.759243 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:41.710906 27054 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:41.761412 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:41.763548 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:41.764207 22454 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:41.757161 22527 raft_consensus.cc:2376] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 14. Re-sending same reply.
I20260709 12:11:41.745595 27051 raft_consensus.cc:2804] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:41.766829 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:41.770499 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 99969.1us
W20260709 12:11:41.771283 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 92976.3us
I20260709 12:11:41.748070 26801 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:41.775357 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:41.777477 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:41.715212 27345 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:41.763557 27259 raft_consensus.cc:2749] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:41.767777 27111 raft_consensus.cc:2804] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:41.791313 27111 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:41.791811 27111 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:41.792758 27222 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:41.793936 23120 raft_consensus.cc:1240] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:11:41.777266 27051 raft_consensus.cc:697] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 14 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:41.713136 27123 rpcz_store.cc:276] 0709 12:11:35.783624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.835044 (+ 51420us) service_pool.cc:224] Handling call
0709 12:11:36.378536 (+543492us) log.cc:844] Serialized 513 byte log entry
0709 12:11:37.465651 (+1087115us) spinlock_profiling.cc:243] Waited 4.9 ms on lock 0x7b18002a4e40. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc77bbc0a 00007f9cd0efb219 00007f9cc7843a40 00007f9cc783e4e4 00007f9cc783e455 00007f9cca887b0b 00007f9cca90cb63 00007f9cca934752 00007f9ccf8f4d29
0709 12:11:41.644857 (+4179206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":465814,"raft.queue_time_us":503533,"raft.run_cpu_time_us":1569,"raft.run_wall_time_us":32071,"spinlock_wait_cycles":11281280,"thread_start_us":496939,"threads_started":1,"wal-append.queue_time_us":767936,"wal-append.run_cpu_time_us":3913,"wal-append.run_wall_time_us":1305155}
I20260709 12:11:41.796355 27051 consensus_queue.cc:237] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:41.799566 27104 raft_consensus.cc:2749] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:41.755278 27087 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:41.801474 22527 raft_consensus.cc:1275] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:41.801297 26801 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:41.801687 27087 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:41.803478 26801 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:41.774394 27377 raft_consensus.cc:2749] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:41.806720 27341 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:41.779026 22448 raft_consensus.cc:1275] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 13 index: 13. (term mismatch)
I20260709 12:11:41.778923 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:41.807718 22421 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:41.784379 22570 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:41.266073 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:41.751407 27352 consensus_queue.cc:1048] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:11:41.778892 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:41.822358 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:41.823470 22528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56942 (request call id 2005) took 1083 ms. Trace:
I20260709 12:11:41.824038 27242 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:41.815239 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:41.811343 22454 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
I20260709 12:11:41.826202 27222 leader_election.cc:290] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:41.826880 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:11:41.828243 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 144032us
I20260709 12:11:41.829939 22525 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 16.
I20260709 12:11:41.830838 22528 rpcz_store.cc:276] 0709 12:11:40.740380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.351829 (+611449us) service_pool.cc:224] Handling call
0709 12:11:41.823301 (+471472us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b54003903d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:41.823407 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":760644992}
I20260709 12:11:41.829680 22448 pending_rounds.cc:85] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f: Aborting all ops after (but not including) 12
I20260709 12:11:41.840098 22448 pending_rounds.cc:107] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f: Aborting uncommitted NO_OP operation due to leader change: 12.13
I20260709 12:11:41.840359 22448 raft_consensus.cc:2889] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:41.840811 23116 raft_consensus.cc:2368] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 11. Current term is 12.
I20260709 12:11:41.843358 23088 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:41.846504 22603 raft_consensus.cc:2393] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 12: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:41.848487 22455 raft_consensus.cc:2393] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 11: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
W20260709 12:11:41.851634 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 44022us
I20260709 12:11:41.852027 27355 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:41.852415 22421 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:41.853817 22421 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:41.854387 27355 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:41.855288 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 70985.8us
I20260709 12:11:41.856061 22570 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:41.857560 22570 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:41.858028 27022 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:41.858318 27362 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.859143 27104 raft_consensus.cc:2749] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:41.859334 27362 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:41.860918 27104 raft_consensus.cc:2804] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:41.861310 27104 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:41.861646 27104 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:41.862280 27362 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:41.786491 27363 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:41.863371 27345 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:41.865880 27363 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:41.866091 27054 raft_consensus.cc:3055] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:41.866662 27054 raft_consensus.cc:740] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:41.867285 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:41.867889 22531 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 12.
I20260709 12:11:41.869907 27266 raft_consensus.cc:2749] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:41.847604 27269 raft_consensus.cc:2764] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:11:41.844908 27242 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:41.848300 27259 raft_consensus.cc:2749] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:41.872655 27225 raft_consensus.cc:3055] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:41.873683 22526 raft_consensus.cc:2393] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 11: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:41.810906 27111 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:41.880070 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:41.883730 27269 raft_consensus.cc:2749] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:41.882817 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:41.886052 27217 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.886636 27217 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:41.887326 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:41.888154 27341 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:41.888720 27217 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:41.882073 27123 raft_consensus.cc:2804] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:41.889497 27123 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:41.889866 27123 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:41.890605 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:41.842669 27119 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:41.873186 27225 raft_consensus.cc:740] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:41.910883 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:41.915225 27242 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:41.919548 22600 raft_consensus.cc:1240] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:41.867637 27054 consensus_queue.cc:260] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:41.921355 26976 consensus_queue.cc:1059] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:41.921868 27054 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:41.923120 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 81151.5us
W20260709 12:11:41.925443 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 71705.6us
I20260709 12:11:41.927920 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:41.922627 27269 raft_consensus.cc:3055] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:41.930567 23088 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:41.933140 22496 leader_election.cc:400] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 election: Vote denied by peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353) with higher term. Message: Invalid argument: T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 11. Current term is 12.
I20260709 12:11:41.937037 22496 leader_election.cc:403] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:11:41.941772 26801 consensus_queue.cc:1059] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:41.862243 27366 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:41.944907 23088 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:41.895901 27352 consensus_queue.cc:1059] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:11:41.935057 27269 raft_consensus.cc:740] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:41.944432 27282 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:41.960983 22570 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:41.929768 26770 consensus_queue.cc:1059] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:11:41.967617 22495 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:41.971378 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:41.969309 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:41.973253 27370 raft_consensus.cc:2804] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:41.973752 27359 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.973868 27370 raft_consensus.cc:697] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 14 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:41.974274 27359 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:41.975085 22597 raft_consensus.cc:1240] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:41.974857 27370 consensus_queue.cc:237] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:41.976588 27359 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:41.984548 22600 raft_consensus.cc:1275] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:41.990998 27022 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:41.964757 27225 consensus_queue.cc:260] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:41.992669 27225 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:41.995126 27201 consensus_queue.cc:1175] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8701cd5186a949538d8efafb5f987270" responder_term: 8 status { last_received { term: 8 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 8 index: 8 } }
I20260709 12:11:41.996533 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:41.996860 27111 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:41.997215 22599 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 16.
I20260709 12:11:41.963310 27259 raft_consensus.cc:2749] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:41.998250 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:42.004578 27123 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:42.008272 27366 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:42.009117 27243 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:42.009683 27243 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:42.010877 27269 consensus_queue.cc:260] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:42.011472 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 43941.6us
I20260709 12:11:42.011759 27243 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:42.012149 27269 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:42.012326 22495 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:41.973467 27119 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:42.016350 27377 consensus_queue.cc:1048] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:42.019186 27352 raft_consensus.cc:2749] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:42.019853 27352 raft_consensus.cc:2749] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:42.020802 26770 raft_consensus.cc:3055] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:42.020665 27055 consensus_queue.cc:1059] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:42.022334 27055 raft_consensus.cc:3055] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:42.024144 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:42.025357 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:42.025890 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:42.026443 26976 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.026950 26976 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:42.028981 26976 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:42.021142 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 66281.6us
W20260709 12:11:42.032384 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 71516.2us
I20260709 12:11:42.035439 27243 raft_consensus.cc:2749] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:42.036460 22421 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:42.036854 27259 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.021332 26770 raft_consensus.cc:740] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:42.038394 26976 raft_consensus.cc:2749] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:42.038609 26770 consensus_queue.cc:260] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:42.039816 22448 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
 from {username='slave'} at 127.0.0.1:51836
I20260709 12:11:42.039749 27104 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:42.037376 27259 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:42.040740 22448 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:42.041225 22448 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.042215 27104 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:42.043027 27259 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:42.043677 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:42.044374 22602 raft_consensus.cc:2368] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 12. Current term is 13.
W20260709 12:11:42.045877 27372 log.cc:927] Time spent T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.218s	user 0.003s	sys 0.000s
I20260709 12:11:42.047200 27354 raft_consensus.cc:3055] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:42.047590 27354 raft_consensus.cc:740] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:42.049710 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:42.050412 27119 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:42.040133 26770 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:42.050659 22454 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:11:42.051055 27119 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:42.022862 27055 raft_consensus.cc:740] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:41.973379 22449 raft_consensus.cc:2368] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 12. Current term is 13.
I20260709 12:11:42.006807 27123 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:42.054731 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:42.056702 22452 raft_consensus.cc:3060] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:42.056815 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:42.057013 27354 consensus_queue.cc:260] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:42.057894 22598 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
I20260709 12:11:42.059690 27055 consensus_queue.cc:260] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:42.063047 27055 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.108721 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:42.072155 22495 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:42.072587 27111 consensus_queue.cc:1048] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:42.082078 22497 leader_election.cc:400] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 election: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 12. Current term is 13.
I20260709 12:11:42.109838 22497 leader_election.cc:403] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:11:42.110262 22495 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:42.111825 22495 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:42.083325 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:42.083422 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:42.084756 22421 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:42.053247 27119 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:42.085691 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 112965us
I20260709 12:11:42.086228 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:42.113942 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:42.113039 22600 raft_consensus.cc:2393] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 13: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
W20260709 12:11:42.088599 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.115424 22569 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:42.058190 27354 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:42.113425 22448 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:42.127394 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:42.128031 22528 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
I20260709 12:11:42.090917 27282 raft_consensus.cc:2749] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353) with higher term. Message: Invalid argument: T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 11. Current term is 12.
I20260709 12:11:42.100354 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:42.101581 23124 raft_consensus.cc:1275] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:11:42.095068 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:42.148697 22527 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:11:42.091887 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:42.092797 23122 raft_consensus.cc:1240] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:42.093217 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:42.105916 22422 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:42.106966 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:42.150504 23125 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:42.150774 22453 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.095609 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:42.049925 22524 raft_consensus.cc:2468] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 9.
I20260709 12:11:42.113034 22452 raft_consensus.cc:2468] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
I20260709 12:11:42.114490 23123 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.087627 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:11:42.151656 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 113926us
I20260709 12:11:42.152505 22525 raft_consensus.cc:1240] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 13. Current term is 14. Ops: [13.8-13.8]
W20260709 12:11:42.150044 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 68188.6us
W20260709 12:11:42.154253 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 48461.8us
I20260709 12:11:42.147713 23118 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
I20260709 12:11:42.152352 23116 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 13.
I20260709 12:11:42.098556 27259 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.156430 22448 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:42.158392 27362 consensus_queue.cc:1048] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:11:42.126212 27352 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:42.175745 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:42.176548 23116 raft_consensus.cc:2393] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 10: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:42.177505 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:42.178224 23116 raft_consensus.cc:2393] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 12: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:42.126397 27250 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:42.161026 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:42.161480 26976 raft_consensus.cc:2804] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:42.156884 27119 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.154284 27341 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:42.163357 22421 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:42.163864 27051 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.149276 22495 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:42.156839 27243 consensus_queue.cc:1048] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:11:42.173202 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:42.173673 27259 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:42.179643 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:42.179963 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:42.203771 22496 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:42.203471 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:42.214389 22532 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.175789 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:42.215108 23122 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:11:42.204949 22528 raft_consensus.cc:1240] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:11:42.219877 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:42.187376 23123 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 13.
I20260709 12:11:42.299880 23124 raft_consensus.cc:1240] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 12. Current term is 13. Ops: []
W20260709 12:11:42.301152 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 149345us
I20260709 12:11:42.182055 22600 raft_consensus.cc:3055] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:42.178948 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:42.181281 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:42.155468 27201 raft_consensus.cc:2804] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:42.170444 27242 raft_consensus.cc:2749] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:42.203231 26976 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.307868 22453 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 13.
W20260709 12:11:42.240758 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 91565.9us
I20260709 12:11:42.231419 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:42.308974 23119 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 15.
I20260709 12:11:42.179183 27250 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:42.254130 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:42.253556 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:42.242208 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:42.258909 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:42.254069 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:42.261155 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:42.240736 27051 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:42.181046 27111 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.315826 27111 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:42.253247 27123 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:42.312093 27145 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.317565 27145 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:42.319948 27145 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:42.311831 27250 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:42.324560 22350 catalog_manager.cc:5697] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 9 to 10, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 10 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:11:42.326421 22350 catalog_manager.cc:5697] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 9 to 10, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 10 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:11:42.327804 27201 raft_consensus.cc:697] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:42.211351 27355 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.331773 22530 raft_consensus.cc:1275] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:11:42.336391 22531 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
I20260709 12:11:42.336817 22454 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:11:42.304111 23120 raft_consensus.cc:1275] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:42.186484 23125 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11.
I20260709 12:11:42.301749 22600 raft_consensus.cc:740] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:42.308974 22495 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:42.261212 26801 raft_consensus.cc:2749] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:42.310436 22525 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 10.
W20260709 12:11:42.312500 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 149240us
I20260709 12:11:42.305351 27341 raft_consensus.cc:697] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
W20260709 12:11:42.314116 22403 auto_rebalancer.cc:629] Failed to schedule move for tablet 88417720c1014406ad04d7fb6b8f7ab4: Illegal state: Replica c863116d91c14d1ca50d6e8a46a37a8f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:11:42.314960 22526 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:42.315084 27282 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.210548 22570 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:42.333117 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:42.303875 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 60914.6us
I20260709 12:11:42.344919 22524 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.348388 27341 consensus_queue.cc:237] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:42.346474 23118 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
W20260709 12:11:42.358587 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 49698us
I20260709 12:11:42.359733 22495 leader_election.cc:400] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 election: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 12. Current term is 13.
I20260709 12:11:42.360772 22495 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:42.312407 26976 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.364753 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:11:42.362279 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 48705.8us
I20260709 12:11:42.380828 23123 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
I20260709 12:11:42.373993 22526 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11.
I20260709 12:11:42.381757 27250 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:42.363503 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 159354us
I20260709 12:11:42.384225 27250 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:42.383832 22570 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:42.386300 22496 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:42.369199 22421 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:42.343524 27354 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.333606 27111 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:42.393323 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:42.396955 27250 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.400054 27087 raft_consensus.cc:2804] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:42.400265 27345 raft_consensus.cc:2804] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:42.424161 27345 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:42.424750 27345 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:42.401060 27242 raft_consensus.cc:3055] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:42.427187 27242 raft_consensus.cc:740] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:42.428337 27242 consensus_queue.cc:260] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:42.404680 22421 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:42.429898 27111 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:42.430361 27111 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:42.431078 27111 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:42.407474 22524 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:11:42.431641 27250 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:42.435951 22532 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:11:42.430336 22421 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:42.389490 22600 consensus_queue.cc:260] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:42.439842 22600 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.439698 22421 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:42.386116 27266 raft_consensus.cc:2804] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:42.392572 27352 raft_consensus.cc:2749] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:42.393927 27055 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:42.333969 27355 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:42.471056 27123 raft_consensus.cc:2749] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:42.421432 27087 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.473140 27266 raft_consensus.cc:697] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:42.359846 27282 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:42.471773 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 88047.2us
I20260709 12:11:42.486635 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:42.493752 22454 raft_consensus.cc:2393] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 14: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
W20260709 12:11:42.487396 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 185593us
I20260709 12:11:42.445091 26770 raft_consensus.cc:2764] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:11:42.328883 27201 consensus_queue.cc:237] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:42.449165 27377 raft_consensus.cc:2804] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:42.454000 27269 raft_consensus.cc:2804] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:42.496061 22569 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:42.502557 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:42.502784 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 116544us
I20260709 12:11:42.503229 22453 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 11.
I20260709 12:11:42.420989 27354 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:42.497617 22570 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:42.507045 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:42.507889 22454 raft_consensus.cc:2410] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:11:42.507833 22569 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:42.493445 27087 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:42.514521 27023 raft_consensus.cc:2749] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:42.516414 27104 raft_consensus.cc:2804] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:42.517904 27104 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.518258 27104 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:42.523594 27354 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:42.524796 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:42.525241 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:42.525497 23118 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
I20260709 12:11:42.511377 23116 raft_consensus.cc:1240] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:11:42.498510 27377 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:42.526645 27377 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.328218 22350 catalog_manager.cc:5697] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 5 to 8, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 8 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:11:42.527262 22496 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:42.528180 27125 raft_consensus.cc:2804] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:42.527711 22350 catalog_manager.cc:5697] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:42.528676 27354 raft_consensus.cc:2804] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:42.529094 27354 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.529448 27051 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:42.529458 27354 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:42.529907 22350 catalog_manager.cc:5697] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:11:42.492165 27362 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.449019 27110 consensus_queue.cc:1048] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
W20260709 12:11:42.526197 22353 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55962 (request call id 344) took 20285 ms (client timeout 15000 ms). Trace:
I20260709 12:11:42.534346 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:42.548998 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:42.525831 22602 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
I20260709 12:11:42.538486 22453 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:42.534080 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:11:42.561291 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 52505.6us
I20260709 12:11:42.559816 22604 raft_consensus.cc:2393] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 14: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
W20260709 12:11:42.566120 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 125324us
I20260709 12:11:42.562554 22569 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:42.494690 27250 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:42.580920 22455 raft_consensus.cc:1240] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:42.584134 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 196355us
I20260709 12:11:42.522651 26976 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:42.528697 27125 raft_consensus.cc:697] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 12 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:42.525830 27259 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:42.584818 22495 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:42.509497 27269 raft_consensus.cc:697] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 9 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:42.533052 27282 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:42.596994 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 82850.1us
I20260709 12:11:42.595098 22453 raft_consensus.cc:1275] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:42.576927 27217 raft_consensus.cc:2749] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:42.601296 26801 raft_consensus.cc:2804] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:42.601773 22532 raft_consensus.cc:1240] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:42.601854 26801 raft_consensus.cc:697] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:42.600173 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:42.605227 22455 raft_consensus.cc:2393] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 11: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:42.606514 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:42.607331 22524 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 11.
I20260709 12:11:42.516774 27023 consensus_queue.cc:1059] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 2, Time since last communication: 0.081s
I20260709 12:11:42.610828 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:42.618144 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:42.619175 22524 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:42.620160 22454 raft_consensus.cc:2368] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 12. Current term is 13.
I20260709 12:11:42.625376 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:42.627130 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:42.627769 22526 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 11.
W20260709 12:11:42.624923 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 62492.1us
I20260709 12:11:42.632359 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:42.634572 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:42.636574 22531 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 12.
I20260709 12:11:42.630956 23089 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:42.577883 27362 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:42.645018 27362 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:42.645716 22524 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 14.
I20260709 12:11:42.646585 22600 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 13.
I20260709 12:11:42.647413 27125 consensus_queue.cc:237] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:42.650686 22526 raft_consensus.cc:1275] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:42.631264 27283 raft_consensus.cc:2804] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:42.651352 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:42.651782 27283 raft_consensus.cc:697] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:42.651957 22530 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 11.
I20260709 12:11:42.652746 27283 consensus_queue.cc:237] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:42.654306 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:42.603024 26801 consensus_queue.cc:237] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:42.654992 22451 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 10.
I20260709 12:11:42.656265 22452 raft_consensus.cc:1275] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:42.640946 27111 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:42.643254 27051 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:42.535583 27266 consensus_queue.cc:237] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:42.682622 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:42.659050 22524 raft_consensus.cc:1275] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:42.685634 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:42.638305 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:42.659277 22453 raft_consensus.cc:2393] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 12: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:42.686537 22422 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:42.694706 27055 raft_consensus.cc:2749] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:42.663640 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:42.695461 27055 raft_consensus.cc:2804] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:42.695924 27055 raft_consensus.cc:697] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 13 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:42.696403 27269 consensus_queue.cc:237] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:42.663192 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 62878.4us
I20260709 12:11:42.668450 22452 raft_consensus.cc:1240] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:42.659966 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:42.630710 27403 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.664830 23088 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:42.654304 27119 raft_consensus.cc:2749] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 12. Current term is 13.
I20260709 12:11:42.690426 22451 raft_consensus.cc:2393] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 14: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:42.692353 26976 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:42.692245 27282 consensus_queue.cc:1048] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:42.695107 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:42.679363 27051 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:42.700938 22450 raft_consensus.cc:1240] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:42.701989 22570 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:42.725879 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 61159.3us
I20260709 12:11:42.728099 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:42.733477 23088 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:42.729454 27111 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:42.729717 22603 raft_consensus.cc:1275] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:42.676688 27110 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.731352 22602 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.699827 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:42.728897 22601 raft_consensus.cc:1240] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 12 LEADER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:42.702033 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:42.696769 27055 consensus_queue.cc:237] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:42.746887 23088 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:42.739807 22570 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:42.748947 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:42.751056 22597 raft_consensus.cc:1240] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:42.724380 27023 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.698760 22350 catalog_manager.cc:5697] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 7 to 8, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 8 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:42.731978 27054 raft_consensus.cc:2804] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:42.687337 27222 consensus_queue.cc:1059] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 12:11:42.736892 27051 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:42.690954 27087 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:42.558714 22353 rpcz_store.cc:269] 0709 12:11:22.246173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.246432 (+   259us) service_pool.cc:224] Handling call
0709 12:11:42.525962 (+20279530us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:35.495326 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:35.589345 (+ 94019us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:35.589414 (+    69us) write_op.cc:435] Acquired schema lock
0709 12:11:35.589440 (+    26us) tablet.cc:662] Decoding operations
0709 12:11:35.708019 (+118579us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:35.708116 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:35.708142 (+    26us) tablet.cc:685] Acquiring locks for 19 operations
0709 12:11:35.709790 (+  1648us) tablet.cc:701] Row locks acquired
0709 12:11:35.709835 (+    45us) write_op.cc:260] PREPARE: finished
0709 12:11:35.709998 (+   163us) write_op.cc:270] Start()
0709 12:11:35.710134 (+   136us) write_op.cc:276] Timestamp: P: 1783599095709939 usec, L: 0
0709 12:11:35.710149 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 12:11:35.766924 (+ 56775us) log.cc:844] Serialized 7514 byte log entry
0709 12:11:37.385599 (+1618675us) op_driver.cc:464] REPLICATION: finished
0709 12:11:38.678072 (+1292473us) spinlock_profiling.cc:243] Waited 7.86 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cc78240ac 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc7840c02 00007f9cce364ef0
0709 12:11:39.241299 (+563227us) write_op.cc:301] APPLY: starting
0709 12:11:39.252193 (+ 10894us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:39.430774 (+178581us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:39.430801 (+    27us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:40.110009 (+679208us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:40.110337 (+   328us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 12:11:40.110389 (+    52us) write_op.cc:312] APPLY: finished
0709 12:11:40.110823 (+   434us) log.cc:844] Serialized 172 byte log entry
0709 12:11:40.275800 (+164977us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:40.275998 (+   198us) write_op.cc:454] Released schema lock
0709 12:11:40.276057 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:40.276484 (+   427us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:40.276522 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1684714,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":1790988,"apply.run_cpu_time_us":72661,"apply.run_wall_time_us":1045222,"cfile_cache_hit":78,"cfile_cache_hit_bytes":83547,"num_ops":19,"prepare.queue_time_us":175737,"prepare.run_cpu_time_us":33092,"prepare.run_wall_time_us":561152,"raft.queue_time_us":253244,"raft.run_cpu_time_us":64695,"raft.run_wall_time_us":1872072,"replication_time_us":1640980,"spinlock_wait_cycles":18080512,"thread_start_us":2254763,"threads_started":5,"wal-append.queue_time_us":1143151,"wal-append.run_cpu_time_us":21465,"wal-append.run_wall_time_us":2513231}]]}
I20260709 12:11:42.761349 22452 raft_consensus.cc:1240] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:42.753593 27355 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:42.751678 27023 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:42.730765 27403 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:42.757128 27054 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:42.737119 27404 consensus_queue.cc:1059] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:11:42.776516 27054 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:42.777312 27404 raft_consensus.cc:3055] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:42.777781 27404 raft_consensus.cc:740] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:42.766470 27409 raft_consensus.cc:2749] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:42.760377 27370 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:42.785926 22523 raft_consensus.cc:2393] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 12: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:42.766965 27259 raft_consensus.cc:2804] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:42.749399 27110 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:42.771726 27125 raft_consensus.cc:2804] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:42.798394 22455 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 16.
I20260709 12:11:42.797416 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:42.798406 27125 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:42.799865 27125 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:42.800621 22350 catalog_manager.cc:5697] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 6 to 9, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 9 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:11:42.804745 22602 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 13.
W20260709 12:11:42.806077 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 57052.1us
I20260709 12:11:42.806926 22570 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:42.789740 27259 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.811578 27282 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.812489 27110 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:42.815662 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:42.816200 27087 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:42.817096 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:42.835625 22449 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:42.835553 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:42.818099 27023 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:42.787019 27355 consensus_queue.cc:1048] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:11:42.819392 22467 tablet_copy_service.cc:140] P c863116d91c14d1ca50d6e8a46a37a8f: Received BeginTabletCopySession request for tablet 82e7db06c6ff4d96853c60f0f42c09a8 from peer 8701cd5186a949538d8efafb5f987270 ({username='slave'} at 127.0.0.1:34452)
W20260709 12:11:42.822242 27393 log.cc:927] Time spent T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.433s	user 0.002s	sys 0.000s
I20260709 12:11:42.778779 27404 consensus_queue.cc:260] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:42.823350 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:42.844014 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 113674us
I20260709 12:11:42.823556 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:42.844820 22456 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:11:42.827831 22570 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:42.826028 27243 raft_consensus.cc:2804] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:42.839680 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:42.836740 22451 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 13: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:42.847069 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:11:42.851900 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 105096us
I20260709 12:11:42.852012 22570 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:42.852612 23088 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:42.830040 27259 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:42.853056 23125 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:42.855944 27415 raft_consensus.cc:2804] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:42.856563 27415 raft_consensus.cc:697] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 13 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:42.860044 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:42.861438 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:42.864331 22454 raft_consensus.cc:2393] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 14: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:42.865330 22457 raft_consensus.cc:1240] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:11:42.866565 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:42.867617 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:42.871743 22454 raft_consensus.cc:2368] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 12. Current term is 13.
W20260709 12:11:42.871822 22495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.877154 23125 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 12.
I20260709 12:11:42.880999 23088 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:42.878763 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:42.882586 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:42.883247 22530 raft_consensus.cc:1240] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 LEADER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:42.837245 27354 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:42.858911 27023 raft_consensus.cc:2804] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:42.838845 27282 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:42.897207 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:42.898150 22526 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
I20260709 12:11:42.841502 27377 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:42.802639 22350 catalog_manager.cc:5697] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:11:42.853856 27362 consensus_queue.cc:1059] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:11:42.930186 22525 raft_consensus.cc:1275] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:42.930552 27354 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:42.931456 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:42.931507 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:42.932236 22528 raft_consensus.cc:2368] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 11. Current term is 12.
I20260709 12:11:42.932595 22526 raft_consensus.cc:2393] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 14: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:42.853967 22467 tablet_copy_service.cc:161] P c863116d91c14d1ca50d6e8a46a37a8f: Beginning new tablet copy session on tablet 82e7db06c6ff4d96853c60f0f42c09a8 from peer 8701cd5186a949538d8efafb5f987270 at {username='slave'} at 127.0.0.1:34452: session id = 8701cd5186a949538d8efafb5f987270-82e7db06c6ff4d96853c60f0f42c09a8
I20260709 12:11:42.858651 27222 consensus_queue.cc:1059] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:11:42.904183 27283 consensus_queue.cc:1059] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 12:11:42.911620 22350 catalog_manager.cc:5697] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 6 to 10, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 10 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:42.913193 27125 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:42.914342 27282 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:42.891855 27243 raft_consensus.cc:697] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:42.904808 27403 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:42.917241 27242 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:42.851187 27370 consensus_queue.cc:1048] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 12:11:42.919272 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:42.919905 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:42.975703 22530 raft_consensus.cc:2468] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 10.
I20260709 12:11:42.976675 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:42.920516 27415 consensus_queue.cc:237] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:42.921072 27377 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:42.923856 27051 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:42.925791 22449 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 12.
I20260709 12:11:42.938791 22456 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 12.
W20260709 12:11:42.984498 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 79838.2us
I20260709 12:11:42.954293 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:42.985311 23125 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:42.954900 22454 raft_consensus.cc:1275] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:42.958423 22527 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:11:42.865239 27345 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:42.969998 27414 log.cc:927] Time spent T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:11:42.905530 27023 raft_consensus.cc:697] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:42.878813 27104 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:42.995064 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:42.978576 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:42.979480 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:42.981389 22530 raft_consensus.cc:2393] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 12: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:42.948089 22570 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:42.985780 22495 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:42.993950 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:42.993954 22421 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:42.994927 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:42.978044 27422 consensus_queue.cc:1048] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:42.999997 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:43.000312 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:43.002631 22530 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.003867 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:43.004509 22454 raft_consensus.cc:2393] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 11: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:43.004659 22449 raft_consensus.cc:2393] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 14: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
W20260709 12:11:42.999949 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 52039.8us
I20260709 12:11:43.006688 22457 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 13.
I20260709 12:11:43.008399 22495 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:43.009960 22606 raft_consensus.cc:1240] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:43.009974 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:43.016412 22456 raft_consensus.cc:2393] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 12: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:43.018505 22421 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:43.019387 27403 raft_consensus.cc:2749] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:43.019887 22421 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:43.021013 27403 raft_consensus.cc:2749] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:43.021500 22421 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:43.022279 27403 raft_consensus.cc:2749] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:43.023597 22421 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:43.024324 26976 raft_consensus.cc:2749] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:42.981971 27424 raft_consensus.cc:2804] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:43.038444 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:11:43.033494 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 66261.8us
I20260709 12:11:43.049077 22454 raft_consensus.cc:1240] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:43.049449 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:43.051118 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:43.028460 22570 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:43.009692 27282 raft_consensus.cc:2804] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:43.026892 22421 leader_election.cc:400] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 11. Current term is 12.
I20260709 12:11:43.027776 27354 raft_consensus.cc:2804] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:43.058660 27355 raft_consensus.cc:2749] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:43.058723 27395 consensus_queue.cc:1059] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:11:43.091866 22528 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 16.
I20260709 12:11:43.096935 22523 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
I20260709 12:11:43.005373 27283 raft_consensus.cc:2804] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:43.000713 27222 consensus_queue.cc:1048] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 12:11:43.063324 22442 tablet_service.cc:1558] Processing DeleteTablet for tablet 263d51d0b43744d899e37466045af890 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 5 (current committed config index is 7)) from {username='slave'} at 127.0.0.1:51832
I20260709 12:11:43.026695 26976 consensus_queue.cc:1048] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:11:42.997243 27418 raft_consensus.cc:2804] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:43.068213 22421 leader_election.cc:403] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:43.070134 22570 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:43.072255 27425 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.074194 22467 tablet_copy_source_session.cc:215] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:11:43.075232 22403 auto_rebalancer.cc:629] Failed to schedule move for tablet ee8d73c903fd41f7b207be9ca1cada33: Illegal state: Replica 6c6fa11e8ee34711b3551f0c670442bc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:11:43.076493 27405 raft_consensus.cc:3055] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:43.077752 22457 raft_consensus.cc:1275] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:43.078158 27404 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:43.083088 27266 consensus_queue.cc:1059] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:43.050083 27417 consensus_queue.cc:1048] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 12:11:43.084484 27125 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:43.057881 23125 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 12.
I20260709 12:11:43.103621 22530 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 13.
I20260709 12:11:43.152128 27125 consensus_queue.cc:1048] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:43.153867 27426 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.050858 27377 raft_consensus.cc:2749] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:43.107524 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:43.113168 27418 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.111763 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:11:43.113255 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 86495.3us
I20260709 12:11:43.115935 27409 raft_consensus.cc:3055] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:43.116180 27051 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:43.102084 27424 raft_consensus.cc:697] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 12 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:43.116819 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:11:43.114584 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 44563.5us
I20260709 12:11:43.126756 27405 raft_consensus.cc:740] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:43.129925 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:43.172479 22597 raft_consensus.cc:2410] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 17 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 13.
I20260709 12:11:43.131484 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:43.087790 27354 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.135630 23119 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.138216 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:43.144114 27362 raft_consensus.cc:3055] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:43.146821 22497 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:43.147224 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:43.180456 22598 raft_consensus.cc:2393] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 16: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:43.148084 26770 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.103966 27282 raft_consensus.cc:697] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:43.107574 27283 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:43.156556 23120 raft_consensus.cc:1275] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:43.158849 22528 raft_consensus.cc:2393] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 12: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:43.110550 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:43.160778 22526 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.161134 23125 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.162842 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:43.128399 27110 raft_consensus.cc:2749] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 11. Current term is 12.
I20260709 12:11:43.105916 27370 consensus_queue.cc:1059] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
W20260709 12:11:43.166320 23087 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.511s (SENT) [suppressed 47 similar messages]
I20260709 12:11:43.133790 27395 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.136840 27355 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:43.169641 22570 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:43.122448 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:43.165659 27418 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:43.154577 27266 consensus_queue.cc:1243] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer 1676e7af5e4a47cb86ee7db83e3d4881 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:43.258688 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:43.173277 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:43.185541 23121 raft_consensus.cc:2368] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 11. Current term is 12.
I20260709 12:11:43.182003 22523 raft_consensus.cc:2955] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:11:43.251938 23123 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 12.
I20260709 12:11:43.181471 27354 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:43.172441 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:43.262676 23118 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
I20260709 12:11:43.165112 27409 raft_consensus.cc:740] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:43.128160 27425 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:43.253255 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 83696.4us
I20260709 12:11:43.183218 22421 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:43.085266 27243 consensus_queue.cc:237] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:43.257584 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:43.262794 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:11:43.261195 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 127136us
I20260709 12:11:43.262771 23117 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 13.
I20260709 12:11:43.252878 27355 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.310665 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:43.181514 27362 raft_consensus.cc:740] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
W20260709 12:11:43.270469 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 87360.6us
I20260709 12:11:43.311462 23118 raft_consensus.cc:2393] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 10: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:43.308189 23122 raft_consensus.cc:2410] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 17 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 13.
I20260709 12:11:43.185635 27119 raft_consensus.cc:2749] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:43.268718 27283 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:43.312453 22421 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:43.161441 27426 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:43.259713 27142 raft_consensus.cc:2804] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:43.168896 27023 consensus_queue.cc:237] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:43.320075 22421 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:43.266939 27400 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:43.311455 27055 raft_consensus.cc:2749] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:43.320587 27403 raft_consensus.cc:2749] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:43.321259 27142 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.324250 27359 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.257791 27395 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:43.327353 27110 raft_consensus.cc:2749] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 13 LEADER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:43.329145 27282 consensus_queue.cc:237] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:43.331040 27425 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:43.338887 23125 raft_consensus.cc:1275] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:43.188599 26770 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:43.316527 27355 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:43.340859 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 174553us
I20260709 12:11:43.350214 22526 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 13.
I20260709 12:11:43.336229 27104 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:43.343321 22421 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:43.343405 27142 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:43.369338 22421 leader_election.cc:400] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Vote denied by peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353) with higher term. Message: Invalid argument: T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 11. Current term is 12.
I20260709 12:11:43.370151 23087 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:43.367146 27362 consensus_queue.cc:260] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:43.377791 22531 raft_consensus.cc:2410] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:11:43.383574 23087 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:43.368440 27403 raft_consensus.cc:2749] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:43.322059 27405 consensus_queue.cc:260] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:43.395097 23087 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:43.340945 27400 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:43.383405 27420 log.cc:927] Time spent T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.264s	user 0.003s	sys 0.000s
I20260709 12:11:43.403029 27104 raft_consensus.cc:3055] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:11:43.405624 27428 log.cc:927] Time spent T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
W20260709 12:11:43.411666 27429 log.cc:927] Time spent T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 12:11:43.376019 27425 consensus_queue.cc:1059] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 12:11:43.373477 27055 consensus_queue.cc:1048] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 12:11:43.394526 27051 raft_consensus.cc:2749] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:43.429951 22570 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:43.374930 27370 consensus_queue.cc:1048] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 12:11:43.354415 27359 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:43.414945 23119 raft_consensus.cc:1275] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:43.397454 27269 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:43.412221 27431 raft_consensus.cc:2749] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:43.420236 27104 raft_consensus.cc:740] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:43.352573 27409 consensus_queue.cc:260] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:43.343315 27424 consensus_queue.cc:237] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:43.438755 22570 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:43.437986 27341 raft_consensus.cc:2749] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:43.397958 27434 consensus_queue.cc:1048] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 12:11:43.455986 27023 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:43.460983 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:43.461822 23125 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:43.451463 27266 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.456530 27023 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.480485 27023 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:11:43.471671 27438 log.cc:927] Time spent T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:11:43.476250 27266 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:43.483345 27395 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:43.457015 27431 raft_consensus.cc:3055] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:43.457069 27051 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:43.477759 27402 log.cc:927] Time spent T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.713s	user 0.000s	sys 0.002s
I20260709 12:11:43.448274 22350 catalog_manager.cc:5697] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:11:43.479967 27426 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:43.484720 27431 raft_consensus.cc:740] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
W20260709 12:11:43.463095 27259 consensus_meta.cc:287] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.598s	user 0.010s	sys 0.000s
I20260709 12:11:43.445658 27269 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:43.515450 22570 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:43.518308 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:43.463570 27409 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.520841 22597 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 13.
W20260709 12:11:43.507519 27054 consensus_meta.cc:287] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.730s	user 0.008s	sys 0.004s
I20260709 12:11:43.537772 23125 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
I20260709 12:11:43.559547 22570 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:11:43.561836 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.563743 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:43.548442 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:43.463908 27142 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:43.583271 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 197582us
I20260709 12:11:43.773702 23087 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:43.771159 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:43.775327 22597 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:43.776782 23087 leader_election.cc:400] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 election: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 12. Current term is 13.
I20260709 12:11:43.777208 23087 leader_election.cc:403] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:11:43.547372 27054 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:43.527438 27259 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:43.770684 27125 raft_consensus.cc:2804] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:43.491082 27104 consensus_queue.cc:260] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:43.539844 27404 raft_consensus.cc:2749] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:43.567167 26770 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:43.834805 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 58967.2us
I20260709 12:11:43.787892 27363 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.776422 27426 raft_consensus.cc:2749] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:43.566690 27266 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:43.824497 23121 raft_consensus.cc:1240] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:43.777384 27341 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:43.837037 23087 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:43.809239 22532 raft_consensus.cc:1240] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 LEADER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:43.838642 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:43.853343 22599 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 10.
I20260709 12:11:43.808813 27242 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:43.847854 27441 log.cc:927] Time spent T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.328s	user 0.000s	sys 0.001s
I20260709 12:11:43.547189 27418 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:43.857230 22599 raft_consensus.cc:1240] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:43.837795 27424 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.838744 27125 raft_consensus.cc:697] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:43.842311 27400 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:43.842523 27104 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:43.862048 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:43.869908 22600 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 13.
I20260709 12:11:43.864989 22601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43070 (request call id 789) took 1167 ms. Trace:
I20260709 12:11:43.871011 23087 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:43.866101 22422 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:43.830385 27355 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:43.875419 23116 raft_consensus.cc:1240] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:43.875568 27439 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
W20260709 12:11:43.876772 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.877503 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:43.871104 22601 rpcz_store.cc:276] 0709 12:11:42.697659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.699080 (+  1421us) service_pool.cc:224] Handling call
0709 12:11:42.699375 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:42.742250 (+ 42875us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:43.864748 (+1122498us) spinlock_profiling.cc:243] Waited 29.2 ms on lock 0x7b54002df854. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:43.864936 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67218816}
I20260709 12:11:43.880998 27142 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:43.869083 22350 catalog_manager.cc:5697] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 3 to 9, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 9 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:11:43.911276 27364 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:43.911376 27425 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:43.911976 27364 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:43.912045 27425 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:43.912806 22350 catalog_manager.cc:5697] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 5 to 11. New cstate: current_term: 11 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:11:43.914369 27425 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:43.826824 27431 consensus_queue.cc:260] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:43.914597 22350 catalog_manager.cc:5697] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 4 to 10. New cstate: current_term: 10 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:11:43.915890 27431 raft_consensus.cc:3060] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:43.917150 27355 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:43.916855 22350 catalog_manager.cc:5697] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 6 to 9, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 9 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:11:43.917817 27439 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:43.926887 27430 raft_consensus.cc:3055] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:43.927445 27430 raft_consensus.cc:740] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:43.927874 27439 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:43.928411 27430 consensus_queue.cc:260] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:43.929512 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:43.930065 27430 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:43.930886 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:43.931525 22528 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:43.934197 27425 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.885589 27359 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:43.887118 27403 raft_consensus.cc:2804] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:43.937053 22496 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:43.887185 27110 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.887982 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:43.888540 23089 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:43.889734 27125 consensus_queue.cc:237] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:43.867594 27370 raft_consensus.cc:2749] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:43.848925 27363 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:43.893115 27446 log.cc:927] Time spent T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:11:43.893298 22570 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:43.964403 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 71178.5us
I20260709 12:11:43.893853 27269 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:43.898036 27426 raft_consensus.cc:2749] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:43.972772 27426 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.973354 27426 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:43.898496 27145 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:43.899034 27399 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.899189 27415 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.860037 27242 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:43.975395 27399 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:43.975667 27415 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:43.977102 27242 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:43.977488 27399 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:43.977880 22523 raft_consensus.cc:1275] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 12:11:43.975281 27145 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:43.901976 22529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 2013) took 1745 ms. Trace:
I20260709 12:11:43.874907 23087 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:43.979652 22524 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 11.
W20260709 12:11:43.979753 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 104881us
I20260709 12:11:43.981140 27145 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:43.903206 27054 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:11:43.884701 27354 consensus_meta.cc:287] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.579s	user 0.008s	sys 0.002s
I20260709 12:11:43.858451 27341 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:43.982012 27359 raft_consensus.cc:2804] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:43.979208 22529 rpcz_store.cc:276] 0709 12:11:42.128378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.145859 (+ 17481us) service_pool.cc:224] Handling call
0709 12:11:42.170446 (+ 24587us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:42.208225 (+ 37779us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:42.240394 (+ 32169us) log.cc:844] Serialized 14 byte log entry
0709 12:11:42.549534 (+309140us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:42.576584 (+ 27050us) log.cc:844] Serialized 26 byte log entry
0709 12:11:42.576747 (+   163us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:42.576779 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:42.576853 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:43.476902 (+900049us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:11:43.862822 (+385920us) raft_consensus.cc:1685] finished
0709 12:11:43.873172 (+ 10350us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:43.873302 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":21864,"prepare.run_cpu_time_us":2461,"prepare.run_wall_time_us":32253,"raft.queue_time_us":1435,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":47499,"spinlock_wait_cycles":4945280,"thread_start_us":158042,"threads_started":1,"wal-append.queue_time_us":402591}
I20260709 12:11:43.984148 27341 leader_election.cc:290] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:43.984254 27363 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:43.985605 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:43.986583 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.867571 26976 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.918587 22350 catalog_manager.cc:5697] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:11:43.988768 26976 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:43.989153 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:43.923895 27051 raft_consensus.cc:2749] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:43.924430 22597 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 12.
I20260709 12:11:43.924911 27448 consensus_queue.cc:1048] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 12:11:43.954372 22497 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:43.993513 22525 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 10.
W20260709 12:11:44.000682 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 46426us
I20260709 12:11:44.000962 22528 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 12.
I20260709 12:11:43.914402 27364 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:43.959048 27110 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:43.934842 27425 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:43.982090 27054 raft_consensus.cc:2804] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:43.981040 23087 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:44.022213 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:43.904491 27259 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:44.021140 27051 raft_consensus.cc:2749] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:44.036978 27259 raft_consensus.cc:2749] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:44.037149 22339 catalog_manager.cc:5028] TS c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): tablet 263d51d0b43744d899e37466045af890 (table test-workload [id=1e73b97ba677488c8829a696096f4885]) successfully deleted
I20260709 12:11:43.988507 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:44.038033 22529 raft_consensus.cc:2393] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 9: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:44.038956 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:44.039498 22529 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.991122 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:44.041389 22601 raft_consensus.cc:2393] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 15: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:43.961768 26770 raft_consensus.cc:2804] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:44.042290 26770 raft_consensus.cc:697] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:44.006541 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:44.043543 22600 raft_consensus.cc:2410] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 11 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 12:11:43.966960 22531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38310 (request call id 943) took 1329 ms. Trace:
I20260709 12:11:44.044302 22531 rpcz_store.cc:276] 0709 12:11:42.637731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.638008 (+   277us) service_pool.cc:224] Handling call
0709 12:11:43.966693 (+1328685us) spinlock_profiling.cc:243] Waited 691 ms on lock 0x7b5400262d54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:43.966881 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1588606336}
I20260709 12:11:44.045529 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:44.022812 23087 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:44.046334 27054 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.046917 27054 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:44.050483 27350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82e7db06c6ff4d96853c60f0f42c09a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:44.043447 26976 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:44.055336 27051 raft_consensus.cc:2749] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:44.055589 27418 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:44.056135 27418 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:44.056576 26770 consensus_queue.cc:237] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:44.062090 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:44.063598 22529 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:11:44.066586 22600 raft_consensus.cc:1240] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:44.069504 22600 raft_consensus.cc:1275] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:44.010071 22421 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:11:44.071859 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 61904.4us
I20260709 12:11:44.072451 22600 raft_consensus.cc:1275] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:44.072543 22421 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:44.075273 22600 raft_consensus.cc:1275] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:11:44.076265 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 70138.6us
I20260709 12:11:44.077936 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:43.977891 27415 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:44.004315 27145 raft_consensus.cc:2804] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:44.098670 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:44.098850 22421 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:44.099377 22605 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 15.
I20260709 12:11:44.002223 27359 raft_consensus.cc:697] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 12 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:44.089701 26976 raft_consensus.cc:2749] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:44.091284 27055 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:44.062484 27424 raft_consensus.cc:2749] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 12. Current term is 13.
I20260709 12:11:43.975178 27443 consensus_queue.cc:1059] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.109s
I20260709 12:11:44.061399 27142 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.100286 22421 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:11:44.079653 22603 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.010s	sys 0.009s
I20260709 12:11:44.089213 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:44.101284 22570 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
W20260709 12:11:44.110603 22603 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.010s	sys 0.009s
I20260709 12:11:44.104969 22528 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 10.
I20260709 12:11:43.982438 27354 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:44.090672 27364 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.108820 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:44.113921 22570 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:44.097427 27145 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.097062 27426 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:44.108952 27283 consensus_meta.cc:287] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.776s	user 0.011s	sys 0.000s
I20260709 12:11:44.107160 27352 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.056609 27418 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:44.109951 27425 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:44.121753 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:44.113361 27415 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:44.144332 22528 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 14.
I20260709 12:11:44.123026 27145 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:44.124800 27409 raft_consensus.cc:2804] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:44.157322 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:44.159943 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 224596us
I20260709 12:11:44.160957 23088 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:44.161767 27425 raft_consensus.cc:2804] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:44.162194 23088 leader_election.cc:304] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:44.162307 27425 raft_consensus.cc:697] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 12 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:44.113518 27142 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:44.175078 23120 raft_consensus.cc:1275] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:44.147814 26976 raft_consensus.cc:2749] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:44.177857 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 289407us
I20260709 12:11:44.184419 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:44.185322 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:44.187448 23125 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:44.179519 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:44.123154 27364 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:44.186918 23121 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
W20260709 12:11:44.174110 27023 consensus_meta.cc:287] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.693s	user 0.004s	sys 0.006s
I20260709 12:11:44.190368 23122 raft_consensus.cc:1275] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 12:11:44.217850 23122 pending_rounds.cc:85] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270: Aborting all ops after (but not including) 10
I20260709 12:11:44.211452 23118 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:44.182848 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.211903 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:44.213744 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:44.190001 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:44.218919 23122 pending_rounds.cc:107] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:11:44.219339 23122 raft_consensus.cc:2889] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:44.220404 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:44.220705 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:44.143574 27283 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:44.221279 23123 raft_consensus.cc:2468] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
I20260709 12:11:44.158188 27415 raft_consensus.cc:697] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:44.143996 27352 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:44.224920 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:44.224419 23120 raft_consensus.cc:2410] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 14 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:11:44.176820 27403 raft_consensus.cc:697] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:44.575181 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:44.576078 27403 consensus_queue.cc:237] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:44.578110 27283 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:44.175542 27426 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:11:44.261544 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 160112us
I20260709 12:11:44.579339 27426 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:44.581440 27426 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:44.581904 27426 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:44.582356 22422 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:44.584158 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:44.576032 22525 raft_consensus.cc:2393] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 14: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:44.262353 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:44.587818 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:44.264859 23125 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:11:44.582366 27426 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:44.589339 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:44.265662 22529 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
I20260709 12:11:44.590451 27426 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:44.590903 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.591151 27269 consensus_queue.cc:1048] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:44.591372 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:44.592235 22525 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 10.
I20260709 12:11:44.592640 27269 consensus_queue.cc:1048] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:44.593581 22525 raft_consensus.cc:1240] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:11:44.176844 27409 raft_consensus.cc:697] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:44.593711 27243 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:44.594444 27243 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:44.594664 27409 consensus_queue.cc:237] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:44.228186 27345 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:44.596683 27345 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.275610 27087 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.597103 27345 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:44.597374 27087 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:44.599365 27087 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:44.364471 27458 log.cc:927] Time spent T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
W20260709 12:11:44.410521 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.600513 27472 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:44.602209 23088 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:44.603737 27243 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:44.604538 26976 raft_consensus.cc:3055] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:44.605108 26976 raft_consensus.cc:740] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:44.600922 27472 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.606581 27472 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:44.605993 26976 consensus_queue.cc:260] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:44.607793 26976 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:44.432931 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 332707us
I20260709 12:11:44.610018 22421 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:44.611074 22421 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:44.237149 27023 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:44.613071 22604 raft_consensus.cc:2368] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 16. Current term is 17.
I20260709 12:11:44.613999 22604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43070 (request call id 795) took 1050 ms. Trace:
I20260709 12:11:44.614320 22604 rpcz_store.cc:276] 0709 12:11:43.563426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:43.563532 (+   106us) service_pool.cc:224] Handling call
0709 12:11:44.613802 (+1050270us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400043654. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:44.613919 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2411154688}
I20260709 12:11:44.616119 22525 raft_consensus.cc:1240] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:44.617085 27023 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:44.621251 27464 consensus_queue.cc:1048] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:44.619539 22525 raft_consensus.cc:1240] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:11:44.593909 27269 consensus_queue.cc:1048] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
W20260709 12:11:44.623003 27055 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.000s	sys 0.011s
W20260709 12:11:44.623417 27055 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.000s	sys 0.011s
I20260709 12:11:44.623741 27055 raft_consensus.cc:697] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:44.624701 27055 consensus_queue.cc:237] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:44.625376 22525 raft_consensus.cc:1275] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:44.551851 23122 raft_consensus.cc:1275] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:44.552917 27352 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:44.172876 27425 consensus_queue.cc:237] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:44.553361 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:44.553809 27463 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:11:44.553982 27054 consensus_meta.cc:287] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.507s	user 0.014s	sys 0.002s
I20260709 12:11:44.555080 27462 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:44.555823 22451 raft_consensus.cc:1275] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:44.712450 27463 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:44.713028 27462 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:44.713896 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:44.714712 22451 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
I20260709 12:11:44.715199 27462 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:44.716080 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:44.715992 27054 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:44.716842 22451 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:44.717669 23124 raft_consensus.cc:2393] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 11: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:44.556921 22532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 938) took 1951 ms. Trace:
I20260709 12:11:44.719175 22532 rpcz_store.cc:276] 0709 12:11:42.605705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.605952 (+   247us) service_pool.cc:224] Handling call
0709 12:11:42.624226 (+ 18274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:43.854852 (+1230626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:44.555889 (+701037us) spinlock_profiling.cc:243] Waited 1.01 ms on lock 0x7b5400383220. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca8a5dc0 00007f9cca931a02 00007f9cca92ddd6 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2
0709 12:11:44.556714 (+   825us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54001f2554. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:44.556866 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2705179904}
I20260709 12:11:44.714766 27463 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:44.720943 22532 raft_consensus.cc:1275] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:44.722361 22532 raft_consensus.cc:1275] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:44.722824 27054 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:44.556965 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:44.723708 22569 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:44.723896 22453 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 13.
I20260709 12:11:44.724851 27404 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:44.725093 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:44.725350 27404 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.725862 27404 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:44.557955 27110 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:44.558409 22598 raft_consensus.cc:1240] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:44.558265 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:44.558588 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:44.558275 27377 raft_consensus.cc:2804] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:44.728499 27377 raft_consensus.cc:697] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:44.729413 27377 consensus_queue.cc:237] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:44.559346 27473 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:44.731379 27473 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:44.733771 27473 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:44.738924 22598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 2904) took 1269 ms. Trace:
I20260709 12:11:44.560362 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:44.561309 27418 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:44.173326 27430 raft_consensus.cc:2749] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:44.563521 22602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:43060 (request call id 19) took 1184 ms. Trace:
I20260709 12:11:44.740360 23125 raft_consensus.cc:2393] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 12: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:44.740232 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:44.565002 27145 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:44.224473 27359 consensus_queue.cc:237] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:44.565587 27399 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.741360 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:44.741889 27399 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:44.740015 22602 rpcz_store.cc:276] 0709 12:11:43.379705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:43.383103 (+  3398us) service_pool.cc:224] Handling call
0709 12:11:44.563297 (+1180194us) spinlock_profiling.cc:243] Waited 559 ms on lock 0x7b540039a3d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca934735 00007f9ccf8f4d29 00007f9cc8e731d4 00007f9cc8e73162 00007f9cc8e73091 00007f9cc8e7300c 00007f9cc8e722c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:44.563437 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1285855616}
I20260709 12:11:44.559931 27364 leader_election.cc:290] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:44.744107 27399 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:44.566455 22527 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56942 (request call id 2019) took 2389 ms (client timeout 2196 ms). Trace:
I20260709 12:11:44.263937 26770 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.569344 23116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 1146) took 1449 ms. Trace:
I20260709 12:11:44.744875 26770 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:44.744663 22527 rpcz_store.cc:269] 0709 12:11:42.177319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.219569 (+ 42250us) service_pool.cc:224] Handling call
0709 12:11:44.566270 (+2346701us) spinlock_profiling.cc:243] Waited 429 ms on lock 0x7b5400400bd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:44.566370 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":987639168}
I20260709 12:11:44.570519 27456 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.746953 22527 raft_consensus.cc:1275] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:44.747239 27456 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:44.751652 22529 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 11.
I20260709 12:11:44.752795 27110 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.587989 23123 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
I20260709 12:11:44.175276 27225 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.753834 22526 raft_consensus.cc:1275] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:44.754029 27225 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:44.744127 22598 rpcz_store.cc:276] 0709 12:11:43.469020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:43.469140 (+   120us) service_pool.cc:224] Handling call
0709 12:11:43.473380 (+  4240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:44.734777 (+1261397us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:44.738693 (+  3916us) spinlock_profiling.cc:243] Waited 807 ms on lock 0x7b54000e9054. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:44.738867 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1855175424}
I20260709 12:11:44.756469 27225 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:44.591485 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.761000 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:44.761591 22601 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
I20260709 12:11:44.761914 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:44.600126 27345 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:11:44.430816 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 169691us
I20260709 12:11:44.769747 27055 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.770200 27055 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:44.618001 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:44.771289 22454 raft_consensus.cc:2468] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 10.
I20260709 12:11:44.619418 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:44.619769 27470 raft_consensus.cc:2749] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:44.772224 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:44.772895 22454 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:11:44.773048 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:44.773725 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:44.620564 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:44.628813 27405 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:44.775516 22403 auto_rebalancer.cc:629] Failed to schedule move for tablet bb7fd922979743428612619e8de33af1: Illegal state: Replica 6c6fa11e8ee34711b3551f0c670442bc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:11:44.342631 27465 consensus_queue.cc:1059] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 12:11:44.549538 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:44.774770 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:44.274248 23118 raft_consensus.cc:1275] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:11:44.651621 27468 log.cc:927] Time spent T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.084s	user 0.001s	sys 0.001s
W20260709 12:11:44.652251 27444 log.cc:927] Time spent T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.830s	user 0.007s	sys 0.016s
W20260709 12:11:44.650029 27467 log.cc:927] Time spent T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.077s	user 0.002s	sys 0.000s
W20260709 12:11:44.659226 27427 log.cc:927] Time spent T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 1.542s	user 0.014s	sys 0.008s
W20260709 12:11:44.668219 27453 log.cc:927] Time spent T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.753s	user 0.006s	sys 0.011s
I20260709 12:11:44.669273 27422 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.669627 27269 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.670228 27366 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.672315 27142 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:44.673179 27362 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:44.673301 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:44.676281 23088 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:44.551801 27415 consensus_queue.cc:237] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:44.676492 27472 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:44.677094 27459 log.cc:927] Time spent T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.101s	user 0.001s	sys 0.002s
I20260709 12:11:44.677665 27282 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:44.680500 27363 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:44.686254 27469 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.738822 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:44.744822 23116 rpcz_store.cc:276] 0709 12:11:43.119628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:43.119757 (+   129us) service_pool.cc:224] Handling call
0709 12:11:43.148179 (+ 28422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:43.905423 (+757244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:44.569118 (+663695us) spinlock_profiling.cc:243] Waited 727 ms on lock 0x7b54004e6454. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:44.569286 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1672040832}
I20260709 12:11:44.747910 26770 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:44.570106 27201 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:44.744653 22532 raft_consensus.cc:1275] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:44.749755 27145 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:44.571633 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 310378us
I20260709 12:11:44.747426 22531 raft_consensus.cc:2393] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 14: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:44.752867 27456 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:44.572265 27354 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:44.762490 22606 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:44.762868 22599 raft_consensus.cc:1275] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:44.763494 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:44.764022 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:44.764513 27259 raft_consensus.cc:2804] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:44.765372 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:44.620493 27471 raft_consensus.cc:2804] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:11:44.567358 27104 consensus_meta.cc:287] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.676s	user 0.013s	sys 0.012s
I20260709 12:11:44.782900 23119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 1364) took 1323 ms. Trace:
I20260709 12:11:44.783239 22452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 915) took 2011 ms. Trace:
W20260709 12:11:44.783358 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 107147us
I20260709 12:11:44.783562 27430 raft_consensus.cc:2804] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:44.813726 27430 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.786340 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:44.787325 22448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 2127) took 2149 ms. Trace:
I20260709 12:11:44.814134 27430 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:44.809975 22452 rpcz_store.cc:276] 0709 12:11:42.772235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.837031 (+ 64796us) service_pool.cc:224] Handling call
0709 12:11:42.837373 (+   342us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:42.863997 (+ 26624us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:42.864027 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:42.882265 (+ 18238us) log.cc:844] Serialized 52 byte log entry
0709 12:11:43.017317 (+135052us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:43.017721 (+   404us) log.cc:844] Serialized 14 byte log entry
0709 12:11:43.018465 (+   744us) log.cc:844] Serialized 14 byte log entry
0709 12:11:43.018844 (+   379us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:43.018920 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:44.580472 (+1561552us) spinlock_profiling.cc:243] Waited 2.83 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:11:44.783039 (+202567us) raft_consensus.cc:1685] finished
0709 12:11:44.783061 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:44.783189 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1858,"prepare.queue_time_us":297,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":57,"raft.queue_time_us":11647,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":11317,"spinlock_wait_cycles":6516608,"thread_start_us":83374,"threads_started":1,"wal-append.queue_time_us":160038}
I20260709 12:11:44.783211 22455 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
I20260709 12:11:44.786135 22450 raft_consensus.cc:2368] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 15. Current term is 16.
I20260709 12:11:44.789465 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:44.792269 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:44.802589 22497 leader_election.cc:304] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:44.791077 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:44.790126 22456 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 9.
I20260709 12:11:44.825814 22526 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
I20260709 12:11:44.789027 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:44.803678 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:44.827677 22601 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:44.839468 22523 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 16.
I20260709 12:11:44.806602 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:11:44.784403 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 52910.2us
I20260709 12:11:44.815384 22448 rpcz_store.cc:276] 0709 12:11:42.637439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.638798 (+  1359us) service_pool.cc:224] Handling call
0709 12:11:42.639129 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:42.639438 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:42.639463 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:43.853745 (+1214282us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b2c00033c98. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc9227a11 00007f9cc9237372 00007f9cca969a01 00007f9cca92e43a 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2
0709 12:11:43.854126 (+   381us) log.cc:844] Serialized 26 byte log entry
0709 12:11:44.163177 (+309051us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:44.163216 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:44.163989 (+   773us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:44.786974 (+622985us) raft_consensus.cc:1685] finished
0709 12:11:44.787029 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:44.787244 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1182,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"spinlock_wait_cycles":45531392,"thread_start_us":275426,"threads_started":1,"wal-append.queue_time_us":701879}
I20260709 12:11:44.780865 22530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 2326) took 1796 ms. Trace:
I20260709 12:11:44.841363 22530 rpcz_store.cc:276] 0709 12:11:42.984216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:43.152891 (+168675us) service_pool.cc:224] Handling call
0709 12:11:43.153169 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:43.153478 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:43.153506 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:43.153941 (+   435us) log.cc:844] Serialized 26 byte log entry
0709 12:11:43.447923 (+293982us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:43.447968 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:43.448035 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:44.583646 (+1135611us) spinlock_profiling.cc:243] Waited 6.03 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:11:44.780619 (+196973us) raft_consensus.cc:1685] finished
0709 12:11:44.780642 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:44.780811 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1034,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":10876,"spinlock_wait_cycles":13858688,"thread_start_us":293627,"threads_started":1,"wal-append.queue_time_us":381932}
I20260709 12:11:44.842793 22495 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:44.807776 23119 rpcz_store.cc:276] 0709 12:11:43.459479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:43.459649 (+   170us) service_pool.cc:224] Handling call
0709 12:11:43.459980 (+   331us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:43.485158 (+ 25178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:43.485189 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:43.519857 (+ 34668us) log.cc:844] Serialized 52 byte log entry
0709 12:11:43.853278 (+333421us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:44.117040 (+263762us) log.cc:844] Serialized 14 byte log entry
0709 12:11:44.117322 (+   282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:44.117412 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:44.570740 (+453328us) spinlock_profiling.cc:243] Waited 3 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:11:44.782602 (+211862us) raft_consensus.cc:1685] finished
0709 12:11:44.782710 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:44.782843 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":332909,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":37,"raft.queue_time_us":32187,"raft.run_cpu_time_us":336,"raft.run_wall_time_us":33088,"spinlock_wait_cycles":6890752,"thread_start_us":325770,"threads_started":2,"wal-append.queue_time_us":373778}
I20260709 12:11:44.840624 22604 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:44.778155 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:44.844583 22454 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:44.797017 22569 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:44.845402 23116 raft_consensus.cc:1275] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 12:11:44.823221 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:44.845832 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 48918.3us
I20260709 12:11:44.788839 22570 leader_election.cc:304] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
W20260709 12:11:44.849231 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 46719.8us
I20260709 12:11:44.802029 23089 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:44.853443 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:44.871552 22452 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:44.852783 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 50833us
I20260709 12:11:44.838598 22601 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 16.
I20260709 12:11:44.772181 27055 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:44.918627 22569 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:44.793465 27470 raft_consensus.cc:3055] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:44.784598 27225 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.776243 27350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:57318 (request call id 1141) took 3623 ms. Trace:
W20260709 12:11:44.852090 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 63327.9us
I20260709 12:11:44.822010 27352 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:44.814801 27087 consensus_queue.cc:1059] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.108s
I20260709 12:11:44.786872 27363 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:44.923192 27399 raft_consensus.cc:2804] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:44.851226 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 239190us
I20260709 12:11:44.805459 27471 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:44.928500 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:44.785887 27472 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:44.931682 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:44.874455 27142 raft_consensus.cc:2804] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:44.961607 22495 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:44.964447 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:44.924237 27465 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:44.934580 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:44.971590 23123 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:44.930716 27470 raft_consensus.cc:740] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:44.871146 27054 raft_consensus.cc:2749] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:44.874617 26770 raft_consensus.cc:2804] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:44.786603 27282 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:44.782060 27366 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:44.781791 27269 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:44.924252 23089 leader_election.cc:400] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 election: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 16. Current term is 17.
I20260709 12:11:44.924703 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:45.006767 23089 leader_election.cc:403] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
W20260709 12:11:45.007647 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 89630us
I20260709 12:11:45.010608 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:44.997885 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:44.948206 22452 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
I20260709 12:11:44.945399 22454 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 17.
I20260709 12:11:44.778959 27110 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:44.960919 22450 raft_consensus.cc:1240] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 LEADER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:44.965044 22531 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 12.
W20260709 12:11:44.928180 27491 log.cc:927] Time spent T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.084s	user 0.003s	sys 0.000s
I20260709 12:11:44.779189 27217 consensus_queue.cc:1048] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.126s
I20260709 12:11:44.789760 27201 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:44.968267 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:44.969262 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:44.969494 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:44.787588 27469 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:44.967747 27142 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:44.980592 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:44.781541 27422 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:44.983242 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:44.984462 27409 consensus_queue.cc:1048] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:44.964046 27345 consensus_queue.cc:1059] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.102s
I20260709 12:11:44.986204 27259 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.964294 27471 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:44.987416 27441 log.cc:927] Time spent T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:11:44.989135 22598 raft_consensus.cc:1275] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 12:11:45.104735 22598 pending_rounds.cc:85] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting all ops after (but not including) 8
I20260709 12:11:45.105067 22598 pending_rounds.cc:107] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 12:11:45.105307 22598 raft_consensus.cc:2889] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:44.933131 22422 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:45.002532 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:45.094053 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:44.965195 27395 raft_consensus.cc:2804] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:11:45.061271 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 99765.5us
I20260709 12:11:44.988438 27362 consensus_queue.cc:1048] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 12:11:45.016631 27472 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.934180 27364 consensus_queue.cc:1048] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 12:11:45.070341 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:44.966293 27399 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:45.072001 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:45.216133 22603 raft_consensus.cc:2393] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 15: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
W20260709 12:11:45.077883 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 111013us
I20260709 12:11:45.078032 22525 raft_consensus.cc:1275] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:44.964841 27352 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:11:45.087877 22529 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:11:44.940166 27225 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:45.018321 27417 consensus_queue.cc:1048] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.166s
I20260709 12:11:45.000447 26770 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.968873 27104 consensus_queue.cc:1059] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.102s
I20260709 12:11:44.974112 27055 consensus_queue.cc:1048] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.116s
I20260709 12:11:45.017843 27463 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:45.106775 22601 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:45.127494 27259 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:45.110512 27201 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:45.111883 27484 log.cc:927] Time spent T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:11:45.112215 27110 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:45.238447 27110 raft_consensus.cc:476] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 13 LEADER]: Not starting pre-election -- already a leader
I20260709 12:11:45.240103 27110 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:45.240700 27110 raft_consensus.cc:697] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 16 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:45.025446 26976 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:45.241569 26976 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:45.244138 26976 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:45.113471 22450 raft_consensus.cc:1275] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:11:45.114499 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 184699us
I20260709 12:11:45.117834 27366 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:44.975769 27377 consensus_queue.cc:1059] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.112s
I20260709 12:11:45.119390 22453 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
I20260709 12:11:45.120596 27469 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:44.936626 27350 rpcz_store.cc:276] 0709 12:11:41.158180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.162699 (+  4519us) service_pool.cc:224] Handling call
0709 12:11:41.397833 (+235134us) ts_tablet_manager.cc:934] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317)
0709 12:11:44.049104 (+2651271us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:11:44.677704 (+628600us) tablet_metadata.cc:665] Metadata flushed
0709 12:11:44.677828 (+   124us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:11:44.775445 (+ 97617us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:11:44.775776 (+   331us) tablet_replica.cc:206] Creating consensus instance
0709 12:11:44.776113 (+   337us) ts_tablet_manager.cc:989] Replica registered.
0709 12:11:44.776169 (+    56us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":13497,"tablet-copy.queue_time_us":126960,"thread_start_us":120084,"threads_started":2}
I20260709 12:11:45.125068 23118 raft_consensus.cc:1275] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:45.126811 22495 leader_election.cc:400] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 15. Current term is 16.
I20260709 12:11:45.057704 27456 raft_consensus.cc:2804] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:45.106314 23122 raft_consensus.cc:2468] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 9.
I20260709 12:11:45.128680 22451 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 14.
I20260709 12:11:45.004132 27464 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.025246 27473 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.066418 23123 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 15.
I20260709 12:11:45.184172 22449 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
I20260709 12:11:45.186574 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:45.192193 22606 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 14.
I20260709 12:11:45.066418 27403 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:45.196180 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 186782us
I20260709 12:11:45.217497 22570 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:45.004276 27415 consensus_queue.cc:1048] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.122s
I20260709 12:11:45.218950 23119 raft_consensus.cc:1275] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:45.077541 27443 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.246876 27119 consensus_queue.cc:1048] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:11:45.086124 27142 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:45.222342 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:45.087939 27355 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.224054 27400 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:44.989861 27465 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:45.005448 27404 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:45.131662 27243 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.262466 22604 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 14.
W20260709 12:11:45.214251 27500 log.cc:927] Time spent T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.229s	user 0.000s	sys 0.004s
I20260709 12:11:45.195791 27354 raft_consensus.cc:3055] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:45.253054 22601 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 11.
I20260709 12:11:45.262320 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:45.263355 22495 leader_election.cc:403] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:45.264649 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:45.265693 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:45.286126 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:45.286334 22525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 2040) took 1292 ms. Trace:
I20260709 12:11:45.224306 27405 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.220817 27399 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:45.227181 26770 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:45.311842 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:45.333045 23121 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
W20260709 12:11:45.258044 27483 log.cc:927] Time spent T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.182s	user 0.000s	sys 0.000s
I20260709 12:11:45.337596 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:45.316267 22451 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1143406a95dd472688b2fe621abd815f"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
mode: GRACEFUL
new_leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:44568
I20260709 12:11:45.338868 22451 raft_consensus.cc:606] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Received request to transfer leadership to TS 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:45.339322 22451 raft_consensus.cc:614] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:11:45.289222 27494 log.cc:927] Time spent T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 12:11:45.318758 23120 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
I20260709 12:11:45.328553 23122 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 12.
I20260709 12:11:45.327936 23123 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
I20260709 12:11:45.328298 22525 rpcz_store.cc:276] 0709 12:11:43.990200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:44.712167 (+721967us) service_pool.cc:224] Handling call
0709 12:11:44.712448 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:45.216667 (+504219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:45.282699 (+ 66032us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b5400230d54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:45.282937 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":840036608}
I20260709 12:11:45.353807 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:45.349131 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:45.354970 22450 raft_consensus.cc:2368] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 16. Current term is 17.
I20260709 12:11:45.349730 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:45.351622 22600 raft_consensus.cc:2393] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 13: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:45.357630 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:45.358968 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:45.345727 22529 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 16.
I20260709 12:11:45.361471 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:45.262950 27350 tablet_copy_client.cc:806] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 0 data blocks...
I20260709 12:11:45.264657 27225 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:45.220178 27472 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:45.288127 27422 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:45.254289 27511 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:45.427273 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:45.290514 27104 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.263872 27456 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:45.286463 27363 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:45.464429 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:45.465323 22600 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 14.
I20260709 12:11:45.361884 22496 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:45.267848 27403 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:45.467778 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 106016us
I20260709 12:11:45.469128 22496 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:45.469488 27403 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:45.335389 27243 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:45.351198 27054 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.471037 27054 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:45.274276 27355 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:45.462072 27341 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.473762 27341 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:45.424988 22449 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 11.
I20260709 12:11:45.375587 23117 raft_consensus.cc:1240] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 12 LEADER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:11:45.292480 27352 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:45.428395 22448 raft_consensus.cc:1275] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:45.429345 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:45.433202 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:45.432546 23123 raft_consensus.cc:1275] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:45.311903 27407 raft_consensus.cc:2764] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:11:45.265065 27473 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:45.264999 27464 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:45.426312 27145 raft_consensus.cc:2749] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 15. Current term is 16.
I20260709 12:11:45.365746 23089 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:45.318100 27354 raft_consensus.cc:740] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:45.462212 23119 raft_consensus.cc:1275] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:45.293810 27479 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.466913 27506 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.478888 22496 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:45.290933 27400 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:45.366882 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 240187us
I20260709 12:11:45.430550 23121 raft_consensus.cc:2393] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 12: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:45.224961 27470 consensus_queue.cc:260] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:45.489409 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:45.271040 27443 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:45.511389 22457 raft_consensus.cc:1275] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:45.512195 22452 raft_consensus.cc:1275] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:45.487869 27055 consensus_queue.cc:1048] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:11:45.508455 27119 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:45.515296 27217 raft_consensus.cc:2804] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:45.515990 22496 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:45.485148 27409 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:45.535279 22496 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:45.516523 22604 raft_consensus.cc:1275] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:45.517901 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:45.519845 22422 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:45.521508 22606 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:11:45.462177 27362 raft_consensus.cc:3055] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:11:45.528391 22456 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.074s	sys 0.117s
I20260709 12:11:45.478399 27456 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:45.530406 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:45.546128 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:45.433815 27472 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:45.502940 27054 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:45.487979 27425 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.487808 27366 raft_consensus.cc:2804] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:45.541440 23125 raft_consensus.cc:1240] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 14. Current term is 15. Ops: []
W20260709 12:11:45.541860 22456 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.074s	sys 0.117s
I20260709 12:11:45.537997 22598 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 13.
I20260709 12:11:45.528617 27350 tablet_copy_client.cc:670] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 1 WAL segments...
I20260709 12:11:45.542114 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:45.547796 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:45.568897 22604 raft_consensus.cc:1240] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:45.534403 27217 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:45.359719 27259 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:45.431764 27282 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:45.557920 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 340477us
I20260709 12:11:45.363024 27405 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:45.560550 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:45.478856 27104 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:45.561872 23087 leader_election.cc:336] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.511s (SENT)
I20260709 12:11:45.594835 23087 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:45.462970 27511 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:45.542441 27395 raft_consensus.cc:697] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:45.540844 27409 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:45.543677 27145 raft_consensus.cc:2749] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:45.543891 27352 raft_consensus.cc:2804] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:45.541682 27362 raft_consensus.cc:740] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:45.523886 27475 consensus_queue.cc:1048] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:11:45.465374 27110 consensus_queue.cc:237] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:45.563004 27366 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:45.581687 27054 raft_consensus.cc:2804] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:45.606487 22606 raft_consensus.cc:606] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Received request to transfer leadership to TS 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:45.743299 22606 raft_consensus.cc:614] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:45.579911 27225 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.590070 27217 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:45.616302 23123 raft_consensus.cc:1275] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:45.651696 27395 consensus_queue.cc:237] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:45.602113 27505 raft_consensus.cc:2804] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:11:45.707482 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 389417us
I20260709 12:11:45.680863 23117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 1366) took 1539 ms. Trace:
I20260709 12:11:45.601445 27449 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.660852 27142 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:45.596798 27269 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:45.529512 27506 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:45.662932 27259 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:45.662508 27400 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:45.609208 27422 raft_consensus.cc:2749] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:45.529731 27479 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:45.659734 27404 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:45.671424 27469 raft_consensus.cc:3055] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:45.602715 27409 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:45.603911 27352 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:45.721772 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:45.661209 22452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 2143) took 1037 ms. Trace:
I20260709 12:11:45.680413 27355 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:45.669510 23088 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:45.678520 27465 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:45.624951 27366 raft_consensus.cc:3060] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:45.671399 27362 consensus_queue.cc:260] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:45.571386 27425 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:45.736300 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:45.833549 22448 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:11:45.834841 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:45.737097 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:45.836812 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:45.698874 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:45.740798 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:11:45.741911 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 376200us
I20260709 12:11:45.672816 27511 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:11:45.744657 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 191867us
I20260709 12:11:45.771672 27449 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:45.747756 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:45.670789 27473 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:45.811709 27469 raft_consensus.cc:740] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:45.762128 22451 raft_consensus.cc:1275] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:11:45.764671 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:45.858458 22528 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 13.
I20260709 12:11:45.762271 23117 rpcz_store.cc:276] 0709 12:11:44.141626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:44.175072 (+ 33446us) service_pool.cc:224] Handling call
0709 12:11:44.214733 (+ 39661us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:45.479806 (+1265073us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:45.679974 (+200168us) spinlock_profiling.cc:243] Waited 3.54 ms on lock 0x7b54007e0f20. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca8a5dc0 00007f9cca931a02 00007f9cca92ddd6 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2
0709 12:11:45.680583 (+   609us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b540017e654. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:45.680791 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2677012096}
I20260709 12:11:45.830883 27259 raft_consensus.cc:2749] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:45.742424 27283 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.003s	sys 0.008s
I20260709 12:11:45.676949 27399 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:45.885365 27399 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:45.781641 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:45.886201 27499 log.cc:927] Time spent T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.561s	user 0.000s	sys 0.002s
I20260709 12:11:45.886307 22603 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 13.
W20260709 12:11:45.768275 27463 consensus_meta.cc:287] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.519s	user 0.009s	sys 0.000s
I20260709 12:11:45.887458 27463 raft_consensus.cc:2749] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 16. Current term is 17.
I20260709 12:11:45.888134 27506 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:45.761770 27505 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:45.888916 27505 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:45.891067 27513 log.cc:927] Time spent T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.083s	user 0.005s	sys 0.000s
I20260709 12:11:45.855062 27418 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:11:45.891853 27504 log.cc:927] Time spent T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:11:45.762113 27054 raft_consensus.cc:697] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 11 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:45.869982 27443 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:45.893438 27054 consensus_queue.cc:237] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:45.895162 27531 log.cc:927] Time spent T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:11:45.788548 27104 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:45.896776 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:45.897339 22450 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:45.898521 27479 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:45.794095 27471 consensus_meta.cc:287] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.581s	user 0.007s	sys 0.000s
I20260709 12:11:45.794481 27503 consensus_queue.cc:1048] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 12:11:45.899508 27471 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:45.795118 27508 log.cc:927] Time spent T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.101s	user 0.003s	sys 0.001s
I20260709 12:11:45.796478 27142 leader_election.cc:290] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:45.901620 27471 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:45.901719 22456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 2141) took 1278 ms. Trace:
I20260709 12:11:45.814605 22452 rpcz_store.cc:276] 0709 12:11:44.623734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:45.015584 (+391850us) service_pool.cc:224] Handling call
0709 12:11:45.015901 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:45.527461 (+511560us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:45.660873 (+133412us) spinlock_profiling.cc:243] Waited 496 ms on lock 0x7b5400379954. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:45.661130 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1140637184}
I20260709 12:11:45.902292 22454 raft_consensus.cc:1240] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:45.903062 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:45.904076 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:45.904683 22452 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:45.773842 27520 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.762845 27225 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:45.830313 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 160886us
I20260709 12:11:45.919351 23088 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:45.920486 23088 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:45.767870 27282 consensus_queue.cc:1048] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:11:45.746353 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:45.771970 27345 consensus_queue.cc:1048] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 12:11:45.845677 22496 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:45.846973 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:45.826779 27352 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:45.757666 22570 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:11:45.942803 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 185235us
I20260709 12:11:45.943547 22570 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:45.945454 22570 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:45.945672 22524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 958) took 1216 ms. Trace:
W20260709 12:11:45.851240 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 89087.6us
I20260709 12:11:45.946771 22421 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:45.945997 22524 rpcz_store.cc:276] 0709 12:11:44.729603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:44.742142 (+ 12539us) service_pool.cc:224] Handling call
0709 12:11:44.742458 (+   316us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:44.779368 (+ 36910us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:11:44.779681 (+   313us) log.cc:844] Serialized 14 byte log entry
0709 12:11:45.195671 (+415990us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:45.246733 (+ 51062us) log.cc:844] Serialized 52 byte log entry
0709 12:11:45.247217 (+   484us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:45.247276 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:45.247359 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:45.280212 (+ 32853us) spinlock_profiling.cc:243] Waited 3.68 ms on lock 0x7b18002a15a0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc7841522 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd 0000000000388634 0000000000388479 00007f9cc782483a
0709 12:11:45.885595 (+605383us) spinlock_profiling.cc:243] Waited 28.7 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:11:45.945467 (+ 59872us) raft_consensus.cc:1685] finished
0709 12:11:45.945491 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:45.945616 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":305419,"prepare.queue_time_us":6231,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":286846,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":7316,"spinlock_wait_cycles":74500096,"thread_start_us":183475,"threads_started":1,"wal-append.queue_time_us":444978}
W20260709 12:11:45.947533 27430 consensus_meta.cc:287] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 1.078s	user 0.010s	sys 0.002s
I20260709 12:11:45.948068 22457 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 2155) took 1182 ms. Trace:
I20260709 12:11:45.947993 27430 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:45.948437 27242 raft_consensus.cc:2804] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:45.948956 27242 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:45.949280 27242 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:45.862413 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:45.950134 27430 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:45.951180 27269 consensus_queue.cc:1048] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:45.941815 27259 raft_consensus.cc:2804] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:45.891795 27418 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:45.952307 27259 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:45.952663 27269 raft_consensus.cc:2749] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:45.844030 27422 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.953646 27422 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:45.954280 27418 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:45.878012 27415 raft_consensus.cc:3055] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:45.954295 27518 raft_consensus.cc:2804] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:45.955148 27415 raft_consensus.cc:740] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:45.955276 27518 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:45.955737 27422 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:45.871511 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:45.956032 27415 consensus_queue.cc:260] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:45.957072 27415 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:45.957123 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:45.957962 22451 raft_consensus.cc:2393] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 13: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:45.880800 27449 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:45.874415 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:45.906543 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 149752us
I20260709 12:11:45.959395 22449 raft_consensus.cc:2393] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 9: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:45.959441 27243 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:45.959821 22569 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:45.870157 27473 consensus_queue.cc:1048] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
W20260709 12:11:45.869397 27283 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.004s	sys 0.008s
I20260709 12:11:45.960167 27243 raft_consensus.cc:2749] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:45.960898 27243 raft_consensus.cc:2749] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:45.877146 27405 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:45.961155 27283 raft_consensus.cc:2749] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:45.867715 27469 consensus_queue.cc:260] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:45.962479 27469 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:45.918738 27362 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:45.968497 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:45.969097 22570 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:45.961009 22569 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:11:45.941856 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 96295.8us
I20260709 12:11:45.948119 22421 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:45.902074 22456 rpcz_store.cc:276] 0709 12:11:44.623184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:44.987248 (+364064us) service_pool.cc:224] Handling call
0709 12:11:44.987579 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:44.987951 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:44.987982 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:44.988456 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 12:11:45.563753 (+575297us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:45.563789 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:45.563851 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:45.901527 (+337676us) raft_consensus.cc:1685] finished
0709 12:11:45.901548 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:45.901666 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10710,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":60394,"thread_start_us":574921,"threads_started":1,"wal-append.queue_time_us":636518}
I20260709 12:11:45.759059 22495 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:45.971547 22569 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:45.960258 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:45.952760 27259 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:45.973151 22570 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
W20260709 12:11:45.971869 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 212908us
I20260709 12:11:45.966207 27354 consensus_queue.cc:260] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:45.970681 22496 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:45.958760 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:45.994592 22451 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
I20260709 12:11:45.948499 22457 rpcz_store.cc:276] 0709 12:11:44.766085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:45.078610 (+312525us) service_pool.cc:224] Handling call
0709 12:11:45.078888 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:45.527138 (+448250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:45.947849 (+420711us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b54004056d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:45.948008 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":993700608}
I20260709 12:11:45.996169 23088 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:45.997680 23088 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:46.002225 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:11:46.002651 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.003480 22450 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:11:45.993395 27418 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.005669 22569 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:46.012131 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:46.009936 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:46.010417 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:46.014011 23123 raft_consensus.cc:2393] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 12: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:46.010890 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:46.014585 22523 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 11.
I20260709 12:11:46.014773 23124 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 17.
I20260709 12:11:46.011648 22449 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 12.
I20260709 12:11:45.943786 27464 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:45.942430 27463 raft_consensus.cc:2749] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:45.955752 27518 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:45.983557 22452 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 14.
I20260709 12:11:46.036104 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:46.036290 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:46.017762 23088 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:46.032678 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:11:46.034439 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 61348.6us
I20260709 12:11:46.034299 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:46.039168 23123 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 14.
I20260709 12:11:46.035254 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:46.038352 23119 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 14.
I20260709 12:11:46.041584 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:46.042183 22528 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:46.036732 23117 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
I20260709 12:11:46.044059 23121 raft_consensus.cc:1275] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:46.045461 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:46.047240 27243 raft_consensus.cc:2804] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:46.047654 27243 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.032337 27354 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:46.047966 27243 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:46.049299 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:45.968302 27142 consensus_queue.cc:1048] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:11:46.006136 27023 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:45.993750 27405 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.050951 27355 consensus_queue.cc:1048] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:11:46.054338 27405 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:46.054621 22421 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:45.983706 27472 raft_consensus.cc:2804] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:46.051156 27283 consensus_queue.cc:1048] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:11:46.055629 27472 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.056044 27472 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:46.056622 27405 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:46.056386 27505 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:45.994369 27145 raft_consensus.cc:2804] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:46.057431 27145 raft_consensus.cc:697] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:46.052120 27515 consensus_queue.cc:1048] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 12:11:46.058297 27145 consensus_queue.cc:237] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:46.060067 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:46.052855 27409 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:46.062281 22604 raft_consensus.cc:1240] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:46.062918 27523 raft_consensus.cc:2804] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:46.063419 27523 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:46.063687 27456 consensus_meta.cc:287] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.504s	user 0.005s	sys 0.007s
I20260709 12:11:46.063794 27523 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:46.064270 26770 consensus_meta.cc:287] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.643s	user 0.006s	sys 0.003s
I20260709 12:11:46.064155 27456 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:46.064678 26770 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:45.941517 27479 consensus_queue.cc:1048] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.090s
I20260709 12:11:46.065899 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:46.034102 27475 consensus_queue.cc:1048] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:11:46.033887 27449 raft_consensus.cc:2804] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:46.067730 27449 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.067925 27409 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:46.068095 27449 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:46.068811 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:46.069449 22456 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
I20260709 12:11:46.058459 27505 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:46.069900 27464 consensus_queue.cc:1059] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:45.981518 27104 raft_consensus.cc:2749] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:46.070834 27464 consensus_queue.cc:1048] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:46.071401 27505 raft_consensus.cc:2749] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:46.071508 27514 raft_consensus.cc:2804] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:46.063580 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:46.072157 27514 raft_consensus.cc:697] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 15 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:46.073834 23125 raft_consensus.cc:1240] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:46.074311 23117 raft_consensus.cc:1275] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:45.960237 27407 consensus_queue.cc:1048] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 12:11:46.074898 27352 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:46.075459 23123 raft_consensus.cc:1275] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:11:46.075726 22597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:11:46.076295 22597 raft_consensus.cc:606] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:11:46.076617 22597 raft_consensus.cc:614] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:46.077008 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:46.077895 27341 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:46.078094 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:11:46.079634 27522 log.cc:927] Time spent T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.213s	user 0.000s	sys 0.000s
I20260709 12:11:46.012782 27430 raft_consensus.cc:2749] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:46.035617 27418 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:46.083117 27418 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:46.043712 27119 raft_consensus.cc:2749] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:45.981170 27399 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:46.100410 22455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 2147) took 1475 ms. Trace:
I20260709 12:11:46.005224 27512 raft_consensus.cc:2749] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:46.079674 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:46.053107 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:46.089323 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:46.104009 22603 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 13.
I20260709 12:11:46.106595 23088 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:46.108425 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:46.113160 23089 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:46.100800 22455 rpcz_store.cc:276] 0709 12:11:44.624787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:45.065127 (+440340us) service_pool.cc:224] Handling call
0709 12:11:45.065445 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:45.245828 (+180383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:45.245867 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:45.256293 (+ 10426us) log.cc:844] Serialized 26 byte log entry
0709 12:11:45.728294 (+472001us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:45.728332 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:46.078740 (+350408us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b54003f3ed4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:46.078783 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:46.078827 (+    44us) raft_consensus.cc:1685] finished
0709 12:11:46.078841 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:46.100348 (+ 21507us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":414226304,"thread_start_us":367462,"threads_started":1,"wal-append.queue_time_us":534426}
I20260709 12:11:46.124439 23089 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:46.124817 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:46.053185 27477 raft_consensus.cc:2804] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:46.053730 27023 raft_consensus.cc:697] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:46.090865 22528 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 11.
I20260709 12:11:46.093205 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:46.139726 23123 raft_consensus.cc:2393] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 12: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:46.085458 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:46.143036 22598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:11:46.143601 22598 raft_consensus.cc:606] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:11:46.143903 22598 raft_consensus.cc:614] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:46.053730 27364 consensus_queue.cc:1048] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 12:11:46.128087 27463 raft_consensus.cc:2749] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:46.146129 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 239929us
I20260709 12:11:46.053025 27142 consensus_queue.cc:1048] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.083s
I20260709 12:11:46.150029 22526 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 11.
I20260709 12:11:46.133131 27430 raft_consensus.cc:2804] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:46.132853 27477 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.105387 27511 consensus_queue.cc:1048] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:11:46.107605 27399 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:46.103407 27104 consensus_queue.cc:1059] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:11:46.189990 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:46.105537 27341 consensus_queue.cc:1048] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 12:11:46.156234 27430 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.192059 27477 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:46.189064 27405 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:46.190416 27418 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:46.234694 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:46.216640 27023 consensus_queue.cc:237] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:46.235339 22455 raft_consensus.cc:2376] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14. Re-sending same reply.
W20260709 12:11:46.235808 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 185559us
I20260709 12:11:46.219368 26770 leader_election.cc:290] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:46.153708 27525 consensus_queue.cc:1059] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.090s
I20260709 12:11:46.231750 27430 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:46.244730 23124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57328 (request call id 1379) took 1281 ms. Trace:
I20260709 12:11:46.247011 22602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:11:46.232841 27395 raft_consensus.cc:3055] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:11:46.243655 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.254828 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:46.256496 23124 rpcz_store.cc:276] 0709 12:11:44.963641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:44.964120 (+   479us) service_pool.cc:224] Handling call
0709 12:11:46.244574 (+1280454us) spinlock_profiling.cc:243] Waited 877 ms on lock 0x7b54000a0d54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:46.244668 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2017357184}
I20260709 12:11:46.276387 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:46.277326 22598 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 14.
I20260709 12:11:46.279553 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:46.280588 22450 raft_consensus.cc:2393] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 15: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:46.281463 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:46.281826 22600 raft_consensus.cc:1275] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:11:46.282094 23124 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:46.282346 22600 pending_rounds.cc:85] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting all ops after (but not including) 9
I20260709 12:11:46.282742 22600 pending_rounds.cc:107] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:11:46.283042 22600 raft_consensus.cc:2889] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:46.284436 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:46.255429 27225 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:46.258241 27425 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:46.330412 22529 raft_consensus.cc:1275] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:11:46.258734 27395 raft_consensus.cc:740] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:46.238126 27418 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:46.249857 27475 consensus_queue.cc:1048] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 12:11:46.333354 22532 raft_consensus.cc:1240] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:46.450145 22450 raft_consensus.cc:1275] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:46.339702 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:46.498888 22597 raft_consensus.cc:1275] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:11:46.366732 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:46.504094 22529 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:46.370350 27537 log.cc:927] Time spent T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.270s	user 0.000s	sys 0.001s
I20260709 12:11:46.366070 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:46.351155 23124 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 13.
I20260709 12:11:46.364080 27087 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:46.524262 22496 leader_election.cc:304] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:46.527309 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:46.528083 22532 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:46.537243 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:11:46.518187 27242 consensus_meta.cc:287] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.568s	user 0.004s	sys 0.008s
I20260709 12:11:46.516628 27087 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:46.547503 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 766144us
I20260709 12:11:46.522743 27377 raft_consensus.cc:3055] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:46.474278 27463 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:46.552915 22497 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:46.554903 22529 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:11:46.520222 27425 consensus_queue.cc:1048] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 12:11:46.556800 22532 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 17.
I20260709 12:11:46.561067 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:46.561853 22532 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
I20260709 12:11:46.563071 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:46.564886 22532 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 13.
I20260709 12:11:46.566006 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:46.564184 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:46.567747 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:46.568821 27269 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:46.569504 27269 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:46.572809 27269 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:46.574062 27269 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:46.574755 27269 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:46.577710 27541 log.cc:927] Time spent T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
W20260709 12:11:46.578161 27546 log.cc:927] Time spent T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:11:46.583148 27399 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:46.558243 27377 raft_consensus.cc:740] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
W20260709 12:11:46.583838 27540 log.cc:927] Time spent T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:11:46.584585 27377 consensus_queue.cc:260] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:46.584848 27395 consensus_queue.cc:260] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:46.585691 27377 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:46.586491 27395 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:46.588621 27418 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:46.589571 27418 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:46.590173 27418 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:46.601807 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 49023us
I20260709 12:11:46.608129 22422 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:46.611974 22497 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
W20260709 12:11:46.543573 27217 consensus_meta.cc:287] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.775s	user 0.008s	sys 0.002s
W20260709 12:11:46.606036 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.613653 22497 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:46.616891 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:46.551390 27469 consensus_meta.cc:287] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.586s	user 0.005s	sys 0.005s
W20260709 12:11:46.544003 27535 log.cc:927] Time spent T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.329s	user 0.001s	sys 0.000s
I20260709 12:11:46.545615 27475 raft_consensus.cc:2804] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:11:46.582796 27243 consensus_meta.cc:287] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.534s	user 0.007s	sys 0.000s
W20260709 12:11:46.590889 27449 consensus_meta.cc:287] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.522s	user 0.010s	sys 0.000s
I20260709 12:11:46.621770 22602 raft_consensus.cc:606] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
W20260709 12:11:46.593896 27354 consensus_meta.cc:287] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.546s	user 0.006s	sys 0.000s
I20260709 12:11:46.625938 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:46.594074 27259 consensus_meta.cc:287] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.578s	user 0.007s	sys 0.000s
I20260709 12:11:46.628240 22497 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:45.923923 27520 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:46.610505 26770 raft_consensus.cc:2749] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:46.618862 27366 consensus_meta.cc:287] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.774s	user 0.010s	sys 0.000s
I20260709 12:11:46.691078 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:46.692737 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:46.658262 22448 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 12.
I20260709 12:11:46.599313 27463 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:46.073096 27514 consensus_queue.cc:237] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:46.707523 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 79362.4us
I20260709 12:11:46.552035 27242 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:46.620010 27547 raft_consensus.cc:2804] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:46.702072 22529 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
W20260709 12:11:46.615447 27415 consensus_meta.cc:287] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.658s	user 0.006s	sys 0.004s
I20260709 12:11:46.712314 22603 raft_consensus.cc:1275] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:46.712325 22497 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:46.714778 22497 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:46.715302 27509 consensus_queue.cc:1048] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:46.717563 26770 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:46.720026 27352 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:46.720070 26770 raft_consensus.cc:2804] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:46.720654 26770 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:46.721022 26770 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:46.718490 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:46.619849 27473 raft_consensus.cc:2804] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:46.657480 27145 raft_consensus.cc:2749] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:46.661816 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:46.697160 27545 log.cc:927] Time spent T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 12:11:46.685672 27269 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:46.614943 27217 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:46.732646 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:46.738009 22495 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:46.740825 22495 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:46.743332 22527 raft_consensus.cc:1240] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:11:46.710592 27354 raft_consensus.cc:2749] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:46.669973 27243 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:46.677532 27449 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:46.701634 27259 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:46.735877 27473 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.757586 22531 raft_consensus.cc:2393] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 12: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:46.744428 27399 raft_consensus.cc:2749] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:46.759202 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:46.704571 27366 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:46.738350 27547 raft_consensus.cc:697] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
W20260709 12:11:46.761435 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.764972 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:46.746865 27558 raft_consensus.cc:2804] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:46.770428 22598 raft_consensus.cc:2393] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 14: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:46.772231 23125 raft_consensus.cc:1240] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:11:46.773257 23121 raft_consensus.cc:1240] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 11. Current term is 12. Ops: [11.10-11.10]
W20260709 12:11:46.773383 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 57537.4us
I20260709 12:11:46.764079 27473 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:46.782641 27225 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:11:46.784587 27562 log.cc:927] Time spent T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 12:11:46.784739 27225 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:46.788776 22597 raft_consensus.cc:1275] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:11:46.770089 27558 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
W20260709 12:11:46.793022 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.794431 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:46.794767 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:46.795272 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:46.795542 22601 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:46.795544 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:46.796558 22600 raft_consensus.cc:2393] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 11: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:46.770217 27475 raft_consensus.cc:697] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:46.800215 22605 raft_consensus.cc:1275] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 12:11:46.790663 27430 consensus_meta.cc:287] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.516s	user 0.007s	sys 0.002s
I20260709 12:11:46.808846 22497 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:46.820087 27477 consensus_meta.cc:287] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.582s	user 0.010s	sys 0.000s
I20260709 12:11:46.820706 27477 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:46.823287 22524 raft_consensus.cc:1240] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:11:46.798051 27558 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:46.826754 22601 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 13.
I20260709 12:11:46.808342 27087 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:46.840180 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:46.841012 22523 raft_consensus.cc:2393] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 12: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:46.841809 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:46.842360 22523 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 14.
I20260709 12:11:46.843472 27511 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.844192 27511 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:46.846865 27511 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:46.847755 27259 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:46.852321 27366 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:46.853052 27520 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:46.853188 22523 raft_consensus.cc:1240] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:46.854218 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:46.860258 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:46.862607 22523 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:46.853735 27558 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:46.864969 27225 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:46.866263 27558 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:46.822964 27477 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:46.856606 27475 consensus_queue.cc:237] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:46.811803 27430 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:46.857393 27449 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:46.867841 23123 raft_consensus.cc:2393] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 14: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:46.868793 27430 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:46.869743 27217 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:46.803485 26976 consensus_queue.cc:1048] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:11:46.870091 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:46.870677 23123 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:46.871934 22453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 939) took 1556 ms. Trace:
I20260709 12:11:46.872293 22453 rpcz_store.cc:276] 0709 12:11:45.315680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:45.421329 (+105649us) service_pool.cc:224] Handling call
0709 12:11:45.421644 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:45.491060 (+ 69416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:45.491104 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:45.527030 (+ 35926us) log.cc:844] Serialized 26 byte log entry
0709 12:11:45.841803 (+314773us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:46.194671 (+352868us) log.cc:844] Serialized 14 byte log entry
0709 12:11:46.194999 (+   328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:46.871573 (+676574us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b5400241b54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:46.871616 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:46.871660 (+    44us) raft_consensus.cc:1685] finished
0709 12:11:46.871751 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:46.871882 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63300,"prepare.queue_time_us":376857,"raft.queue_time_us":118776,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":37066,"spinlock_wait_cycles":40319744,"thread_start_us":561054,"threads_started":2,"wal-append.queue_time_us":410080}
W20260709 12:11:46.876686 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.StartTabletCopy -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 820933us
I20260709 12:11:46.877351 22421 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:46.879043 23123 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 12.
I20260709 12:11:46.879721 27469 raft_consensus.cc:2804] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:46.880167 27469 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:46.828083 27242 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:46.881590 22527 raft_consensus.cc:1275] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:11:46.825345 27399 consensus_queue.cc:1048] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 12:11:46.882875 22421 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:46.882876 22527 raft_consensus.cc:1240] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:11:46.884244 27509 raft_consensus.cc:2804] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:46.886071 27509 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.886497 27509 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:46.819190 27145 raft_consensus.cc:2749] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:46.884030 22496 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:11:46.837859 27551 log.cc:927] Time spent T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 12:11:46.897258 27119 raft_consensus.cc:2804] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:46.897746 27119 raft_consensus.cc:697] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
W20260709 12:11:46.881649 27472 consensus_meta.cc:287] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.825s	user 0.007s	sys 0.003s
I20260709 12:11:46.898775 27472 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:46.834534 27556 log.cc:927] Time spent T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 12:11:46.898628 27119 consensus_queue.cc:237] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:46.902127 22456 raft_consensus.cc:1240] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:11:46.884069 22421 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:46.880548 27469 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:46.907292 22527 raft_consensus.cc:1240] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:46.814808 27418 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:46.910808 22421 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:46.825577 27547 consensus_queue.cc:237] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:46.918377 22421 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:46.913518 27472 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:46.916383 22531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38310 (request call id 969) took 1169 ms. Trace:
I20260709 12:11:46.917161 27377 raft_consensus.cc:2749] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:46.919553 22531 rpcz_store.cc:276] 0709 12:11:45.747331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:45.747478 (+   147us) service_pool.cc:224] Handling call
0709 12:11:46.916110 (+1168632us) spinlock_profiling.cc:243] Waited 909 ms on lock 0x7b54004001d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:46.916294 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2089659136}
I20260709 12:11:46.920487 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:11:46.925268 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.930119 22523 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 14.
I20260709 12:11:46.930861 22525 raft_consensus.cc:1240] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:11:46.932561 22523 raft_consensus.cc:1240] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:46.925134 27110 raft_consensus.cc:2749] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:46.933496 27463 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:46.923285 26976 raft_consensus.cc:2804] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:46.938459 22523 raft_consensus.cc:1275] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:46.945314 22523 raft_consensus.cc:1240] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 9. Current term is 10. Ops: [9.11-9.11]
I20260709 12:11:46.953329 23087 leader_election.cc:400] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 election: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 16. Current term is 17.
I20260709 12:11:46.956269 23087 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:46.958792 23087 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:46.976028 23087 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:46.977665 22526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38310 (request call id 965) took 1278 ms. Trace:
I20260709 12:11:46.978061 22526 rpcz_store.cc:276] 0709 12:11:45.699661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:45.699833 (+   172us) service_pool.cc:224] Handling call
0709 12:11:46.977522 (+1277689us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b5400262354. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:46.977613 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":565055872}
I20260709 12:11:46.943852 26976 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:46.996232 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 182977us
I20260709 12:11:47.003295 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:46.998080 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:46.937330 27473 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:46.969591 27243 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:46.986233 27405 raft_consensus.cc:2749] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:46.986495 27449 raft_consensus.cc:2749] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:46.987172 27418 raft_consensus.cc:2749] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:46.993881 26976 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:46.988512 27430 consensus_queue.cc:1048] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.040s
W20260709 12:11:47.037254 27523 consensus_meta.cc:287] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.973s	user 0.008s	sys 0.005s
W20260709 12:11:47.075860 27557 log.cc:927] Time spent T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.331s	user 0.002s	sys 0.002s
I20260709 12:11:47.071728 27511 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:47.088511 27511 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:47.093175 27470 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:47.066555 27243 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:47.105867 27243 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:47.058187 27523 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:47.109655 27518 consensus_meta.cc:287] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 1.000s	user 0.013s	sys 0.000s
I20260709 12:11:47.114108 27507 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.115641 23117 raft_consensus.cc:1240] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:11:47.118331 27507 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:47.121133 27507 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:47.120929 26770 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:47.122110 22528 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 13.
I20260709 12:11:47.125311 27509 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:47.126768 26770 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:47.127879 27473 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:47.128029 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:47.137549 22603 raft_consensus.cc:2368] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 13. Current term is 14.
I20260709 12:11:47.139765 27243 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:47.139920 22497 leader_election.cc:400] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 election: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 13. Current term is 14.
I20260709 12:11:47.140311 22497 leader_election.cc:403] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:11:47.141031 26770 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:47.111513 27511 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:47.146852 27523 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:47.148962 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:47.126425 22526 raft_consensus.cc:1275] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:11:47.114383 27518 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:47.162020 27518 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:47.169196 22606 raft_consensus.cc:2393] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 15: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:47.176725 27509 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:47.188938 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 269013us
I20260709 12:11:47.192370 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:47.193130 22603 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:47.194082 27469 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:47.196892 27469 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:47.200676 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:47.201282 23118 raft_consensus.cc:3060] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:47.201504 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:47.201757 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:47.202728 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:47.202971 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:47.203454 23124 raft_consensus.cc:2393] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 12: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:47.203763 23119 raft_consensus.cc:2393] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 12: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:47.204190 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:47.206538 23116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 1169) took 1208 ms. Trace:
I20260709 12:11:47.206967 23116 rpcz_store.cc:276] 0709 12:11:45.998136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:45.998280 (+   144us) service_pool.cc:224] Handling call
0709 12:11:46.034923 (+ 36643us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:46.068040 (+ 33117us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:46.068074 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:46.068548 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 12:11:46.253331 (+184783us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:46.284622 (+ 31291us) log.cc:844] Serialized 14 byte log entry
0709 12:11:46.284862 (+   240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:47.206080 (+921218us) spinlock_profiling.cc:243] Waited 32.7 ms on lock 0x7b5400750154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:47.206145 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:47.206205 (+    60us) raft_consensus.cc:1685] finished
0709 12:11:47.206300 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:47.206464 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7691,"prepare.queue_time_us":34863,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":10639,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":45850,"spinlock_wait_cycles":75312896,"thread_start_us":184388,"threads_started":1,"wal-append.queue_time_us":375176}
I20260709 12:11:47.209544 22496 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:47.209789 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:47.213064 27558 raft_consensus.cc:2749] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:47.214288 22496 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:47.215042 27558 raft_consensus.cc:2749] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:47.216384 23118 raft_consensus.cc:2468] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 10.
I20260709 12:11:47.218334 22496 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:47.219095 27558 raft_consensus.cc:2804] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:47.219604 27558 raft_consensus.cc:697] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:47.220568 27558 consensus_queue.cc:237] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:47.221364 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.193769 26976 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:47.224085 27555 log.cc:927] Time spent T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.688s	user 0.003s	sys 0.000s
I20260709 12:11:47.224699 26976 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:47.225973 22599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45576 (request call id 2935) took 1679 ms (client timeout 1755 ms). Trace:
W20260709 12:11:47.226305 22448 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2690) took 1482 ms (client timeout 1740 ms). Trace:
W20260709 12:11:47.226769 22448 rpcz_store.cc:269] 0709 12:11:45.744260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:45.846728 (+102468us) service_pool.cc:224] Handling call
0709 12:11:47.226127 (+1379399us) spinlock_profiling.cc:243] Waited 703 ms on lock 0x7b5400389fd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:47.226215 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1617414400}
I20260709 12:11:47.227150 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:11:47.226368 22599 rpcz_store.cc:269] 0709 12:11:45.546367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:45.547391 (+  1024us) service_pool.cc:224] Handling call
0709 12:11:47.225790 (+1678399us) spinlock_profiling.cc:243] Waited 609 ms on lock 0x7b54003ae3d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:47.225916 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1399901440}
I20260709 12:11:47.228911 22495 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:47.230918 27400 raft_consensus.cc:2804] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:47.231297 27400 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:47.231633 27400 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:47.244699 22603 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 15.
I20260709 12:11:47.246380 22422 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:11:47.265931 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.259334 27469 raft_consensus.cc:2804] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:11:47.273757 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:47.289355 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 97932.5us
I20260709 12:11:47.272851 27469 raft_consensus.cc:697] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 15 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:47.296507 27475 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
W20260709 12:11:47.300510 27593 log.cc:927] Time spent T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:11:47.302682 27475 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:47.304481 27104 raft_consensus.cc:3055] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:47.304915 27104 raft_consensus.cc:740] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:47.306013 27475 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:47.307479 27400 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:47.310310 27400 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:47.305795 27104 consensus_queue.cc:260] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:47.314998 22524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 2054) took 1043 ms. Trace:
I20260709 12:11:47.331981 22524 rpcz_store.cc:276] 0709 12:11:46.271732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:46.271848 (+   116us) service_pool.cc:224] Handling call
0709 12:11:46.287830 (+ 15982us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:46.824055 (+536225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:47.314572 (+490517us) spinlock_profiling.cc:243] Waited 535 ms on lock 0x7b540030f2d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:47.314893 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1230765824}
I20260709 12:11:47.316372 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:47.333070 22527 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:47.334064 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:47.334295 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:47.334594 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:47.335472 22523 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11.
I20260709 12:11:47.337029 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:47.337093 27469 consensus_queue.cc:237] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:47.341710 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:47.343235 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:47.343911 22526 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
I20260709 12:11:47.333976 22605 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 12.
I20260709 12:11:47.317233 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:47.320712 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:47.319757 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:47.321871 23125 raft_consensus.cc:1275] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:11:47.321568 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:47.323045 27514 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:47.348706 23116 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:47.349164 27514 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:11:47.351460 22497 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:47.352696 27514 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:47.352968 22497 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:47.353217 22602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:60938 (request call id 63) took 1106 ms. Trace:
I20260709 12:11:47.353615 22602 rpcz_store.cc:276] 0709 12:11:46.246726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:46.246872 (+   146us) service_pool.cc:224] Handling call
0709 12:11:47.353055 (+1106183us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b5400043654. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca928853 00007f9ccf8f660a 00007f9cc8e7c7d4 00007f9cc8e7c762 00007f9cc8e7c691 00007f9cc8e7c60c 00007f9cc8e7b8c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:47.353135 (+    80us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":839553920}
I20260709 12:11:47.333531 26770 raft_consensus.cc:2749] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 13. Current term is 14.
I20260709 12:11:47.320444 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:47.339022 27475 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.355139 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:47.355891 23123 raft_consensus.cc:2393] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 12: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:47.355471 27475 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:47.356786 27366 raft_consensus.cc:2804] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:47.357197 27366 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:47.357581 27366 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:47.358402 27475 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:47.330099 27549 log.cc:927] Time spent T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.620s	user 0.000s	sys 0.004s
I20260709 12:11:47.327862 22570 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:47.359876 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:47.360615 27516 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:47.364848 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:47.365552 23123 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
I20260709 12:11:47.366868 22496 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:47.368280 26770 raft_consensus.cc:2804] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:47.368711 26770 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.369088 26770 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:47.369975 27516 raft_consensus.cc:2749] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:47.373857 23116 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 15.
W20260709 12:11:47.374955 27582 log.cc:927] Time spent T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.230s	user 0.000s	sys 0.000s
I20260709 12:11:47.380640 22527 raft_consensus.cc:1275] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:47.383152 27475 raft_consensus.cc:2749] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:47.386032 23121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 1387) took 1282 ms. Trace:
I20260709 12:11:47.386610 22570 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:47.386400 23121 rpcz_store.cc:276] 0709 12:11:46.103849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:46.250795 (+146946us) service_pool.cc:224] Handling call
0709 12:11:46.251171 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:46.774686 (+523515us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:47.385779 (+611093us) spinlock_profiling.cc:243] Waited 522 ms on lock 0x7b5400759754. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:47.385978 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1199954688}
I20260709 12:11:47.396683 27463 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:47.425997 27282 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.400012 27507 consensus_queue.cc:1059] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 12:11:47.438570 27282 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:47.440927 27282 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:47.442904 23121 raft_consensus.cc:1275] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:47.425288 27366 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:47.451812 26770 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:47.452778 27366 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:47.453372 27366 consensus_queue.cc:1048] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:47.453794 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:47.400637 27514 consensus_queue.cc:1048] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
W20260709 12:11:47.485693 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.486857 26770 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:47.437731 27463 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:47.494464 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:47.496163 23121 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:47.497917 27463 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:47.498993 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:47.505573 23121 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 16.
I20260709 12:11:47.507243 27395 consensus_queue.cc:1048] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:11:47.508245 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.491223 27511 raft_consensus.cc:2804] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:11:47.513890 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 80062.2us
I20260709 12:11:47.516384 22496 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:47.517302 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:47.520368 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:47.519322 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:47.521077 22605 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:47.521685 26770 raft_consensus.cc:2804] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:47.522198 26770 raft_consensus.cc:697] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:47.524168 26770 consensus_queue.cc:237] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:47.526306 22570 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:47.527083 27511 raft_consensus.cc:697] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 15 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:47.527622 27611 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.528123 27611 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:47.528080 27511 consensus_queue.cc:237] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:47.532732 22452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2691) took 1787 ms. Trace:
I20260709 12:11:47.533170 22452 rpcz_store.cc:276] 0709 12:11:45.745338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:46.036512 (+291174us) service_pool.cc:224] Handling call
0709 12:11:46.036785 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:46.105627 (+ 68842us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:46.105656 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:46.121987 (+ 16331us) log.cc:844] Serialized 26 byte log entry
0709 12:11:46.284504 (+162517us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:46.284542 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:46.284600 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:47.202620 (+918020us) spinlock_profiling.cc:243] Waited 4.57 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:11:47.532398 (+329778us) raft_consensus.cc:1685] finished
0709 12:11:47.532424 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:47.532667 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68507,"raft.queue_time_us":71126,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":8839,"spinlock_wait_cycles":10501504,"thread_start_us":91743,"threads_started":1,"wal-append.queue_time_us":368881}
I20260709 12:11:47.536254 23121 raft_consensus.cc:1275] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:47.539764 22605 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 13.
W20260709 12:11:47.540606 27538 log.cc:927] Time spent T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 1.324s	user 0.004s	sys 0.000s
I20260709 12:11:47.540936 22497 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:47.542104 27571 raft_consensus.cc:2804] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:47.542603 27571 raft_consensus.cc:697] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:47.543041 23120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 1099) took 1690 ms. Trace:
I20260709 12:11:47.543444 27571 consensus_queue.cc:237] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:47.543398 23120 rpcz_store.cc:276] 0709 12:11:45.852569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:45.852917 (+   348us) service_pool.cc:224] Handling call
0709 12:11:45.853222 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:45.853523 (+   301us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:45.853556 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:45.875158 (+ 21602us) log.cc:844] Serialized 26 byte log entry
0709 12:11:46.155824 (+280666us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:46.155883 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:46.156701 (+   818us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:47.540068 (+1383367us) spinlock_profiling.cc:243] Waited 2.88 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:11:47.542754 (+  2686us) raft_consensus.cc:1685] finished
0709 12:11:47.542776 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:47.542964 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":34869,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"spinlock_wait_cycles":6615808,"thread_start_us":280168,"threads_started":1,"wal-append.queue_time_us":341314}
I20260709 12:11:47.544636 27463 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:47.545159 27463 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:47.552289 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:47.562232 22570 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:47.587456 27395 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:47.588063 27395 raft_consensus.cc:697] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:47.589007 27395 consensus_queue.cc:237] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:47.589509 27608 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:47.590101 27608 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:47.590780 27400 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:47.591302 27400 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:47.594286 27400 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:47.606604 27523 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:47.607358 27523 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:47.604995 22603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:11:47.609632 27523 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:47.609771 22603 raft_consensus.cc:606] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:11:47.611321 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:47.612190 22531 raft_consensus.cc:2393] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 10: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:47.563856 27507 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:47.609999 22606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45562 (request call id 2595) took 1076 ms. Trace:
I20260709 12:11:47.611999 22603 raft_consensus.cc:614] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:47.563306 27469 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:47.618296 22599 raft_consensus.cc:1275] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:47.620512 22606 rpcz_store.cc:276] 0709 12:11:46.533563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:46.536919 (+  3356us) service_pool.cc:224] Handling call
0709 12:11:47.609781 (+1072862us) spinlock_profiling.cc:243] Waited 629 ms on lock 0x7b54000e8b54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:47.609930 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1446103424}
I20260709 12:11:47.619055 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:47.614373 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 52229.6us
I20260709 12:11:47.625694 22570 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:47.629431 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 12:11:47.611340 27589 log.cc:927] Time spent T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.464s	user 0.002s	sys 0.000s
I20260709 12:11:47.631839 22570 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:47.637897 27608 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:47.639539 27611 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:47.632223 27558 consensus_queue.cc:1048] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:11:47.626922 27463 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:47.629870 27507 raft_consensus.cc:697] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:47.643699 27507 consensus_queue.cc:237] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:47.630172 27469 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:47.648967 27534 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:47.649302 27469 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:47.649689 27534 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:47.626734 27400 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.671569 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:47.655031 22570 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:47.632853 27609 raft_consensus.cc:2749] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:47.672915 27611 raft_consensus.cc:2764] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:11:47.655694 27534 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:47.707377 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:47.708128 22451 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:47.712673 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:47.713415 22448 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
I20260709 12:11:47.714537 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:47.717427 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:47.719259 22453 raft_consensus.cc:2393] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 15: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:47.721529 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:47.679436 27400 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:47.724948 22570 leader_election.cc:304] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:47.731163 27610 consensus_queue.cc:1059] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:47.744977 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:47.731694 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:47.739554 27605 consensus_queue.cc:1059] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:47.745651 22452 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
I20260709 12:11:47.748127 22451 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
I20260709 12:11:47.724874 27456 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:47.724241 27516 consensus_queue.cc:1048] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:11:47.720050 27607 consensus_queue.cc:1059] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:11:47.719112 27514 consensus_queue.cc:1059] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:11:47.748034 27470 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.759029 27608 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:47.761569 27400 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:47.764571 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:47.765609 22605 raft_consensus.cc:2410] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 12:11:47.769119 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.773625 22456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 2164) took 1692 ms. Trace:
I20260709 12:11:47.774070 22456 rpcz_store.cc:276] 0709 12:11:46.081133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:46.081313 (+   180us) service_pool.cc:224] Handling call
0709 12:11:46.081653 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:46.902606 (+820953us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:47.773320 (+870714us) spinlock_profiling.cc:243] Waited 820 ms on lock 0x7b54004051d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:47.773573 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1886230784}
I20260709 12:11:47.770658 22604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2587) took 1908 ms. Trace:
I20260709 12:11:47.775962 22604 rpcz_store.cc:276] 0709 12:11:45.862643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:45.863586 (+   943us) service_pool.cc:224] Handling call
0709 12:11:45.863929 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:46.062631 (+198702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:47.770375 (+1707744us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b54002dee54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:47.770586 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":455728384}
W20260709 12:11:47.788520 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.773810 27516 raft_consensus.cc:2749] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:11:47.807499 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 124852us
I20260709 12:11:47.855288 27463 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:47.856032 27463 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:47.859887 27463 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:47.860700 27473 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:47.861352 27473 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:47.774099 27470 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:47.864735 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.869091 27470 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:47.916931 27610 raft_consensus.cc:3055] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:47.964529 27610 raft_consensus.cc:740] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:47.965772 27610 consensus_queue.cc:260] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:47.967490 27618 log.cc:927] Time spent T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:11:47.967507 27610 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:48.005110 27630 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.005688 27630 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:48.007872 27630 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:48.023419 23117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 1386) took 1922 ms. Trace:
I20260709 12:11:48.027832 23117 rpcz_store.cc:276] 0709 12:11:46.100542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:46.109310 (+  8768us) service_pool.cc:224] Handling call
0709 12:11:46.134142 (+ 24832us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:47.118336 (+984194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:48.023110 (+904774us) spinlock_profiling.cc:243] Waited 981 ms on lock 0x7b54006400d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:48.023351 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2256599424}
I20260709 12:11:48.096128 27472 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.102779 27472 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:48.110213 27472 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:48.117653 22528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56940 (request call id 2352) took 1608 ms. Trace:
I20260709 12:11:48.118119 22528 rpcz_store.cc:276] 0709 12:11:46.509045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:46.764689 (+255644us) service_pool.cc:224] Handling call
0709 12:11:48.117462 (+1352773us) spinlock_profiling.cc:243] Waited 354 ms on lock 0x7b54000d4dd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:48.117586 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":814970752}
I20260709 12:11:48.143088 27473 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:48.195809 27624 log.cc:927] Time spent T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.226s	user 0.001s	sys 0.001s
I20260709 12:11:48.213400 27518 raft_consensus.cc:3055] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:48.213913 27518 raft_consensus.cc:740] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:48.214818 27518 consensus_queue.cc:260] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:48.235260 27425 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:48.235920 27425 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:48.238185 27425 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:48.239310 22569 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.027s	sys 0.032s
W20260709 12:11:48.239678 22569 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.027s	sys 0.032s
I20260709 12:11:48.241904 27630 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:48.242378 27630 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:48.244336 27630 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:48.244797 27630 consensus_queue.cc:1048] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:48.260043 27511 consensus_queue.cc:1048] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:48.265208 22569 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:48.270869 27507 raft_consensus.cc:2804] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:48.271341 27507 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:48.271705 27507 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:48.279656 27507 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:48.284924 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:48.285259 23088 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:48.285562 22457 raft_consensus.cc:2468] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
I20260709 12:11:48.285674 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:48.284546 22569 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:48.286410 27507 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:48.295534 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:48.296141 22455 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:48.296567 27503 raft_consensus.cc:2804] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:48.288426 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:48.297158 27503 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:48.286412 22451 raft_consensus.cc:2393] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 12: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:48.297595 27503 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:48.298636 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:48.299309 22451 raft_consensus.cc:2368] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 13. Current term is 14.
I20260709 12:11:48.289975 27425 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:48.300805 27425 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:48.303031 27518 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:48.303208 22455 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 12.
I20260709 12:11:48.287175 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:48.302868 27425 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:48.305107 22452 raft_consensus.cc:2410] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:11:48.304539 22569 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:48.286749 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:48.292870 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:48.307492 22457 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 12.
I20260709 12:11:48.292479 22453 raft_consensus.cc:1240] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:48.288792 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:48.297598 22448 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 14.
I20260709 12:11:48.293550 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:48.311635 22450 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:48.314316 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:48.314847 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:48.316262 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:48.317042 22598 raft_consensus.cc:2410] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:11:48.320314 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:48.311718 27604 raft_consensus.cc:2804] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:48.322007 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:48.325742 22450 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 13.
I20260709 12:11:48.326920 27503 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:48.329401 27503 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:11:48.330097 27514 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.013s	sys 0.018s
W20260709 12:11:48.330489 27514 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.014s	sys 0.019s
I20260709 12:11:48.332605 27523 raft_consensus.cc:2804] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:11:48.333387 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.334899 27604 raft_consensus.cc:697] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:48.313297 27023 consensus_queue.cc:1059] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:11:48.339908 27604 consensus_queue.cc:237] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:48.324224 23088 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:48.345811 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:48.347795 22457 raft_consensus.cc:3055] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:48.349413 22448 raft_consensus.cc:1275] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 12:11:48.349686 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.350417 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:48.350850 27023 raft_consensus.cc:3055] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:48.351290 27023 raft_consensus.cc:740] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:48.352121 22453 raft_consensus.cc:1275] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:48.348181 22457 raft_consensus.cc:740] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:48.353981 22457 consensus_queue.cc:260] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:48.356804 22457 raft_consensus.cc:3060] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:48.366335 22451 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 12.
W20260709 12:11:48.389114 27620 log.cc:927] Time spent T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.419s	user 0.001s	sys 0.001s
I20260709 12:11:48.392481 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:11:48.397776 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 514761us
I20260709 12:11:48.403849 27352 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:48.404361 27352 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:48.406338 27352 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:48.371798 27523 raft_consensus.cc:697] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 11 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:48.407482 27523 consensus_queue.cc:237] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:48.410233 22495 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:48.412220 22495 leader_election.cc:400] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 election: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 13. Current term is 14.
I20260709 12:11:48.399721 27119 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:48.400146 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.416047 22602 raft_consensus.cc:2410] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:11:48.418107 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:48.352154 27023 consensus_queue.cc:260] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:48.415964 22495 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:48.422101 22457 raft_consensus.cc:1275] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 11. (term mismatch)
I20260709 12:11:48.422403 22457 pending_rounds.cc:85] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f: Aborting all ops after (but not including) 10
I20260709 12:11:48.422612 22457 pending_rounds.cc:107] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f: Aborting uncommitted NO_OP operation due to leader change: 9.11
I20260709 12:11:48.422842 22457 raft_consensus.cc:2889] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:48.380954 27639 raft_consensus.cc:2804] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:11:48.425931 22570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.007s	sys 0.006s
W20260709 12:11:48.426239 22570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.007s	sys 0.006s
W20260709 12:11:48.426654 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 701762us
I20260709 12:11:48.427511 22570 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:48.428400 22570 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:48.430127 22570 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:48.434959 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:48.435577 22530 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 6.
W20260709 12:11:48.436553 23087 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 2.176s (SENT) [suppressed 8 similar messages]
I20260709 12:11:48.420938 27558 raft_consensus.cc:2804] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:48.443184 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:48.449234 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:48.431981 27243 raft_consensus.cc:2749] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:48.449882 23124 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:11:48.436201 27514 raft_consensus.cc:2764] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:11:48.450573 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:48.444922 27023 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:48.437359 27639 raft_consensus.cc:697] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 14 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
W20260709 12:11:48.457926 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 133752us
I20260709 12:11:48.442062 27558 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:48.421372 27119 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:48.476405 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:48.436365 27518 consensus_queue.cc:1059] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
W20260709 12:11:48.559019 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.567725 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:48.568570 22532 raft_consensus.cc:1240] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:48.569139 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:48.570223 22570 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:48.571317 27514 raft_consensus.cc:2804] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:48.572067 22570 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:48.572178 27514 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:48.572834 27514 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:48.572918 27503 raft_consensus.cc:2804] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:48.573426 27503 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:48.573855 27503 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:48.580466 27425 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.580792 27507 consensus_queue.cc:1059] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:48.581094 27425 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:48.471910 27604 raft_consensus.cc:2804] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:48.594569 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.476733 27558 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:48.584400 27243 raft_consensus.cc:3055] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:48.566314 27607 consensus_queue.cc:1059] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:11:48.592622 27604 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:48.612948 27243 raft_consensus.cc:740] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:48.631274 27604 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:48.818480 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.691473 27641 consensus_queue.cc:1048] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.212s
I20260709 12:11:48.692502 27569 raft_consensus.cc:2804] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:48.676960 27639 consensus_queue.cc:237] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:48.690616 27628 consensus_queue.cc:1048] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.303s
W20260709 12:11:48.833026 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:48.834786 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 415594us
I20260709 12:11:48.832440 27469 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:48.893903 27644 log.cc:927] Time spent T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.442s	user 0.008s	sys 0.000s
I20260709 12:11:48.833910 27425 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:48.913676 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 497802us
I20260709 12:11:48.932909 22495 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:48.947036 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.897903 27569 raft_consensus.cc:697] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:48.895596 27400 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:48.968640 22525 raft_consensus.cc:1275] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:48.969959 23125 raft_consensus.cc:1275] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:11:48.918615 27523 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:48.912516 27650 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:48.927433 27469 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:48.971997 22478 debug-util.cc:398] Leaking SignalData structure 0x7b080037cf00 after lost signal to thread 21269
W20260709 12:11:48.994135 22478 debug-util.cc:398] Leaking SignalData structure 0x7b080033c060 after lost signal to thread 22389
I20260709 12:11:48.935034 27243 consensus_queue.cc:260] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:48.974534 27643 log.cc:927] Time spent T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.383s	user 0.000s	sys 0.000s
I20260709 12:11:48.975530 27119 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:48.975971 27646 log.cc:927] Time spent T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.384s	user 0.000s	sys 0.001s
I20260709 12:11:48.976691 27507 consensus_queue.cc:1048] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:11:48.979305 27352 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:48.985374 22421 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.066s	user 0.025s	sys 0.016s
I20260709 12:11:48.959498 22495 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:48.986374 27558 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:49.003146 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:49.008929 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 49553.1us
I20260709 12:11:49.009765 22495 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:49.023792 22495 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:48.967751 27400 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:49.029811 22526 raft_consensus.cc:2410] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:11:48.996652 27650 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:49.013815 27243 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:48.999852 27523 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:49.001312 27503 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:11:49.048584 27647 raft_consensus.cc:2749] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:49.049369 27647 raft_consensus.cc:2804] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:49.049749 27647 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:49.050091 27647 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:49.028728 27569 consensus_queue.cc:237] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:49.052742 27282 consensus_queue.cc:1059] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:49.053807 27282 raft_consensus.cc:2804] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:49.054175 27282 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:49.054557 27282 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:49.056324 27650 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:49.056532 27395 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.241s	user 0.041s	sys 0.035s
I20260709 12:11:49.056932 27650 raft_consensus.cc:3055] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:49.057282 27650 raft_consensus.cc:740] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:49.057683 27400 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:49.058240 27650 consensus_queue.cc:260] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:49.061501 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.059792 27650 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:49.065791 27558 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:49.068128 27604 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:49.069850 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.012152 27352 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:49.028352 27642 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:49.063042 27512 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:49.074285 27514 consensus_meta.cc:287] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.501s	user 0.004s	sys 0.011s
W20260709 12:11:49.086365 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 114886us
W20260709 12:11:49.088132 22421 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.169s	user 0.025s	sys 0.016s
W20260709 12:11:49.089200 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 2.17076e+06us
W20260709 12:11:49.095120 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.095965 27518 consensus_queue.cc:1048] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:49.098611 27518 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:49.099464 27518 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:49.103492 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:49.108718 27518 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:49.109040 27269 consensus_queue.cc:1048] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:49.111508 27477 raft_consensus.cc:2749] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:49.112664 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:49.113423 22598 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 13.
I20260709 12:11:49.124892 22457 raft_consensus.cc:1275] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:49.124938 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:49.125969 23125 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
I20260709 12:11:49.130888 22570 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:49.131839 27518 raft_consensus.cc:2804] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:49.132361 27518 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:49.132879 27518 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:49.134496 22451 raft_consensus.cc:1275] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:11:49.136327 23117 raft_consensus.cc:1275] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:49.141333 22448 raft_consensus.cc:1240] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 14. Current term is 15. Ops: [12.10-14.11]
I20260709 12:11:49.145246 27605 raft_consensus.cc:3055] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:49.145687 27605 raft_consensus.cc:740] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:49.146493 27605 consensus_queue.cc:260] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:49.147428 22530 raft_consensus.cc:1240] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 LEADER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:49.147468 27605 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:49.149753 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:49.151922 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:49.152504 22451 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
I20260709 12:11:49.153524 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:49.154305 22457 raft_consensus.cc:2410] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 12:11:49.158167 27621 log.cc:927] Time spent T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 1.188s	user 0.001s	sys 0.002s
I20260709 12:11:49.161921 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:49.162671 22457 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:49.166342 27525 consensus_queue.cc:1048] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:11:49.172287 23087 leader_election.cc:336] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.850s (SENT)
I20260709 12:11:49.172881 23087 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:49.175199 27666 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:49.175690 27666 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:49.177279 27657 raft_consensus.cc:2749] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:49.177781 27666 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:49.178066 27657 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:49.178675 27657 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:49.182647 27470 consensus_queue.cc:1059] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:49.183131 27641 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.183799 27641 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:49.186179 27516 raft_consensus.cc:3055] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:49.181543 27657 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:49.186246 27641 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:49.190125 27641 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:49.190814 27641 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:49.186888 27516 raft_consensus.cc:740] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:49.193794 27641 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:49.194080 27516 consensus_queue.cc:260] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:49.195919 27516 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:49.210441 27571 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.596s	user 0.029s	sys 0.026s
W20260709 12:11:49.210959 27571 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.597s	user 0.029s	sys 0.026s
I20260709 12:11:49.212391 23121 raft_consensus.cc:1240] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:11:49.213899 27507 consensus_queue.cc:1059] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:11:49.215255 27511 raft_consensus.cc:3055] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:49.215709 27511 raft_consensus.cc:740] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:49.216696 27511 consensus_queue.cc:260] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:49.218212 27511 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:49.224099 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:49.224987 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:49.225585 22353 catalog_manager.cc:5697] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 10 to 14, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 14 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:49.229614 22525 raft_consensus.cc:1240] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:49.086822 27395 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.271s	user 0.042s	sys 0.036s
I20260709 12:11:49.234917 22451 raft_consensus.cc:1275] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:49.237160 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:49.239126 22531 raft_consensus.cc:1275] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:49.240877 22353 catalog_manager.cc:5697] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 10 to 11, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 11 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
W20260709 12:11:49.250240 27653 log.cc:927] Time spent T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.207s	user 0.000s	sys 0.000s
I20260709 12:11:49.254168 27352 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:49.260087 27605 raft_consensus.cc:3055] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:49.260675 27605 raft_consensus.cc:740] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:49.261722 27605 consensus_queue.cc:260] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:49.087880 27512 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:49.264142 27503 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:49.265411 27512 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:49.267601 27604 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:49.268802 27469 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:49.270077 27469 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
W20260709 12:11:49.272428 22478 debug-util.cc:398] Leaking SignalData structure 0x7b08000e41e0 after lost signal to thread 22481
W20260709 12:11:49.272827 22478 debug-util.cc:398] Leaking SignalData structure 0x7b08000e4200 after lost signal to thread 22482
I20260709 12:11:49.274106 23116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 1125) took 1761 ms. Trace:
I20260709 12:11:49.091678 27514 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:49.278507 27514 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:49.241202 27523 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:49.274590 23116 rpcz_store.cc:276] 0709 12:11:47.512875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.513026 (+   151us) service_pool.cc:224] Handling call
0709 12:11:47.513339 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:47.515134 (+  1795us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:47.515166 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:47.515629 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 12:11:47.809667 (+294038us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:47.809722 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:47.809806 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:49.273823 (+1464017us) raft_consensus.cc:1685] finished
0709 12:11:49.273856 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:49.274034 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":125,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":2366,"thread_start_us":240276,"threads_started":1,"wal-append.queue_time_us":375542,"wal-append.run_cpu_time_us":1904,"wal-append.run_wall_time_us":1068179}
W20260709 12:11:49.281329 27023 consensus_meta.cc:287] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.805s	user 0.011s	sys 0.000s
I20260709 12:11:49.287184 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:49.287856 23117 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
I20260709 12:11:49.081825 27642 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:49.285673 27104 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:49.297524 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:49.298302 23116 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:49.293380 23089 connection.cc:256] RPC call timeout handler was delayed by -1.0686538519998976s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17830000000000001s for a response
I20260709 12:11:49.293526 22570 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:11:49.294004 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:49.294335 22478 debug-util.cc:398] Leaking SignalData structure 0x7b08000e4100 after lost signal to thread 22556
W20260709 12:11:49.300823 22478 debug-util.cc:398] Leaking SignalData structure 0x7b08000e40e0 after lost signal to thread 22557
I20260709 12:11:49.295987 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:11:49.303808 22478 debug-util.cc:398] Leaking SignalData structure 0x7b0800420620 after lost signal to thread 22630
W20260709 12:11:49.304169 22478 debug-util.cc:398] Leaking SignalData structure 0x7b08003f3880 after lost signal to thread 22631
W20260709 12:11:49.305624 22478 debug-util.cc:398] Leaking SignalData structure 0x7b08002279c0 after lost signal to thread 23149
W20260709 12:11:49.305958 22478 debug-util.cc:398] Leaking SignalData structure 0x7b08003f8160 after lost signal to thread 23150
W20260709 12:11:49.306571 22478 debug-util.cc:398] Leaking SignalData structure 0x7b0800326120 after lost signal to thread 27369
W20260709 12:11:49.311645 22478 debug-util.cc:398] Leaking SignalData structure 0x7b0800384120 after lost signal to thread 27560
I20260709 12:11:49.320789 23089 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:11:49.327522 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 303824us
I20260709 12:11:49.334270 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:49.337020 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:49.338841 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:49.270671 27469 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:49.344241 22598 raft_consensus.cc:1240] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:49.319705 27628 raft_consensus.cc:2804] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:49.327235 27604 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.359705 22605 raft_consensus.cc:1240] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:49.360741 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:49.361375 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:49.342203 27512 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.319782 27641 consensus_queue.cc:1048] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:11:49.369608 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:49.370811 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:49.402422 22599 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 13.
I20260709 12:11:49.392191 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:49.404660 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:49.405659 22603 raft_consensus.cc:2393] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 11: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
W20260709 12:11:49.378262 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 57599.9us
I20260709 12:11:49.374022 22495 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:49.410071 23116 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
I20260709 12:11:49.412667 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:49.412990 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:49.153894 27518 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:49.422775 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:49.435171 22604 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 13.
I20260709 12:11:49.435582 23089 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:49.436069 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:49.424573 22570 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:49.437435 27023 raft_consensus.cc:2804] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:49.437973 27023 raft_consensus.cc:697] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:49.438378 27666 raft_consensus.cc:2749] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:49.410844 27512 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:49.438941 27023 consensus_queue.cc:237] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:49.439474 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:49.447585 27668 log.cc:927] Time spent T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:11:49.448371 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:49.448710 27642 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:49.449872 22601 raft_consensus.cc:1275] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 12:11:49.450212 22601 pending_rounds.cc:85] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting all ops after (but not including) 9
I20260709 12:11:49.450469 22601 pending_rounds.cc:107] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:11:49.450711 22601 raft_consensus.cc:2889] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:49.390264 27523 raft_consensus.cc:2749] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:49.421800 22600 raft_consensus.cc:2468] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 7.
I20260709 12:11:49.400190 27628 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:49.431597 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 57693.4us
I20260709 12:11:49.431815 26770 raft_consensus.cc:2804] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:49.459793 26770 raft_consensus.cc:697] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:49.434051 22497 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:49.442152 27512 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:49.451128 27647 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:49.451937 27547 consensus_queue.cc:1059] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:11:49.464342 23123 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.061s	sys 0.089s
W20260709 12:11:49.464815 23123 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.061s	sys 0.089s
I20260709 12:11:49.465575 23123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 1399) took 1031 ms. Trace:
I20260709 12:11:49.416484 22457 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 15.
I20260709 12:11:49.459280 22495 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:49.465950 23123 rpcz_store.cc:276] 0709 12:11:48.434125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.434275 (+   150us) service_pool.cc:224] Handling call
0709 12:11:48.436706 (+  2431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:48.436892 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:11:48.945355 (+508463us) log.cc:844] Serialized 14 byte log entry
0709 12:11:49.465249 (+519894us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:49.465301 (+    52us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:49.465352 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:49.465417 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:49.465524 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7760,"prepare.queue_time_us":143266,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"thread_start_us":1013059,"threads_started":2}
W20260709 12:11:49.444419 27670 log.cc:927] Time spent T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:11:49.474255 26770 consensus_queue.cc:237] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:49.474973 23124 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.847s	user 0.015s	sys 0.032s
W20260709 12:11:49.495277 23124 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.885s	user 0.015s	sys 0.032s
I20260709 12:11:49.476307 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:49.496040 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:49.475931 23089 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
W20260709 12:11:49.498294 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 61627.9us
I20260709 12:11:49.501770 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:49.503405 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:49.494508 22495 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:49.406383 27604 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:49.494006 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 400477us
I20260709 12:11:49.504865 23123 raft_consensus.cc:1275] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:49.506333 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:49.462460 27642 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.474793 27477 raft_consensus.cc:2804] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:49.525911 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:49.463008 27628 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:49.516690 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:49.529371 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:49.519547 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 333870us
I20260709 12:11:49.533737 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:49.506521 27648 raft_consensus.cc:3055] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:49.499614 27569 raft_consensus.cc:2749] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:49.511000 27523 raft_consensus.cc:2804] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:49.542824 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:49.544301 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:49.524922 27547 raft_consensus.cc:2804] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:11:49.511019 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.475425 27475 consensus_queue.cc:1059] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 12:11:49.539551 22454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2719) took 1193 ms. Trace:
I20260709 12:11:49.530148 27477 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:49.538683 27648 raft_consensus.cc:740] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:49.568361 23124 raft_consensus.cc:2393] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 12: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
W20260709 12:11:49.583127 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.583997 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:49.509366 27400 consensus_queue.cc:1048] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
W20260709 12:11:49.586580 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.515607 27512 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:49.588073 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:49.589416 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:49.509152 27119 consensus_queue.cc:1048] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
W20260709 12:11:49.644291 22527 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.013s	sys 0.015s
W20260709 12:11:49.644847 22527 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.013s	sys 0.015s
I20260709 12:11:49.535249 27677 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:49.542521 22569 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:49.621758 23123 raft_consensus.cc:3055] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:49.668578 23123 raft_consensus.cc:740] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:49.624996 22451 raft_consensus.cc:2468] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
I20260709 12:11:49.525085 27399 consensus_queue.cc:1048] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 12:11:49.547456 27523 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:49.631685 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:49.644709 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:49.695549 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:49.596268 22454 rpcz_store.cc:276] 0709 12:11:48.345869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.346716 (+   847us) service_pool.cc:224] Handling call
0709 12:11:48.346953 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:48.347190 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:48.355718 (+  8528us) log.cc:844] Serialized 14 byte log entry
0709 12:11:49.164123 (+808405us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b1800373c60. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cca4d64bc 00007f9cc782448b 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc7840c02 00007f9cca4c820b 00007f9cca4cdd23 00007f9cca4ce23a
0709 12:11:49.539212 (+375089us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:49.539267 (+    55us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:49.539318 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:49.539383 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:49.539492 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3191,"prepare.queue_time_us":8396,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":105559,"raft.run_cpu_time_us":66,"raft.run_wall_time_us":66,"spinlock_wait_cycles":5320064,"thread_start_us":387658,"threads_started":2,"wal-append.queue_time_us":69773}
I20260709 12:11:49.697077 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:49.698463 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:49.669710 23123 consensus_queue.cc:260] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:49.700125 22454 raft_consensus.cc:2410] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
W20260709 12:11:49.582336 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 484571us
I20260709 12:11:49.646739 22456 raft_consensus.cc:2393] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 12: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:49.700532 23123 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:49.702325 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.702396 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:49.529762 27642 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:49.621487 27477 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:49.546139 27395 consensus_queue.cc:1048] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 12:11:49.546265 27503 consensus_queue.cc:1048] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.088s
I20260709 12:11:49.579275 27607 consensus_queue.cc:1048] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.060s
I20260709 12:11:49.649686 27512 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:49.666478 23119 raft_consensus.cc:1240] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 14 LEADER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:11:49.704885 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:49.708096 22457 raft_consensus.cc:2393] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 15: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:49.660897 27145 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:49.672292 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 129852us
I20260709 12:11:49.641558 27525 consensus_queue.cc:1059] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:11:49.724802 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:49.736783 22454 raft_consensus.cc:2393] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 14: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:49.654558 27569 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.726018 22569 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:49.665943 27518 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:49.726135 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:49.695472 27523 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:49.748725 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:49.755841 22454 raft_consensus.cc:2393] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 14: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:49.756106 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:49.756687 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:49.756909 22457 raft_consensus.cc:2393] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 12: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
W20260709 12:11:49.750020 23087 leader_election.cc:336] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.528s (SENT)
I20260709 12:11:49.764061 23087 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:49.764364 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:49.680956 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:49.770200 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:49.777412 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:49.783926 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:49.785125 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:49.786703 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:49.787156 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:49.787578 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:49.736613 27469 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:49.800396 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:11:49.800709 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 74814.5us
I20260709 12:11:49.792626 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:49.803014 23117 raft_consensus.cc:1240] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:11:49.803210 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:49.803571 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:49.803894 22451 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 12.
I20260709 12:11:49.814388 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:49.814646 22528 raft_consensus.cc:1275] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:49.793740 22523 raft_consensus.cc:1240] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 LEADER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:49.795274 22524 raft_consensus.cc:1240] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 LEADER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
W20260709 12:11:49.802482 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.816697 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:49.656009 27677 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:49.778187 27525 raft_consensus.cc:2749] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:49.783842 27518 raft_consensus.cc:3055] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:49.783571 27645 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.824815 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:49.824949 22569 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:49.825456 22526 raft_consensus.cc:2468] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 10.
I20260709 12:11:49.823446 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:49.792879 22454 raft_consensus.cc:2393] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 10: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
W20260709 12:11:49.818678 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.828100 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:49.815146 22457 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 17.
I20260709 12:11:49.829203 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:49.793501 27641 raft_consensus.cc:2749] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:49.746397 27145 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:49.817780 23121 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.011s	sys 0.028s
I20260709 12:11:49.824349 23087 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:49.816287 23124 raft_consensus.cc:1240] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 9. Current term is 10. Ops: [9.11-9.11]
I20260709 12:11:49.831367 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:49.822003 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:49.826812 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:11:49.832352 23121 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.011s	sys 0.028s
I20260709 12:11:49.833081 23117 raft_consensus.cc:2410] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:11:49.830367 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:49.817020 27676 log.cc:927] Time spent T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
I20260709 12:11:49.763720 27569 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:49.836089 22450 raft_consensus.cc:2393] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 12: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:49.800495 27680 raft_consensus.cc:2804] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:49.843175 27680 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:49.837988 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:49.815241 27604 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:49.841755 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:49.845177 22569 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:49.836630 27395 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.846249 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:49.837946 27282 consensus_meta.cc:287] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.773s	user 0.011s	sys 0.007s
I20260709 12:11:49.840072 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:49.847512 22450 raft_consensus.cc:1240] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 12. Current term is 13. Ops: [10.9-12.10]
I20260709 12:11:49.847565 23087 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:49.838954 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:49.845116 22353 catalog_manager.cc:5697] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:11:49.879738 23123 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:49.830642 27518 raft_consensus.cc:740] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:49.850915 23117 raft_consensus.cc:2393] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 12: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:49.841141 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:49.883698 23087 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:49.883701 26770 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.884984 26770 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:49.886023 22451 raft_consensus.cc:2410] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:11:49.836675 27645 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:49.843777 27525 consensus_queue.cc:1048] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 12:11:49.887506 27469 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.908629 27399 consensus_queue.cc:1048] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:11:49.907902 27350 tablet_copy_client.cc:538] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:11:49.840011 27607 raft_consensus.cc:2749] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:49.922021 27145 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:49.930706 27511 consensus_meta.cc:287] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.712s	user 0.008s	sys 0.005s
I20260709 12:11:49.909087 27512 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:49.941015 22602 raft_consensus.cc:1275] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 12:11:49.933094 22599 raft_consensus.cc:1275] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:49.941387 22602 pending_rounds.cc:85] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc: Aborting all ops after (but not including) 12
I20260709 12:11:49.941663 22602 pending_rounds.cc:107] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 12:11:49.941880 22602 raft_consensus.cc:2889] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:49.919361 22452 raft_consensus.cc:3055] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:49.942369 22452 raft_consensus.cc:740] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:49.911635 27642 leader_election.cc:290] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:49.943178 22452 consensus_queue.cc:260] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:49.944648 27677 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:11:49.928948 27243 consensus_meta.cc:287] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.886s	user 0.008s	sys 0.002s
I20260709 12:11:49.946925 22605 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 10.
W20260709 12:11:49.915616 27684 log.cc:927] Time spent T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
W20260709 12:11:49.914364 27672 log.cc:927] Time spent T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.213s	user 0.000s	sys 0.000s
W20260709 12:11:49.916455 27692 log.cc:927] Time spent T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
W20260709 12:11:49.908470 22557 heartbeater.cc:646] Failed to heartbeat to 127.20.196.190:44877 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.20.196.190:44877 timed out after 15.000s (SENT)
W20260709 12:11:49.933221 27516 consensus_meta.cc:287] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.737s	user 0.009s	sys 0.000s
I20260709 12:11:49.949846 22597 raft_consensus.cc:2468] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
W20260709 12:11:49.915606 27682 log.cc:927] Time spent T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 12:11:49.938730 27469 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:49.919797 27104 consensus_meta.cc:287] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.616s	user 0.008s	sys 0.002s
I20260709 12:11:49.954196 27469 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:49.954864 27514 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.955557 27514 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:49.917815 27675 log.cc:927] Time spent T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.332s	user 0.001s	sys 0.000s
I20260709 12:11:49.956844 22606 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 14.
I20260709 12:11:49.959949 27645 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:49.960331 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:49.961207 22449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2700) took 1677 ms. Trace:
I20260709 12:11:49.961374 22603 raft_consensus.cc:2410] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 12:11:49.961594 22449 rpcz_store.cc:276] 0709 12:11:48.283414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.288932 (+  5518us) service_pool.cc:224] Handling call
0709 12:11:48.289204 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:48.289548 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:48.289578 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:49.114169 (+824591us) spinlock_profiling.cc:243] Waited 26.8 ms on lock 0x7b2c00033c98. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc9227a11 00007f9cc9237372 00007f9cca969a01 00007f9cca92e43a 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2
0709 12:11:49.114641 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 12:11:49.462705 (+348064us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:49.462745 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:49.462816 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:49.960924 (+498108us) raft_consensus.cc:1685] finished
0709 12:11:49.960946 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:49.961136 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21785,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":3423,"spinlock_wait_cycles":61745024,"thread_start_us":347703,"threads_started":1,"wal-append.queue_time_us":662360}
I20260709 12:11:49.913789 27569 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:49.963757 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:49.965790 27642 raft_consensus.cc:2749] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:49.965950 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 82318.2us
I20260709 12:11:49.967820 23087 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:49.969715 27642 raft_consensus.cc:2749] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:49.934041 27647 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:49.881127 27518 consensus_queue.cc:260] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:49.976579 27641 raft_consensus.cc:2749] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:49.882519 27395 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:49.979427 22599 raft_consensus.cc:2410] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:11:49.945314 22452 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:49.992476 22449 raft_consensus.cc:1275] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:49.995005 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:49.992369 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:49.990473 27269 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.002074 27269 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:49.993702 27687 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:50.003515 27687 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:50.004315 27269 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:50.005782 27571 raft_consensus.cc:3055] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:50.006404 27571 raft_consensus.cc:740] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:49.990662 27681 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.007302 27681 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:50.009922 27681 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:50.005928 27687 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:50.012938 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:49.988075 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:49.838663 27678 raft_consensus.cc:2749] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:11:50.016948 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:49.994633 22421 connection.cc:256] RPC call timeout handler was delayed by -2.2806235529999412s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1704s for a response
I20260709 12:11:50.017398 22353 catalog_manager.cc:5697] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 3 to 14, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 14 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:50.022352 22421 connection.cc:256] RPC call timeout handler was delayed by -2.27972355299994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1705s for a response
W20260709 12:11:50.022855 22421 connection.cc:256] RPC call timeout handler was delayed by -2.1798235530000056s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1816s for a response
W20260709 12:11:50.023259 22421 connection.cc:256] RPC call timeout handler was delayed by -2.0187235529999725s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1995s for a response
W20260709 12:11:50.018574 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:50.023612 22421 connection.cc:256] RPC call timeout handler was delayed by -1.6857235529998889s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23650000000000004s for a response
W20260709 12:11:50.024408 22421 connection.cc:256] RPC call timeout handler was delayed by -1.6533235529998365s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24009999999999998s for a response
I20260709 12:11:50.023612 22353 catalog_manager.cc:5697] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 12 to 14, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 14 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:50.024736 22421 connection.cc:256] RPC call timeout handler was delayed by -1.4598235529999783s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2616s for a response
I20260709 12:11:50.025836 22421 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:50.028312 26770 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:50.028560 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.029112 27571 consensus_queue.cc:260] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:50.030352 27571 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:50.031791 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 146636us
W20260709 12:11:50.021446 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 142893us
I20260709 12:11:50.033383 23089 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:49.849774 27680 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:50.034523 23089 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:50.037755 22453 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 12.
W20260709 12:11:50.039158 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.039220 22456 raft_consensus.cc:1275] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:50.040277 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:11:50.043599 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 121627us
I20260709 12:11:50.047971 23089 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:50.049641 23089 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:50.026021 22353 catalog_manager.cc:5697] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 9 to 12, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 12 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:50.051070 23088 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:50.041252 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:50.055234 23119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 1407) took 1463 ms. Trace:
I20260709 12:11:50.055720 23119 rpcz_store.cc:276] 0709 12:11:48.591757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.591904 (+   147us) service_pool.cc:224] Handling call
0709 12:11:48.592265 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:49.705202 (+1112937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:50.054922 (+349720us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400787dd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:50.055161 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2469595392}
W20260709 12:11:50.058142 22606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43070 (request call id 824) took 1744 ms (client timeout 1783 ms). Trace:
W20260709 12:11:50.058562 22606 rpcz_store.cc:269] 0709 12:11:48.313897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.314033 (+   136us) service_pool.cc:224] Handling call
0709 12:11:50.057949 (+1743916us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b5400448754. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:50.058070 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3776034688}
I20260709 12:11:50.054162 27525 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:50.063546 27525 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:50.065652 27525 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:50.054585 27511 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
W20260709 12:11:50.066702 27683 log.cc:927] Time spent T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.232s	user 0.001s	sys 0.001s
I20260709 12:11:50.066531 27511 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:50.068578 27511 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:50.069005 27642 raft_consensus.cc:2804] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:50.069419 27642 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:50.069651 27605 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:50.069792 27642 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:50.071614 23121 raft_consensus.cc:1240] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:11:50.059914 27678 raft_consensus.cc:2749] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:50.072768 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:50.074035 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:50.074729 23122 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 12.
I20260709 12:11:50.054831 27667 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:50.080083 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:50.081745 27518 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:50.086560 22599 raft_consensus.cc:1275] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:50.088210 23089 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:50.089030 27639 raft_consensus.cc:2804] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:50.089463 27639 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:50.089854 27639 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:50.089952 23089 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:50.091156 27463 raft_consensus.cc:2804] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:50.091518 27463 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:50.091910 27463 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:50.092677 22606 raft_consensus.cc:1240] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:50.089459 27641 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:50.095650 27641 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.096073 27641 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:50.089201 23088 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:50.097880 27667 raft_consensus.cc:2749] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:50.097965 27641 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:50.098253 23088 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:50.098621 27641 raft_consensus.cc:2749] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:50.099414 23088 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:50.099507 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:50.100194 22597 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 14.
I20260709 12:11:50.100481 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:50.102061 27639 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:50.102479 22455 raft_consensus.cc:1240] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 14. Current term is 15. Ops: [12.10-14.11]
I20260709 12:11:49.985574 27503 raft_consensus.cc:2804] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:50.091742 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:50.104202 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:50.107043 22603 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 14.
W20260709 12:11:50.104190 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.104614 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:11:50.109338 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:50.105710 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 79973.3us
I20260709 12:11:50.111084 22452 raft_consensus.cc:1275] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 12:11:50.111348 22421 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:50.111637 22452 pending_rounds.cc:85] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f: Aborting all ops after (but not including) 10
I20260709 12:11:50.112120 22452 pending_rounds.cc:107] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 12:11:50.052722 23123 raft_consensus.cc:2468] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 10.
I20260709 12:11:50.112452 22452 raft_consensus.cc:2889] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:50.114053 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:50.114599 22603 raft_consensus.cc:1240] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:11:50.116566 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:50.120291 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:50.120910 22597 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 14.
I20260709 12:11:50.125001 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:11:50.171135 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.191244 22532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 2092) took 1083 ms. Trace:
I20260709 12:11:50.191937 22532 rpcz_store.cc:276] 0709 12:11:49.108172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.108531 (+   359us) service_pool.cc:224] Handling call
0709 12:11:49.108906 (+   375us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:49.115575 (+  6669us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:49.115615 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:49.116251 (+   636us) log.cc:844] Serialized 52 byte log entry
0709 12:11:49.540060 (+423809us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:49.620001 (+ 79941us) log.cc:844] Serialized 14 byte log entry
0709 12:11:50.066079 (+446078us) spinlock_profiling.cc:243] Waited 2.28 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:11:50.104874 (+ 38795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:50.104942 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:50.104981 (+    39us) raft_consensus.cc:1685] finished
0709 12:11:50.190798 (+ 85817us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:50.191180 (+   382us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19447,"prepare.queue_time_us":87769,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":92425,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":18274,"spinlock_wait_cycles":5482112,"thread_start_us":894577,"threads_started":2,"wal-append.queue_time_us":666499}
I20260709 12:11:49.888273 27282 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:50.199177 22597 raft_consensus.cc:1240] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:50.125972 22605 raft_consensus.cc:2410] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 14 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:11:50.200028 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:50.201426 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:50.203665 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 92395.7us
I20260709 12:11:50.204521 22421 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:50.209971 22495 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:50.113108 27470 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:50.210007 22605 raft_consensus.cc:1240] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 LEADER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:50.205878 27641 raft_consensus.cc:2749] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:50.215649 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:50.216536 22603 raft_consensus.cc:2410] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:11:50.214211 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:50.217553 22597 raft_consensus.cc:2410] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:11:50.114867 27678 raft_consensus.cc:2764] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 12:11:50.213444 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 114101us
I20260709 12:11:50.222066 22603 raft_consensus.cc:1275] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:50.224852 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:50.225528 22603 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 10.
I20260709 12:11:50.224424 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:50.235006 27689 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:50.235559 27689 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:50.238266 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 183823us
I20260709 12:11:50.239506 22496 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:50.240091 27282 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:50.238437 27677 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.241091 22528 raft_consensus.cc:1240] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:50.240851 27677 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:50.242138 22497 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:50.243175 27475 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:50.244161 27702 consensus_queue.cc:1048] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:50.245738 27702 consensus_queue.cc:1048] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:11:50.247185 27645 raft_consensus.cc:2804] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:50.247588 27645 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:50.247908 27645 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:50.249428 27642 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:50.250447 23117 raft_consensus.cc:1240] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:50.250548 27282 consensus_queue.cc:1048] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:50.242869 27677 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:50.238370 27558 consensus_queue.cc:1048] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 12:11:50.125769 27667 raft_consensus.cc:2749] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:50.274919 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:50.301034 22527 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11.
I20260709 12:11:50.113114 27547 raft_consensus.cc:697] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:50.278548 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:50.310120 22523 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
W20260709 12:11:50.205891 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 80954.8us
W20260709 12:11:50.310925 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 101017us
I20260709 12:11:50.311645 23125 raft_consensus.cc:1275] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:11:50.311790 22495 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:50.312572 26770 raft_consensus.cc:2749] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:50.315232 22495 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:50.103307 27425 consensus_queue.cc:1048] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.109s
I20260709 12:11:50.317058 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:11:50.211201 27679 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 12:11:50.271574 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:50.319321 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:50.323028 23125 raft_consensus.cc:2393] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 12: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:50.324065 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:50.324764 22526 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 16.
W20260709 12:11:50.257624 27628 consensus_meta.cc:287] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.719s	user 0.005s	sys 0.007s
I20260709 12:11:50.206776 27469 raft_consensus.cc:2749] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:50.205708 27503 raft_consensus.cc:697] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:50.326865 22524 raft_consensus.cc:1275] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:11:50.330348 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:50.347656 22532 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:50.335502 26770 consensus_queue.cc:1048] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:50.332839 22495 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:50.320986 27269 raft_consensus.cc:2749] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:50.259579 27470 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:50.357278 22530 raft_consensus.cc:1275] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:11:50.320734 27475 raft_consensus.cc:2749] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:50.362753 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:50.321465 27641 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:50.371567 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:50.374603 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:11:50.376595 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 48802.9us
I20260709 12:11:50.392987 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:50.395694 23125 raft_consensus.cc:1275] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:50.254925 27463 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:50.393880 22457 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
I20260709 12:11:50.329555 27700 raft_consensus.cc:2749] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:50.401814 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 69093us
I20260709 12:11:50.403033 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:50.403239 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:50.414844 22525 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:50.414892 22495 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:50.415531 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:50.416109 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 211680us
I20260709 12:11:50.417142 22421 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:50.403975 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:50.417256 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:50.418401 22527 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:50.419693 22452 raft_consensus.cc:3055] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:50.420068 22452 raft_consensus.cc:740] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:50.357039 27708 raft_consensus.cc:2804] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:50.356803 27470 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:50.425817 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:50.426147 22421 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:50.343943 27681 consensus_queue.cc:1048] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:11:50.429116 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:50.437173 22421 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:50.437930 23123 raft_consensus.cc:2410] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:11:50.439610 22453 raft_consensus.cc:1275] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:50.399765 27395 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:50.433986 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:50.435571 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:50.434495 22532 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 7.
I20260709 12:11:50.350466 27695 consensus_queue.cc:1048] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.095s
I20260709 12:11:50.447896 22524 raft_consensus.cc:1240] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:50.441224 22452 consensus_queue.cc:260] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:50.448966 22452 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:50.450867 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 133611us
I20260709 12:11:50.413115 27647 raft_consensus.cc:2749] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:50.453101 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:50.468441 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:50.435437 27269 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:50.461194 22527 raft_consensus.cc:2410] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:11:50.425742 27525 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.464818 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:50.465076 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:50.350313 27701 consensus_queue.cc:1048] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.122s
I20260709 12:11:50.465939 22569 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:50.430287 27642 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:50.401468 27511 consensus_queue.cc:1048] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 12:11:50.472398 23119 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 12.
I20260709 12:11:50.346664 27628 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:50.506932 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:50.509353 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:50.515758 22528 raft_consensus.cc:2393] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 15: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
W20260709 12:11:50.516036 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.442610 27708 raft_consensus.cc:697] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:50.402101 27641 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:50.444834 27700 raft_consensus.cc:2804] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:11:50.511126 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 52391us
I20260709 12:11:50.513933 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:50.510152 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 102631us
I20260709 12:11:50.449934 27687 raft_consensus.cc:2749] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:50.470127 27707 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.559828 22602 raft_consensus.cc:1240] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 13. Current term is 15. Ops: []
W20260709 12:11:50.564812 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 127695us
I20260709 12:11:50.574337 22529 raft_consensus.cc:2468] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 10.
I20260709 12:11:50.549527 22452 raft_consensus.cc:1275] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:50.404870 27680 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:50.554301 27712 raft_consensus.cc:2804] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:50.449456 27714 consensus_queue.cc:1059] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.124s
W20260709 12:11:50.578191 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 145668us
I20260709 12:11:50.586277 22421 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:50.441145 27547 consensus_queue.cc:237] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:50.582510 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 130688us
I20260709 12:11:50.509393 27525 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:50.538097 27645 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:50.567186 27700 raft_consensus.cc:697] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
W20260709 12:11:50.584429 27571 consensus_meta.cc:287] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.554s	user 0.007s	sys 0.004s
I20260709 12:11:50.617726 22422 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:50.619370 26770 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:50.619858 26770 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:50.611713 22606 raft_consensus.cc:1240] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:50.621954 22496 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:50.623562 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:50.624177 22599 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:50.627326 27395 consensus_queue.cc:1048] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:50.582098 27639 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:50.591636 27712 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:50.629694 22496 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:50.636044 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:50.629467 22530 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 15.
I20260709 12:11:50.578487 27282 consensus_queue.cc:1048] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:11:50.639413 26770 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:50.554493 27503 consensus_queue.cc:237] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:50.646389 26770 raft_consensus.cc:2749] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:50.566299 27716 consensus_queue.cc:1048] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.116s
I20260709 12:11:50.617002 27145 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:50.631666 27475 raft_consensus.cc:2749] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:50.658820 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 66689.1us
W20260709 12:11:50.652053 27477 consensus_meta.cc:287] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.908s	user 0.011s	sys 0.001s
I20260709 12:11:50.640504 27712 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:50.646492 27717 raft_consensus.cc:2749] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:50.579665 27707 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:11:50.639940 27687 consensus_queue.cc:1048] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 12:11:50.686411 27350 tablet_bootstrap.cc:492] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270: Bootstrap starting.
I20260709 12:11:50.652038 27639 consensus_queue.cc:1059] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 12:11:50.669510 27681 raft_consensus.cc:2804] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:50.643723 27715 consensus_queue.cc:1048] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 12:11:50.631985 27708 consensus_queue.cc:237] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:50.668815 27571 consensus_queue.cc:1048] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
W20260709 12:11:50.704181 27709 log.cc:927] Time spent T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
I20260709 12:11:50.696504 27681 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:50.723177 27645 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:50.671622 27724 consensus_queue.cc:1059] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
W20260709 12:11:50.717533 27720 log.cc:927] Time spent T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
W20260709 12:11:50.717933 27719 log.cc:927] Time spent T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:11:50.734133 27724 raft_consensus.cc:3055] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:50.731473 27681 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:50.734620 27724 raft_consensus.cc:740] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
W20260709 12:11:50.735648 27718 log.cc:927] Time spent T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 12:11:50.695130 27700 consensus_queue.cc:237] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:50.721138 27714 consensus_queue.cc:1243] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer 1676e7af5e4a47cb86ee7db83e3d4881 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 12:11:50.780081 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 162221us
I20260709 12:11:50.786512 22422 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:50.789788 22422 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:50.656075 22496 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:50.663986 22525 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 15.
I20260709 12:11:50.847939 27647 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:50.848541 27733 raft_consensus.cc:2804] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:50.679445 27463 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:50.849220 27733 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:50.849879 27733 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:50.849442 27647 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:50.853246 22528 raft_consensus.cc:1275] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:50.854815 27647 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:50.870716 27641 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:50.871862 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.871979 27639 raft_consensus.cc:3055] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:50.872479 27639 raft_consensus.cc:740] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:50.879774 22353 catalog_manager.cc:5697] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 9 to 10, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 10 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:50.856891 27728 raft_consensus.cc:2804] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:50.887315 27728 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:50.887833 27728 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:50.893700 27645 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.669984 27477 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:50.894928 27645 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:50.897282 27477 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:50.898191 27645 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:50.897324 27475 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:11:50.872884 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.907768 27715 raft_consensus.cc:2804] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:50.909499 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:50.665126 27145 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:50.944259 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 288177us
I20260709 12:11:50.926411 27715 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:50.874289 27639 consensus_queue.cc:260] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:50.956454 22496 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:50.882685 22353 catalog_manager.cc:5697] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 11 to 12, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 12 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:11:50.939985 27647 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.957787 22529 raft_consensus.cc:2393] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 10: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:50.958724 27463 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:50.959504 27736 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.960395 23089 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:50.952797 27715 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:50.961428 27733 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:50.970259 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:50.970366 27463 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:50.977524 27463 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:50.981704 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:50.982753 22452 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Advancing to term 12
W20260709 12:11:50.987166 23087 leader_election.cc:336] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 2.176s (SENT)
I20260709 12:11:50.987838 23087 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:50.988477 27701 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.989333 27701 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:50.990702 27723 raft_consensus.cc:2749] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:50.992635 22455 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.007s	sys 0.028s
W20260709 12:11:50.993136 22455 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.007s	sys 0.028s
I20260709 12:11:50.994793 27269 raft_consensus.cc:2764] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:11:50.999043 23087 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:51.003490 27145 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:51.005662 27647 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:50.981763 27514 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:51.042343 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:51.053489 27742 consensus_queue.cc:1059] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:11:51.054380 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 56178.7us
I20260709 12:11:51.054958 27742 raft_consensus.cc:3055] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:51.055452 27742 raft_consensus.cc:740] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:51.057235 23087 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:51.058104 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:51.047750 27463 raft_consensus.cc:2749] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:51.057065 27742 consensus_queue.cc:260] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:51.071807 22604 raft_consensus.cc:1240] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 LEADER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:50.973151 27475 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:51.085690 23124 raft_consensus.cc:1240] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:51.043131 27736 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:51.087658 23125 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 12.
I20260709 12:11:51.089335 27736 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:51.095177 27511 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:51.096191 27511 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:51.098297 27723 raft_consensus.cc:2804] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:51.098901 27723 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:51.099404 27723 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:51.100235 27647 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:51.103617 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:51.104421 27714 raft_consensus.cc:2804] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:51.105050 27714 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:51.105598 27714 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:51.064971 27145 raft_consensus.cc:2749] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:51.123385 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 66364.8us
I20260709 12:11:51.123617 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:51.124552 23087 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:51.124998 22602 raft_consensus.cc:1240] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:51.141572 27742 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:11:51.142750 27733 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:51.144179 27701 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:51.155439 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 199319us
W20260709 12:11:51.156798 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 45495.8us
W20260709 12:11:51.160579 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 200450us
I20260709 12:11:51.161834 23089 leader_election.cc:304] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:51.164307 27463 raft_consensus.cc:2749] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:51.168464 27475 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:51.181329 27735 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:51.181915 27735 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:51.182361 27735 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:51.182624 27648 consensus_queue.cc:260] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:51.183641 22448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2732) took 1191 ms. Trace:
I20260709 12:11:51.184135 22448 rpcz_store.cc:276] 0709 12:11:49.992333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.992435 (+   102us) service_pool.cc:224] Handling call
0709 12:11:49.992740 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:50.003288 (+ 10548us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:50.003320 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:50.003806 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 12:11:50.361279 (+357473us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:50.419887 (+ 58608us) log.cc:844] Serialized 14 byte log entry
0709 12:11:50.420227 (+   340us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:50.915507 (+495280us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b54002a4c54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:50.935451 (+ 19944us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:51.171562 (+236111us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b18003c65e0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc780f2a6 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc78413f3 00007f9cc78437c1
0709 12:11:51.173218 (+  1656us) spinlock_profiling.cc:243] Waited 3.32 ms on lock 0x7b18003c65e0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc78413f3 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd 0000000000388634 0000000000388479 00007f9cc782483a
0709 12:11:51.183223 (+ 10005us) raft_consensus.cc:1685] finished
0709 12:11:51.183247 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:51.183435 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":58456,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":6984,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":12046,"spinlock_wait_cycles":57668480,"thread_start_us":357103,"threads_started":1,"wal-append.queue_time_us":436827}
I20260709 12:11:51.193220 22524 raft_consensus.cc:1217] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 LEADER]: Deduplicated request from leader. Original: 10.9->[12.10-12.10]   Dedup: 12.10->[]
I20260709 12:11:51.193917 22524 raft_consensus.cc:1240] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 LEADER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:11:51.184131 27648 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:51.197633 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:51.198378 22531 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 13.
I20260709 12:11:51.155602 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:51.194382 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:51.205295 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 148646us
W20260709 12:11:51.204414 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 47922.7us
I20260709 12:11:51.195796 27728 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:51.223277 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.226189 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:51.227427 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:51.227789 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:51.233796 27523 consensus_meta.cc:287] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 1.447s	user 0.009s	sys 0.008s
W20260709 12:11:51.235683 27747 log.cc:927] Time spent T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 12:11:51.236212 23117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 1192) took 1168 ms. Trace:
I20260709 12:11:51.236655 23117 rpcz_store.cc:276] 0709 12:11:50.067899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.079273 (+ 11374us) service_pool.cc:224] Handling call
0709 12:11:50.079608 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:50.250819 (+171211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:51.235695 (+984876us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b540018ef54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:51.236002 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":392482048}
I20260709 12:11:51.239040 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:51.239449 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:51.240221 22601 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 13.
I20260709 12:11:51.240411 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:51.240844 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:51.241274 23087 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:51.241206 22605 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:51.234323 27523 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:51.246377 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:51.246675 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:51.247380 22524 raft_consensus.cc:2393] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 10: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
W20260709 12:11:51.250313 27710 log.cc:927] Time spent T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.783s	user 0.005s	sys 0.000s
I20260709 12:11:51.250154 22496 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:51.255312 22457 raft_consensus.cc:1240] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:51.211813 27511 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:51.263238 27742 consensus_queue.cc:1059] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 12:11:51.272924 27666 raft_consensus.cc:2749] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:51.273859 23116 raft_consensus.cc:1240] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:51.274326 27689 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:51.275641 23116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 1135) took 1719 ms. Trace:
I20260709 12:11:51.275889 22496 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:51.276054 23116 rpcz_store.cc:276] 0709 12:11:49.556053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.580883 (+ 24830us) service_pool.cc:224] Handling call
0709 12:11:49.581253 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:51.274327 (+1693074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:51.275363 (+  1036us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b54005528d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:51.275588 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3867276160}
I20260709 12:11:51.276847 27400 raft_consensus.cc:2749] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:51.280601 27523 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:51.285480 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:51.288174 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:51.289889 27724 consensus_queue.cc:260] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:51.293157 22604 raft_consensus.cc:1240] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:51.296095 27707 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:51.267714 27641 consensus_queue.cc:1059] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 12:11:51.297787 27641 raft_consensus.cc:3055] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:51.298214 27641 raft_consensus.cc:740] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:51.299402 23088 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:51.302222 27666 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:51.302718 27666 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:51.303200 27666 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:51.304437 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:51.310192 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:51.311101 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:51.311744 27741 consensus_queue.cc:1059] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:51.313030 27741 raft_consensus.cc:3055] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:51.313481 27741 raft_consensus.cc:740] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
W20260709 12:11:51.313853 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.315305 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:51.316150 22454 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 13.
W20260709 12:11:51.325731 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 54671.2us
I20260709 12:11:51.322808 22448 raft_consensus.cc:1240] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:11:51.265704 27477 raft_consensus.cc:2749] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:51.330941 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:51.340447 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:51.341076 22453 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 10.
I20260709 12:11:51.349179 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:51.293110 27680 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:51.343791 27724 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:51.354435 22497 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:51.347223 27523 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:51.368549 22454 raft_consensus.cc:1275] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:51.370728 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:11:51.374933 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.373901 22450 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 13.
W20260709 12:11:51.378312 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 139471us
W20260709 12:11:51.370134 27470 consensus_meta.cc:287] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.798s	user 0.013s	sys 0.009s
W20260709 12:11:51.386108 22599 consensus_meta.cc:287] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.633s	user 0.012s	sys 0.008s
I20260709 12:11:51.314852 27741 consensus_queue.cc:260] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:11:51.389441 22605 raft_consensus.cc:2468] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 12.
I20260709 12:11:51.390637 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:51.377822 27477 raft_consensus.cc:2804] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:51.383446 27641 consensus_queue.cc:260] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:51.425453 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:11:51.429236 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 45284.6us
I20260709 12:11:51.435797 27282 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.439946 22604 pending_rounds.cc:85] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc: Aborting all ops after (but not including) 11
I20260709 12:11:51.440274 22604 pending_rounds.cc:107] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 12:11:51.440613 22604 raft_consensus.cc:2889] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:51.439553 27282 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:51.442152 27751 log.cc:927] Time spent T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.205s	user 0.000s	sys 0.000s
I20260709 12:11:51.420920 27678 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:51.431053 27470 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:51.443873 27282 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:51.443799 27678 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:51.429478 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 81316.1us
I20260709 12:11:51.445269 22421 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:51.421373 22451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2733) took 1406 ms. Trace:
I20260709 12:11:51.399426 27523 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:51.446020 22451 rpcz_store.cc:276] 0709 12:11:49.992590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.992952 (+   362us) service_pool.cc:224] Handling call
0709 12:11:49.993287 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:49.993618 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:49.993646 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:49.994081 (+   435us) log.cc:844] Serialized 26 byte log entry
0709 12:11:50.206846 (+212765us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:50.206890 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:50.206966 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:51.249491 (+1042525us) spinlock_profiling.cc:243] Waited 3.19 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:11:51.365715 (+116224us) raft_consensus.cc:1685] finished
0709 12:11:51.365744 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:51.399411 (+ 33667us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68127,"raft.queue_time_us":1832,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":22459,"spinlock_wait_cycles":7337856,"thread_start_us":212439,"threads_started":1,"wal-append.queue_time_us":425751}
I20260709 12:11:51.447758 27754 raft_consensus.cc:2749] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:11:51.427297 27681 consensus_meta.cc:287] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.692s	user 0.007s	sys 0.008s
I20260709 12:11:51.448628 27523 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:51.448495 27681 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:51.449374 22421 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:51.445398 27470 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:51.437865 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:11:51.487687 22452 consensus_meta.cc:287] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.504s	user 0.009s	sys 0.002s
I20260709 12:11:51.486522 23087 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:51.468737 22598 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 10.
I20260709 12:11:51.425854 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:51.459457 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:51.433073 22599 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 14.
I20260709 12:11:51.425014 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:51.488925 22452 raft_consensus.cc:2468] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 12.
I20260709 12:11:51.458458 22421 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
W20260709 12:11:51.402287 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.507097 27728 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:51.508131 27741 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:51.455894 27745 log.cc:927] Time spent T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:11:51.509958 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:51.402724 22448 raft_consensus.cc:1275] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:11:51.513520 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 52372.6us
I20260709 12:11:51.450870 27681 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:51.429416 27712 consensus_meta.cc:287] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.689s	user 0.005s	sys 0.012s
I20260709 12:11:51.461210 27678 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:11:51.518837 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 79782.3us
I20260709 12:11:51.452778 27754 raft_consensus.cc:2749] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:51.521407 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:51.489282 27477 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.430270 27736 consensus_queue.cc:1059] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.100s
I20260709 12:11:51.425318 27715 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:51.530777 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:51.533842 27511 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:51.534603 27701 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:51.553110 27701 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:51.535266 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 105089us
I20260709 12:11:51.543458 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:51.545475 22601 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 10.
I20260709 12:11:51.549126 22495 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:51.553112 27511 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:51.561658 22495 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:51.562636 27645 raft_consensus.cc:2749] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:51.541836 27477 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:51.563669 27701 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:51.564764 27645 raft_consensus.cc:2749] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:51.549685 27523 raft_consensus.cc:3055] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:51.564869 27511 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:51.565801 27523 raft_consensus.cc:740] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:51.570571 27523 consensus_queue.cc:260] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:51.552033 27715 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:51.566727 22495 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:51.573563 22495 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:51.574082 23119 raft_consensus.cc:1275] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:51.574348 22495 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:51.575860 23116 raft_consensus.cc:1240] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:51.576858 27674 raft_consensus.cc:2749] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:51.577234 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:51.577833 27674 raft_consensus.cc:2804] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:51.578333 27674 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.579555 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:51.580032 27569 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:51.580595 27569 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:51.581048 27569 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:51.583890 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:51.584553 23123 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
I20260709 12:11:51.585775 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:51.588372 22497 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:51.591185 27547 raft_consensus.cc:2804] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:51.591674 22456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2739) took 1155 ms. Trace:
I20260709 12:11:51.593901 22452 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:51.592144 22456 rpcz_store.cc:276] 0709 12:11:50.435844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.445960 (+ 10116us) service_pool.cc:224] Handling call
0709 12:11:50.446439 (+   479us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:50.446909 (+   470us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:50.446990 (+    81us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:50.452792 (+  5802us) log.cc:844] Serialized 26 byte log entry
0709 12:11:50.784093 (+331301us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:50.784949 (+   856us) log.cc:844] Serialized 14 byte log entry
0709 12:11:50.785457 (+   508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:50.785654 (+   197us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:51.589216 (+803562us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b240013b008. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc76c79c4 00007f9cc76c5acb 00007f9cc7880dc9 00007f9cc7880a55 00007f9cc787ffb0 00007f9cca4f6488 00007f9cca4f6be8 00007f9cca4ce398 00007f9cca4c976a 00007f9cca4c8bb6
0709 12:11:51.591193 (+  1977us) raft_consensus.cc:1685] finished
0709 12:11:51.591319 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:51.591481 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17701,"prepare.queue_time_us":44005,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":5752,"raft.queue_time_us":191742,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":13727,"spinlock_wait_cycles":13175040,"thread_start_us":229974,"threads_started":1,"wal-append.queue_time_us":213165}
I20260709 12:11:51.595136 27663 consensus_queue.cc:1059] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 12:11:51.597370 27663 raft_consensus.cc:3055] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:51.597694 27663 raft_consensus.cc:740] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:51.598717 27663 consensus_queue.cc:260] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:51.600311 27663 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:51.600813 22606 raft_consensus.cc:1275] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:11:51.600989 27759 log.cc:927] Time spent T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 12:11:51.601521 27695 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.602129 27695 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:51.602387 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:51.603067 22600 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7.
I20260709 12:11:51.603139 27678 raft_consensus.cc:2749] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:51.604158 27641 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:51.605647 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 70017.1us
I20260709 12:11:51.607144 27639 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:51.607331 23089 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:51.609190 27463 raft_consensus.cc:2804] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:51.609647 27463 raft_consensus.cc:697] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 10 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:51.611517 22449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 2199) took 1516 ms. Trace:
I20260709 12:11:51.429446 27514 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.567564 22597 raft_consensus.cc:1240] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 13. Current term is 14. Ops: []
W20260709 12:11:51.568425 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 168026us
I20260709 12:11:51.514354 27728 raft_consensus.cc:2749] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:51.569355 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:51.514855 27666 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:51.578794 27674 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:51.388242 27738 consensus_queue.cc:1059] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 12.10, Next index: 10, Last known committed idx: 9, Time since last communication: 0.278s
I20260709 12:11:51.622035 22448 raft_consensus.cc:2393] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 15: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:51.613956 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:51.428942 27735 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:51.633046 22456 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:11:51.646534 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:11:51.648538 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:51.651090 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.432451 27714 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:51.652772 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:51.653122 23124 raft_consensus.cc:1240] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:51.591715 27547 raft_consensus.cc:697] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:51.662922 22528 raft_consensus.cc:1275] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:11:51.663410 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:51.611913 22449 rpcz_store.cc:276] 0709 12:11:50.095241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.096620 (+  1379us) service_pool.cc:224] Handling call
0709 12:11:50.096918 (+   298us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:50.193314 (+ 96396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:50.193346 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:50.876311 (+682965us) spinlock_profiling.cc:243] Waited 6.39 ms on lock 0x7b2c00033c98. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc9227a11 00007f9cc9237372 00007f9cca969a01 00007f9cca92e43a 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2
0709 12:11:50.877378 (+  1067us) log.cc:844] Serialized 52 byte log entry
0709 12:11:50.966965 (+ 89587us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:11:50.974968 (+  8003us) log.cc:844] Serialized 14 byte log entry
0709 12:11:51.027665 (+ 52697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:51.035199 (+  7534us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:51.187456 (+152257us) spinlock_profiling.cc:243] Waited 2.91 ms on lock 0x7b4800130d58. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9ccf857aa1 00007f9ccf84eb37 00007f9ccf84e9ca 00007f9ccf94626f 00007f9ccf945f37 00007f9ccf95a55c 00007f9ccf95a508 00007f9ccf95a488 00007f9ccf95a443 00007f9ccf9596ec 00007f9cce883a96
0709 12:11:51.611159 (+423703us) raft_consensus.cc:1685] finished
0709 12:11:51.611182 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:51.611341 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":137449,"prepare.queue_time_us":7314,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":73,"raft.queue_time_us":171188,"raft.run_cpu_time_us":12181,"raft.run_wall_time_us":1004654,"spinlock_wait_cycles":21386368,"thread_start_us":88846,"threads_started":1,"wal-append.queue_time_us":465869}
I20260709 12:11:51.679409 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:51.680759 22526 raft_consensus.cc:2393] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 13: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:51.673853 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:51.610642 27463 consensus_queue.cc:237] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:51.688460 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:51.548012 27723 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:51.696943 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 238622us
I20260709 12:11:51.697315 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:51.698222 23119 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
I20260709 12:11:51.689879 23120 pending_rounds.cc:85] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270: Aborting all ops after (but not including) 9
I20260709 12:11:51.702790 23120 pending_rounds.cc:107] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 12:11:51.695842 22497 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:51.699290 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:51.548058 27712 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:51.657004 27738 consensus_queue.cc:1243] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer 1676e7af5e4a47cb86ee7db83e3d4881 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:11:51.681556 27754 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.703150 23120 raft_consensus.cc:2889] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:51.638126 27715 consensus_queue.cc:1048] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 6, Time since last communication: 0.060s
W20260709 12:11:51.727481 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 45322.7us
I20260709 12:11:51.730887 22606 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:51.735702 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:11:51.749312 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 121799us
I20260709 12:11:51.753810 22602 raft_consensus.cc:1240] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:51.754568 23117 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
I20260709 12:11:51.760809 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:51.761711 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:51.760728 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:51.700115 27514 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:51.783319 22456 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
I20260709 12:11:51.786948 22452 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:11:51.794438 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:51.795102 23117 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:51.792667 23121 raft_consensus.cc:1275] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:51.797137 22452 raft_consensus.cc:1240] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 13. Current term is 14. Ops: []
W20260709 12:11:51.801100 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.803036 27750 consensus_queue.cc:1048] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.112s
I20260709 12:11:51.803598 23121 raft_consensus.cc:1240] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:51.804914 26770 raft_consensus.cc:2804] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:51.805356 26770 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.805686 26770 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:51.806332 27695 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:51.811013 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:51.792805 22530 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
W20260709 12:11:51.817008 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.813469 23088 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:51.821976 23116 raft_consensus.cc:1275] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 12:11:51.837589 22421 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:51.801538 27738 consensus_queue.cc:1059] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:11:51.787274 27754 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:51.824666 27666 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:51.848357 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.844794 26770 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:11:51.854697 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:51.819083 27645 consensus_queue.cc:1048] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:11:51.857905 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:51.859742 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:51.861570 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:51.867405 22496 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
W20260709 12:11:51.870117 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.850317 27641 raft_consensus.cc:2749] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:51.873732 22528 raft_consensus.cc:2410] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:11:51.869336 27714 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:51.858440 27735 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:51.881671 27703 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:51.882347 27703 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:51.878165 23088 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:11:51.884111 27770 log.cc:927] Time spent T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 12:11:51.885015 27758 log.cc:927] Time spent T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.379s	user 0.001s	sys 0.000s
W20260709 12:11:51.885299 27769 log.cc:927] Time spent T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:11:51.886741 27760 log.cc:927] Time spent T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.457s	user 0.001s	sys 0.000s
I20260709 12:11:51.898770 27469 raft_consensus.cc:2749] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:11:51.899937 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 76487.4us
I20260709 12:11:51.900888 22421 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:51.904896 27735 raft_consensus.cc:2749] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:51.907049 27666 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:51.907234 27754 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:51.907713 27666 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:51.908062 27754 raft_consensus.cc:2749] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:51.910015 27666 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:51.909555 22451 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 15.
W20260709 12:11:51.910970 27765 log.cc:927] Time spent T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 12:11:51.913767 22570 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:51.916532 27604 raft_consensus.cc:2749] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:51.918171 22570 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:51.879529 27282 raft_consensus.cc:2749] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:51.937106 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:51.937579 22421 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:51.837721 27547 consensus_queue.cc:237] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:51.943454 22455 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
I20260709 12:11:51.940128 27712 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:51.992877 22451 raft_consensus.cc:1275] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 12:11:51.939599 27715 consensus_queue.cc:1048] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 12:11:51.995241 27650 consensus_queue.cc:1048] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.009s
W20260709 12:11:51.999665 27766 log.cc:927] Time spent T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:11:51.999390 27477 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:51.952426 27145 consensus_queue.cc:1059] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 12:11:52.006326 22606 raft_consensus.cc:2410] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 12:11:52.011273 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 93248.4us
I20260709 12:11:51.943943 27701 raft_consensus.cc:2749] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:52.027827 23122 raft_consensus.cc:3055] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:52.028293 23122 raft_consensus.cc:740] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:52.029240 23122 consensus_queue.cc:260] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:52.030797 23122 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:52.036703 27703 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:51.993953 27469 raft_consensus.cc:2804] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:52.020116 27477 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:52.078322 27677 consensus_queue.cc:1048] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:11:52.078789 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 221195us
I20260709 12:11:52.081845 27514 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:52.087419 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 94101us
I20260709 12:11:52.060496 27469 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:52.085772 27741 consensus_meta.cc:287] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.577s	user 0.011s	sys 0.000s
I20260709 12:11:52.096903 22454 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 7.
I20260709 12:11:52.101058 23122 raft_consensus.cc:1275] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:52.092265 27469 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:52.104254 22421 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:52.108536 23116 raft_consensus.cc:1240] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 12. Current term is 13. Ops: []
W20260709 12:11:52.114570 27642 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
W20260709 12:11:52.116847 27639 consensus_meta.cc:287] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.509s	user 0.009s	sys 0.001s
I20260709 12:11:52.113623 27738 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:52.123174 27738 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:52.124006 22570 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:52.128018 27754 consensus_queue.cc:1059] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:52.129140 27681 raft_consensus.cc:3055] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:52.129526 27681 raft_consensus.cc:740] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:52.130546 27681 consensus_queue.cc:260] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:52.132208 22421 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:52.133708 27514 raft_consensus.cc:2764] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:11:52.135883 27728 raft_consensus.cc:2804] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:52.136243 27728 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.136576 27728 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:52.134653 22570 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:52.144356 27350 tablet_bootstrap.cc:492] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:11:52.144536 27728 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:52.148948 23087 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:52.149796 27639 raft_consensus.cc:2749] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:52.151235 27741 raft_consensus.cc:2804] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:52.155448 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:52.155709 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:52.154233 22570 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:52.151165 27350 tablet_bootstrap.cc:492] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270: Bootstrap complete.
I20260709 12:11:52.157667 23122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 1148) took 1649 ms. Trace:
I20260709 12:11:52.157958 23122 rpcz_store.cc:276] 0709 12:11:50.508012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.508193 (+   181us) service_pool.cc:224] Handling call
0709 12:11:50.508533 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:52.027548 (+1519015us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b54007f0420. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca8a5dc0 00007f9cca9301c0 00007f9cca931231 00007f9cca92dd8f 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c
0709 12:11:52.102163 (+ 74615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:52.157613 (+ 55450us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":807524608}
I20260709 12:11:52.158924 23117 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 13.
I20260709 12:11:52.159724 23087 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:52.161072 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:52.161689 23121 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:52.151906 27741 raft_consensus.cc:697] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 10 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:52.169783 27677 raft_consensus.cc:2804] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:52.169279 27741 consensus_queue.cc:237] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:52.170241 27677 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.159292 27639 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.171257 27639 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:52.172564 23116 raft_consensus.cc:1240] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:52.172873 22597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2635) took 1105 ms. Trace:
I20260709 12:11:52.173297 22597 rpcz_store.cc:276] 0709 12:11:51.067202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.072072 (+  4870us) service_pool.cc:224] Handling call
0709 12:11:51.502467 (+430395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:51.626998 (+124531us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:52.172679 (+545681us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b54003aded0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:52.172792 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":956242176}
I20260709 12:11:52.163928 27514 raft_consensus.cc:2804] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:52.175158 27514 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.170738 27677 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:52.175537 27514 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:52.159358 27282 consensus_queue.cc:1059] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.009s
W20260709 12:11:52.179330 27569 consensus_meta.cc:287] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.598s	user 0.004s	sys 0.009s
W20260709 12:11:52.179620 27755 log.cc:927] Time spent T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.744s	user 0.002s	sys 0.004s
I20260709 12:11:52.183187 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:52.183835 27712 consensus_queue.cc:1059] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:11:52.184716 27712 raft_consensus.cc:3055] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:52.185110 27712 raft_consensus.cc:740] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:52.187361 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:52.194384 23121 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 15.
I20260709 12:11:52.186184 27712 consensus_queue.cc:260] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:52.196818 27724 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.197219 22603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2632) took 1285 ms. Trace:
I20260709 12:11:52.197531 27712 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:52.197336 27724 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:52.197695 22603 rpcz_store.cc:276] 0709 12:11:50.911644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.915399 (+  3755us) service_pool.cc:224] Handling call
0709 12:11:50.973816 (+ 58417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:51.059443 (+ 85627us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:51.059476 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:51.060107 (+   631us) log.cc:844] Serialized 26 byte log entry
0709 12:11:51.251699 (+191592us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:51.251738 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:51.251822 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:52.179063 (+927241us) spinlock_profiling.cc:243] Waited 25.7 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:11:52.196828 (+ 17765us) raft_consensus.cc:1685] finished
0709 12:11:52.196850 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:52.197044 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9591,"raft.queue_time_us":22845,"raft.run_cpu_time_us":866,"raft.run_wall_time_us":140053,"spinlock_wait_cycles":59023104,"thread_start_us":191036,"threads_started":1,"wal-append.queue_time_us":291344}
I20260709 12:11:52.199443 27724 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:51.898933 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:52.203424 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:52.205142 22421 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:52.207171 27724 raft_consensus.cc:2749] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:52.207691 22421 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:52.209615 27724 raft_consensus.cc:2749] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:52.202968 27350 ts_tablet_manager.cc:1403] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270: Time spent bootstrapping tablet: real 1.517s	user 0.023s	sys 0.034s
I20260709 12:11:52.231395 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:52.231976 22529 raft_consensus.cc:1240] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:52.232223 27723 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:52.232692 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:52.233320 22524 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 17.
I20260709 12:11:52.233603 27525 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:11:52.238335 22523 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56940 (request call id 2367) took 1823 ms (client timeout 1999 ms). Trace:
I20260709 12:11:52.240991 27425 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:52.241384 27674 consensus_meta.cc:287] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.588s	user 0.008s	sys 0.000s
I20260709 12:11:52.241550 27425 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:52.241894 27628 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:52.243814 27786 log.cc:927] Time spent T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.166s	user 0.000s	sys 0.002s
I20260709 12:11:52.245209 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:52.245828 23121 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 15.
I20260709 12:11:52.246691 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:52.247985 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:52.231395 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:52.241786 27674 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:52.250504 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:52.238884 22523 rpcz_store.cc:269] 0709 12:11:50.418766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.433759 (+ 14993us) service_pool.cc:224] Handling call
0709 12:11:52.237939 (+1804180us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54001f2054. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:52.238135 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3206681344}
I20260709 12:11:52.262445 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:52.263137 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 110774us
I20260709 12:11:52.268476 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:52.268882 23125 raft_consensus.cc:1240] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:52.269258 22449 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:52.179757 27569 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:52.271159 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.271216 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:52.275696 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:52.277351 22531 raft_consensus.cc:2368] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 10. Current term is 11.
I20260709 12:11:52.277487 27667 raft_consensus.cc:2749] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:11:52.263993 22570 connection.cc:256] RPC call timeout handler was delayed by -1.2577020639998864s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18700000000000003s for a response
I20260709 12:11:52.243841 27425 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:52.289115 22570 connection.cc:256] RPC call timeout handler was delayed by -1.1376925059998939s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19730000000000003s for a response
W20260709 12:11:52.289569 22570 connection.cc:256] RPC call timeout handler was delayed by -1.0023211339998852s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15200000000000002s for a response
I20260709 12:11:52.300043 27674 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:52.294407 27728 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:52.312258 22495 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:52.300649 27701 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.313855 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:52.316452 22457 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:52.286877 27713 consensus_queue.cc:1059] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
W20260709 12:11:52.324272 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 116659us
I20260709 12:11:52.302112 27677 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:52.361260 22421 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:52.344738 27645 consensus_queue.cc:1048] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 12:11:52.323634 27701 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:52.369781 22570 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:52.376084 27708 raft_consensus.cc:2804] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:52.376587 27708 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.376946 27708 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:52.378477 27400 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.379114 27400 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:52.379690 27762 log.cc:927] Time spent T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.945s	user 0.007s	sys 0.000s
I20260709 12:11:52.381310 27400 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:52.383157 27782 log.cc:927] Time spent T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.302s	user 0.001s	sys 0.001s
I20260709 12:11:52.384038 27680 raft_consensus.cc:2804] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:52.384495 27680 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.384940 27680 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:52.386588 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:52.387349 22453 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 14.
I20260709 12:11:52.388123 26770 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:52.388536 22453 raft_consensus.cc:1240] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 12. Current term is 13. Ops: [12.13-12.13]
I20260709 12:11:52.384058 27569 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:52.389001 22454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2755) took 1010 ms. Trace:
I20260709 12:11:52.389436 22454 rpcz_store.cc:276] 0709 12:11:51.378857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.379352 (+   495us) service_pool.cc:224] Handling call
0709 12:11:52.388849 (+1009497us) spinlock_profiling.cc:243] Waited 697 ms on lock 0x7b5400379e54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:52.388951 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1602366336}
I20260709 12:11:52.389858 22570 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:52.384553 27768 log.cc:927] Time spent T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.588s	user 0.000s	sys 0.002s
I20260709 12:11:52.391770 27350 raft_consensus.cc:359] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 6 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:11:52.392614 27350 raft_consensus.cc:740] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 6 LEARNER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Initialized, Role: LEARNER
I20260709 12:11:52.366113 27547 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.399827 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:52.393105 27503 raft_consensus.cc:2804] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:11:52.435510 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 45753.9us
I20260709 12:11:52.436367 22570 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:52.439004 27667 raft_consensus.cc:3055] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:52.439426 27667 raft_consensus.cc:740] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:52.440246 27667 consensus_queue.cc:260] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:52.441484 27667 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:52.446705 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.449389 27681 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:52.456001 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:52.457201 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:52.462401 22597 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:52.477756 27701 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:52.478070 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:52.478637 22605 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:52.478564 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:52.479701 22598 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:52.479545 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 120299us
I20260709 12:11:52.483184 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:52.485632 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:52.416316 27503 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:52.485805 22602 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
W20260709 12:11:52.480253 27463 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.032s	sys 0.023s
I20260709 12:11:52.484654 27523 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:52.499303 22421 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:52.498383 22495 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:52.413406 27547 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:52.487462 27701 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:52.489967 27503 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:52.491911 27463 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.032s	sys 0.024s
I20260709 12:11:52.393308 27350 consensus_queue.cc:260] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:11:52.513926 26770 consensus_queue.cc:1059] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:11:52.513281 22497 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:52.504624 27701 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:52.536826 26770 raft_consensus.cc:3055] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:52.537226 26770 raft_consensus.cc:740] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:52.519935 27703 raft_consensus.cc:2804] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:52.542261 22605 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
I20260709 12:11:52.544627 22598 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
I20260709 12:11:52.544767 22605 raft_consensus.cc:1275] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:11:52.535470 27701 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:11:52.548573 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.536334 27469 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:52.563726 27803 log.cc:927] Time spent T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:11:52.564643 27469 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:52.567298 22451 raft_consensus.cc:1240] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:52.567615 27399 raft_consensus.cc:3055] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:52.568023 27399 raft_consensus.cc:740] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:52.568873 27399 consensus_queue.cc:260] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:52.569000 27514 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:52.570031 27399 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:52.571285 27514 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:52.534137 27269 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:52.575820 27801 log.cc:927] Time spent T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
W20260709 12:11:52.558638 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 122349us
I20260709 12:11:52.584929 22570 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:52.586109 27514 raft_consensus.cc:2749] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:52.586927 22570 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:52.586824 27514 consensus_queue.cc:1048] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:52.587967 27571 raft_consensus.cc:2749] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:52.588830 27514 raft_consensus.cc:2764] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 12:11:52.593156 27269 raft_consensus.cc:2749] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:52.540524 27703 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.553939 27677 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:52.629300 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 76355.7us
I20260709 12:11:52.633304 27269 consensus_queue.cc:1048] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:11:52.633510 22421 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:52.634829 27269 raft_consensus.cc:2749] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:52.636777 26770 consensus_queue.cc:260] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:52.638334 26770 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:52.641759 22421 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
W20260709 12:11:52.642882 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 54249.3us
I20260709 12:11:52.643626 22570 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:52.624478 27703 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:52.651612 22457 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
I20260709 12:11:52.630523 22449 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 14.
I20260709 12:11:52.653347 27677 raft_consensus.cc:2749] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:52.659233 27797 raft_consensus.cc:2749] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:52.653327 27269 raft_consensus.cc:2749] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:52.606880 27708 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:52.684461 27738 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:52.686708 22597 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 14.
I20260709 12:11:52.687126 22570 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:52.692834 22422 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:52.693712 27680 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:52.694819 27269 raft_consensus.cc:2764] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 12:11:52.695832 27680 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:52.697144 27639 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:52.696988 22421 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:52.698007 27741 raft_consensus.cc:2804] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:52.698446 27741 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:52.698886 27741 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:52.698596 22353 catalog_manager.cc:5697] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:11:52.700260 22353 catalog_manager.cc:5697] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 8 to 11, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 11 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:52.701828 22353 catalog_manager.cc:5697] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 11 to 13, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 13 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
W20260709 12:11:52.705119 27781 log.cc:927] Time spent T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.631s	user 0.002s	sys 0.000s
I20260709 12:11:52.706420 23120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 1153) took 1097 ms. Trace:
I20260709 12:11:52.706811 23120 rpcz_store.cc:276] 0709 12:11:51.609088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.622132 (+ 13044us) service_pool.cc:224] Handling call
0709 12:11:51.674933 (+ 52801us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:51.762201 (+ 87268us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:51.762232 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:51.777693 (+ 15461us) log.cc:844] Serialized 26 byte log entry
0709 12:11:51.854906 (+ 77213us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:51.854967 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:51.855080 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:52.704842 (+849762us) spinlock_profiling.cc:243] Waited 7.12 ms on lock 0x7b2400303ed8. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc76c79c4 00007f9cc76c5acb 00007f9cc7880dc9 00007f9cc7880a55 00007f9cc788009d 00007f9cca4b210e 00007f9cca4c988c 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221
0709 12:11:52.706141 (+  1299us) raft_consensus.cc:1685] finished
0709 12:11:52.706163 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:52.706363 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16404096,"thread_start_us":61302,"threads_started":1,"wal-append.queue_time_us":167492}
I20260709 12:11:52.697948 27701 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:52.708551 27741 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:52.710455 27754 consensus_queue.cc:1059] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:52.721704 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:52.722020 27754 raft_consensus.cc:3055] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:52.722394 27754 raft_consensus.cc:740] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:52.723140 22601 raft_consensus.cc:1240] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:52.723235 27754 consensus_queue.cc:260] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:52.724468 27754 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:52.711215 27701 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:52.714275 27628 raft_consensus.cc:2749] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:52.714684 27807 consensus_queue.cc:1048] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:52.711210 22421 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:52.729480 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:52.730415 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:52.733137 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:52.734282 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:52.736522 22448 raft_consensus.cc:2393] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 15: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:52.736670 22450 raft_consensus.cc:2393] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 15: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:52.736910 22597 raft_consensus.cc:2393] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 15: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:52.735172 22449 raft_consensus.cc:1275] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:11:52.723260 27503 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:52.741953 27503 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:52.742069 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:52.743034 22457 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 15.
I20260709 12:11:52.743312 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:52.743957 22455 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 15.
I20260709 12:11:52.745427 27681 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:52.745816 27681 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:52.746181 27681 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:52.746512 23123 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:11:52.742179 27741 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:52.753810 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:52.754925 22422 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:52.755438 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:52.756534 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:52.761449 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:52.762236 22598 raft_consensus.cc:1240] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:52.762662 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:52.762238 22599 raft_consensus.cc:2393] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 15: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:52.763423 22606 raft_consensus.cc:2393] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 15: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
W20260709 12:11:52.767105 27800 log.cc:927] Time spent T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.271s	user 0.004s	sys 0.000s
I20260709 12:11:52.767691 27723 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.768246 27723 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:52.770244 27723 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:52.770689 27723 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.771166 27680 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:52.771644 27680 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:52.773638 27680 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:52.774192 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:52.774268 27701 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:52.776022 22495 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:52.778656 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:52.779230 22449 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:52.780856 22496 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:52.782279 22453 raft_consensus.cc:1275] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:11:52.783277 22495 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:52.751305 27708 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:52.786062 22495 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:52.791939 22449 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 16.
W20260709 12:11:52.793112 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 79402.2us
I20260709 12:11:52.784516 27645 consensus_queue.cc:1048] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 12:11:52.794363 22570 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:52.786592 27650 raft_consensus.cc:2804] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:52.787386 27741 raft_consensus.cc:2749] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:52.795291 27628 raft_consensus.cc:2749] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:52.796871 22421 leader_election.cc:400] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 10. Current term is 11.
I20260709 12:11:52.799232 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:52.799453 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:52.800230 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:52.802721 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:52.804576 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:52.786573 27399 raft_consensus.cc:2749] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:52.795471 27477 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:52.794399 27648 raft_consensus.cc:2804] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:52.808338 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:52.810716 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:52.811122 22452 raft_consensus.cc:2368] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 14. Current term is 15.
I20260709 12:11:52.808928 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:52.804898 27650 raft_consensus.cc:697] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:52.813071 27352 raft_consensus.cc:2804] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:52.813601 27352 raft_consensus.cc:697] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:52.813779 27650 consensus_queue.cc:237] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:52.814517 27352 consensus_queue.cc:237] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:52.815552 27648 raft_consensus.cc:697] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:52.817175 22454 raft_consensus.cc:2393] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 13: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:52.816876 27648 consensus_queue.cc:237] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:52.824211 27571 consensus_queue.cc:1048] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:52.775101 27701 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:52.826872 22495 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:52.827575 27701 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:52.787520 27723 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:52.829988 27350 ts_tablet_manager.cc:1434] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270: Time spent starting tablet: real 0.605s	user 0.009s	sys 0.000s
I20260709 12:11:52.842720 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:52.843720 22532 raft_consensus.cc:2468] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 10.
W20260709 12:11:52.847301 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 67516.6us
I20260709 12:11:52.849826 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:52.850878 23122 raft_consensus.cc:2393] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 15: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:52.830796 27547 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:52.853754 23088 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:52.857285 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:52.860114 22421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.860574 23087 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:52.834746 27399 raft_consensus.cc:2804] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:52.867592 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:52.867707 27463 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.867715 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:52.868449 27463 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:52.869446 23124 raft_consensus.cc:2393] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 8: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:52.871197 27639 raft_consensus.cc:2749] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:52.871508 23116 raft_consensus.cc:1240] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:52.872051 23087 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:52.872438 27667 raft_consensus.cc:2804] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:52.872972 27667 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.873394 27667 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:52.873780 23087 leader_election.cc:400] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 election: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 14. Current term is 15.
I20260709 12:11:52.874359 23087 leader_election.cc:403] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:11:52.875116 27425 raft_consensus.cc:2749] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:52.875268 27738 raft_consensus.cc:2749] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 14. Current term is 15.
I20260709 12:11:52.876366 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:52.877108 22457 raft_consensus.cc:2393] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 15: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:52.862133 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:52.862399 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:52.883841 23121 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:52.883978 23120 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:52.883417 23087 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:52.865407 22421 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:52.888486 23087 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:52.889906 23087 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:52.845459 27350 ts_tablet_manager.cc:1467] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270: Tablet startup took 608ms
I20260709 12:11:52.883073 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:52.892848 22454 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 15.
I20260709 12:11:52.898062 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:52.897316 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:52.831120 27477 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:52.878451 27681 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:52.908661 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:52.910441 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:52.909493 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:52.914368 22530 raft_consensus.cc:2410] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 13 because replica has last-logged OpId of term: 12 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 12.
I20260709 12:11:52.917102 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:52.917929 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:52.919353 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:52.919790 22526 raft_consensus.cc:1275] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:52.920382 22597 raft_consensus.cc:2393] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 13: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:52.892052 27399 raft_consensus.cc:697] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:52.901041 27738 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:52.903497 27523 raft_consensus.cc:2749] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:52.893690 27713 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:52.934182 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:52.934656 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:52.943848 23121 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 15.
I20260709 12:11:52.943281 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:52.953707 22597 raft_consensus.cc:2368] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 14. Current term is 15.
I20260709 12:11:52.958714 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:52.959501 22605 raft_consensus.cc:2468] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 9.
I20260709 12:11:52.906555 27750 consensus_queue.cc:1059] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:11:52.985328 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:52.989043 22602 raft_consensus.cc:1240] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:11:52.992540 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:11:52.992507 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 137618us
I20260709 12:11:52.991442 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:52.995548 22524 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:52.996671 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:52.997695 22605 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 15.
I20260709 12:11:52.952849 27463 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:11:52.989596 27761 log.cc:927] Time spent T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 1.552s	user 0.000s	sys 0.005s
I20260709 12:11:52.999497 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:53.002194 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:53.004226 22570 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:53.012596 22570 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:53.008311 22601 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 14.
W20260709 12:11:53.013881 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 96813.1us
I20260709 12:11:53.017127 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:53.017961 22605 raft_consensus.cc:2393] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 15: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:53.021610 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:53.033118 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:53.016201 27701 raft_consensus.cc:2804] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:53.020095 27814 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:53.066215 27477 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:53.096165 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:53.029454 27503 consensus_queue.cc:1059] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.075s
I20260709 12:11:53.110289 27503 raft_consensus.cc:3055] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:11:53.110809 27503 raft_consensus.cc:740] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:53.111968 27503 consensus_queue.cc:260] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:53.113634 27503 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:53.067907 27701 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.114377 27701 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:53.117156 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:53.113658 22524 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:11:53.128041 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:53.128686 22531 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 11.
I20260709 12:11:53.128545 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:53.130074 22569 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:53.138473 27708 raft_consensus.cc:3055] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:53.141161 27708 raft_consensus.cc:740] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:53.133086 23088 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:53.154011 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:53.154695 22602 raft_consensus.cc:2376] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 14. Re-sending same reply.
I20260709 12:11:53.159293 22604 raft_consensus.cc:2393] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 12: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
W20260709 12:11:53.159578 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 59526.8us
I20260709 12:11:53.160446 22524 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 15.
I20260709 12:11:53.160270 27822 consensus_queue.cc:1048] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 12:11:53.161934 27713 raft_consensus.cc:2804] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:53.162345 27713 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:53.162424 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 375122us
I20260709 12:11:53.162812 27713 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:53.166285 22570 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:53.167090 23120 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
W20260709 12:11:53.160300 23123 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57328 (request call id 1429) took 1508 ms (client timeout 1851 ms). Trace:
I20260709 12:11:53.169618 23088 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:11:53.168273 23123 rpcz_store.cc:269] 0709 12:11:51.639878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.753427 (+113549us) service_pool.cc:224] Handling call
0709 12:11:53.148117 (+1394690us) spinlock_profiling.cc:243] Waited 952 ms on lock 0x7b54005235d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:53.148244 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2188826368}
I20260709 12:11:53.032728 27399 consensus_queue.cc:237] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:53.186802 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:11:53.186295 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 87109.7us
I20260709 12:11:53.188298 22497 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:53.194898 22570 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:53.197094 22570 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:11:53.203152 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 73176.4us
I20260709 12:11:53.180135 27822 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:53.190961 27824 raft_consensus.cc:2804] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:53.184162 27723 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:53.168386 27703 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:53.193135 27831 raft_consensus.cc:2764] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:11:53.198334 27815 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.200040 27680 raft_consensus.cc:2749] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:53.210076 27681 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:53.173096 27708 consensus_queue.cc:260] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:53.240298 27750 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.228070 27547 raft_consensus.cc:2804] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:53.174456 27741 consensus_queue.cc:1059] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 12:11:53.229496 27824 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.240660 27724 raft_consensus.cc:2749] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:53.270135 22532 raft_consensus.cc:2368] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 15. Current term is 16.
I20260709 12:11:53.209122 27469 consensus_queue.cc:1059] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:11:53.279124 27824 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:53.283988 27547 raft_consensus.cc:697] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:53.296135 27741 raft_consensus.cc:3055] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:53.258837 27728 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:53.238773 27822 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:53.321310 27703 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:53.323491 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:53.315084 27628 raft_consensus.cc:2804] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:53.326056 27824 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:53.351372 22604 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:53.258543 27815 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:53.302764 27831 raft_consensus.cc:2804] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:53.296618 27741 raft_consensus.cc:740] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:53.279371 27477 consensus_queue.cc:1048] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
W20260709 12:11:52.891942 27350 ts_tablet_manager.cc:1469] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270: Trace:
0709 12:11:41.158180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.162699 (+  4519us) service_pool.cc:224] Handling call
0709 12:11:41.397833 (+235134us) ts_tablet_manager.cc:934] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317)
0709 12:11:44.049104 (+2651271us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:11:44.677704 (+628600us) tablet_metadata.cc:665] Metadata flushed
0709 12:11:44.677828 (+   124us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:11:44.775445 (+ 97617us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:11:44.775776 (+   331us) tablet_replica.cc:206] Creating consensus instance
0709 12:11:44.776113 (+   337us) ts_tablet_manager.cc:989] Replica registered.
0709 12:11:44.776169 (+    56us) inbound_call.cc:177] Queueing success response
0709 12:11:50.685874 (+5909705us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:11:52.225217 (+1539343us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:11:52.290453 (+ 65236us) tablet_replica.cc:261] Starting instrumentation
0709 12:11:52.291094 (+   641us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":13497,"mutex_wait_us":258581,"raft.queue_time_us":259747,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":6201,"tablet-copy.queue_time_us":126960,"tablet-download-pool.queue_time_us":33950,"tablet-download-pool.run_cpu_time_us":1473,"tablet-download-pool.run_wall_time_us":4298892,"thread_start_us":120084,"threads_started":2}
W20260709 12:11:53.369980 27817 log.cc:927] Time spent T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
W20260709 12:11:53.370530 27826 log.cc:927] Time spent T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:11:53.295799 27547 consensus_queue.cc:237] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:11:53.277527 27750 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:53.380995 27828 log.cc:927] Time spent T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 12:11:53.326818 27667 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:53.403970 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 538625us
I20260709 12:11:53.404906 22421 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:53.380191 27628 raft_consensus.cc:697] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:53.333817 27728 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:53.426322 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:53.446637 27728 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:53.447220 27728 raft_consensus.cc:2749] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:53.447860 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:53.450601 22353 catalog_manager.cc:5697] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 6 to 14, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 14 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:11:53.423627 27724 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:53.452329 27724 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:53.452642 22353 catalog_manager.cc:5697] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:11:53.454564 27724 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:53.455646 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:53.462685 27824 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:53.464906 27701 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:53.433753 22453 raft_consensus.cc:1240] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:11:53.468384 27824 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:53.440613 23089 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.196.131:37785 timed out after 1.574s (SENT) [suppressed 14 similar messages]
I20260709 12:11:53.468871 27824 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:53.444224 27815 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:53.469645 22602 raft_consensus.cc:1240] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:53.439242 27741 consensus_queue.cc:260] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:53.471588 27824 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:53.471781 22604 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 16.
I20260709 12:11:53.471887 27797 consensus_queue.cc:1059] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:53.473022 27701 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:53.473886 27820 log.cc:927] Time spent T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.407s	user 0.002s	sys 0.002s
I20260709 12:11:53.481308 22453 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10ed4486435d4f82978c5cb544504999"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:44568
I20260709 12:11:53.482231 22453 raft_consensus.cc:606] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:11:53.482606 22453 raft_consensus.cc:614] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:11:53.483621 27827 log.cc:927] Time spent T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
I20260709 12:11:53.487473 27822 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:53.488900 22421 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:53.489698 27724 consensus_queue.cc:1059] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:53.490864 27724 raft_consensus.cc:3055] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:53.491259 27724 raft_consensus.cc:740] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:53.492156 27724 consensus_queue.cc:260] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:53.493788 27724 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:53.392391 27831 raft_consensus.cc:697] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 13 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:53.489737 27750 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:53.495937 27831 consensus_queue.cc:237] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:53.489845 27797 raft_consensus.cc:2804] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:53.500808 27797 raft_consensus.cc:697] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:53.502161 27797 consensus_queue.cc:237] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:53.504954 27713 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:53.506918 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:53.508715 27628 consensus_queue.cc:237] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:53.511485 23119 raft_consensus.cc:2368] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 12. Current term is 13.
W20260709 12:11:53.427058 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:53.467495 27738 consensus_meta.cc:287] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.525s	user 0.010s	sys 0.000s
I20260709 12:11:53.519371 22523 raft_consensus.cc:1240] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 LEADER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:11:53.515153 23087 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:53.454392 22353 catalog_manager.cc:5697] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 7 to 11, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 11 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:11:53.525489 27822 raft_consensus.cc:2804] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:53.525049 27738 raft_consensus.cc:2749] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:53.560451 22497 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:53.576027 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:53.576783 22602 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 13.
I20260709 12:11:53.537834 27399 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.579766 22604 raft_consensus.cc:1275] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 12:11:53.584563 22604 pending_rounds.cc:85] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting all ops after (but not including) 9
I20260709 12:11:53.584823 22604 pending_rounds.cc:107] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:11:53.585067 22604 raft_consensus.cc:2889] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:53.546144 27724 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:53.588021 27399 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:53.597988 27724 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:53.599402 27399 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:53.571278 27822 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.601111 27822 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:53.544137 27469 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:53.604296 27469 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:53.607123 27724 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:53.607934 27713 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:53.576423 27282 raft_consensus.cc:2804] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:53.625605 27848 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.626315 27848 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:53.629406 27848 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:53.632063 27829 log.cc:927] Time spent T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.304s	user 0.001s	sys 0.000s
I20260709 12:11:53.637125 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:53.637706 22453 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:53.635092 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 97742us
I20260709 12:11:53.672647 22421 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:53.653225 22497 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
W20260709 12:11:53.678525 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 237925us
I20260709 12:11:53.685629 22451 raft_consensus.cc:1275] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:53.687386 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:53.688015 22452 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 14.
I20260709 12:11:53.692294 22606 raft_consensus.cc:1275] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:11:53.694278 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 497211us
I20260709 12:11:53.694717 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:53.696584 22421 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:53.721347 22421 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
W20260709 12:11:53.699314 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 49140.1us
W20260709 12:11:53.699914 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 46802.5us
I20260709 12:11:53.606890 27469 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:53.579532 27843 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:53.678361 27399 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:11:53.714920 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 463440us
I20260709 12:11:53.693838 27282 raft_consensus.cc:697] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:53.684692 27738 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:53.709347 27400 raft_consensus.cc:2804] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:53.707636 27848 raft_consensus.cc:2749] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:53.752600 22569 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:53.752817 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:53.751194 27639 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:53.754684 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:53.756484 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:53.759054 23123 raft_consensus.cc:2376] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13. Re-sending same reply.
I20260709 12:11:53.758091 22457 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 15.
I20260709 12:11:53.759274 22569 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:53.746273 27724 raft_consensus.cc:2749] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:53.758113 22495 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:53.766909 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:53.768204 23124 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
I20260709 12:11:53.769042 27680 raft_consensus.cc:2804] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:53.769304 27650 raft_consensus.cc:2804] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:53.769569 27680 raft_consensus.cc:697] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:53.769752 27650 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.770174 27650 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:53.770653 27814 consensus_queue.cc:1059] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:53.770530 27680 consensus_queue.cc:237] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:53.779373 27282 consensus_queue.cc:237] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:53.765781 27712 raft_consensus.cc:2804] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:53.783636 27712 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:53.784121 27712 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:53.784816 27832 log.cc:927] Time spent T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.519s	user 0.000s	sys 0.004s
I20260709 12:11:53.765920 27639 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:53.764123 27806 consensus_queue.cc:1048] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:11:53.789252 27639 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:53.752655 27713 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:53.759783 27400 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.807672 27822 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:53.816084 27400 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:53.816653 23121 raft_consensus.cc:2393] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 16: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:53.817689 27822 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:53.757272 27843 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:53.758606 27399 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:53.820461 27843 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:53.820961 27843 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:53.753131 27842 raft_consensus.cc:2749] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:53.756909 27849 consensus_queue.cc:1059] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 12:11:53.855087 22453 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 16.
I20260709 12:11:53.867901 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:53.868696 23119 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 14.
I20260709 12:11:53.760066 27738 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:53.821175 27399 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:53.867000 27848 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.821602 27843 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:53.905292 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:53.870370 27822 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:53.910661 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:53.928315 22421 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:53.929291 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:53.846918 27713 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:53.930124 22453 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:53.939725 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:53.942754 22454 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 13.
I20260709 12:11:53.909624 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:53.948565 23124 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 12.
I20260709 12:11:53.938386 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:53.949443 22456 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:53.926319 27754 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.928180 27639 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.956244 22453 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 16.
I20260709 12:11:53.939307 27837 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:11:53.962697 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 204666us
I20260709 12:11:53.909814 27842 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.909485 27848 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:53.948632 27838 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:11:53.958904 27525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.908s	user 0.013s	sys 0.008s
I20260709 12:11:53.947252 27822 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:53.964823 27824 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.982105 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:11:53.971479 27525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.919s	user 0.013s	sys 0.009s
I20260709 12:11:53.984788 22531 raft_consensus.cc:1275] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:53.968565 27724 raft_consensus.cc:2749] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:53.957870 27754 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:53.993652 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 223407us
I20260709 12:11:53.959367 27639 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:53.999392 22597 raft_consensus.cc:3055] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:53.999738 22597 raft_consensus.cc:740] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:53.995700 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:54.001137 22532 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:54.001295 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:53.997052 22569 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:53.967713 27674 consensus_queue.cc:1048] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 12:11:54.002836 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:54.002996 22569 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:54.003859 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:54.011534 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:53.985083 27645 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:54.014812 22569 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:53.968869 27837 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:54.016466 22467 tablet_copy_service.cc:342] P c863116d91c14d1ca50d6e8a46a37a8f: Request end of tablet copy session 8701cd5186a949538d8efafb5f987270-82e7db06c6ff4d96853c60f0f42c09a8 received from {username='slave'} at 127.0.0.1:34452
W20260709 12:11:54.017078 27856 log.cc:927] Time spent T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:11:54.017092 22467 tablet_copy_service.cc:434] P c863116d91c14d1ca50d6e8a46a37a8f: ending tablet copy session 8701cd5186a949538d8efafb5f987270-82e7db06c6ff4d96853c60f0f42c09a8 on tablet 82e7db06c6ff4d96853c60f0f42c09a8 with peer 8701cd5186a949538d8efafb5f987270
I20260709 12:11:54.017557 27713 leader_election.cc:290] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:54.018831 27639 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:54.011732 27282 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:54.019273 27738 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:54.019847 27282 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:54.020196 27645 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:54.022048 27282 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:54.022253 27645 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:54.023671 22353 catalog_manager.cc:5697] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:11:54.032212 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:54.032779 22524 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:54.032353 22353 catalog_manager.cc:5697] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 7 to 13, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 13 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:11:54.002540 27831 raft_consensus.cc:2749] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:53.971210 27838 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:54.036567 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:54.036832 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:54.038789 22353 catalog_manager.cc:5697] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 7 to 9, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 9 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:11:53.986099 27824 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:53.997361 27712 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:54.055887 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:54.056543 27712 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:11:54.043149 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:54.043275 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:54.057197 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:54.058466 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:54.059293 23122 raft_consensus.cc:2393] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 11: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:54.060461 27667 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:54.060715 23122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57332 (request call id 1185) took 1164 ms. Trace:
I20260709 12:11:54.061110 23122 rpcz_store.cc:276] 0709 12:11:52.896456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:53.010561 (+114105us) service_pool.cc:224] Handling call
0709 12:11:54.060529 (+1049968us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400671bd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:54.060659 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2384219008}
I20260709 12:11:54.061805 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:54.062201 23125 raft_consensus.cc:1240] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:54.064483 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:54.028158 27822 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:54.068150 22525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 2383) took 1170 ms. Trace:
I20260709 12:11:54.068734 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:54.069420 22599 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 18.
I20260709 12:11:54.070652 22599 raft_consensus.cc:1240] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:54.068569 22525 rpcz_store.cc:276] 0709 12:11:52.897979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:52.898091 (+   112us) service_pool.cc:224] Handling call
0709 12:11:52.900488 (+  2397us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:52.930710 (+ 30222us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:52.982583 (+ 51873us) log.cc:844] Serialized 14 byte log entry
0709 12:11:53.101681 (+119098us) log.cc:844] Serialized 14 byte log entry
0709 12:11:53.191729 (+ 90048us) log.cc:844] Serialized 14 byte log entry
0709 12:11:53.191902 (+   173us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:53.476403 (+284501us) spinlock_profiling.cc:243] Waited 8.27 ms on lock 0x7b1800413320. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc7841522 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd 0000000000388634 0000000000388479 00007f9cc782483a
0709 12:11:54.065705 (+589302us) spinlock_profiling.cc:243] Waited 1.32 ms on lock 0x7b2c000010a8. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc9227a11 00007f9cc9237372 00007f9cca969a01 00007f9cca92e43a 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2
0709 12:11:54.066234 (+   529us) log.cc:844] Serialized 52 byte log entry
0709 12:11:54.066414 (+   180us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:54.066448 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:54.066511 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:54.067815 (+  1304us) raft_consensus.cc:1685] finished
0709 12:11:54.067832 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:54.067967 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":206793,"prepare.queue_time_us":336826,"prepare.run_cpu_time_us":114,"prepare.run_wall_time_us":117,"raft.queue_time_us":139584,"raft.run_cpu_time_us":477,"raft.run_wall_time_us":38053,"spinlock_wait_cycles":34830592,"thread_start_us":55293,"threads_started":1,"wal-append.queue_time_us":237040}
I20260709 12:11:54.044920 27838 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:54.045369 27834 log.cc:927] Time spent T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.725s	user 0.002s	sys 0.000s
I20260709 12:11:54.046661 22569 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:54.046837 27754 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:54.080646 22529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 2115) took 1105 ms. Trace:
I20260709 12:11:54.047384 27503 raft_consensus.cc:2749] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:11:54.048929 27837 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:54.049369 27851 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.081137 22529 rpcz_store.cc:276] 0709 12:11:52.975474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:52.975652 (+   178us) service_pool.cc:224] Handling call
0709 12:11:52.991704 (+ 16052us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:53.010116 (+ 18412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:53.010145 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:53.022870 (+ 12725us) log.cc:844] Serialized 26 byte log entry
0709 12:11:53.172929 (+150059us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:53.172965 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:53.173025 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:54.044862 (+871837us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:11:54.075052 (+ 30190us) raft_consensus.cc:1685] finished
0709 12:11:54.075076 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:54.080576 (+  5500us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10596,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":3902,"spinlock_wait_cycles":28576512,"thread_start_us":81905,"threads_started":1,"wal-append.queue_time_us":228928}
I20260709 12:11:54.081993 27851 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:54.050953 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:54.083015 27778 consensus_queue.cc:1048] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:11:54.084553 27830 log.cc:927] Time spent T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.770s	user 0.009s	sys 0.003s
I20260709 12:11:54.085124 27851 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:54.087949 27848 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:54.088709 23118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 1183) took 1198 ms. Trace:
I20260709 12:11:54.088843 27843 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:54.089084 23118 rpcz_store.cc:276] 0709 12:11:52.890175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:52.890296 (+   121us) service_pool.cc:224] Handling call
0709 12:11:52.907605 (+ 17309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:53.009896 (+102291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:53.009943 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:53.019225 (+  9282us) log.cc:844] Serialized 26 byte log entry
0709 12:11:53.168269 (+149044us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:53.193334 (+ 25065us) log.cc:844] Serialized 14 byte log entry
0709 12:11:54.029248 (+835914us) spinlock_profiling.cc:243] Waited 9.22 ms on lock 0x7b180038b3c0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cca4d64bc 00007f9cc782448b 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc783e455 00007f9cca926060 00007f9cca938716 00007f9cca949287
0709 12:11:54.029364 (+   116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:54.029429 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:54.083840 (+ 54411us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:11:54.088511 (+  4671us) raft_consensus.cc:1685] finished
0709 12:11:54.088531 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:54.088656 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":467,"prepare.queue_time_us":57236,"prepare.run_wall_time_us":43,"raft.queue_time_us":120470,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":11581,"spinlock_wait_cycles":71687680,"thread_start_us":311943,"threads_started":3,"wal-append.queue_time_us":254628}
W20260709 12:11:54.051748 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 290179us
W20260709 12:11:54.052228 27818 log.cc:927] Time spent T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.984s	user 0.001s	sys 0.004s
I20260709 12:11:54.053220 27824 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:54.042433 27859 raft_consensus.cc:2749] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:54.095350 27859 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:54.095706 22570 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:54.095853 27859 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:54.096582 27815 raft_consensus.cc:2804] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:54.097085 27815 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.971346 27842 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:11:54.098070 27859 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:54.007009 27814 consensus_queue.cc:1048] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:11:54.079358 22456 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 16.
I20260709 12:11:54.022962 27400 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:54.080482 27701 raft_consensus.cc:2764] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:11:54.099584 27842 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:54.100960 27400 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:54.090857 22524 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 13.
W20260709 12:11:54.104444 22350 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48412 (request call id 242) took 28477 ms (client timeout 15000 ms). Trace:
I20260709 12:11:54.108726 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:54.109380 22453 raft_consensus.cc:2468] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:11:54.109611 22604 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 13.
I20260709 12:11:54.110114 22422 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:54.113346 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:54.119702 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:54.135389 22531 raft_consensus.cc:2393] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 15: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:54.135748 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:54.140018 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:54.140798 22524 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:54.144282 23089 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:11:54.161047 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 232801us
I20260709 12:11:54.164670 23087 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:54.181483 22605 raft_consensus.cc:1275] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:11:54.187300 22602 raft_consensus.cc:2393] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 8: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
W20260709 12:11:54.188612 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 44448.1us
I20260709 12:11:54.190197 23089 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:54.193795 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:54.194548 22457 raft_consensus.cc:2393] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 16: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:54.194434 23089 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:54.191586 23087 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:54.195761 23089 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:54.196924 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:54.196293 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:54.199713 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:54.200436 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:54.201992 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:54.039973 22532 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 16.
I20260709 12:11:54.097433 27815 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:54.208091 22453 raft_consensus.cc:1275] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:11:54.207887 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 48410.6us
I20260709 12:11:54.211400 22599 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 12.
I20260709 12:11:54.212194 23088 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:54.212435 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:54.212574 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:54.213191 22599 raft_consensus.cc:2368] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 14. Current term is 15.
I20260709 12:11:54.213629 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:54.213940 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:54.214516 22599 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:54.215066 27713 raft_consensus.cc:2749] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:54.215561 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:54.216163 23117 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 15.
I20260709 12:11:54.216528 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:54.217229 23125 raft_consensus.cc:2393] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 18: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:54.217106 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:54.217923 23124 raft_consensus.cc:2393] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 13: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:54.218235 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:54.218397 27707 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:54.218685 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:54.218822 23122 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 14.
I20260709 12:11:54.214684 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:54.221347 22602 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 15.
I20260709 12:11:54.148211 27843 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:54.225169 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:54.240430 22453 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 15.
I20260709 12:11:54.225839 22421 leader_election.cc:400] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 election: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 15. Current term is 16.
I20260709 12:11:54.222070 22454 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
I20260709 12:11:54.241148 22421 leader_election.cc:403] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:11:54.195254 27569 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.195305 27523 raft_consensus.cc:2749] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:54.242240 22421 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:54.227644 22524 raft_consensus.cc:2468] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 11.
I20260709 12:11:54.243373 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:54.243778 22532 raft_consensus.cc:1240] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:54.261912 22448 raft_consensus.cc:2468] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 8.
I20260709 12:11:54.244191 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:54.245122 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:54.264029 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:54.264258 22569 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:54.199358 27639 raft_consensus.cc:2804] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:54.218930 27707 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:54.237468 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:54.258517 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:54.270923 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:54.266131 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:54.270013 22452 raft_consensus.cc:2393] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 14: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:54.219970 27848 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:54.273592 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:54.236728 27797 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:54.281220 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 89717.7us
I20260709 12:11:54.282358 23087 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:54.188401 27842 consensus_queue.cc:1059] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 12:11:54.285375 22530 raft_consensus.cc:1275] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:11:54.286760 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 44612us
I20260709 12:11:54.238107 27866 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:54.246080 27843 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:54.293536 23087 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:54.294502 23087 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:54.197973 27650 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:54.219902 27425 consensus_queue.cc:1059] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 12:11:54.255736 27754 raft_consensus.cc:2749] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 15. Current term is 16.
I20260709 12:11:54.293864 27843 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:54.308609 27269 raft_consensus.cc:3055] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:54.308967 27269 raft_consensus.cc:740] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:54.309774 27269 consensus_queue.cc:260] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:54.279170 27514 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:54.311954 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:54.288931 22450 raft_consensus.cc:1275] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:11:54.301234 27852 raft_consensus.cc:3055] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:54.301633 27836 raft_consensus.cc:2804] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:54.289935 27708 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:54.304873 27870 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:54.306185 27425 raft_consensus.cc:2804] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:54.270924 27639 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:54.285554 27824 raft_consensus.cc:2804] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:54.285669 27738 raft_consensus.cc:2804] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:54.320705 23121 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
I20260709 12:11:54.301862 27707 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:54.321808 23087 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:54.323767 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 111629us
I20260709 12:11:54.339011 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:54.300091 27523 raft_consensus.cc:2804] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:54.290426 27807 raft_consensus.cc:2804] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:54.310861 27269 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:54.312304 27514 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:54.265090 27569 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:54.364153 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:54.365717 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:54.366420 22569 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:54.367928 22569 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:54.368922 27701 raft_consensus.cc:2749] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:54.369539 27701 raft_consensus.cc:2749] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:54.372645 22453 raft_consensus.cc:1240] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 15. Current term is 16. Ops: [14.9-15.10]
I20260709 12:11:54.286917 27848 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:54.343844 27869 raft_consensus.cc:2749] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:54.346227 27871 raft_consensus.cc:2804] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:54.392766 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:54.393435 22605 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 13.
I20260709 12:11:54.394603 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:54.395262 22451 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:11:54.347150 27843 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:54.347616 22570 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:54.347916 22599 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 13.
W20260709 12:11:54.105005 22350 rpcz_store.cc:269] 0709 12:11:25.627273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.628837 (+  1564us) service_pool.cc:224] Handling call
0709 12:11:26.320796 (+691959us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b5400198a54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca898090 00007f9cca936f3a 00007f9cd06ece9c 00007f9cd07eb04e 00007f9ccecac2a4 00007f9ccecac232 00007f9ccecac161 00007f9ccecac0dc 00007f9ccecab392 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:54.104151 (+27783355us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:44.694349 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:44.694916 (+   567us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:44.694959 (+    43us) write_op.cc:435] Acquired schema lock
0709 12:11:44.701293 (+  6334us) tablet.cc:662] Decoding operations
0709 12:11:44.734582 (+ 33289us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:44.734714 (+   132us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:44.734755 (+    41us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:11:44.736436 (+  1681us) tablet.cc:701] Row locks acquired
0709 12:11:44.736499 (+    63us) write_op.cc:260] PREPARE: finished
0709 12:11:44.736724 (+   225us) write_op.cc:270] Start()
0709 12:11:44.736900 (+   176us) write_op.cc:276] Timestamp: P: 1783599104736649 usec, L: 0
0709 12:11:44.736954 (+    54us) op_driver.cc:348] REPLICATION: starting
0709 12:11:44.738019 (+  1065us) log.cc:844] Serialized 6008 byte log entry
0709 12:11:45.879049 (+1141030us) op_driver.cc:464] REPLICATION: finished
0709 12:11:46.363228 (+484179us) write_op.cc:301] APPLY: starting
0709 12:11:46.447785 (+ 84557us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:47.103898 (+656113us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:47.104031 (+   133us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:47.313527 (+209496us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:47.313867 (+   340us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 12:11:47.313915 (+    48us) write_op.cc:312] APPLY: finished
0709 12:11:47.386079 (+ 72164us) log.cc:844] Serialized 139 byte log entry
0709 12:11:47.490597 (+104518us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:47.508983 (+ 18386us) write_op.cc:454] Released schema lock
0709 12:11:47.511135 (+  2152us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:47.522059 (+ 10924us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:47.523553 (+  1494us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":244101,"reported_tablets":40,"spinlock_wait_cycles":37447552,"child_traces":[["op",{"apply.queue_time_us":396461,"apply.run_cpu_time_us":47942,"apply.run_wall_time_us":1225588,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66827,"num_ops":15,"prepare.queue_time_us":334722,"prepare.run_cpu_time_us":56471,"prepare.run_wall_time_us":241060,"raft.queue_time_us":313837,"raft.run_cpu_time_us":14360,"raft.run_wall_time_us":358224,"replication_time_us":1112251,"thread_start_us":895732,"threads_started":5,"wal-append.queue_time_us":684901,"wal-append.run_cpu_time_us":14469,"wal-append.run_wall_time_us":2497558}]]}
W20260709 12:11:54.400265 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 78554.5us
I20260709 12:11:54.327013 22450 raft_consensus.cc:1240] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:54.350502 22421 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
W20260709 12:11:54.411365 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 60953.3us
I20260709 12:11:54.350899 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:54.366453 22603 raft_consensus.cc:2393] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 14: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:54.381844 23120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 1442) took 1208 ms. Trace:
I20260709 12:11:54.396868 22495 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:54.412467 23120 rpcz_store.cc:276] 0709 12:11:53.173736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:53.173888 (+   152us) service_pool.cc:224] Handling call
0709 12:11:53.174238 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:54.196070 (+1021832us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:54.196098 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:54.196139 (+    41us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:54.196176 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:54.381616 (+185440us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54005f19d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:54.381662 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:54.381788 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2349530496}
I20260709 12:11:54.355916 23088 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:54.288657 27797 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:54.381175 22422 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:54.320288 27852 raft_consensus.cc:740] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:54.337512 27425 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:54.341923 27639 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:54.374212 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:54.453063 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:54.453295 22604 raft_consensus.cc:2376] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 14. Re-sending same reply.
I20260709 12:11:54.453724 22598 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 13.
I20260709 12:11:54.454151 22602 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 18.
I20260709 12:11:54.341753 27807 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:54.403610 27650 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:54.391315 22597 consensus_queue.cc:260] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:54.373678 27523 raft_consensus.cc:697] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 16 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:54.391271 27681 consensus_queue.cc:1048] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.014s
W20260709 12:11:54.409243 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 61710us
I20260709 12:11:54.413893 22495 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:54.414436 23116 raft_consensus.cc:1275] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:11:54.342108 27836 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:54.299268 27866 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:54.375852 27822 raft_consensus.cc:2804] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:11:54.444944 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:54.456133 22597 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:54.390013 27880 raft_consensus.cc:3055] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:11:54.481462 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 67686.4us
I20260709 12:11:54.416145 27831 raft_consensus.cc:2749] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:54.432266 27707 raft_consensus.cc:2749] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:54.416324 27754 raft_consensus.cc:2749] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:54.470822 27807 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:54.486048 22570 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:11:54.486752 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 291024us
I20260709 12:11:54.489902 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:54.490128 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:54.509394 22603 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:11:54.454635 27469 raft_consensus.cc:2804] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:54.455381 27425 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:54.342615 27870 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:54.408618 27145 consensus_queue.cc:1048] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 12:11:54.516899 22605 raft_consensus.cc:2393] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 17: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:54.480505 27859 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.480212 27836 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:54.487046 27822 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:54.520299 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 223055us
I20260709 12:11:54.488536 27880 raft_consensus.cc:740] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:54.488116 27547 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:54.527652 22496 leader_election.cc:400] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353) with higher term. Message: Invalid argument: T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 12. Current term is 13.
I20260709 12:11:54.534068 22496 leader_election.cc:403] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:54.527980 23089 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:11:54.530655 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:54.539484 22496 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:54.514034 27469 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:54.544692 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:54.545467 22601 raft_consensus.cc:2393] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 16: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:54.546252 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:54.546763 22601 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:11:54.547930 27863 raft_consensus.cc:2749] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:54.538209 27852 consensus_queue.cc:260] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:54.549222 27852 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:54.549346 23116 raft_consensus.cc:1275] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:54.549779 27843 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:54.458096 27701 consensus_queue.cc:1175] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" responder_term: 16 status { last_received { term: 12 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 15. Current term is 16. Ops: [14.9-15.10]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:11:54.505352 27399 consensus_queue.cc:1048] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:11:54.495327 27738 raft_consensus.cc:697] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 16 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:54.552506 27523 consensus_queue.cc:237] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:54.553192 27738 consensus_queue.cc:237] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:54.553807 27815 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:54.557833 22601 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
W20260709 12:11:54.547884 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:54.553606 27741 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:54.562678 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:54.566188 22597 raft_consensus.cc:1275] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 12:11:54.524749 27680 raft_consensus.cc:2804] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:54.566668 22454 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:54.566735 22597 pending_rounds.cc:85] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting all ops after (but not including) 9
I20260709 12:11:54.521418 27886 raft_consensus.cc:2749] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:54.567283 22600 raft_consensus.cc:2393] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 15: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:54.568251 23089 leader_election.cc:400] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 election: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 14. Current term is 15.
I20260709 12:11:54.572149 23089 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:54.567836 22597 pending_rounds.cc:107] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 12:11:54.573156 22597 raft_consensus.cc:2889] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:54.533135 27822 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:54.568445 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:54.580327 22451 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:54.586649 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:54.587817 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:54.592264 27815 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:54.542547 27469 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:54.596393 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 240535us
I20260709 12:11:54.541263 27707 raft_consensus.cc:2749] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353) with higher term. Message: Invalid argument: T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 12. Current term is 13.
I20260709 12:11:54.605728 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:54.607174 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:54.604547 27883 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.607900 23117 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:54.608117 27883 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:54.608846 27870 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:54.570567 27680 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:54.566902 27879 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:54.611040 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:54.615659 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:54.622167 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:54.625314 23119 raft_consensus.cc:2393] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 14: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:54.620497 22531 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 13.
I20260709 12:11:54.628103 23120 raft_consensus.cc:1275] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:54.531644 27859 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:11:54.630103 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:54.630749 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:54.628962 22570 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:54.639983 27677 raft_consensus.cc:2749] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:54.594441 27824 raft_consensus.cc:697] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 13 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:54.594357 27889 raft_consensus.cc:2804] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:54.641819 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:54.574410 27831 consensus_queue.cc:1048] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 12:11:54.594219 27866 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:54.605340 27713 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:54.620601 27680 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:54.668705 22597 raft_consensus.cc:1275] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:54.669607 22606 raft_consensus.cc:2393] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 18: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:54.669030 23120 raft_consensus.cc:1275] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:11:54.631057 27886 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:11:54.678933 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 266985us
W20260709 12:11:54.680502 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 56835.7us
I20260709 12:11:54.642354 27712 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:54.684912 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:54.685035 22421 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:54.685773 23121 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 13.
I20260709 12:11:54.682428 23117 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
I20260709 12:11:54.690838 22421 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:54.647511 27891 raft_consensus.cc:2749] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:54.705668 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:54.677999 27871 raft_consensus.cc:697] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 14 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
W20260709 12:11:54.861037 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 171823us
I20260709 12:11:54.898115 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:54.899346 23120 raft_consensus.cc:2393] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 18: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:54.642894 27851 consensus_queue.cc:1059] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:11:54.683934 27866 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.914840 22570 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:54.694065 27837 raft_consensus.cc:2804] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:54.704856 27838 raft_consensus.cc:2804] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:54.832690 27754 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.678443 27713 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:54.943503 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:54.832113 27797 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:54.632272 27880 consensus_queue.cc:260] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:54.627935 27879 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:54.691972 27870 consensus_queue.cc:1059] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.240s
I20260709 12:11:54.900959 27893 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.892462 27842 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.694906 27677 consensus_queue.cc:1048] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.245s
I20260709 12:11:54.951700 22597 raft_consensus.cc:1240] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:54.688879 27886 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:54.695334 27712 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:54.818099 27843 consensus_queue.cc:1048] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.132s
I20260709 12:11:54.938200 27837 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:54.943058 27838 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:54.936589 27269 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:54.949007 27814 raft_consensus.cc:3055] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:54.991583 23117 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 13.
I20260709 12:11:54.939145 27883 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:54.919747 27571 consensus_queue.cc:1048] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
W20260709 12:11:54.971094 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 56366.5us
I20260709 12:11:54.960502 27754 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:54.953169 27891 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:54.930239 27503 consensus_queue.cc:1048] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.067s
I20260709 12:11:54.973747 27851 raft_consensus.cc:2749] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:54.936915 27866 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:55.016426 22603 consensus_meta.cc:287] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.506s	user 0.010s	sys 0.001s
I20260709 12:11:55.015286 27837 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:55.021708 27876 log.cc:927] Time spent T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.284s	user 0.001s	sys 0.000s
W20260709 12:11:55.179073 27885 log.cc:927] Time spent T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.534s	user 0.000s	sys 0.001s
W20260709 12:11:55.179265 27884 log.cc:927] Time spent T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.555s	user 0.000s	sys 0.001s
I20260709 12:11:55.021473 27269 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:55.182297 27886 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:55.184247 27712 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:55.184731 27836 consensus_meta.cc:287] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.646s	user 0.005s	sys 0.002s
I20260709 12:11:55.185174 27836 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:55.001413 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 100856us
I20260709 12:11:55.003873 27896 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:54.936187 27824 consensus_queue.cc:237] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:55.001643 27842 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:55.017432 27838 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:55.019482 27889 raft_consensus.cc:697] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 11 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:55.048192 22603 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
W20260709 12:11:55.027016 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.170619 27900 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.171165 27871 consensus_queue.cc:237] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:55.171761 27879 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:11:55.172785 27881 log.cc:927] Time spent T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.344s	user 0.000s	sys 0.001s
I20260709 12:11:54.996088 27893 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:55.048038 27890 raft_consensus.cc:2749] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:55.191845 22454 consensus_meta.cc:287] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.624s	user 0.009s	sys 0.000s
I20260709 12:11:55.017712 27814 raft_consensus.cc:740] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:55.188665 22496 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:55.280249 27269 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:55.280834 27269 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:55.281414 27269 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:55.258821 27639 consensus_meta.cc:287] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.778s	user 0.010s	sys 0.000s
I20260709 12:11:55.250363 27870 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:11:55.244234 27887 log.cc:927] Time spent T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.574s	user 0.001s	sys 0.000s
W20260709 12:11:55.260710 22601 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.000s	sys 0.006s
W20260709 12:11:55.291819 22601 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.000s	sys 0.007s
W20260709 12:11:55.253763 27885 log.cc:927] Time spent T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:11:55.270499 22454 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
I20260709 12:11:55.049116 27891 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:55.264572 27811 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:55.271857 27859 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:55.255505 27886 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:55.312932 22457 raft_consensus.cc:1275] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:11:55.299386 26770 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:55.315793 26770 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:55.289288 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 100708us
I20260709 12:11:55.308842 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:55.309485 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:55.319217 22454 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 13.
I20260709 12:11:55.327705 22495 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:55.317323 22496 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:55.330370 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:55.331224 22456 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 13.
I20260709 12:11:55.285120 27843 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:55.278412 27814 consensus_queue.cc:260] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:55.336419 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:55.345414 22529 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 13.
I20260709 12:11:55.346598 27269 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:55.347113 27902 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.347646 27902 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:55.349849 27902 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317)
W20260709 12:11:55.351239 27895 log.cc:927] Time spent T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 12:11:55.351641 27713 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:11:55.356460 27680 consensus_meta.cc:287] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.674s	user 0.005s	sys 0.003s
I20260709 12:11:55.356876 27680 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:55.303642 27571 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.358696 27571 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:55.361052 27754 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:55.332432 27811 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:55.362650 22605 raft_consensus.cc:2368] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 13. Current term is 14.
I20260709 12:11:55.363323 27811 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:55.364296 22605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43070 (request call id 878) took 1235 ms. Trace:
I20260709 12:11:55.364639 22605 rpcz_store.cc:276] 0709 12:11:54.129138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:54.531704 (+402566us) service_pool.cc:224] Handling call
0709 12:11:55.364115 (+832411us) spinlock_profiling.cc:243] Waited 781 ms on lock 0x7b5400350cd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:55.364233 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1796556160}
I20260709 12:11:55.366569 27848 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:55.304904 27477 raft_consensus.cc:2804] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:11:55.369547 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 52307.9us
I20260709 12:11:55.244553 27896 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:55.260619 27900 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:55.393128 27898 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.398602 27898 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:55.399180 27866 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:55.400952 27898 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:55.401134 27889 consensus_queue.cc:237] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:55.392504 27811 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.402215 27811 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:55.402343 27837 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:55.404165 27811 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:55.404405 27837 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:55.336979 27886 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:55.406611 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:55.382989 27849 raft_consensus.cc:2804] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:55.345309 27399 raft_consensus.cc:2804] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:55.397475 26770 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:55.407914 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:55.368482 27892 log.cc:927] Time spent T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.352s	user 0.000s	sys 0.001s
I20260709 12:11:55.397907 27700 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:55.393772 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.409677 22523 raft_consensus.cc:1240] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:55.292630 27639 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:55.361091 27891 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:55.406962 27852 consensus_meta.cc:287] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.857s	user 0.000s	sys 0.011s
I20260709 12:11:55.421752 22605 raft_consensus.cc:1275] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:11:55.406817 27886 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:55.383329 27859 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:55.304721 27870 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:55.430060 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.411907 27893 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:55.368482 27843 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:55.396579 27814 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:55.389420 27875 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.747s	user 0.016s	sys 0.008s
I20260709 12:11:55.473492 22601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3066) took 1204 ms. Trace:
I20260709 12:11:55.383809 27680 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:55.445545 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:55.380960 27477 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:55.410817 27842 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:55.468225 23118 raft_consensus.cc:1240] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:55.461419 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:55.433969 27866 consensus_queue.cc:1059] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:55.473969 22601 rpcz_store.cc:276] 0709 12:11:54.269550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:54.571946 (+302396us) service_pool.cc:224] Handling call
0709 12:11:54.572231 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:54.596278 (+ 24047us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:54.596301 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:54.606517 (+ 10216us) log.cc:844] Serialized 26 byte log entry
0709 12:11:55.292853 (+686336us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:55.292914 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:55.293007 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:55.473214 (+180207us) raft_consensus.cc:1685] finished
0709 12:11:55.473241 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:55.473423 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9542,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":6905,"thread_start_us":649830,"threads_started":1,"wal-append.queue_time_us":766758}
W20260709 12:11:55.478282 27875 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.016s	sys 0.008s
I20260709 12:11:55.491601 27477 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:55.495123 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:11:55.492342 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 145271us
I20260709 12:11:55.493528 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:55.504365 23121 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:55.507682 27680 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:55.508270 27680 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:55.509377 23088 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:55.511963 27738 raft_consensus.cc:2804] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:55.512430 27738 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:55.512874 27738 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:55.516129 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 148804us
I20260709 12:11:55.428390 27700 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:55.517637 23089 leader_election.cc:304] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:55.516969 22570 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:55.531526 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:55.535219 23120 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
I20260709 12:11:55.489837 27713 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:11:55.519333 27807 consensus_meta.cc:287] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.995s	user 0.010s	sys 0.001s
I20260709 12:11:55.536736 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:55.492406 27902 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:55.494617 27890 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.494324 27896 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:55.479907 27859 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:55.546133 23089 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:55.547695 23121 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
I20260709 12:11:55.540189 27879 raft_consensus.cc:2804] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:55.546732 22570 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:55.570621 23089 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:55.571750 27890 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:55.574405 23124 raft_consensus.cc:1275] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:11:55.575832 27824 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:55.576063 22570 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:55.576421 27639 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:55.575829 27712 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:55.541906 27811 raft_consensus.cc:2749] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:55.578910 27469 consensus_meta.cc:287] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.969s	user 0.003s	sys 0.005s
I20260709 12:11:55.583917 27896 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:11:55.579850 27879 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:55.598838 27896 raft_consensus.cc:697] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 18 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:55.598932 27879 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:55.599501 27741 consensus_meta.cc:287] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 1.016s	user 0.011s	sys 0.000s
I20260709 12:11:55.600250 22448 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 17.
I20260709 12:11:55.599923 27896 consensus_queue.cc:237] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:55.601341 22448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2807) took 1338 ms. Trace:
I20260709 12:11:55.601665 22448 rpcz_store.cc:276] 0709 12:11:54.263211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:54.263801 (+   590us) service_pool.cc:224] Handling call
0709 12:11:55.601160 (+1337359us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54003f2ad4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:55.601264 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3071611136}
I20260709 12:11:55.587951 27824 raft_consensus.cc:697] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 14 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:55.598471 27469 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:55.603179 27824 consensus_queue.cc:237] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:55.605087 27469 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:55.547463 27900 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:55.578635 27890 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:55.589871 27910 consensus_queue.cc:1048] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:11:55.590507 27425 consensus_meta.cc:287] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 1.067s	user 0.010s	sys 0.000s
I20260709 12:11:55.591629 23089 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
W20260709 12:11:55.594167 27822 consensus_meta.cc:287] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.989s	user 0.006s	sys 0.002s
I20260709 12:11:55.583690 27712 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:55.595325 27547 consensus_meta.cc:287] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 1.053s	user 0.011s	sys 0.000s
I20260709 12:11:55.596124 27911 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:55.567116 27807 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:55.597864 27859 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:55.608724 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:55.610901 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:55.609943 22495 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:55.583791 27503 raft_consensus.cc:2804] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:55.625046 23089 leader_election.cc:400] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 13. Current term is 14.
I20260709 12:11:55.631630 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:55.627084 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:55.551849 27713 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:55.588284 27399 raft_consensus.cc:697] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:55.568241 27902 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:55.653127 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:55.632905 27890 raft_consensus.cc:2764] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
W20260709 12:11:55.709012 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 199685us
I20260709 12:11:55.737294 22448 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 16.
I20260709 12:11:55.708384 22449 raft_consensus.cc:2368] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 14. Current term is 15.
W20260709 12:11:55.739356 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 129511us
W20260709 12:11:55.739766 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 114905us
I20260709 12:11:55.743309 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:55.632611 27712 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:55.753585 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:55.751808 22495 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:55.756587 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:55.626019 27849 raft_consensus.cc:697] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:55.759956 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:55.622409 27811 consensus_queue.cc:1048] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.123s
I20260709 12:11:55.736382 27865 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.763736 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:55.764673 22526 raft_consensus.cc:2393] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 14: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:55.738940 27503 raft_consensus.cc:697] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 14 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:55.736367 27741 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:55.768371 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:55.761004 23124 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 6 LEARNER]: Advancing to term 8
I20260709 12:11:55.769518 22497 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:55.769795 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:55.629781 27425 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:55.770787 22601 raft_consensus.cc:2393] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 16: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:55.762480 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:55.764842 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:55.776021 27849 consensus_queue.cc:237] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:55.777884 27700 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:55.757783 27921 raft_consensus.cc:2804] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:55.780601 27425 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:55.780778 27921 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:55.781369 27921 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:55.766098 27870 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:55.703238 27547 raft_consensus.cc:2749] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:55.633015 27822 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:55.789024 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 362356us
I20260709 12:11:55.762598 27843 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:55.806167 27822 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:55.807089 27700 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:55.802238 22569 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:55.790872 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:55.746133 27838 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:55.765904 27514 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:55.740388 27911 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:55.790686 22451 raft_consensus.cc:1275] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:11:55.783939 27741 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:55.816170 27859 raft_consensus.cc:2749] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:55.829000 22454 raft_consensus.cc:2393] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 14: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
W20260709 12:11:55.832208 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 89511us
I20260709 12:11:55.833977 22456 raft_consensus.cc:2393] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 15: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:55.836952 27915 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:55.837472 27915 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:55.837852 27915 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:55.834923 27833 raft_consensus.cc:3055] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:11:55.848114 27833 raft_consensus.cc:740] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:55.848992 27833 consensus_queue.cc:260] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:55.852497 27911 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:55.854535 27680 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:55.767664 27865 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:55.835863 27514 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:55.839483 27838 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:55.885569 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 67205.7us
I20260709 12:11:55.884497 22452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 2242) took 1521 ms. Trace:
W20260709 12:11:55.894536 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.850956 27833 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:55.839495 27645 consensus_queue.cc:1048] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:11:55.887473 22452 rpcz_store.cc:276] 0709 12:11:54.363236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:54.387371 (+ 24135us) service_pool.cc:224] Handling call
0709 12:11:54.404425 (+ 17054us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:54.404623 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:54.404846 (+   223us) log.cc:844] Serialized 14 byte log entry
0709 12:11:55.849087 (+1444241us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b18003e80c0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cca4d64bc 00007f9cc782448b 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc7840c02 00007f9cca4c820b 00007f9cca4cdd23 00007f9cca4ce23a
0709 12:11:55.883997 (+ 34910us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:55.884074 (+    77us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:55.884145 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:55.884258 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:55.884419 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34559,"prepare.queue_time_us":12838,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":35829,"spinlock_wait_cycles":28663040,"thread_start_us":64517,"threads_started":1,"wal-append.queue_time_us":205784}
I20260709 12:11:55.900827 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:55.901484 23122 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 13.
I20260709 12:11:55.886088 27741 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:55.896876 27738 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:55.825913 27399 consensus_queue.cc:237] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:55.908869 27738 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:55.909783 23120 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 13.
I20260709 12:11:55.879839 27514 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:55.903638 27713 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:55.906231 27645 consensus_queue.cc:1059] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:55.887934 27870 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.897500 27917 consensus_queue.cc:1048] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:11:55.897620 27879 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:55.921574 27797 raft_consensus.cc:3055] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:55.922093 27797 raft_consensus.cc:740] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:55.886132 27503 consensus_queue.cc:237] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:55.931066 23123 raft_consensus.cc:1240] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:55.918138 27807 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:55.913300 27921 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:55.925400 27911 raft_consensus.cc:3055] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:55.950557 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:55.916174 27870 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:55.955907 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:55.957469 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 132379us
W20260709 12:11:55.985863 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 88566.5us
I20260709 12:11:55.986733 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:55.987931 22604 raft_consensus.cc:2410] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:11:55.989989 22604 raft_consensus.cc:1275] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:11:55.991858 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:55.992658 22604 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 15.
I20260709 12:11:55.985401 22496 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:55.953668 27911 raft_consensus.cc:740] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:55.994462 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:55.995503 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:55.996791 22601 raft_consensus.cc:2376] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 13. Re-sending same reply.
I20260709 12:11:55.998370 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:55.998934 22603 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:56.006064 22603 raft_consensus.cc:2468] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 9.
I20260709 12:11:55.923122 27797 consensus_queue.cc:260] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:56.024622 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:56.024642 22603 raft_consensus.cc:1275] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:11:56.026535 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:56.027141 22606 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:56.006296 27712 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:56.010428 27920 raft_consensus.cc:2804] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:56.031813 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:56.032428 22598 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 10.
I20260709 12:11:56.039908 27865 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:56.041873 27934 consensus_queue.cc:1048] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 12:11:56.043659 22606 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 16.
I20260709 12:11:56.048475 27870 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:56.052470 27700 raft_consensus.cc:2749] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:56.055383 27921 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:56.035372 27797 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:56.052883 27911 consensus_queue.cc:260] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:56.062310 22495 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:56.063071 27879 leader_election.cc:290] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:56.065663 27836 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:56.069602 27814 consensus_meta.cc:287] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.597s	user 0.009s	sys 0.001s
I20260709 12:11:56.071523 27870 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:56.072037 22531 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
I20260709 12:11:56.072161 27870 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:56.073568 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:56.075493 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:56.075736 27870 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:56.076318 27477 consensus_meta.cc:287] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.555s	user 0.000s	sys 0.010s
I20260709 12:11:56.076689 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:56.077622 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:56.077832 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:56.078092 22421 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:56.079603 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:56.080228 23117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57318 (request call id 1218) took 1376 ms. Trace:
I20260709 12:11:56.080582 23117 rpcz_store.cc:276] 0709 12:11:54.703824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:54.705430 (+  1606us) service_pool.cc:224] Handling call
0709 12:11:56.080079 (+1374649us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54007f0154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:56.080175 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":394493824}
I20260709 12:11:56.080772 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:56.031230 27920 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:56.079604 22421 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:56.074764 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:56.088546 22421 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:56.065692 27934 raft_consensus.cc:2804] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:56.080590 22530 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13854b1cf45740e680c203d064295c78"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:46680
I20260709 12:11:56.085142 22497 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:56.094539 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:56.095047 22530 raft_consensus.cc:606] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 LEADER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:11:56.095197 22448 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:56.078933 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:56.098188 22421 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:56.099063 22525 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 13.
I20260709 12:11:56.111217 22523 raft_consensus.cc:1275] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:11:56.117077 22569 leader_election.cc:400] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 14. Current term is 15.
I20260709 12:11:56.117533 22569 leader_election.cc:403] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:56.091028 27920 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:56.089772 27741 raft_consensus.cc:2749] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:11:56.120390 22421 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:56.097494 27934 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:56.129966 22569 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:56.126551 22421 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:56.112397 27728 raft_consensus.cc:2749] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:56.083766 27681 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:56.132969 22569 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:56.121150 27911 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:56.114446 27838 raft_consensus.cc:2749] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:56.076737 27477 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:56.137913 22421 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:56.125567 27650 raft_consensus.cc:2804] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:56.122431 27503 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:56.127498 27701 raft_consensus.cc:2749] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 14. Current term is 15.
I20260709 12:11:56.124783 27469 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:56.127107 27836 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:56.133404 27934 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:56.132089 27870 raft_consensus.cc:2804] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:56.133638 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:56.144202 27741 raft_consensus.cc:2749] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:56.135550 27896 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:56.165000 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:56.143266 27712 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:56.160993 27503 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:56.147502 27650 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:56.148609 27677 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.176391 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:56.180593 23117 raft_consensus.cc:2468] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 10.
I20260709 12:11:56.143472 27866 consensus_queue.cc:1048] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 12:11:56.178962 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:56.147819 27728 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:56.180970 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:56.185672 23121 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:56.185986 23124 raft_consensus.cc:2393] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 14: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:56.144073 27681 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:56.182904 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:56.183823 22421 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:56.160451 27870 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:56.179816 27650 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:56.186605 27677 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:56.182082 27469 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:56.192529 27503 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:56.218375 27677 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:56.194965 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:56.195611 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:56.156133 27836 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:56.224326 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:56.197378 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:56.203368 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:56.225980 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:56.206501 22450 raft_consensus.cc:2468] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 8.
I20260709 12:11:56.171968 27569 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:56.218340 23121 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 16.
I20260709 12:11:56.469949 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:56.451437 22569 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:56.218499 27469 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:56.175446 27896 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:56.451072 23124 raft_consensus.cc:2393] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 9: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:56.451732 22448 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 14.
I20260709 12:11:56.452869 22456 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 17.
I20260709 12:11:56.475710 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:56.476174 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:56.476377 22448 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 14.
I20260709 12:11:56.476671 22569 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:56.480079 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:56.480579 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:56.482594 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:56.484333 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:56.208026 27870 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:56.207568 27838 raft_consensus.cc:2804] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:56.490258 22448 raft_consensus.cc:1275] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:11:56.207378 27700 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:11:56.469298 27915 consensus_meta.cc:287] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.631s	user 0.011s	sys 0.000s
I20260709 12:11:56.498530 23125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 1203) took 1869 ms. Trace:
I20260709 12:11:56.500618 23125 rpcz_store.cc:276] 0709 12:11:54.629545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:54.645690 (+ 16145us) service_pool.cc:224] Handling call
0709 12:11:54.678849 (+ 33159us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:55.005942 (+327093us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:55.005972 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:55.006011 (+    39us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:55.006045 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:56.498298 (+1492253us) spinlock_profiling.cc:243] Waited 327 ms on lock 0x7b54004e4154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:56.498346 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:56.498472 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":751812992}
I20260709 12:11:56.502861 23117 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 13.
I20260709 12:11:56.496762 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:56.488025 27677 raft_consensus.cc:2764] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 12:11:56.493929 27811 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:56.493696 27838 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:56.556176 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:56.517663 27833 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.547976 27811 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:56.501941 27700 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:56.561043 27838 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:56.502390 27915 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:56.559628 27477 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:56.598608 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:56.600997 22448 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:56.576689 27811 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:11:56.614024 27938 log.cc:927] Time spent T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.466s	user 0.001s	sys 0.000s
W20260709 12:11:56.614782 27942 log.cc:927] Time spent T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.458s	user 0.001s	sys 0.000s
I20260709 12:11:56.618956 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:56.597126 27677 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:56.622100 22450 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:56.625398 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 460744us
I20260709 12:11:56.573776 27833 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:56.640434 27833 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:56.642830 23087 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:56.643942 27888 raft_consensus.cc:2749] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:56.648478 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:56.649665 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:56.650184 22457 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:56.652391 27940 log.cc:927] Time spent T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:11:56.652839 22495 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:11:56.653519 27945 log.cc:927] Time spent T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 12:11:56.654996 27750 raft_consensus.cc:2804] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:56.654914 27934 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:56.655604 27750 raft_consensus.cc:697] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:56.655776 27469 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:56.656515 27750 consensus_queue.cc:237] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:56.674768 23087 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:56.678050 22421 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:56.683367 23087 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:56.680410 27955 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.690519 27955 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:56.692570 27955 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:56.659474 27896 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:56.695209 22421 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:56.657142 27934 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:56.705894 22457 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 14.
I20260709 12:11:56.688808 27888 raft_consensus.cc:2804] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:56.695194 27469 raft_consensus.cc:2804] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:56.630889 27677 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:56.700758 27741 raft_consensus.cc:2804] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:56.701316 27896 raft_consensus.cc:2749] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:56.701161 27836 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:56.726876 22448 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 16.
I20260709 12:11:56.731429 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:56.715378 27469 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:56.714486 27888 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:56.736812 27902 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:56.734179 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:56.738060 22453 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 16.
I20260709 12:11:56.723791 22495 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:56.737450 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:56.739820 22569 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:56.750813 22453 raft_consensus.cc:1275] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:11:56.751075 22450 raft_consensus.cc:2468] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 9.
I20260709 12:11:56.738610 27469 raft_consensus.cc:3060] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:56.749891 27650 consensus_meta.cc:287] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.524s	user 0.010s	sys 0.002s
I20260709 12:11:56.751101 27778 raft_consensus.cc:2804] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:56.750470 27888 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:56.823719 22450 raft_consensus.cc:1275] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:56.825436 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:11:56.837325 22599 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.006s	sys 0.006s
W20260709 12:11:56.843753 22599 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.006s	sys 0.006s
I20260709 12:11:56.713006 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:56.826393 27700 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:56.835809 27797 consensus_meta.cc:287] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.776s	user 0.014s	sys 0.002s
I20260709 12:11:56.831420 27866 raft_consensus.cc:2804] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:56.831524 27778 raft_consensus.cc:697] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:56.851610 22451 raft_consensus.cc:2410] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:11:56.824218 27650 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:56.861104 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 196761us
I20260709 12:11:56.850325 27866 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:56.847134 27547 consensus_queue.cc:1048] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 12:11:56.863181 27866 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:56.860453 27915 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:56.854360 27811 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:56.867467 27934 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
W20260709 12:11:56.878756 22605 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.840s	user 0.000s	sys 0.012s
W20260709 12:11:56.879158 22605 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.841s	user 0.001s	sys 0.012s
I20260709 12:11:56.878469 27778 consensus_queue.cc:237] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:56.895808 27956 log.cc:927] Time spent T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.140s	user 0.011s	sys 0.000s
I20260709 12:11:56.899473 27870 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:56.903486 22454 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 13.
W20260709 12:11:56.914036 27911 consensus_meta.cc:287] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.768s	user 0.012s	sys 0.000s
I20260709 12:11:56.909420 27934 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:56.918792 27934 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:56.921023 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 237736us
I20260709 12:11:56.922214 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:56.905056 27514 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:56.923954 23088 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:56.926806 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:56.926826 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:56.935322 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:56.937726 22457 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 16.
W20260709 12:11:56.938915 22597 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.807s	user 0.000s	sys 0.023s
W20260709 12:11:56.939424 22597 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.000s	sys 0.023s
W20260709 12:11:56.912819 27957 log.cc:927] Time spent T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:11:56.941318 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:11:56.925463 27958 log.cc:927] Time spent T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:11:56.907480 27811 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:56.925223 27902 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:56.909627 27838 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:56.938376 27741 raft_consensus.cc:697] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:56.941175 27814 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:56.941257 27865 raft_consensus.cc:2749] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:56.959185 22450 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 17.
I20260709 12:11:56.953688 27836 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:56.951594 27677 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:56.976428 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 52569.1us
I20260709 12:11:56.977257 23088 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:56.998250 27870 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:56.962255 27902 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:56.994786 27871 raft_consensus.cc:2749] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:57.003614 23088 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:56.993903 27650 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:56.972708 27836 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:57.004833 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 81849.6us
I20260709 12:11:56.999799 27514 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:57.011973 27681 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:57.002573 27677 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.024533 23087 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:57.037577 27871 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:11:57.037884 27728 consensus_meta.cc:287] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.845s	user 0.012s	sys 0.000s
I20260709 12:11:57.038307 27728 raft_consensus.cc:2749] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:57.038123 27871 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:56.998281 27977 raft_consensus.cc:2749] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:57.039716 23118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 1211) took 2847 ms. Trace:
I20260709 12:11:57.040269 27871 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:57.040227 23118 rpcz_store.cc:276] 0709 12:11:54.187893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:54.188298 (+   405us) service_pool.cc:224] Handling call
0709 12:11:54.212062 (+ 23764us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:55.485310 (+1273248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:57.034551 (+1549241us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b540018fbd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:57.034791 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2888471424}
W20260709 12:11:57.043889 27950 log.cc:927] Time spent T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.406s	user 0.003s	sys 0.000s
I20260709 12:11:57.047323 27902 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:57.048038 27972 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:57.048585 27972 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:57.037111 23088 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:57.052898 23088 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:57.047397 27969 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:57.054857 27902 raft_consensus.cc:2804] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:57.055528 27976 consensus_queue.cc:1048] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:11:57.055812 27901 raft_consensus.cc:2749] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:57.051353 27514 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:56.996881 27964 consensus_queue.cc:1048] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 12:11:57.056586 27836 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:57.004464 27741 consensus_queue.cc:237] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:57.058314 27838 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:57.023113 27811 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:57.064167 27920 consensus_meta.cc:287] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.934s	user 0.009s	sys 0.002s
I20260709 12:11:57.036171 27822 raft_consensus.cc:2749] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:57.064508 27897 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:57.064725 27469 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:57.066048 22603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3085) took 1039 ms. Trace:
I20260709 12:11:57.068320 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:57.068466 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:57.078388 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:57.119575 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:57.119772 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:57.120313 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:57.050802 27972 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:57.120863 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:57.121834 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:57.129107 27571 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:57.129594 27870 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.135589 27977 raft_consensus.cc:2804] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:57.156757 22524 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:46680
I20260709 12:11:57.135982 22452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2834) took 1052 ms. Trace:
I20260709 12:11:57.142408 27750 raft_consensus.cc:993] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881: : Instructing follower 8701cd5186a949538d8efafb5f987270 to start an election
I20260709 12:11:57.075225 27902 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:57.149740 22532 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 15.
I20260709 12:11:57.144785 22603 rpcz_store.cc:276] 0709 12:11:56.026983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.027104 (+   121us) service_pool.cc:224] Handling call
0709 12:11:56.027385 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:56.027739 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:56.155213 (+127474us) log.cc:844] Serialized 14 byte log entry
0709 12:11:56.477112 (+321899us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:56.489325 (+ 12213us) log.cc:844] Serialized 26 byte log entry
0709 12:11:56.489960 (+   635us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:56.499936 (+  9976us) log.cc:844] Serialized 14 byte log entry
0709 12:11:56.503960 (+  4024us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:56.504465 (+   505us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:56.646435 (+141970us) spinlock_profiling.cc:243] Waited 25.7 ms on lock 0x7b180044ab80. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc7841522 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd 0000000000388634 0000000000388479 00007f9cc782483a
0709 12:11:57.043236 (+396801us) spinlock_profiling.cc:243] Waited 29.5 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:11:57.065819 (+ 22583us) raft_consensus.cc:1685] finished
0709 12:11:57.065842 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:57.065988 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14934,"prepare.queue_time_us":185201,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":77,"raft.queue_time_us":811,"raft.run_cpu_time_us":357,"raft.run_wall_time_us":22509,"spinlock_wait_cycles":126861568,"thread_start_us":422386,"threads_started":2,"wal-append.queue_time_us":460392}
I20260709 12:11:57.077682 27849 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:57.147722 22526 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 14.
I20260709 12:11:57.166790 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:57.167449 22597 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:57.169637 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:57.170233 22605 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 13.
I20260709 12:11:57.170672 22448 raft_consensus.cc:1240] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:57.169317 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:57.074250 27888 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:57.175757 22603 raft_consensus.cc:1240] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:57.181347 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:57.182225 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:57.183789 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:57.184679 22606 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 13.
I20260709 12:11:57.154731 23089 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:57.054111 27677 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:57.157800 22452 rpcz_store.cc:276] 0709 12:11:56.083355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.083679 (+   324us) service_pool.cc:224] Handling call
0709 12:11:56.097394 (+ 13715us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:56.097591 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:11:56.569456 (+471865us) log.cc:844] Serialized 14 byte log entry
0709 12:11:57.049920 (+480464us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b18004aed20. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cca4d64bc 00007f9cc782448b 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc783e455 00007f9cca926060 00007f9cca938716 00007f9cca949287
0709 12:11:57.050346 (+   426us) log.cc:844] Serialized 14 byte log entry
0709 12:11:57.135547 (+ 85201us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:57.135627 (+    80us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:57.135693 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:57.135777 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:57.135914 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88354,"prepare.queue_time_us":69390,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":86,"raft.queue_time_us":234259,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":18481,"spinlock_wait_cycles":6581120,"thread_start_us":739329,"threads_started":3,"wal-append.queue_time_us":279431}
I20260709 12:11:57.187762 27889 raft_consensus.cc:2749] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:57.167217 27902 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:57.184716 22495 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:57.199682 22495 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:57.200896 27571 raft_consensus.cc:2804] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:57.201606 27571 raft_consensus.cc:697] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:57.200932 27750 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:57.202257 27750 raft_consensus.cc:697] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
W20260709 12:11:57.202440 23116 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57328 (request call id 1452) took 2607 ms (client timeout 2166 ms). Trace:
I20260709 12:11:57.202577 27571 consensus_queue.cc:237] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:57.203227 27750 consensus_queue.cc:237] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:57.203116 27797 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.194640 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:57.205670 27797 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:57.206036 22452 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:11:57.191012 23089 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:57.202872 23116 rpcz_store.cc:269] 0709 12:11:54.595401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:54.605479 (+ 10078us) service_pool.cc:224] Handling call
0709 12:11:57.202200 (+2596721us) spinlock_profiling.cc:243] Waited 2.37 s on lock 0x7b540018ef54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:57.202342 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5450355584}
I20260709 12:11:57.077888 27969 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:57.211535 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:57.176199 27934 raft_consensus.cc:1081] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 LEADER]: Signalling peer 8701cd5186a949538d8efafb5f987270 to start an election
I20260709 12:11:57.127137 27811 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:57.212155 22452 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:57.216833 22597 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 14.
W20260709 12:11:57.212373 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 314085us
I20260709 12:11:57.127287 27920 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:57.175019 27977 raft_consensus.cc:697] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 16 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:57.221243 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:57.221287 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:57.167912 27870 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:57.151587 27897 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:57.211223 27806 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:57.212688 27879 raft_consensus.cc:2804] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:57.233346 22524 raft_consensus.cc:606] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:11:57.234965 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:57.235463 22524 raft_consensus.cc:614] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:57.211421 27809 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:57.174655 27849 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:57.232151 27814 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.234516 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:57.249815 22602 raft_consensus.cc:2393] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 15: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:57.249742 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:57.223862 23089 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:57.250769 22421 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:57.251698 23089 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:57.252948 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 228495us
I20260709 12:11:57.236925 23123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 1210) took 1492 ms. Trace:
I20260709 12:11:57.236990 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:57.222424 27949 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.240161 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:57.217442 27972 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.245252 22452 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 18.
I20260709 12:11:57.235633 23118 raft_consensus.cc:2468] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 12.
I20260709 12:11:57.212016 27976 consensus_queue.cc:1048] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 12:11:57.262552 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:57.256347 23123 rpcz_store.cc:276] 0709 12:11:55.744544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.786923 (+ 42379us) service_pool.cc:224] Handling call
0709 12:11:55.787376 (+   453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:55.934448 (+147072us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:57.236695 (+1302247us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b54006a0ed4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:57.236872 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":329745664}
I20260709 12:11:57.260398 27949 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:57.269765 27949 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:57.270637 27972 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:57.260934 27983 raft_consensus.cc:2749] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:57.260318 27889 raft_consensus.cc:2804] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:57.260614 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:57.231819 27831 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:57.237646 27879 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:11:57.318020 22421 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:11:57.319761 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 265435us
W20260709 12:11:57.320539 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 59128.3us
I20260709 12:11:57.261682 27814 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:57.322602 22603 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 14.
I20260709 12:11:57.281517 27897 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:57.323887 27889 raft_consensus.cc:697] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 9 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:57.324275 27681 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:57.324692 27681 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:57.325060 27681 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:57.324882 27889 consensus_queue.cc:237] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:57.327230 27831 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:57.328329 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:57.329228 27831 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:57.246611 27970 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:57.330014 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:57.329968 27970 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:57.330641 27879 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:57.332216 22531 raft_consensus.cc:1275] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:11:57.320680 22421 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:57.334654 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:57.335841 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:57.373588 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 121954us
I20260709 12:11:57.394120 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:11:57.394496 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 63941.7us
I20260709 12:11:57.395473 22531 raft_consensus.cc:1240] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:57.395803 22569 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:57.385525 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:57.397559 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:57.398108 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:57.400751 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:57.337142 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:57.401883 22602 raft_consensus.cc:2393] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 9: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:57.403056 23123 raft_consensus.cc:1240] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 15. Current term is 16. Ops: [13.10-15.11]
I20260709 12:11:57.371706 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:57.402045 22601 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
I20260709 12:11:57.406369 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:57.407155 22598 raft_consensus.cc:2393] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 15: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:57.405519 22457 raft_consensus.cc:2368] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 13. Current term is 14.
I20260709 12:11:57.415432 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:57.275871 27677 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:57.274055 27469 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:57.332129 27970 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:57.404455 22570 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:57.264818 27645 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.359040 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:57.347815 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:57.277730 27920 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:57.282223 27797 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:57.417377 23087 leader_election.cc:400] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 election: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 13. Current term is 14.
I20260709 12:11:57.439079 23087 leader_election.cc:403] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:11:57.435356 23089 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:57.336336 27987 raft_consensus.cc:2804] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:57.419696 22457 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 15.
I20260709 12:11:57.238147 27806 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:57.336517 22453 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 16.
I20260709 12:11:57.443348 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:57.443913 22453 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 13.
I20260709 12:11:57.444118 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:57.444852 22601 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 13.
I20260709 12:11:57.445401 22569 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:57.447137 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:57.447685 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:57.411800 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:57.285095 27902 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:57.449640 27964 raft_consensus.cc:2749] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:57.433101 27838 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:57.426241 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:57.451514 22600 raft_consensus.cc:2468] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
I20260709 12:11:57.427095 27525 raft_consensus.cc:2749] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:57.458388 23116 raft_consensus.cc:2368] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 13. Current term is 14.
I20260709 12:11:57.458799 23120 raft_consensus.cc:1240] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:57.402702 27898 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:57.251396 27809 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:57.437021 22450 raft_consensus.cc:2368] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 13. Current term is 14.
I20260709 12:11:57.406816 27983 consensus_queue.cc:1048] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 12:11:57.403178 27985 consensus_queue.cc:1059] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 12:11:57.437011 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:57.439500 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:57.441174 23087 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:57.279309 27966 raft_consensus.cc:2749] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:57.470376 22422 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:57.472018 22422 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:57.441684 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:57.420846 27851 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:11:57.447695 22457 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:57.475190 22598 raft_consensus.cc:2393] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 18: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:57.318706 27822 consensus_queue.cc:1048] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.112s
I20260709 12:11:57.402732 27831 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.477269 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:11:57.420991 27866 consensus_meta.cc:287] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.535s	user 0.009s	sys 0.001s
I20260709 12:11:57.463313 27902 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:57.276153 27977 consensus_queue.cc:237] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:57.446732 27891 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:57.465147 27677 raft_consensus.cc:2804] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:57.439146 27989 consensus_queue.cc:1059] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 12:11:57.436007 27814 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:57.442576 27987 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:57.476044 27898 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:57.496748 27987 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:57.498225 27898 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:57.476996 27469 raft_consensus.cc:2749] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:57.492805 27677 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:57.499533 27677 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:57.492316 27866 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:57.501837 27866 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:57.484942 27851 raft_consensus.cc:697] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 18 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:57.476089 22422 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:57.503563 27849 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:57.503278 27851 consensus_queue.cc:237] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:57.503907 22422 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:57.469954 27888 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:57.450575 27838 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:57.505162 22422 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:57.485237 27831 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:57.506323 22422 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:57.506743 27838 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:57.507251 27469 raft_consensus.cc:2749] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:57.507966 27469 raft_consensus.cc:2749] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:57.508625 27469 raft_consensus.cc:2749] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:57.508889 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:57.509502 23117 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:11:57.509580 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:57.509966 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:57.445639 27645 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:57.476557 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:57.509584 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:57.493264 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:57.511873 23124 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 16.
I20260709 12:11:57.512441 22421 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:57.511600 22600 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 15.
I20260709 12:11:57.517160 22457 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 15.
I20260709 12:11:57.476632 27964 raft_consensus.cc:2804] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:57.480890 27806 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:57.547051 27902 raft_consensus.cc:3055] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:57.547467 27902 raft_consensus.cc:740] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:57.548314 27902 consensus_queue.cc:260] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:57.549497 27902 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:57.527369 27838 raft_consensus.cc:2749] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:57.535282 27879 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:57.536617 27811 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:57.527048 27966 raft_consensus.cc:2804] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:57.539775 22523 raft_consensus.cc:1275] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:11:57.540594 27645 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:57.544888 27969 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:57.480088 27870 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:57.545940 27978 log.cc:927] Time spent T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.287s	user 0.001s	sys 0.000s
I20260709 12:11:57.530488 27964 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:11:57.553828 27930 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.003s	sys 0.046s
I20260709 12:11:57.551667 27831 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:57.553923 27728 raft_consensus.cc:2749] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:57.574095 27966 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:57.576153 27985 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.550959 27681 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:57.593199 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 157932us
W20260709 12:11:57.582638 27930 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.003s	sys 0.046s
I20260709 12:11:57.592446 27966 raft_consensus.cc:3060] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:57.606669 23089 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:57.609301 27983 raft_consensus.cc:2804] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:57.609702 27983 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:57.610036 27983 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:57.580778 27964 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:57.617961 23089 leader_election.cc:304] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:57.619235 27966 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:57.623179 27469 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:11:57.623430 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 219049us
I20260709 12:11:57.623680 27469 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:57.625100 22570 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:57.625741 27469 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:57.590958 27870 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:57.626737 27831 raft_consensus.cc:2749] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:57.627225 27870 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:57.628486 22570 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:57.629285 27870 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:57.629308 27966 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:57.629565 27811 raft_consensus.cc:2749] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:11:57.630179 27990 log.cc:927] Time spent T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:11:57.631134 27987 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:57.633174 27987 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:57.633263 27811 consensus_queue.cc:1059] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:57.635044 27701 raft_consensus.cc:3055] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:57.635511 27701 raft_consensus.cc:740] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:57.636597 27701 consensus_queue.cc:260] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:57.637853 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:57.638473 22529 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:57.636539 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:57.642238 23123 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:11:57.647934 22451 raft_consensus.cc:2393] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 15: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:57.648370 22448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2845) took 1010 ms. Trace:
I20260709 12:11:57.648730 22448 rpcz_store.cc:276] 0709 12:11:56.637976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.754162 (+116186us) service_pool.cc:224] Handling call
0709 12:11:56.754391 (+   229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:57.171069 (+416678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:57.648162 (+477093us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b540019b4d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:57.648316 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":956967296}
W20260709 12:11:57.650954 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 144705us
I20260709 12:11:57.652786 22422 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:57.657812 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:57.653450 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:57.669242 22422 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:57.672219 22452 raft_consensus.cc:1240] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 LEADER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:57.675144 22422 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:57.676040 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:57.676630 23122 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:57.679477 27994 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:57.606492 27985 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:57.680023 27994 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:57.681766 27985 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:57.657915 27989 raft_consensus.cc:2804] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:57.682101 27994 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:57.684067 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:57.686487 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:57.642330 27811 consensus_queue.cc:1059] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 12:11:57.687603 27811 raft_consensus.cc:3055] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:57.688004 27811 raft_consensus.cc:740] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:57.688985 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:57.688866 27811 consensus_queue.cc:260] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:57.674124 27967 raft_consensus.cc:2804] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:57.690465 27967 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:57.690837 27967 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:57.626766 27677 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:57.692852 27677 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:11:57.697297 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:57.698864 22529 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 14.
I20260709 12:11:57.694167 22422 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:57.702409 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:57.706825 27870 raft_consensus.cc:2804] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:57.649223 27983 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:57.707317 27870 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:57.707504 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:57.707815 27870 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:57.708593 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:57.708909 27983 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:57.709122 23117 raft_consensus.cc:2468] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
I20260709 12:11:57.710120 23117 raft_consensus.cc:1240] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:57.688026 27681 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:57.711221 23124 raft_consensus.cc:1240] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:57.706935 27987 raft_consensus.cc:2804] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:57.712507 27987 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:57.712898 27987 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:57.715158 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:57.715817 22600 raft_consensus.cc:2368] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 16. Current term is 17.
I20260709 12:11:57.716097 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:57.716572 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:57.717121 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:57.717548 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:57.717795 22597 raft_consensus.cc:2393] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 12: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:57.718557 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:57.718577 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:57.720131 22603 raft_consensus.cc:1240] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:57.720688 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:57.721936 22421 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:57.725319 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:57.725899 22604 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 18.
I20260709 12:11:57.723016 22600 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 13.
I20260709 12:11:57.731810 22603 raft_consensus.cc:1275] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:57.732851 22422 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:57.735183 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:57.736028 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:57.736236 23122 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 14.
I20260709 12:11:57.736657 22600 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 14.
I20260709 12:11:57.737501 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:57.690834 27879 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:57.669762 27849 consensus_queue.cc:1059] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.069s
I20260709 12:11:57.738920 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:57.700569 27989 raft_consensus.cc:697] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 14 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:57.743685 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:57.744837 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:57.745566 23118 raft_consensus.cc:2393] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 10: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:57.745486 27966 raft_consensus.cc:2804] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:57.746064 27966 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:57.746446 27966 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:57.746490 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:57.747604 27989 consensus_queue.cc:237] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:57.754854 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:57.755756 22604 raft_consensus.cc:2393] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 15: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:11:57.755601 22450 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:57.752427 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:57.753201 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:57.754061 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:57.757951 22449 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:57.758337 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:57.748657 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:57.762634 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:57.763927 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:57.765522 22597 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 14.
I20260709 12:11:57.766386 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:57.767467 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:57.768740 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:57.768740 22457 raft_consensus.cc:1275] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:57.748961 27838 consensus_queue.cc:1059] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 12:11:57.748769 27994 raft_consensus.cc:2749] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:11:57.775207 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:57.782109 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:57.788805 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:57.789619 22497 leader_election.cc:400] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 election: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 16. Current term is 17.
I20260709 12:11:57.759548 27681 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:57.815392 27681 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:11:57.816416 27809 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:57.817768 27681 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:57.822830 27961 log.cc:927] Time spent T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.908s	user 0.006s	sys 0.011s
I20260709 12:11:57.824591 27883 consensus_queue.cc:1059] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:11:57.826833 22497 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:57.832842 27701 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:57.833086 27809 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:57.833711 27809 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:57.834241 27809 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:57.774171 27996 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.836094 27996 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:57.838249 27996 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:57.774248 27865 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:57.774570 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:57.839619 23118 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 13.
I20260709 12:11:57.777050 22604 raft_consensus.cc:1240] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 12:11:57.749070 27741 raft_consensus.cc:2804] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:57.824941 22599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3089) took 1766 ms. Trace:
I20260709 12:11:57.806438 22449 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 17.
I20260709 12:11:57.828115 27400 raft_consensus.cc:3055] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:57.829319 23087 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:57.827505 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:57.846015 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:57.804644 22450 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 17.
I20260709 12:11:57.840945 22599 rpcz_store.cc:276] 0709 12:11:56.058825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.081437 (+ 22612us) service_pool.cc:224] Handling call
0709 12:11:56.081716 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:56.082045 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:56.082076 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:56.082564 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 12:11:56.844220 (+761656us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:56.844260 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:56.844325 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:57.822189 (+977864us) spinlock_profiling.cc:243] Waited 1.36 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:11:57.824647 (+  2458us) raft_consensus.cc:1685] finished
0709 12:11:57.824670 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:57.824882 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2168,"raft.queue_time_us":883,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":10698,"spinlock_wait_cycles":3120512,"thread_start_us":761314,"threads_started":1,"wal-append.queue_time_us":831443}
I20260709 12:11:57.846316 22605 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 8.
I20260709 12:11:57.843123 22421 leader_election.cc:400] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Vote denied by peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353) with higher term. Message: Invalid argument: T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 13. Current term is 14.
I20260709 12:11:57.846550 23087 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:57.847177 22421 leader_election.cc:403] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
W20260709 12:11:57.847815 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 48855.7us
I20260709 12:11:57.847960 22421 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:57.857460 23087 leader_election.cc:400] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 election: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 13. Current term is 14.
I20260709 12:11:57.857872 23087 leader_election.cc:403] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:11:57.788288 27880 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:57.875810 22529 raft_consensus.cc:1275] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:57.786258 27972 leader_election.cc:290] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:57.845438 27865 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:57.884387 23121 raft_consensus.cc:1275] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:11:57.884883 27865 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:57.885175 26770 raft_consensus.cc:3055] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:57.885664 26770 raft_consensus.cc:740] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:57.786015 27838 raft_consensus.cc:3055] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:57.886272 27838 raft_consensus.cc:740] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:57.862506 22569 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:57.856029 22422 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:57.860622 23118 raft_consensus.cc:1240] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:57.861677 27977 raft_consensus.cc:2749] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 13. Current term is 14.
I20260709 12:11:57.860508 23087 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:57.859283 28004 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:57.871434 22448 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 18.
I20260709 12:11:57.871948 27997 raft_consensus.cc:2804] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:57.872447 27891 raft_consensus.cc:2749] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 13. Current term is 14.
I20260709 12:11:57.872372 27833 consensus_queue.cc:1048] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:57.861168 27985 raft_consensus.cc:2804] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:57.873577 27966 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:57.841091 27967 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:57.887807 22569 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:57.896035 27681 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.895318 22422 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:57.924736 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:57.894871 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 193790us
I20260709 12:11:57.845377 27741 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:57.845628 27400 raft_consensus.cc:740] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:57.859524 27822 raft_consensus.cc:2749] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:57.923359 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:57.925397 22450 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 15.
I20260709 12:11:57.904429 27994 raft_consensus.cc:2804] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:57.931833 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:57.934464 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:57.935742 22455 raft_consensus.cc:1240] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:57.958106 22569 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:57.936121 22456 raft_consensus.cc:1240] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 16. Current term is 17. Ops: [12.10-16.12]
I20260709 12:11:57.902879 27865 raft_consensus.cc:2804] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:57.906504 28005 raft_consensus.cc:2804] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:57.886588 26770 consensus_queue.cc:260] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:57.882731 27870 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:57.938957 22457 raft_consensus.cc:1275] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:11:57.954461 22570 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:57.918926 27976 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:57.909235 27997 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:57.945353 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:57.925611 27831 raft_consensus.cc:2804] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:57.968982 22602 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:57.958518 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:11:57.941895 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 46672.1us
I20260709 12:11:57.963248 22457 pending_rounds.cc:85] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f: Aborting all ops after (but not including) 8
I20260709 12:11:57.971222 22457 pending_rounds.cc:107] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:11:57.971515 22457 raft_consensus.cc:2889] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:57.955560 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:57.967047 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:57.919031 27985 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:57.974839 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:57.967690 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:57.968714 26770 raft_consensus.cc:3060] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:57.966588 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:57.975555 22526 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 16.
I20260709 12:11:57.971014 22422 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:57.974107 22449 raft_consensus.cc:1275] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 12:11:58.013974 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 59601.5us
I20260709 12:11:58.016052 22570 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:58.017357 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:57.979350 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:58.020224 22532 raft_consensus.cc:2368] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 13. Current term is 14.
I20260709 12:11:57.989794 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:57.964385 27994 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:58.027266 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:57.951761 27741 raft_consensus.cc:3060] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:58.029263 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:57.970651 27997 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:58.048467 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 75057.2us
I20260709 12:11:57.955564 27681 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:58.047591 22497 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:57.941555 28014 consensus_queue.cc:1048] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 12:11:57.970906 27851 raft_consensus.cc:2804] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:58.049211 27525 raft_consensus.cc:2804] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:58.027735 27814 raft_consensus.cc:2804] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:57.970281 27865 raft_consensus.cc:697] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:57.979719 27985 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:58.034040 27994 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:58.059661 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:58.059763 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:58.012312 27831 raft_consensus.cc:697] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:58.053288 22497 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:57.970311 28005 raft_consensus.cc:697] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 15 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:58.093909 22497 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:58.094964 26770 raft_consensus.cc:2749] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:58.059790 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:58.064425 27525 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:58.088254 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:58.087942 22602 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 15.
I20260709 12:11:58.101006 22532 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:58.090945 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:58.094365 22530 raft_consensus.cc:2468] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
I20260709 12:11:58.096130 22524 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 14.
I20260709 12:11:58.097431 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:57.943951 28015 raft_consensus.cc:2749] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:58.064013 27851 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:58.066212 27949 raft_consensus.cc:2804] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:58.034233 22570 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:11:58.115103 22421 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:58.087031 27814 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:58.064858 28014 raft_consensus.cc:2804] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:11:58.126268 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 92118.8us
I20260709 12:11:58.127636 27831 consensus_queue.cc:237] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:57.970508 27976 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:58.104864 27525 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:58.065023 27879 consensus_queue.cc:1059] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 12:11:58.134814 22421 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:58.029996 28013 consensus_queue.cc:1059] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.101s
I20260709 12:11:58.065785 27750 consensus_queue.cc:1048] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:11:58.091295 27902 consensus_queue.cc:1048] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 12:11:58.075505 27964 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:58.089948 27977 consensus_queue.cc:1048] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:11:58.089819 27891 consensus_queue.cc:1059] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:11:58.131181 27920 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:58.144907 22529 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 15.
I20260709 12:11:58.111840 27949 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:58.131870 27814 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:58.156610 22421 leader_election.cc:400] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 13. Current term is 14.
I20260709 12:11:58.159353 22570 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:58.115211 27851 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:58.161578 22496 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:58.026824 27400 consensus_queue.cc:260] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:58.164132 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 193208us
I20260709 12:11:58.131997 28014 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:58.215521 22532 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 15.
I20260709 12:11:58.133373 27503 raft_consensus.cc:2804] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:11:58.250221 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:58.154510 27469 raft_consensus.cc:2804] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:11:58.229470 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 73016.9us
W20260709 12:11:58.254142 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 92662.9us
I20260709 12:11:58.218119 23125 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 14.
W20260709 12:11:58.230031 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 70808.1us
I20260709 12:11:58.254882 22496 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:58.256175 22496 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:58.232304 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:58.257714 22602 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:58.169569 27920 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:58.259896 27469 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:58.228672 27949 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:58.278177 22602 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 16.
I20260709 12:11:58.262166 27920 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:58.250547 28014 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:58.231596 27966 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:58.270943 27469 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:58.253547 27996 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:58.250061 27503 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:11:58.253137 27650 consensus_queue.cc:1175] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8701cd5186a949538d8efafb5f987270" responder_term: 14 status { last_received { term: 13 index: 12 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:11:58.228785 28020 raft_consensus.cc:2749] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:58.261094 27897 raft_consensus.cc:2749] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:58.291483 23118 raft_consensus.cc:1275] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:58.293226 23121 raft_consensus.cc:1240] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:58.260389 27896 raft_consensus.cc:3055] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:58.275476 27715 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:58.283174 27910 raft_consensus.cc:2749] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:11:58.306545 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 195390us
W20260709 12:11:58.312107 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 56032.3us
I20260709 12:11:58.328799 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:58.329427 22530 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:58.329475 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:58.329493 22529 raft_consensus.cc:1240] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 13. Current term is 14. Ops: [13.11-13.11]
W20260709 12:11:58.328995 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:58.294953 27503 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:58.332130 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:58.312866 27987 consensus_meta.cc:287] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.600s	user 0.014s	sys 0.001s
I20260709 12:11:58.340503 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:58.341801 22422 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:58.260511 27865 consensus_queue.cc:237] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:58.307616 27896 raft_consensus.cc:740] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:58.312548 27514 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:58.261060 28005 consensus_queue.cc:237] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:58.308980 27977 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:58.343075 22422 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:58.333597 28020 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:58.373375 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:58.363262 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:58.340169 27870 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:58.400907 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:58.367450 27681 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:58.403836 27681 raft_consensus.cc:2804] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:11:58.404191 28016 log.cc:927] Time spent T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 12:11:58.404433 27681 raft_consensus.cc:697] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 16 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:58.405436 27681 consensus_queue.cc:237] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:58.409073 28018 log.cc:927] Time spent T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 12:11:58.410086 28021 log.cc:927] Time spent T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260709 12:11:58.401527 28006 log.cc:927] Time spent T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.057s	user 0.009s	sys 0.000s
W20260709 12:11:58.411361 27809 consensus_meta.cc:287] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.577s	user 0.004s	sys 0.008s
I20260709 12:11:58.411803 27809 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:58.414084 27809 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:58.415194 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:58.416061 22532 raft_consensus.cc:2393] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 11: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:58.345144 27987 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:58.419413 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 76427.9us
I20260709 12:11:58.421255 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:58.363981 28013 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:58.432794 22531 raft_consensus.cc:2468] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
I20260709 12:11:58.432766 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:58.419135 27987 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:58.380422 27977 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:58.578085 22530 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 15.
I20260709 12:11:58.510625 22451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 2270) took 1174 ms. Trace:
I20260709 12:11:58.660970 23117 raft_consensus.cc:1240] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:58.479120 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:58.523358 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:58.531973 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:58.477715 22455 raft_consensus.cc:1240] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:58.661649 23122 raft_consensus.cc:1240] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:58.547245 22496 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.196.132:44353 timed out after 1.870s (SENT) [suppressed 6 similar messages]
I20260709 12:11:58.651798 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:58.665174 23088 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:58.701356 22448 raft_consensus.cc:2393] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 18: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:58.527379 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:58.664765 23125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57332 (request call id 1217) took 1011 ms. Trace:
I20260709 12:11:58.702560 23125 rpcz_store.cc:276] 0709 12:11:57.653039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:57.653151 (+   112us) service_pool.cc:224] Handling call
0709 12:11:58.664564 (+1011413us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b54004e6454. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:58.664692 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":578428288}
I20260709 12:11:58.705807 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:58.695516 22450 raft_consensus.cc:1240] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:58.548264 22602 raft_consensus.cc:1275] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:11:58.707175 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:58.558584 22421 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:58.444042 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:58.694854 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:58.697474 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:58.549420 22599 raft_consensus.cc:1240] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:58.533527 22570 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:58.444595 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:58.524838 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:58.774211 22598 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 18.
I20260709 12:11:58.543696 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:58.444042 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:58.697818 22451 rpcz_store.cc:276] 0709 12:11:57.335801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:57.335934 (+   133us) service_pool.cc:224] Handling call
0709 12:11:58.510421 (+1174487us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b54003f3ed4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:58.510560 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":568449792}
I20260709 12:11:58.659555 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:58.776054 22532 raft_consensus.cc:3055] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:11:58.776467 22532 raft_consensus.cc:740] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
W20260709 12:11:58.779098 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 62526.1us
I20260709 12:11:58.779824 23118 raft_consensus.cc:1275] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:11:58.780088 23089 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:58.779129 23121 raft_consensus.cc:1275] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:58.781709 22422 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:11:58.782119 23089 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:58.718086 22524 raft_consensus.cc:2393] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 15: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:58.524449 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:58.783375 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:58.778882 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:58.778810 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 65346us
I20260709 12:11:58.779867 22569 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:58.786463 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:58.691722 23120 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13854b1cf45740e680c203d064295c78"
dest_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:57332
W20260709 12:11:58.488879 28004 consensus_meta.cc:287] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.569s	user 0.010s	sys 0.000s
I20260709 12:11:58.787201 22528 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 15.
W20260709 12:11:58.788733 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 230251us
W20260709 12:11:58.805042 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 97603.9us
I20260709 12:11:58.811062 22421 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:58.787784 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:11:58.519599 27880 consensus_meta.cc:287] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.644s	user 0.004s	sys 0.006s
W20260709 12:11:58.484447 28023 log.cc:927] Time spent T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 12:11:58.677546 27985 consensus_meta.cc:287] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.573s	user 0.008s	sys 0.001s
W20260709 12:11:58.529317 28011 log.cc:927] Time spent T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.461s	user 0.001s	sys 0.000s
I20260709 12:11:58.816809 22421 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:58.817405 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:58.818418 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:58.819108 22448 raft_consensus.cc:2393] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 18: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
W20260709 12:11:58.812178 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 278721us
I20260709 12:11:58.777515 22532 consensus_queue.cc:260] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:58.686691 27967 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:58.692044 27836 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:58.527648 27964 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:58.821202 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:58.822009 23119 raft_consensus.cc:2410] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:11:58.826560 22532 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:11:58.645047 27741 consensus_meta.cc:287] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.593s	user 0.006s	sys 0.003s
I20260709 12:11:58.649592 27400 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:58.638893 27996 raft_consensus.cc:2749] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:58.491518 27889 raft_consensus.cc:3055] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:58.512646 27715 raft_consensus.cc:2749] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:58.477181 28013 raft_consensus.cc:697] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:58.844687 22600 raft_consensus.cc:1275] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:11:58.859091 27525 consensus_meta.cc:287] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.709s	user 0.009s	sys 0.001s
W20260709 12:11:58.639086 27994 consensus_meta.cc:287] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.507s	user 0.002s	sys 0.008s
I20260709 12:11:58.649211 27966 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:58.658465 27811 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:58.669945 27728 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.435856 28020 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:58.855582 27967 raft_consensus.cc:2804] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:58.855193 27836 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:58.511065 27976 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:58.786832 27900 raft_consensus.cc:2749] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:58.628165 27870 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:58.857529 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:58.876979 22455 raft_consensus.cc:1240] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:58.638893 27920 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:58.681981 27469 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:58.664994 27871 consensus_queue.cc:1048] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.193s
I20260709 12:11:58.664598 27667 consensus_queue.cc:1059] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.182s
I20260709 12:11:58.778729 27639 consensus_queue.cc:1048] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
I20260709 12:11:58.908176 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:58.907423 27741 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:58.532114 27997 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:58.908346 22448 raft_consensus.cc:1240] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:58.915724 22532 raft_consensus.cc:1275] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 12:11:58.991647 22532 pending_rounds.cc:85] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting all ops after (but not including) 12
I20260709 12:11:58.991904 22532 pending_rounds.cc:107] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 12:11:58.992127 22532 raft_consensus.cc:2889] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:58.878543 22606 raft_consensus.cc:1275] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:11:58.809455 27879 raft_consensus.cc:2749] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:58.815794 28004 raft_consensus.cc:2749] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353) with higher term. Message: Invalid argument: T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 13. Current term is 14.
I20260709 12:11:58.963490 27967 raft_consensus.cc:697] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 15 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:58.815546 27831 raft_consensus.cc:2749] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:58.778398 27891 raft_consensus.cc:2804] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:58.935299 22605 raft_consensus.cc:1240] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:59.017361 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 200619us
I20260709 12:11:58.844269 28015 raft_consensus.cc:2804] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:58.876762 27807 consensus_queue.cc:1059] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
I20260709 12:11:58.856032 27677 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:11:58.652609 27851 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:58.651965 27814 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:58.917080 27865 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.019s	sys 0.058s
I20260709 12:11:58.816093 27849 consensus_queue.cc:1059] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.113s
I20260709 12:11:58.876716 27523 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.867713 28036 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:11:58.530396 27838 consensus_queue.cc:260] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:58.878695 28017 raft_consensus.cc:2804] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:58.511308 28014 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:11:58.477854 27896 consensus_queue.cc:260] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:58.965642 22449 raft_consensus.cc:1240] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 16 LEADER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:58.967062 22455 raft_consensus.cc:1240] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:58.923429 27889 raft_consensus.cc:740] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:59.021833 28013 consensus_queue.cc:237] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:59.043351 27889 consensus_queue.cc:260] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:59.044515 27889 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:58.980572 28020 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:59.046469 28004 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.981973 23120 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:59.046964 28004 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:58.995764 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 448531us
I20260709 12:11:59.048996 28004 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:59.049459 28004 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:58.997560 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 179806us
I20260709 12:11:58.951870 27989 consensus_queue.cc:1048] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 12:11:59.049892 28004 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:59.033021 28017 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:59.005368 22456 raft_consensus.cc:1240] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:59.051379 28017 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:59.006409 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 186471us
I20260709 12:11:59.052882 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:11:59.029395 27949 consensus_meta.cc:287] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.745s	user 0.010s	sys 0.000s
I20260709 12:11:59.053494 22527 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 18.
I20260709 12:11:59.026664 27677 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:58.959687 27966 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:58.952943 27994 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:58.939967 27525 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:59.017619 22452 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 14.
I20260709 12:11:58.968331 27870 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:59.027706 22450 raft_consensus.cc:1240] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 16. Current term is 17. Ops: []
W20260709 12:11:59.021834 27503 consensus_meta.cc:287] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.676s	user 0.012s	sys 0.000s
I20260709 12:11:59.018797 28015 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:59.025025 28005 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:11:59.029426 27865 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.019s	sys 0.058s
I20260709 12:11:59.041929 27836 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:59.031463 27523 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:59.047365 23120 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:58.843070 27985 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:58.962389 27728 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:59.099421 22600 raft_consensus.cc:1240] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 18 LEADER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:59.056946 27902 consensus_queue.cc:1059] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 12:11:59.026417 27891 raft_consensus.cc:697] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 14 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:59.059427 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:59.060014 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:59.060065 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:59.061714 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:59.062487 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:59.062917 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:59.065675 27967 consensus_queue.cc:237] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:59.032872 27987 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:11:59.059403 27831 consensus_queue.cc:1048] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 12:11:59.068722 27851 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:59.069768 27920 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:59.070247 27977 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:59.071762 22449 raft_consensus.cc:1275] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:59.072175 22455 raft_consensus.cc:1240] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:59.074205 22450 raft_consensus.cc:1275] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:11:59.183192 22453 raft_consensus.cc:1240] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:59.183753 22450 raft_consensus.cc:1275] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:11:59.079427 22604 raft_consensus.cc:1240] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:11:59.060883 27677 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:59.076120 22527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:46680
I20260709 12:11:59.064159 27701 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.092851 22448 raft_consensus.cc:1240] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:59.093242 22598 raft_consensus.cc:1240] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:59.051229 27989 consensus_queue.cc:1048] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:11:59.054795 22570 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:59.195513 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 140819us
I20260709 12:11:59.196245 27851 raft_consensus.cc:2749] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:59.200970 22570 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:59.201750 27865 consensus_queue.cc:1059] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:59.202605 27865 raft_consensus.cc:3055] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:59.202921 27865 raft_consensus.cc:740] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:59.203704 27865 consensus_queue.cc:260] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:59.205022 27865 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:59.205879 27836 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.206475 27836 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:59.207146 22495 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:59.207427 28047 raft_consensus.cc:2749] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:59.208227 28004 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:59.208349 22495 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:59.208807 27836 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:59.211081 27883 raft_consensus.cc:2749] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:59.211377 27571 raft_consensus.cc:2749] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:59.211796 27883 consensus_queue.cc:1059] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:59.168076 27987 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:59.212881 27870 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:59.212986 27920 raft_consensus.cc:3055] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:59.213413 27920 raft_consensus.cc:740] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:59.214061 27987 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:59.214205 27920 consensus_queue.cc:260] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:59.214432 27701 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:59.216109 26770 consensus_queue.cc:1059] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:59.124271 22496 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:59.067291 27741 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:59.089341 28015 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:59.145244 27525 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:59.147087 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:59.153231 23120 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:59.101613 28033 consensus_queue.cc:1059] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 12:11:59.059508 27949 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:59.156127 27891 consensus_queue.cc:237] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:59.159196 27814 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:59.101182 28005 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:59.237812 22599 raft_consensus.cc:1240] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:59.239383 28005 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:59.163952 27997 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:59.164057 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:59.240161 22600 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:59.132062 27797 raft_consensus.cc:3055] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:59.243237 27797 raft_consensus.cc:740] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:11:59.244316 27797 consensus_queue.cc:260] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:59.245491 27797 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:59.088011 27503 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:59.247591 22601 raft_consensus.cc:1240] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:59.248589 27503 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:59.166832 22457 raft_consensus.cc:1240] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:59.172449 22605 raft_consensus.cc:1240] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:59.190115 22527 raft_consensus.cc:606] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:11:59.067322 28014 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:59.210086 22570 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
W20260709 12:11:59.206050 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:59.253223 27997 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.222995 22450 raft_consensus.cc:1275] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:11:59.253770 27997 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:59.255986 27997 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:59.256283 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:59.256980 23118 raft_consensus.cc:3060] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:59.258208 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:59.258922 23122 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 12.
I20260709 12:11:59.259620 27650 consensus_queue.cc:1059] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:59.259999 27806 consensus_queue.cc:1059] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:59.260628 27650 raft_consensus.cc:3055] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:59.260932 27750 raft_consensus.cc:3055] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:59.261008 27650 raft_consensus.cc:740] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:59.261404 27750 raft_consensus.cc:740] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:59.261973 27650 consensus_queue.cc:260] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:59.262255 27750 consensus_queue.cc:260] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:11:59.263772 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:59.264853 28035 consensus_queue.cc:1048] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:59.267652 28035 consensus_queue.cc:1048] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:11:59.268247 27701 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:59.268801 27701 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:59.217974 27809 consensus_queue.cc:1059] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 12:11:59.278697 22606 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 18.
I20260709 12:11:59.281500 28015 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:11:59.283358 28042 log.cc:927] Time spent T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:11:59.230016 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 105882us
I20260709 12:11:59.233417 27571 consensus_queue.cc:1059] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:59.234905 27949 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:59.214257 27728 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:59.243255 27934 raft_consensus.cc:2749] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:59.286753 22496 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:11:59.287484 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:59.309365 23118 raft_consensus.cc:2468] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 12.
I20260709 12:11:59.310295 22496 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:11:59.310640 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:59.311636 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:59.312017 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:59.312978 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:59.313349 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:59.313764 23122 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:59.317883 27571 consensus_queue.cc:1243] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer c863116d91c14d1ca50d6e8a46a37a8f log is divergent from this leader: its last log entry 16.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:59.318439 27949 raft_consensus.cc:3055] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:59.318796 27949 raft_consensus.cc:740] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:59.319567 27949 consensus_queue.cc:260] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:59.320676 27949 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:59.323536 23119 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57328 (request call id 1459) took 3807 ms (client timeout 1927 ms). Trace:
I20260709 12:11:59.323724 27989 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:11:59.323968 23119 rpcz_store.cc:269] 0709 12:11:55.516130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.516636 (+   506us) service_pool.cc:224] Handling call
0709 12:11:59.323354 (+3806718us) spinlock_profiling.cc:243] Waited 3.28 s on lock 0x7b54006f04d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:59.323470 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7536085376}
I20260709 12:11:59.324229 27989 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:59.326465 27989 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:59.327596 27977 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:59.329071 27994 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:59.329207 27977 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:59.327898 27966 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:59.331852 22452 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 1031) took 1400 ms (client timeout 1577 ms). Trace:
W20260709 12:11:59.332258 22452 rpcz_store.cc:269] 0709 12:11:57.931043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:57.931614 (+   571us) service_pool.cc:224] Handling call
0709 12:11:59.331700 (+1400086us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540037ad54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:59.331797 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2408452352}
W20260709 12:11:59.287860 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:59.291580 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:59.296665 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:59.304841 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:59.306463 22606 pending_rounds.cc:85] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting all ops after (but not including) 10
I20260709 12:11:59.231199 23123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 1231) took 1521 ms. Trace:
I20260709 12:11:59.225715 27849 raft_consensus.cc:3055] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:59.270735 28017 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:59.391090 22600 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
I20260709 12:11:59.425463 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:59.334946 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:11:59.400705 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 90469.9us
I20260709 12:11:59.378372 22526 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
I20260709 12:11:59.435230 22597 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 15.
I20260709 12:11:59.437295 23122 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 17.
I20260709 12:11:59.443943 23125 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:59.444456 22606 pending_rounds.cc:107] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 12:11:59.449934 22606 raft_consensus.cc:2889] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:59.532246 22600 raft_consensus.cc:1275] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:11:59.444835 23123 rpcz_store.cc:276] 0709 12:11:57.710220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:57.808907 (+ 98687us) service_pool.cc:224] Handling call
0709 12:11:57.809316 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:57.809599 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:57.809621 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:58.652475 (+842854us) spinlock_profiling.cc:243] Waited 34.9 ms on lock 0x7b2c000a5ff8. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc9227a11 00007f9cc9237372 00007f9cca969a01 00007f9cca92e43a 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2
0709 12:11:58.652829 (+   354us) log.cc:844] Serialized 26 byte log entry
0709 12:11:59.007613 (+354784us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:59.217305 (+209692us) log.cc:844] Serialized 14 byte log entry
0709 12:11:59.217610 (+   305us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:59.217679 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:59.217717 (+    38us) raft_consensus.cc:1685] finished
0709 12:11:59.231011 (+ 13294us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:59.231145 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":207482,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":1395,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":3123,"spinlock_wait_cycles":80296192,"thread_start_us":563737,"threads_started":2,"wal-append.queue_time_us":491727}
I20260709 12:11:59.531657 23117 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 14: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:11:59.548244 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:11:59.562057 23123 raft_consensus.cc:2410] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 15 because replica has last-logged OpId of term: 12 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 12.
W20260709 12:11:59.563344 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:59.564184 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:59.409083 27701 raft_consensus.cc:2749] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:59.570603 22451 raft_consensus.cc:1240] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:59.371403 27934 raft_consensus.cc:2749] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:59.571221 23125 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
I20260709 12:11:59.573242 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:59.326959 27989 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:11:59.583737 22456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2861) took 1189 ms. Trace:
I20260709 12:11:59.584177 22456 rpcz_store.cc:276] 0709 12:11:58.394281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.394907 (+   626us) service_pool.cc:224] Handling call
0709 12:11:58.431663 (+ 36756us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:59.051654 (+619991us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:59.583497 (+531843us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b5400242a54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:59.583678 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1316731776}
I20260709 12:11:59.585655 22455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2879) took 1069 ms. Trace:
W20260709 12:11:59.484184 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 216811us
I20260709 12:11:59.364383 27977 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:59.586014 22455 rpcz_store.cc:276] 0709 12:11:58.516635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.060665 (+544030us) service_pool.cc:224] Handling call
0709 12:11:59.061015 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:59.181566 (+120551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:59.585445 (+403879us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b5400379e54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:59.585599 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25261440}
I20260709 12:11:59.479336 27503 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.495312 27849 raft_consensus.cc:740] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:59.600281 22453 raft_consensus.cc:1240] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 16. Current term is 17. Ops: []
W20260709 12:11:59.603194 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 303239us
I20260709 12:11:59.569908 27797 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.378916 27677 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:59.531774 28033 consensus_queue.cc:1048] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.069s
I20260709 12:11:59.531716 27400 consensus_queue.cc:1048] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 12:11:59.573825 28015 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:59.366694 27715 raft_consensus.cc:2749] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:11:59.615165 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 182977us
I20260709 12:11:59.631381 22570 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:59.633323 26770 raft_consensus.cc:3055] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:59.664381 26770 raft_consensus.cc:740] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:59.665369 26770 consensus_queue.cc:260] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:59.666875 26770 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:59.663898 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 260465us
I20260709 12:11:59.658607 22457 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2864) took 1222 ms. Trace:
I20260709 12:11:59.658130 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:59.669502 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:59.663734 22570 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:59.669050 22453 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:59.572036 27966 consensus_queue.cc:1048] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:11:59.624441 27814 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.686779 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:11:59.667793 22457 rpcz_store.cc:276] 0709 12:11:58.436105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.436310 (+   205us) service_pool.cc:224] Handling call
0709 12:11:58.436634 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:59.249333 (+812699us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:59.658345 (+409012us) spinlock_profiling.cc:243] Waited 730 ms on lock 0x7b54002a5b54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:59.658542 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1678910336}
I20260709 12:11:59.622066 27701 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:59.682837 22602 raft_consensus.cc:1240] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 18. Current term is 19. Ops: []
I20260709 12:11:59.678236 22570 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:11:59.684425 23087 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:59.599815 27989 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:59.691371 22456 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 14: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:59.691808 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:59.692414 23123 raft_consensus.cc:1240] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:59.692925 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:11:59.693572 22570 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:59.611063 27503 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:59.697993 23117 raft_consensus.cc:2376] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 14. Re-sending same reply.
I20260709 12:11:59.678570 27514 raft_consensus.cc:2804] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:59.675410 27811 raft_consensus.cc:2804] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:59.725406 28017 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:11:59.726799 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:11:59.727759 28053 log.cc:927] Time spent T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:11:59.630262 27797 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:59.706060 27831 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:59.713838 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:59.714394 23122 raft_consensus.cc:1240] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:59.698685 27871 raft_consensus.cc:2749] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:59.744149 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:59.753474 22456 raft_consensus.cc:2393] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 11: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:59.755556 22457 raft_consensus.cc:2393] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 13: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:11:59.758255 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:11:59.758857 27677 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:59.760515 27838 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:59.698369 27983 consensus_queue.cc:1059] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 12:11:59.758862 22456 raft_consensus.cc:2468] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 10.
I20260709 12:11:59.763976 27797 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:59.764798 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:11:59.765617 28057 log.cc:927] Time spent T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 12:11:59.766340 22456 raft_consensus.cc:1240] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:11:59.766832 27983 raft_consensus.cc:3055] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:59.767243 27983 raft_consensus.cc:740] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:59.684590 27849 consensus_queue.cc:260] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:11:59.768085 27983 consensus_queue.cc:260] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:59.769367 27896 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:59.737466 27811 raft_consensus.cc:697] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:59.744385 27514 raft_consensus.cc:697] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:59.728462 27525 raft_consensus.cc:2749] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:59.694307 27814 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:59.699501 27701 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:59.774936 22448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2875) took 1259 ms. Trace:
I20260709 12:11:59.777201 27811 consensus_queue.cc:237] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:59.775898 27831 raft_consensus.cc:697] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:59.789994 27985 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:59.788375 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:11:59.790829 27972 raft_consensus.cc:3055] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:59.791239 27972 raft_consensus.cc:740] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:11:59.778213 27514 consensus_queue.cc:237] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:59.792164 27972 consensus_queue.cc:260] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:59.793355 27972 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:59.780593 22598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:11:59.780117 22454 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 16.
I20260709 12:11:59.781023 27814 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:59.781303 22449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 2286) took 1229 ms. Trace:
I20260709 12:11:59.796511 22449 rpcz_store.cc:276] 0709 12:11:58.551642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.179799 (+628157us) service_pool.cc:224] Handling call
0709 12:11:59.180081 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:59.215493 (+ 35412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:59.215523 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:59.215563 (+    40us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:59.215591 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:59.781032 (+565441us) spinlock_profiling.cc:243] Waited 35.2 ms on lock 0x7b5400379954. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:59.781096 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:59.781241 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":80983808}
I20260709 12:11:59.795231 22598 raft_consensus.cc:606] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:11:59.799878 22598 raft_consensus.cc:614] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:59.783332 27969 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
W20260709 12:11:59.801452 22597 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43070 (request call id 910) took 2033 ms (client timeout 1692 ms). Trace:
I20260709 12:11:59.801627 27969 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:59.804988 27969 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:59.769373 27983 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:11:59.805567 22526 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56942 (request call id 2161) took 1281 ms (client timeout 1564 ms). Trace:
W20260709 12:11:59.806071 22526 rpcz_store.cc:269] 0709 12:11:58.523781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.527090 (+  3309us) service_pool.cc:224] Handling call
0709 12:11:59.805386 (+1278296us) spinlock_profiling.cc:243] Waited 676 ms on lock 0x7b5400262d54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:59.805502 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1554955008}
I20260709 12:11:59.808105 22525 raft_consensus.cc:1275] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:11:59.811836 22457 raft_consensus.cc:1240] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:11:59.812203 22449 raft_consensus.cc:1275] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:11:59.769459 22456 raft_consensus.cc:1275] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
W20260709 12:11:59.677318 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:59.815294 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:59.816054 27469 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:11:59.816956 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:59.818538 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:59.819640 27994 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.820159 27994 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:59.787693 22448 rpcz_store.cc:276] 0709 12:11:58.515503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.996462 (+480959us) service_pool.cc:224] Handling call
0709 12:11:59.016958 (+ 20496us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:59.193250 (+176292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:59.774698 (+581448us) spinlock_profiling.cc:243] Waited 75.7 ms on lock 0x7b54004051d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:11:59.774866 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":173998336}
I20260709 12:11:59.790014 27831 consensus_queue.cc:237] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:59.814783 27750 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:59.781670 28050 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.829423 28050 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:59.791296 22603 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:59.831532 28050 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:59.783361 27701 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:11:59.787892 28065 raft_consensus.cc:993] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881: : Instructing follower 8701cd5186a949538d8efafb5f987270 to start an election
I20260709 12:11:59.832737 28065 raft_consensus.cc:1081] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Signalling peer 8701cd5186a949538d8efafb5f987270 to start an election
I20260709 12:11:59.832902 27920 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:59.780423 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:11:59.833734 22600 raft_consensus.cc:2468] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 9.
I20260709 12:11:59.824990 22602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:11:59.834571 22602 raft_consensus.cc:606] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 LEADER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:11:59.834735 22453 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 16.
W20260709 12:11:59.801913 22597 rpcz_store.cc:269] 0709 12:11:57.767673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:57.772721 (+  5048us) service_pool.cc:224] Handling call
0709 12:11:59.801231 (+2028510us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b5400042c54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:11:59.801353 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3620061568}
W20260709 12:11:59.818873 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:59.835632 22422 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:11:59.785522 27865 consensus_meta.cc:287] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.580s	user 0.011s	sys 0.001s
I20260709 12:11:59.844866 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:59.845057 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:59.847033 22525 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:59.798866 27523 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:11:59.852402 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 259077us
I20260709 12:11:59.836895 27879 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.857529 27879 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:59.862921 22603 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 14.
I20260709 12:11:59.851955 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:11:59.865496 22525 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 16.
I20260709 12:11:59.844125 27985 raft_consensus.cc:2804] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:59.842489 27897 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:59.876433 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:59.885705 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:59.891016 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:59.875617 27985 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:11:59.886577 27900 raft_consensus.cc:3055] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:59.927772 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:59.928624 22524 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 15.
I20260709 12:11:59.929958 22530 raft_consensus.cc:1240] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:59.887125 27897 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:59.932631 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:59.936043 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:59.907895 27985 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:59.939193 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 75076.1us
I20260709 12:11:59.942799 22532 raft_consensus.cc:1240] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:59.944648 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:59.945580 22527 raft_consensus.cc:2393] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 11: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
W20260709 12:11:59.946780 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 59176.9us
I20260709 12:11:59.909142 27900 raft_consensus.cc:740] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:11:59.948758 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:59.949987 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:59.950548 22532 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 18.
I20260709 12:11:59.951390 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:59.952325 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:59.954192 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:59.955094 22524 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 12.
I20260709 12:11:59.957798 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:59.958861 22524 raft_consensus.cc:2393] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 15: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:11:59.960278 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:59.961426 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:59.944015 27902 consensus_queue.cc:1048] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 12:11:59.965569 22531 raft_consensus.cc:1275] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:59.968449 22528 raft_consensus.cc:1275] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 12:11:59.968914 22528 pending_rounds.cc:85] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting all ops after (but not including) 9
I20260709 12:11:59.969182 22528 pending_rounds.cc:107] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 12:11:59.969456 22528 raft_consensus.cc:2889] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:59.969290 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 275778us
I20260709 12:11:59.970557 22570 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:11:59.971201 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:59.973572 23125 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44"
dest_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:57332
I20260709 12:11:59.974265 23125 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:59.974678 23125 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:59.975796 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:59.976852 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:59.977002 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:59.977448 22531 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 13.
I20260709 12:11:59.978749 23088 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:11:59.979346 22495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:59.980492 22570 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
W20260709 12:11:59.981302 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 296696us
I20260709 12:11:59.959676 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:11:59.986915 23125 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:11:59.954192 27879 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:11:59.998363 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:11:59.998029 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:00.020323 26770 consensus_queue.cc:1059] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:59.998525 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:00.002312 23088 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:11:59.991799 22570 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:11:59.988312 28029 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.997776 27902 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:00.026197 22421 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:11:59.998165 27681 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:00.030733 22570 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:00.031279 26770 raft_consensus.cc:3055] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:00.015846 27469 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:00.029688 27896 raft_consensus.cc:2804] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:00.029855 27838 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:00.036280 22602 raft_consensus.cc:1275] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:12:00.037070 26770 raft_consensus.cc:740] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:11:59.999683 27969 consensus_queue.cc:1048] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 12:11:59.997960 27983 consensus_queue.cc:1059] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 12:11:59.997859 27701 raft_consensus.cc:2749] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:59.989162 27523 consensus_queue.cc:1048] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.104s
I20260709 12:12:00.072361 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:00.077171 23117 raft_consensus.cc:1240] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:00.077056 26770 consensus_queue.cc:260] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:00.078377 26770 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:59.998873 27865 raft_consensus.cc:2749] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:12:00.080400 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 54295.8us
I20260709 12:12:00.081995 22421 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:12:00.055572 22454 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 1034) took 2118 ms (client timeout 1664 ms). Trace:
W20260709 12:12:00.086287 22454 rpcz_store.cc:269] 0709 12:11:57.933048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:57.934252 (+  1204us) service_pool.cc:224] Handling call
0709 12:12:00.050711 (+2116459us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b5400221854. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:00.050932 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4171852544}
I20260709 12:12:00.080782 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:00.031729 28047 raft_consensus.cc:2804] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:00.001854 27900 consensus_queue.cc:260] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:00.088300 28015 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:00.052516 28059 consensus_queue.cc:1059] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.104s
I20260709 12:12:00.156390 28015 raft_consensus.cc:2749] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:12:00.159132 28033 consensus_queue.cc:1059] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:12:00.161652 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.159508 22497 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:00.033453 27902 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:00.032769 27797 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:00.033034 27880 consensus_queue.cc:1048] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.142s
I20260709 12:12:00.176460 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:00.038231 27897 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:00.198740 22524 raft_consensus.cc:3055] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:00.199754 22524 raft_consensus.cc:740] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:00.200794 22524 consensus_queue.cc:260] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:00.201830 22524 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:00.202013 27849 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:00.195181 26770 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:00.203663 26770 raft_consensus.cc:697] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
W20260709 12:12:00.091708 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 62152.8us
I20260709 12:12:00.175176 23125 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:00.194868 27902 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:00.206324 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:00.076040 27681 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:00.198994 28026 raft_consensus.cc:3055] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:00.035375 28029 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:00.088347 27896 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:00.211403 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:00.161209 28047 raft_consensus.cc:697] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 16 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:00.212035 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:00.050185 27703 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:00.092180 27807 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:00.216084 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:00.301223 23119 raft_consensus.cc:1275] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 12:12:00.159718 27900 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:12:00.095741 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.155234 28036 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:00.160589 27879 consensus_queue.cc:1175] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" responder_term: 11 status { last_received { term: 10 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:12:00.301658 23119 pending_rounds.cc:85] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270: Aborting all ops after (but not including) 11
I20260709 12:12:00.212980 27977 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:00.220862 27896 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:00.304440 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:00.148329 27949 consensus_queue.cc:1059] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.067s
I20260709 12:12:00.093612 27728 consensus_queue.cc:1048] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.122s
I20260709 12:12:00.160014 27400 consensus_queue.cc:1059] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
W20260709 12:12:00.306042 23124 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.007s	sys 0.065s
I20260709 12:12:00.171707 28061 consensus_queue.cc:1059] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 12:12:00.160082 28033 consensus_queue.cc:1059] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
W20260709 12:12:00.177799 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.231917 23120 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:00.088897 27838 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:00.214617 28026 raft_consensus.cc:740] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
W20260709 12:12:00.313038 22604 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.023s	sys 0.056s
I20260709 12:12:00.314414 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:00.194096 22497 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:00.318066 22453 raft_consensus.cc:1240] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:00.318923 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:12:00.251958 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.322425 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:12:00.382890 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.324399 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:00.383513 22527 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
I20260709 12:12:00.325047 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:00.325268 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:00.385630 22449 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 14: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:00.386266 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:00.387267 23125 raft_consensus.cc:2410] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:12:00.089083 27469 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:00.222048 22569 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:00.329576 23119 pending_rounds.cc:107] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 12:12:00.392510 23119 raft_consensus.cc:2889] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:12:00.392762 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 170811us
I20260709 12:12:00.219151 27871 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:00.333998 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:00.335382 28015 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:12:00.412377 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.323556 27703 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:00.203943 27797 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:00.340663 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:00.416288 22448 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:00.416970 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:00.341691 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:00.329175 28036 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:00.300684 27865 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:00.300871 27897 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:00.304592 27811 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.013s	sys 0.052s
I20260709 12:12:00.312480 26770 consensus_queue.cc:237] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:00.323128 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:00.355844 27949 raft_consensus.cc:3055] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:00.359336 28033 raft_consensus.cc:3055] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:00.352491 27989 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:00.357347 23124 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.007s	sys 0.065s
W20260709 12:12:00.424113 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 230095us
I20260709 12:12:00.363834 23120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:57332 (request call id 1233) took 1672 ms. Trace:
I20260709 12:12:00.424837 23120 rpcz_store.cc:276] 0709 12:11:58.691443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.691569 (+   126us) service_pool.cc:224] Handling call
0709 12:12:00.211008 (+1519439us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b54004d7e54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca925a3d 00007f9ccf8f5cd0 00007f9cc8e7a254 00007f9cc8e7a1e2 00007f9cc8e7a111 00007f9cc8e7a08c 00007f9cc8e79342 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:00.363752 (+152744us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":406271232}
I20260709 12:12:00.365284 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:00.425971 22600 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 15.
W20260709 12:12:00.381278 22604 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.024s	sys 0.056s
I20260709 12:12:00.381578 22450 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:00.361316 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:00.377871 22451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 2287) took 1826 ms. Trace:
I20260709 12:12:00.427598 22451 rpcz_store.cc:276] 0709 12:11:58.551898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.180450 (+628552us) service_pool.cc:224] Handling call
0709 12:11:59.180750 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:59.571032 (+390282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:00.362867 (+791835us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b54002a5654. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:00.377787 (+ 14920us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":896174336}
W20260709 12:12:00.377362 22606 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.924s	user 0.005s	sys 0.027s
W20260709 12:12:00.428510 22606 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.976s	user 0.005s	sys 0.027s
I20260709 12:12:00.398890 23117 raft_consensus.cc:1275] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:12:00.402179 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.406769 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:00.412707 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:00.352638 27920 consensus_meta.cc:287] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.516s	user 0.009s	sys 0.001s
I20260709 12:12:00.417729 22456 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 14.
I20260709 12:12:00.364187 28029 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:00.350891 27503 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:00.355289 22531 raft_consensus.cc:3055] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:00.415071 27514 consensus_queue.cc:1048] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 12:12:00.363539 27701 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:00.414487 27871 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:00.377272 27977 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:00.411810 27525 consensus_queue.cc:1048] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:12:00.439859 22523 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
I20260709 12:12:00.452078 27977 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:00.423785 27949 raft_consensus.cc:740] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:00.453560 27949 consensus_queue.cc:260] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:00.429999 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:00.426142 27811 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.013s	sys 0.052s
I20260709 12:12:00.431758 22532 raft_consensus.cc:2393] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 14: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:00.401604 27880 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:00.430598 22422 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:00.438345 22450 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
I20260709 12:12:00.468998 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:00.469756 22600 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 15.
I20260709 12:12:00.471052 22523 raft_consensus.cc:1240] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 13. Current term is 14. Ops: []
W20260709 12:12:00.437141 27901 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.015s	user 0.002s	sys 0.033s
W20260709 12:12:00.471935 27901 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.049s	user 0.002s	sys 0.034s
W20260709 12:12:00.440435 27831 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.014s	sys 0.014s
I20260709 12:12:00.443512 22531 raft_consensus.cc:740] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:00.424129 28033 raft_consensus.cc:740] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:00.445302 22527 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
I20260709 12:12:00.448313 27469 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:00.448868 22451 raft_consensus.cc:1240] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:00.449556 27701 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:00.358719 27681 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:00.322044 22524 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 13.
I20260709 12:12:00.462814 22448 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 19.
I20260709 12:12:00.439200 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:00.474756 22422 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:00.467849 22450 raft_consensus.cc:1275] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 12:12:00.483633 22525 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.006s	sys 0.042s
I20260709 12:12:00.413619 27985 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:00.497320 27985 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:00.456941 27949 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:00.479854 27880 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:00.503608 27985 raft_consensus.cc:2804] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:00.419237 27865 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:00.472947 27851 consensus_queue.cc:1048] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:12:00.415856 28015 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:00.469530 27503 consensus_queue.cc:1059] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 12:12:00.441216 27897 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:00.494760 27871 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:00.504714 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:12:00.482388 27831 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.014s	sys 0.014s
W20260709 12:12:00.493261 22525 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.007s	sys 0.042s
I20260709 12:12:00.480978 22531 consensus_queue.cc:260] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:00.480582 28029 raft_consensus.cc:2804] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:00.505136 27703 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:00.517310 22530 raft_consensus.cc:1275] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:12:00.514190 27503 raft_consensus.cc:3055] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:12:00.515210 23121 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.008s	sys 0.006s
I20260709 12:12:00.515763 22531 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:00.512392 22600 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:00.464685 28068 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:00.514014 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:00.524928 23121 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.008s	sys 0.006s
I20260709 12:12:00.502188 27902 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:00.510336 27985 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:00.534561 23122 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.006s	sys 0.010s
W20260709 12:12:00.543906 23122 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.006s	sys 0.010s
I20260709 12:12:00.542608 22600 raft_consensus.cc:2468] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 10.
I20260709 12:12:00.546567 22422 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:12:00.551301 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.514899 27838 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:00.518626 28029 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:00.518441 27503 raft_consensus.cc:740] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:00.470108 28047 consensus_queue.cc:237] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:00.562248 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 480302us
I20260709 12:12:00.576730 22421 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:00.536059 27901 raft_consensus.cc:3055] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:00.546350 27985 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:00.543565 28068 raft_consensus.cc:697] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:00.554315 27469 raft_consensus.cc:2804] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:12:00.577018 22531 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 14.
I20260709 12:12:00.598392 23116 raft_consensus.cc:1240] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:00.562621 28029 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:00.608860 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 186739us
W20260709 12:12:00.587990 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.552685 28033 consensus_queue.cc:260] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:00.583864 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 187289us
I20260709 12:12:00.578497 22421 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:00.619307 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:00.331673 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:12:00.648051 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 69649.6us
I20260709 12:12:00.654891 27811 consensus_queue.cc:1048] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:00.655277 22421 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:00.656049 27681 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:12:00.633843 23116 raft_consensus.cc:2393] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 16: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:00.656543 22421 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:00.656760 22569 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:12:00.657871 22569 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:00.659724 22421 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:00.657513 27681 raft_consensus.cc:2749] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:00.607544 27469 raft_consensus.cc:697] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 10 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:00.587704 28084 raft_consensus.cc:2749] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:12:00.665617 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.622633 28050 raft_consensus.cc:2749] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:00.673810 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 248858us
W20260709 12:12:00.675104 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 261764us
I20260709 12:12:00.654222 27902 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:00.587379 27972 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:00.577946 27865 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:00.685034 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:00.720194 22603 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 13.
I20260709 12:12:00.720501 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:00.721056 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:00.591101 27650 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:00.687604 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:00.580982 27901 raft_consensus.cc:740] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:00.689181 22605 raft_consensus.cc:1240] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:12:00.766323 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:00.672712 28097 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:00.656464 27897 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:00.701793 23088 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:12:00.770991 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 69280.3us
I20260709 12:12:00.772027 23088 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:00.659919 27838 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:00.706095 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:00.774425 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:00.775491 22599 raft_consensus.cc:2410] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:12:00.701414 22497 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
W20260709 12:12:00.776427 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 75122.8us
I20260709 12:12:00.707422 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:00.688974 27966 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:12:00.698721 28076 log.cc:927] Time spent T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.155s	user 0.001s	sys 0.001s
W20260709 12:12:00.708425 22495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.658625 28071 consensus_queue.cc:1059] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 12:12:00.705873 28033 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:00.769443 22598 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 14: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
W20260709 12:12:00.704783 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 52286.5us
I20260709 12:12:00.783077 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:00.801548 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:00.799461 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:00.795173 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:00.780208 23116 raft_consensus.cc:2468] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 10.
I20260709 12:12:00.807301 22454 raft_consensus.cc:1240] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:00.703034 27797 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:00.807395 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:00.799088 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:00.853492 22599 raft_consensus.cc:2376] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 15. Re-sending same reply.
W20260709 12:12:00.797024 28080 log.cc:927] Time spent T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
W20260709 12:12:00.847702 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.699524 28091 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:00.898561 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:00.650895 27503 consensus_queue.cc:260] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:00.798415 27900 raft_consensus.cc:2804] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:12:00.873652 28079 log.cc:927] Time spent T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.274s	user 0.000s	sys 0.000s
I20260709 12:12:00.875810 27681 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:12:00.882047 28072 log.cc:927] Time spent T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.275s	user 0.000s	sys 0.001s
I20260709 12:12:00.796211 27806 raft_consensus.cc:2804] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:12:00.922755 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 117667us
W20260709 12:12:00.888876 28083 log.cc:927] Time spent T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
I20260709 12:12:00.891446 27897 consensus_queue.cc:1059] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:00.784267 27838 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:00.855931 22528 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 14.
I20260709 12:12:00.904920 22451 raft_consensus.cc:2468] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
I20260709 12:12:00.905303 22605 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 14.
I20260709 12:12:00.871400 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:00.905915 22598 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:00.856393 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 52836us
I20260709 12:12:00.933215 22495 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:12:00.906603 22526 raft_consensus.cc:2393] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 14: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:00.798803 27871 raft_consensus.cc:2804] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:00.872467 22531 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:00.797559 28093 raft_consensus.cc:993] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc: : Instructing follower 8701cd5186a949538d8efafb5f987270 to start an election
I20260709 12:12:00.808501 27977 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:00.947901 27977 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:00.769398 27831 raft_consensus.cc:2749] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:12:00.887099 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:00.916980 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.796851 28017 raft_consensus.cc:2804] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:00.798301 28086 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:12:00.888106 28081 log.cc:927] Time spent T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.261s	user 0.000s	sys 0.000s
I20260709 12:12:00.810710 28097 raft_consensus.cc:697] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:00.718237 27701 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:00.936055 22497 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:00.928678 27900 raft_consensus.cc:697] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 13 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:00.799515 27966 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:00.762148 27972 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:00.784145 27865 consensus_queue.cc:1048] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.138s
I20260709 12:12:01.069229 22598 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 14.
I20260709 12:12:01.066289 22604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2722) took 1287 ms. Trace:
I20260709 12:12:00.920642 27681 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:01.078260 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 142311us
I20260709 12:12:00.937295 22599 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 12.
I20260709 12:12:00.914340 28091 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:00.961059 26770 raft_consensus.cc:2804] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:01.082458 26770 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:01.083052 26770 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:00.961640 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:00.963267 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 305224us
I20260709 12:12:01.083756 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:01.084363 22421 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:12:00.964267 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 71743.9us
I20260709 12:12:01.084790 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:00.966605 23089 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:00.971722 22531 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 16.
I20260709 12:12:00.928313 27838 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:00.906828 27469 consensus_queue.cc:237] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:00.981383 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:00.937932 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:00.979432 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:01.048365 23121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 1251) took 1086 ms. Trace:
I20260709 12:12:01.052156 22530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 2428) took 1096 ms. Trace:
I20260709 12:12:01.056782 27778 raft_consensus.cc:3055] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:00.952142 28065 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.065526 23124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 1245) took 1377 ms. Trace:
I20260709 12:12:00.980221 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:00.924503 27901 consensus_queue.cc:260] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:01.045414 28089 raft_consensus.cc:1081] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 LEADER]: Signalling peer 8701cd5186a949538d8efafb5f987270 to start an election
W20260709 12:12:01.079047 28036 consensus_meta.cc:287] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.638s	user 0.010s	sys 0.002s
I20260709 12:12:01.072798 22604 rpcz_store.cc:276] 0709 12:11:59.779320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.781392 (+  2072us) service_pool.cc:224] Handling call
0709 12:11:59.781713 (+   321us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:59.782048 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:59.782075 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:59.782605 (+   530us) log.cc:844] Serialized 52 byte log entry
0709 12:12:00.426956 (+644351us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:00.427014 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:00.427076 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:01.065965 (+638889us) raft_consensus.cc:1685] finished
0709 12:12:01.065995 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:01.066201 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8230,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"thread_start_us":644004,"threads_started":1,"wal-append.queue_time_us":707242}
I20260709 12:12:01.140439 22604 raft_consensus.cc:1240] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:01.085480 22599 raft_consensus.cc:2468] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 10.
W20260709 12:12:01.103454 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 136933us
I20260709 12:12:00.951471 28100 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:01.105655 22421 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:01.156603 28100 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:01.105301 22530 rpcz_store.cc:276] 0709 12:11:59.955504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.956976 (+  1472us) service_pool.cc:224] Handling call
0709 12:11:59.957297 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:00.517703 (+560406us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:01.051911 (+534208us) spinlock_profiling.cc:243] Waited 560 ms on lock 0x7b54002ec554. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:01.052093 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1287173888}
I20260709 12:12:00.799029 28068 consensus_queue.cc:237] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:01.105903 23121 rpcz_store.cc:276] 0709 12:11:59.961776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.961943 (+   167us) service_pool.cc:224] Handling call
0709 12:11:59.962306 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:59.962714 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:59.962754 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:59.967409 (+  4655us) log.cc:844] Serialized 26 byte log entry
0709 12:12:00.525514 (+558105us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:00.525570 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:00.525662 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:01.048034 (+522372us) raft_consensus.cc:1685] finished
0709 12:12:01.048063 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:01.048278 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2391,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"thread_start_us":557745,"threads_started":1,"wal-append.queue_time_us":682412}
I20260709 12:12:01.059978 27525 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.112749 22598 raft_consensus.cc:1275] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:00.958178 27503 raft_consensus.cc:3060] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:01.123481 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 169006us
W20260709 12:12:01.144925 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.146930 22604 raft_consensus.cc:1240] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 13. Current term is 14. Ops: []
W20260709 12:12:01.160434 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 73098.2us
I20260709 12:12:01.133231 23124 rpcz_store.cc:276] 0709 12:11:59.687690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.688084 (+   394us) service_pool.cc:224] Handling call
0709 12:11:59.688418 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:59.733912 (+ 45494us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:59.733968 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:59.737542 (+  3574us) log.cc:844] Serialized 26 byte log entry
0709 12:12:00.424562 (+687020us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:00.424601 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:01.052826 (+628225us) spinlock_profiling.cc:243] Waited 45.2 ms on lock 0x7b54005528d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:01.052871 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:01.052917 (+    46us) raft_consensus.cc:1685] finished
0709 12:12:01.052930 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:01.065414 (+ 12484us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":103943552,"thread_start_us":671327,"threads_started":1,"wal-append.queue_time_us":734111}
I20260709 12:12:00.962772 28017 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:12:01.158249 27949 consensus_meta.cc:287] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.660s	user 0.010s	sys 0.001s
I20260709 12:12:01.110376 28061 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.105508 27897 raft_consensus.cc:2804] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:01.183441 26770 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:01.110313 27778 raft_consensus.cc:740] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:01.110702 27977 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:01.114203 28111 raft_consensus.cc:2749] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:01.178084 27901 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:01.167312 27987 raft_consensus.cc:2749] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:01.181749 28017 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:01.179723 28100 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:01.184850 27897 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:01.206267 26770 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:01.178442 27806 raft_consensus.cc:697] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:00.984134 28085 consensus_queue.cc:1059] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.214s
I20260709 12:12:01.163561 28036 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:01.194705 28107 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.201593 27977 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.202885 27871 raft_consensus.cc:697] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 14 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:00.984632 28086 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:01.167289 28065 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:01.216492 28107 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:01.210551 27897 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:01.187239 28061 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:01.225174 28091 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:01.225339 28086 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:01.225914 28104 log.cc:927] Time spent T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:12:01.208511 28097 consensus_queue.cc:237] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:01.226764 28065 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:01.231040 28107 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:01.223399 28118 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.233179 28118 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:01.235241 28123 raft_consensus.cc:3055] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:01.235668 28123 raft_consensus.cc:740] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
W20260709 12:12:01.159723 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 54158.8us
I20260709 12:12:01.133698 22451 raft_consensus.cc:2410] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:12:01.178769 22525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 1071) took 1294 ms. Trace:
W20260709 12:12:01.261837 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 92470.6us
I20260709 12:12:01.281183 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:01.284550 22602 raft_consensus.cc:1240] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 16 LEADER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:01.179708 27525 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:01.433205 22525 rpcz_store.cc:276] 0709 12:11:59.884781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.884971 (+   190us) service_pool.cc:224] Handling call
0709 12:11:59.885331 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:59.885718 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:59.885756 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:59.894554 (+  8798us) log.cc:844] Serialized 26 byte log entry
0709 12:12:00.516482 (+621928us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:00.516536 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:00.516599 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:01.178559 (+661960us) raft_consensus.cc:1685] finished
0709 12:12:01.178584 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:01.178716 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1624,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"thread_start_us":606526,"threads_started":1,"wal-append.queue_time_us":676275}
I20260709 12:12:01.438495 27880 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:01.296995 27681 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:01.297963 27750 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.297901 27806 consensus_queue.cc:237] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:01.433110 22570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.007s	sys 0.006s
I20260709 12:12:01.299111 27778 consensus_queue.cc:260] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:01.302248 27514 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.308431 27871 consensus_queue.cc:237] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:01.442605 27778 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:01.442783 27514 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:01.444657 27994 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:01.310519 27966 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:01.313751 27972 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:01.218946 27977 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:01.448328 27977 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:01.321137 28036 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:01.322396 27896 consensus_meta.cc:287] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.969s	user 0.014s	sys 0.003s
I20260709 12:12:01.201953 27900 consensus_queue.cc:237] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:01.324177 28061 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:01.326152 28118 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:01.220232 28085 consensus_queue.cc:1059] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
W20260709 12:12:01.333887 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.342203 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:01.456593 22456 raft_consensus.cc:2393] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 16: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:01.432560 28123 consensus_queue.cc:260] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:01.374723 27838 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:01.377094 27985 consensus_meta.cc:287] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.780s	user 0.005s	sys 0.013s
I20260709 12:12:01.459499 27985 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:01.461609 28067 raft_consensus.cc:3055] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:01.462095 28067 raft_consensus.cc:740] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:01.462204 27985 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:01.462474 27838 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:01.377846 28017 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:01.463541 22453 raft_consensus.cc:1240] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 12:12:01.463521 28067 consensus_queue.cc:260] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:01.388633 27715 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
W20260709 12:12:01.392889 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.395862 22601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3135) took 1405 ms. Trace:
W20260709 12:12:01.397171 27650 consensus_meta.cc:287] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.614s	user 0.015s	sys 0.008s
I20260709 12:12:01.400534 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:01.465930 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.466113 22455 raft_consensus.cc:2393] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 16: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:01.466601 22448 raft_consensus.cc:1240] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:01.400382 27897 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:01.402829 28029 consensus_meta.cc:287] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.775s	user 0.007s	sys 0.011s
I20260709 12:12:01.411978 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:01.424645 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 254831us
I20260709 12:12:01.435446 28115 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:01.290328 27400 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.439440 22605 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 14.
I20260709 12:12:01.458004 28123 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:01.432597 22421 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:01.438592 27525 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:01.440240 27750 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:01.449769 22570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.007s	sys 0.006s
I20260709 12:12:01.451742 27896 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:01.500506 28061 raft_consensus.cc:1064] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
W20260709 12:12:01.501047 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 632428us
I20260709 12:12:01.502395 27896 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:01.504369 28118 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:01.505198 28118 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:01.441232 22495 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:01.479641 22601 rpcz_store.cc:276] 0709 12:11:59.990165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.990345 (+   180us) service_pool.cc:224] Handling call
0709 12:11:59.990689 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:00.453028 (+462339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:00.453063 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:00.453108 (+    45us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:00.453147 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:01.395334 (+942187us) spinlock_profiling.cc:243] Waited 462 ms on lock 0x7b54003b3154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:01.395410 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:01.395621 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1062785920}
W20260709 12:12:01.295877 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 333588us
I20260709 12:12:01.465009 28067 raft_consensus.cc:3060] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:01.465044 28017 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:01.494526 22450 raft_consensus.cc:2393] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 19: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:01.494108 28115 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:01.499306 27715 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:01.516417 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:01.517091 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.488324 27880 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.517879 27715 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:01.494313 27400 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:01.518416 28115 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:01.518133 27880 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:01.519268 27897 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:01.495829 28085 raft_consensus.cc:3055] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:12:01.497172 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 64993.4us
I20260709 12:12:01.497118 23089 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:01.499528 28105 raft_consensus.cc:3055] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:01.477600 27514 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:01.454392 28026 consensus_queue.cc:260] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:01.526464 27880 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:01.504428 27778 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.532501 27778 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:01.535427 22569 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:01.536718 23117 raft_consensus.cc:1240] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:01.538228 27969 consensus_queue.cc:1048] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:01.539124 22529 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 14.
I20260709 12:12:01.534813 27778 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:01.540207 27969 raft_consensus.cc:2749] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:01.540468 23089 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:01.541189 27880 raft_consensus.cc:2749] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:01.541625 27901 raft_consensus.cc:2749] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:01.543192 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 104352us
I20260709 12:12:01.545832 23088 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:01.546860 27901 raft_consensus.cc:2804] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:01.547382 27901 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:01.547421 23088 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:01.547920 27901 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:01.548619 27880 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:01.549201 27880 raft_consensus.cc:697] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 16 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:01.549631 27778 raft_consensus.cc:2804] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:01.550105 27778 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:01.550536 27778 raft_consensus.cc:3060] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:01.550482 27880 consensus_queue.cc:237] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:01.554924 22526 raft_consensus.cc:1240] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:01.555652 27977 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:01.499320 28050 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:01.556279 27977 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:01.556591 28050 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:01.523015 28105 raft_consensus.cc:740] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:01.560535 28105 consensus_queue.cc:260] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:01.562463 28105 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:01.563202 27989 raft_consensus.cc:2764] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 14 LEADER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:12:01.561156 27977 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:01.568820 28061 consensus_queue.cc:237] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:01.523617 28085 raft_consensus.cc:740] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:01.489146 28029 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:01.586366 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 93047.1us
I20260709 12:12:01.586583 28118 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:01.530511 27985 raft_consensus.cc:2749] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:12:01.587630 28106 log.cc:927] Time spent T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.540s	user 0.002s	sys 0.001s
W20260709 12:12:01.588502 22452 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.024s	sys 0.036s
W20260709 12:12:01.588915 22452 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.024s	sys 0.036s
W20260709 12:12:01.589744 28114 log.cc:927] Time spent T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.385s	user 0.002s	sys 0.000s
I20260709 12:12:01.590420 22452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2889) took 1275 ms. Trace:
I20260709 12:12:01.593010 22603 raft_consensus.cc:2468] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 13.
I20260709 12:12:01.530491 27400 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:01.598922 28026 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:01.609112 22602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2725) took 1411 ms. Trace:
I20260709 12:12:01.609625 22602 rpcz_store.cc:276] 0709 12:12:00.198207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.198366 (+   159us) service_pool.cc:224] Handling call
0709 12:12:00.198695 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:01.435532 (+1236837us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:01.608824 (+173292us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54000e8654. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:01.609051 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2495057792}
I20260709 12:12:01.599387 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:01.612440 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:01.613008 27838 consensus_queue.cc:1059] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:01.613839 27838 consensus_queue.cc:1243] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer 6c6fa11e8ee34711b3551f0c670442bc log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:12:01.614421 27838 raft_consensus.cc:3055] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:01.614760 27838 raft_consensus.cc:740] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:01.615496 23122 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775"
dest_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:57328
I20260709 12:12:01.616240 23122 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:01.616317 22523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 1088) took 1213 ms. Trace:
I20260709 12:12:01.616691 23122 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:01.616716 22523 rpcz_store.cc:276] 0709 12:12:00.402568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.456041 (+ 53473us) service_pool.cc:224] Handling call
0709 12:12:00.470809 (+ 14768us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:00.473359 (+  2550us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:01.615910 (+1142551us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b5400262350. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:01.616125 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33285888}
I20260709 12:12:01.617491 28029 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:01.619390 22454 raft_consensus.cc:2393] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 16: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
W20260709 12:12:01.588832 23087 leader_election.cc:336] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.577s (SENT)
I20260709 12:12:01.606549 22421 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:01.622653 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:01.607928 28085 consensus_queue.cc:260] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:01.624286 22453 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:01.606401 28017 consensus_queue.cc:1048] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:12:01.625285 28085 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:01.607438 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:01.599869 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:01.627439 22455 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 15.
I20260709 12:12:01.625528 27778 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:01.627506 22569 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:01.599757 22529 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38310 (request call id 1074) took 1714 ms (client timeout 1932 ms). Trace:
I20260709 12:12:01.590828 22452 rpcz_store.cc:276] 0709 12:12:00.315068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.315181 (+   113us) service_pool.cc:224] Handling call
0709 12:12:00.315467 (+   286us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:00.315813 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:00.315841 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:00.323982 (+  8141us) log.cc:844] Serialized 52 byte log entry
0709 12:12:00.631675 (+307693us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b18003b05c0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc7823e07 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc7840c02 00007f9cca4c820b 00007f9cca4cdd23 00007f9cca4ce0d1 00007f9cca8e9a0f
0709 12:12:00.779499 (+147824us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:01.589463 (+809964us) log.cc:844] Serialized 14 byte log entry
0709 12:12:01.589856 (+   393us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:01.589945 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:01.590011 (+    66us) raft_consensus.cc:1685] finished
0709 12:12:01.590097 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:01.590345 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":159279,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":44,"raft.queue_time_us":2034,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":7344,"spinlock_wait_cycles":25273088,"thread_start_us":927323,"threads_started":2,"wal-append.queue_time_us":730455}
W20260709 12:12:01.629699 22529 rpcz_store.cc:269] 0709 12:11:59.885621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.890697 (+  5076us) service_pool.cc:224] Handling call
0709 12:12:01.599520 (+1708823us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b54003f0cd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:01.599667 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3673248000}
I20260709 12:12:01.601511 27750 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:01.631747 27525 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:01.661847 22455 raft_consensus.cc:1240] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:01.675504 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:01.639555 28050 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:12:01.679724 28073 log.cc:927] Time spent T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 1.084s	user 0.006s	sys 0.000s
W20260709 12:12:01.680485 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 74106.9us
W20260709 12:12:01.681577 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 58238.2us
W20260709 12:12:01.690073 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 101296us
W20260709 12:12:01.705459 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.638731 27778 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:01.679478 28050 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:01.684502 28017 raft_consensus.cc:2804] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:12:01.747997 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 100061us
I20260709 12:12:01.745028 23122 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:01.664759 27838 consensus_queue.cc:260] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:01.745774 28017 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:12:01.758431 23087 leader_election.cc:336] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.664s (SENT)
W20260709 12:12:01.761685 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.768723 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:01.768927 23122 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317)
W20260709 12:12:01.777660 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.767429 23116 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:12:01.784016 22421 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:01.784089 22453 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
I20260709 12:12:01.750262 27901 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:01.790784 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.778582 23087 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:01.794186 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:01.765882 28017 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:01.809480 27514 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:01.809850 28075 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:01.810305 27514 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:01.810632 28075 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:01.813094 28075 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:01.813033 27514 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:01.814010 22527 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56942 (request call id 2180) took 1485 ms (client timeout 1977 ms). Trace:
I20260709 12:12:01.815331 22452 raft_consensus.cc:2393] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 15: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
W20260709 12:12:01.819075 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 72376.9us
W20260709 12:12:01.818783 22527 rpcz_store.cc:269] 0709 12:12:00.328541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.406298 (+ 77757us) service_pool.cc:224] Handling call
0709 12:12:01.807629 (+1401331us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b54000d48d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:01.813841 (+  6212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36203264}
I20260709 12:12:01.815711 22570 leader_election.cc:304] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:12:01.822541 22570 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:01.823056 28050 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:12:01.824457 22570 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:01.816462 27851 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.825688 27851 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:01.817052 27503 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:01.827600 27503 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:01.828635 27901 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:01.830042 27503 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:01.787947 27838 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:01.831599 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.831744 27851 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:01.832531 27972 raft_consensus.cc:2804] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:01.832938 27972 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:01.833287 27972 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:01.757944 27969 consensus_queue.cc:1059] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 12:12:01.839717 28050 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:01.840631 27985 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:01.841388 28015 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:01.841204 27985 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:01.843472 27969 raft_consensus.cc:3055] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:01.806200 22569 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:01.856267 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 61818.3us
W20260709 12:12:01.860508 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.862867 28118 raft_consensus.cc:2749] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:01.862957 28067 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.863255 22606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2710) took 2573 ms. Trace:
I20260709 12:12:01.863737 28067 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:01.866219 28067 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:01.857429 28029 raft_consensus.cc:2804] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:01.864059 28115 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:01.867554 28029 raft_consensus.cc:697] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:01.867664 28115 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:01.868831 28029 consensus_queue.cc:237] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:01.870059 28115 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:01.866916 27966 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.871153 27966 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:01.866950 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 116360us
I20260709 12:12:01.836181 27503 raft_consensus.cc:2749] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:01.844092 27514 raft_consensus.cc:2749] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:01.846349 27969 raft_consensus.cc:740] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
W20260709 12:12:01.885504 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 131298us
I20260709 12:12:01.886085 27966 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:01.887424 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:01.910696 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:01.914325 22421 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
W20260709 12:12:01.914564 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 90204us
I20260709 12:12:01.915441 23089 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:01.881182 28050 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:01.913862 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:01.863653 22606 rpcz_store.cc:276] 0709 12:11:59.289912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.305847 (+ 15935us) service_pool.cc:224] Handling call
0709 12:11:59.306225 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:59.451995 (+145770us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:59.452041 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:59.452584 (+   543us) log.cc:844] Serialized 26 byte log entry
0709 12:12:00.428852 (+976268us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:00.674365 (+245513us) log.cc:844] Serialized 14 byte log entry
0709 12:12:00.705319 (+ 30954us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:00.705423 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:01.661854 (+956431us) spinlock_profiling.cc:243] Waited 38.3 ms on lock 0x7b2400261a58. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc76c79c4 00007f9cc76c5acb 00007f9cc7880dc9 00007f9cc7880a55 00007f9cc788009d 00007f9cca4b210e 00007f9cca4c988c 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221
0709 12:12:01.843041 (+181187us) raft_consensus.cc:1685] finished
0709 12:12:01.848090 (+  5049us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:01.863080 (+ 14990us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":244752,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":125028,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":45734,"spinlock_wait_cycles":88007552,"thread_start_us":1232826,"threads_started":3,"wal-append.queue_time_us":1102105}
I20260709 12:12:01.922968 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:01.938412 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 146891us
I20260709 12:12:01.934930 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:01.935340 27525 raft_consensus.cc:2749] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:01.941636 22457 raft_consensus.cc:2393] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 17: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:01.941701 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:01.942716 22495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.909584 27985 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:01.950304 27809 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:01.943499 28017 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:01.951367 27809 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:01.952920 28017 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:01.959986 22526 raft_consensus.cc:1275] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:12:01.962348 22421 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:01.963090 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:01.968400 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 87594us
W20260709 12:12:01.979592 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.963191 28090 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.992069 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:01.995306 22523 raft_consensus.cc:2376] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 14. Re-sending same reply.
I20260709 12:12:01.998582 22456 raft_consensus.cc:1240] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:02.001974 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:02.013283 22529 raft_consensus.cc:1240] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:01.975485 28067 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.004863 27985 raft_consensus.cc:2749] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:02.016557 22523 raft_consensus.cc:1240] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:02.016996 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:02.017853 22532 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
I20260709 12:12:02.018167 22531 raft_consensus.cc:1275] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 12:12:02.019845 28092 log.cc:927] Time spent T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 1.113s	user 0.003s	sys 0.000s
I20260709 12:12:02.022492 28120 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:02.023254 28120 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:02.009711 28015 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.025550 28015 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:02.027264 22570 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:02.029269 28085 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.035615 28085 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:02.036863 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:02.029879 27989 raft_consensus.cc:2804] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:02.047639 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:12:02.050485 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:02.039871 28144 log.cc:927] Time spent T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
W20260709 12:12:02.039177 28135 log.cc:927] Time spent T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:12:02.046120 22526 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 14.
W20260709 12:12:02.056936 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.057019 22523 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:02.029570 28067 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:02.060883 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:02.062758 22529 raft_consensus.cc:2468] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 12.
I20260709 12:12:02.050554 27989 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:02.063772 27989 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:12:02.064090 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 62456.4us
I20260709 12:12:02.065176 22570 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:02.067186 27503 raft_consensus.cc:2749] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:02.037708 27871 consensus_queue.cc:1048] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
W20260709 12:12:02.070382 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 108483us
I20260709 12:12:02.057914 28105 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:02.031679 27809 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:02.026402 28090 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:02.063246 22569 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:02.074286 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:02.074795 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:02.079329 22598 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
I20260709 12:12:02.079797 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:02.076586 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:02.080714 28015 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:02.050333 27969 consensus_queue.cc:260] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:02.083912 27969 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:02.086361 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:02.086685 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:02.087119 22600 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 13.
I20260709 12:12:02.087306 28097 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:02.087756 28097 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:02.088195 28097 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:02.089888 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:02.090157 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:02.090692 22604 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 13.
I20260709 12:12:02.060575 27525 consensus_queue.cc:1059] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:12:02.091974 22497 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:02.092692 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:02.096884 22421 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:02.115840 22570 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:12:02.112740 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:02.121553 22599 raft_consensus.cc:1275] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:02.120775 22603 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
I20260709 12:12:02.096284 28105 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:02.127602 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:02.129165 28066 raft_consensus.cc:3055] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:12:02.133476 28126 raft_consensus.cc:2804] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:02.133533 28066 raft_consensus.cc:740] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:02.134161 28126 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:02.134554 28126 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:02.134706 28066 consensus_queue.cc:260] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:02.139746 28145 log.cc:927] Time spent T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:12:02.131929 28075 raft_consensus.cc:2804] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:02.146214 28075 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:02.146694 28075 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:02.154284 28105 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:02.160624 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:02.123875 27750 raft_consensus.cc:2804] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:12:02.170017 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 54263.8us
I20260709 12:12:02.114671 27503 consensus_queue.cc:1059] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 12:12:02.176093 22523 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 13.
I20260709 12:12:02.184648 22570 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:02.186921 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.187970 28033 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.132977 27809 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.188695 28033 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:02.190297 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.196821 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:02.189713 27809 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:02.202646 28035 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:02.203022 27972 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:02.203948 22353 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48412 (request call id 243) took 19093 ms (client timeout 15000 ms). Trace:
I20260709 12:12:02.204783 27880 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:02.205284 27972 leader_election.cc:290] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:02.203344 28035 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:02.205478 27880 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:02.207300 28035 leader_election.cc:290] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:02.207855 27880 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:02.203310 27809 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:02.174314 27750 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:02.246719 22497 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:02.259766 22531 raft_consensus.cc:1275] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:12:02.212244 28090 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:02.220027 27750 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:02.265799 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 129223us
I20260709 12:12:02.266674 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:02.264930 27809 raft_consensus.cc:2804] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:02.289173 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:02.283733 22452 raft_consensus.cc:1240] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 LEADER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:02.287249 22569 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:02.289793 22599 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:02.302175 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.302286 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:02.307505 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 122998us
I20260709 12:12:02.305547 22598 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 16.
I20260709 12:12:02.295614 27809 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:02.289657 28085 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:02.306708 22497 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:02.289234 27503 raft_consensus.cc:3055] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:02.320952 22531 raft_consensus.cc:1275] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 12:12:02.321432 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:02.323144 22570 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:02.315078 27809 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:02.319778 27503 raft_consensus.cc:740] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:02.322667 28068 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.325888 27400 raft_consensus.cc:2804] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:02.343248 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:02.377694 22497 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:02.378021 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:02.329082 28033 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:02.343254 22523 raft_consensus.cc:1275] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 12:12:02.406011 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 118919us
W20260709 12:12:02.408310 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 99909.1us
I20260709 12:12:02.412993 22570 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:02.343091 27400 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:02.414459 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:02.427394 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:02.428057 22523 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 16.
I20260709 12:12:02.435227 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:02.384058 28026 consensus_queue.cc:1048] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 12:12:02.436131 22601 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 16.
I20260709 12:12:02.441602 28033 raft_consensus.cc:2804] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:02.441784 28152 raft_consensus.cc:2749] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:02.442097 28033 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:02.442564 28033 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:02.442668 28152 consensus_queue.cc:1048] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:02.425386 27851 consensus_queue.cc:1048] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 12:12:02.424049 27400 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:02.204350 22353 rpcz_store.cc:269] 0709 12:11:43.115045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:43.143072 (+ 28027us) service_pool.cc:224] Handling call
0709 12:12:02.203643 (+19060571us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:54.379386 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:54.407613 (+ 28227us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:54.407665 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:11:54.407683 (+    18us) tablet.cc:662] Decoding operations
0709 12:11:54.544297 (+136614us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:54.544373 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:54.544400 (+    27us) tablet.cc:685] Acquiring locks for 17 operations
0709 12:11:54.545748 (+  1348us) tablet.cc:701] Row locks acquired
0709 12:11:54.545777 (+    29us) write_op.cc:260] PREPARE: finished
0709 12:11:54.545957 (+   180us) write_op.cc:270] Start()
0709 12:11:54.546113 (+   156us) write_op.cc:276] Timestamp: P: 1783599114545889 usec, L: 0
0709 12:11:54.546146 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 12:11:54.546880 (+   734us) log.cc:844] Serialized 6712 byte log entry
0709 12:11:55.815905 (+1269025us) op_driver.cc:464] REPLICATION: finished
0709 12:11:55.848910 (+ 33005us) write_op.cc:301] APPLY: starting
0709 12:11:55.848996 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:56.502223 (+653227us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:56.546614 (+ 44391us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:56.890260 (+343646us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:56.890746 (+   486us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0709 12:11:56.890815 (+    69us) write_op.cc:312] APPLY: finished
0709 12:11:56.920368 (+ 29553us) log.cc:844] Serialized 156 byte log entry
0709 12:11:57.324474 (+404106us) spinlock_profiling.cc:243] Waited 7.21 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cc78240ac 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc7840c02 00007f9cca4c820b
0709 12:11:57.607047 (+282573us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:57.607235 (+   188us) write_op.cc:454] Released schema lock
0709 12:11:57.607304 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:57.607852 (+   548us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:57.607888 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4498269,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":32712,"apply.run_cpu_time_us":81308,"apply.run_wall_time_us":1758921,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75187,"num_ops":17,"prepare.queue_time_us":266233,"prepare.run_cpu_time_us":32208,"prepare.run_wall_time_us":1162738,"raft.queue_time_us":229739,"raft.run_cpu_time_us":13216,"raft.run_wall_time_us":34589,"replication_time_us":1269565,"spinlock_wait_cycles":16589568,"thread_start_us":1927731,"threads_started":5,"wal-append.queue_time_us":1643484,"wal-append.run_cpu_time_us":62390,"wal-append.run_wall_time_us":2361999}]]}
I20260709 12:12:02.447049 28153 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:02.463946 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 86372.9us
I20260709 12:12:02.468789 22532 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 14.
I20260709 12:12:02.480589 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:02.454357 27966 raft_consensus.cc:2749] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:02.439356 28154 raft_consensus.cc:2804] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:02.414283 28068 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:02.488252 22602 raft_consensus.cc:1275] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:12:02.491158 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:02.491886 23116 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 16.
W20260709 12:12:02.492654 28136 log.cc:927] Time spent T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.250s	user 0.001s	sys 0.001s
I20260709 12:12:02.499936 23122 raft_consensus.cc:1275] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 16. (term mismatch)
I20260709 12:12:02.500361 23122 pending_rounds.cc:85] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270: Aborting all ops after (but not including) 15
I20260709 12:12:02.500452 28015 raft_consensus.cc:2749] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:12:02.500692 23122 pending_rounds.cc:107] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270: Aborting uncommitted NO_OP operation due to leader change: 18.16
I20260709 12:12:02.501622 23122 raft_consensus.cc:2889] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:02.502199 28126 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:02.485767 28154 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:02.505801 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:02.499320 27503 consensus_queue.cc:260] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:02.518868 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:02.523552 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:02.516606 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 133115us
W20260709 12:12:02.527442 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.532953 23116 raft_consensus.cc:1240] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:02.534204 23088 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:02.535744 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:02.536461 22456 raft_consensus.cc:3060] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:02.523056 28026 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:02.539129 28104 log.cc:927] Time spent T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260709 12:12:02.539471 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:02.517341 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:02.557082 23088 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:12:02.543534 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:02.560490 22495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.561178 22495 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:02.562952 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:02.564164 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:02.566521 22450 raft_consensus.cc:1240] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:02.567312 23124 raft_consensus.cc:2393] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 14: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:02.551831 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:02.520731 28154 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:02.564947 22604 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 12.
I20260709 12:12:02.570248 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:02.573402 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 476581us
I20260709 12:12:02.585290 22457 raft_consensus.cc:1275] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:12:02.526872 28123 consensus_queue.cc:1059] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 12:12:02.590132 22453 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 12.
I20260709 12:12:02.590790 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:02.590580 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:02.578151 23088 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:02.598927 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:02.607336 22450 raft_consensus.cc:2393] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 14: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:02.608026 27523 raft_consensus.cc:2804] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:02.608227 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:02.608646 27523 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:02.609086 27523 raft_consensus.cc:3060] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:02.611367 27503 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:02.551167 27880 consensus_queue.cc:1059] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:12:02.596381 27871 raft_consensus.cc:2804] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:02.620903 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:02.621659 23123 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
I20260709 12:12:02.622238 28033 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:02.622598 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:02.623122 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:02.631141 28119 raft_consensus.cc:2749] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:12:02.651225 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 90144.3us
I20260709 12:12:02.652597 22495 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:02.654026 22495 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:02.654189 28061 raft_consensus.cc:2804] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:02.562247 28026 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:02.632632 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:02.656584 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:02.658281 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:02.658563 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:02.670341 22599 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 19.
I20260709 12:12:02.672747 22495 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:02.634626 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.605074 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:02.642218 23123 raft_consensus.cc:3060] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:12:02.644979 28153 raft_consensus.cc:2749] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:02.648101 28067 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:02.638926 23118 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 17.
W20260709 12:12:02.660465 28157 log.cc:927] Time spent T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.187s	user 0.000s	sys 0.000s
I20260709 12:12:02.661139 28168 raft_consensus.cc:2749] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:02.659871 28160 log.cc:927] Time spent T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 12:12:02.573541 27400 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:02.663575 28026 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:02.654414 27989 consensus_meta.cc:287] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.590s	user 0.003s	sys 0.007s
I20260709 12:12:02.677772 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:02.666564 23119 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 14.
I20260709 12:12:02.667487 22454 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 12.
I20260709 12:12:02.678855 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:12:02.683487 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 105426us
W20260709 12:12:02.684136 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.666044 22531 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 15.
I20260709 12:12:02.694862 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:02.686408 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:02.655918 28158 log.cc:927] Time spent T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:12:02.679077 22456 raft_consensus.cc:2468] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 12.
W20260709 12:12:02.680701 28050 consensus_meta.cc:287] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.736s	user 0.013s	sys 0.000s
I20260709 12:12:02.608083 27849 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.656523 28123 raft_consensus.cc:3055] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:02.701956 22450 raft_consensus.cc:2410] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:12:02.654685 28061 raft_consensus.cc:697] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:02.683069 27525 raft_consensus.cc:2749] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:02.633090 28075 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:02.702530 28026 raft_consensus.cc:2749] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:02.654021 28119 consensus_queue.cc:1059] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 12:12:02.700999 27989 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:02.753911 27989 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:02.758494 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:02.737584 23118 raft_consensus.cc:1275] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
W20260709 12:12:02.773487 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 129129us
I20260709 12:12:02.776916 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:02.777870 22599 raft_consensus.cc:2468] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 13.
I20260709 12:12:02.743551 27523 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:02.734022 28050 raft_consensus.cc:2749] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:02.726250 28123 raft_consensus.cc:740] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:02.755551 27880 raft_consensus.cc:3055] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:02.755336 27750 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:02.810671 23089 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:02.811827 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:02.815249 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:02.813462 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:02.817848 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.814823 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:02.818622 22450 raft_consensus.cc:2393] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 15: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:02.785676 28168 raft_consensus.cc:3055] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:02.819167 28168 raft_consensus.cc:740] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:02.820118 27900 raft_consensus.cc:2804] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:02.820183 28168 consensus_queue.cc:260] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:02.820749 27523 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:02.821605 28168 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:02.821568 27523 consensus_queue.cc:1048] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:02.766541 28015 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:02.823493 22422 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:02.734171 27849 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:02.931103 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:02.853710 22454 raft_consensus.cc:1275] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
W20260709 12:12:02.879376 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 50378.1us
W20260709 12:12:02.879287 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 53232.6us
I20260709 12:12:02.840265 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:02.931056 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 232096us
W20260709 12:12:02.943082 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 249709us
I20260709 12:12:02.938253 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:02.879990 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:02.987332 22495 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:02.791520 28171 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.898729 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:02.942186 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:02.808370 27880 raft_consensus.cc:740] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:02.991494 22603 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:02.984855 22605 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 12.
I20260709 12:12:02.897500 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:02.788394 27851 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:12:02.824405 28097 consensus_meta.cc:287] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.726s	user 0.003s	sys 0.017s
I20260709 12:12:02.996634 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:03.003404 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 367911us
I20260709 12:12:02.994961 22597 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 13.
I20260709 12:12:02.813346 28068 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:03.006677 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:03.007499 22454 raft_consensus.cc:2368] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 14. Current term is 15.
I20260709 12:12:02.811080 27503 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:03.009589 22422 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:02.824925 28126 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:02.820783 27900 raft_consensus.cc:697] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 13 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:02.945559 28029 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.999209 28171 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:03.009918 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.813616 27989 consensus_queue.cc:1059] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.190s
I20260709 12:12:02.938237 28033 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:02.875401 28120 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:02.988505 28017 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:02.920790 28181 raft_consensus.cc:2804] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:02.999948 28075 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:03.017376 22450 raft_consensus.cc:2393] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 9: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:03.022344 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:02.991474 28159 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:03.026114 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:03.023859 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:03.022210 22599 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 14: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:03.029945 22605 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 14.
I20260709 12:12:03.005770 27838 raft_consensus.cc:2804] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:03.023552 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:03.031841 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:03.022809 22496 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:03.013695 28029 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:03.036072 22495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.036163 22597 raft_consensus.cc:2393] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 15: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:03.050390 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:12:03.023278 27809 consensus_meta.cc:287] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.639s	user 0.010s	sys 0.001s
I20260709 12:12:03.054006 22605 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:03.024693 28115 raft_consensus.cc:2804] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:02.934486 28123 consensus_queue.cc:260] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:03.004433 28097 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:03.052919 23088 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:03.050426 22496 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:03.054646 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:03.077116 22456 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 16.
W20260709 12:12:03.055112 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.055648 22454 raft_consensus.cc:1240] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:03.025338 28181 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:12:03.031729 28174 log.cc:927] Time spent T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 12:12:03.022012 28180 consensus_queue.cc:1048] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 12:12:03.060411 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:03.036180 27838 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:03.013115 28015 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:03.062881 27879 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.121s	user 0.007s	sys 0.004s
I20260709 12:12:03.073688 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:03.114270 22526 raft_consensus.cc:3060] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:03.039268 28167 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.120479 22606 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 16.
I20260709 12:12:03.030781 28068 raft_consensus.cc:2749] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:02.922710 28061 consensus_queue.cc:237] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:03.028244 27851 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:03.022639 27503 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:03.079806 23088 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:03.080590 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:03.123924 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.081604 28179 raft_consensus.cc:2804] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:03.083585 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:03.136435 22448 raft_consensus.cc:2393] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 12: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:03.084028 27849 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:03.112692 28119 raft_consensus.cc:2749] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:03.087762 27900 consensus_queue.cc:237] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:03.027994 28017 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:03.061928 28115 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:03.093377 27966 consensus_queue.cc:1048] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:12:03.094748 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:03.095026 27880 consensus_queue.cc:260] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:03.096567 28029 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:03.097420 27514 raft_consensus.cc:3055] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:12:03.103431 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 48203.5us
I20260709 12:12:03.106815 22497 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
W20260709 12:12:03.154357 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 47678.5us
I20260709 12:12:03.155050 22497 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:03.155968 22570 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:03.108778 22601 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 16.
I20260709 12:12:03.057335 28033 raft_consensus.cc:2804] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:12:03.111375 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 61089.8us
I20260709 12:12:03.057664 27750 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:03.111780 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:03.049388 27989 consensus_queue.cc:1048] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 12:12:03.128130 22449 raft_consensus.cc:2393] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 14: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
W20260709 12:12:03.128546 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 48870.6us
I20260709 12:12:03.129819 28118 raft_consensus.cc:2804] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:12:03.131623 28156 log.cc:927] Time spent T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.715s	user 0.003s	sys 0.000s
W20260709 12:12:03.113960 27879 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.172s	user 0.007s	sys 0.008s
I20260709 12:12:03.160223 28119 raft_consensus.cc:2804] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:03.171710 28119 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:03.172134 28154 consensus_meta.cc:287] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.560s	user 0.011s	sys 0.000s
I20260709 12:12:03.163086 22497 leader_election.cc:304] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:03.172765 28154 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:03.112812 27838 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:03.137337 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:03.035308 28188 consensus_queue.cc:1048] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 12:12:03.139127 22603 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 13.
I20260709 12:12:03.061578 27809 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:03.110306 28181 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:03.158418 28033 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:03.142190 22495 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:12:03.190361 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 48264.5us
I20260709 12:12:03.161116 28068 raft_consensus.cc:2804] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:03.147869 22602 raft_consensus.cc:2468] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
I20260709 12:12:03.135607 28179 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:03.148829 28115 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:03.149504 27525 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.165609 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:03.125568 28167 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:03.167130 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:03.168404 22604 raft_consensus.cc:1240] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 12:12:03.206648 22449 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
I20260709 12:12:03.207818 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:03.208673 22449 raft_consensus.cc:2393] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 16: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:03.168460 28017 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:03.168934 27880 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:03.191973 28033 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:03.220081 22448 raft_consensus.cc:2393] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 13: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:03.199594 28068 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:03.164809 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:03.224541 22451 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:03.134618 23123 raft_consensus.cc:2468] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 12.
I20260709 12:12:03.200765 28185 raft_consensus.cc:2804] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:03.143702 27778 consensus_queue.cc:1059] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 12:12:03.153903 27514 raft_consensus.cc:740] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:03.184725 22454 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 14.
I20260709 12:12:03.147918 27849 consensus_queue.cc:1048] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:12:03.036006 28159 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:03.187146 22603 raft_consensus.cc:1275] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:12:03.189392 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:03.191525 22600 raft_consensus.cc:1240] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:03.191781 22495 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:03.250487 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 58788.3us
I20260709 12:12:03.174135 28180 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:03.253248 28180 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:03.201730 22532 raft_consensus.cc:2368] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 14. Current term is 15.
I20260709 12:12:03.186820 27750 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:03.191089 28186 raft_consensus.cc:2749] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:03.255913 28180 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:03.256093 28167 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:03.169272 28171 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:03.124396 27969 consensus_meta.cc:287] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 1.040s	user 0.011s	sys 0.003s
I20260709 12:12:03.172108 28119 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:03.259636 22598 raft_consensus.cc:2410] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
W20260709 12:12:03.251129 28189 log.cc:927] Time spent T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
W20260709 12:12:03.221910 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 68427.3us
I20260709 12:12:03.263341 27809 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:03.236652 28182 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.264387 28182 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:03.264811 27750 raft_consensus.cc:2749] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:03.265620 22570 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:03.201138 28179 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:03.225375 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:03.268702 22449 raft_consensus.cc:2376] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 16. Re-sending same reply.
I20260709 12:12:03.258487 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:03.269806 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:03.270171 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:03.236650 27851 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:03.243284 28015 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:03.243669 27514 consensus_queue.cc:260] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:03.244911 27806 raft_consensus.cc:3055] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:03.286083 27806 raft_consensus.cc:740] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:03.286959 27806 consensus_queue.cc:260] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:03.287740 22451 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 13.
I20260709 12:12:03.288658 27806 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:03.245569 28033 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:03.292419 28033 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:03.245729 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:03.293805 22454 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 14: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:03.249478 22456 raft_consensus.cc:2468] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 12.
W20260709 12:12:03.295601 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.296849 28179 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:03.250633 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.251088 28026 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:03.227837 28068 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:03.142752 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 124209us
I20260709 12:12:03.228399 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:03.271687 28050 raft_consensus.cc:2804] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:03.272183 28172 consensus_queue.cc:1048] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:03.274047 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:03.274710 27503 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:03.277757 28154 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:03.278757 28097 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:03.208387 27525 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:03.285375 22455 raft_consensus.cc:2393] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 15: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
W20260709 12:12:03.297500 28177 log.cc:927] Time spent T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.507s	user 0.001s	sys 0.000s
I20260709 12:12:03.300735 28119 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:03.249523 28159 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:03.305183 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:03.229910 28185 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:03.307049 28182 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:03.312196 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:03.313083 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.313947 22530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 1103) took 1138 ms. Trace:
I20260709 12:12:03.320149 22605 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 12.
I20260709 12:12:03.251750 22495 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:03.333406 28118 raft_consensus.cc:697] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 14 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:03.338307 22449 raft_consensus.cc:2393] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 13: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:03.338794 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:03.342348 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 167742us
I20260709 12:12:03.340430 22422 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:03.318130 27880 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.354173 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: true dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:03.392025 22599 raft_consensus.cc:3055] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:03.294116 22349 catalog_manager.cc:5697] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 11 to 16. New cstate: current_term: 16 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:03.355762 22604 raft_consensus.cc:1275] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
W20260709 12:12:03.357620 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.361963 22497 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:03.363826 22606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45562 (request call id 2739) took 1058 ms. Trace:
I20260709 12:12:03.364323 22600 raft_consensus.cc:1240] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:12:03.349540 28015 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.371704 28123 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:03.387092 22530 rpcz_store.cc:276] 0709 12:12:02.175209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:02.175378 (+   169us) service_pool.cc:224] Handling call
0709 12:12:02.198975 (+ 23597us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:02.208187 (+  9212us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:12:02.208516 (+   329us) log.cc:844] Serialized 14 byte log entry
0709 12:12:02.211906 (+  3390us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:02.211970 (+    64us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:02.212033 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:03.313572 (+1101539us) spinlock_profiling.cc:243] Waited 8.91 ms on lock 0x7b5400262d54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:03.313618 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:03.313743 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3108,"prepare.queue_time_us":399,"prepare.run_wall_time_us":1025,"raft.queue_time_us":6151,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":44432,"spinlock_wait_cycles":52240384}
I20260709 12:12:03.375803 22452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2908) took 1518 ms. Trace:
I20260709 12:12:03.400352 23087 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:03.400156 22452 rpcz_store.cc:276] 0709 12:12:01.857015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.857230 (+   215us) service_pool.cc:224] Handling call
0709 12:12:01.864792 (+  7562us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:02.300904 (+436112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:03.375462 (+1074558us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b5400242a54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:03.375722 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":959637376}
I20260709 12:12:03.334707 28050 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:03.388783 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 137088us
I20260709 12:12:03.392328 22599 raft_consensus.cc:740] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:03.355597 27871 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:03.405150 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:03.389345 22597 raft_consensus.cc:2468] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 10.
I20260709 12:12:03.393667 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:03.334635 27849 consensus_queue.cc:1048] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 12:12:03.395733 22606 rpcz_store.cc:276] 0709 12:12:02.305913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:02.306066 (+   153us) service_pool.cc:224] Handling call
0709 12:12:03.363573 (+1057507us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b5400042c54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:03.363718 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1154105600}
I20260709 12:12:03.366148 22603 raft_consensus.cc:1240] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 14. Current term is 15. Ops: []
W20260709 12:12:03.391084 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 50742.6us
I20260709 12:12:03.387822 28185 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:03.334621 27809 consensus_queue.cc:1059] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:12:03.396950 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:03.398492 22497 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:03.402823 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:03.414136 22448 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:03.402781 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:03.415143 22454 raft_consensus.cc:2368] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 11. Current term is 12.
I20260709 12:12:03.405251 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:03.415727 22604 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:03.402601 27750 raft_consensus.cc:2804] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:03.409147 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:03.390928 28193 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.417131 28193 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:03.420050 28193 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:03.408437 22422 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:03.421185 22422 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:03.421985 28017 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:03.411664 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:03.413017 22495 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:03.422681 28017 raft_consensus.cc:697] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:03.425158 28029 raft_consensus.cc:2804] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:03.426179 28029 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:03.426707 28029 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:03.432323 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:03.433125 22455 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:03.435245 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:03.397038 27966 raft_consensus.cc:2804] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:03.441782 22597 raft_consensus.cc:1275] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:12:03.437237 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:03.438252 23089 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:03.424680 28017 consensus_queue.cc:237] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:03.444391 22605 raft_consensus.cc:1240] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:03.441202 23123 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
W20260709 12:12:03.453395 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 55023.5us
I20260709 12:12:03.407531 28050 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:03.412196 27871 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:03.411056 27989 raft_consensus.cc:476] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 14 LEADER]: Not starting pre-election -- already a leader
I20260709 12:12:03.458572 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:03.460009 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:03.399063 28159 consensus_queue.cc:1048] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.046s
I20260709 12:12:03.434024 27750 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:03.431826 27900 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:12:03.467016 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 54124.1us
I20260709 12:12:03.396991 27880 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:03.446545 27966 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:03.467337 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:03.463186 22599 consensus_queue.cc:260] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:03.474937 22526 raft_consensus.cc:2468] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 13.
I20260709 12:12:03.458408 27650 raft_consensus.cc:2749] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:03.455873 28168 raft_consensus.cc:3055] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:03.553607 28168 raft_consensus.cc:740] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:03.554761 28168 consensus_queue.cc:260] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:03.555332 27525 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:03.555934 27525 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:03.556231 28168 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:03.556563 27525 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:03.477808 22454 raft_consensus.cc:2393] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 12: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:03.478513 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:03.563271 22600 raft_consensus.cc:2468] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 13.
W20260709 12:12:03.537099 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 142476us
I20260709 12:12:03.483744 28066 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:12:03.536100 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:03.435926 28181 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:03.512393 27966 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:03.531350 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:03.472242 27750 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:03.535956 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:03.575568 22448 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 14.
I20260709 12:12:03.575776 23119 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:03.458674 28033 raft_consensus.cc:2804] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:03.466082 28193 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.512295 28199 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.558878 27525 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:03.541347 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 71744.8us
I20260709 12:12:03.600117 23125 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:03.539394 22452 raft_consensus.cc:2376] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 13. Re-sending same reply.
I20260709 12:12:03.482648 27900 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:03.549325 27880 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:03.548465 22349 catalog_manager.cc:5697] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 9 to 13, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 13 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:03.550093 22599 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:03.550199 28119 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:03.551020 28178 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.551453 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:03.551997 28161 raft_consensus.cc:2804] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:12:03.553115 28196 log.cc:927] Time spent T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 12:12:03.568629 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:03.578166 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:03.579311 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:03.535789 27989 raft_consensus.cc:2804] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:03.581547 22601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45562 (request call id 2743) took 1133 ms. Trace:
I20260709 12:12:03.627599 22601 rpcz_store.cc:276] 0709 12:12:02.448466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:02.463886 (+ 15420us) service_pool.cc:224] Handling call
0709 12:12:03.581388 (+1117502us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b54003aded4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:03.581489 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":488538368}
I20260709 12:12:03.582352 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:03.583393 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:03.589553 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 429470us
I20260709 12:12:03.434214 28015 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:03.603552 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:03.630818 22602 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 14.
I20260709 12:12:03.604287 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:03.631824 22454 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 17.
I20260709 12:12:03.630725 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:03.610013 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:03.613332 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:03.616520 23087 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:12:03.620901 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 207992us
I20260709 12:12:03.624284 23088 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:03.626545 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:03.629370 22496 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:03.636986 22599 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 14.
I20260709 12:12:03.638036 28200 raft_consensus.cc:2749] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:03.639256 28197 log.cc:927] Time spent T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:12:03.603399 28075 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:03.641695 28075 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:03.643141 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:03.643888 28075 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:03.644258 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:03.644845 23122 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 16.
I20260709 12:12:03.645637 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:03.646618 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:03.647022 23118 raft_consensus.cc:2410] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:12:03.647853 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:03.648358 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:03.648955 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:03.649658 23118 raft_consensus.cc:2393] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 11: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:03.650251 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:03.650410 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:03.650810 22528 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:03.652382 27900 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:03.651933 22349 catalog_manager.cc:5697] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 9 to 13, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 13 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:03.598737 28033 raft_consensus.cc:697] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:03.606083 28199 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:03.655715 28033 consensus_queue.cc:237] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:03.657047 28199 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:03.658058 23125 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 15.
I20260709 12:12:03.646612 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:03.659317 23122 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:03.661476 28181 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:03.661751 28015 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:03.643730 28161 raft_consensus.cc:697] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:03.662554 22449 raft_consensus.cc:2393] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 14: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:03.633471 22452 raft_consensus.cc:2376] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 13. Re-sending same reply.
I20260709 12:12:03.663691 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:03.668278 23119 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 14.
I20260709 12:12:03.668519 22528 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 18.
I20260709 12:12:03.630771 27989 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:03.607966 28097 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.671420 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:03.672465 23089 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:03.673833 22604 raft_consensus.cc:2468] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 11.
I20260709 12:12:03.674345 27989 raft_consensus.cc:3060] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:03.536509 28118 consensus_queue.cc:237] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:03.675462 28068 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:03.711907 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:03.712858 28068 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:03.678905 23122 raft_consensus.cc:2410] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:12:03.714668 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:03.712898 23118 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 16.
I20260709 12:12:03.684247 27514 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:03.685127 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:03.685863 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:03.686815 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 57539.6us
I20260709 12:12:03.717947 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:03.718845 22452 raft_consensus.cc:2393] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 17: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:03.687577 27871 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:03.741149 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:03.741849 22456 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
I20260709 12:12:03.688597 28090 raft_consensus.cc:2749] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:03.690111 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:03.745287 22603 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:12:03.691362 28208 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:03.682284 28115 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:03.694078 27879 raft_consensus.cc:3055] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:03.679854 27400 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:03.716646 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:03.754791 23120 raft_consensus.cc:2393] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 14: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:03.622131 28179 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:03.724054 22600 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 14.
I20260709 12:12:03.758301 22497 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:03.605755 28193 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:12:03.761459 28193 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:03.726336 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 53938.1us
I20260709 12:12:03.765296 28180 consensus_queue.cc:1059] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:03.766414 28180 consensus_queue.cc:1048] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:03.767150 28180 consensus_queue.cc:1243] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer 6c6fa11e8ee34711b3551f0c670442bc log is divergent from this leader: its last log entry 15.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:12:03.745157 28066 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:03.768504 28066 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:03.768596 28180 consensus_queue.cc:1059] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:03.769942 28199 raft_consensus.cc:3055] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:03.770414 28199 raft_consensus.cc:740] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:03.770602 28066 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:03.726868 28210 raft_consensus.cc:2749] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:03.728679 28205 log.cc:927] Time spent T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 12:12:03.728565 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:03.729234 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:12:03.731545 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:03.828374 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.829250 22570 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:03.731848 28067 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.732662 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:03.724538 22422 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.196.131:37785 timed out after 1.755s (SENT) [suppressed 20 similar messages]
W20260709 12:12:03.733381 28207 log.cc:927] Time spent T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:12:03.622560 28178 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:03.736009 27989 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:03.736334 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:03.737232 22529 raft_consensus.cc:2410] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:12:03.739233 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:03.844959 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:03.845005 22606 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:03.845602 22450 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:03.742708 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 118493us
W20260709 12:12:03.743321 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.745824 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:03.747406 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:03.749496 22528 raft_consensus.cc:1275] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:12:03.848137 22604 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:12:03.741146 23124 raft_consensus.cc:1240] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:03.752734 22454 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 14.
I20260709 12:12:03.717299 28097 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:03.631742 27838 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:03.753268 27966 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:03.749342 27879 raft_consensus.cc:740] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:03.771579 28199 consensus_queue.cc:260] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:03.773692 28188 raft_consensus.cc:3055] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:12:03.775301 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 165899us
I20260709 12:12:03.777199 27750 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:03.778200 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:03.780452 22457 raft_consensus.cc:1275] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
W20260709 12:12:03.781572 22598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45562 (request call id 2740) took 1451 ms (client timeout 1755 ms). Trace:
W20260709 12:12:03.792513 28203 log.cc:927] Time spent T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
I20260709 12:12:03.882496 23123 raft_consensus.cc:2410] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:12:03.794518 23089 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:03.795147 28208 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:03.887001 22453 raft_consensus.cc:2368] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 16. Current term is 17.
I20260709 12:12:03.662915 28161 consensus_queue.cc:237] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:03.744989 28181 raft_consensus.cc:2804] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:03.726491 27650 consensus_queue.cc:1048] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:03.803157 28171 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:03.804486 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:03.654407 22349 catalog_manager.cc:5697] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 9 to 13, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 13 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:03.805992 28212 log.cc:927] Time spent T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:12:03.806099 22523 raft_consensus.cc:1240] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:03.806563 28026 raft_consensus.cc:2749] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:03.806689 22532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56942 (request call id 2194) took 1244 ms. Trace:
I20260709 12:12:03.879902 28015 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.807698 22456 raft_consensus.cc:1240] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:03.805754 22603 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
I20260709 12:12:03.813189 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:03.819161 22455 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 16.
I20260709 12:12:03.876154 28188 raft_consensus.cc:740] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
W20260709 12:12:03.823642 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 99054.1us
I20260709 12:12:03.825039 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:03.830900 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:03.832700 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:03.908517 23125 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 15.
I20260709 12:12:03.823570 27400 raft_consensus.cc:2804] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:03.858161 22497 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:03.914073 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 56000us
I20260709 12:12:03.852039 28067 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:03.878598 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:03.850404 22495 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:03.931551 22454 raft_consensus.cc:2393] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 19: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:03.829238 27778 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:03.859958 23088 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:03.857358 28167 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.881745 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:03.882372 22525 raft_consensus.cc:2393] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 15: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:03.884495 23087 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:03.879436 22598 rpcz_store.cc:269] 0709 12:12:02.330432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:02.330690 (+   258us) service_pool.cc:224] Handling call
0709 12:12:03.781386 (+1450696us) spinlock_profiling.cc:243] Waited 914 ms on lock 0x7b5400041854. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:03.781517 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2102565120}
I20260709 12:12:03.879140 22457 pending_rounds.cc:85] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f: Aborting all ops after (but not including) 8
I20260709 12:12:03.936098 22457 pending_rounds.cc:107] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 12:12:03.936474 22457 raft_consensus.cc:2889] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:03.842300 27851 raft_consensus.cc:2749] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:03.887662 22448 raft_consensus.cc:2393] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 13: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:03.799614 27871 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:03.887787 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 93357.4us
I20260709 12:12:03.857733 28085 raft_consensus.cc:2804] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:03.828948 28029 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:03.894997 22597 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 19.
I20260709 12:12:03.806933 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:03.907588 28176 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.900899 22532 rpcz_store.cc:276] 0709 12:12:02.562545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:02.562659 (+   114us) service_pool.cc:224] Handling call
0709 12:12:03.806484 (+1243825us) spinlock_profiling.cc:243] Waited 638 ms on lock 0x7b540010c7d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:03.806633 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1466774784}
I20260709 12:12:03.905332 22452 raft_consensus.cc:1240] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:12:03.891222 28123 raft_consensus.cc:2749] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:03.909294 23116 raft_consensus.cc:2468] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 13.
I20260709 12:12:03.915231 22497 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:03.862491 22606 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 13.
I20260709 12:12:03.915992 22421 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:03.916144 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:03.838409 22570 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:03.952358 22523 raft_consensus.cc:2393] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 14: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:03.918105 27989 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:03.913337 27879 consensus_queue.cc:260] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:03.902565 28171 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:03.907001 28015 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:03.931573 22604 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 16.
I20260709 12:12:03.932752 28035 raft_consensus.cc:2749] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:03.903044 28199 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:03.940219 22454 raft_consensus.cc:1240] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:03.963029 23089 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:03.950485 28210 raft_consensus.cc:2749] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:03.940719 23121 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 15.
I20260709 12:12:03.942624 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:03.976449 22526 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 9.
I20260709 12:12:03.818660 22601 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
W20260709 12:12:03.946424 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 96110.9us
I20260709 12:12:03.908123 28181 raft_consensus.cc:697] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 16 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
W20260709 12:12:03.947363 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 87479.6us
I20260709 12:12:03.981887 23088 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:12:03.952896 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 114598us
I20260709 12:12:03.954547 22497 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:03.952950 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:03.983206 22570 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:03.963333 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:03.984795 22570 leader_election.cc:304] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:03.985123 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:12:03.958209 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 81441.2us
I20260709 12:12:03.919775 27838 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:03.957350 22569 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:03.955206 27514 raft_consensus.cc:2749] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:03.962296 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:03.996675 28067 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:03.997051 22523 raft_consensus.cc:2410] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:12:03.998198 22523 raft_consensus.cc:1240] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:03.962560 27879 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:03.998543 28188 consensus_queue.cc:260] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:03.964393 22451 raft_consensus.cc:2393] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 11: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:03.964203 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:03.970242 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:03.949513 27523 raft_consensus.cc:2749] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:03.941392 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 216883us
I20260709 12:12:03.959172 28068 raft_consensus.cc:2804] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:03.951725 27650 raft_consensus.cc:2804] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:03.987321 28090 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:03.953416 28085 raft_consensus.cc:697] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 13 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:03.986632 23089 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:03.989792 22497 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:03.991534 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:12:04.048615 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 62055.7us
I20260709 12:12:04.049127 22526 raft_consensus.cc:2410] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:12:04.049132 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:04.049970 22606 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:04.050534 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:04.051229 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.986368 23087 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:03.995060 27989 raft_consensus.cc:2804] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:03.996272 28015 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:03.968770 28050 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:04.015985 22529 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56942 (request call id 2197) took 1410 ms (client timeout 1677 ms). Trace:
I20260709 12:12:03.942653 27778 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:04.055593 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:04.000897 27871 raft_consensus.cc:2804] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:12:04.025521 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:04.019461 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 62181.6us
I20260709 12:12:04.060429 23122 raft_consensus.cc:1275] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 12:12:04.060881 23122 pending_rounds.cc:85] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270: Aborting all ops after (but not including) 7
I20260709 12:12:04.061234 23122 pending_rounds.cc:107] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:12:04.061568 23122 raft_consensus.cc:2889] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:04.062711 22422 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:12:04.016609 28216 log.cc:927] Time spent T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:12:03.944352 28167 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:04.000375 28154 raft_consensus.cc:2749] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:03.968112 27900 consensus_queue.cc:1048] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 12:12:04.014281 28181 consensus_queue.cc:237] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:04.011860 27400 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
W20260709 12:12:04.040611 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 55910.4us
I20260709 12:12:04.052955 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:04.094777 23117 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:12:04.053545 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 70024.5us
I20260709 12:12:04.053573 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:03.953074 28176 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:04.054507 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:04.111289 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:04.111954 22456 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 19.
I20260709 12:12:04.112174 22603 raft_consensus.cc:2410] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 12:12:04.012701 28188 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:04.112385 22497 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:04.011190 22349 catalog_manager.cc:5697] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 11 to 12, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 12 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:04.055253 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:03.998368 28208 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:04.055419 22529 rpcz_store.cc:269] 0709 12:12:02.605626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:02.632251 (+ 26625us) service_pool.cc:224] Handling call
0709 12:12:04.010575 (+1378324us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54004006d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:04.015922 (+  5347us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2465207552}
I20260709 12:12:04.046298 28090 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:04.061100 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:03.969511 28193 raft_consensus.cc:2804] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:12:04.007441 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 91524.2us
I20260709 12:12:04.063951 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:04.067155 22450 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 16.
I20260709 12:12:04.038081 28153 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:04.189891 28153 raft_consensus.cc:697] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
W20260709 12:12:04.191382 28211 log.cc:927] Time spent T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.532s	user 0.004s	sys 0.006s
I20260709 12:12:04.191104 28153 consensus_queue.cc:237] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:04.192236 22569 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:04.193133 27514 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:04.072332 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:04.074409 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:04.046561 27650 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:04.074838 28180 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:12:04.075201 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 88942.8us
I20260709 12:12:04.075347 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:04.194543 23087 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:04.194973 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:04.077456 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:04.195829 23119 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 14.
I20260709 12:12:04.078609 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:04.196849 23123 raft_consensus.cc:2393] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 15: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:04.079167 28015 raft_consensus.cc:2804] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:04.044358 28182 raft_consensus.cc:2749] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:04.055223 27966 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:04.232421 23089 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:04.090543 22422 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:04.092092 22524 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 14.
I20260709 12:12:04.047608 28068 raft_consensus.cc:697] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
W20260709 12:12:04.233526 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 143056us
I20260709 12:12:04.234028 22604 raft_consensus.cc:1275] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:12:04.209584 28015 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:04.109928 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:04.234645 27838 raft_consensus.cc:2804] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:04.057762 28035 raft_consensus.cc:2804] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:04.061285 28118 raft_consensus.cc:2804] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:12:04.243294 28118 raft_consensus.cc:697] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 11 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:04.244195 28118 consensus_queue.cc:237] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:04.163889 28193 raft_consensus.cc:697] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:04.212673 27514 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:04.057549 27989 raft_consensus.cc:697] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 14 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:04.248176 27989 consensus_queue.cc:237] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:04.234195 28068 consensus_queue.cc:237] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:04.240499 28198 consensus_queue.cc:1048] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 12:12:04.252452 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:04.253023 22448 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:04.253383 28176 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:04.254074 28029 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:04.211179 27650 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:04.255941 28035 raft_consensus.cc:697] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:04.256924 28035 consensus_queue.cc:237] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:04.240486 28050 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:04.210775 23087 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:04.234908 28015 raft_consensus.cc:3060] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:04.265131 27879 raft_consensus.cc:2749] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:12:04.266191 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 55459.9us
I20260709 12:12:04.267280 23087 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:04.058244 27750 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:04.120611 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:12:04.096491 28185 consensus_meta.cc:287] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.655s	user 0.011s	sys 0.000s
I20260709 12:12:04.123591 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:12:04.158931 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.069952 28097 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:04.160213 22421 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:04.096772 28033 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.093276 27871 raft_consensus.cc:697] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 18 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
W20260709 12:12:04.163841 28218 log.cc:927] Time spent T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:12:04.292438 27966 raft_consensus.cc:2749] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:04.165115 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:04.293443 28033 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:04.166271 22349 catalog_manager.cc:5697] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 6 to 16. New cstate: current_term: 16 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:04.167241 28220 log.cc:927] Time spent T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 12:12:04.168256 27778 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:04.125011 28168 raft_consensus.cc:2804] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:04.296618 28033 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:04.296800 28168 raft_consensus.cc:697] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:04.293556 28185 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:04.297783 28168 consensus_queue.cc:237] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:04.169137 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 190355us
I20260709 12:12:04.299350 28185 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:04.300490 22531 raft_consensus.cc:1240] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:12:04.124743 28090 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:04.304252 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:04.305341 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:04.305905 22455 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:04.171344 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:04.289238 27838 raft_consensus.cc:697] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 16 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:04.302321 27871 consensus_queue.cc:237] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:04.308992 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:04.309551 22452 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:04.235378 28179 raft_consensus.cc:2749] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:04.311308 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:04.311906 22456 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 14.
I20260709 12:12:04.171452 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:04.312970 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:04.313723 22529 raft_consensus.cc:2410] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:12:04.172209 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:04.173606 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:04.182111 28085 consensus_queue.cc:237] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:04.112967 28115 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:04.109850 27400 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:04.187822 28171 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:04.069769 22606 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 17.
I20260709 12:12:04.233889 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:04.092856 28105 consensus_queue.cc:1048] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 12:12:04.326452 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:04.110409 22570 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:04.210724 22605 pending_rounds.cc:85] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting all ops after (but not including) 13
I20260709 12:12:04.327075 22529 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:04.327383 22605 pending_rounds.cc:107] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting uncommitted NO_OP operation due to leader change: 15.14
I20260709 12:12:04.327800 22605 raft_consensus.cc:2889] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:04.234246 22422 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:04.236956 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:04.237287 23089 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:04.236835 27523 raft_consensus.cc:2749] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:04.121713 28178 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:04.339330 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:04.340114 22524 raft_consensus.cc:2368] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 12. Current term is 13.
I20260709 12:12:04.247268 27514 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:04.117368 22497 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:04.269860 22603 raft_consensus.cc:2368] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 14. Current term is 15.
W20260709 12:12:04.343739 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 233402us
I20260709 12:12:04.273351 22448 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 17.
I20260709 12:12:04.282050 23117 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 12.
I20260709 12:12:04.288820 22496 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
W20260709 12:12:04.289090 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 128966us
I20260709 12:12:04.288265 27879 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:04.315478 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:04.348307 22528 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 15.
I20260709 12:12:04.302842 22523 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 13.
I20260709 12:12:04.316711 22451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 1070) took 1003 ms. Trace:
W20260709 12:12:04.349417 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 232177us
I20260709 12:12:04.318605 22527 raft_consensus.cc:2393] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 15: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:04.318852 22598 raft_consensus.cc:2393] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 15: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:04.323096 23087 leader_election.cc:400] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 11. Current term is 12.
I20260709 12:12:04.350739 23087 leader_election.cc:403] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:12:04.340960 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 103743us
I20260709 12:12:04.341200 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:04.233191 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:04.351670 22601 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 8.
I20260709 12:12:04.351774 22526 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 14.
I20260709 12:12:04.346566 22421 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
W20260709 12:12:04.348614 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 114442us
I20260709 12:12:04.349684 22451 rpcz_store.cc:276] 0709 12:12:03.313064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:03.582725 (+269661us) service_pool.cc:224] Handling call
0709 12:12:04.316493 (+733768us) spinlock_profiling.cc:243] Waited 330 ms on lock 0x7b54003cad54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:04.316656 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":759545728}
I20260709 12:12:04.354586 22570 leader_election.cc:400] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 14. Current term is 15.
I20260709 12:12:04.354931 22570 leader_election.cc:403] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:04.355475 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:04.356890 22421 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:04.357211 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:04.361985 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:04.362661 22526 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
I20260709 12:12:04.363860 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:04.364288 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:04.368394 22570 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:04.369928 22570 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:04.370508 22526 raft_consensus.cc:1240] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:04.371236 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:04.371851 23123 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 14.
I20260709 12:12:04.371958 22526 raft_consensus.cc:1275] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:12:04.372722 22527 raft_consensus.cc:1275] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:04.373983 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:04.377189 23089 leader_election.cc:400] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 election: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 14. Current term is 15.
I20260709 12:12:04.377516 23089 leader_election.cc:403] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:12:04.361001 28097 raft_consensus.cc:2764] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:12:04.352481 28029 raft_consensus.cc:2764] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:12:04.402678 22455 raft_consensus.cc:2468] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 13.
W20260709 12:12:04.407568 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 128344us
I20260709 12:12:04.246914 28193 consensus_queue.cc:237] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:04.354635 27778 raft_consensus.cc:2804] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:04.364876 27966 raft_consensus.cc:2749] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:04.411489 22524 raft_consensus.cc:1240] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:04.296715 22349 catalog_manager.cc:5697] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 12 to 13, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 13 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:04.412266 28199 raft_consensus.cc:2749] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 11. Current term is 12.
I20260709 12:12:04.418222 22529 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 15.
I20260709 12:12:04.354859 28066 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:04.423935 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:04.369108 28176 raft_consensus.cc:2749] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 14. Current term is 15.
I20260709 12:12:04.376204 27523 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:04.378775 27851 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:12:04.435895 23087 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
W20260709 12:12:04.438223 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:04.444010 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 87187.2us
I20260709 12:12:04.422994 28050 raft_consensus.cc:2804] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:04.418901 28118 raft_consensus.cc:2749] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:04.447327 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 77488.8us
I20260709 12:12:04.421277 28180 raft_consensus.cc:2749] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 14. Current term is 15.
W20260709 12:12:04.461244 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 172508us
W20260709 12:12:04.458030 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 98200.5us
I20260709 12:12:04.464622 22452 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 14.
I20260709 12:12:04.472018 22570 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:04.442943 28210 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.475322 22597 raft_consensus.cc:2468] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 13.
I20260709 12:12:04.447306 28198 raft_consensus.cc:2764] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 13 LEADER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:12:04.448995 28017 raft_consensus.cc:2749] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:04.482337 22570 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:04.452008 28050 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:04.487820 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 64397.9us
W20260709 12:12:04.491026 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.450677 28067 raft_consensus.cc:2749] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:04.435524 28066 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:04.501742 22570 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:04.489135 28210 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:04.506247 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:12:04.507748 28229 log.cc:927] Time spent T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:12:04.458669 27650 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:04.445191 27523 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:04.532634 23123 raft_consensus.cc:1275] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:04.437986 27838 consensus_queue.cc:237] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:04.553177 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 99823.1us
I20260709 12:12:04.499082 28050 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:04.562566 22496 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:04.501260 28097 raft_consensus.cc:2804] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:12:04.557901 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 56309us
I20260709 12:12:04.558676 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:04.569682 23124 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:04.559237 28182 raft_consensus.cc:2749] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:04.559947 28167 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:04.554143 28214 log.cc:927] Time spent T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:12:04.561214 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:04.535182 28066 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:04.570192 22570 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:04.575466 22422 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:04.506744 27514 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:04.582886 23119 raft_consensus.cc:2468] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 12.
W20260709 12:12:04.557843 28228 log.cc:927] Time spent T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:12:04.531144 28171 raft_consensus.cc:2804] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:04.531535 27650 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:04.588006 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:04.552125 27778 raft_consensus.cc:697] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:04.496316 27966 consensus_queue.cc:1059] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.072s
I20260709 12:12:04.594528 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:04.569183 28097 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:04.593437 22570 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:04.603123 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:04.603114 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:04.612774 23121 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 8 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 8.
I20260709 12:12:04.596859 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:04.613263 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:04.650714 23125 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:04.687913 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:04.688531 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:04.689278 22455 raft_consensus.cc:2393] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 11: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:04.690205 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:04.590211 28237 raft_consensus.cc:2804] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:04.691258 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:04.694703 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:04.695827 22451 raft_consensus.cc:1240] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:12:04.653590 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:04.614682 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.692313 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:04.590517 28017 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.693394 22455 raft_consensus.cc:1240] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:04.647095 28171 raft_consensus.cc:697] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 15 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:04.697153 22450 raft_consensus.cc:1240] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:12:04.697932 22456 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:04.613858 22496 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:04.694440 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:04.584614 28067 raft_consensus.cc:2804] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:04.659422 22525 raft_consensus.cc:2410] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 12:12:04.658322 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 64928.1us
I20260709 12:12:04.595570 28238 consensus_queue.cc:1048] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.124s
I20260709 12:12:04.712196 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:04.604085 28176 raft_consensus.cc:2804] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:04.713322 28176 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:04.713814 28176 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:04.713956 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:04.652936 28097 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:04.686836 28105 raft_consensus.cc:2804] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:04.722738 28176 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:04.731972 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:04.732733 23125 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 17.
W20260709 12:12:04.734177 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 120399us
I20260709 12:12:04.731063 28017 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:04.744834 27851 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:12:04.745329 28017 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:04.745942 22457 raft_consensus.cc:1240] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:04.746256 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:04.745494 27851 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.750967 22495 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:04.753381 22456 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 18.
I20260709 12:12:04.746853 23124 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
I20260709 12:12:04.647535 28210 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:04.756213 22495 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:12:04.757408 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:04.755148 22496 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:04.747033 27851 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:04.768376 27879 raft_consensus.cc:2749] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:04.770493 23089 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:12:04.764973 28226 log.cc:927] Time spent T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
I20260709 12:12:04.710471 28067 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:04.745957 28017 consensus_queue.cc:1048] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 12:12:04.796993 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:04.797168 22451 raft_consensus.cc:1275] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:04.756274 28235 raft_consensus.cc:2804] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:12:04.862876 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 163729us
I20260709 12:12:04.585259 22349 catalog_manager.cc:5697] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 7 to 11, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 11 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
W20260709 12:12:04.847174 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 91032.6us
I20260709 12:12:04.827531 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:04.884943 22450 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
I20260709 12:12:04.865262 23120 raft_consensus.cc:1275] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:12:04.899489 23124 raft_consensus.cc:1275] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:12:04.899868 22570 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
W20260709 12:12:04.847440 28015 consensus_meta.cc:287] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.582s	user 0.004s	sys 0.006s
I20260709 12:12:04.903884 22570 leader_election.cc:400] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 12. Current term is 13.
I20260709 12:12:04.867561 28068 raft_consensus.cc:2804] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:04.905659 22570 leader_election.cc:403] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:04.907768 22421 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:04.826514 28246 raft_consensus.cc:2804] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:04.907985 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:04.796852 27879 raft_consensus.cc:2804] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:04.891579 28235 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:04.771824 28090 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:04.802968 28067 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:04.802722 28245 raft_consensus.cc:2804] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:04.904474 27523 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:12:04.903136 27400 consensus_meta.cc:287] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.559s	user 0.008s	sys 0.001s
I20260709 12:12:04.991050 27400 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:04.991775 22601 raft_consensus.cc:1275] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:12:04.993395 22601 raft_consensus.cc:1275] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:12:04.993927 27400 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:04.994858 22529 raft_consensus.cc:1240] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:04.995309 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:04.996085 22606 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
I20260709 12:12:05.000226 28090 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:05.001329 22532 raft_consensus.cc:2393] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 19: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:05.003132 28182 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 13
W20260709 12:12:05.004081 23087 leader_election.cc:336] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 1.824s (SENT)
W20260709 12:12:05.004949 23087 leader_election.cc:336] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 2.569s (SENT)
W20260709 12:12:05.009449 28227 log.cc:927] Time spent T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.441s	user 0.000s	sys 0.001s
I20260709 12:12:05.011968 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:05.012746 22451 raft_consensus.cc:2393] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 12: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:05.013458 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:05.014123 22451 raft_consensus.cc:2393] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 19: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:04.867595 28105 raft_consensus.cc:697] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 15 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:04.923246 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:04.801882 28176 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:05.027400 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 123633us
I20260709 12:12:05.028124 22570 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:05.029084 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:04.920683 22569 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:04.934937 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:04.924084 28068 raft_consensus.cc:697] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:04.929844 28235 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:04.906210 28242 consensus_queue.cc:1048] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:12:04.937028 22349 catalog_manager.cc:5697] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 6 to 9, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 9 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:04.943547 28231 log.cc:927] Time spent T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
I20260709 12:12:04.948136 28253 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.884443 28171 consensus_queue.cc:237] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:04.884181 27778 consensus_queue.cc:237] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:04.953063 28097 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:04.958045 28225 log.cc:927] Time spent T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.460s	user 0.002s	sys 0.000s
I20260709 12:12:04.961712 28238 raft_consensus.cc:3055] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:05.072117 28238 raft_consensus.cc:740] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:05.072199 22349 catalog_manager.cc:5697] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 7 to 14. New cstate: current_term: 14 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:12:05.072988 28238 consensus_queue.cc:260] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:05.074067 28238 raft_consensus.cc:3060] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:04.969812 28240 log.cc:927] Time spent T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.214s	user 0.002s	sys 0.000s
W20260709 12:12:04.971773 28217 log.cc:927] Time spent T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.739s	user 0.005s	sys 0.000s
W20260709 12:12:04.974665 28248 log.cc:927] Time spent T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:12:05.076772 22605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43070 (request call id 965) took 1003 ms. Trace:
I20260709 12:12:05.077472 22600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3178) took 1393 ms. Trace:
I20260709 12:12:05.077951 22600 rpcz_store.cc:276] 0709 12:12:03.684482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:03.756535 (+ 72053us) service_pool.cc:224] Handling call
0709 12:12:03.757019 (+   484us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:03.800264 (+ 43245us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:03.800313 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:03.800962 (+   649us) log.cc:844] Serialized 26 byte log entry
0709 12:12:03.929580 (+128618us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:03.929620 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:03.929688 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:04.971155 (+1041467us) spinlock_profiling.cc:243] Waited 2.66 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:12:05.077124 (+105969us) raft_consensus.cc:1685] finished
0709 12:12:05.077154 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:05.077403 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42675,"raft.queue_time_us":42907,"raft.run_cpu_time_us":46,"raft.run_wall_time_us":46,"spinlock_wait_cycles":6111616,"thread_start_us":128168,"threads_started":1,"wal-append.queue_time_us":259977}
I20260709 12:12:04.984556 28258 raft_consensus.cc:2749] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:04.934511 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:05.081382 22598 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 14.
W20260709 12:12:04.986313 28254 log.cc:927] Time spent T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:12:04.989423 27514 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:05.014801 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:05.024401 22601 raft_consensus.cc:1240] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:05.022251 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:05.084376 22454 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
I20260709 12:12:05.020184 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:05.032099 22497 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:12:05.032621 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:05.086490 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 54484.2us
I20260709 12:12:05.070626 28253 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:05.032572 28161 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.089288 28253 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:05.088891 28161 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:05.035322 28185 consensus_queue.cc:1048] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:05.039853 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:05.092962 22604 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:05.040525 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:05.093868 22599 raft_consensus.cc:2368] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 19. Current term is 20.
I20260709 12:12:04.937332 28250 raft_consensus.cc:2749] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:12:05.049958 22570 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:05.050635 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 130051us
I20260709 12:12:04.928618 27879 raft_consensus.cc:697] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 13 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:05.057485 23088 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:04.910710 28015 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:05.030524 28245 raft_consensus.cc:697] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
W20260709 12:12:05.097927 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 48031.6us
I20260709 12:12:05.020156 28237 raft_consensus.cc:697] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:05.073727 22349 catalog_manager.cc:5697] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 5 to 12, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 12 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:05.091010 22603 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 19.
W20260709 12:12:05.091526 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 188186us
W20260709 12:12:05.112061 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 54674.9us
I20260709 12:12:05.112757 22421 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:05.060384 28239 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:05.063455 28176 raft_consensus.cc:2804] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:05.060639 28210 consensus_queue.cc:1048] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 12:12:05.085222 22605 rpcz_store.cc:276] 0709 12:12:04.073115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:04.210043 (+136928us) service_pool.cc:224] Handling call
0709 12:12:04.210447 (+   404us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:04.353777 (+143330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:04.353807 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:04.356593 (+  2786us) log.cc:844] Serialized 52 byte log entry
0709 12:12:04.468534 (+111941us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:04.468572 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:04.468634 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:04.969121 (+500487us) spinlock_profiling.cc:243] Waited 35.9 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:12:05.076354 (+107233us) raft_consensus.cc:1685] finished
0709 12:12:05.076387 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:05.076697 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9993,"raft.queue_time_us":11505,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":17364,"spinlock_wait_cycles":82498944,"thread_start_us":84175,"threads_started":1,"wal-append.queue_time_us":247845}
I20260709 12:12:05.100095 22569 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:05.116324 22570 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:05.097604 27400 raft_consensus.cc:2804] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:12:05.131423 22452 raft_consensus.cc:1275] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:12:05.128293 22604 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
I20260709 12:12:05.129070 22453 raft_consensus.cc:2368] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 13. Current term is 14.
I20260709 12:12:05.135646 22599 raft_consensus.cc:1240] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 12:12:05.105054 28253 raft_consensus.cc:2749] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:12:05.137894 22456 raft_consensus.cc:1275] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:12:05.114202 28179 raft_consensus.cc:2749] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:05.146476 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:05.148154 22450 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:05.114022 28239 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:05.150156 22421 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:05.154228 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:05.130570 27400 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:05.129568 28246 raft_consensus.cc:697] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:05.143316 28250 raft_consensus.cc:2749] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:05.116261 28181 consensus_queue.cc:1059] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 12:12:05.162595 27400 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:05.167984 22497 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:12:05.173427 22421 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:05.153869 28066 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.157362 28239 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:05.176548 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 142029us
I20260709 12:12:05.188164 22497 leader_election.cc:400] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 election: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 19. Current term is 20.
I20260709 12:12:05.188565 22497 leader_election.cc:403] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:12:05.189575 22497 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:05.192447 28097 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:05.192807 27838 raft_consensus.cc:2804] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:12:05.193212 27838 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:05.193265 28097 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:05.193688 27838 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:05.193828 28097 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:05.192816 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:05.192497 22421 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:05.127519 28105 consensus_queue.cc:237] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:05.197887 22421 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:05.199136 28017 raft_consensus.cc:2749] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:05.199754 28017 consensus_queue.cc:1059] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:05.200856 28017 raft_consensus.cc:2749] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:05.201539 28017 raft_consensus.cc:3055] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:05.201881 28017 raft_consensus.cc:740] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:05.160897 28261 raft_consensus.cc:2749] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:05.144377 28068 consensus_queue.cc:237] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:05.206223 28182 raft_consensus.cc:2749] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 12. Current term is 13.
I20260709 12:12:05.137480 28252 consensus_queue.cc:1048] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:12:05.162442 27514 raft_consensus.cc:2804] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:05.207916 22421 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:05.221367 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:05.159308 28259 raft_consensus.cc:2749] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:05.325631 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 117771us
I20260709 12:12:05.326596 22421 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:05.219898 27514 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:05.336714 27514 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:05.338500 22450 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 20.
I20260709 12:12:05.341709 22531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 1116) took 1708 ms. Trace:
I20260709 12:12:05.225009 28167 raft_consensus.cc:2804] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:05.218235 28176 raft_consensus.cc:697] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:05.357170 22421 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:12:05.358002 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 223831us
I20260709 12:12:05.358724 22570 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:05.342687 22531 rpcz_store.cc:276] 0709 12:12:03.632982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:03.659696 (+ 26714us) service_pool.cc:224] Handling call
0709 12:12:03.660026 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:04.300845 (+640819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:05.341373 (+1040528us) spinlock_profiling.cc:243] Waited 640 ms on lock 0x7b54000d52d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:05.341635 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1472393472}
I20260709 12:12:05.202667 28017 consensus_queue.cc:260] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:05.187440 28236 consensus_queue.cc:1048] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.285s
I20260709 12:12:05.189563 28066 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:05.337759 28168 raft_consensus.cc:2804] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:05.337111 28243 raft_consensus.cc:2749] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:12:05.381101 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:05.338460 27778 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:05.383023 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:05.382452 22421 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:12:05.390043 23125 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:05.176957 28237 consensus_queue.cc:237] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:05.359370 28167 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:05.439143 28167 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:05.439798 22570 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:05.441279 28182 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.441761 28182 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:05.444411 28105 raft_consensus.cc:2749] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:05.447644 28182 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:05.449220 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:05.449837 22454 raft_consensus.cc:2468] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11.
I20260709 12:12:05.450796 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:05.398835 28168 raft_consensus.cc:697] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:05.451975 28168 consensus_queue.cc:237] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:05.453227 28208 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.453725 28208 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:05.189375 27879 consensus_queue.cc:237] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:05.400336 28029 raft_consensus.cc:2804] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:05.469898 28029 raft_consensus.cc:697] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:05.401298 22421 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
W20260709 12:12:05.472441 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 71223.5us
I20260709 12:12:05.470959 28029 consensus_queue.cc:237] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:05.177153 28245 consensus_queue.cc:237] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:05.480680 28115 raft_consensus.cc:2804] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:05.481101 28115 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:05.481427 28115 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:05.403339 28017 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:05.397979 28268 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.397768 28181 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:05.371719 28153 raft_consensus.cc:2749] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:05.405440 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 215945us
I20260709 12:12:05.405922 23118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57332 (request call id 1286) took 1347 ms. Trace:
W20260709 12:12:05.411571 28263 log.cc:927] Time spent T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:12:05.413223 27900 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.422402 23125 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 17.
W20260709 12:12:05.424919 22532 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56940 (request call id 2447) took 1481 ms (client timeout 1755 ms). Trace:
I20260709 12:12:05.425834 27838 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:05.430401 28161 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:05.431559 28097 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:05.382925 27966 raft_consensus.cc:2749] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:05.433156 22449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 2331) took 1716 ms. Trace:
I20260709 12:12:05.438040 28066 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:05.351114 28246 consensus_queue.cc:237] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:05.461489 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:05.544909 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.462364 28015 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:05.463284 28208 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:05.169123 22349 catalog_manager.cc:5697] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 9 to 11, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 11 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:05.367112 28259 raft_consensus.cc:2804] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:05.473323 22421 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:05.342626 28262 consensus_queue.cc:1059] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.069s
I20260709 12:12:05.477721 22603 raft_consensus.cc:1275] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:12:05.548659 22422 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:12:05.480228 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.482924 22602 raft_consensus.cc:2468] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 13.
I20260709 12:12:05.450660 28235 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:05.500070 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:05.551559 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 78333.3us
I20260709 12:12:05.534711 22449 rpcz_store.cc:276] 0709 12:12:03.717147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:03.917826 (+200679us) service_pool.cc:224] Handling call
0709 12:12:03.918100 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:03.999347 (+ 81247us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:12:04.067699 (+ 68352us) log.cc:844] Serialized 14 byte log entry
0709 12:12:04.537052 (+469353us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:04.565221 (+ 28169us) log.cc:844] Serialized 26 byte log entry
0709 12:12:04.565487 (+   266us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:12:04.565524 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:05.008737 (+443213us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:12:05.432860 (+424123us) spinlock_profiling.cc:243] Waited 80.9 ms on lock 0x7b540037b254. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:05.432911 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:05.432953 (+    42us) raft_consensus.cc:1685] finished
0709 12:12:05.432965 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:05.433101 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":74807,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":77256,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":8757,"spinlock_wait_cycles":212697216,"thread_start_us":432719,"threads_started":3,"wal-append.queue_time_us":340281}
I20260709 12:12:05.553378 22421 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:05.497509 23118 rpcz_store.cc:276] 0709 12:12:04.058693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:04.074123 (+ 15430us) service_pool.cc:224] Handling call
0709 12:12:05.405729 (+1331606us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b54005f2654. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:05.405849 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":568244992}
W20260709 12:12:05.508319 22532 rpcz_store.cc:269] 0709 12:12:03.943607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:03.960184 (+ 16577us) service_pool.cc:224] Handling call
0709 12:12:05.424726 (+1464542us) spinlock_profiling.cc:243] Waited 961 ms on lock 0x7b54003f07d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:05.424861 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2210907520}
W20260709 12:12:05.493005 28050 consensus_meta.cc:287] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.908s	user 0.010s	sys 0.003s
I20260709 12:12:05.554955 28050 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:05.422478 28067 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:05.512295 22497 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:05.509487 28033 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.558843 28033 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:05.559707 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:05.560431 28067 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:05.560468 22449 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:05.560890 28033 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:05.561678 22597 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 15: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:05.564836 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:05.565547 22601 raft_consensus.cc:2393] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 13: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:05.566326 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:05.523406 28242 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.587814 23087 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:05.586549 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:05.593663 23125 raft_consensus.cc:1275] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:12:05.567588 22601 raft_consensus.cc:2376] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 16. Re-sending same reply.
I20260709 12:12:05.599884 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:05.600483 22601 raft_consensus.cc:3060] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:05.596407 22422 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:05.604147 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:05.604810 23125 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
I20260709 12:12:05.570210 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:05.606673 22603 raft_consensus.cc:2393] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 11: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
W20260709 12:12:05.610913 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 98679.8us
I20260709 12:12:05.501916 28268 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:05.507879 28181 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:05.615736 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:05.522274 27900 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:05.567109 28243 raft_consensus.cc:2749] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:05.586404 28208 raft_consensus.cc:2749] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:05.630179 28050 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:05.541116 28176 consensus_queue.cc:237] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:05.616912 22422 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:12:05.631960 28208 raft_consensus.cc:2804] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:05.632498 28208 raft_consensus.cc:697] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:05.633417 28208 consensus_queue.cc:237] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:05.634282 28277 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:05.634416 22601 raft_consensus.cc:2468] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 14.
I20260709 12:12:05.634733 28277 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:05.635160 28277 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:05.585177 28238 raft_consensus.cc:2804] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:12:05.631253 23123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 1293) took 1158 ms. Trace:
I20260709 12:12:05.600006 28259 raft_consensus.cc:697] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:05.639696 23123 rpcz_store.cc:276] 0709 12:12:04.465895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:04.480477 (+ 14582us) service_pool.cc:224] Handling call
0709 12:12:04.502836 (+ 22359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:04.533178 (+ 30342us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:05.624226 (+1091048us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b54006dfbd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:05.624436 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32117504}
I20260709 12:12:05.604629 27989 raft_consensus.cc:2749] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:05.647368 28198 consensus_queue.cc:1059] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:05.592952 28118 consensus_queue.cc:1059] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 12:12:05.648399 28235 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:05.648844 28118 raft_consensus.cc:3055] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:05.649217 28118 raft_consensus.cc:740] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:05.649946 28118 consensus_queue.cc:260] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:05.650266 22349 catalog_manager.cc:5697] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 7 to 10, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 10 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:05.655059 28280 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:05.660434 22422 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:05.602187 28179 consensus_queue.cc:1048] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 12:12:05.656745 28033 raft_consensus.cc:3055] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:05.626808 28250 raft_consensus.cc:2749] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:05.675407 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:05.545742 27400 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:05.641901 28238 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:05.708952 22453 raft_consensus.cc:1240] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 9. Current term is 10. Ops: []
I20260709 12:12:05.663774 28243 raft_consensus.cc:2804] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:05.620906 28242 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:05.718715 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:05.592685 27514 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:05.675036 28033 raft_consensus.cc:740] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
W20260709 12:12:05.723094 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 209900us
I20260709 12:12:05.689093 28238 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:05.747821 22600 raft_consensus.cc:1275] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:12:05.755113 28168 consensus_queue.cc:1048] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:05.768038 22496 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:05.675238 28167 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:05.675386 28280 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:05.723023 28243 raft_consensus.cc:697] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 14 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:05.721976 27989 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:05.776609 27523 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:05.791494 27523 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:05.793103 27778 raft_consensus.cc:2749] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 19. Current term is 20.
I20260709 12:12:05.793995 27523 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:05.798476 22452 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
W20260709 12:12:05.799542 28273 log.cc:927] Time spent T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 12:12:05.799216 28033 consensus_queue.cc:260] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:05.800760 28033 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:05.770675 28245 consensus_queue.cc:1048] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
W20260709 12:12:05.773475 28178 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.897s	user 0.022s	sys 0.021s
I20260709 12:12:05.787365 27989 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:05.803319 27989 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:05.788336 27838 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:05.788441 27900 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:05.804457 28167 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:05.804961 28178 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.929s	user 0.022s	sys 0.021s
I20260709 12:12:05.806164 28242 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:05.806774 28178 raft_consensus.cc:3055] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:05.785590 28262 raft_consensus.cc:2749] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:05.806960 22600 raft_consensus.cc:1275] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:12:05.808333 22604 raft_consensus.cc:1240] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:05.852471 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:12:05.884979 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 289383us
I20260709 12:12:05.887799 22600 raft_consensus.cc:1275] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:12:05.849272 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:05.889573 22421 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:05.855266 22449 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 15.
I20260709 12:12:05.811406 22496 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:12:05.893994 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 82690.2us
W20260709 12:12:05.816378 28278 log.cc:927] Time spent T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:12:05.896385 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:05.898890 22421 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:05.900300 22528 raft_consensus.cc:1240] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 14. Current term is 15. Ops: []
W20260709 12:12:05.896868 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 286548us
I20260709 12:12:05.807219 28178 raft_consensus.cc:740] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:05.901532 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:05.902359 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:05.906872 22525 raft_consensus.cc:1275] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 12:12:05.907289 22525 pending_rounds.cc:85] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting all ops after (but not including) 8
I20260709 12:12:05.907318 22524 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
I20260709 12:12:05.905866 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:05.885888 28182 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.909972 22528 raft_consensus.cc:2393] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 14: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:05.903936 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:05.828616 27514 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:05.907658 22525 pending_rounds.cc:107] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 12:12:05.842519 28280 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:05.832317 27400 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:05.810963 28268 leader_election.cc:290] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:05.831017 28238 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:12:05.893299 27838 consensus_queue.cc:1048] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 12:12:05.913501 28182 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:05.898994 28262 raft_consensus.cc:2804] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:05.914264 22526 raft_consensus.cc:1275] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:12:05.893512 28017 consensus_queue.cc:1059] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 12:12:05.916354 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:05.783569 28250 consensus_queue.cc:1048] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.124s
I20260709 12:12:05.936542 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:05.937162 22523 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:05.939025 28255 log.cc:927] Time spent T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.809s	user 0.005s	sys 0.000s
I20260709 12:12:05.932896 28015 raft_consensus.cc:2749] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:05.907927 27851 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:05.917085 28243 consensus_queue.cc:237] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:05.807116 28259 consensus_queue.cc:237] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:05.848312 28115 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:05.921236 28277 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:05.924820 22525 raft_consensus.cc:2889] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:05.927925 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:05.960325 22524 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 15: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:05.926106 22532 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 16.
I20260709 12:12:05.927043 23087 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:05.812119 28168 consensus_queue.cc:1048] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.095s
I20260709 12:12:05.901576 28237 raft_consensus.cc:2749] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:05.930119 22421 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:05.932225 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:05.915284 28239 consensus_meta.cc:287] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.697s	user 0.008s	sys 0.003s
I20260709 12:12:05.934428 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:05.970083 22453 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 16.
I20260709 12:12:05.935223 28262 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:05.985363 28238 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:05.987308 28182 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:05.981420 28239 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:05.989853 28115 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:05.990082 28239 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:05.990571 22603 raft_consensus.cc:1240] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:05.971179 27900 raft_consensus.cc:2749] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:05.991439 28262 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:05.981204 27989 consensus_queue.cc:1048] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 12:12:05.997305 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:06.007211 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:05.927903 28180 consensus_queue.cc:1059] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 12:12:06.016390 22603 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:06.019090 22529 raft_consensus.cc:2393] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 20: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:06.019294 22453 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 15: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:05.996343 28277 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:06.025445 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 95401.5us
I20260709 12:12:05.966403 23087 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:06.033022 22525 raft_consensus.cc:1275] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:12:06.040839 22523 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 15.
I20260709 12:12:06.046849 22523 raft_consensus.cc:1240] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 LEADER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 14. Current term is 15. Ops: []
W20260709 12:12:06.080768 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 114458us
I20260709 12:12:06.033571 22531 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 20.
I20260709 12:12:06.048594 22603 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 10.
I20260709 12:12:06.031013 28268 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.081290 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:05.807550 22349 catalog_manager.cc:5697] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 7 to 10, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 10 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:12:06.085108 22422 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:06.085924 22451 raft_consensus.cc:1275] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:12:06.031270 28017 raft_consensus.cc:2749] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:12:06.103158 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:06.103999 22454 raft_consensus.cc:2393] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 12: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:06.105225 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:06.080176 22453 raft_consensus.cc:1240] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:05.970912 28178 consensus_queue.cc:260] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:06.036850 28208 consensus_queue.cc:1059] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 12:12:06.105612 28268 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:06.109865 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:06.137036 22603 raft_consensus.cc:2393] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 10: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:06.112560 22454 raft_consensus.cc:1275] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:12:06.117904 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:06.139140 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 51394.8us
I20260709 12:12:06.130429 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:06.135183 22453 raft_consensus.cc:1275] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:12:06.119038 22597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45576 (request call id 3186) took 1211 ms. Trace:
I20260709 12:12:06.111718 22449 raft_consensus.cc:1240] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:06.115351 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:06.117231 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:06.144768 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:06.145301 22601 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
I20260709 12:12:06.146368 22601 raft_consensus.cc:1275] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:12:06.146621 22570 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:06.141853 22597 rpcz_store.cc:276] 0709 12:12:04.907462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:04.907627 (+   165us) service_pool.cc:224] Handling call
0709 12:12:06.118831 (+1211204us) spinlock_profiling.cc:243] Waited 651 ms on lock 0x7b54000eae54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:06.118963 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1497205120}
W20260709 12:12:06.147949 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:06.148643 22601 raft_consensus.cc:1275] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:06.149194 22597 raft_consensus.cc:1275] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:12:06.152390 22597 raft_consensus.cc:1275] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:12:06.154199 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:12:06.156744 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:06.157608 22570 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:06.158154 23087 leader_election.cc:400] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 election: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 13. Current term is 14.
I20260709 12:12:06.159754 22570 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:06.110623 28118 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:06.183033 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:06.129925 28268 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:06.133692 27838 raft_consensus.cc:2804] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:12:06.125020 28178 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:06.108677 28297 raft_consensus.cc:2749] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:06.147603 27523 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:06.156549 27879 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.147563 28280 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:06.188589 28198 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.154876 28235 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.155069 27900 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.184412 28239 raft_consensus.cc:2804] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:12:06.202343 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 46190.1us
I20260709 12:12:06.188673 27514 raft_consensus.cc:2804] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:06.203661 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:06.156070 28272 consensus_queue.cc:1048] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:12:06.154330 28180 consensus_queue.cc:1048] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 12:12:06.207222 28017 consensus_queue.cc:1048] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:06.211221 27838 raft_consensus.cc:697] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
W20260709 12:12:06.200399 28068 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.985s	user 0.027s	sys 0.021s
I20260709 12:12:06.200362 27523 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:06.134560 22349 catalog_manager.cc:5697] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 10 to 13, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 13 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:06.220077 28280 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:06.199177 28238 raft_consensus.cc:3055] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:06.126026 28293 consensus_queue.cc:1059] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.075s
I20260709 12:12:06.197507 28252 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:06.227927 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:06.238795 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 79306.9us
I20260709 12:12:06.202877 27879 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:06.258059 28068 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.051s	user 0.028s	sys 0.021s
I20260709 12:12:06.244294 28239 raft_consensus.cc:697] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:06.233583 28235 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:06.231132 28198 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:06.234880 27900 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:06.262013 27514 raft_consensus.cc:697] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:06.338588 22449 raft_consensus.cc:1275] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:12:06.323616 28182 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.264433 28238 raft_consensus.cc:740] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
W20260709 12:12:06.340090 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 175476us
I20260709 12:12:06.330123 27851 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.265096 28179 consensus_queue.cc:1048] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.080s
I20260709 12:12:06.359284 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:06.361975 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:06.335083 28279 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:06.361294 22569 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:06.367522 22448 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
I20260709 12:12:06.338867 28252 raft_consensus.cc:697] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 20 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:06.380281 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:06.388722 28262 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:06.390174 22528 raft_consensus.cc:1240] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:06.395080 28272 raft_consensus.cc:2804] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:06.395550 28272 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:06.396044 28272 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:06.395583 28239 consensus_queue.cc:237] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:06.370014 27851 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:06.398660 27851 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:06.351588 28297 consensus_queue.cc:1059] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 12:12:06.404950 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:06.405825 22523 raft_consensus.cc:2393] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 10: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:06.406679 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:06.414287 22523 raft_consensus.cc:2368] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 19. Current term is 20.
I20260709 12:12:06.415830 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:06.410872 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:06.418025 22421 leader_election.cc:400] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 election: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 19. Current term is 20.
I20260709 12:12:06.418435 22421 leader_election.cc:403] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:12:06.419528 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:06.363134 28182 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:06.413872 28301 log.cc:927] Time spent T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:12:06.371615 28050 consensus_queue.cc:1048] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:12:06.424593 22421 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:06.376605 28279 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:06.461750 22523 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:06.461046 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 83136.6us
I20260709 12:12:06.413389 28293 raft_consensus.cc:3055] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:06.467248 22421 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:12:06.467767 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 108552us
W20260709 12:12:06.463286 28304 log.cc:927] Time spent T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.205s	user 0.000s	sys 0.003s
I20260709 12:12:06.472757 28293 raft_consensus.cc:740] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:06.480832 22497 leader_election.cc:304] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:06.482537 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:06.486240 22527 raft_consensus.cc:2410] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:12:06.449923 28017 raft_consensus.cc:2749] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 19. Current term is 20.
W20260709 12:12:06.468344 28305 log.cc:927] Time spent T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.122s	user 0.002s	sys 0.000s
W20260709 12:12:06.488994 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 163461us
I20260709 12:12:06.491163 23087 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:06.468127 28029 raft_consensus.cc:2749] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:12:06.497179 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:06.407622 27838 consensus_queue.cc:237] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:12:06.413659 28238 consensus_queue.cc:260] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:06.485600 28259 raft_consensus.cc:2749] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:06.398885 22349 catalog_manager.cc:5697] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 8 to 13, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 13 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:06.518941 22523 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 16.
I20260709 12:12:06.524678 22527 raft_consensus.cc:1240] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:12:06.521541 22570 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:06.439291 27514 consensus_queue.cc:237] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:06.543354 28238 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:06.466699 28252 consensus_queue.cc:237] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:06.547958 22523 raft_consensus.cc:1240] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:06.548056 22529 raft_consensus.cc:1240] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 LEADER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:06.550820 22529 raft_consensus.cc:1240] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:06.533761 28067 raft_consensus.cc:2804] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:06.527226 27523 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:06.536643 27879 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:12:06.559616 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 59469.4us
I20260709 12:12:06.523001 28268 consensus_queue.cc:1048] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 12:12:06.540374 28198 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:06.584758 23087 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:06.561997 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 80376us
W20260709 12:12:06.592471 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 111727us
I20260709 12:12:06.554795 28067 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:06.558817 28280 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:06.605516 28310 log.cc:927] Time spent T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:12:06.607653 22349 catalog_manager.cc:5697] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 4 to 10, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 10 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:06.608722 28181 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:06.609263 28312 log.cc:927] Time spent T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 12:12:06.609761 22349 catalog_manager.cc:5697] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: config changed from index -1 to 5, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New cstate: current_term: 6 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:06.588078 28311 consensus_queue.cc:1059] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:12:06.595016 23087 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:06.620402 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 151532us
I20260709 12:12:06.614084 28279 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:06.560503 28208 consensus_queue.cc:1059] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 12:12:06.600953 28235 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:06.601223 28067 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:06.622637 22569 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:06.534727 28293 consensus_queue.cc:260] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:06.589717 28313 raft_consensus.cc:2749] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:06.633349 28198 raft_consensus.cc:2749] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:06.641196 28319 consensus_queue.cc:1048] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:06.642576 28293 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:06.643451 28182 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:06.595032 28325 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:06.602425 28262 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:06.647802 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 91620us
W20260709 12:12:06.635339 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 46097.4us
I20260709 12:12:06.595312 28322 raft_consensus.cc:2749] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:12:06.653466 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:06.654708 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:06.657559 22455 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 15.
I20260709 12:12:06.592502 27523 consensus_queue.cc:1048] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.042s
W20260709 12:12:06.590042 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 68595.2us
I20260709 12:12:06.661657 22495 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:06.649995 28208 consensus_queue.cc:1243] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer 1676e7af5e4a47cb86ee7db83e3d4881 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:12:06.667275 22495 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:06.669417 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 75492.1us
I20260709 12:12:06.672067 22448 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 16.
W20260709 12:12:06.675535 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:06.674463 22570 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:06.635952 28181 consensus_queue.cc:1059] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 12:12:06.661170 28118 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:06.662774 28179 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:06.647496 28067 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:06.673185 28326 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.675094 28235 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:06.675411 28279 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:06.703169 22495 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:06.703622 28338 consensus_queue.cc:1048] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:06.683681 28318 raft_consensus.cc:3055] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:12:06.691496 28182 raft_consensus.cc:2804] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:06.677929 28208 consensus_queue.cc:1059] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:12:06.701406 28235 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:06.716771 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 65976us
W20260709 12:12:06.724292 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:06.713579 28333 raft_consensus.cc:3055] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:06.711228 28318 raft_consensus.cc:740] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:06.701375 28118 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:06.716908 28182 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:06.719269 28235 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:06.740448 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:06.741189 22495 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:06.716419 28311 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
W20260709 12:12:06.742206 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:06.701745 28179 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:06.711220 28268 consensus_queue.cc:1048] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 12:12:06.718539 28279 raft_consensus.cc:2749] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:06.754112 28279 consensus_queue.cc:1048] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:06.755074 28334 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.746021 22454 raft_consensus.cc:2468] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 12.
I20260709 12:12:06.759394 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:06.760244 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:06.742275 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:06.761027 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:06.761210 22456 raft_consensus.cc:2468] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 12.
W20260709 12:12:06.736349 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 60915us
I20260709 12:12:06.737221 28333 raft_consensus.cc:740] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:06.762120 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:06.708729 28326 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:06.753333 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:06.758332 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:06.742883 28238 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.763841 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:06.767140 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:06.752684 28339 raft_consensus.cc:2749] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:06.765470 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:06.775933 22529 raft_consensus.cc:2468] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 12.
I20260709 12:12:06.744199 28182 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:06.769205 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 94832.1us
I20260709 12:12:06.774272 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:06.784498 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:06.785636 23117 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:06.776223 28238 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:06.790294 28238 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:06.776423 27523 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.794472 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:06.749647 28328 consensus_queue.cc:1048] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:12:06.798623 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:06.802664 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:06.807408 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:06.808089 22601 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 16.
I20260709 12:12:06.808768 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:06.809160 22601 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:06.810009 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:06.810837 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:06.791611 28181 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.814014 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:06.814487 23117 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
I20260709 12:12:06.816179 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:06.816813 23117 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
I20260709 12:12:06.791734 28313 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.819191 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:12:06.824029 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:06.824236 22570 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:06.823859 22349 catalog_manager.cc:5697] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 8 to 9, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 9 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:12:06.825934 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:12:06.808470 28321 log.cc:927] Time spent T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 12:12:06.791091 27523 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:06.820451 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:06.791482 28316 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:06.821601 23123 raft_consensus.cc:2468] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 12.
I20260709 12:12:06.791864 28210 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:06.826797 23116 raft_consensus.cc:1240] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 13 LEADER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 12:12:06.759330 28334 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:06.760185 28311 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:06.828224 22601 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 16.
I20260709 12:12:06.833436 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:06.853287 23121 raft_consensus.cc:2410] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:12:06.853904 23117 raft_consensus.cc:1240] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:06.834040 22598 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 15: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:06.836699 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:06.854894 23123 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 8 LEARNER]: Advancing to term 10
I20260709 12:12:06.855919 23124 raft_consensus.cc:1240] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:06.849946 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:06.850879 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:06.851341 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:12:06.848790 28178 consensus_meta.cc:287] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.654s	user 0.012s	sys 0.000s
I20260709 12:12:06.866034 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:06.867309 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:06.869030 22598 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 16.
I20260709 12:12:06.872041 23117 raft_consensus.cc:1275] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:12:06.873517 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:06.812207 28181 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:06.876231 23123 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 10 LEARNER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 10.
I20260709 12:12:06.876688 22525 raft_consensus.cc:1240] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 LEADER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:12:06.877054 23121 raft_consensus.cc:3055] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:06.880108 23121 raft_consensus.cc:740] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:06.881232 23117 raft_consensus.cc:1275] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:12:06.882068 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:06.853716 28325 raft_consensus.cc:697] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:06.881007 23121 consensus_queue.cc:260] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:06.894644 23119 raft_consensus.cc:1275] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 12:12:06.896464 23119 pending_rounds.cc:85] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270: Aborting all ops after (but not including) 12
I20260709 12:12:06.896607 23121 raft_consensus.cc:3060] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:06.896731 23119 pending_rounds.cc:107] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 12:12:06.897086 23119 raft_consensus.cc:2889] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:06.897773 23124 raft_consensus.cc:1275] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 12:12:06.898190 23124 pending_rounds.cc:85] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270: Aborting all ops after (but not including) 11
I20260709 12:12:06.898391 23124 pending_rounds.cc:107] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 12:12:06.898614 23124 raft_consensus.cc:2889] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:06.866425 28067 leader_election.cc:290] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:06.905709 22497 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:06.910735 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:06.857215 28210 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:06.917025 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:06.783352 28318 consensus_queue.cc:260] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:06.914024 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:06.923342 23117 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 13.
I20260709 12:12:06.924198 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:06.831548 28313 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:06.924863 23119 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 15: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
W20260709 12:12:06.927697 28332 log.cc:927] Time spent T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 12:12:06.927799 28017 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:06.928676 28313 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:06.928556 28017 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:06.929382 28335 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.929979 28335 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:06.934639 22455 raft_consensus.cc:1275] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:12:06.936172 28334 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:06.910991 28118 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:06.936779 23119 raft_consensus.cc:1275] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:06.938484 22421 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:06.852597 28316 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:06.968684 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 63066.1us
I20260709 12:12:06.965552 27838 raft_consensus.cc:2749] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:12:06.974795 28296 log.cc:927] Time spent T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.950s	user 0.003s	sys 0.000s
I20260709 12:12:06.975987 28235 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:06.976507 22457 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 2339) took 2204 ms. Trace:
I20260709 12:12:06.977437 22528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 2232) took 1073 ms. Trace:
I20260709 12:12:06.977916 22528 rpcz_store.cc:276] 0709 12:12:05.932542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:05.979259 (+ 46717us) service_pool.cc:224] Handling call
0709 12:12:05.979674 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:06.390581 (+410907us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:06.977225 (+586644us) spinlock_profiling.cc:243] Waited 410 ms on lock 0x7b54000d48d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:06.977385 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":943606016}
I20260709 12:12:06.816874 28333 consensus_queue.cc:260] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:06.979985 28347 log.cc:927] Time spent T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 12:12:06.980443 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:06.980556 28351 raft_consensus.cc:2804] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:06.981156 28351 raft_consensus.cc:697] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:06.983507 28325 consensus_queue.cc:237] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:06.835079 22349 catalog_manager.cc:5697] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 2 to 13. New cstate: current_term: 13 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:12:06.982115 28351 consensus_queue.cc:237] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:06.976945 22457 rpcz_store.cc:276] 0709 12:12:04.772262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:04.772378 (+   116us) service_pool.cc:224] Handling call
0709 12:12:04.772680 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:04.773013 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:04.773042 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:05.625016 (+851974us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b2c00033c98. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc9227a11 00007f9cc9237372 00007f9cca969a01 00007f9cca92e43a 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2
0709 12:12:05.625468 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 12:12:05.781193 (+155725us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:05.781233 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:05.781304 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:06.974100 (+1192796us) spinlock_profiling.cc:243] Waited 2.4 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:12:06.976280 (+  2180us) raft_consensus.cc:1685] finished
0709 12:12:06.976300 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:06.976422 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2872,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":9196,"spinlock_wait_cycles":10357248,"thread_start_us":149336,"threads_started":1,"wal-append.queue_time_us":303742}
I20260709 12:12:07.053741 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:07.054363 23119 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:07.010191 28333 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:06.966153 28179 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:07.058480 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:06.928834 28348 consensus_queue.cc:1059] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.134s
I20260709 12:12:07.061990 28348 consensus_queue.cc:1243] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer 1676e7af5e4a47cb86ee7db83e3d4881 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:12:07.062479 28181 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:07.062563 28348 consensus_queue.cc:1048] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:07.063095 28335 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:07.065230 28311 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:07.066349 28337 raft_consensus.cc:3055] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:07.066761 28337 raft_consensus.cc:740] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:07.067160 28326 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:07.067806 28349 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:07.067603 28337 consensus_queue.cc:260] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:07.068416 28349 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:07.069265 28309 log.cc:927] Time spent T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.674s	user 0.000s	sys 0.002s
I20260709 12:12:07.070638 28316 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:07.071281 28182 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:07.072083 28210 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:07.072633 27523 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:07.068940 28337 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:07.070847 28349 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:07.052423 28280 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:07.207523 22527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 2462) took 1063 ms. Trace:
I20260709 12:12:07.207713 23088 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:07.207996 22527 rpcz_store.cc:276] 0709 12:12:06.144423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.499606 (+355183us) service_pool.cc:224] Handling call
0709 12:12:06.523473 (+ 23867us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:06.530485 (+  7012us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:07.207320 (+676835us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b5400400bd0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:07.207467 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54055296}
I20260709 12:12:07.091434 28235 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:07.186602 23120 raft_consensus.cc:2410] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:12:07.187001 23119 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 16.
I20260709 12:12:07.236405 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:07.237039 23119 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:07.195781 28193 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:12:07.204336 22602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45576 (request call id 3187) took 2284 ms (client timeout 1813 ms). Trace:
W20260709 12:12:07.243685 22602 rpcz_store.cc:269] 0709 12:12:04.919826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:04.921669 (+  1843us) service_pool.cc:224] Handling call
0709 12:12:07.204067 (+2282398us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b540013c254. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:07.204219 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":405478784}
I20260709 12:12:07.205319 22597 raft_consensus.cc:1275] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:12:07.011409 28237 consensus_queue.cc:1059] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 12:12:07.209142 23089 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:07.210460 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:12:07.211899 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 386566us
I20260709 12:12:07.066238 27838 consensus_queue.cc:1059] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
W20260709 12:12:07.239230 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 232291us
I20260709 12:12:07.255872 22602 raft_consensus.cc:1240] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 14. Current term is 15. Ops: [14.14-14.14]
I20260709 12:12:07.257350 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:07.258529 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 49459.4us
I20260709 12:12:07.263622 22496 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:07.266621 22570 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:07.269413 22496 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:07.277904 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:07.237813 28347 log.cc:927] Time spent T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.147s	user 0.010s	sys 0.000s
I20260709 12:12:07.185654 27851 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:07.207686 28280 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:07.178607 28316 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.283666 22496 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:07.233779 28311 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.282807 22527 raft_consensus.cc:1240] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:12:07.347327 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:07.354738 23119 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 16.
I20260709 12:12:07.378031 22602 raft_consensus.cc:1240] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 12:12:07.238183 27523 raft_consensus.cc:2804] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:12:07.302526 28272 consensus_meta.cc:287] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.906s	user 0.015s	sys 0.000s
I20260709 12:12:07.238826 28349 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:07.386823 22449 raft_consensus.cc:1240] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 14 LEADER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 13. Current term is 14. Ops: []
W20260709 12:12:07.440073 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:07.387359 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 103767us
I20260709 12:12:07.418483 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:07.286303 28236 raft_consensus.cc:2749] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:07.442494 22496 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:07.237969 28181 consensus_queue.cc:1048] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 12:12:07.285643 28293 raft_consensus.cc:2804] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:07.306046 28280 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:07.300354 28235 raft_consensus.cc:2749] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:07.259068 28193 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:07.444723 22604 raft_consensus.cc:1240] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:07.445111 22450 raft_consensus.cc:3055] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:07.448165 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:07.480167 22450 raft_consensus.cc:740] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:07.365932 28237 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:07.453048 22496 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:07.482554 22496 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:07.420485 28340 raft_consensus.cc:2749] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:07.306262 27851 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:07.439523 27523 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:07.497752 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 227390us
W20260709 12:12:07.501180 22421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:07.460819 28293 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:07.386488 28353 consensus_queue.cc:1059] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.078s
I20260709 12:12:07.502697 22450 consensus_queue.cc:260] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:07.416383 28316 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:07.462378 27966 raft_consensus.cc:3055] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:07.527837 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:12:07.529047 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 111580us
I20260709 12:12:07.533855 22450 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:07.483402 28017 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:07.419279 28243 consensus_queue.cc:1048] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.086s
I20260709 12:12:07.512213 28210 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.505215 27523 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:07.510042 28325 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:07.459462 28349 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:07.455665 28311 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:07.534868 28236 raft_consensus.cc:2804] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:07.591742 28236 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:07.592290 28236 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:07.593242 28243 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:07.593879 28243 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:07.595887 28356 log.cc:927] Time spent T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.475s	user 0.000s	sys 0.001s
I20260709 12:12:07.558409 28210 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:07.559278 28288 log.cc:927] Time spent T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:12:07.560187 28323 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:07.560819 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:07.532691 28293 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:07.615445 22602 raft_consensus.cc:2468] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 13.
I20260709 12:12:07.531049 28362 raft_consensus.cc:2804] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:12:07.565436 28369 log.cc:927] Time spent T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:12:07.567133 28372 consensus_queue.cc:1048] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.105s
I20260709 12:12:07.542157 27966 raft_consensus.cc:740] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:07.576563 28193 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:07.577068 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:07.598460 28323 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:07.541311 28182 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:07.583361 28350 log.cc:927] Time spent T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.326s	user 0.001s	sys 0.000s
I20260709 12:12:07.585266 27851 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:07.448446 28272 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:07.585492 22605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2776) took 1647 ms. Trace:
W20260709 12:12:08.049824 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:07.586001 28365 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:07.591114 28324 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:08.052156 28365 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:07.495751 28237 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:08.054518 28365 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:08.054953 28237 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:07.603518 22601 raft_consensus.cc:1275] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:12:08.055825 22449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 1096) took 1316 ms. Trace:
I20260709 12:12:08.056207 22449 rpcz_store.cc:276] 0709 12:12:06.739720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.746996 (+  7276us) service_pool.cc:224] Handling call
0709 12:12:06.760637 (+ 13641us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:07.439233 (+678596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:08.055599 (+616366us) spinlock_profiling.cc:243] Waited 626 ms on lock 0x7b5400222c54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:08.055764 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1439693056}
I20260709 12:12:07.615608 22450 raft_consensus.cc:1275] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 12:12:07.611193 22497 leader_election.cc:304] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:08.057605 28208 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.057842 22450 pending_rounds.cc:85] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f: Aborting all ops after (but not including) 10
I20260709 12:12:08.058133 22450 pending_rounds.cc:107] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 12:12:08.058398 22450 raft_consensus.cc:2889] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:07.561790 28017 consensus_queue.cc:1048] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 12:12:07.543154 28346 raft_consensus.cc:2804] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:08.050024 22605 rpcz_store.cc:276] 0709 12:12:05.937885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:05.938018 (+   133us) service_pool.cc:224] Handling call
0709 12:12:05.938307 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:05.938664 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:05.938692 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:07.192525 (+1253833us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b2c000fd4f8. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc9227a11 00007f9cc9237372 00007f9cca969a01 00007f9cca92e43a 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2
0709 12:12:07.193029 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 12:12:07.490148 (+297119us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:07.490182 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:07.490258 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:07.585187 (+ 94929us) raft_consensus.cc:1685] finished
0709 12:12:07.585212 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:07.585432 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3429,"raft.run_cpu_time_us":64,"raft.run_wall_time_us":64,"spinlock_wait_cycles":50099584,"thread_start_us":296723,"threads_started":1,"wal-append.queue_time_us":347887}
I20260709 12:12:07.636700 23087 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:07.603960 27989 raft_consensus.cc:3055] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:07.598910 28210 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:07.605800 28349 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:07.639639 28381 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:08.098433 28272 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:07.640522 28243 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:08.098778 28381 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:08.099628 28243 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.100239 28243 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:07.607306 28371 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:08.102013 28371 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:07.604015 28311 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:08.104332 28311 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:08.104979 28311 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:07.648504 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:12:07.652603 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 170144us
W20260709 12:12:07.592303 28364 log.cc:927] Time spent T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 12:12:07.609158 28316 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:08.107848 22452 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 2347) took 2659 ms (client timeout 2014 ms). Trace:
I20260709 12:12:07.733328 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:12:08.108237 22452 rpcz_store.cc:269] 0709 12:12:05.448450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:05.450575 (+  2125us) service_pool.cc:224] Handling call
0709 12:12:08.107665 (+2657090us) spinlock_profiling.cc:243] Waited 347 ms on lock 0x7b5400199954. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:08.107758 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":798039296}
I20260709 12:12:08.048471 28193 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:07.738730 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:08.109404 23125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 1308) took 1316 ms. Trace:
I20260709 12:12:08.109211 28193 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:08.109781 23125 rpcz_store.cc:276] 0709 12:12:06.793037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.793223 (+   186us) service_pool.cc:224] Handling call
0709 12:12:06.793588 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:06.796960 (+  3372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:06.796992 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:06.812920 (+ 15928us) log.cc:844] Serialized 26 byte log entry
0709 12:12:07.052154 (+239234us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:07.052196 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:07.052272 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:08.109200 (+1056928us) raft_consensus.cc:1685] finished
0709 12:12:08.109219 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:08.109349 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1301,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":1788,"thread_start_us":196586,"threads_started":1,"wal-append.queue_time_us":407425}
I20260709 12:12:07.646157 27523 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:07.821682 23123 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.001s	sys 0.009s
W20260709 12:12:08.112973 23123 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.021s	user 0.001s	sys 0.009s
I20260709 12:12:08.113947 23123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 1314) took 1251 ms. Trace:
W20260709 12:12:07.822395 22456 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.005s	sys 0.005s
W20260709 12:12:08.115273 22456 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.876s	user 0.005s	sys 0.005s
W20260709 12:12:07.970481 22570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.005s	sys 0.012s
W20260709 12:12:08.116302 22570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.849s	user 0.005s	sys 0.012s
W20260709 12:12:07.970023 28085 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.012s	sys 0.000s
I20260709 12:12:08.178364 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:08.043385 28181 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.043329 28182 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:08.045644 28323 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:08.046321 22422 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:07.657158 28118 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.599398 28386 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:12:07.866237 22600 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.003s	sys 0.007s
I20260709 12:12:08.098371 27900 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:07.634522 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:08.067955 23124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 1315) took 1184 ms. Trace:
I20260709 12:12:08.087303 27966 consensus_queue.cc:260] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:08.215749 23124 rpcz_store.cc:276] 0709 12:12:06.883452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.911768 (+ 28316us) service_pool.cc:224] Handling call
0709 12:12:06.915554 (+  3786us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:06.915949 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:06.915983 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:06.916526 (+   543us) log.cc:844] Serialized 26 byte log entry
0709 12:12:07.185021 (+268495us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:07.185072 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:07.185158 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:08.067732 (+882574us) raft_consensus.cc:1685] finished
0709 12:12:08.067750 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:08.067894 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":866,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":5297,"thread_start_us":180207,"threads_started":1,"wal-append.queue_time_us":486325}
I20260709 12:12:08.088578 28370 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.067085 27989 raft_consensus.cc:740] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:08.058845 28286 raft_consensus.cc:2804] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:08.058130 28208 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:08.092301 28017 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:08.173573 23117 raft_consensus.cc:1275] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:12:08.175302 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 538676us
W20260709 12:12:08.175696 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 909132us
I20260709 12:12:08.234421 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:08.066145 28337 consensus_meta.cc:287] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.970s	user 0.011s	sys 0.009s
W20260709 12:12:08.197345 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 504061us
I20260709 12:12:08.239617 22530 raft_consensus.cc:1275] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:12:08.240036 22530 pending_rounds.cc:85] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting all ops after (but not including) 6
W20260709 12:12:08.240244 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:08.198524 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:08.117559 28346 raft_consensus.cc:697] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
W20260709 12:12:08.177798 28085 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.014s	sys 0.001s
I20260709 12:12:08.068631 28362 raft_consensus.cc:697] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:08.206604 22603 raft_consensus.cc:1240] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 16. Current term is 17. Ops: []
W20260709 12:12:08.058123 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 447026us
W20260709 12:12:08.207326 22600 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.116s	user 0.006s	sys 0.009s
I20260709 12:12:08.201937 28182 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:08.215786 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:08.188674 28236 consensus_meta.cc:287] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.596s	user 0.011s	sys 0.006s
I20260709 12:12:08.087285 28179 raft_consensus.cc:2804] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:08.234702 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:08.240293 22530 pending_rounds.cc:107] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 8.7
I20260709 12:12:08.212265 28118 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:08.283741 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 48841.8us
I20260709 12:12:08.286466 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:08.254009 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:08.289884 22530 raft_consensus.cc:2917] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Aborting config change with OpId 8.7: Aborted: Op aborted by new leader
I20260709 12:12:08.291889 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:08.302139 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:08.304929 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:08.309561 22530 raft_consensus.cc:2889] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:08.240471 28372 raft_consensus.cc:2804] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:08.310202 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:08.316699 23124 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 17.
I20260709 12:12:08.311051 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:08.309486 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:08.311077 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:08.309515 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:08.242587 28266 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.219692 28386 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:08.231035 28370 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:08.243438 28017 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:08.285007 27523 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:08.309989 28236 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:08.252697 28286 raft_consensus.cc:697] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:08.306046 28179 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:08.197183 28181 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:08.239845 28340 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:08.328608 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:08.318650 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:08.376847 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:08.325843 22530 raft_consensus.cc:1275] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:08.351182 22528 raft_consensus.cc:1240] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:08.344277 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:08.413442 22524 raft_consensus.cc:2393] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 15: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:08.284765 28337 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.310084 27966 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:08.427960 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 185834us
W20260709 12:12:08.372712 28280 consensus_meta.cc:287] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.877s	user 0.020s	sys 0.012s
I20260709 12:12:08.316444 28372 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:08.312274 28210 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:08.335527 28115 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:12:08.374317 28333 consensus_meta.cc:287] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 1.313s	user 0.008s	sys 0.021s
W20260709 12:12:08.375656 28293 consensus_meta.cc:287] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.740s	user 0.022s	sys 0.020s
I20260709 12:12:08.350368 28179 raft_consensus.cc:3060] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:08.338905 28193 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:08.330086 28208 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:08.326515 28182 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:08.341629 28243 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:08.403497 27523 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.343905 28017 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:08.348743 28236 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:08.372999 28181 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:08.378118 28316 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.373793 28311 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:08.476642 23116 raft_consensus.cc:2410] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 12:12:08.341205 28370 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:08.345969 28388 consensus_queue.cc:1048] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.114s
I20260709 12:12:08.399801 28340 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:08.454627 28372 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:08.338284 28386 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:08.458880 22524 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "272afea078f74bf19baefd3c1300644d"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:46680
I20260709 12:12:08.575837 22524 raft_consensus.cc:606] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:12:08.576195 22524 raft_consensus.cc:614] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:08.515159 22602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2788) took 1030 ms. Trace:
I20260709 12:12:08.515540 28316 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:08.320415 28389 consensus_queue.cc:1048] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.169s
W20260709 12:12:08.516628 28239 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.118s	user 0.013s	sys 0.032s
I20260709 12:12:08.516799 28085 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:08.343251 28381 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:08.431115 28337 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:08.510502 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 47511.5us
I20260709 12:12:08.469790 28115 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:08.376281 28362 consensus_queue.cc:237] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:08.476765 28293 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:08.531471 28371 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:08.533918 28306 raft_consensus.cc:3055] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:08.495947 28407 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:08.535207 22599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3232) took 1636 ms. Trace:
I20260709 12:12:08.613817 23124 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:08.471799 28374 consensus_queue.cc:1059] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 12:12:08.496495 28208 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.623234 28208 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:08.349756 28286 consensus_queue.cc:237] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:08.545118 22531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 1135) took 2527 ms. Trace:
I20260709 12:12:08.626861 22531 rpcz_store.cc:276] 0709 12:12:06.017869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.083996 (+ 66127us) service_pool.cc:224] Handling call
0709 12:12:06.084427 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:06.106604 (+ 22177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:06.106634 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:06.141035 (+ 34401us) log.cc:844] Serialized 26 byte log entry
0709 12:12:06.261165 (+120130us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:06.261205 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:06.261275 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:07.068567 (+807292us) spinlock_profiling.cc:243] Waited 4.02 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:12:08.543303 (+1474736us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b240029b958. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc76c79c4 00007f9cc76c5acb 00007f9cc7880dc9 00007f9cc7880a55 00007f9cc787ffb0 00007f9cca4f6488 00007f9cca4f6be8 00007f9cca4ce398 00007f9cca4c976a 00007f9cca4c8bb6
0709 12:12:08.544832 (+  1529us) raft_consensus.cc:1685] finished
0709 12:12:08.544856 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:08.545032 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19756,"raft.queue_time_us":22176,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":22623,"spinlock_wait_cycles":61138048,"thread_start_us":58770,"threads_started":1,"wal-append.queue_time_us":145334}
W20260709 12:12:08.545938 28250 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 12:12:08.548040 22453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 1092) took 2435 ms. Trace:
I20260709 12:12:08.496464 27523 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:08.559574 28299 log.cc:927] Time spent T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 2.331s	user 0.000s	sys 0.008s
W20260709 12:12:08.563198 28367 log.cc:927] Time spent T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 1.128s	user 0.000s	sys 0.001s
I20260709 12:12:08.427403 27989 consensus_queue.cc:260] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:08.651999 27989 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:08.326126 28266 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:08.652590 28316 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:08.654227 28266 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:08.114384 23123 rpcz_store.cc:276] 0709 12:12:06.862250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.885145 (+ 22895us) service_pool.cc:224] Handling call
0709 12:12:06.885471 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:06.885729 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:12:07.091784 (+206055us) log.cc:844] Serialized 14 byte log entry
0709 12:12:08.113514 (+1021730us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:08.113582 (+    68us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:08.113653 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:08.113740 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:08.113879 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16732,"prepare.queue_time_us":393662,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":41990,"raft.queue_time_us":4497,"thread_start_us":1199971,"threads_started":2}
I20260709 12:12:08.655333 23122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 1309) took 1857 ms. Trace:
I20260709 12:12:08.570904 28067 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.656000 28067 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:08.658380 28067 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:08.571755 22523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 2463) took 2427 ms. Trace:
I20260709 12:12:08.658915 22523 rpcz_store.cc:276] 0709 12:12:06.144576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.530764 (+386188us) service_pool.cc:224] Handling call
0709 12:12:06.547432 (+ 16668us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:06.548692 (+  1260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:08.571509 (+2022817us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b54000d39d0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:08.571683 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37316352}
I20260709 12:12:08.572039 22455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2972) took 1815 ms. Trace:
I20260709 12:12:08.494722 28323 consensus_queue.cc:1048] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 12:12:08.660211 22603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2784) took 1421 ms. Trace:
I20260709 12:12:08.660583 22603 rpcz_store.cc:276] 0709 12:12:07.238578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.059836 (+821258us) service_pool.cc:224] Handling call
0709 12:12:08.060109 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:08.288921 (+228812us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:08.659998 (+371077us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b5400449654. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:08.660155 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":336445696}
I20260709 12:12:08.493415 28193 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:08.661316 22527 raft_consensus.cc:1275] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:08.661662 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:08.661687 28193 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:08.576689 22602 rpcz_store.cc:276] 0709 12:12:07.485240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.111571 (+626331us) service_pool.cc:224] Handling call
0709 12:12:08.174689 (+ 63118us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:08.174972 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:08.429198 (+254226us) log.cc:844] Serialized 14 byte log entry
0709 12:12:08.514660 (+ 85462us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:08.514728 (+    68us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:08.514800 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:08.514898 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:08.515090 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17238,"prepare.queue_time_us":322870,"raft.queue_time_us":17440,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":124,"thread_start_us":290331,"threads_started":2}
I20260709 12:12:08.467401 28210 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:08.584533 28239 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.186s	user 0.014s	sys 0.033s
W20260709 12:12:08.580652 28324 consensus_meta.cc:287] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.528s	user 0.012s	sys 0.004s
I20260709 12:12:08.664901 28324 raft_consensus.cc:2749] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:08.523694 28243 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:08.666499 27838 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:08.667168 28210 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:08.659946 22455 rpcz_store.cc:276] 0709 12:12:06.756508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.907457 (+150949us) service_pool.cc:224] Handling call
0709 12:12:06.921869 (+ 14412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:06.935021 (+ 13152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:08.571816 (+1636795us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b540037a354. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:08.571982 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28527488}
I20260709 12:12:08.600229 22570 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:08.668942 28324 raft_consensus.cc:2749] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:12:08.669108 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 68986.6us
I20260709 12:12:08.670202 27838 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:08.604137 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 178442us
I20260709 12:12:08.525522 28181 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:08.617977 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:08.613638 22599 rpcz_store.cc:276] 0709 12:12:06.898524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:07.449808 (+551284us) service_pool.cc:224] Handling call
0709 12:12:07.450362 (+   554us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:08.043916 (+593554us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:08.043951 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:08.044013 (+    62us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:08.044051 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:08.534929 (+490878us) spinlock_profiling.cc:243] Waited 593 ms on lock 0x7b540013c754. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:08.535000 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:08.535147 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1364646784}
I20260709 12:12:08.683447 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:08.631246 23119 raft_consensus.cc:2393] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 17: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:08.655676 23122 rpcz_store.cc:276] 0709 12:12:06.797656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.801337 (+  3681us) service_pool.cc:224] Handling call
0709 12:12:06.815904 (+ 14567us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:06.816218 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:06.816243 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:06.828015 (+ 11772us) log.cc:844] Serialized 26 byte log entry
0709 12:12:07.052724 (+224709us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:07.052770 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:07.052863 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:08.562038 (+1509175us) spinlock_profiling.cc:243] Waited 7.68 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:12:08.655059 (+ 93021us) raft_consensus.cc:1685] finished
0709 12:12:08.655078 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:08.655276 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2372,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":10206,"spinlock_wait_cycles":17655552,"thread_start_us":185678,"threads_started":1,"wal-append.queue_time_us":399121}
I20260709 12:12:08.687104 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:08.687736 22449 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 14.
I20260709 12:12:08.689257 22599 raft_consensus.cc:2410] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
W20260709 12:12:08.621996 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 155209us
I20260709 12:12:08.630597 22453 rpcz_store.cc:276] 0709 12:12:06.112886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.117117 (+  4231us) service_pool.cc:224] Handling call
0709 12:12:06.117404 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:06.141812 (+ 24408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:08.547747 (+2405935us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b54003cad54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:08.547966 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40098048}
I20260709 12:12:08.477667 28346 consensus_queue.cc:237] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:08.452626 28280 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:08.666908 28243 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:08.670290 22570 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:08.599756 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:08.603933 22530 raft_consensus.cc:1275] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:12:08.673822 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:08.674311 22450 raft_consensus.cc:1240] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:08.674852 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:08.675148 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:08.697506 22448 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:08.676842 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:08.678123 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:08.695017 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:08.698900 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:08.696293 22452 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 17.
I20260709 12:12:08.678742 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:08.701876 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:08.703070 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:08.703727 22523 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 16.
I20260709 12:12:08.614029 28306 raft_consensus.cc:740] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:08.595927 28085 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:08.683846 22603 raft_consensus.cc:1275] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:12:08.713176 22603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2790) took 1163 ms. Trace:
I20260709 12:12:08.713531 22603 rpcz_store.cc:276] 0709 12:12:07.549686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.662721 (+1113035us) service_pool.cc:224] Handling call
0709 12:12:08.662970 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:08.712914 (+ 49944us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:08.713122 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:08.686832 28348 consensus_queue.cc:1048] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:12:08.693420 22455 pending_rounds.cc:85] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f: Aborting all ops after (but not including) 11
I20260709 12:12:08.693715 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:08.719350 22455 pending_rounds.cc:107] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 12:12:08.719642 22455 raft_consensus.cc:2889] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:08.719838 22532 raft_consensus.cc:2410] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 12:12:08.693878 28250 consensus_queue.cc:1059] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:08.715516 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:08.724520 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:08.694351 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:08.629940 28386 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.709367 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:08.709321 22570 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:08.695299 23117 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 16.
I20260709 12:12:08.716280 22527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:46680
I20260709 12:12:08.717499 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:08.723384 22603 raft_consensus.cc:1275] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:12:08.652676 28208 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:08.724779 22524 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 14.
I20260709 12:12:08.789882 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:08.799358 22529 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 17.
I20260709 12:12:08.801973 28409 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:08.802451 22421 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:08.803668 22421 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
W20260709 12:12:08.795766 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 86541.4us
I20260709 12:12:08.794624 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:08.807734 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:08.806710 22570 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:08.693444 28293 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:08.796582 28029 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:08.684702 28193 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:08.804631 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:08.817562 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:08.795663 22527 raft_consensus.cc:606] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:12:08.688722 28323 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:08.811118 23087 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:08.813162 22570 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:08.820013 22527 raft_consensus.cc:614] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:08.794991 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:08.821164 22570 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:08.815640 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:08.821542 22421 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:08.721864 28324 raft_consensus.cc:2749] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:08.821486 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:08.822353 23117 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 14.
I20260709 12:12:08.780752 22448 raft_consensus.cc:2468] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 13.
I20260709 12:12:08.715919 28180 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.841840 22570 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:08.790674 28268 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:08.790216 28118 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:08.696043 28381 consensus_queue.cc:1059] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.119s
I20260709 12:12:08.696293 28181 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:08.898895 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:08.834118 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:08.724231 28398 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:12:08.900890 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 59154.4us
I20260709 12:12:08.901005 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:08.797735 28250 consensus_queue.cc:1243] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer 1676e7af5e4a47cb86ee7db83e3d4881 log is divergent from this leader: its last log entry 18.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:12:08.840698 23087 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:08.828148 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:08.725179 28239 consensus_queue.cc:1048] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.109s
I20260709 12:12:08.716867 28210 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:08.809774 28371 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.797400 28339 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:08.625566 28407 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:08.823906 22421 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:08.804549 28066 consensus_queue.cc:1048] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.206s
W20260709 12:12:08.925061 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:08.806757 28386 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:09.011350 23088 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 1.544s (SENT) [suppressed 6 similar messages]
I20260709 12:12:09.076205 23124 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 9.
I20260709 12:12:08.804858 27851 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:08.908728 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:09.096221 22599 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 13.
I20260709 12:12:08.814388 28348 raft_consensus.cc:2749] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:09.140683 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 300062us
W20260709 12:12:09.233909 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 410074us
I20260709 12:12:09.236485 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:09.236685 22421 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:09.237475 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:08.825778 28208 raft_consensus.cc:2749] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:09.238325 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:08.809958 28017 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:12:09.231822 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 156335us
I20260709 12:12:08.816978 28403 raft_consensus.cc:2749] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:08.901940 28252 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.082s	user 0.031s	sys 0.008s
I20260709 12:12:08.828547 28176 raft_consensus.cc:2749] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:09.225461 28238 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.217s	user 0.017s	sys 0.050s
W20260709 12:12:09.224658 27966 consensus_meta.cc:287] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.784s	user 0.005s	sys 0.006s
I20260709 12:12:09.229799 28406 raft_consensus.cc:2804] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:09.069249 28413 raft_consensus.cc:2804] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:09.024432 28293 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.263320 22454 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 19.
I20260709 12:12:08.909283 28351 raft_consensus.cc:2749] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:08.802603 28409 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:09.231669 28250 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.230962 28193 raft_consensus.cc:3055] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:08.828069 28029 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:09.010607 28297 consensus_queue.cc:1048] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.271s
I20260709 12:12:08.915498 28306 consensus_queue.cc:260] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:08.903913 28370 consensus_queue.cc:1048] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.361s
I20260709 12:12:08.900411 28323 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:09.252442 28412 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.004298 28268 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:09.252537 28381 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:12:09.270603 22602 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.036s	sys 0.042s
I20260709 12:12:09.275512 22570 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:08.909740 28180 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:09.297794 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.298007 22448 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 17.
W20260709 12:12:09.284920 22455 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.019s	sys 0.021s
I20260709 12:12:09.225710 28210 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:09.277181 28252 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.458s	user 0.031s	sys 0.008s
W20260709 12:12:09.277302 28238 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.400s	user 0.017s	sys 0.051s
W20260709 12:12:09.278749 28404 log.cc:927] Time spent T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.482s	user 0.000s	sys 0.001s
W20260709 12:12:09.279876 28286 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.022s	sys 0.056s
I20260709 12:12:09.225616 28371 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:09.308137 28348 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:09.335101 22602 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.036s	sys 0.042s
W20260709 12:12:09.335335 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 59888.9us
W20260709 12:12:09.271067 28388 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.139s	sys 0.171s
I20260709 12:12:09.312636 28293 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:09.298506 28413 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:09.315026 27966 raft_consensus.cc:2749] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:09.354558 28286 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.022s	sys 0.056s
I20260709 12:12:09.335418 28333 consensus_queue.cc:1059] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 12:12:09.339116 28381 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:09.320426 28193 raft_consensus.cc:740] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:09.381955 28193 consensus_queue.cc:260] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:09.376134 28085 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:09.291915 28406 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:09.383734 28406 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:09.384212 28409 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:09.225680 28339 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:09.389225 28339 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:09.375883 28413 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:09.370944 28388 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.139s	sys 0.171s
I20260709 12:12:09.276942 28017 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:09.342882 22455 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.020s	sys 0.022s
I20260709 12:12:09.344897 28050 raft_consensus.cc:2804] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:09.323983 28250 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:09.381102 28381 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:09.332178 28340 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:09.410722 28268 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:09.366605 28317 raft_consensus.cc:2749] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:09.345908 28412 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:09.400359 28050 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:09.348348 23122 raft_consensus.cc:1275] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 10 LEARNER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:12:09.370244 27523 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:09.375747 28411 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.398967 28193 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:09.368870 28348 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:09.437873 28348 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:09.270133 28398 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:09.420611 28407 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:09.590276 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.492941 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:09.598812 23122 raft_consensus.cc:2410] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:12:09.440932 22422 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:09.427551 28050 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:09.613201 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:09.613863 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 173013us
W20260709 12:12:09.450889 28397 log.cc:927] Time spent T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.919s	user 0.000s	sys 0.017s
W20260709 12:12:09.557770 28179 consensus_meta.cc:287] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 1.070s	user 0.009s	sys 0.002s
I20260709 12:12:09.582633 27966 raft_consensus.cc:3055] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:09.558337 28293 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:09.625000 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.557480 28017 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:09.558203 27523 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.558225 28297 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:12:09.607673 28387 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.767s	user 0.026s	sys 0.071s
I20260709 12:12:09.446379 28029 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:09.447520 28180 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:09.639164 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:09.617329 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 380693us
I20260709 12:12:09.645025 22421 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:09.619325 28407 raft_consensus.cc:2804] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:09.441125 28381 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:09.648641 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:09.565563 28406 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:09.626577 27966 raft_consensus.cc:740] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
W20260709 12:12:09.660068 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 648744us
W20260709 12:12:09.647842 28387 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.136s	user 0.026s	sys 0.072s
W20260709 12:12:09.665405 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.662786 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:09.665814 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.641628 28351 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:09.637518 28386 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:09.439493 28411 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:09.646169 28407 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:09.629834 28179 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:09.675390 22421 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:09.643934 27523 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:09.692834 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.646410 28297 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:09.689111 28029 raft_consensus.cc:2804] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:12:09.678546 28407 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:09.678493 28386 raft_consensus.cc:2804] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:09.702956 23087 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:09.680276 28210 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:09.676496 28293 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:09.683200 27989 consensus_meta.cc:287] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 1.031s	user 0.012s	sys 0.001s
I20260709 12:12:09.719936 28180 raft_consensus.cc:2804] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:09.723086 28269 raft_consensus.cc:3055] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:09.728089 22455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 1102) took 1055 ms. Trace:
I20260709 12:12:09.748826 22455 rpcz_store.cc:276] 0709 12:12:08.673093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.675063 (+  1970us) service_pool.cc:224] Handling call
0709 12:12:08.693239 (+ 18176us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:08.720171 (+ 26932us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:08.720199 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:08.720622 (+   423us) log.cc:844] Serialized 26 byte log entry
0709 12:12:09.399412 (+678790us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:09.399468 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.399559 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:09.727760 (+328201us) raft_consensus.cc:1685] finished
0709 12:12:09.727791 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:09.728009 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":678469,"threads_started":1,"wal-append.queue_time_us":944267}
I20260709 12:12:09.730183 28412 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:09.732973 23125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 1558) took 1413 ms. Trace:
W20260709 12:12:09.701351 28416 log.cc:927] Time spent T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.267s	user 0.001s	sys 0.000s
I20260709 12:12:09.751120 23125 rpcz_store.cc:276] 0709 12:12:08.319357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.327470 (+  8113us) service_pool.cc:224] Handling call
0709 12:12:08.327720 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:08.671435 (+343715us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:08.671465 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:08.671516 (+    51us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:12:08.671551 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.732696 (+1061145us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b54000a0d54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:09.732748 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:09.732899 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":790050176}
I20260709 12:12:09.675385 28351 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:09.754760 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:09.699996 28029 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:09.756007 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:09.757002 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:12:09.760332 22528 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.157s	user 0.006s	sys 0.029s
W20260709 12:12:09.761584 22528 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.159s	user 0.006s	sys 0.029s
I20260709 12:12:09.763280 22422 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:09.717315 28386 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:09.767252 22422 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:09.750367 28269 raft_consensus.cc:740] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
W20260709 12:12:09.770033 23089 connection.cc:256] RPC call timeout handler was delayed by -1.8351902619999692s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2497s for a response
W20260709 12:12:09.784878 23089 connection.cc:256] RPC call timeout handler was delayed by -1.0952887250000458s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1544s for a response
I20260709 12:12:09.758710 28029 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:09.755337 28180 raft_consensus.cc:697] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 13 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:09.696305 27966 consensus_queue.cc:260] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:09.783521 28253 consensus_queue.cc:1048] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 12:12:09.772217 28386 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:09.773063 28412 raft_consensus.cc:2749] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:09.834940 28408 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.835505 28408 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:09.795763 28316 consensus_queue.cc:1048] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:12:09.752903 28293 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:09.795892 28371 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:09.839541 28293 leader_election.cc:290] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:09.841498 28279 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.841998 28279 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:09.843318 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:09.843771 22526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 2251) took 1242 ms. Trace:
I20260709 12:12:09.844381 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:09.844859 28279 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:09.845006 22605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2785) took 2584 ms. Trace:
W20260709 12:12:09.804526 23120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57318 (request call id 1283) took 2976 ms (client timeout 3309 ms). Trace:
W20260709 12:12:09.846000 23120 rpcz_store.cc:269] 0709 12:12:06.828108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.828223 (+   115us) service_pool.cc:224] Handling call
0709 12:12:09.804300 (+2976077us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b54007f0154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:09.804438 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":599525632}
W20260709 12:12:09.847788 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.807102 28338 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.809175 22599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3241) took 1238 ms. Trace:
I20260709 12:12:09.844955 22451 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:09.851176 22599 rpcz_store.cc:276] 0709 12:12:08.570270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:09.227090 (+656820us) service_pool.cc:224] Handling call
0709 12:12:09.227514 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:09.246500 (+ 18986us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:09.246545 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:09.266057 (+ 19512us) log.cc:844] Serialized 26 byte log entry
0709 12:12:09.667727 (+401670us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:09.667789 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.667893 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:09.808966 (+141073us) raft_consensus.cc:1685] finished
0709 12:12:09.808986 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:09.809120 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18465,"raft.queue_time_us":18594,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"thread_start_us":342611,"threads_started":1,"wal-append.queue_time_us":479880}
I20260709 12:12:09.852564 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:12:09.834698 28372 consensus_meta.cc:287] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 1.250s	user 0.008s	sys 0.004s
I20260709 12:12:09.811461 28176 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:09.812779 28311 raft_consensus.cc:3055] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:12:09.815723 28433 log.cc:927] Time spent T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:12:09.817571 27838 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:09.818292 28337 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:09.743120 28429 consensus_queue.cc:1048] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 12:12:09.826350 28323 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:09.826745 23124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 1293) took 1149 ms. Trace:
I20260709 12:12:09.908908 23124 rpcz_store.cc:276] 0709 12:12:08.677133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:09.241859 (+564726us) service_pool.cc:224] Handling call
0709 12:12:09.249463 (+  7604us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:09.268952 (+ 19489us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:12:09.305144 (+ 36192us) log.cc:844] Serialized 14 byte log entry
0709 12:12:09.671299 (+366155us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:09.681524 (+ 10225us) log.cc:844] Serialized 26 byte log entry
0709 12:12:09.681717 (+   193us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:09.681766 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.681852 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:09.826496 (+144644us) raft_consensus.cc:1685] finished
0709 12:12:09.826523 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:09.826674 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":39903,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":3423,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":18773,"thread_start_us":327162,"threads_started":1,"wal-append.queue_time_us":468182}
I20260709 12:12:09.833524 28411 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:09.913918 22531 raft_consensus.cc:1240] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:09.834327 28406 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:09.771548 28426 raft_consensus.cc:2749] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:09.848783 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:09.917315 22454 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 16.
I20260709 12:12:09.918565 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:09.844146 22526 rpcz_store.cc:276] 0709 12:12:08.601590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.613064 (+ 11474us) service_pool.cc:224] Handling call
0709 12:12:08.630358 (+ 17294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:08.677906 (+ 47548us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:08.677935 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:08.677972 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:12:08.678001 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.843562 (+1165561us) spinlock_profiling.cc:243] Waited 47.4 ms on lock 0x7b5400263754. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:09.843607 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:09.843715 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":108946176}
I20260709 12:12:09.850102 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:09.810886 28351 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:09.853305 23120 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:09.845448 22605 rpcz_store.cc:276] 0709 12:12:07.260483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.064221 (+803738us) service_pool.cc:224] Handling call
0709 12:12:08.064595 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:08.328051 (+263456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:08.328094 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:08.328148 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:08.328191 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.844796 (+1516605us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b54000ea954. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:09.844846 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:09.844953 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":605364480}
I20260709 12:12:09.925130 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:09.855233 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.796295 27989 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.858546 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:09.861927 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:09.932170 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.800329 28398 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:09.851464 27851 consensus_meta.cc:287] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.600s	user 0.010s	sys 0.002s
I20260709 12:12:09.864739 23089 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:09.895684 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:09.856441 28338 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:09.897923 28311 raft_consensus.cc:740] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:09.866312 22601 raft_consensus.cc:1240] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 LEADER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:09.898710 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:09.905810 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:09.857293 28239 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.907271 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:09.797559 28431 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.966873 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:09.966738 28431 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:09.914867 22603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3240) took 1344 ms. Trace:
I20260709 12:12:09.920514 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:09.970675 28239 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:12:09.921357 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:09.858525 28262 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.972132 28262 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:09.972378 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:09.903046 28269 consensus_queue.cc:260] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:09.973059 28239 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:09.923233 22451 raft_consensus.cc:2468] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
I20260709 12:12:09.973595 22524 raft_consensus.cc:1240] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:09.942678 28180 consensus_queue.cc:237] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:09.854014 27966 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:09.856695 28336 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:09.926424 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:09.899740 28066 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.862289 22600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3228) took 3058 ms. Trace:
I20260709 12:12:09.935461 22449 raft_consensus.cc:2393] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 17: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
W20260709 12:12:09.935920 22569 connection.cc:256] RPC call timeout handler was delayed by -2.5555791090000639s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2014s for a response
I20260709 12:12:09.896292 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:09.906781 28408 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:09.833541 28386 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:09.946385 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:09.894291 28176 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:09.880388 28372 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:09.948107 22601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2783) took 2738 ms. Trace:
I20260709 12:12:09.941874 27989 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:09.950855 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:09.951557 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:09.953322 22529 raft_consensus.cc:2393] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 16: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:09.866477 28340 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:12:09.948088 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 83441.3us
I20260709 12:12:10.067384 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:10.100438 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.071336 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:10.075734 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 361192us
W20260709 12:12:10.181703 22421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.971084 22603 rpcz_store.cc:276] 0709 12:12:08.570016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:09.079497 (+509481us) service_pool.cc:224] Handling call
0709 12:12:09.232582 (+153085us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:09.232825 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:12:09.679906 (+447081us) log.cc:844] Serialized 14 byte log entry
0709 12:12:09.914012 (+234106us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:09.914065 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:09.914107 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.914164 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:09.914816 (+   652us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":616137,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":3354,"raft.queue_time_us":626,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":12654,"thread_start_us":602865,"threads_started":2,"wal-append.queue_time_us":377430}
W20260709 12:12:10.182845 22421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.150183 22597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3219) took 4125 ms. Trace:
I20260709 12:12:10.184945 22597 rpcz_store.cc:276] 0709 12:12:06.024543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.153282 (+128739us) service_pool.cc:224] Handling call
0709 12:12:07.204877 (+1051595us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:07.246270 (+ 41393us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:10.149910 (+2903640us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540013c250. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:10.150111 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2417569664}
I20260709 12:12:10.177661 22527 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 15.
I20260709 12:12:10.187234 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:10.001917 23120 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 14.
I20260709 12:12:10.188396 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:10.168704 22604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43070 (request call id 975) took 4563 ms. Trace:
W20260709 12:12:10.121024 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.939996 27851 raft_consensus.cc:2749] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:10.075146 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:10.178167 22601 rpcz_store.cc:276] 0709 12:12:07.209888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.056370 (+846482us) service_pool.cc:224] Handling call
0709 12:12:08.056807 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:09.866100 (+1809293us) spinlock_profiling.cc:243] Waited 6.45 ms on lock 0x7b54004428a0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca8a5dc0 00007f9cca9301c0 00007f9cca931231 00007f9cca92dd8f 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c
0709 12:12:09.947767 (+ 81667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.948032 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14843136}
I20260709 12:12:10.189255 22604 rpcz_store.cc:276] 0709 12:12:05.605511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:05.853551 (+248040us) service_pool.cc:224] Handling call
0709 12:12:05.853892 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:07.480193 (+1626301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:10.168348 (+2688155us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b54000e8b54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:10.168590 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3658011392}
I20260709 12:12:09.973817 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:10.194334 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:10.223351 22531 raft_consensus.cc:2393] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 17: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:10.223824 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:10.227262 23120 raft_consensus.cc:2410] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 16 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:12:10.224860 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:10.064952 28360 log.cc:927] Time spent T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 2.518s	user 0.003s	sys 0.001s
I20260709 12:12:10.224368 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:09.976986 28413 consensus_meta.cc:287] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.586s	user 0.008s	sys 0.004s
I20260709 12:12:10.036621 22528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 2250) took 1435 ms. Trace:
I20260709 12:12:10.069494 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:10.139804 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.236974 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:10.223948 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:10.244984 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:10.254129 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:10.142326 28357 raft_consensus.cc:2804] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:10.229297 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:10.195621 22569 connection.cc:256] RPC call timeout handler was delayed by -1.8350452259999201s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2211s for a response
I20260709 12:12:10.225064 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:10.140805 28401 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.767s	user 0.021s	sys 0.014s
I20260709 12:12:10.258212 22604 raft_consensus.cc:2468] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 12.
I20260709 12:12:10.184382 22600 rpcz_store.cc:276] 0709 12:12:06.804125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.814865 (+ 10740us) service_pool.cc:224] Handling call
0709 12:12:06.815171 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:07.055251 (+240080us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:12:07.091394 (+ 36143us) log.cc:844] Serialized 14 byte log entry
0709 12:12:08.314087 (+1222693us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:08.314141 (+    54us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:08.314187 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.862074 (+1547887us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b54002dfd54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:09.862122 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:09.862239 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19623,"prepare.queue_time_us":36457,"prepare.run_cpu_time_us":9939,"prepare.run_wall_time_us":34761,"raft.queue_time_us":25865,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":10048,"spinlock_wait_cycles":494404864,"thread_start_us":1196700,"threads_started":1,"wal-append.queue_time_us":1133223,"wal-append.run_cpu_time_us":1338,"wal-append.run_wall_time_us":1112311}
W20260709 12:12:10.258826 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 69004.9us
I20260709 12:12:10.252663 22453 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 16.
I20260709 12:12:10.259513 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:10.260416 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:09.974099 28406 raft_consensus.cc:2749] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:10.261256 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:10.257090 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:10.257205 23124 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
I20260709 12:12:10.262634 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:09.986541 28381 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:10.186367 28396 log.cc:927] Time spent T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 1.175s	user 0.000s	sys 0.003s
I20260709 12:12:10.259593 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:10.112159 28354 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:12:10.257517 22569 connection.cc:256] RPC call timeout handler was delayed by -1.25949510800001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2117s for a response
I20260709 12:12:10.269448 22603 raft_consensus.cc:2393] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 12: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:10.067405 28115 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:10.275178 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:10.264268 28401 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.894s	user 0.025s	sys 0.019s
I20260709 12:12:10.228104 22457 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 14.
I20260709 12:12:10.277727 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:10.067813 27523 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:10.264678 22422 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:10.265117 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:10.263942 23087 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:10.072121 28029 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:10.262085 22530 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 16.
I20260709 12:12:10.281612 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:10.282827 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:10.275321 28293 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:10.283478 28293 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:10.283836 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:10.225625 28340 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:10.284373 22530 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 15.
I20260709 12:12:10.287283 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:10.288386 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:10.289867 22530 raft_consensus.cc:1240] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 19. Current term is 20. Ops: [19.12-19.12]
W20260709 12:12:10.290896 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.291815 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:10.221627 28297 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:10.294299 23119 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57328 (request call id 1545) took 3040 ms (client timeout 3200 ms). Trace:
I20260709 12:12:10.296205 23122 raft_consensus.cc:1240] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:12:10.224388 28385 consensus_queue.cc:1059] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
W20260709 12:12:10.294708 23119 rpcz_store.cc:269] 0709 12:12:07.253647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.106927 (+853280us) service_pool.cc:224] Handling call
0709 12:12:10.294118 (+2187191us) spinlock_profiling.cc:243] Waited 452 ms on lock 0x7b5400750154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:10.294240 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1038907136}
I20260709 12:12:10.306083 22448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 1108) took 1060 ms. Trace:
I20260709 12:12:10.223939 28336 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:10.306592 22448 rpcz_store.cc:276] 0709 12:12:09.235290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:09.237240 (+  1950us) service_pool.cc:224] Handling call
0709 12:12:10.295534 (+1058294us) spinlock_profiling.cc:243] Waited 59.9 ms on lock 0x7b54002206d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:10.295667 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":137773824}
I20260709 12:12:10.310241 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:10.310967 22448 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:10.073325 28311 consensus_queue.cc:260] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:10.279055 28338 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:10.186782 28407 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:10.223644 28389 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:10.194504 28353 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:10.065471 28280 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:10.269847 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:10.274451 22569 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
W20260709 12:12:10.319379 28050 consensus_meta.cc:287] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.695s	user 0.009s	sys 0.002s
I20260709 12:12:10.264212 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:10.254508 22528 rpcz_store.cc:276] 0709 12:12:08.601231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.601408 (+   177us) service_pool.cc:224] Handling call
0709 12:12:08.601816 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:08.602110 (+   294us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:08.602147 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:08.602664 (+   517us) log.cc:844] Serialized 26 byte log entry
0709 12:12:09.763066 (+1160402us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:09.763127 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.763224 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:10.036398 (+273174us) raft_consensus.cc:1685] finished
0709 12:12:10.036419 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:10.036558 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1160034,"threads_started":1,"wal-append.queue_time_us":1342266}
I20260709 12:12:10.330065 23118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 1277) took 3498 ms. Trace:
I20260709 12:12:10.263224 22527 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 15.
I20260709 12:12:10.186282 28349 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:10.276010 22604 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 15.
W20260709 12:12:10.277482 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.266942 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:10.338997 22453 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 15.
I20260709 12:12:10.278605 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:10.340127 22457 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 17.
I20260709 12:12:10.317354 28406 raft_consensus.cc:3055] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:10.278378 22449 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 15.
I20260709 12:12:10.268483 22421 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:10.300912 23120 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 17.
I20260709 12:12:10.301676 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:10.344293 22448 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 18.
I20260709 12:12:10.223336 28066 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:12:10.301188 28115 raft_consensus.cc:2804] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:10.257483 28413 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:10.304553 28210 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:10.326321 23119 raft_consensus.cc:1240] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:12:10.113720 28269 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:10.331288 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 56902.2us
I20260709 12:12:10.336560 28311 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:10.273418 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.254431 28262 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:10.277408 28354 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:10.338680 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.341188 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:10.338997 22604 raft_consensus.cc:1240] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:10.313247 28431 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:10.344719 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 76341.5us
I20260709 12:12:10.335135 23118 rpcz_store.cc:276] 0709 12:12:06.824894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.833575 (+  8681us) service_pool.cc:224] Handling call
0709 12:12:06.862203 (+ 28628us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:06.862567 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:06.862599 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:06.863055 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 12:12:07.095203 (+232148us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:12:07.178466 (+ 83263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:07.178540 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:10.057009 (+2878469us) spinlock_profiling.cc:243] Waited 7.88 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:12:10.317616 (+260607us) raft_consensus.cc:1685] finished
0709 12:12:10.317645 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:10.323085 (+  5440us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":100,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":6197,"spinlock_wait_cycles":18123136,"thread_start_us":193908,"threads_started":1,"wal-append.queue_time_us":567445}
I20260709 12:12:10.354925 22457 raft_consensus.cc:1240] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:10.355612 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:10.384095 22421 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:10.357537 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:10.358246 23119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 1301) took 1649 ms. Trace:
I20260709 12:12:10.364029 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:10.273115 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:10.379768 23117 raft_consensus.cc:2393] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 15: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:10.385707 22453 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 15.
I20260709 12:12:10.343364 28406 raft_consensus.cc:740] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:10.341892 28446 raft_consensus.cc:2804] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:10.398917 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:10.380797 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.381183 22449 raft_consensus.cc:1275] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 12:12:10.401870 22449 pending_rounds.cc:85] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f: Aborting all ops after (but not including) 9
I20260709 12:12:10.402127 22449 pending_rounds.cc:107] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f: Aborting uncommitted NO_OP operation due to leader change: 14.10
W20260709 12:12:10.385622 28440 log.cc:927] Time spent T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 12:12:10.354247 28391 raft_consensus.cc:2749] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:10.363792 28210 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:10.385118 23119 rpcz_store.cc:276] 0709 12:12:08.708519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.312646 (+1604127us) service_pool.cc:224] Handling call
0709 12:12:10.326018 (+ 13372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:10.357993 (+ 31975us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:10.358195 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:10.387356 22421 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:10.388132 22457 raft_consensus.cc:1240] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:12:10.409353 22453 raft_consensus.cc:1240] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:10.340852 28353 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:10.393941 22495 connection.cc:256] RPC call timeout handler was delayed by -2.8383975159999864s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17980000000000002s for a response
I20260709 12:12:10.340883 28050 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:10.338675 28389 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:10.402354 22449 raft_consensus.cc:2889] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:10.351248 28115 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:10.399724 22528 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 9.
I20260709 12:12:10.351055 28349 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:10.411262 23118 raft_consensus.cc:1240] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:12:10.403031 22526 raft_consensus.cc:2410] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 21 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 12:12:10.397956 28381 raft_consensus.cc:2749] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:10.412462 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:10.396572 28442 log.cc:927] Time spent T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.202s	user 0.000s	sys 0.000s
I20260709 12:12:10.413972 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:10.426380 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:10.385392 28385 consensus_queue.cc:1059] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.035s
I20260709 12:12:10.416164 28210 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:10.423620 22495 connection.cc:256] RPC call timeout handler was delayed by -1.9181671269998333s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1895s for a response
W20260709 12:12:10.468426 22495 connection.cc:256] RPC call timeout handler was delayed by -1.8650671269999748s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19540000000000002s for a response
I20260709 12:12:10.418097 22421 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:12:10.469695 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 51694.7us
I20260709 12:12:10.471091 22421 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:10.462304 23119 pending_rounds.cc:85] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270: Aborting all ops after (but not including) 11
I20260709 12:12:10.472100 23119 pending_rounds.cc:107] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 12:12:10.472385 23119 raft_consensus.cc:2889] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:10.462647 22604 raft_consensus.cc:1240] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:10.465342 22600 raft_consensus.cc:2410] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:12:10.474504 28337 raft_consensus.cc:2749] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:10.475272 28391 raft_consensus.cc:2804] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:10.475672 28391 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:10.476018 28391 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:10.462718 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:10.466734 23118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 1567) took 1101 ms. Trace:
I20260709 12:12:10.414494 22496 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:12:10.477928 22495 connection.cc:256] RPC call timeout handler was delayed by -1.2897398459997476s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19290000000000002s for a response
I20260709 12:12:10.459239 22527 raft_consensus.cc:2393] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 14: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:10.477566 23118 rpcz_store.cc:276] 0709 12:12:09.365048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.389003 (+1023955us) service_pool.cc:224] Handling call
0709 12:12:10.408940 (+ 19937us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:10.466286 (+ 57346us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:10.466681 (+   395us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:10.479367 22495 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:10.480049 22527 raft_consensus.cc:1240] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:12:10.480472 22421 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:10.477557 22528 raft_consensus.cc:2393] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 16: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:10.480358 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:10.482112 28208 raft_consensus.cc:2804] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:10.482523 28208 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:10.482898 28208 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:10.483490 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:10.484831 23118 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
I20260709 12:12:10.486255 28391 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:10.471487 22529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:46680
I20260709 12:12:10.490038 28208 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:10.491034 22529 raft_consensus.cc:606] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Received request to transfer leadership to TS 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:10.491485 22529 raft_consensus.cc:614] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:10.489379 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:10.490432 22421 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:10.511703 23118 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 16.
W20260709 12:12:10.508422 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 94057.8us
I20260709 12:12:10.512578 22421 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:10.398238 28446 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:10.426553 28362 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:10.518391 22528 raft_consensus.cc:1275] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:12:10.423529 28408 raft_consensus.cc:2804] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:10.493201 28340 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:10.494894 28353 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:10.495885 28413 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:10.497413 28050 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:10.498052 28445 log.cc:927] Time spent T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
W20260709 12:12:10.498690 28444 log.cc:927] Time spent T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 12:12:10.468889 28406 consensus_queue.cc:260] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:10.502081 28336 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:10.503219 28306 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:10.426143 28115 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:10.424238 28176 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:10.457803 27989 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:10.509037 22495 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:10.502748 28029 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:10.507665 28372 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:10.523636 23087 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:10.530076 22421 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:10.550777 22421 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:10.532076 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:10.545849 28193 consensus_meta.cc:287] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 1.103s	user 0.011s	sys 0.003s
I20260709 12:12:10.503643 28407 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:10.507977 28385 raft_consensus.cc:3055] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:10.510033 28262 raft_consensus.cc:2749] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:10.515748 28237 raft_consensus.cc:2749] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:10.559624 22456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 1100) took 3818 ms. Trace:
I20260709 12:12:10.559988 22456 rpcz_store.cc:276] 0709 12:12:06.740949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.776909 (+ 35960us) service_pool.cc:224] Handling call
0709 12:12:06.777266 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:06.815335 (+ 38069us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:07.040281 (+224946us) log.cc:844] Serialized 14 byte log entry
0709 12:12:08.115765 (+1075484us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:08.188456 (+ 72691us) log.cc:844] Serialized 26 byte log entry
0709 12:12:08.188615 (+   159us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:08.188652 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:10.557145 (+2368493us) spinlock_profiling.cc:243] Waited 4.59 ms on lock 0x7b540038a9d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:10.557207 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:10.557264 (+    57us) raft_consensus.cc:1685] finished
0709 12:12:10.559424 (+  2160us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:10.559571 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1262026,"prepare.queue_time_us":121539,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":69415,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":1276534,"spinlock_wait_cycles":10559744,"thread_start_us":1081570,"threads_started":3,"wal-append.queue_time_us":1356461,"wal-append.run_cpu_time_us":2624,"wal-append.run_wall_time_us":1062078}
I20260709 12:12:10.513722 28338 raft_consensus.cc:2804] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:10.542192 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:12:10.572584 28338 raft_consensus.cc:697] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:10.573510 28338 consensus_queue.cc:237] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:10.574493 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:10.576095 22449 raft_consensus.cc:1275] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:12:10.519531 28446 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:10.531629 28381 raft_consensus.cc:2749] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:10.529507 28408 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:10.536089 22527 raft_consensus.cc:1240] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:12:10.553300 23087 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:10.592353 23087 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
W20260709 12:12:10.554131 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 45224.7us
I20260709 12:12:10.531037 28362 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:10.594821 22495 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:10.555614 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:10.558858 22455 raft_consensus.cc:2410] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:12:10.555065 27966 raft_consensus.cc:2804] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:10.557499 28029 raft_consensus.cc:2749] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:10.506620 28386 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:10.565600 22597 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 17.
I20260709 12:12:10.570448 22422 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:10.605546 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:10.606212 22599 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:12:10.557811 28385 raft_consensus.cc:740] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:10.554064 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:10.578842 22449 raft_consensus.cc:1240] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:10.588009 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:10.589059 23122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 1296) took 1908 ms. Trace:
I20260709 12:12:10.609823 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:10.610514 23122 rpcz_store.cc:276] 0709 12:12:08.680293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:09.607992 (+927699us) service_pool.cc:224] Handling call
0709 12:12:10.295942 (+687950us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:10.296725 (+   783us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:10.570144 (+273419us) spinlock_profiling.cc:243] Waited 688 ms on lock 0x7b5400750150. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:10.588981 (+ 18837us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1581376256}
I20260709 12:12:10.611992 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:10.553588 28406 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:10.558171 27989 raft_consensus.cc:2804] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:10.597695 23087 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:10.627976 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:10.628517 22453 raft_consensus.cc:2393] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 15: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:10.628328 23087 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:10.596747 28408 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:10.612691 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:10.630409 23087 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:10.616961 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:10.614180 22495 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:10.607122 27900 raft_consensus.cc:2804] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:10.607765 28413 raft_consensus.cc:2804] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:10.623169 28354 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:10.597146 27966 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:10.623857 28452 log.cc:927] Time spent T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 12:12:10.624596 28451 log.cc:927] Time spent T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:12:10.663455 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:10.664320 22450 raft_consensus.cc:2393] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 16: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:10.625770 28386 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.626024 28362 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:10.626425 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:10.629663 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:10.676440 23122 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 14.
I20260709 12:12:10.555106 28286 raft_consensus.cc:2749] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:10.606220 28066 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:10.588423 28349 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:10.609141 28407 raft_consensus.cc:2749] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:12:10.629894 28449 log.cc:927] Time spent T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 12:12:10.615274 28026 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:12:10.639175 28459 raft_consensus.cc:2804] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:12:10.654316 28438 log.cc:927] Time spent T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.682s	user 0.003s	sys 0.000s
I20260709 12:12:10.658289 23119 raft_consensus.cc:1240] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:10.647037 28413 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:10.630399 27989 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:12:10.674889 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 124191us
I20260709 12:12:10.644821 28389 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:10.682622 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:10.682966 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:10.647524 28180 raft_consensus.cc:2804] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:10.639412 27900 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:10.722703 22451 raft_consensus.cc:1240] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 9. Current term is 10. Ops: []
W20260709 12:12:10.724366 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 58454.4us
I20260709 12:12:10.644783 28280 raft_consensus.cc:2749] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:10.649250 27966 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:10.686838 22531 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:10.686466 23125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 1297) took 2005 ms. Trace:
W20260709 12:12:10.687616 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 57306.1us
I20260709 12:12:10.739987 23087 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:10.739094 23125 rpcz_store.cc:276] 0709 12:12:08.680991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:09.770810 (+1089819us) service_pool.cc:224] Handling call
0709 12:12:09.771181 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:09.771553 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:12:09.797402 (+ 25849us) log.cc:844] Serialized 14 byte log entry
0709 12:12:10.052748 (+255346us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:10.060402 (+  7654us) log.cc:844] Serialized 26 byte log entry
0709 12:12:10.060617 (+   215us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:10.060959 (+   342us) log.cc:844] Serialized 14 byte log entry
0709 12:12:10.073031 (+ 12072us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:10.073098 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:10.686274 (+613176us) raft_consensus.cc:1685] finished
0709 12:12:10.686295 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:10.686414 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":21583,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":77,"raft.queue_time_us":35538,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":7392,"thread_start_us":245151,"threads_started":1,"wal-append.queue_time_us":471002}
I20260709 12:12:10.686156 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:10.741443 22453 raft_consensus.cc:2393] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 17: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:10.694363 22599 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 15.
I20260709 12:12:10.694630 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:10.705894 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 90522.9us
I20260709 12:12:10.696866 28459 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:10.703263 28413 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:10.708639 28463 raft_consensus.cc:2804] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:12:10.711544 28456 log.cc:927] Time spent T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 12:12:10.714160 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:10.720142 28457 log.cc:927] Time spent T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:12:10.705107 27989 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:10.736342 23119 raft_consensus.cc:1275] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:12:10.680465 28336 consensus_queue.cc:1048] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:12:10.691273 28362 consensus_queue.cc:1048] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 12:12:10.681948 28185 consensus_queue.cc:1048] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:12:10.680639 28386 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:10.742799 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:10.769856 22599 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:10.745183 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:10.749117 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:10.750708 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:10.727815 28180 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:10.668159 28385 consensus_queue.cc:260] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:10.735364 27900 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:10.754129 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:10.777724 22530 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 15.
I20260709 12:12:10.700011 28286 consensus_queue.cc:1059] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 12:12:10.774915 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:10.751420 28459 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:10.769508 28455 log.cc:927] Time spent T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 12:12:10.779722 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:10.781441 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 78437.3us
I20260709 12:12:10.782599 22531 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 15.
W20260709 12:12:10.784412 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.769382 28465 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:10.777117 28180 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:10.789412 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:10.805501 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:10.805698 28463 raft_consensus.cc:697] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 18 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:10.806646 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:10.807276 22451 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 20.
I20260709 12:12:10.806828 28463 consensus_queue.cc:237] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:10.793979 22599 raft_consensus.cc:2468] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 14.
I20260709 12:12:10.813362 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:10.814000 22602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2802) took 1172 ms. Trace:
I20260709 12:12:10.814054 22453 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 18.
I20260709 12:12:10.814518 22602 rpcz_store.cc:276] 0709 12:12:09.642416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.342786 (+700370us) service_pool.cc:224] Handling call
0709 12:12:10.343086 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:10.343288 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:10.343310 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:10.360260 (+ 16950us) log.cc:844] Serialized 26 byte log entry
0709 12:12:10.511312 (+151052us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:10.511349 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:10.511414 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:10.813794 (+302380us) raft_consensus.cc:1685] finished
0709 12:12:10.813818 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:10.813942 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":124225,"threads_started":1,"wal-append.queue_time_us":236424}
I20260709 12:12:10.803797 28385 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:10.837226 22604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2809) took 1096 ms. Trace:
I20260709 12:12:10.932080 22604 rpcz_store.cc:276] 0709 12:12:09.740690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.383675 (+642985us) service_pool.cc:224] Handling call
0709 12:12:10.383988 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:10.473878 (+ 89890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:10.836917 (+363039us) spinlock_profiling.cc:243] Waited 78.4 ms on lock 0x7b54003aded4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:10.837147 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":180389760}
W20260709 12:12:10.834656 28464 log.cc:927] Time spent T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:12:10.834055 28243 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:10.826500 28475 raft_consensus.cc:2804] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:12:10.821679 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 62240.2us
I20260709 12:12:10.812325 28465 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:10.946996 28475 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:10.831593 28479 consensus_queue.cc:1059] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.171s
W20260709 12:12:11.067363 28473 log.cc:927] Time spent T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.264s	user 0.000s	sys 0.001s
I20260709 12:12:11.068581 23118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 1568) took 1291 ms. Trace:
W20260709 12:12:11.069149 28115 consensus_meta.cc:287] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.519s	user 0.009s	sys 0.000s
I20260709 12:12:11.068971 23118 rpcz_store.cc:276] 0709 12:12:09.777250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.515977 (+738727us) service_pool.cc:224] Handling call
0709 12:12:10.535971 (+ 19994us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:10.682153 (+146182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:10.682189 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:10.687770 (+  5581us) log.cc:844] Serialized 26 byte log entry
0709 12:12:10.751735 (+ 63965us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:10.751805 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:10.752344 (+   539us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:11.068317 (+315973us) raft_consensus.cc:1685] finished
0709 12:12:11.068345 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:11.068512 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9473,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":3738,"thread_start_us":182476,"threads_started":2,"wal-append.queue_time_us":61810}
I20260709 12:12:11.069979 28115 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:11.071133 22450 raft_consensus.cc:1240] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:11.071640 23118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 1331) took 1283 ms. Trace:
I20260709 12:12:11.072028 23118 rpcz_store.cc:276] 0709 12:12:09.788179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:11.070814 (+1282635us) service_pool.cc:224] Handling call
0709 12:12:11.071166 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:11.071349 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:11.071374 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:11.071411 (+    37us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:11.071437 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:11.071483 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:11.071584 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:11.074019 23118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 1571) took 1280 ms. Trace:
I20260709 12:12:11.076563 23118 rpcz_store.cc:276] 0709 12:12:09.794145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:11.072866 (+1278721us) service_pool.cc:224] Handling call
0709 12:12:11.073231 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:11.073560 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:11.073608 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:11.073670 (+    62us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:11.073725 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:11.073798 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:11.073932 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:12:11.088335 28466 log.cc:927] Time spent T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.310s	user 0.001s	sys 0.000s
W20260709 12:12:11.090168 28269 consensus_meta.cc:287] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.721s	user 0.006s	sys 0.003s
I20260709 12:12:11.065414 28475 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:11.090181 22523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 2254) took 1184 ms. Trace:
I20260709 12:12:11.103328 22523 rpcz_store.cc:276] 0709 12:12:09.905721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:09.907705 (+  1984us) service_pool.cc:224] Handling call
0709 12:12:09.908008 (+   303us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:09.931652 (+ 23644us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:09.931684 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:09.932236 (+   552us) log.cc:844] Serialized 52 byte log entry
0709 12:12:10.564546 (+632310us) spinlock_profiling.cc:243] Waited 7.37 ms on lock 0x7b18003535c0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc7823e07 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc7840c02 00007f9cca4c820b 00007f9cca4cdd23 00007f9cca4ce0d1 00007f9cca8e9a0f
0709 12:12:10.679990 (+115444us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:10.698813 (+ 18823us) log.cc:844] Serialized 14 byte log entry
0709 12:12:10.703723 (+  4910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:10.703794 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:11.089781 (+385987us) raft_consensus.cc:1685] finished
0709 12:12:11.089915 (+   134us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:11.090106 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34965,"prepare.queue_time_us":16466,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":32164,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":35103,"spinlock_wait_cycles":24771712,"thread_start_us":115269,"threads_started":1,"wal-append.queue_time_us":777148}
I20260709 12:12:11.093212 27989 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:11.110849 28306 consensus_meta.cc:287] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.567s	user 0.001s	sys 0.009s
I20260709 12:12:11.127699 23121 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 17.
I20260709 12:12:11.128288 28297 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.128767 28297 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:11.078323 28467 log.cc:927] Time spent T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.309s	user 0.000s	sys 0.001s
I20260709 12:12:11.112013 27966 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:11.115324 23125 raft_consensus.cc:1240] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:11.116974 27989 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:11.119853 28386 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:11.124100 28459 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:11.109467 28470 raft_consensus.cc:3055] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:12:11.127131 28210 consensus_meta.cc:287] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.613s	user 0.008s	sys 0.002s
I20260709 12:12:11.132220 22456 raft_consensus.cc:2368] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 10. Current term is 11.
W20260709 12:12:11.143676 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 227262us
W20260709 12:12:11.171164 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 181712us
I20260709 12:12:11.174196 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:11.174799 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:11.175066 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:11.175611 22525 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 14.
I20260709 12:12:11.172051 28210 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:11.185448 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:11.187641 28386 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.188131 28386 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:11.190634 28386 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:11.158731 28470 raft_consensus.cc:740] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:11.109141 28408 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:11.191797 28470 consensus_queue.cc:260] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:11.193182 28408 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:11.195672 28459 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:11.195735 28475 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:11.187250 28210 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:11.193312 28470 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:12:11.271951 23089 leader_election.cc:336] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Timed out: RequestConsensusVote RPC to 127.20.196.131:37785 timed out after 1.523s (SENT)
I20260709 12:12:11.272675 23089 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:11.111708 28465 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:11.233669 22495 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:11.312515 23123 raft_consensus.cc:1240] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 17. Current term is 18. Ops: []
W20260709 12:12:11.313122 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 79536.4us
W20260709 12:12:11.173336 28446 consensus_meta.cc:287] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.568s	user 0.006s	sys 0.005s
I20260709 12:12:11.314162 22495 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:11.331463 28336 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:11.331965 28336 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:11.332306 28336 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:11.334268 28478 raft_consensus.cc:2804] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:11.334811 28478 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:11.335245 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:11.337893 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:11.335276 28478 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:11.349582 28465 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:11.350185 28465 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:11.354884 23116 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57318 (request call id 1288) took 4488 ms (client timeout 2040 ms). Trace:
W20260709 12:12:11.355845 23116 rpcz_store.cc:269] 0709 12:12:06.829442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.849701 (+ 20259us) service_pool.cc:224] Handling call
0709 12:12:11.312216 (+4462515us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b54005f19d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:11.317965 (+  5749us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3704248704}
I20260709 12:12:11.315382 28210 raft_consensus.cc:2749] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:11.378397 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:11.379197 22529 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 20.
I20260709 12:12:11.314141 28474 consensus_queue.cc:1059] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
W20260709 12:12:11.376089 28413 consensus_meta.cc:287] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.611s	user 0.006s	sys 0.006s
W20260709 12:12:11.388402 23124 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57332 (request call id 1325) took 1602 ms (client timeout 2106 ms). Trace:
W20260709 12:12:11.421711 23124 rpcz_store.cc:269] 0709 12:12:09.786303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:09.922784 (+136481us) service_pool.cc:224] Handling call
0709 12:12:11.388251 (+1465467us) spinlock_profiling.cc:243] Waited 78.7 ms on lock 0x7b54007f0154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:11.388350 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":181054208}
W20260709 12:12:11.388751 23088 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.017s	sys 0.025s
W20260709 12:12:11.423484 23088 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.017s	sys 0.026s
W20260709 12:12:11.423914 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 626522us
I20260709 12:12:11.426810 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:11.427520 22523 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:11.333465 28446 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:11.377977 28475 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:11.447264 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:11.447836 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:11.451821 28318 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:11.455255 27966 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:11.457307 28180 consensus_meta.cc:287] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.636s	user 0.007s	sys 0.002s
I20260709 12:12:11.457901 28180 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:11.448814 23088 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:11.483387 23124 raft_consensus.cc:1240] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 15. Current term is 16. Ops: []
W20260709 12:12:11.504004 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 123585us
I20260709 12:12:11.476558 28486 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:11.491650 28475 raft_consensus.cc:2804] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:11.440725 28413 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:11.503518 27900 consensus_meta.cc:287] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.719s	user 0.012s	sys 0.000s
I20260709 12:12:11.498931 28446 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:11.513870 28475 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.520663 28475 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:11.521857 28293 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:11.526394 23116 raft_consensus.cc:1240] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:11.516798 28465 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:11.530004 28489 log.cc:927] Time spent T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:12:11.530373 28208 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:11.530354 28180 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:11.533457 23118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 1572) took 1737 ms. Trace:
I20260709 12:12:11.533854 23118 rpcz_store.cc:276] 0709 12:12:09.796284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:11.077858 (+1281574us) service_pool.cc:224] Handling call
0709 12:12:11.079374 (+  1516us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:11.079619 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:11.079663 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:11.080277 (+   614us) log.cc:844] Serialized 26 byte log entry
0709 12:12:11.367393 (+287116us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:11.367446 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:11.367538 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:11.533248 (+165710us) raft_consensus.cc:1685] finished
0709 12:12:11.533271 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:11.533393 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":286738,"threads_started":1,"wal-append.queue_time_us":303756}
I20260709 12:12:11.535490 23118 raft_consensus.cc:1240] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:11.536034 23118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 1335) took 1120 ms. Trace:
I20260709 12:12:11.536329 23118 rpcz_store.cc:276] 0709 12:12:10.415578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:11.535024 (+1119446us) service_pool.cc:224] Handling call
0709 12:12:11.535320 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:11.535818 (+   498us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:11.535987 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:11.536934 28478 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:11.514755 28486 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:11.519336 27900 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:11.541918 28336 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:11.543510 28413 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:11.546691 28475 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:11.548295 28250 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:11.548661 28486 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:11.549039 23123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 1565) took 2949 ms. Trace:
I20260709 12:12:11.552505 23123 rpcz_store.cc:276] 0709 12:12:08.599840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.655005 (+ 55165us) service_pool.cc:224] Handling call
0709 12:12:11.312333 (+2657328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:11.313009 (+   676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:11.548858 (+235849us) spinlock_profiling.cc:243] Waited 2.66 s on lock 0x7b54005f19d0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:11.548982 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6110856448}
I20260709 12:12:11.551110 27900 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:11.551328 28336 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:11.552096 28472 log.cc:927] Time spent T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.613s	user 0.010s	sys 0.004s
I20260709 12:12:11.557014 28478 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:11.557494 28475 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:11.560056 28434 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.560871 28434 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:11.563972 28434 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:11.600756 23118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 1337) took 1176 ms. Trace:
I20260709 12:12:11.602029 23118 rpcz_store.cc:276] 0709 12:12:10.423759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:11.537001 (+1113242us) service_pool.cc:224] Handling call
0709 12:12:11.537246 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:11.537460 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:12:11.552528 (+ 15068us) log.cc:844] Serialized 14 byte log entry
0709 12:12:11.599480 (+ 46952us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:11.599643 (+   163us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:11.599854 (+   211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:11.600029 (+   175us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:11.600410 (+   381us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22866,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"thread_start_us":60778,"threads_started":2,"wal-append.queue_time_us":10734}
I20260709 12:12:11.608824 23118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 1341) took 1100 ms. Trace:
I20260709 12:12:11.609423 23118 rpcz_store.cc:276] 0709 12:12:10.508929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:11.606585 (+1097656us) service_pool.cc:224] Handling call
0709 12:12:11.607595 (+  1010us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:11.608319 (+   724us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:11.608363 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:11.608438 (+    75us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:11.608497 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:11.608570 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:11.608726 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:11.612071 27900 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:11.613512 27900 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:11.618222 27900 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:11.630334 23123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 1338) took 1186 ms. Trace:
I20260709 12:12:11.630879 23123 rpcz_store.cc:276] 0709 12:12:10.441125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:11.553335 (+1112210us) service_pool.cc:224] Handling call
0709 12:12:11.553638 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:11.553836 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:12:11.599234 (+ 45398us) log.cc:844] Serialized 14 byte log entry
0709 12:12:11.627103 (+ 27869us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:11.627217 (+   114us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:11.627364 (+   147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:11.627473 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:11.627713 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":6792,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"raft.queue_time_us":978,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":219,"thread_start_us":70132,"threads_started":2,"wal-append.queue_time_us":28773}
W20260709 12:12:11.681816 23120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57332 (request call id 1333) took 1817 ms (client timeout 2129 ms). Trace:
W20260709 12:12:11.682775 23120 rpcz_store.cc:269] 0709 12:12:09.863937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.264841 (+400904us) service_pool.cc:224] Handling call
0709 12:12:11.681250 (+1416409us) spinlock_profiling.cc:243] Waited 21.9 ms on lock 0x7b54001acf54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:11.681547 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50439040}
W20260709 12:12:11.691682 23089 leader_election.cc:336] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Timed out: RequestConsensusVote RPC to 127.20.196.131:37785 timed out after 1.860s (SENT)
I20260709 12:12:11.692518 23089 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:11.695456 28475 raft_consensus.cc:2749] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:11.710845 22531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56940 (request call id 2512) took 1176 ms. Trace:
I20260709 12:12:11.711428 22531 rpcz_store.cc:276] 0709 12:12:10.533867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.598484 (+ 64617us) service_pool.cc:224] Handling call
0709 12:12:11.710343 (+1111859us) spinlock_profiling.cc:243] Waited 53.4 ms on lock 0x7b5400181854. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:11.710632 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":122904960}
I20260709 12:12:11.723500 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:11.724113 23118 raft_consensus.cc:1240] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 12:12:11.724960 23123 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 16: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:11.725829 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:11.727582 23122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 1570) took 1943 ms. Trace:
I20260709 12:12:11.728212 23122 rpcz_store.cc:276] 0709 12:12:09.784012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.677218 (+893206us) service_pool.cc:224] Handling call
0709 12:12:11.681556 (+1004338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:11.682058 (+   502us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:11.682089 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:11.682150 (+    61us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:11.682195 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:11.682268 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:11.727081 (+ 44813us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54001acf50. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:11.727307 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2308805504}
I20260709 12:12:11.726835 23123 raft_consensus.cc:1240] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 19. Current term is 20. Ops: []
W20260709 12:12:11.734437 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:11.739609 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:11.740440 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:11.741349 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:11.742272 23123 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 16: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:11.743216 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:11.743382 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:11.744328 23123 raft_consensus.cc:2393] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 18: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:11.744539 23120 raft_consensus.cc:2368] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 15. Current term is 16.
I20260709 12:12:11.752651 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:11.754338 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:11.764765 28354 raft_consensus.cc:3055] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:11.764778 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:11.765425 28354 raft_consensus.cc:740] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:11.765717 28297 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:11.765892 23123 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 14.
I20260709 12:12:11.764899 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:11.767210 23120 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 15.
I20260709 12:12:11.767380 28354 consensus_queue.cc:260] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:11.769025 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:11.769748 28354 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:11.774130 28480 raft_consensus.cc:3055] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:12:11.774658 28480 raft_consensus.cc:740] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:11.776748 28480 consensus_queue.cc:260] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:11.778820 28488 log.cc:927] Time spent T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.258s	user 0.001s	sys 0.002s
I20260709 12:12:11.778868 28480 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:11.813829 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:11.814528 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:11.814726 22450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2993) took 1225 ms. Trace:
I20260709 12:12:11.816107 22450 rpcz_store.cc:276] 0709 12:12:10.588810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.692974 (+104164us) service_pool.cc:224] Handling call
0709 12:12:10.693376 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:11.071470 (+378094us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:11.814107 (+742637us) spinlock_profiling.cc:243] Waited 378 ms on lock 0x7b5400241654. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:11.814383 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":868443136}
I20260709 12:12:11.818863 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:11.830186 27966 consensus_queue.cc:1059] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 12:12:11.833742 27966 raft_consensus.cc:3055] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:11.834192 27966 raft_consensus.cc:740] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:11.837188 27966 consensus_queue.cc:260] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:11.839600 27966 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:11.851082 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:11.851933 22531 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 9 FOLLOWER]: Advancing to term 11
W20260709 12:12:11.853421 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:11.854135 28480 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:11.854928 28480 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:11.869293 22451 raft_consensus.cc:1240] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:12:11.871076 28480 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:11.872962 22531 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
I20260709 12:12:11.874081 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:11.875437 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:11.876406 22531 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:12:11.877054 22421 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:11.880352 28208 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:11.904414 22597 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45562 (request call id 2816) took 1802 ms (client timeout 1532 ms). Trace:
W20260709 12:12:11.908483 22597 rpcz_store.cc:269] 0709 12:12:10.101706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.186966 (+ 85260us) service_pool.cc:224] Handling call
0709 12:12:11.903661 (+1716695us) spinlock_profiling.cc:243] Waited 378 ms on lock 0x7b5400041d54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:11.904039 (+   378us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":868778368}
I20260709 12:12:11.886709 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:11.910181 22605 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 10.
W20260709 12:12:11.927320 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 50574.1us
I20260709 12:12:11.929382 22421 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:11.929850 23116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 1332) took 2066 ms. Trace:
I20260709 12:12:11.931562 22421 leader_election.cc:400] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 election: Vote denied by peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353) with higher term. Message: Invalid argument: T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 15. Current term is 16.
I20260709 12:12:11.931986 22421 leader_election.cc:403] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:12:11.934267 22421 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:11.935180 28465 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:11.939371 28403 raft_consensus.cc:2749] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:11.944401 22421 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:11.945502 22421 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:12:11.931936 23121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57318 (request call id 1298) took 3245 ms (client timeout 2109 ms). Trace:
I20260709 12:12:11.930236 23116 rpcz_store.cc:276] 0709 12:12:09.863661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:11.375734 (+1512073us) service_pool.cc:224] Handling call
0709 12:12:11.376148 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:11.526856 (+150708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:11.929385 (+402529us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54006dfbd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:11.929643 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":344268032}
I20260709 12:12:11.948010 22531 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 16.
I20260709 12:12:11.934273 23125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 1326) took 2147 ms. Trace:
I20260709 12:12:11.949451 23125 rpcz_store.cc:276] 0709 12:12:09.786608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.741648 (+955040us) service_pool.cc:224] Handling call
0709 12:12:10.741895 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:11.131527 (+389632us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:11.933812 (+802285us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b54000a00d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:11.934092 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":858385792}
W20260709 12:12:11.946754 23121 rpcz_store.cc:269] 0709 12:12:08.686885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.715740 (+ 28855us) service_pool.cc:224] Handling call
0709 12:12:11.931596 (+3215856us) spinlock_profiling.cc:243] Waited 2.32 s on lock 0x7b54000a19d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:11.931726 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5333810432}
I20260709 12:12:11.956547 28029 raft_consensus.cc:2804] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:11.956880 23088 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:11.957211 28029 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:11.957816 28029 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:11.959637 28477 raft_consensus.cc:2804] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:12:11.966969 28436 log.cc:927] Time spent T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 1.992s	user 0.007s	sys 0.007s
I20260709 12:12:11.969305 28403 raft_consensus.cc:2804] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:11.969930 28403 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.970328 28403 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:11.935226 27966 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:11.976354 28499 log.cc:927] Time spent T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:12:11.980607 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:11.981633 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:11.975363 28477 raft_consensus.cc:697] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 16 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:11.990823 23118 raft_consensus.cc:1275] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:12:11.991576 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:11.992967 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:11.981316 23116 raft_consensus.cc:1275] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:12:12.016502 28208 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:11.982354 23122 raft_consensus.cc:1240] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 13 LEADER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:12.018033 22528 raft_consensus.cc:1240] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:12.003106 28477 consensus_queue.cc:237] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:12.018033 22421 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:12.010455 28403 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:12.045359 22453 raft_consensus.cc:1240] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:12.048856 28403 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:12.045326 28250 raft_consensus.cc:2749] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:12.062189 28179 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:12.061847 28029 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:12.071552 28357 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:12.082728 28506 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:12.079886 28357 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:12.091542 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 73717.4us
I20260709 12:12:12.094844 22421 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:12.096973 28029 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:12.097704 28029 raft_consensus.cc:2749] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:12.104388 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:12.107606 28181 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:12.108580 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:12.109241 22453 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:12.110423 28357 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:12.102802 22605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45562 (request call id 2814) took 2198 ms (client timeout 1561 ms). Trace:
W20260709 12:12:12.111688 22605 rpcz_store.cc:269] 0709 12:12:09.904311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:09.924879 (+ 20568us) service_pool.cc:224] Handling call
0709 12:12:12.101765 (+2176886us) spinlock_profiling.cc:243] Waited 1.98 s on lock 0x7b54003ae3d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:12.102702 (+   937us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4563372416}
I20260709 12:12:12.105764 28115 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:12.102246 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 67591.1us
I20260709 12:12:12.105194 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:12.122936 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:12.125387 22496 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:12.126588 28362 raft_consensus.cc:2804] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:12.127097 28362 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:12.127498 28362 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:12.127614 22496 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:12.127846 28477 consensus_queue.cc:1059] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:12.129302 28477 raft_consensus.cc:3055] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:12.123700 22452 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 14.
W20260709 12:12:12.140292 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.139412 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:12.122170 28357 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:12.133317 28477 raft_consensus.cc:740] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:12.145859 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:12.147527 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:12.148471 22530 raft_consensus.cc:3055] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:12.150378 22530 raft_consensus.cc:740] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:12.151340 22530 consensus_queue.cc:260] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:12.152372 22530 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:12.156064 28477 consensus_queue.cc:260] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:12.157800 28477 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:12.092857 28506 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:12.167989 23088 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:12.171726 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:12.173645 23118 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 15.
I20260709 12:12:12.174892 28338 raft_consensus.cc:2804] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:12.175418 28338 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:12.175860 28338 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:12.176240 22523 consensus_meta.cc:287] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.748s	user 0.014s	sys 0.000s
I20260709 12:12:12.176704 22523 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 16.
I20260709 12:12:12.179708 22452 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 17.
I20260709 12:12:12.182541 28181 raft_consensus.cc:2749] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:12.187182 23124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 1334) took 2322 ms. Trace:
I20260709 12:12:12.187641 23124 rpcz_store.cc:276] 0709 12:12:09.864167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:11.422919 (+1558752us) service_pool.cc:224] Handling call
0709 12:12:11.437564 (+ 14645us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:11.493976 (+ 56412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:12.186608 (+692632us) spinlock_profiling.cc:243] Waited 45.5 ms on lock 0x7b5400670f54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:12.186965 (+   357us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":104683904}
I20260709 12:12:12.190172 23119 raft_consensus.cc:1240] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:12.192054 23119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 1329) took 2404 ms. Trace:
I20260709 12:12:12.192363 23119 rpcz_store.cc:276] 0709 12:12:09.787617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.775372 (+987755us) service_pool.cc:224] Handling call
0709 12:12:12.189766 (+1414394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:12.190625 (+   859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:12.191870 (+  1245us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54004e4150. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:12.192005 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3229430528}
I20260709 12:12:12.192435 28362 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:12.194607 22453 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 18.
W20260709 12:12:12.196576 23117 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57318 (request call id 1300) took 3499 ms (client timeout 3059 ms). Trace:
W20260709 12:12:12.197026 23117 rpcz_store.cc:269] 0709 12:12:08.695067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.833845 (+138778us) service_pool.cc:224] Handling call
0709 12:12:12.188937 (+3355092us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54004e4154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:12.194704 (+  5767us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2974848256}
I20260709 12:12:12.199235 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:12.200438 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:12.201326 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:12.219285 22448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 2991) took 1634 ms. Trace:
I20260709 12:12:12.219754 22448 rpcz_store.cc:276] 0709 12:12:10.585216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.670752 (+ 85536us) service_pool.cc:224] Handling call
0709 12:12:10.672118 (+  1366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:10.672405 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:10.672443 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:10.679666 (+  7223us) log.cc:844] Serialized 26 byte log entry
0709 12:12:10.708613 (+ 28947us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:10.708664 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:10.708729 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:11.551478 (+842749us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:12:12.218712 (+667234us) raft_consensus.cc:1685] finished
0709 12:12:12.218755 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:12.219099 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4943232,"thread_start_us":5021,"threads_started":1,"wal-append.queue_time_us":118506}
I20260709 12:12:12.221520 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:12.222281 22448 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:12.224939 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:12.226249 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:12.229293 22455 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 1120) took 1968 ms (client timeout 1808 ms). Trace:
W20260709 12:12:12.229732 22455 rpcz_store.cc:269] 0709 12:12:10.260531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.291569 (+ 31038us) service_pool.cc:224] Handling call
0709 12:12:12.228915 (+1937346us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b54003f34d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:12.229115 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":607158656}
I20260709 12:12:12.232600 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:12.233485 22449 raft_consensus.cc:2410] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
W20260709 12:12:12.233899 22449 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2986) took 1649 ms (client timeout 1522 ms). Trace:
W20260709 12:12:12.234244 22449 rpcz_store.cc:269] 0709 12:12:10.583984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.613879 (+ 29895us) service_pool.cc:224] Handling call
0709 12:12:12.232332 (+1618453us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b5800002a98. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf8f40a0 00007f9ccf8f3984 00007f9cc8e6e6d4 00007f9cc8e6e662
0709 12:12:12.233838 (+  1506us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31700736}
I20260709 12:12:12.239655 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:12.240495 22450 raft_consensus.cc:2393] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 17: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:12.241302 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:12.241797 22450 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:12.245783 28033 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:12.246491 28033 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:12.272243 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:12.273324 22453 raft_consensus.cc:2368] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 14. Current term is 15.
I20260709 12:12:12.210254 27966 raft_consensus.cc:2749] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353) with higher term. Message: Invalid argument: T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 15. Current term is 16.
I20260709 12:12:12.275907 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:12:12.282804 22525 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.946s	user 0.029s	sys 0.042s
W20260709 12:12:12.283236 22525 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.950s	user 0.029s	sys 0.042s
I20260709 12:12:12.284176 22525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 1168) took 1057 ms. Trace:
I20260709 12:12:12.284521 22525 rpcz_store.cc:276] 0709 12:12:11.226639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:11.228499 (+  1860us) service_pool.cc:224] Handling call
0709 12:12:11.228897 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:11.229147 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:12:11.332634 (+103487us) log.cc:844] Serialized 14 byte log entry
0709 12:12:12.283654 (+951020us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:12.283757 (+   103us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:12.283862 (+   105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:12.283945 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:12.284107 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":103869,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":56,"thread_start_us":950637,"threads_started":1,"wal-append.queue_time_us":198594}
I20260709 12:12:12.287304 28033 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:12.287338 28185 consensus_queue.cc:1059] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:12.288125 28033 consensus_queue.cc:1059] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:12.290171 28354 raft_consensus.cc:3055] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:12.290585 28354 raft_consensus.cc:740] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:12.291461 28286 consensus_queue.cc:1048] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:12.291666 28354 consensus_queue.cc:260] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:12.293249 28354 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:12.294414 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:12.297398 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 85034.6us
I20260709 12:12:12.297657 22448 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 20.
I20260709 12:12:12.295159 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:12.298719 22457 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:12.300038 22530 raft_consensus.cc:1275] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 12:12:12.301179 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:12:12.303169 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.300779 22530 pending_rounds.cc:85] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting all ops after (but not including) 9
I20260709 12:12:12.304330 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:12.304566 22452 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 16.
I20260709 12:12:12.290848 28280 raft_consensus.cc:3055] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:12.309719 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:12.316766 28262 consensus_queue.cc:1059] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:12.320439 28262 raft_consensus.cc:3055] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:12.320844 28262 raft_consensus.cc:740] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:12.320894 28374 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:12.321794 28374 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:12.322353 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:12.322110 28262 consensus_queue.cc:260] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:12.323419 22455 raft_consensus.cc:2410] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 12:12:12.323788 28362 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:12.324486 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:12.326031 28374 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:12.328500 22532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 2490) took 2419 ms. Trace:
I20260709 12:12:12.329000 22532 rpcz_store.cc:276] 0709 12:12:09.908692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.265951 (+357259us) service_pool.cc:224] Handling call
0709 12:12:10.266237 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:10.369260 (+103023us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:10.369292 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:10.380544 (+ 11252us) log.cc:844] Serialized 26 byte log entry
0709 12:12:10.506359 (+125815us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:12:10.506402 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:12.327773 (+1821371us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b54004006d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:12.327860 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:12.327944 (+    84us) raft_consensus.cc:1685] finished
0709 12:12:12.327960 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:12.328299 (+   339us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":203,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":10390,"spinlock_wait_cycles":236122496,"thread_start_us":125527,"threads_started":1,"wal-append.queue_time_us":186948,"wal-append.run_cpu_time_us":2990,"wal-append.run_wall_time_us":1223784}
W20260709 12:12:12.331780 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.332479 22598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2780) took 5123 ms. Trace:
I20260709 12:12:12.332835 22598 rpcz_store.cc:276] 0709 12:12:07.209144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:07.601842 (+392698us) service_pool.cc:224] Handling call
0709 12:12:07.602241 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:08.047557 (+445316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:08.047590 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:09.830821 (+1783231us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b2c000fd4f8. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc9227a11 00007f9cc9237372 00007f9cca969a01 00007f9cca92e43a 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2
0709 12:12:09.831277 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 12:12:10.116324 (+285047us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:10.116369 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:12.331990 (+2215621us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b5400448754. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:12.332060 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:12.332111 (+    51us) raft_consensus.cc:1685] finished
0709 12:12:12.332121 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:12.332314 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3501,"raft.queue_time_us":120907,"raft.run_cpu_time_us":54,"raft.run_wall_time_us":53,"spinlock_wait_cycles":88839424,"thread_start_us":547508,"threads_started":2,"wal-append.queue_time_us":406250,"wal-append.run_cpu_time_us":2582,"wal-append.run_wall_time_us":1290471}
I20260709 12:12:12.336607 28262 raft_consensus.cc:3060] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:12.321111 22606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43070 (request call id 978) took 5469 ms. Trace:
I20260709 12:12:12.339285 22606 rpcz_store.cc:276] 0709 12:12:06.852094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:07.262712 (+410618us) service_pool.cc:224] Handling call
0709 12:12:07.263002 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:07.263212 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:12:07.300684 (+ 37472us) log.cc:844] Serialized 14 byte log entry
0709 12:12:10.070500 (+2769816us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b18002a8bc0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc7823e07 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc7840c02 00007f9cca4c820b 00007f9cca4cdd23 00007f9cca4ce23a 00007f9cca938a2a
0709 12:12:10.341369 (+270869us) log.cc:844] Serialized 14 byte log entry
0709 12:12:11.693299 (+1351930us) spinlock_profiling.cc:243] Waited 2.08 ms on lock 0x7b18002a8bc0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc7841522 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd 0000000000388634 0000000000388479 00007f9cc782483a
0709 12:12:12.320116 (+626817us) spinlock_profiling.cc:243] Waited 5.39 ms on lock 0x7b18002a8bc0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc77bbc0a 00007f9cd0efb219 00007f9cc7843a40 00007f9cc783e4e4 00007f9cc783e455 00007f9cca926060 00007f9cca938716 00007f9cca949287 00007f9cca949208
0709 12:12:12.320452 (+   336us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:12.320537 (+    85us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:12:12.320615 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:12.320732 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:12.320887 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25723,"prepare.queue_time_us":37369,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":15110,"raft.queue_time_us":29831,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":8057,"spinlock_wait_cycles":24822144,"thread_start_us":250541,"threads_started":1,"wal-append.queue_time_us":3085090,"wal-append.run_cpu_time_us":3001,"wal-append.run_wall_time_us":1353342}
I20260709 12:12:12.342134 28338 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:12.344868 22421 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:12.345988 27966 raft_consensus.cc:2749] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:12.348981 22421 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:12.349814 27966 raft_consensus.cc:2749] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:12:12.351752 22455 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 16.
W20260709 12:12:12.359138 22600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45562 (request call id 2812) took 2602 ms (client timeout 2334 ms). Trace:
W20260709 12:12:12.359543 22600 rpcz_store.cc:269] 0709 12:12:09.756393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.259253 (+502860us) service_pool.cc:224] Handling call
0709 12:12:12.358728 (+2099475us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b54002de954. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:12.358950 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":470801152}
W20260709 12:12:12.362478 22456 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 2987) took 1778 ms (client timeout 2116 ms). Trace:
W20260709 12:12:12.362855 22456 rpcz_store.cc:269] 0709 12:12:10.584177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.624840 (+ 40663us) service_pool.cc:224] Handling call
0709 12:12:10.693069 (+ 68229us) spinlock_profiling.cc:243] Waited 2.88 ms on lock 0x7b5800002a98. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf8f40a0 00007f9ccf8f3984 00007f9cc8e6e6d4 00007f9cc8e6e662
0709 12:12:12.362127 (+1669058us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b5400264dd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:12.362320 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":900099072}
I20260709 12:12:12.311623 28280 raft_consensus.cc:740] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:12.367300 28391 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:12.367599 28280 consensus_queue.cc:260] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:12.369006 28280 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:12.366423 22456 raft_consensus.cc:1275] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:12:12.352443 22421 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:12.357967 22524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 1142) took 2463 ms. Trace:
I20260709 12:12:12.310196 22530 pending_rounds.cc:107] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 12:12:12.372960 22530 raft_consensus.cc:2889] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:12.379339 22448 raft_consensus.cc:2468] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 13.
I20260709 12:12:12.390134 22450 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 15.
I20260709 12:12:12.390789 22457 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 21.
I20260709 12:12:12.372805 22524 rpcz_store.cc:276] 0709 12:12:09.895024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:09.895169 (+   145us) service_pool.cc:224] Handling call
0709 12:12:09.895543 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:10.190994 (+295451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:12.357535 (+2166541us) spinlock_profiling.cc:243] Waited 77.9 ms on lock 0x7b5400230d54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:12.357794 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":179099008}
I20260709 12:12:12.395288 22450 raft_consensus.cc:1275] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 12:12:12.403317 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:12.403882 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:12.405467 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.388005 28391 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:12:12.419849 22526 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56940 (request call id 2497) took 2161 ms (client timeout 2325 ms). Trace:
I20260709 12:12:12.419730 28391 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:12.420329 22526 rpcz_store.cc:269] 0709 12:12:10.258572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.259136 (+   564us) service_pool.cc:224] Handling call
0709 12:12:12.419401 (+2160265us) spinlock_profiling.cc:243] Waited 71.8 ms on lock 0x7b54003f07d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:12.419639 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":165250304}
I20260709 12:12:12.421926 28391 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:12.424522 22450 raft_consensus.cc:1240] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:12:12.397194 28465 raft_consensus.cc:2749] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:12.429085 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:12.430205 22529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38310 (request call id 1170) took 1005 ms. Trace:
I20260709 12:12:12.397975 27966 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:12.433598 27966 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:12.433952 27966 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:12.430588 22529 rpcz_store.cc:276] 0709 12:12:11.425343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:11.425549 (+   206us) service_pool.cc:224] Handling call
0709 12:12:12.430111 (+1004562us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:12.451095 22421 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:12.454617 22453 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 18.
W20260709 12:12:12.460718 22497 connection.cc:256] RPC call timeout handler was delayed by -1.1868070720001924s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15480000000000002s for a response
W20260709 12:12:12.455834 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 2.09071e+06us
W20260709 12:12:12.467259 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 149752us
I20260709 12:12:12.464758 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:12:12.465798 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 65176.1us
I20260709 12:12:12.469333 22421 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:12:12.466212 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 180691us
I20260709 12:12:12.468006 23120 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:12.464823 28338 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:12.475179 28386 raft_consensus.cc:2804] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:12:12.487546 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.487422 23087 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:12.495996 28386 raft_consensus.cc:697] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:12.488044 28115 raft_consensus.cc:2804] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:12:12.496096 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.498253 28386 consensus_queue.cc:237] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:12.498337 23087 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:12.503232 23087 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:12.498647 28411 raft_consensus.cc:2804] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:12.504482 28411 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:12.504829 28411 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:12.499094 28115 raft_consensus.cc:697] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 11 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:12.507573 22421 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:12.508353 28115 consensus_queue.cc:237] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:12.491061 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:12.509788 23116 raft_consensus.cc:2393] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 13: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:12.509200 22421 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:12.511375 28181 raft_consensus.cc:2804] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:12.508898 28391 raft_consensus.cc:2749] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:12.511794 28181 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:12.512264 28181 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:12.511857 28465 raft_consensus.cc:2804] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:12.513298 28465 raft_consensus.cc:697] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:12.514245 28465 consensus_queue.cc:237] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:12.517168 28477 raft_consensus.cc:2804] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:12.517817 28477 raft_consensus.cc:697] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 18 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:12.522413 28477 consensus_queue.cc:237] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:12.527026 27966 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:12.490624 23120 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 15.
I20260709 12:12:12.563427 22421 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:12.565212 28403 raft_consensus.cc:2804] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:12.565785 28403 raft_consensus.cc:697] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
W20260709 12:12:12.569146 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 96554us
I20260709 12:12:12.568681 28411 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:12.586891 22449 raft_consensus.cc:1275] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 12:12:12.572652 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 69548us
I20260709 12:12:12.561286 27966 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:12.599274 28026 consensus_queue.cc:1059] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.007s
I20260709 12:12:12.601150 28250 raft_consensus.cc:1064] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
W20260709 12:12:12.601641 28250 raft_consensus.cc:1068] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f: Unable to promote non-voter 8701cd5186a949538d8efafb5f987270: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:12:12.601589 22451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 3003) took 1212 ms. Trace:
I20260709 12:12:12.602275 22451 rpcz_store.cc:276] 0709 12:12:11.389101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:11.870418 (+481317us) service_pool.cc:224] Handling call
0709 12:12:11.870865 (+   447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:12.108352 (+237487us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:12:12.108631 (+   279us) log.cc:844] Serialized 14 byte log entry
0709 12:12:12.123837 (+ 15206us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:12.123926 (+    89us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:12.123979 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:12.490763 (+366784us) spinlock_profiling.cc:243] Waited 908 us on lock 0x7b1800412240. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc780f2a6 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419
0709 12:12:12.601366 (+110603us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b54002a5654. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:12.601410 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:12.601535 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10925,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":2247,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":963,"spinlock_wait_cycles":547670144,"thread_start_us":12629,"threads_started":1,"wal-append.queue_time_us":16625}
I20260709 12:12:12.602747 28115 raft_consensus.cc:1064] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
W20260709 12:12:12.604796 28115 raft_consensus.cc:1068] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f: Unable to promote non-voter 8701cd5186a949538d8efafb5f987270: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:12:12.566821 28403 consensus_queue.cc:237] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:12.607547 22496 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:12.604212 22495 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:12.586915 28338 consensus_queue.cc:1059] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 12:12:12.620131 28115 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.624415 28115 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:12.627950 28523 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:12.628746 28523 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:12.637493 28411 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:12.635825 28115 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:12.644134 28523 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:12.650168 28338 raft_consensus.cc:3055] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:12:12.650259 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 59743.5us
I20260709 12:12:12.650851 28338 raft_consensus.cc:740] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:12.652092 28338 consensus_queue.cc:260] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:12.653491 28480 raft_consensus.cc:2749] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:12.653880 22496 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:12.654327 28480 consensus_queue.cc:1048] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:12.655164 28262 consensus_queue.cc:1048] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:12:12.645920 28524 log.cc:927] Time spent T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:12:12.653628 28338 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:12.665323 28185 consensus_queue.cc:1059] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 12:12:12.678747 28185 consensus_queue.cc:1243] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer 8701cd5186a949538d8efafb5f987270 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:12:12.679502 28185 raft_consensus.cc:3055] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:12.679914 28185 raft_consensus.cc:740] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:12.681730 28362 raft_consensus.cc:2749] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:12:12.684013 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 79921.8us
I20260709 12:12:12.685123 22495 leader_election.cc:400] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 10. Current term is 11.
I20260709 12:12:12.685484 22495 leader_election.cc:403] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:12.686359 28266 raft_consensus.cc:2749] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 10. Current term is 11.
I20260709 12:12:12.665184 28026 raft_consensus.cc:2749] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:12.659224 28480 consensus_queue.cc:1059] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 12:12:12.689296 28480 raft_consensus.cc:3055] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:12.689723 28480 raft_consensus.cc:740] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:12.681097 28185 consensus_queue.cc:260] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:12.686431 22495 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:12:12.697250 22495 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:12.690786 28480 consensus_queue.cc:260] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:12.719880 28185 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:12.769083 28480 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:12.722795 28506 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:12.724287 23087 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:12.732924 22495 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:12:12.771986 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 47840.6us
W20260709 12:12:12.745182 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.750062 28519 raft_consensus.cc:2804] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:12.772763 23087 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:12.750691 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:12.751842 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:12.773121 28526 raft_consensus.cc:2749] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:12.773624 22532 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:12.774560 23087 leader_election.cc:400] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 14. Current term is 15.
I20260709 12:12:12.750661 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:12.754957 28517 raft_consensus.cc:3055] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:12.775241 28517 raft_consensus.cc:740] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:12.775336 28354 raft_consensus.cc:2749] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:12.749948 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:12.776830 22529 raft_consensus.cc:2393] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 21: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:12.776295 28517 consensus_queue.cc:260] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:12.777544 28523 raft_consensus.cc:2749] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:12.777743 28517 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:12.772817 28519 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:12.778082 28354 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:12.778474 28519 raft_consensus.cc:3060] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:12.774871 23087 leader_election.cc:403] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:12.778625 28354 raft_consensus.cc:697] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:12.773633 22524 raft_consensus.cc:2468] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 13.
I20260709 12:12:12.782873 28354 consensus_queue.cc:237] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.14, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:12.780515 28526 raft_consensus.cc:2749] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 14. Current term is 15.
I20260709 12:12:12.787835 23087 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:12:12.792807 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.792701 23087 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:12.794014 28523 raft_consensus.cc:2804] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:12.794503 28523 raft_consensus.cc:697] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 16 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:12.795442 28523 consensus_queue.cc:237] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:12.798705 28519 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:12.800750 28519 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:12.801338 28526 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:12.808888 22532 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 21.
W20260709 12:12:12.815267 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:12.819870 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 47573.2us
I20260709 12:12:12.849301 28526 raft_consensus.cc:697] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 20 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:12.861446 22421 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:12:12.862717 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 48338.1us
I20260709 12:12:12.863529 22421 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:12:12.865617 28506 raft_consensus.cc:2749] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:12.865818 22532 raft_consensus.cc:1240] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:12.866025 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:12.866847 22453 raft_consensus.cc:2393] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 18: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:12.867043 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:12.850788 28526 consensus_queue.cc:237] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:12.867610 22524 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 15.
I20260709 12:12:12.869346 28185 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:12.870021 28185 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:12.871891 22421 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:12.872076 23088 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:12.872380 28185 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:12.873049 28337 raft_consensus.cc:2804] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:12.873457 28337 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:12.873816 28337 raft_consensus.cc:3060] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:12.877367 22570 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:12.877633 23087 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:12.850493 28533 consensus_queue.cc:1048] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.029s
W20260709 12:12:12.880156 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:12.880612 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:12.880934 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.881174 28533 consensus_queue.cc:1048] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:12.891667 28337 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:12.893941 28029 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:12.894526 28029 raft_consensus.cc:697] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:12.895606 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:12.897507 28533 raft_consensus.cc:2804] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:12.897980 28533 raft_consensus.cc:697] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 15 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:12.898866 28533 consensus_queue.cc:237] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:12.907409 22530 raft_consensus.cc:2468] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 13.
W20260709 12:12:12.904964 22495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.910718 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:12.918120 22421 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:12.921744 22456 raft_consensus.cc:1240] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 LEADER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:12.929925 28185 consensus_queue.cc:1059] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:12:12.932487 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.930776 28185 consensus_queue.cc:1243] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer c863116d91c14d1ca50d6e8a46a37a8f log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
W20260709 12:12:12.942847 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 70885us
I20260709 12:12:12.920745 28536 consensus_queue.cc:1048] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 12:12:12.946911 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:12.947568 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:12.948657 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:12.954228 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:12.940796 28337 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:12.948179 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:12.936730 28523 raft_consensus.cc:2749] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:12.959301 22605 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 20.
I20260709 12:12:12.958510 23088 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:12.961306 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:12.962658 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:12.963295 22604 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:12.963828 28536 raft_consensus.cc:2804] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:12.964268 28536 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:12.964747 28536 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:12.964953 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:12.965514 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:12.965802 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.967308 22598 raft_consensus.cc:2393] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 15: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:12.967774 22606 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
I20260709 12:12:12.971068 28029 consensus_queue.cc:237] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:12.973241 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 45096.2us
I20260709 12:12:12.975215 23122 raft_consensus.cc:2393] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 13: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:12.977106 28026 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.977849 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:12.977669 28026 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:12.978543 22597 raft_consensus.cc:2393] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 15: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:12.978468 23087 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:12.979317 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:12.979804 28026 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:12.980283 28538 consensus_queue.cc:1059] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 12:12:12.983774 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:12.985250 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:12.986438 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:12.986294 28506 consensus_queue.cc:1059] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:12.987083 28534 raft_consensus.cc:2804] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:12.988049 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:12.988853 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:12.991573 22606 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:12.982555 28477 consensus_queue.cc:1048] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 12:12:12.987120 23121 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
I20260709 12:12:12.996577 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:12.988528 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:12.997972 22456 raft_consensus.cc:2410] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:12:12.998880 22605 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 17.
I20260709 12:12:12.985267 28250 raft_consensus.cc:2804] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:13.014321 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:13.014381 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:13.019963 22602 raft_consensus.cc:2410] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:12:13.019917 22604 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
I20260709 12:12:13.021416 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:13.022387 23118 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:13.033430 23119 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:13.035508 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:13.040125 22524 raft_consensus.cc:1275] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:12:13.052726 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:13.053369 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:13.054171 22598 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:13.054800 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:13.055467 22605 raft_consensus.cc:2376] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 14. Re-sending same reply.
I20260709 12:12:12.706787 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:13.056674 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:13.060917 23123 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 17.
I20260709 12:12:13.028985 28026 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.073679 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:13.073521 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:13.061571 28550 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:13.080744 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 127553us
I20260709 12:12:13.081215 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:13.071488 28519 raft_consensus.cc:3055] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:13.077088 28534 raft_consensus.cc:697] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 18 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:13.080497 22604 raft_consensus.cc:2376] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 15. Re-sending same reply.
I20260709 12:12:13.087488 28519 raft_consensus.cc:740] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:13.085405 28538 consensus_queue.cc:1048] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:13.088454 28519 consensus_queue.cc:260] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:13.089735 28519 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:13.090040 28534 consensus_queue.cc:237] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:13.086443 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 98664.7us
I20260709 12:12:13.093631 22496 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:13.094785 22602 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 16.
I20260709 12:12:13.104450 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:13.105940 23120 raft_consensus.cc:1240] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:13.108049 22453 raft_consensus.cc:1275] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:13.074970 28026 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:13.110188 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:13.110563 28026 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:13.111238 22456 raft_consensus.cc:2393] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 15: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:13.116129 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:13.116765 22451 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:13.127592 23119 raft_consensus.cc:2410] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 17 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 12:12:13.129706 23118 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
I20260709 12:12:13.132153 23118 raft_consensus.cc:1275] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:13.141943 22451 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 15.
I20260709 12:12:13.132721 22422 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:13.143913 22496 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:12:13.135993 28181 consensus_meta.cc:287] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.623s	user 0.014s	sys 0.000s
I20260709 12:12:13.149976 23087 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:13.153193 22496 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:13.131304 28532 raft_consensus.cc:2804] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:13.092515 28550 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:13.148787 28250 raft_consensus.cc:697] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 13 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:13.124835 28538 consensus_queue.cc:1048] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 12:12:13.147071 28286 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.154053 28533 raft_consensus.cc:2804] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:13.156942 28532 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:13.168076 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:13.157850 28026 raft_consensus.cc:2749] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:13.157451 28506 raft_consensus.cc:2749] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:13.170207 22524 raft_consensus.cc:1275] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:12:13.170487 23118 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 9.
I20260709 12:12:13.161743 28266 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:13.179867 28544 consensus_queue.cc:1048] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:12:13.155445 28181 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:13.197607 28550 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:13.196882 28181 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:13.198378 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:13.197677 22606 raft_consensus.cc:2468] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 13.
I20260709 12:12:13.190466 28286 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:13.201742 28286 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:13.188131 28536 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:13.171782 28532 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:13.179018 28553 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:13.191738 22422 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:13.173403 28533 raft_consensus.cc:697] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 15 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:13.199527 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:13.227974 22451 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:13.191069 28266 raft_consensus.cc:697] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:13.203395 22598 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 21.
I20260709 12:12:13.222030 22529 raft_consensus.cc:1275] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 12:12:13.229348 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 753154us
I20260709 12:12:13.230588 28250 consensus_queue.cc:237] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:13.230793 28533 consensus_queue.cc:237] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:13.235970 28266 consensus_queue.cc:237] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:13.244364 28544 raft_consensus.cc:2804] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:13.244918 28544 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:13.245303 28544 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:12:13.247385 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 55753.7us
I20260709 12:12:13.248193 22422 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:13.249507 22422 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:13.258641 22451 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 18.
I20260709 12:12:13.234267 28181 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:13.267014 28250 raft_consensus.cc:2749] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:13.284926 28541 raft_consensus.cc:2749] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:13.279248 28538 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.291812 22530 raft_consensus.cc:1275] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:13.232158 28553 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:13.294165 28536 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:12:13.294306 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.295337 28506 consensus_queue.cc:1048] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:12:13.295922 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:13.308446 28538 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:13.296590 22526 raft_consensus.cc:1275] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:12:13.293573 22422 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:13.318249 22523 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 15.
I20260709 12:12:13.319837 23088 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:13.310972 28538 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:13.327450 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:13.327993 22495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.303297 28386 consensus_queue.cc:1048] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 12:12:13.328608 28532 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:13.297299 28181 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:13.327486 28477 raft_consensus.cc:3055] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:13.333884 28386 consensus_queue.cc:1243] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer 1676e7af5e4a47cb86ee7db83e3d4881 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:12:13.321702 28250 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:13.336545 28542 raft_consensus.cc:3055] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:13.339555 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:13.309932 28553 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:13.344020 28536 raft_consensus.cc:2804] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:13.376143 28536 raft_consensus.cc:697] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 15 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:13.376876 28542 raft_consensus.cc:740] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:13.377118 28536 consensus_queue.cc:237] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:13.321125 28533 consensus_queue.cc:1048] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 12:12:13.377843 28542 consensus_queue.cc:260] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:13.379357 28542 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:13.381603 28252 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:13.382177 28252 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:13.373766 28250 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:13.383446 28250 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:13.384722 28252 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:13.382465 28544 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:13.391017 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.395422 23117 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 17.
I20260709 12:12:13.369141 22496 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:13.369946 28477 raft_consensus.cc:740] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:13.402218 22496 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:12:13.404013 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 111156us
I20260709 12:12:13.414005 22422 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:13.403342 28544 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:13.405260 28266 raft_consensus.cc:2804] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:13.425256 28543 raft_consensus.cc:2749] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:13.426729 22422 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:13.432387 28181 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:13.436156 22603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2806) took 3739 ms. Trace:
I20260709 12:12:13.436738 22603 rpcz_store.cc:276] 0709 12:12:09.694149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.344956 (+650807us) service_pool.cc:224] Handling call
0709 12:12:10.350526 (+  5570us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:13.169487 (+2818961us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:13.173919 (+  4432us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:13.177118 (+  3199us) log.cc:844] Serialized 26 byte log entry
0709 12:12:13.305130 (+128012us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:12:13.305167 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:13.305251 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:13.429535 (+124284us) raft_consensus.cc:1685] finished
0709 12:12:13.429566 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:13.433686 (+  4120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2766767,"thread_start_us":134267,"threads_started":2,"wal-append.queue_time_us":233779}
W20260709 12:12:13.450605 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:13.434845 28338 consensus_meta.cc:287] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.769s	user 0.014s	sys 0.000s
I20260709 12:12:13.428531 28544 raft_consensus.cc:2749] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:13.453207 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.452622 28477 consensus_queue.cc:260] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:13.456547 28477 raft_consensus.cc:3060] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:13.462524 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:13.463332 22451 raft_consensus.cc:2393] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 15: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:13.465821 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:13.466555 22457 raft_consensus.cc:2468] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 12.
W20260709 12:12:13.468317 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:13.468753 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:13.471506 28465 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.801s	user 0.013s	sys 0.019s
W20260709 12:12:13.471879 28465 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.806s	user 0.013s	sys 0.019s
I20260709 12:12:13.472198 28269 raft_consensus.cc:2749] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:13.472911 28269 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:13.473486 28269 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:13.476243 28269 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:13.477238 28547 raft_consensus.cc:1064] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
I20260709 12:12:13.480724 28547 consensus_queue.cc:237] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:13.483825 28250 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:13.486615 28250 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:13.486670 22456 raft_consensus.cc:1275] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:12:13.488408 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:13.489089 22457 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 10.
I20260709 12:12:13.489289 28532 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:13.490378 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:13.493296 28286 raft_consensus.cc:2804] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:13.493690 28286 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:13.493994 28286 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:13.496004 22422 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:13.496636 28544 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.497144 28544 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:13.497557 22422 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:13.499305 28543 raft_consensus.cc:2804] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:13.499162 28465 raft_consensus.cc:2749] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:13.500126 28543 raft_consensus.cc:697] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:13.501379 23087 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:13.502488 28181 raft_consensus.cc:2804] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:12:13.503257 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:13.509035 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 104972us
I20260709 12:12:13.502993 28181 raft_consensus.cc:697] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 18 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:13.519111 28181 consensus_queue.cc:237] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:13.522073 28266 raft_consensus.cc:697] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:13.525782 22449 raft_consensus.cc:1240] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 11. Current term is 12. Ops: []
W20260709 12:12:13.528771 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.533571 22496 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:13.535147 28555 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.537554 28544 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:13.535763 28519 raft_consensus.cc:2804] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:13.538341 28519 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:13.539949 22532 pending_rounds.cc:85] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting all ops after (but not including) 10
I20260709 12:12:13.540334 22532 pending_rounds.cc:107] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 12:12:13.540596 22532 raft_consensus.cc:2889] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:12:13.543777 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.544749 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:13.545786 22529 raft_consensus.cc:2393] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 17: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:13.546902 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:13.547753 22523 raft_consensus.cc:2410] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 12:12:13.550519 28250 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:13.551040 28250 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:13.553184 28250 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:13.551326 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:13.554111 23123 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:13.558777 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 61317.7us
I20260709 12:12:13.559665 28286 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:13.561086 22422 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:13.561810 28286 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:13.564210 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:13.564821 22523 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 16.
I20260709 12:12:13.565249 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:13.565791 23119 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:12:13.566908 22422 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:13.571414 28544 consensus_queue.cc:1048] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:13.573146 28544 raft_consensus.cc:2804] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:13.573520 28544 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:13.573863 28544 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:13.576545 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:13.538866 28519 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:13.580680 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:12:13.583287 28575 log.cc:927] Time spent T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 12:12:13.583498 28280 consensus_queue.cc:1048] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:13.587073 23119 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
I20260709 12:12:13.592980 23117 raft_consensus.cc:2393] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 16: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:13.594264 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:13.621013 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 54179us
I20260709 12:12:13.596201 23087 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:13.624643 22456 raft_consensus.cc:1275] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:13.535678 28555 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:13.632761 22457 raft_consensus.cc:1275] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:12:13.631165 23123 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 16.
I20260709 12:12:13.595907 28029 raft_consensus.cc:2804] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:13.634652 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:13.638285 22451 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:13.621693 28517 consensus_queue.cc:1059] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:12:13.647019 28517 raft_consensus.cc:3055] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:13.647475 28517 raft_consensus.cc:740] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:13.648394 28517 consensus_queue.cc:260] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:13.649644 28517 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:13.631686 28179 raft_consensus.cc:2804] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:13.656740 22457 raft_consensus.cc:1275] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 12:12:13.660342 23089 leader_election.cc:336] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Timed out: RequestConsensusVote RPC to 127.20.196.131:37785 timed out after 1.544s (SENT)
I20260709 12:12:13.501401 28543 consensus_queue.cc:237] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:13.664451 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 78715.2us
I20260709 12:12:13.664515 23089 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:13.674247 22496 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:13.635583 28523 consensus_queue.cc:1048] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:12:13.651664 28029 raft_consensus.cc:697] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:13.663116 28179 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:13.670157 28538 raft_consensus.cc:2749] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:13.691572 28179 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:13.695645 28029 consensus_queue.cc:237] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:13.699272 28337 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:13.706621 22349 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55962 (request call id 345) took 26122 ms (client timeout 15000 ms). Trace:
W20260709 12:12:13.705458 22627 debug-util.cc:398] Leaking SignalData structure 0x7b080024d880 after lost signal to thread 21269
I20260709 12:12:13.659592 28550 consensus_queue.cc:1048] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:12:13.728240 22451 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
W20260709 12:12:13.731051 22627 debug-util.cc:398] Leaking SignalData structure 0x7b08002ab700 after lost signal to thread 22389
I20260709 12:12:13.707618 23123 raft_consensus.cc:1275] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 12:12:13.731952 28584 raft_consensus.cc:2804] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:12:13.731827 28337 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:13.722668 28580 log.cc:927] Time spent T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:12:13.732563 28584 raft_consensus.cc:697] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:13.685115 28181 consensus_queue.cc:1048] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 12:12:13.733455 28584 consensus_queue.cc:237] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:13.701293 28542 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:13.728266 23119 raft_consensus.cc:1275] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 10 LEARNER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 12:12:13.736919 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 62743.6us
I20260709 12:12:13.734213 28337 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:13.737640 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:13.742723 28179 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:13.743885 28555 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:13.744531 28181 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.745054 28181 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:13.745554 28179 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:13.746188 22627 debug-util.cc:398] Leaking SignalData structure 0x7b080015cc60 after lost signal to thread 22481
W20260709 12:12:13.747402 22627 debug-util.cc:398] Leaking SignalData structure 0x7b0800277fc0 after lost signal to thread 22556
W20260709 12:12:13.747673 22627 debug-util.cc:398] Leaking SignalData structure 0x7b080042c440 after lost signal to thread 22557
I20260709 12:12:13.747597 28181 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317)
W20260709 12:12:13.748960 22627 debug-util.cc:398] Leaking SignalData structure 0x7b08003dd5a0 after lost signal to thread 22630
W20260709 12:12:13.749233 22627 debug-util.cc:398] Leaking SignalData structure 0x7b08003992c0 after lost signal to thread 22631
W20260709 12:12:13.750370 22627 debug-util.cc:398] Leaking SignalData structure 0x7b0800412fa0 after lost signal to thread 23149
W20260709 12:12:13.750629 22627 debug-util.cc:398] Leaking SignalData structure 0x7b08000ea060 after lost signal to thread 23150
W20260709 12:12:13.751416 28576 log.cc:927] Time spent T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.288s	user 0.004s	sys 0.000s
I20260709 12:12:13.734722 28542 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:13.754043 28542 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:13.758168 22496 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:12:13.750862 22627 debug-util.cc:398] Leaking SignalData structure 0x7b0800353620 after lost signal to thread 27851
I20260709 12:12:13.761309 23119 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 17.
I20260709 12:12:13.761678 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:12:13.745023 28581 log.cc:927] Time spent T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:12:13.763911 22421 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:13.764444 23117 raft_consensus.cc:2393] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 15: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:13.651759 28266 consensus_queue.cc:237] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:13.770524 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 110225us
I20260709 12:12:13.773185 22421 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:12:13.776293 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:13.787463 28583 log.cc:927] Time spent T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:12:13.787513 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:13.788812 22529 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 15.
W20260709 12:12:13.795562 23089 leader_election.cc:336] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Timed out: RequestConsensusVote RPC to 127.20.196.131:37785 timed out after 1.635s (SENT)
I20260709 12:12:13.796037 23089 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:13.789178 22526 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 19.
I20260709 12:12:13.774960 28465 raft_consensus.cc:2804] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:13.759271 28391 consensus_queue.cc:1048] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 12:12:13.799170 22421 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:12:13.785167 28362 raft_consensus.cc:2804] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:13.779268 28541 raft_consensus.cc:2804] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:13.767695 28542 consensus_queue.cc:1048] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:12:13.804018 23088 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:13.809166 28362 raft_consensus.cc:697] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:13.804450 28533 raft_consensus.cc:2749] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:13.813424 28362 consensus_queue.cc:237] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:13.819141 28550 raft_consensus.cc:2804] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:13.819609 28550 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:13.819944 28550 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:13.804956 28541 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:13.820868 28541 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:13.799427 28465 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:13.823304 28465 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:13.828480 22627 debug-util.cc:398] Leaking SignalData structure 0x7b08003743c0 after lost signal to thread 28311
W20260709 12:12:13.828925 22627 debug-util.cc:398] Leaking SignalData structure 0x7b08003fb1c0 after lost signal to thread 28324
W20260709 12:12:13.829269 22627 debug-util.cc:398] Leaking SignalData structure 0x7b08003d3d20 after lost signal to thread 28353
W20260709 12:12:13.829546 22627 debug-util.cc:398] Leaking SignalData structure 0x7b0800047340 after lost signal to thread 28357
W20260709 12:12:13.829766 22627 debug-util.cc:398] Leaking SignalData structure 0x7b08003e6160 after lost signal to thread 28363
W20260709 12:12:13.829965 22627 debug-util.cc:398] Leaking SignalData structure 0x7b080034c1a0 after lost signal to thread 28374
W20260709 12:12:13.830193 22627 debug-util.cc:398] Leaking SignalData structure 0x7b08000ea040 after lost signal to thread 28389
W20260709 12:12:13.830420 22627 debug-util.cc:398] Leaking SignalData structure 0x7b08003e4d80 after lost signal to thread 28401
W20260709 12:12:13.830662 22627 debug-util.cc:398] Leaking SignalData structure 0x7b08003cd8e0 after lost signal to thread 28431
W20260709 12:12:13.830907 22627 debug-util.cc:398] Leaking SignalData structure 0x7b08003e8060 after lost signal to thread 28446
W20260709 12:12:13.845271 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 935555us
I20260709 12:12:13.845714 28386 raft_consensus.cc:2804] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:13.846138 28386 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:13.846539 28386 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:13.730260 22349 rpcz_store.cc:269] 0709 12:11:47.584316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.633980 (+ 49664us) service_pool.cc:224] Handling call
0709 12:12:13.706411 (+26072431us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:08.796743 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:08.801771 (+  5028us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:08.801827 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:12:08.801846 (+    19us) tablet.cc:662] Decoding operations
0709 12:12:09.068789 (+266943us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:09.234898 (+166109us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:09.241758 (+  6860us) tablet.cc:685] Acquiring locks for 20 operations
0709 12:12:09.450414 (+208656us) tablet.cc:701] Row locks acquired
0709 12:12:09.450499 (+    85us) write_op.cc:260] PREPARE: finished
0709 12:12:09.450705 (+   206us) write_op.cc:270] Start()
0709 12:12:09.450867 (+   162us) write_op.cc:276] Timestamp: P: 1783599129450633 usec, L: 0
0709 12:12:09.450905 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 12:12:09.563749 (+112844us) log.cc:844] Serialized 7984 byte log entry
0709 12:12:09.932677 (+368928us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b5400198a54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca929e28 00007f9cce364581 00007f9cce363d58 00007f9cce3689f1 00007f9cce3689a9 00007f9cce368939 00007f9cce368901 00007f9cce367b2d 0000000000388634 0000000000388479
0709 12:12:10.414577 (+481900us) op_driver.cc:464] REPLICATION: finished
0709 12:12:10.708149 (+293572us) write_op.cc:301] APPLY: starting
0709 12:12:10.742361 (+ 34212us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:11.126536 (+384175us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:11.126576 (+    40us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:11.541190 (+414614us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:11.541734 (+   544us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=40,mrs_lookups=0
0709 12:12:11.541798 (+    64us) write_op.cc:312] APPLY: finished
0709 12:12:11.542501 (+   703us) log.cc:844] Serialized 180 byte log entry
0709 12:12:11.563261 (+ 20760us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:11.563469 (+   208us) write_op.cc:454] Released schema lock
0709 12:12:11.563548 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:11.564070 (+   522us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:11.564102 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1358129,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":259276,"apply.run_cpu_time_us":39136,"apply.run_wall_time_us":867439,"cfile_cache_hit":82,"cfile_cache_hit_bytes":87727,"num_ops":20,"prepare.queue_time_us":704699,"prepare.run_cpu_time_us":55362,"prepare.run_wall_time_us":1154757,"raft.queue_time_us":398663,"raft.run_cpu_time_us":16307,"raft.run_wall_time_us":237834,"replication_time_us":937605,"spinlock_wait_cycles":35562752,"thread_start_us":819694,"threads_started":5,"wal-append.queue_time_us":379649,"wal-append.run_cpu_time_us":24443,"wal-append.run_wall_time_us":2422792}]]}
I20260709 12:12:13.853344 22598 raft_consensus.cc:1240] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:13.854387 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:13.855038 22606 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:13.856849 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.860191 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:13.862440 28363 consensus_queue.cc:1048] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:13.862627 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:13.863796 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:13.864456 22453 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:13.863904 28363 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:13.865016 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 84567.9us
I20260709 12:12:13.867388 22606 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 17.
I20260709 12:12:13.874657 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:13.880995 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:13.886713 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:13.892128 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 607638us
I20260709 12:12:13.893035 22602 raft_consensus.cc:2368] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 10. Current term is 11.
I20260709 12:12:13.833321 28541 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:13.892472 23089 leader_election.cc:336] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Timed out: RequestConsensusVote RPC to 127.20.196.131:37785 timed out after 1.716s (SENT)
I20260709 12:12:13.899559 22452 raft_consensus.cc:1275] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:13.899690 23089 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:13.912786 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:13.915095 28363 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:13.924584 22606 raft_consensus.cc:1275] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
W20260709 12:12:13.927451 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 51483.1us
W20260709 12:12:13.938853 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.939306 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:13.947083 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:13.955787 22569 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:13.956059 22453 raft_consensus.cc:2468] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 13.
I20260709 12:12:13.965037 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:13.967446 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:13.972673 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:13.974998 22603 raft_consensus.cc:1240] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:13.950737 28411 raft_consensus.cc:2749] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:13.987293 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:13.977170 28587 log.cc:927] Time spent T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:12:13.998090 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:14.000479 22597 raft_consensus.cc:1275] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:12:14.001950 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:14.004927 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 123362us
I20260709 12:12:14.003844 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:14.016367 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:14.023720 22597 raft_consensus.cc:1275] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:12:13.973913 28519 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:14.032120 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 96915.7us
I20260709 12:12:14.033340 23121 raft_consensus.cc:1275] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
W20260709 12:12:14.034373 23089 leader_election.cc:336] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Timed out: RequestConsensusVote RPC to 127.20.196.131:37785 timed out after 1.789s (SENT)
I20260709 12:12:14.035446 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:14.074447 23087 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:14.076624 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:14.079389 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:14.082623 22525 raft_consensus.cc:2393] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 18: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:14.032757 28363 leader_election.cc:290] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:14.086280 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 119511us
I20260709 12:12:14.087530 22597 raft_consensus.cc:1275] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:12:14.088312 22452 raft_consensus.cc:1275] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:14.089378 22604 raft_consensus.cc:1275] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:12:14.094640 22526 raft_consensus.cc:1275] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:14.090533 23121 raft_consensus.cc:1275] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:12:14.070587 28185 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:14.097007 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 79555.4us
W20260709 12:12:14.097666 23089 leader_election.cc:336] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Timed out: RequestConsensusVote RPC to 127.20.196.131:37785 timed out after 1.800s (SENT)
I20260709 12:12:14.098050 23089 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:14.068028 28026 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.070484 28547 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:14.107609 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:14.154345 22601 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
I20260709 12:12:14.154168 28547 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:14.155332 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:14.155896 22601 raft_consensus.cc:2376] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 17. Re-sending same reply.
I20260709 12:12:14.156311 28547 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:14.156781 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:14.157404 22601 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
W20260709 12:12:14.157702 28594 log.cc:927] Time spent T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 12:12:14.107928 28589 log.cc:927] Time spent T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:12:14.108188 28558 raft_consensus.cc:2764] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:12:14.108232 28590 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:14.108829 28185 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:14.109618 28026 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:14.099171 28411 raft_consensus.cc:2804] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:12:14.111681 28588 log.cc:927] Time spent T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
W20260709 12:12:14.115620 28592 log.cc:927] Time spent T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 12:12:14.117780 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:14.134616 28591 consensus_queue.cc:1048] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 12:12:14.127311 22599 raft_consensus.cc:1275] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 12:12:14.131213 22569 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:14.140580 28386 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:14.145392 28465 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:14.152329 28519 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:14.032611 28544 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:14.169253 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 88163.8us
I20260709 12:12:14.212984 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:14.213657 22600 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 13.
W20260709 12:12:14.213809 28603 log.cc:927] Time spent T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.100s	user 0.000s	sys 0.002s
I20260709 12:12:14.214543 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:14.216051 22497 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.196.131:37785 timed out after 1.503s (SENT) [suppressed 54 similar messages]
I20260709 12:12:14.216769 28544 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:14.217713 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 85313.9us
I20260709 12:12:14.217811 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:14.182909 28590 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:14.222231 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:14.223021 22600 raft_consensus.cc:2368] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 10. Current term is 11.
I20260709 12:12:14.225492 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:14.180830 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:14.182467 22598 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 17.
I20260709 12:12:14.185623 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:14.118626 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:14.088608 28538 consensus_queue.cc:1048] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.088s
I20260709 12:12:14.183933 28553 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.181321 28541 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:14.191027 28565 log.cc:927] Time spent T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 12:12:14.190996 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 91224.8us
I20260709 12:12:14.191697 28269 raft_consensus.cc:2749] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:14.193027 28185 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:14.197444 28026 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:14.202189 22422 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:12:14.254442 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 52385us
I20260709 12:12:14.254443 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:14.204169 22524 raft_consensus.cc:1275] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:14.246291 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:14.260031 23120 raft_consensus.cc:2393] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 17: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:14.207259 28550 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:14.207710 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 110076us
I20260709 12:12:14.208132 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:14.188369 22599 pending_rounds.cc:85] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc: Aborting all ops after (but not including) 12
W20260709 12:12:14.269088 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 53063.5us
I20260709 12:12:14.211055 22606 raft_consensus.cc:1275] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:12:14.179757 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:14.236032 22532 raft_consensus.cc:1275] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:12:14.269120 22599 pending_rounds.cc:107] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 12:12:14.270192 22599 raft_consensus.cc:2889] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:14.187989 28534 raft_consensus.cc:2749] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:14.223237 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:14.270565 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:14.272507 22599 raft_consensus.cc:1240] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:14.239418 22523 raft_consensus.cc:2393] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 19: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:14.243443 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:14.275044 22600 raft_consensus.cc:1275] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 12:12:14.247799 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:14.250903 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:14.203814 28411 raft_consensus.cc:697] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 13 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:14.259768 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:14.235854 28262 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.261875 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:14.304116 22602 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:14.206475 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:14.263139 22529 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 16.
I20260709 12:12:14.265308 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:14.305433 22524 raft_consensus.cc:2393] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 14: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:14.265857 22455 raft_consensus.cc:1275] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
W20260709 12:12:14.284307 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:14.294094 23121 raft_consensus.cc:2393] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 16: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:14.294109 22531 raft_consensus.cc:1275] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:12:14.296844 22422 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:14.298198 22604 raft_consensus.cc:2410] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:12:14.299533 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:14.303004 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 45787.4us
I20260709 12:12:14.308422 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:12:14.321941 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 51880.6us
I20260709 12:12:14.235692 28181 consensus_queue.cc:1048] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 12:12:14.326861 23117 raft_consensus.cc:2368] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 19. Current term is 20.
I20260709 12:12:14.240015 28523 consensus_queue.cc:1048] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.067s
I20260709 12:12:14.335304 22527 raft_consensus.cc:1275] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:12:14.248270 28544 consensus_queue.cc:1048] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 12:12:14.304525 28590 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:14.362280 23089 leader_election.cc:336] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Timed out: RequestConsensusVote RPC to 127.20.196.131:37785 timed out after 1.929s (SENT)
I20260709 12:12:14.371117 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:14.246683 28553 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:14.309736 28269 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:14.377424 22570 connection.cc:256] RPC call timeout handler was delayed by -2.7956983900000978s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1763s for a response
W20260709 12:12:14.341677 28587 log.cc:927] Time spent T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:12:14.311369 28262 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:14.377820 22570 connection.cc:256] RPC call timeout handler was delayed by -1.9742321930000344s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1757s for a response
I20260709 12:12:14.373724 23089 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:14.380679 22569 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:14.266548 28547 consensus_queue.cc:1059] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.076s
I20260709 12:12:14.342528 28181 consensus_queue.cc:1243] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer 1676e7af5e4a47cb86ee7db83e3d4881 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:12:14.343816 28551 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.388800 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:14.402348 22604 raft_consensus.cc:2468] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 13.
W20260709 12:12:14.376590 28581 log.cc:927] Time spent T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:12:14.373544 28506 raft_consensus.cc:2749] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:14.396741 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:14.398339 22529 raft_consensus.cc:1240] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 12:12:14.399183 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:14.381902 28565 log.cc:927] Time spent T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:12:14.417757 22528 raft_consensus.cc:1275] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 12:12:14.419653 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:14.341857 28606 consensus_queue.cc:1048] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 12:12:14.382197 28584 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:14.425343 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:14.418454 22528 pending_rounds.cc:85] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting all ops after (but not including) 8
I20260709 12:12:14.501441 22528 pending_rounds.cc:107] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:12:14.501834 22528 raft_consensus.cc:2889] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:14.376030 28541 consensus_queue.cc:1048] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:12:14.390048 28269 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:14.392943 28533 raft_consensus.cc:2749] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:14.506028 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:14.514148 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:14.519400 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 118261us
I20260709 12:12:14.528723 22599 raft_consensus.cc:3055] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:14.529105 22599 raft_consensus.cc:740] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:14.541453 28550 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:12:14.506538 28587 log.cc:927] Time spent T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:12:14.515691 28543 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:14.560328 22599 consensus_queue.cc:260] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:14.586731 22599 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:14.592401 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:14.506695 28542 consensus_queue.cc:1048] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 12:12:14.408545 28551 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:14.597249 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 259889us
I20260709 12:12:14.418948 28411 consensus_queue.cc:237] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:14.583675 28599 raft_consensus.cc:2749] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:12:14.603345 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 241138us
I20260709 12:12:14.589783 28386 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:14.558445 28584 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:14.561162 28026 consensus_queue.cc:1048] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.039s
I20260709 12:12:14.595201 28185 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.597215 28465 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:14.619360 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 291930us
I20260709 12:12:14.629807 22422 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:14.592522 28543 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:14.655491 22569 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:14.662395 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:12:14.662678 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 326230us
I20260709 12:12:14.663033 22527 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:14.626328 28606 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.654289 28599 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:12:14.714036 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 51368.9us
I20260709 12:12:14.731040 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:14.626471 28567 consensus_queue.cc:1059] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.096s
I20260709 12:12:14.740379 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:14.741130 22601 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:12:14.652828 28181 consensus_queue.cc:1048] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.072s
I20260709 12:12:14.633298 28185 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:14.662286 28363 consensus_queue.cc:1059] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.073s
I20260709 12:12:14.767267 28558 raft_consensus.cc:2749] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:14.767390 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:14.767838 28605 log.cc:927] Time spent T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.343s	user 0.000s	sys 0.001s
I20260709 12:12:14.768441 22603 raft_consensus.cc:1275] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:14.769204 22524 pending_rounds.cc:85] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting all ops after (but not including) 10
I20260709 12:12:14.735383 28599 raft_consensus.cc:697] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:14.725324 28262 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:14.712517 28465 consensus_queue.cc:1048] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 12:12:14.781086 22524 pending_rounds.cc:107] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 12:12:14.796417 22524 raft_consensus.cc:2889] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:12:14.771816 28575 log.cc:927] Time spent T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.371s	user 0.000s	sys 0.003s
I20260709 12:12:14.722510 28606 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:14.790123 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 184337us
I20260709 12:12:14.778148 22525 raft_consensus.cc:2468] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 13.
I20260709 12:12:14.764015 28477 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:14.801493 23089 leader_election.cc:336] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Timed out: RequestConsensusVote RPC to 127.20.196.131:37785 timed out after 1.998s (SENT)
I20260709 12:12:14.773505 28553 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:12:14.804311 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:14.804708 28269 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:14.803850 28477 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:14.805416 28610 log.cc:927] Time spent T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.290s	user 0.000s	sys 0.001s
W20260709 12:12:14.800891 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 151265us
W20260709 12:12:14.813557 28607 log.cc:927] Time spent T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.262s	user 0.000s	sys 0.001s
I20260709 12:12:14.813946 28477 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:12:14.821975 23089 leader_election.cc:336] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Timed out: RequestConsensusVote RPC to 127.20.196.131:37785 timed out after 2.041s (SENT)
I20260709 12:12:14.822606 23089 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:12:14.858605 28050 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.006s	sys 0.013s
W20260709 12:12:14.859244 28050 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.006s	sys 0.013s
I20260709 12:12:14.867863 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:14.868616 22525 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 16.
I20260709 12:12:14.818737 22602 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 16.
I20260709 12:12:14.871457 28536 raft_consensus.cc:2749] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:14.880255 28624 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.880880 28624 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:14.885656 22452 raft_consensus.cc:1275] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:12:14.896572 22450 raft_consensus.cc:1240] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:14.878364 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:14.899274 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 47310.9us
I20260709 12:12:14.918152 22531 raft_consensus.cc:1240] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 LEADER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 20. Current term is 21. Ops: []
W20260709 12:12:14.930126 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 108190us
I20260709 12:12:14.878870 28266 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
W20260709 12:12:14.948457 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 44762.9us
I20260709 12:12:14.928545 28363 consensus_queue.cc:1243] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer 8701cd5186a949538d8efafb5f987270 log is divergent from this leader: its last log entry 16.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:12:14.955075 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:14.956035 23120 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 16.
I20260709 12:12:14.954690 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:12:14.958035 28616 log.cc:927] Time spent T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.283s	user 0.001s	sys 0.001s
I20260709 12:12:14.958235 23121 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:14.959651 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 346522us
I20260709 12:12:14.960148 23117 raft_consensus.cc:1275] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:14.961361 22569 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
W20260709 12:12:14.961755 28604 log.cc:927] Time spent T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.850s	user 0.006s	sys 0.000s
I20260709 12:12:14.926219 28635 consensus_queue.cc:1059] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 12:12:14.963721 28465 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:14.964068 28622 log.cc:927] Time spent T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 12:12:14.964246 28465 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:14.964588 28584 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:14.965906 28354 consensus_queue.cc:1059] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:14.966773 28465 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:14.967103 28626 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.967664 28626 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:14.968479 22570 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:14.969867 28626 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:14.949965 28551 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:12:14.971335 28615 log.cc:927] Time spent T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 12:12:14.971666 28185 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:14.971827 28050 consensus_queue.cc:1059] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:12:14.973129 28050 raft_consensus.cc:2749] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:14.973881 28050 raft_consensus.cc:3055] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:14.974303 28050 raft_consensus.cc:740] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:14.979490 28635 raft_consensus.cc:3055] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:14.979995 28635 raft_consensus.cc:740] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:14.980352 28026 raft_consensus.cc:3055] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:14.980759 28026 raft_consensus.cc:740] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:14.980994 28635 consensus_queue.cc:260] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:14.982738 28635 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:14.948307 28543 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:14.984148 28606 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:14.981597 28026 consensus_queue.cc:260] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:14.966936 28354 consensus_queue.cc:1048] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:14.962756 22527 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 20.
I20260709 12:12:14.987303 23121 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 18.
I20260709 12:12:14.932356 28624 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:14.995169 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:15.006901 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:15.010694 22605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3249) took 1160 ms. Trace:
I20260709 12:12:15.014864 28544 raft_consensus.cc:3055] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:12:15.018385 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:15.018479 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:15.026041 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:15.026487 22599 raft_consensus.cc:1275] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
W20260709 12:12:15.025339 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 84232.4us
I20260709 12:12:15.018783 22605 rpcz_store.cc:276] 0709 12:12:13.850617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:13.860038 (+  9421us) service_pool.cc:224] Handling call
0709 12:12:13.860315 (+   277us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:13.955517 (+ 95202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:13.955558 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:13.970429 (+ 14871us) log.cc:844] Serialized 52 byte log entry
0709 12:12:14.250208 (+279779us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:14.250245 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:14.250317 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:15.009119 (+758802us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b24002618a8. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc76c79c4 00007f9cc76c5acb 00007f9cc7880dc9 00007f9cc7880a55 00007f9cc787ffb0 00007f9cca4f6488 00007f9cca4f6be8 00007f9cca4ce398 00007f9cca4c976a 00007f9cca4c8bb6
0709 12:12:15.010291 (+  1172us) raft_consensus.cc:1685] finished
0709 12:12:15.010321 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:15.010600 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53864,"raft.queue_time_us":62244,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":8808,"spinlock_wait_cycles":36052736,"thread_start_us":247844,"threads_started":1,"wal-append.queue_time_us":378792}
I20260709 12:12:15.029597 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:14.948817 28266 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:15.032564 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:15.033460 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:15.034487 23089 leader_election.cc:336] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Timed out: RequestConsensusVote RPC to 127.20.196.131:37785 timed out after 2.133s (SENT)
I20260709 12:12:15.037220 23089 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:15.037562 22527 raft_consensus.cc:2410] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:12:14.920408 28599 consensus_queue.cc:237] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:15.041683 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:15.042822 23120 raft_consensus.cc:2393] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 17: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:14.991032 28626 consensus_queue.cc:1048] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:12:15.021246 28544 raft_consensus.cc:740] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:15.059175 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:12:15.045199 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 83964us
I20260709 12:12:15.033154 28179 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.062170 28252 raft_consensus.cc:2804] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:15.064142 28179 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:15.034713 28617 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.039050 28534 raft_consensus.cc:2749] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:15.069593 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:15.045344 28363 raft_consensus.cc:2804] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:12:15.066174 28641 log.cc:927] Time spent T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 12:12:15.071722 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 122957us
W20260709 12:12:15.099215 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:15.099712 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:15.103705 23088 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:15.114346 23121 raft_consensus.cc:1240] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:15.114356 22570 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:15.117635 22569 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:15.118789 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:15.117818 23089 leader_election.cc:336] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Timed out: RequestConsensusVote RPC to 127.20.196.131:37785 timed out after 2.248s (SENT)
I20260709 12:12:15.119632 23089 leader_election.cc:304] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:15.097985 28026 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:15.120637 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:15.123560 28550 raft_consensus.cc:2749] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:15.123993 28647 log.cc:927] Time spent T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:12:15.130180 22497 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:15.132682 28586 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.133148 28586 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:15.061645 28269 consensus_queue.cc:1059] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
I20260709 12:12:15.019424 28050 consensus_queue.cc:260] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:15.134315 28651 raft_consensus.cc:2749] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:15.135329 28586 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:15.136544 23121 raft_consensus.cc:1275] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:12:15.138939 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:15.139567 23116 raft_consensus.cc:2468] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 14.
I20260709 12:12:15.140105 28266 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:15.140441 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:15.140336 28586 consensus_queue.cc:1048] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:15.140694 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:15.141410 23124 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
I20260709 12:12:15.121074 28538 raft_consensus.cc:2804] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:15.142508 28538 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:15.142858 28538 raft_consensus.cc:3060] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:15.147748 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:15.148391 22453 raft_consensus.cc:2468] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 13.
I20260709 12:12:15.147871 22497 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:12:15.152076 28349 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:15.153457 28179 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:15.155244 28544 consensus_queue.cc:260] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:15.155916 28176 raft_consensus.cc:3055] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:15.156298 28176 raft_consensus.cc:740] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:15.156553 28544 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:15.157266 28176 consensus_queue.cc:260] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:15.158300 28176 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:15.103354 28617 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:15.159960 28632 log.cc:927] Time spent T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.419s	user 0.001s	sys 0.000s
I20260709 12:12:15.160733 28617 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:15.163642 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:15.164378 23116 raft_consensus.cc:2393] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 15: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:15.165676 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:15.166273 23124 raft_consensus.cc:2468] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 14.
I20260709 12:12:15.167470 28349 raft_consensus.cc:2749] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:15.169891 28586 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:15.170471 28586 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:12:15.170861 22496 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:15.172034 28362 raft_consensus.cc:2804] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:15.172410 28362 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:15.172741 28362 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:15.172905 28586 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:15.179490 22496 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:15.180188 23088 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:12:15.181003 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 59404.2us
I20260709 12:12:15.104176 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:15.182111 23088 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:15.204737 22497 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:15.206694 22421 leader_election.cc:400] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Vote denied by peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353) with higher term. Message: Invalid argument: T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 19. Current term is 20.
I20260709 12:12:15.207050 22421 leader_election.cc:403] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:15.212186 22496 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:15.221094 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:15.221939 22455 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 12.
I20260709 12:12:15.224797 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:15.225481 23121 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:15.226413 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:15.227442 23123 raft_consensus.cc:2393] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 16: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:15.228626 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:15.236744 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:15.204236 28651 consensus_queue.cc:1048] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 12:12:15.241107 22497 leader_election.cc:400] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 10. Current term is 11.
I20260709 12:12:15.241668 28651 raft_consensus.cc:2749] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:15.242889 22497 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:15.251351 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:15.252115 22526 raft_consensus.cc:2468] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 14.
I20260709 12:12:15.253291 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:15.205118 28551 raft_consensus.cc:2804] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:15.256248 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:15.256481 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:15.206380 28624 raft_consensus.cc:2804] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:15.219439 28623 raft_consensus.cc:2804] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:15.266669 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:15.268129 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:15.273308 22528 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 15.
I20260709 12:12:15.217087 28584 raft_consensus.cc:2804] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:12:15.271229 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 59146.3us
I20260709 12:12:15.224463 28542 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:12:15.274691 22496 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:12:15.278002 28588 log.cc:927] Time spent T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:12:15.266152 28551 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:15.224033 28519 consensus_queue.cc:1048] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.120s
I20260709 12:12:15.270357 28624 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:15.244549 28506 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:15.455974 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:15.495643 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 387866us
W20260709 12:12:15.496084 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:15.461462 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:15.455171 22421 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
W20260709 12:12:15.494215 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 222178us
W20260709 12:12:15.503368 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 228725us
W20260709 12:12:15.500564 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 401481us
I20260709 12:12:15.266003 28620 consensus_queue.cc:1048] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.215s
W20260709 12:12:15.500102 23089 leader_election.cc:336] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Timed out: RequestConsensusVote RPC to 127.20.196.131:37785 timed out after 2.749s (SENT)
W20260709 12:12:15.511592 22601 consensus_meta.cc:287] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.762s	user 0.011s	sys 0.001s
W20260709 12:12:15.511811 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 56048.1us
I20260709 12:12:15.341688 28363 raft_consensus.cc:697] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:15.518201 23124 raft_consensus.cc:1240] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 18 LEADER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:15.518293 23123 raft_consensus.cc:1240] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 15 LEADER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:15.471747 28654 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:15.509270 22570 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:15.514370 22601 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 18.
I20260709 12:12:15.534843 28431 raft_consensus.cc:2749] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:15.536594 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:15.515297 22497 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:15.515457 23089 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:15.537642 23088 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:15.493767 28551 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:15.493042 28651 raft_consensus.cc:2804] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:15.494935 23121 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 18.
W20260709 12:12:15.537428 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:15.536657 22422 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:12:15.542508 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:15.543675 28644 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:15.544873 28363 consensus_queue.cc:237] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:15.514520 28586 raft_consensus.cc:2804] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:15.497915 28624 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:15.547564 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:15.500617 28584 raft_consensus.cc:697] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:15.551869 23118 raft_consensus.cc:1240] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 18 LEADER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:12:15.552863 22570 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:15.492690 28465 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:15.579946 22531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 2277) took 1180 ms. Trace:
I20260709 12:12:15.580430 22531 rpcz_store.cc:276] 0709 12:12:14.399782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:14.399904 (+   122us) service_pool.cc:224] Handling call
0709 12:12:14.496790 (+ 96886us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:14.918754 (+421964us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:15.579701 (+660947us) spinlock_profiling.cc:243] Waited 421 ms on lock 0x7b54003f07d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:15.579881 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":968518016}
I20260709 12:12:15.582913 22570 leader_election.cc:304] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
W20260709 12:12:15.583801 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:15.479223 28606 consensus_queue.cc:1048] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 12:12:15.498605 22421 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:15.525039 28623 raft_consensus.cc:697] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 20 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:15.513186 28269 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:15.531075 28590 raft_consensus.cc:2804] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:15.563230 28555 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:15.634970 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 72770.7us
I20260709 12:12:15.563339 28586 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:15.562323 28651 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:15.564862 28550 raft_consensus.cc:2804] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:12:15.610247 28641 log.cc:927] Time spent T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:12:15.508375 28621 consensus_queue.cc:1048] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.125s
I20260709 12:12:15.513762 28506 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:15.609956 28642 raft_consensus.cc:2749] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:15.610843 28645 raft_consensus.cc:2749] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:15.623643 28349 raft_consensus.cc:2749] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:15.673552 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 407470us
W20260709 12:12:15.674919 23089 leader_election.cc:336] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Timed out: RequestConsensusVote RPC to 127.20.196.131:37785 timed out after 1.507s (SENT)
W20260709 12:12:15.675907 23089 leader_election.cc:336] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Timed out: RequestConsensusVote RPC to 127.20.196.131:37785 timed out after 2.887s (SENT)
I20260709 12:12:15.676961 28533 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:15.677565 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 162487us
I20260709 12:12:15.677520 28533 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:15.679148 28639 consensus_queue.cc:1059] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.058s
I20260709 12:12:15.679816 28533 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:15.679836 28653 consensus_queue.cc:1059] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.123s
I20260709 12:12:15.681556 28653 consensus_queue.cc:1048] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:12:15.682927 28653 raft_consensus.cc:3055] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:15.683272 28653 raft_consensus.cc:740] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:15.684073 28653 consensus_queue.cc:260] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:15.691099 28653 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:15.696220 28584 consensus_queue.cc:237] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:15.703287 28252 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:15.703811 28252 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:15.707844 28542 raft_consensus.cc:2749] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353) with higher term. Message: Invalid argument: T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 19. Current term is 20.
I20260709 12:12:15.708608 28542 raft_consensus.cc:2804] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:15.709049 28542 raft_consensus.cc:697] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:15.709851 28542 consensus_queue.cc:237] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:15.628937 28280 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:15.621901 28411 raft_consensus.cc:2749] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:15.678675 22497 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:15.713950 23088 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:12:15.714134 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 72058.4us
W20260709 12:12:15.677052 23089 leader_election.cc:336] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Timed out: RequestConsensusVote RPC to 127.20.196.131:37785 timed out after 3.094s (SENT)
I20260709 12:12:15.733506 23089 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:15.644836 28550 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:15.645285 28651 raft_consensus.cc:3060] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:15.645438 28586 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:15.738528 22569 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:15.575496 28644 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:15.612073 28465 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:15.747514 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:15.755883 28620 raft_consensus.cc:2749] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:12:15.739496 28655 log.cc:927] Time spent T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:12:15.771417 28349 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:15.772060 28349 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:15.773859 28544 consensus_meta.cc:287] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.617s	user 0.007s	sys 0.000s
I20260709 12:12:15.773594 28623 consensus_queue.cc:237] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:15.774169 28349 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:15.762228 28252 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:15.774886 28639 raft_consensus.cc:2804] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:15.775317 28639 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:15.775664 28639 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:15.776432 28252 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:15.763376 28262 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:15.780871 28176 consensus_meta.cc:287] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.622s	user 0.009s	sys 0.000s
W20260709 12:12:15.781371 28635 consensus_meta.cc:287] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.789s	user 0.004s	sys 0.004s
I20260709 12:12:15.716730 28617 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:15.782296 28617 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:15.784891 28617 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:15.765326 28644 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:15.768103 28538 consensus_meta.cc:287] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.625s	user 0.009s	sys 0.000s
I20260709 12:12:15.744166 28550 raft_consensus.cc:3060] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:15.652568 28555 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:15.785991 22606 raft_consensus.cc:1240] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:15.786890 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:15.787031 28465 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:15.764371 22454 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 20.
I20260709 12:12:15.636348 28269 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:15.795156 22598 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.009s	sys 0.035s
I20260709 12:12:15.794458 22604 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 18.
I20260709 12:12:15.825026 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:15.826176 22598 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.009s	sys 0.035s
I20260709 12:12:15.736089 28636 consensus_queue.cc:1059] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.067s
I20260709 12:12:15.790454 28411 raft_consensus.cc:2804] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:12:15.836760 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 158147us
I20260709 12:12:15.837764 22497 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:15.836181 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 299635us
I20260709 12:12:15.840380 22497 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:15.838959 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:15.797016 28635 consensus_queue.cc:1059] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 12:12:15.869396 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:15.837376 28411 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:15.810956 28538 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:15.874145 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:15.876902 22606 raft_consensus.cc:2410] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
W20260709 12:12:15.861429 28179 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.018s	sys 0.037s
I20260709 12:12:15.825398 28176 consensus_queue.cc:1048] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 12:12:15.878409 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:15.865993 28636 consensus_queue.cc:1243] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer 8701cd5186a949538d8efafb5f987270 log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:12:15.845362 28465 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:15.882002 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:15.885346 22602 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 12.
I20260709 12:12:15.884119 22605 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 17.
W20260709 12:12:15.880645 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 382129us
W20260709 12:12:15.879232 28179 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.018s	sys 0.037s
I20260709 12:12:15.875020 28411 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:15.890782 23117 raft_consensus.cc:1240] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 13. Current term is 14. Ops: [13.13-13.13]
W20260709 12:12:15.897989 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 182015us
I20260709 12:12:15.905356 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:15.906391 22602 raft_consensus.cc:2393] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 18: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:15.892489 28617 raft_consensus.cc:2749] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:15.910050 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 233040us
I20260709 12:12:15.892238 28653 raft_consensus.cc:2749] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:15.894263 28506 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:15.913534 28663 log.cc:927] Time spent T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:12:15.913355 28653 raft_consensus.cc:2749] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:15.918059 28050 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:15.911957 23089 leader_election.cc:336] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Timed out: RequestConsensusVote RPC to 127.20.196.131:37785 timed out after 1.536s (SENT)
I20260709 12:12:15.923663 23089 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:15.923697 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 395244us
I20260709 12:12:15.890776 28465 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:15.938591 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:15.928849 28262 raft_consensus.cc:2749] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:15.983796 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:15.933883 28668 log.cc:927] Time spent T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:12:15.948005 22601 raft_consensus.cc:1240] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 14. Current term is 16. Ops: []
W20260709 12:12:15.947789 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 233919us
I20260709 12:12:16.007618 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:16.010159 22606 raft_consensus.cc:2393] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 17: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:16.010700 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:16.012708 28675 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.013242 28675 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:16.013737 28644 raft_consensus.cc:3055] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:16.014155 28644 raft_consensus.cc:740] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
W20260709 12:12:16.015419 28677 log.cc:927] Time spent T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:12:16.016149 28465 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:16.016407 28672 log.cc:927] Time spent T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:12:16.017807 28555 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:16.019392 23119 raft_consensus.cc:1240] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:16.020264 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:16.020992 23120 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
I20260709 12:12:16.021925 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:16.014997 28644 consensus_queue.cc:260] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:16.021004 28635 consensus_queue.cc:1059] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 12:12:16.023725 28635 consensus_queue.cc:1243] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer 8701cd5186a949538d8efafb5f987270 log is divergent from this leader: its last log entry 18.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:12:16.023769 28644 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:16.005841 28176 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.024559 28176 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:16.025180 22570 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:16.026274 28675 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:16.026232 28636 consensus_queue.cc:1059] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:12:16.018862 28551 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:16.027520 28636 raft_consensus.cc:2804] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:16.028014 28636 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:16.028424 28636 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:16.028882 28362 consensus_meta.cc:287] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.856s	user 0.010s	sys 0.000s
I20260709 12:12:16.029018 28551 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:16.026718 28176 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:16.029311 28362 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:16.029881 28176 raft_consensus.cc:3055] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:16.030238 28176 raft_consensus.cc:740] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:16.031062 28176 consensus_queue.cc:260] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:16.032541 28176 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:16.034080 28550 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:16.041414 28550 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:16.036067 28280 raft_consensus.cc:2749] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:16.043362 22531 raft_consensus.cc:1240] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 15. Current term is 16. Ops: []
W20260709 12:12:16.045213 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.048243 22527 raft_consensus.cc:1240] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:16.049947 22602 raft_consensus.cc:1240] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 LEADER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:12:15.936484 28671 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
W20260709 12:12:16.061795 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.064579 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:12:16.061762 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 221472us
I20260709 12:12:16.065516 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:16.066250 28681 raft_consensus.cc:2749] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:16.066356 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:16.067545 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 56901.8us
I20260709 12:12:16.077248 22529 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 17.
I20260709 12:12:16.071267 22497 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:16.073905 22570 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:16.080073 22570 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:16.081238 28635 raft_consensus.cc:2749] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:16.081961 28635 raft_consensus.cc:2749] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:16.084429 28669 log.cc:927] Time spent T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
I20260709 12:12:16.085582 28658 raft_consensus.cc:3055] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:16.085980 28658 raft_consensus.cc:740] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:16.086544 28269 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:16.089882 28538 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:16.090709 28671 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:16.092942 28671 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:16.097956 28654 consensus_meta.cc:287] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.533s	user 0.000s	sys 0.006s
I20260709 12:12:16.098387 28654 raft_consensus.cc:2749] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:16.099668 22528 raft_consensus.cc:1240] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:16.100648 28651 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:16.051156 28542 consensus_queue.cc:1048] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 12:12:16.104389 28542 consensus_queue.cc:1243] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer 1676e7af5e4a47cb86ee7db83e3d4881 log is divergent from this leader: its last log entry 18.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 12:12:16.070590 28665 log.cc:927] Time spent T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.246s	user 0.000s	sys 0.001s
I20260709 12:12:16.105964 22600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2868) took 1039 ms. Trace:
I20260709 12:12:16.106323 22600 rpcz_store.cc:276] 0709 12:12:15.066361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:15.066511 (+   150us) service_pool.cc:224] Handling call
0709 12:12:15.066819 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:15.099113 (+ 32294us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:15.099143 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:15.099618 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 12:12:15.479752 (+380134us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:15.479837 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:15.479968 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:16.105740 (+625772us) raft_consensus.cc:1685] finished
0709 12:12:16.105760 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:16.105908 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":33807,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":51094,"thread_start_us":272086,"threads_started":1,"wal-append.queue_time_us":597074}
W20260709 12:12:16.112073 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.117142 22599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3285) took 1983 ms. Trace:
I20260709 12:12:16.117520 22599 rpcz_store.cc:276] 0709 12:12:14.133749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:14.273253 (+139504us) service_pool.cc:224] Handling call
0709 12:12:14.273593 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:15.026810 (+753217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:16.116916 (+1090106us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b5400041854. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:16.117085 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":555387136}
I20260709 12:12:16.125344 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:16.128032 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:16.128752 23118 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
I20260709 12:12:16.102857 28651 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:16.133901 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 62732.3us
I20260709 12:12:16.219761 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:16.220836 22529 raft_consensus.cc:2368] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 16. Current term is 17.
W20260709 12:12:16.227561 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 90420.1us
W20260709 12:12:16.241369 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.325687 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:16.123390 28363 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.331101 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:16.369203 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:16.006363 28623 consensus_queue.cc:1048] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.131s
I20260709 12:12:16.137882 28519 raft_consensus.cc:2804] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:16.086783 28658 consensus_queue.cc:260] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:16.385927 22526 raft_consensus.cc:1275] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:12:16.257012 28590 raft_consensus.cc:697] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:16.397894 22454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 1171) took 1173 ms. Trace:
I20260709 12:12:16.398185 22570 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
W20260709 12:12:16.406133 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.407500 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:16.328035 28620 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:16.403632 28606 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:16.407521 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:16.413944 22454 rpcz_store.cc:276] 0709 12:12:15.224958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:15.225107 (+   149us) service_pool.cc:224] Handling call
0709 12:12:16.397704 (+1172597us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b540038a9d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:16.397821 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1044447616}
I20260709 12:12:16.427701 22570 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:16.371146 28506 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:16.418154 22421 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.028s	sys 0.075s
W20260709 12:12:16.444849 22421 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.028s	sys 0.075s
W20260709 12:12:16.445226 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 556344us
I20260709 12:12:16.388289 28519 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.424489 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:16.427939 22453 raft_consensus.cc:3060] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:12:16.134914 28362 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:16.416309 22451 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:12:16.391490 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:16.429292 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 517320us
I20260709 12:12:16.122625 28639 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:16.399152 28349 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:16.451337 22421 leader_election.cc:400] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 16. Current term is 17.
I20260709 12:12:16.451953 22421 leader_election.cc:403] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:16.387187 28636 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:16.445078 28606 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:16.458213 28625 consensus_queue.cc:1048] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:16.459441 28636 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:16.460086 28606 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:16.460286 22421 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:12:16.461974 28411 consensus_meta.cc:287] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.564s	user 0.007s	sys 0.000s
I20260709 12:12:16.462374 28411 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:16.469485 22421 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:16.463703 28599 raft_consensus.cc:2749] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:16.466758 28625 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.470956 28625 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:16.447983 28506 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:16.467854 22599 raft_consensus.cc:2393] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 15: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:16.472541 22421 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:16.473450 28599 raft_consensus.cc:2749] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:16.474906 28506 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:16.477399 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:16.479346 22524 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 15.
I20260709 12:12:16.479393 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:16.480917 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:16.481160 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:16.483834 22452 raft_consensus.cc:1275] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:16.484308 22605 raft_consensus.cc:2410] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:12:16.484695 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:16.485091 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:16.425436 28620 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:16.480057 28625 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:16.481913 28411 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:16.485841 22605 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 15.
I20260709 12:12:16.487215 28620 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:16.485828 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:12:16.490427 28586 consensus_meta.cc:287] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.732s	user 0.004s	sys 0.005s
I20260709 12:12:16.481488 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:16.490804 28586 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:16.491322 22604 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 16.
I20260709 12:12:16.481796 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:16.492254 22601 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 15.
I20260709 12:12:16.487182 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:16.492843 28586 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:16.493285 22605 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 16.
I20260709 12:12:16.484807 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:16.497852 22598 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 18.
I20260709 12:12:16.500444 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:12:16.496795 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 171166us
I20260709 12:12:16.380182 28363 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:16.504518 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:16.504576 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:16.503973 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:16.505342 28362 consensus_queue.cc:1048] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:12:16.506379 28590 consensus_queue.cc:237] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:16.507128 22495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.497165 28349 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:16.507781 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:16.528046 22606 raft_consensus.cc:2368] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 17. Current term is 18.
I20260709 12:12:16.508478 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:16.509483 28679 log.cc:927] Time spent T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.494s	user 0.008s	sys 0.003s
I20260709 12:12:16.530515 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:16.512499 28656 log.cc:927] Time spent T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.883s	user 0.001s	sys 0.000s
I20260709 12:12:16.513089 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:16.513741 28050 consensus_meta.cc:287] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.585s	user 0.006s	sys 0.002s
I20260709 12:12:16.513839 28558 raft_consensus.cc:3055] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:16.512497 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:16.541049 22601 raft_consensus.cc:2393] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 18: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:16.517377 28639 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:16.518854 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:16.520112 28678 log.cc:927] Time spent T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.509s	user 0.001s	sys 0.000s
I20260709 12:12:16.520716 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:16.553126 22602 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 17.
I20260709 12:12:16.451305 28176 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:16.452286 28635 raft_consensus.cc:2804] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:16.523273 22598 raft_consensus.cc:2410] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:12:16.450103 28519 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:16.528915 22448 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 15.
W20260709 12:12:16.529521 22525 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.040s	sys 0.085s
W20260709 12:12:16.555984 22525 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.040s	sys 0.085s
I20260709 12:12:16.532291 22532 raft_consensus.cc:1275] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:16.534160 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:16.558090 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:16.535041 22451 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 17.
I20260709 12:12:16.537405 22453 raft_consensus.cc:2468] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
I20260709 12:12:16.545127 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:16.550884 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:16.542471 22603 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 20.
I20260709 12:12:16.558938 22532 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 16.
I20260709 12:12:16.601310 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:16.605799 22598 raft_consensus.cc:2410] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:12:16.604279 22497 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:16.541734 28586 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.540426 28558 raft_consensus.cc:740] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:16.632721 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:16.641827 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:16.643612 22601 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 17.
I20260709 12:12:16.642630 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:16.643050 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:12:16.601629 28624 consensus_meta.cc:287] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.967s	user 0.009s	sys 0.001s
I20260709 12:12:16.646042 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:16.556695 28635 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:16.668531 22448 raft_consensus.cc:1275] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 12:12:16.650209 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 46054.3us
I20260709 12:12:16.666338 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:16.669056 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:16.683252 28635 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:16.686548 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:16.687664 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:16.684816 22604 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 15.
I20260709 12:12:16.688616 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:16.688957 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:16.689175 22601 raft_consensus.cc:2376] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 18. Re-sending same reply.
I20260709 12:12:16.689965 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:16.665934 28628 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:16.690627 22448 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:16.555439 28176 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.630435 28606 raft_consensus.cc:2749] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 16. Current term is 17.
I20260709 12:12:16.649245 22598 raft_consensus.cc:2368] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 17. Current term is 18.
I20260709 12:12:16.707162 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:16.559674 28637 raft_consensus.cc:3055] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:12:16.668782 28656 log.cc:927] Time spent T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 12:12:16.645016 28534 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.004s	sys 0.011s
I20260709 12:12:16.696152 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:16.630056 28639 consensus_queue.cc:1059] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 12:12:16.714932 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:16.715682 28639 raft_consensus.cc:3055] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:16.715935 22599 raft_consensus.cc:2393] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 15: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:16.648538 28691 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:16.715029 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:16.716707 28691 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:16.717053 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:16.717487 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:16.717979 22599 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
I20260709 12:12:16.645390 28694 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:16.696486 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:16.696983 22450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 1168) took 1489 ms. Trace:
I20260709 12:12:16.705370 22456 raft_consensus.cc:1275] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:12:16.691039 28628 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:16.666440 28688 log.cc:927] Time spent T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 12:12:16.693783 22421 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:12:16.712320 22495 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:16.631932 28480 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.713331 28558 consensus_queue.cc:260] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:16.718948 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:16.721019 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:16.723611 22527 raft_consensus.cc:2393] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 15: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:16.721608 23125 raft_consensus.cc:1240] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:16.724068 22597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2860) took 2008 ms. Trace:
I20260709 12:12:16.723296 22450 rpcz_store.cc:276] 0709 12:12:15.207848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:15.224269 (+ 16421us) service_pool.cc:224] Handling call
0709 12:12:15.260149 (+ 35880us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:15.274287 (+ 14138us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:15.274333 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:15.338574 (+ 64241us) log.cc:844] Serialized 26 byte log entry
0709 12:12:15.892810 (+554236us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:15.892848 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:15.892907 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:16.508933 (+616026us) spinlock_profiling.cc:243] Waited 3.25 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:12:16.696646 (+187713us) raft_consensus.cc:1685] finished
0709 12:12:16.696669 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:16.696901 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16213,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":19819,"spinlock_wait_cycles":7475072,"thread_start_us":363004,"threads_started":1,"wal-append.queue_time_us":429431}
I20260709 12:12:16.727253 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:16.634586 28671 raft_consensus.cc:2764] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:12:16.690064 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:16.729909 22603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45562 (request call id 2866) took 1704 ms (client timeout 2266 ms). Trace:
I20260709 12:12:16.736558 22598 raft_consensus.cc:2410] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 16 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
W20260709 12:12:16.736649 22603 rpcz_store.cc:269] 0709 12:12:15.025139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:15.027118 (+  1979us) service_pool.cc:224] Handling call
0709 12:12:15.103992 (+ 76874us) spinlock_profiling.cc:243] Waited 909 us on lock 0x7b58001b3098. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf8f40a0 00007f9ccf8f3984 00007f9cc8e6e6d4 00007f9cc8e6e662
0709 12:12:16.729696 (+1625704us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b5400043654. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:16.729833 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3126750336}
I20260709 12:12:16.703871 28176 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:16.734859 23125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 1582) took 1699 ms. Trace:
I20260709 12:12:16.736279 22601 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 17.
I20260709 12:12:16.737495 22495 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:16.738113 28480 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:16.738588 28691 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:16.668052 28363 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:16.741389 23125 rpcz_store.cc:276] 0709 12:12:15.035663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:15.035923 (+   260us) service_pool.cc:224] Handling call
0709 12:12:16.721220 (+1685297us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b5800110198. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf907fc0 00007f9ccf8f2929 00007f9ccf8f23d2 00007f9cc8e69bd4
0709 12:12:16.721416 (+   196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:16.734616 (+ 13200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:16.734807 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3388160}
I20260709 12:12:16.742200 22448 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 16.
I20260709 12:12:16.734171 22525 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:16.730710 28362 raft_consensus.cc:2749] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:16.736756 22421 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:16.716080 28639 raft_consensus.cc:740] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:16.743083 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:16.755178 22598 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 16.
I20260709 12:12:16.756265 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:16.756831 22598 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:16.704319 28651 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:16.743470 23087 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:16.645470 28586 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:16.768323 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:16.769018 22527 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:16.747557 28626 consensus_queue.cc:1048] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:12:16.769789 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.752770 22495 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:16.757666 28262 raft_consensus.cc:2804] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:16.772891 22495 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:16.773253 28262 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.766134 28550 raft_consensus.cc:2749] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:16.773674 28262 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:16.776455 28623 consensus_queue.cc:1048] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:16.776710 23087 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:16.777887 28623 consensus_queue.cc:1048] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:16.779204 28533 raft_consensus.cc:2804] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:16.779651 28411 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:16.779717 28533 raft_consensus.cc:697] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 16 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:16.780344 28411 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:16.780812 28533 consensus_queue.cc:237] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:16.782171 28262 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:16.783922 28280 raft_consensus.cc:2804] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:16.784329 28262 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:16.784446 28280 raft_consensus.cc:697] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:16.785470 28280 consensus_queue.cc:237] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:16.773398 28551 consensus_queue.cc:1048] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 12:12:16.790598 28411 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:16.758688 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:16.721118 28534 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.004s	sys 0.015s
I20260709 12:12:16.650281 28624 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:16.719775 28694 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:16.766348 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:16.734774 28637 raft_consensus.cc:740] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:16.732862 22597 rpcz_store.cc:276] 0709 12:12:14.715925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:14.716050 (+   125us) service_pool.cc:224] Handling call
0709 12:12:14.735204 (+ 19154us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:14.872648 (+137444us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:14.933618 (+ 60970us) log.cc:844] Serialized 14 byte log entry
0709 12:12:15.176185 (+242567us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:15.204906 (+ 28721us) log.cc:844] Serialized 26 byte log entry
0709 12:12:15.214592 (+  9686us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:15.214647 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:15.214743 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:16.511707 (+1296964us) spinlock_profiling.cc:243] Waited 7.75 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:12:16.723676 (+211969us) raft_consensus.cc:1685] finished
0709 12:12:16.723813 (+   137us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:16.723997 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71592,"prepare.queue_time_us":78496,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":37,"raft.queue_time_us":124805,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":23876,"spinlock_wait_cycles":17833728,"thread_start_us":257625,"threads_started":2,"wal-append.queue_time_us":526664}
I20260709 12:12:16.749996 28480 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:16.790539 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:16.802395 28185 raft_consensus.cc:2804] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:16.811868 22454 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 18.
I20260709 12:12:16.812326 28185 raft_consensus.cc:697] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:16.813211 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:16.813910 22600 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 16.
I20260709 12:12:16.813535 28185 consensus_queue.cc:237] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:16.817306 28349 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:16.754863 28625 raft_consensus.cc:2764] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 12:12:16.762754 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:16.757642 22453 raft_consensus.cc:2393] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 15: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:16.797904 22422 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:16.762295 28558 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:16.806502 28694 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:16.809945 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:16.810312 28636 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.811008 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:16.793205 22601 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 18.
I20260709 12:12:16.818804 23087 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:16.814728 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:16.838670 22600 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:16.826107 22422 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:12:16.826329 22598 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 18.
I20260709 12:12:16.838052 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:16.848564 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:16.837706 22527 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 17.
I20260709 12:12:16.849644 22598 raft_consensus.cc:2410] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 16 because replica has last-logged OpId of term: 15 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 14.
I20260709 12:12:16.828647 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:16.835901 22606 raft_consensus.cc:2410] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:12:16.842751 28626 raft_consensus.cc:2955] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 LEADER]: Committing config change with OpId 10.8: config changed from index 5 to 8, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:16.767128 28691 raft_consensus.cc:2804] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:16.849992 23088 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:16.855048 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:16.829032 28692 raft_consensus.cc:2804] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:16.866571 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:16.879571 22597 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 18.
W20260709 12:12:16.908620 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.932646 28544 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:16.933548 28544 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:16.938295 28544 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:16.960558 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 110656us
I20260709 12:12:16.793159 28651 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:17.016336 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:16.966892 23117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 1353) took 1804 ms. Trace:
I20260709 12:12:16.964648 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:17.022845 22599 raft_consensus.cc:2393] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 17: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:17.013849 28411 raft_consensus.cc:2804] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:17.028973 28411 raft_consensus.cc:697] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 17 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:17.035737 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:17.036773 22598 raft_consensus.cc:2393] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 16: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:17.041671 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:17.021019 23117 rpcz_store.cc:276] 0709 12:12:15.162634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:15.179305 (+ 16671us) service_pool.cc:224] Handling call
0709 12:12:15.179579 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:15.891711 (+712132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:16.966639 (+1074928us) spinlock_profiling.cc:243] Waited 711 ms on lock 0x7b5400284bd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:16.966829 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1635148672}
I20260709 12:12:17.045935 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:16.807590 28637 consensus_queue.cc:260] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:17.048425 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:17.046747 22528 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 17.
I20260709 12:12:16.857817 28623 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:16.859223 28555 raft_consensus.cc:2804] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:16.859521 28691 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:16.963065 28692 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:17.063534 28692 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:17.064783 28652 log.cc:927] Time spent T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 1.499s	user 0.012s	sys 0.002s
I20260709 12:12:16.846130 28636 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:17.068017 28544 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:17.069061 28636 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:17.069746 22606 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 18.
I20260709 12:12:17.070864 28671 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.071594 28671 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:17.072223 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:17.072875 22606 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 21.
I20260709 12:12:17.073729 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:17.075274 28671 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:16.868803 28639 consensus_queue.cc:260] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:17.077105 28639 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:17.030151 28411 consensus_queue.cc:237] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:16.862625 28617 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:17.060879 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:17.061868 28637 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:17.068701 28544 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:17.060497 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:16.961067 28550 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:17.058305 28624 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:16.965569 28695 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:17.083933 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:17.083191 23089 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.029s	sys 0.093s
I20260709 12:12:17.089962 22528 raft_consensus.cc:1240] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:17.096362 22597 raft_consensus.cc:2410] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:12:17.081139 28691 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:17.101106 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:17.101558 23089 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.029s	sys 0.093s
I20260709 12:12:17.061360 28555 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:12:17.138473 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 688788us
I20260709 12:12:17.149080 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:17.156827 22421 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:17.150270 22606 raft_consensus.cc:2376] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 18. Re-sending same reply.
W20260709 12:12:17.188004 23089 leader_election.cc:336] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Timed out: RequestConsensusVote RPC to 127.20.196.131:37785 timed out after 2.543s (SENT)
I20260709 12:12:17.079595 28623 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:17.149902 28555 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:17.104183 28695 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:17.224077 22529 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.003s	sys 0.056s
I20260709 12:12:17.187996 28354 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:17.225311 22529 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.003s	sys 0.056s
I20260709 12:12:17.187834 28694 raft_consensus.cc:2804] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:17.188671 28538 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.103490 28550 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:17.188890 28624 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:17.095201 28617 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:17.226617 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:17.150480 28519 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:17.236284 22606 raft_consensus.cc:2393] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 17: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:17.220193 28628 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:17.088768 22455 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1143406a95dd472688b2fe621abd815f"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
mode: GRACEFUL
new_leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:44568
I20260709 12:12:17.246428 22455 raft_consensus.cc:606] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 11 LEADER]: Received request to transfer leadership to TS 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:17.249413 22525 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 16.
I20260709 12:12:17.244539 28586 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:17.279536 28697 log.cc:927] Time spent T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.223s	user 0.000s	sys 0.000s
I20260709 12:12:17.280778 28519 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:17.232110 28694 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:17.281720 28694 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:17.284662 28550 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:17.286535 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:17.287325 22525 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 16.
I20260709 12:12:17.288371 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:17.289227 22525 raft_consensus.cc:2393] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 13: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
W20260709 12:12:17.291247 28698 log.cc:927] Time spent T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.324s	user 0.001s	sys 0.000s
I20260709 12:12:17.294085 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:17.296238 28699 log.cc:927] Time spent T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:12:17.235620 28538 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:17.299460 28538 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:17.303812 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:17.304730 22455 raft_consensus.cc:2410] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
W20260709 12:12:17.317982 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:17.322275 28635 consensus_meta.cc:287] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.636s	user 0.005s	sys 0.002s
I20260709 12:12:17.324118 28544 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:17.206239 28636 consensus_queue.cc:1059] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:12:17.329054 28636 raft_consensus.cc:3055] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:17.329520 28636 raft_consensus.cc:740] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:17.331386 28691 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:17.212949 28363 consensus_queue.cc:1059] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:12:17.333810 28363 raft_consensus.cc:3055] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:17.334278 28363 raft_consensus.cc:740] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:17.335374 28363 consensus_queue.cc:260] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:17.336412 28694 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:17.336850 28363 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:17.340161 28617 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:17.342017 28623 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:17.232936 28687 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:17.347507 28691 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:17.232985 28354 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:17.350039 28354 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:17.351904 28694 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:17.356746 28695 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:17.364578 22524 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.825s	user 0.036s	sys 0.086s
W20260709 12:12:17.365684 22524 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.826s	user 0.037s	sys 0.086s
W20260709 12:12:17.372133 22530 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.824s	user 0.011s	sys 0.032s
W20260709 12:12:17.372776 22530 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.012s	sys 0.033s
W20260709 12:12:17.374051 23090 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.959s	user 0.024s	sys 0.070s
W20260709 12:12:17.374509 23090 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.960s	user 0.024s	sys 0.070s
W20260709 12:12:17.374848 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 186865us
W20260709 12:12:17.375608 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:17.376073 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:17.376470 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:17.376761 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:17.378425 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:17.380560 22600 consensus_meta.cc:287] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.521s	user 0.009s	sys 0.001s
I20260709 12:12:17.381032 22600 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 16.
I20260709 12:12:17.381872 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:17.382133 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:17.382020 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:17.386861 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:17.390201 23089 connection.cc:256] RPC call timeout handler was delayed by -1.6678179620000719s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2932s for a response
W20260709 12:12:17.391016 23089 leader_election.cc:336] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Timed out: RequestConsensusVote RPC to 127.20.196.131:37785 timed out after 1.632s (SENT)
I20260709 12:12:17.391584 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:17.330523 28636 consensus_queue.cc:260] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:17.250839 28624 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:17.322914 28635 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:17.587267 22601 raft_consensus.cc:2368] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 16. Current term is 17.
W20260709 12:12:17.412112 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:17.420513 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:17.391919 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:17.461127 22452 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.006s	sys 0.028s
I20260709 12:12:17.629130 22453 raft_consensus.cc:1240] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:17.614894 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:17.471750 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:17.436518 22523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 2278) took 3036 ms. Trace:
I20260709 12:12:17.415162 22524 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 16.
I20260709 12:12:17.575017 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:12:17.434808 22450 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.019s	sys 0.016s
I20260709 12:12:17.615298 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:12:17.573452 22448 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.000s	sys 0.013s
W20260709 12:12:17.449213 22449 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.009s	sys 0.009s
I20260709 12:12:17.652274 22605 raft_consensus.cc:2393] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 13: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:17.662900 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:17.657348 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:17.433459 22456 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.010s	sys 0.025s
W20260709 12:12:17.648563 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:17.478576 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:17.648851 22606 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 17.
I20260709 12:12:17.608302 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:12:17.392685 23089 connection.cc:256] RPC call timeout handler was delayed by -1.191975045999925s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3163s for a response
I20260709 12:12:17.489195 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:12:17.668505 22450 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.882s	user 0.019s	sys 0.030s
W20260709 12:12:17.669569 22448 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.830s	user 0.000s	sys 0.015s
I20260709 12:12:17.654604 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:17.654285 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:17.669770 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:17.701046 22452 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.908s	user 0.022s	sys 0.028s
I20260709 12:12:17.701256 22453 raft_consensus.cc:2393] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 12: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:17.700048 22421 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:12:17.446297 28590 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.015s	sys 0.058s
W20260709 12:12:17.561303 28659 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.003s	sys 0.020s
W20260709 12:12:17.443166 22451 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.005s	sys 0.014s
I20260709 12:12:17.705053 23119 raft_consensus.cc:1275] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 12:12:17.532912 28391 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.017s	sys 0.040s
W20260709 12:12:17.540490 28280 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.016s	sys 0.001s
W20260709 12:12:17.580547 28534 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.003s	sys 0.020s
W20260709 12:12:17.544042 28533 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.010s	sys 0.013s
W20260709 12:12:17.668025 22456 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.883s	user 0.013s	sys 0.036s
I20260709 12:12:17.677582 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:12:17.670634 23089 connection.cc:256] RPC call timeout handler was delayed by -1.1190750460000345s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3244s for a response
W20260709 12:12:17.670758 22422 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.011s	sys 0.005s
W20260709 12:12:17.746873 22422 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.011s	sys 0.007s
W20260709 12:12:17.666473 22449 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.874s	user 0.010s	sys 0.010s
I20260709 12:12:17.747104 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:17.541268 23087 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:17.475572 28666 log.cc:927] Time spent T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 1.638s	user 0.008s	sys 0.006s
W20260709 12:12:17.570806 28185 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.008s	sys 0.006s
I20260709 12:12:17.644851 28628 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:17.653903 28704 log.cc:927] Time spent T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 12:12:17.501744 28176 consensus_meta.cc:287] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.746s	user 0.011s	sys 0.000s
I20260709 12:12:17.757218 28624 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:17.757150 28176 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:17.546774 28692 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:17.758860 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 217703us
I20260709 12:12:17.759532 28176 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:17.759722 28692 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:17.561980 28506 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.004s	sys 0.009s
I20260709 12:12:17.760331 28692 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.393174 28363 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:17.760809 28700 raft_consensus.cc:2749] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:12:17.657533 28705 log.cc:927] Time spent T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:12:17.761125 28363 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:17.760353 28506 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.915s	user 0.005s	sys 0.009s
W20260709 12:12:17.721402 22527 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.006s	sys 0.010s
W20260709 12:12:17.764667 22527 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.008s	sys 0.011s
W20260709 12:12:17.764986 28685 log.cc:927] Time spent T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 1.344s	user 0.011s	sys 0.002s
I20260709 12:12:17.765700 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:17.706602 28599 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:17.766999 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:17.767832 28599 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:17.768256 28599 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:17.769049 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:17.770103 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:17.736127 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:17.736405 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:17.772276 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:17.772948 22598 raft_consensus.cc:2393] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 16: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:17.741122 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:17.773612 22531 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:17.774650 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:17.446379 28683 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.024s	sys 0.012s
W20260709 12:12:17.444557 28600 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.930s	user 0.032s	sys 0.055s
I20260709 12:12:17.660099 28635 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:17.592555 28543 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:17.645973 28266 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:17.480760 28658 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:17.747977 22606 raft_consensus.cc:2468] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 10.
W20260709 12:12:17.708866 28590 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.891s	user 0.037s	sys 0.091s
I20260709 12:12:17.590138 28250 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:17.578572 28701 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:17.813560 22531 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 18.
I20260709 12:12:17.755966 28628 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:17.760495 22455 raft_consensus.cc:2368] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 17. Current term is 18.
I20260709 12:12:17.763235 22530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 2556) took 1262 ms. Trace:
I20260709 12:12:17.783361 28176 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:17.650406 23125 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 16.
W20260709 12:12:17.822598 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:17.763983 28363 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:17.735361 22451 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.050s	user 0.010s	sys 0.017s
I20260709 12:12:17.672084 28637 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:17.650820 22523 rpcz_store.cc:276] 0709 12:12:14.400160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:14.400278 (+   118us) service_pool.cc:224] Handling call
0709 12:12:14.400602 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:14.656707 (+256105us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:14.723859 (+ 67152us) log.cc:844] Serialized 14 byte log entry
0709 12:12:15.264318 (+540459us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:15.264370 (+    52us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:15.264414 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:17.436206 (+2171792us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b540030f7d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:17.436268 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:17.436446 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5203,"prepare.queue_time_us":52032,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":4476,"raft.queue_time_us":29234,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"spinlock_wait_cycles":588507904,"thread_start_us":484735,"threads_started":2,"wal-append.queue_time_us":268427,"wal-append.run_cpu_time_us":1199,"wal-append.run_wall_time_us":1003270}
I20260709 12:12:17.736117 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:17.779522 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:17.737469 28391 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.032s	sys 0.058s
I20260709 12:12:17.798183 28543 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:17.740355 28591 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.003s	sys 0.013s
W20260709 12:12:17.833446 28591 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.003s	sys 0.013s
I20260709 12:12:17.833684 22529 raft_consensus.cc:1275] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:12:17.834697 22457 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:12:17.755151 22422 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:17.835523 22526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 2553) took 1523 ms. Trace:
I20260709 12:12:17.835939 22526 rpcz_store.cc:276] 0709 12:12:16.312605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:16.312776 (+   171us) service_pool.cc:224] Handling call
0709 12:12:16.377892 (+ 65116us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:16.386399 (+  8507us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:17.835295 (+1448896us) spinlock_profiling.cc:243] Waited 7.56 ms on lock 0x7b54000d3ed4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:17.835465 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17394944}
I20260709 12:12:17.797868 28266 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:17.845140 28266 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:17.845631 23120 raft_consensus.cc:1240] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 13 LEADER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:17.814919 28250 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:17.847297 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:12:17.848635 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 93631.2us
I20260709 12:12:17.849315 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:17.850153 22457 raft_consensus.cc:2393] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 17: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
W20260709 12:12:17.850262 28558 consensus_meta.cc:287] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 1.014s	user 0.004s	sys 0.007s
I20260709 12:12:17.851207 28391 raft_consensus.cc:2804] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:12:17.851480 28716 log.cc:927] Time spent T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:12:17.851660 28391 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:17.852049 22603 raft_consensus.cc:2410] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 12:12:17.834820 28543 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:17.853097 22603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43070 (request call id 1016) took 1308 ms. Trace:
I20260709 12:12:17.853433 22603 rpcz_store.cc:276] 0709 12:12:16.545155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:16.744755 (+199600us) service_pool.cc:224] Handling call
0709 12:12:17.852903 (+1108148us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54000e8b54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:17.853043 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2369069312}
I20260709 12:12:17.854568 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:17.773033 28185 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.929s	user 0.012s	sys 0.006s
I20260709 12:12:17.784092 22532 pending_rounds.cc:85] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting all ops after (but not including) 11
I20260709 12:12:17.381625 28694 consensus_queue.cc:1059] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.335s
I20260709 12:12:17.386276 28645 consensus_queue.cc:1059] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.362s
I20260709 12:12:17.859845 28694 raft_consensus.cc:3055] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:17.860798 28694 raft_consensus.cc:740] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:17.861565 28694 consensus_queue.cc:260] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:17.863219 28645 raft_consensus.cc:3055] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:17.863615 28645 raft_consensus.cc:740] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:17.864435 28645 consensus_queue.cc:260] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:17.865083 28628 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:17.865401 22601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43070 (request call id 1012) took 1343 ms. Trace:
I20260709 12:12:17.865641 28637 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:17.865748 22601 rpcz_store.cc:276] 0709 12:12:16.522168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:16.963704 (+441536us) service_pool.cc:224] Handling call
0709 12:12:17.865196 (+901492us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b5400043154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:17.865341 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1236949760}
I20260709 12:12:17.709473 28337 raft_consensus.cc:2804] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:17.866925 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:17.867386 28337 raft_consensus.cc:697] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:17.867506 22601 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:17.867887 28637 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:17.869374 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 58978.2us
I20260709 12:12:17.858894 22532 pending_rounds.cc:107] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 12:12:17.870337 22532 raft_consensus.cc:2889] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:17.869441 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:17.871600 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:17.872526 22457 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
mode: GRACEFUL
new_leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:44568
I20260709 12:12:17.873049 22457 raft_consensus.cc:606] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Received request to transfer leadership to TS 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:17.873436 22457 raft_consensus.cc:614] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:12:17.737353 28280 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.896s	user 0.016s	sys 0.013s
I20260709 12:12:17.858057 22422 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:17.852079 28391 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:17.880412 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:17.881032 22606 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
I20260709 12:12:17.881450 22528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 1221) took 1184 ms. Trace:
W20260709 12:12:17.744343 28534 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.937s	user 0.007s	sys 0.025s
I20260709 12:12:17.786972 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:17.791708 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:17.885819 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:17.886888 22529 raft_consensus.cc:2393] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 14: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:17.881400 22422 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:17.638752 28555 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:17.795635 22525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 1222) took 1084 ms. Trace:
I20260709 12:12:17.775009 28636 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:17.799471 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:12:17.782243 28683 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.999s	user 0.026s	sys 0.026s
W20260709 12:12:17.751040 28533 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.898s	user 0.018s	sys 0.016s
W20260709 12:12:17.790616 28600 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.377s	user 0.034s	sys 0.071s
I20260709 12:12:17.754890 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:12:17.796101 28679 log.cc:927] Time spent T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:12:17.818034 22421 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:12:17.912778 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 94829.1us
I20260709 12:12:17.821630 22530 rpcz_store.cc:276] 0709 12:12:16.500660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:16.502196 (+  1536us) service_pool.cc:224] Handling call
0709 12:12:16.502498 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:16.502793 (+   295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:16.502817 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:16.503225 (+   408us) log.cc:844] Serialized 26 byte log entry
0709 12:12:17.373463 (+870238us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:17.373532 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:17.373647 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:17.763045 (+389398us) raft_consensus.cc:1685] finished
0709 12:12:17.763065 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:17.763182 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2912,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":150,"thread_start_us":834587,"threads_started":1,"wal-append.queue_time_us":1021040}
I20260709 12:12:17.829671 22599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43070 (request call id 1014) took 1285 ms. Trace:
I20260709 12:12:17.760844 28692 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:17.827173 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:17.920377 22598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43070 (request call id 1036) took 1230 ms. Trace:
I20260709 12:12:17.920842 22598 rpcz_store.cc:276] 0709 12:12:16.690139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.811707 (+1121568us) service_pool.cc:224] Handling call
0709 12:12:17.920298 (+108591us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:17.856593 28250 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:17.741958 28659 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.003s	sys 0.025s
I20260709 12:12:17.862771 28694 raft_consensus.cc:3060] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:17.742859 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:17.935020 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:17.883481 22528 rpcz_store.cc:276] 0709 12:12:16.696969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.191411 (+494442us) service_pool.cc:224] Handling call
0709 12:12:17.219518 (+ 28107us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:17.715670 (+496152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:17.715701 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:17.715744 (+    43us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:17.715783 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:17.881239 (+165456us) spinlock_profiling.cc:243] Waited 496 ms on lock 0x7b5400231254. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:17.881291 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:17.881399 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1140574464}
I20260709 12:12:17.886118 23118 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
I20260709 12:12:17.792500 22600 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 20.
I20260709 12:12:17.889726 22422 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:17.936360 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:17.896904 22525 rpcz_store.cc:276] 0709 12:12:16.711055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.289820 (+578765us) service_pool.cc:224] Handling call
0709 12:12:17.290142 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:17.290363 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:17.297279 (+  6916us) log.cc:844] Serialized 14 byte log entry
0709 12:12:17.795229 (+497950us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:17.795284 (+    55us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:17.795333 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:17.795422 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:17.795562 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1063,"prepare.queue_time_us":6447,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":7802,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":15368,"thread_start_us":489769,"threads_started":1}
I20260709 12:12:17.885231 28543 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:17.899482 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:17.902518 22450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 1190) took 1119 ms. Trace:
I20260709 12:12:17.941942 22602 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:17.902055 28590 raft_consensus.cc:2804] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:17.907572 22497 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:17.910880 22601 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 18.
I20260709 12:12:17.943866 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:17.944646 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:17.945403 22600 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
I20260709 12:12:17.924922 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:17.825790 28701 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:17.916491 22599 rpcz_store.cc:276] 0709 12:12:16.544608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.770908 (+1226300us) service_pool.cc:224] Handling call
0709 12:12:17.829594 (+ 58686us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:17.946246 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:17.929127 23125 raft_consensus.cc:1240] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:17.947155 22600 raft_consensus.cc:2410] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:12:17.932332 23117 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 18.
I20260709 12:12:17.937071 23119 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:17.947536 22600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43070 (request call id 1037) took 1257 ms. Trace:
I20260709 12:12:17.876209 22603 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 13.
I20260709 12:12:17.947904 22600 rpcz_store.cc:276] 0709 12:12:16.690423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.946048 (+1255625us) service_pool.cc:224] Handling call
0709 12:12:17.947485 (+  1437us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:17.937997 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:17.948902 22598 raft_consensus.cc:2410] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 12:12:17.948737 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:17.949348 22600 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:12:17.949739 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:17.950268 22598 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:17.952693 22605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43070 (request call id 1010) took 1441 ms (client timeout 1716 ms). Trace:
W20260709 12:12:17.953069 22605 rpcz_store.cc:269] 0709 12:12:16.511733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:16.512871 (+  1138us) service_pool.cc:224] Handling call
0709 12:12:17.952519 (+1439648us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540013c754. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:17.952640 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2572331264}
I20260709 12:12:17.954010 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:17.870160 28176 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:17.956283 28176 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:17.957280 22600 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 13.
I20260709 12:12:17.958145 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:17.906677 23120 raft_consensus.cc:1217] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 18 LEADER]: Deduplicated request from leader. Original: 15.12->[17.13-17.13]   Dedup: 17.13->[]
I20260709 12:12:17.958935 23120 raft_consensus.cc:1240] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 18 LEADER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:12:17.924631 28626 raft_consensus.cc:2804] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:17.959687 28626 raft_consensus.cc:697] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 18 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:17.941874 22450 rpcz_store.cc:276] 0709 12:12:16.783375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:16.786018 (+  2643us) service_pool.cc:224] Handling call
0709 12:12:16.786331 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:16.786521 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:17.707578 (+921057us) log.cc:844] Serialized 14 byte log entry
0709 12:12:17.902141 (+194563us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:17.902229 (+    88us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:17.902287 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:17.902352 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:17.902466 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10898,"prepare.queue_time_us":831208,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":3556,"raft.queue_time_us":87,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":15366,"thread_start_us":1114515,"threads_started":2}
I20260709 12:12:17.960603 28626 consensus_queue.cc:237] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:17.963596 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 73984.1us
I20260709 12:12:17.964214 28250 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:12:17.964540 28719 log.cc:927] Time spent T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 12:12:17.964704 28250 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:17.965106 22422 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:17.965225 28250 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:17.967024 28721 raft_consensus.cc:2804] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:17.967451 28721 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:17.967556 28628 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:17.967809 28721 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:17.967975 28628 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:17.968405 28628 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:17.970232 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:17.971812 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:17.974288 28391 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:17.979352 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:17.980065 22603 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 16.
I20260709 12:12:17.981303 22603 raft_consensus.cc:1240] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:17.981906 22603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3295) took 1462 ms. Trace:
I20260709 12:12:17.982249 22603 rpcz_store.cc:276] 0709 12:12:16.519803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.980762 (+1460959us) service_pool.cc:224] Handling call
0709 12:12:17.981101 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:17.981667 (+   566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:17.981851 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:17.984432 22529 raft_consensus.cc:2955] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 5 to 8, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:17.987406 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:17.988044 22599 raft_consensus.cc:2376] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 16. Re-sending same reply.
I20260709 12:12:17.925900 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:17.990190 22606 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 16.
W20260709 12:12:17.917150 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:17.993251 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:17.944892 22601 raft_consensus.cc:2410] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:12:17.994621 22601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45562 (request call id 2877) took 1175 ms. Trace:
W20260709 12:12:17.995340 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 47563.1us
I20260709 12:12:17.995764 22601 rpcz_store.cc:276] 0709 12:12:16.819735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.943544 (+1123809us) service_pool.cc:224] Handling call
0709 12:12:17.994537 (+ 50993us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:17.997128 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:17.997993 22601 raft_consensus.cc:2393] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 17: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:17.995616 22605 raft_consensus.cc:2410] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 12:12:18.003417 22601 raft_consensus.cc:1240] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:18.003630 22422 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:12:17.889361 28411 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.011s	sys 0.028s
I20260709 12:12:18.009248 22601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3299) took 1483 ms. Trace:
I20260709 12:12:18.004408 23119 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 15.
W20260709 12:12:18.010838 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:18.011549 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.017061 22422 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:12:18.018741 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 111293us
I20260709 12:12:18.019579 22422 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:18.019757 22497 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:18.021138 22497 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:18.023550 22497 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:18.009836 22601 rpcz_store.cc:276] 0709 12:12:16.520745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.998728 (+1477983us) service_pool.cc:224] Handling call
0709 12:12:18.003209 (+  4481us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:18.003968 (+   759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:18.004253 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:18.029007 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:18.035331 22602 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 14.
I20260709 12:12:18.037748 22598 raft_consensus.cc:2468] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 14.
I20260709 12:12:18.040449 22497 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:18.039654 22456 raft_consensus.cc:2368] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 18. Current term is 19.
W20260709 12:12:18.004956 28699 log.cc:927] Time spent T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:12:18.030653 22606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3298) took 1510 ms. Trace:
I20260709 12:12:18.047809 22606 rpcz_store.cc:276] 0709 12:12:16.520495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.990752 (+1470257us) service_pool.cc:224] Handling call
0709 12:12:18.030186 (+ 39434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:18.030358 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:18.030382 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:18.030424 (+    42us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:18.030453 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:18.030501 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:18.030599 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:18.045032 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:18.049263 23119 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 15.
I20260709 12:12:18.049481 22497 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
W20260709 12:12:18.015579 28411 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.012s	sys 0.028s
I20260709 12:12:17.947347 28590 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:17.982753 28692 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:17.933925 28625 consensus_queue.cc:1048] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.110s
I20260709 12:12:17.868351 28337 consensus_queue.cc:237] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:18.039710 28591 raft_consensus.cc:2804] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:18.053915 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:18.039987 28544 raft_consensus.cc:2804] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:18.055982 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:18.050601 22497 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:17.986479 28721 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:18.057683 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:18.027643 28185 raft_consensus.cc:2749] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:18.027667 28354 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:18.051452 22421 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:18.056777 28621 raft_consensus.cc:2804] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:18.077131 22603 raft_consensus.cc:2393] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 18: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:18.051282 28680 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.057389 28590 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:18.082659 23089 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:18.100446 28266 consensus_queue.cc:1059] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 12:12:18.124488 28266 raft_consensus.cc:3055] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:18.124871 28266 raft_consensus.cc:740] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:18.125746 28266 consensus_queue.cc:260] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:18.130388 28729 log.cc:927] Time spent T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:12:18.117412 22351 catalog_manager.cc:5697] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:18.133339 22351 catalog_manager.cc:5697] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 8 to 10, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 10 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:18.135180 28266 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:18.138052 22351 catalog_manager.cc:5697] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 9 to 11, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 11 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:18.138554 28250 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:18.089969 22598 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 12.
I20260709 12:12:18.051506 28659 raft_consensus.cc:2804] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:18.140362 22351 catalog_manager.cc:5697] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 3 to 10. New cstate: current_term: 10 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:18.098275 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:18.140559 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:18.088966 22497 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:18.141791 22598 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 10.
W20260709 12:12:18.142043 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 53154.9us
I20260709 12:12:18.143193 28185 raft_consensus.cc:2804] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:18.143255 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:18.095445 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:18.143860 28185 raft_consensus.cc:697] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:18.144297 22606 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 16.
I20260709 12:12:18.144832 28185 consensus_queue.cc:237] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:18.041100 28707 raft_consensus.cc:2749] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:18.140938 28659 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:18.146298 28659 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:18.057046 28584 raft_consensus.cc:2804] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:18.147650 28584 raft_consensus.cc:697] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:18.148512 28584 consensus_queue.cc:237] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:18.149247 28555 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:18.150813 28723 log.cc:927] Time spent T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:12:18.142705 22497 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
W20260709 12:12:18.143672 28728 log.cc:927] Time spent T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:12:18.152230 28624 raft_consensus.cc:2804] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:12:18.101704 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 50351.7us
I20260709 12:12:18.152752 28624 raft_consensus.cc:697] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:18.153232 28701 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:18.153295 22527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 2561) took 1620 ms. Trace:
I20260709 12:12:18.153592 28624 consensus_queue.cc:237] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:18.145201 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:18.154178 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:18.155236 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.155380 22606 raft_consensus.cc:2410] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
W20260709 12:12:18.156677 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 147216us
W20260709 12:12:18.157519 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.143945 22598 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 16.
I20260709 12:12:18.154486 28026 consensus_queue.cc:1059] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 12:12:18.158456 22454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 1195) took 1305 ms. Trace:
I20260709 12:12:18.176103 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:18.177026 22602 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 18.
I20260709 12:12:18.159720 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:18.078691 28591 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:18.161211 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:18.174342 22454 rpcz_store.cc:276] 0709 12:12:16.852893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:16.853031 (+   138us) service_pool.cc:224] Handling call
0709 12:12:16.960151 (+107120us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:16.960504 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:16.960531 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:17.050469 (+ 89938us) log.cc:844] Serialized 26 byte log entry
0709 12:12:17.441094 (+390625us) spinlock_profiling.cc:243] Waited 2.07 ms on lock 0x7b180048eb00. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc7823e07 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc7840c02 00007f9cca4c820b 00007f9cca4cdd23 00007f9cca4ce0d1 00007f9cca8e9a0f
0709 12:12:17.792884 (+351790us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:17.792946 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:17.793035 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:18.154797 (+361762us) raft_consensus.cc:1685] finished
0709 12:12:18.154815 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:18.158385 (+  3570us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3755,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":28759,"spinlock_wait_cycles":4756352,"thread_start_us":351549,"threads_started":1,"wal-append.queue_time_us":959698}
I20260709 12:12:18.153858 22527 rpcz_store.cc:276] 0709 12:12:16.533486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.100129 (+566643us) service_pool.cc:224] Handling call
0709 12:12:17.102820 (+  2691us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:17.103171 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:17.103198 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:17.103741 (+   543us) log.cc:844] Serialized 26 byte log entry
0709 12:12:17.765103 (+661362us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:17.765156 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:17.765247 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:18.153100 (+387853us) raft_consensus.cc:1685] finished
0709 12:12:18.153121 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:18.153238 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1245,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":54761,"thread_start_us":552490,"threads_started":1,"wal-append.queue_time_us":869960}
I20260709 12:12:18.184362 22457 raft_consensus.cc:1240] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 18 LEADER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 16. Current term is 18. Ops: []
W20260709 12:12:18.120002 28715 log.cc:927] Time spent T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 12:12:18.185829 22606 raft_consensus.cc:1240] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:18.187322 23119 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:18.088231 28637 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:18.191757 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:18.189611 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:18.097952 28682 raft_consensus.cc:2804] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:18.204272 22606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3301) took 1682 ms. Trace:
W20260709 12:12:18.211498 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.211851 22606 rpcz_store.cc:276] 0709 12:12:16.521423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:18.174361 (+1652938us) service_pool.cc:224] Handling call
0709 12:12:18.174771 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:18.203964 (+ 29193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:18.204203 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:18.211541 22603 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 15.
I20260709 12:12:18.122872 28621 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:18.220407 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:18.158916 28620 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:18.228613 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:18.230338 22454 raft_consensus.cc:2368] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 18. Current term is 19.
I20260709 12:12:18.178489 28635 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.225605 23119 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:12:18.227778 23088 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:18.198501 28591 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:18.101015 28544 raft_consensus.cc:697] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 18 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:18.238036 22454 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:44568
I20260709 12:12:18.247200 22454 raft_consensus.cc:606] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:12:18.247555 22454 raft_consensus.cc:614] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:18.240707 23087 leader_election.cc:400] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 election: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 18. Current term is 19.
I20260709 12:12:18.221117 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:18.247983 23087 leader_election.cc:403] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:12:18.242534 22598 raft_consensus.cc:1275] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:12:18.248703 22598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3304) took 1645 ms. Trace:
I20260709 12:12:18.249081 22598 rpcz_store.cc:276] 0709 12:12:16.603609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:18.215575 (+1611966us) service_pool.cc:224] Handling call
0709 12:12:18.242201 (+ 26626us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:18.248467 (+  6266us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:18.248648 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:12:18.249559 28732 log.cc:927] Time spent T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:12:18.250651 22598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3306) took 1646 ms. Trace:
I20260709 12:12:18.228596 28542 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.251266 28542 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:18.251679 28735 log.cc:927] Time spent T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:12:18.253619 28542 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:18.255975 28544 consensus_queue.cc:237] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:18.259135 28681 consensus_queue.cc:1059] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:18.260200 28681 raft_consensus.cc:3055] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:18.260578 28681 raft_consensus.cc:740] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:18.261380 28681 consensus_queue.cc:260] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:18.263422 22449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 1194) took 1473 ms. Trace:
I20260709 12:12:18.263777 22449 rpcz_store.cc:276] 0709 12:12:16.790426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:16.791072 (+   646us) service_pool.cc:224] Handling call
0709 12:12:16.791431 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:16.791888 (+   457us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:12:17.747623 (+955735us) log.cc:844] Serialized 14 byte log entry
0709 12:12:17.908010 (+160387us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:17.924909 (+ 16899us) log.cc:844] Serialized 26 byte log entry
0709 12:12:17.925061 (+   152us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:17.925097 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:17.925167 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:18.258116 (+332949us) spinlock_profiling.cc:243] Waited 5.1 ms on lock 0x7b4800130d58. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9ccf857aa1 00007f9ccf84eb37 00007f9ccf84e9ca 00007f9ccf94626f 00007f9ccf945f37 00007f9ccf95a55c 00007f9ccf95a508 00007f9ccf95a488 00007f9ccf95a443 00007f9ccf9596ec 00007f9cce883a96
0709 12:12:18.263129 (+  5013us) raft_consensus.cc:1685] finished
0709 12:12:18.263233 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:18.263362 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":844615,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":550,"raft.run_cpu_time_us":2923,"raft.run_wall_time_us":347114,"spinlock_wait_cycles":11740416,"thread_start_us":1098458,"threads_started":2,"wal-append.queue_time_us":295559}
I20260709 12:12:18.265679 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:18.266348 22449 raft_consensus.cc:2393] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 22: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:18.268307 22454 raft_consensus.cc:1240] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:12:18.246492 23088 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:18.272681 23088 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:18.273310 28659 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:18.274000 23088 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:18.275144 28534 raft_consensus.cc:2749] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:18.275377 28651 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:18.275800 28534 raft_consensus.cc:2749] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:18.276530 28534 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:18.241689 28179 raft_consensus.cc:2749] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:18.279547 22449 raft_consensus.cc:1240] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:18.280176 22524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 2567) took 1474 ms. Trace:
I20260709 12:12:18.280448 28391 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:18.262750 28681 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:18.216364 28555 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:18.216711 28480 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.229099 28682 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:18.120647 28354 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:18.245869 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:18.243345 22351 catalog_manager.cc:5697] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 10 to 12, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 12 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:18.327929 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 265433us
I20260709 12:12:18.288040 22598 rpcz_store.cc:276] 0709 12:12:16.604405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:18.249912 (+1645507us) service_pool.cc:224] Handling call
0709 12:12:18.250169 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:18.250340 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:18.250365 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:18.250410 (+    45us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:18.250452 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:18.250511 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:18.250603 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:18.289693 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:12:18.290764 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 208178us
I20260709 12:12:18.331856 23089 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:18.292376 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:18.332959 22601 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:18.226774 28621 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:18.293762 22570 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:12:18.337940 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 44266.3us
I20260709 12:12:18.294629 22421 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
W20260709 12:12:18.300328 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:18.339568 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 45015.2us
I20260709 12:12:18.310595 28026 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.160386 28680 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:18.280665 22524 rpcz_store.cc:276] 0709 12:12:16.805959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.705770 (+899811us) service_pool.cc:224] Handling call
0709 12:12:17.706089 (+   319us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:17.706510 (+   421us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:12:17.750851 (+ 44341us) log.cc:844] Serialized 14 byte log entry
0709 12:12:17.980676 (+229825us) spinlock_profiling.cc:243] Waited 7.04 ms on lock 0x7b1800436a80. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc78413f3 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd 0000000000388634 0000000000388479 00007f9cc782483a
0709 12:12:18.009913 (+ 29237us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:18.027657 (+ 17744us) log.cc:844] Serialized 52 byte log entry
0709 12:12:18.027825 (+   168us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:18.027860 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:18.027927 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:18.279824 (+251897us) raft_consensus.cc:1685] finished
0709 12:12:18.279949 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:18.280110 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4749,"prepare.queue_time_us":59476,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":13201,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":35726,"spinlock_wait_cycles":16184576,"thread_start_us":194955,"threads_started":1,"wal-append.queue_time_us":329447}
I20260709 12:12:18.334337 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:18.351334 22598 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 16.
I20260709 12:12:18.222623 28637 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:18.340987 22421 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:18.346362 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:18.311851 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 71282.6us
I20260709 12:12:18.354907 22421 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:18.346382 22527 raft_consensus.cc:1240] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:18.356336 22598 raft_consensus.cc:1275] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:12:18.292829 28606 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.362177 22421 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:18.365808 22448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 1189) took 1605 ms. Trace:
W20260709 12:12:18.311669 28639 consensus_meta.cc:287] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 1.234s	user 0.013s	sys 0.001s
I20260709 12:12:18.350196 22570 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:18.367828 22448 rpcz_store.cc:276] 0709 12:12:16.760396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:16.760532 (+   136us) service_pool.cc:224] Handling call
0709 12:12:16.760902 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:16.798599 (+ 37697us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:16.798646 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:16.828294 (+ 29648us) log.cc:844] Serialized 26 byte log entry
0709 12:12:17.701585 (+873291us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:12:17.701625 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:17.702082 (+   457us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:18.365542 (+663460us) raft_consensus.cc:1685] finished
0709 12:12:18.365574 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:18.365737 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":96,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":4982,"thread_start_us":862258,"threads_started":1,"wal-append.queue_time_us":958061}
I20260709 12:12:18.370733 22598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43070 (request call id 1029) took 1669 ms. Trace:
I20260709 12:12:18.371438 22598 rpcz_store.cc:276] 0709 12:12:16.688022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:18.355566 (+1667544us) service_pool.cc:224] Handling call
0709 12:12:18.355908 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:18.357651 (+  1743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:18.357820 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:18.372445 22421 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:18.311379 28280 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:18.378968 22450 raft_consensus.cc:1217] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Deduplicated request from leader. Original: 15.12->[17.13-17.13]   Dedup: 17.13->[]
I20260709 12:12:18.379537 22450 raft_consensus.cc:1240] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:12:18.380234 22451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 1186) took 1699 ms. Trace:
I20260709 12:12:18.382426 22457 raft_consensus.cc:1240] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:18.374482 22598 raft_consensus.cc:1275] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 12:12:18.335685 28682 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:18.247745 28635 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:18.383185 22597 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 17.
I20260709 12:12:18.312974 28691 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:18.358182 28534 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:18.350862 28533 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:18.380609 22451 rpcz_store.cc:276] 0709 12:12:16.680943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:16.681071 (+   128us) service_pool.cc:224] Handling call
0709 12:12:16.681368 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:16.681598 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:12:17.846533 (+1164935us) log.cc:844] Serialized 14 byte log entry
0709 12:12:18.054309 (+207776us) log.cc:844] Serialized 14 byte log entry
0709 12:12:18.255731 (+201422us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b180019f9c0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc7841522 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd 0000000000388634 0000000000388479 00007f9cc782483a
0709 12:12:18.274927 (+ 19196us) spinlock_profiling.cc:243] Waited 3.43 ms on lock 0x7b180019f9c0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc7823e07 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc783e455 00007f9cca926060 00007f9cca938716 00007f9cca949287 00007f9cca949208
0709 12:12:18.377450 (+102523us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:18.378265 (+   815us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:18.378677 (+   412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:18.378755 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:18.380162 (+  1407us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8183,"prepare.queue_time_us":906558,"prepare.run_cpu_time_us":120,"prepare.run_wall_time_us":20985,"raft.queue_time_us":16285,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":20887,"spinlock_wait_cycles":58629248,"thread_start_us":1432484,"threads_started":3,"wal-append.queue_time_us":384483}
I20260709 12:12:18.349617 28349 raft_consensus.cc:2804] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:12:18.361232 28599 consensus_meta.cc:287] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.593s	user 0.007s	sys 0.004s
I20260709 12:12:18.385533 22351 catalog_manager.cc:5697] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 6 to 10, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 10 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:18.407912 22351 catalog_manager.cc:5697] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 7 to 12, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 12 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:18.393505 22598 pending_rounds.cc:85] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting all ops after (but not including) 11
I20260709 12:12:18.358464 28391 raft_consensus.cc:2749] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:18.387321 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:18.311806 28176 consensus_queue.cc:1059] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 12:12:18.364490 28625 raft_consensus.cc:2749] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:18.419844 22598 pending_rounds.cc:107] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 12:12:18.335701 28480 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:18.384814 28363 raft_consensus.cc:2804] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:18.325898 28538 consensus_queue.cc:1048] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.058s
W20260709 12:12:18.404943 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:18.431182 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.398934 22601 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 19.
I20260709 12:12:18.429126 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:18.387945 28542 raft_consensus.cc:2749] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:18.360105 28687 consensus_queue.cc:1059] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 12:12:18.359900 28026 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:18.463059 22449 raft_consensus.cc:1240] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:18.441828 28754 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:18.403002 28659 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:18.464342 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:18.442864 28543 raft_consensus.cc:2749] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:18.444384 28250 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 22 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:18.447584 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:18.448382 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:18.449968 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.451140 28680 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:18.451422 28687 raft_consensus.cc:3055] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:12:18.452122 28726 log.cc:927] Time spent T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:12:18.454523 28645 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:18.455940 22597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45562 (request call id 2884) took 1615 ms. Trace:
I20260709 12:12:18.457859 22603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2875) took 1656 ms. Trace:
I20260709 12:12:18.364174 28626 consensus_queue.cc:1048] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.061s
W20260709 12:12:18.459571 28748 log.cc:927] Time spent T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:12:18.506443 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:18.424599 28349 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:18.460543 28721 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:18.461946 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:18.424041 28692 raft_consensus.cc:2804] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:18.463946 22601 raft_consensus.cc:1275] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:12:18.510004 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:18.509538 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 137272us
I20260709 12:12:18.405465 28720 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:18.472303 28639 consensus_queue.cc:1059] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 12:12:18.431047 28599 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:18.476331 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:18.480432 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:18.442898 28737 log.cc:927] Time spent T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:12:18.523036 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:12:18.484333 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 152584us
I20260709 12:12:18.400770 28691 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:18.397943 28744 consensus_queue.cc:1048] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.090s
I20260709 12:12:18.485700 22597 rpcz_store.cc:276] 0709 12:12:16.840599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.100854 (+260255us) service_pool.cc:224] Handling call
0709 12:12:18.455781 (+1354927us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54000e8654. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:18.455884 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2942042368}
I20260709 12:12:18.527952 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:18.528734 22597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2876) took 1726 ms. Trace:
I20260709 12:12:18.494886 22598 raft_consensus.cc:2889] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:12:18.486291 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 146410us
I20260709 12:12:18.529276 22597 rpcz_store.cc:276] 0709 12:12:16.802213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:18.528013 (+1725800us) service_pool.cc:224] Handling call
0709 12:12:18.528283 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:18.528449 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:18.528482 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:18.528523 (+    41us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:18.528552 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:18.528600 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:18.528684 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:18.472671 28754 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:18.425516 28533 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:18.507169 22603 rpcz_store.cc:276] 0709 12:12:16.801906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:18.457108 (+1655202us) service_pool.cc:224] Handling call
0709 12:12:18.457413 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:18.457583 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:18.457605 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:18.457644 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:12:18.457672 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:18.457720 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:18.457810 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:18.532657 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:18.532073 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:18.488085 22605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3305) took 1884 ms. Trace:
I20260709 12:12:18.531787 22598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43070 (request call id 1035) took 1841 ms. Trace:
I20260709 12:12:18.458774 28628 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:18.510689 22601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43070 (request call id 1040) took 1785 ms. Trace:
I20260709 12:12:18.534672 22598 rpcz_store.cc:276] 0709 12:12:16.689844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:18.372320 (+1682476us) service_pool.cc:224] Handling call
0709 12:12:18.372690 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:18.531271 (+158581us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:18.531670 (+   399us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:18.510793 22448 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 17.
I20260709 12:12:18.495151 22351 catalog_manager.cc:5697] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:12:18.534912 22601 rpcz_store.cc:276] 0709 12:12:16.725237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:18.439206 (+1713969us) service_pool.cc:224] Handling call
0709 12:12:18.439670 (+   464us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:18.510446 (+ 70776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:18.510633 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:18.536360 22598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2878) took 1711 ms. Trace:
I20260709 12:12:18.536540 22601 raft_consensus.cc:1240] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:18.537238 22601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2880) took 1697 ms. Trace:
I20260709 12:12:18.536703 22598 rpcz_store.cc:276] 0709 12:12:16.825840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:18.535667 (+1709827us) service_pool.cc:224] Handling call
0709 12:12:18.535915 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:18.536065 (+   150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:18.536088 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:18.536125 (+    37us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:18.536152 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:18.536199 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:18.536294 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:18.512058 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:12:18.459483 28736 log.cc:927] Time spent T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:12:18.382427 28606 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:18.515944 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:18.518872 22570 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:18.524392 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:18.526542 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:18.528702 23121 raft_consensus.cc:2376] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 15. Re-sending same reply.
I20260709 12:12:18.531070 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:12:18.531618 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.507836 28176 consensus_queue.cc:1243] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer 8701cd5186a949538d8efafb5f987270 log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:12:18.533651 22605 rpcz_store.cc:276] 0709 12:12:16.604020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:18.238787 (+1634767us) service_pool.cc:224] Handling call
0709 12:12:18.239124 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:18.239326 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:12:18.308779 (+ 69453us) log.cc:844] Serialized 14 byte log entry
0709 12:12:18.405492 (+ 96713us) log.cc:844] Serialized 14 byte log entry
0709 12:12:18.487651 (+ 82159us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:18.487719 (+    68us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:18.487788 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:18.487873 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:18.488018 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":272045,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":109063,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":141,"thread_start_us":218942,"threads_started":3}
I20260709 12:12:18.537639 22601 rpcz_store.cc:276] 0709 12:12:16.839449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:18.536090 (+1696641us) service_pool.cc:224] Handling call
0709 12:12:18.536369 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:18.537014 (+   645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:18.537186 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:18.465091 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:18.570278 22452 raft_consensus.cc:1240] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 19. Current term is 21. Ops: []
I20260709 12:12:18.559196 22531 raft_consensus.cc:1275] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:12:18.511621 28349 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:18.539778 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:12:18.564508 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.575976 22351 catalog_manager.cc:5697] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:12:18.520870 28758 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:18.482551 28687 raft_consensus.cc:740] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:18.568234 22449 raft_consensus.cc:2410] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 21 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 12:12:18.514724 28692 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:18.565738 22450 raft_consensus.cc:2393] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 13: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:18.581789 22523 raft_consensus.cc:2410] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
W20260709 12:12:18.585456 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 51311.7us
I20260709 12:12:18.590548 23089 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:18.588182 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 69414.7us
I20260709 12:12:18.533331 28754 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:18.596239 22570 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:18.585412 23121 raft_consensus.cc:2955] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 5 to 8, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:18.617025 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:18.588390 22603 raft_consensus.cc:2955] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 5 to 8, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:18.592245 28758 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:18.584821 28765 raft_consensus.cc:3055] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:18.593735 28692 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:18.637741 22448 raft_consensus.cc:1240] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 21. Current term is 22. Ops: []
W20260709 12:12:18.656281 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 58960.1us
I20260709 12:12:18.634402 28762 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.646436 28639 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.648113 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:12:18.696650 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 63568.6us
I20260709 12:12:18.697640 22569 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:18.633379 28176 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:18.637598 28759 log.cc:927] Time spent T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:12:18.641208 28651 raft_consensus.cc:3055] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:18.593852 28707 consensus_queue.cc:1048] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
W20260709 12:12:18.701210 28737 log.cc:927] Time spent T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:12:18.638775 28628 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:18.648942 28765 raft_consensus.cc:740] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:18.638393 28758 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:12:18.721742 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 125559us
I20260709 12:12:18.724645 22569 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:18.724720 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:18.707471 28354 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:18.708411 28651 raft_consensus.cc:740] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:18.733891 22524 raft_consensus.cc:1240] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 11. Current term is 12. Ops: []
W20260709 12:12:18.732194 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 145656us
I20260709 12:12:18.714581 28179 raft_consensus.cc:2804] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:18.711918 28764 raft_consensus.cc:2804] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:18.741138 28179 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:18.736158 22532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 2570) took 1573 ms. Trace:
I20260709 12:12:18.741657 28179 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:18.741611 28780 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.743260 28781 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.741787 22532 rpcz_store.cc:276] 0709 12:12:17.162273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.783454 (+621181us) service_pool.cc:224] Handling call
0709 12:12:17.783849 (+   395us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:17.882180 (+ 98331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:17.882227 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:17.885443 (+  3216us) log.cc:844] Serialized 52 byte log entry
0709 12:12:18.052507 (+167064us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:18.159015 (+106508us) log.cc:844] Serialized 14 byte log entry
0709 12:12:18.394645 (+235630us) log.cc:844] Serialized 14 byte log entry
0709 12:12:18.430091 (+ 35446us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:18.430238 (+   147us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:18.735908 (+305670us) raft_consensus.cc:1685] finished
0709 12:12:18.735928 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:18.736052 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54252,"prepare.queue_time_us":26075,"prepare.run_cpu_time_us":129,"prepare.run_wall_time_us":2771,"raft.queue_time_us":173241,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":9982,"thread_start_us":337358,"threads_started":2,"wal-append.queue_time_us":317000}
I20260709 12:12:18.743745 28781 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:18.746253 22569 leader_election.cc:400] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 election: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 17. Current term is 18.
I20260709 12:12:18.746672 22569 leader_election.cc:403] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:12:18.746994 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:18.716048 28635 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:18.705447 28639 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:18.748042 22532 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 16.
I20260709 12:12:18.739462 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:18.727130 28758 raft_consensus.cc:2749] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:18.711680 28176 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:18.701050 28762 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:18.750520 28781 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:18.782831 28599 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:18.822693 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.704792 28687 consensus_queue.cc:260] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:18.747517 28363 raft_consensus.cc:697] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:18.749362 28764 raft_consensus.cc:697] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:18.782595 28765 consensus_queue.cc:260] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:18.785249 28635 raft_consensus.cc:2749] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:12:18.851014 28759 log.cc:927] Time spent T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:12:18.876166 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:18.742551 28780 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:18.890347 28761 log.cc:927] Time spent T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
W20260709 12:12:18.891431 28739 log.cc:927] Time spent T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.643s	user 0.000s	sys 0.004s
W20260709 12:12:18.892108 28753 log.cc:927] Time spent T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
W20260709 12:12:18.903467 28769 log.cc:927] Time spent T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:12:18.903669 22605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2885) took 2062 ms. Trace:
I20260709 12:12:18.904048 22605 rpcz_store.cc:276] 0709 12:12:16.840905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:18.568212 (+1727307us) service_pool.cc:224] Handling call
0709 12:12:18.568492 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:18.638595 (+ 70103us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:18.638633 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:18.638678 (+    45us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:18.638712 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:18.903421 (+264709us) spinlock_profiling.cc:243] Waited 69.9 ms on lock 0x7b54000c08d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:18.903473 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:18.903612 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":160747392}
I20260709 12:12:18.906445 28733 raft_consensus.cc:3055] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:18.906888 28733 raft_consensus.cc:740] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:18.907768 28733 consensus_queue.cc:260] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:18.908298 22599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3297) took 2388 ms. Trace:
I20260709 12:12:18.908771 28637 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:18.911274 28780 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:18.913340 28026 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:18.869688 28781 raft_consensus.cc:2749] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 17. Current term is 18.
I20260709 12:12:18.914862 28480 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:18.784143 28682 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:18.928318 28555 consensus_meta.cc:287] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.603s	user 0.034s	sys 0.011s
I20260709 12:12:18.928850 28682 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:18.928861 28555 raft_consensus.cc:2749] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:18.906324 28764 consensus_queue.cc:237] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:18.868053 28651 consensus_queue.cc:260] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:18.918290 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:18.931639 22529 raft_consensus.cc:1240] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:18.921551 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:18.932488 22524 raft_consensus.cc:2468] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
I20260709 12:12:18.932853 23125 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:18.922871 22456 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 17.
I20260709 12:12:18.873543 28691 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:18.908640 22599 rpcz_store.cc:276] 0709 12:12:16.520270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.988726 (+1468456us) service_pool.cc:224] Handling call
0709 12:12:17.989036 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:17.989427 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:12:18.291985 (+302558us) log.cc:844] Serialized 14 byte log entry
0709 12:12:18.512747 (+220762us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:18.531633 (+ 18886us) log.cc:844] Serialized 26 byte log entry
0709 12:12:18.531859 (+   226us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:18.556683 (+ 24824us) log.cc:844] Serialized 14 byte log entry
0709 12:12:18.586250 (+ 29567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:18.586321 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:18.908106 (+321785us) raft_consensus.cc:1685] finished
0709 12:12:18.908127 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:18.908242 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29278,"prepare.queue_time_us":434287,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":66,"raft.queue_time_us":84884,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":19281,"thread_start_us":421183,"threads_started":3,"wal-append.queue_time_us":113439}
I20260709 12:12:18.935962 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:18.921754 23117 raft_consensus.cc:1240] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 13 LEADER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:12:18.908783 28733 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:18.956574 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 210507us
I20260709 12:12:18.957594 22569 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
W20260709 12:12:18.959676 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.935802 28765 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:18.936087 28651 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:18.939728 28606 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:18.958786 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 241230us
I20260709 12:12:18.983906 22569 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:18.984920 22605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2889) took 1957 ms. Trace:
I20260709 12:12:18.990360 22525 raft_consensus.cc:1240] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:12:18.993439 22598 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 17.
I20260709 12:12:18.976998 28781 raft_consensus.cc:2804] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:18.977334 28337 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
W20260709 12:12:18.989089 28591 consensus_meta.cc:287] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.695s	user 0.018s	sys 0.007s
I20260709 12:12:18.991950 22569 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:19.003847 28775 log.cc:927] Time spent T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 12:12:19.005465 28777 log.cc:927] Time spent T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:12:19.007042 28762 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:19.008720 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:19.009480 28179 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:19.011529 28750 log.cc:927] Time spent T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.375s	user 0.003s	sys 0.000s
I20260709 12:12:19.011996 22569 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:19.013254 22569 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:18.990716 28658 consensus_meta.cc:287] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 1.178s	user 0.018s	sys 0.014s
I20260709 12:12:19.017390 22606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3302) took 2490 ms. Trace:
I20260709 12:12:19.017756 22606 rpcz_store.cc:276] 0709 12:12:16.526572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:18.213379 (+1686807us) service_pool.cc:224] Handling call
0709 12:12:18.213777 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:18.214290 (+   513us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:18.214328 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:18.226133 (+ 11805us) log.cc:844] Serialized 26 byte log entry
0709 12:12:18.721551 (+495418us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:12:18.721607 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:18.721703 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:19.006845 (+285142us) raft_consensus.cc:1685] finished
0709 12:12:19.006863 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:19.017318 (+ 10455us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1606,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":3868,"thread_start_us":428477,"threads_started":1,"wal-append.queue_time_us":641397}
I20260709 12:12:19.018788 28637 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.019104 28639 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:19.019572 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:19.019333 28637 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:19.013819 28762 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:19.025171 23125 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 18.
I20260709 12:12:19.026647 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:19.001437 23089 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:19.028995 22606 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 16.
I20260709 12:12:19.027139 22523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56940 (request call id 2582) took 1016 ms. Trace:
I20260709 12:12:19.029887 22523 rpcz_store.cc:276] 0709 12:12:18.011068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:18.028769 (+ 17701us) service_pool.cc:224] Handling call
0709 12:12:19.014929 (+986160us) spinlock_profiling.cc:243] Waited 552 ms on lock 0x7b5400400bd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:19.027081 (+ 12152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1269202816}
I20260709 12:12:19.030236 22497 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:19.028272 22604 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 15.
I20260709 12:12:18.993353 28780 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:19.056453 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:19.057340 23089 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:19.057776 22456 raft_consensus.cc:1240] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:19.058494 22606 raft_consensus.cc:1275] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:19.059123 22606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43070 (request call id 1047) took 2007 ms. Trace:
I20260709 12:12:19.059641 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:19.060873 22529 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 17.
I20260709 12:12:19.059405 22606 rpcz_store.cc:276] 0709 12:12:17.056041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.033124 (+1977083us) service_pool.cc:224] Handling call
0709 12:12:19.057652 (+ 24528us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:19.058870 (+  1218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:19.059073 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:18.998345 28781 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:12:19.064744 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 51563.4us
I20260709 12:12:19.065868 22569 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:19.066113 22601 raft_consensus.cc:1275] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:19.066686 22601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43070 (request call id 1049) took 1980 ms. Trace:
I20260709 12:12:19.079144 22601 rpcz_store.cc:276] 0709 12:12:17.086050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.065538 (+1979488us) service_pool.cc:224] Handling call
0709 12:12:19.065809 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:19.066439 (+   630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:19.066628 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:19.081465 22601 raft_consensus.cc:1275] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:12:19.082262 22601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43070 (request call id 1050) took 1975 ms. Trace:
I20260709 12:12:19.082777 22601 rpcz_store.cc:276] 0709 12:12:17.107321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.080426 (+1973105us) service_pool.cc:224] Handling call
0709 12:12:19.080875 (+   449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:19.081985 (+  1110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:19.082193 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:19.085695 23089 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:19.111073 23089 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:19.031955 28558 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:19.136075 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:19.109531 28645 consensus_meta.cc:287] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.603s	user 0.002s	sys 0.021s
I20260709 12:12:19.062261 28538 raft_consensus.cc:2749] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:18.986868 28363 consensus_queue.cc:237] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:19.110954 28555 raft_consensus.cc:2804] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:12:19.111737 28590 consensus_meta.cc:287] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.923s	user 0.021s	sys 0.005s
I20260709 12:12:19.083503 28480 raft_consensus.cc:2804] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:19.063097 28782 raft_consensus.cc:2749] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:19.109786 28781 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:19.194464 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 83486.9us
I20260709 12:12:19.329852 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:19.330451 23124 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:19.195518 22600 raft_consensus.cc:1275] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:12:19.196412 28788 log.cc:927] Time spent T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:12:19.333806 23122 raft_consensus.cc:1240] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:19.334787 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:19.336212 23122 raft_consensus.cc:1275] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:12:19.337481 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:19.337950 23124 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 17.
I20260709 12:12:19.136757 28558 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:19.339432 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:19.339802 22606 raft_consensus.cc:1275] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:19.342310 23125 raft_consensus.cc:1275] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:12:19.021940 28591 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:19.343570 22450 raft_consensus.cc:1240] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:19.344864 28591 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:19.200170 22603 consensus_meta.cc:287] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.557s	user 0.005s	sys 0.027s
W20260709 12:12:19.200839 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 67377.8us
I20260709 12:12:19.202028 28776 raft_consensus.cc:2804] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:19.207484 28763 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:12:19.208356 28681 consensus_meta.cc:287] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.911s	user 0.006s	sys 0.002s
W20260709 12:12:19.216818 28636 consensus_meta.cc:287] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 1.305s	user 0.009s	sys 0.002s
W20260709 12:12:19.221732 22604 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43070 (request call id 1030) took 2533 ms (client timeout 1585 ms). Trace:
W20260709 12:12:19.224152 28266 consensus_meta.cc:287] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 1.088s	user 0.007s	sys 0.003s
I20260709 12:12:19.229766 22602 raft_consensus.cc:1240] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:19.229700 22570 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:19.361311 22602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2892) took 1605 ms. Trace:
W20260709 12:12:19.361402 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 131785us
I20260709 12:12:19.362712 23119 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
W20260709 12:12:19.358436 22604 rpcz_store.cc:269] 0709 12:12:16.688380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:16.688733 (+   353us) service_pool.cc:224] Handling call
0709 12:12:19.221476 (+2532743us) spinlock_profiling.cc:243] Waited 2.32 s on lock 0x7b5400350cd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:19.221631 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5347221376}
W20260709 12:12:19.237594 28770 log.cc:927] Time spent T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.316s	user 0.000s	sys 0.001s
I20260709 12:12:19.301543 28555 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:19.239432 22598 raft_consensus.cc:1275] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:19.367734 22598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2894) took 1611 ms. Trace:
I20260709 12:12:19.368114 22598 rpcz_store.cc:276] 0709 12:12:17.756790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.238776 (+1481986us) service_pool.cc:224] Handling call
0709 12:12:19.239094 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:19.367495 (+128401us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:19.367683 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:18.985386 22605 rpcz_store.cc:276] 0709 12:12:17.027642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:18.905066 (+1877424us) service_pool.cc:224] Handling call
0709 12:12:18.905362 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:18.905560 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:12:18.936398 (+ 30838us) log.cc:844] Serialized 14 byte log entry
0709 12:12:18.980619 (+ 44221us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:18.980670 (+    51us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:18.984680 (+  4010us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:18.984749 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:18.984866 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":30823,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":10427,"raft.queue_time_us":88,"thread_start_us":43784,"threads_started":1}
I20260709 12:12:19.258133 28687 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:19.263302 28179 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:19.270886 28637 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:19.276015 28787 log.cc:927] Time spent T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 12:12:19.385409 22525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 2584) took 1039 ms. Trace:
I20260709 12:12:19.385836 22525 rpcz_store.cc:276] 0709 12:12:18.346859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:18.347248 (+   389us) service_pool.cc:224] Handling call
0709 12:12:18.347593 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:18.992382 (+644789us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:19.385157 (+392775us) spinlock_profiling.cc:243] Waited 642 ms on lock 0x7b54000d3ed4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:19.385348 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1477571328}
I20260709 12:12:19.276793 28176 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:19.282186 28620 consensus_meta.cc:287] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 1.039s	user 0.008s	sys 0.001s
I20260709 12:12:19.143162 28623 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:12:19.297999 28534 consensus_meta.cc:287] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.897s	user 0.008s	sys 0.009s
I20260709 12:12:19.399274 22457 raft_consensus.cc:1240] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:19.135650 28762 raft_consensus.cc:2749] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:19.027463 28337 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:19.300613 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:19.338212 23116 raft_consensus.cc:2393] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 15: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:19.410071 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:19.410518 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:12:19.196753 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 130951us
I20260709 12:12:19.411966 22569 leader_election.cc:400] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 election: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 18. Current term is 19.
I20260709 12:12:19.412350 22569 leader_election.cc:403] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:12:19.347913 23124 raft_consensus.cc:1240] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 14. Current term is 15. Ops: []
W20260709 12:12:19.348907 22495 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.196.129:42317 timed out after 2.291s (SENT) [suppressed 22 similar messages]
W20260709 12:12:19.413776 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 64918.5us
W20260709 12:12:19.414644 22495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:19.235419 28785 log.cc:927] Time spent T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 12:12:19.364722 22604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2895) took 1607 ms. Trace:
I20260709 12:12:19.410826 22525 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 17.
I20260709 12:12:19.417038 22604 rpcz_store.cc:276] 0709 12:12:17.757046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.363908 (+1606862us) service_pool.cc:224] Handling call
0709 12:12:19.364197 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:19.364383 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:19.364422 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:19.364467 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:19.364501 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:19.364566 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:19.364672 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:19.418686 22604 raft_consensus.cc:1275] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:12:19.419565 22604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3309) took 1576 ms. Trace:
I20260709 12:12:19.361697 22602 rpcz_store.cc:276] 0709 12:12:17.756198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.229156 (+1472958us) service_pool.cc:224] Handling call
0709 12:12:19.229576 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:19.361060 (+131484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:19.361259 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:19.239408 22497 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:19.420773 23120 raft_consensus.cc:2410] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 12:12:19.363248 22570 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:19.326519 28480 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:19.369673 22601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2891) took 1613 ms. Trace:
I20260709 12:12:19.371239 22599 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 18.
I20260709 12:12:19.372890 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:19.350723 28776 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:19.381265 22598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3307) took 1539 ms. Trace:
I20260709 12:12:19.367153 28782 raft_consensus.cc:2804] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:19.383991 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:12:19.440279 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 200953us
W20260709 12:12:19.409335 28754 consensus_meta.cc:287] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.776s	user 0.010s	sys 0.000s
I20260709 12:12:19.447172 28754 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:19.449222 28754 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:19.395670 22455 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 2385) took 1688 ms (client timeout 2075 ms). Trace:
I20260709 12:12:19.371759 28555 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:19.449939 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:12:19.450477 28621 consensus_meta.cc:287] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 1.092s	user 0.012s	sys 0.016s
I20260709 12:12:19.450906 28621 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:19.451295 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:19.453285 28026 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.453840 28026 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:19.454486 22527 raft_consensus.cc:2393] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 18: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:19.132205 28701 raft_consensus.cc:2804] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:19.440001 28185 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:19.455226 28701 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:19.455806 28701 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:19.455538 28185 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:19.421649 28480 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:19.370383 28591 consensus_queue.cc:1059] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:12:19.460005 28591 raft_consensus.cc:3055] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:19.439772 28624 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:19.460525 28591 raft_consensus.cc:740] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:19.460887 28624 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:19.461615 28591 consensus_queue.cc:260] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:19.464267 28337 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:19.348034 28590 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:19.444777 28176 raft_consensus.cc:2749] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 18. Current term is 19.
I20260709 12:12:19.445127 28782 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:19.468011 28782 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:19.468971 28590 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:19.419966 22604 rpcz_store.cc:276] 0709 12:12:17.870551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.417986 (+1547435us) service_pool.cc:224] Handling call
0709 12:12:19.418300 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:19.419296 (+   996us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:19.419506 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:19.470559 22604 raft_consensus.cc:1240] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 16. Current term is 17. Ops: []
W20260709 12:12:19.450095 22455 rpcz_store.cc:269] 0709 12:12:17.707663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.847003 (+139340us) service_pool.cc:224] Handling call
0709 12:12:19.383083 (+1536080us) spinlock_profiling.cc:243] Waited 908 ms on lock 0x7b54002a5654. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:19.395598 (+ 12515us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2088859008}
I20260709 12:12:19.421854 22601 rpcz_store.cc:276] 0709 12:12:17.755896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.111148 (+1355252us) service_pool.cc:224] Handling call
0709 12:12:19.132702 (+ 21554us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:19.132913 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:12:19.133216 (+   303us) log.cc:844] Serialized 14 byte log entry
0709 12:12:19.369349 (+236133us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:19.369397 (+    48us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:19.369442 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:19.369503 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:19.369623 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":986,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":2467,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":9460,"thread_start_us":235133,"threads_started":1}
I20260709 12:12:19.473953 22604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3317) took 1582 ms. Trace:
I20260709 12:12:19.399456 28626 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:19.407482 28534 raft_consensus.cc:2749] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 18. Current term is 19.
W20260709 12:12:19.433943 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 70776.3us
I20260709 12:12:19.481217 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:19.435209 22569 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:19.442085 28682 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:19.384984 22422 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:12:19.484841 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 99944.8us
I20260709 12:12:19.444144 22454 raft_consensus.cc:1275] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 12:12:19.446269 22531 raft_consensus.cc:1240] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:19.395628 28599 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:19.401644 28620 raft_consensus.cc:2749] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:19.440640 28776 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:19.474417 28645 raft_consensus.cc:2804] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:19.360702 28763 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:19.474368 22604 rpcz_store.cc:276] 0709 12:12:17.891591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.469965 (+1578374us) service_pool.cc:224] Handling call
0709 12:12:19.470335 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:19.473657 (+  3322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:19.473886 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:19.429358 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:19.518292 23116 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 17.
I20260709 12:12:19.475584 22451 raft_consensus.cc:1240] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:19.430377 22598 rpcz_store.cc:276] 0709 12:12:17.842399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.368953 (+1526554us) service_pool.cc:224] Handling call
0709 12:12:19.380633 (+ 11680us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:19.380869 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:19.380907 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:19.380963 (+    56us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:19.381008 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:19.381077 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:19.381198 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:19.482257 22570 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:19.521018 22570 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
W20260709 12:12:19.522228 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:19.483333 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 48232.2us
W20260709 12:12:19.455323 28771 log.cc:927] Time spent T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.550s	user 0.003s	sys 0.000s
I20260709 12:12:19.408143 28623 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:19.485723 22422 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:12:19.449946 28692 consensus_meta.cc:287] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.748s	user 0.006s	sys 0.011s
I20260709 12:12:19.453218 28621 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:19.414179 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:19.491688 28765 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:19.462891 28624 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:19.549696 23123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 1379) took 1016 ms. Trace:
I20260709 12:12:19.480288 28591 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:19.527208 28780 raft_consensus.cc:2749] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:19.529304 28651 consensus_meta.cc:287] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.558s	user 0.008s	sys 0.002s
I20260709 12:12:19.530691 28782 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:19.536021 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 50419.3us
I20260709 12:12:19.536556 23118 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 19.
W20260709 12:12:19.497911 28349 consensus_meta.cc:287] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.910s	user 0.016s	sys 0.012s
I20260709 12:12:19.479912 28185 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:19.541922 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:19.542680 22604 raft_consensus.cc:1240] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:19.572970 22604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3321) took 1042 ms. Trace:
I20260709 12:12:19.573427 22604 rpcz_store.cc:276] 0709 12:12:18.530450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.542100 (+1011650us) service_pool.cc:224] Handling call
0709 12:12:19.542446 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:19.572666 (+ 30220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:19.572896 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:19.575431 28590 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.546041 23124 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
I20260709 12:12:19.576838 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:19.546376 28542 raft_consensus.cc:2804] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:19.540916 28762 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:19.541014 28636 raft_consensus.cc:2804] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:19.547767 28692 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:19.548450 28765 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:19.514120 28682 raft_consensus.cc:697] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:19.561121 22454 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:44568
W20260709 12:12:19.540838 28700 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.027s	sys 0.054s
I20260709 12:12:19.512915 28645 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:19.484925 28626 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:19.575551 22604 raft_consensus.cc:1275] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:19.495172 28751 raft_consensus.cc:2804] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:19.578119 23116 raft_consensus.cc:2410] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 12:12:19.544263 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:19.614970 22449 raft_consensus.cc:1240] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:19.578191 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:19.616163 23124 raft_consensus.cc:2393] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 15: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:19.589478 28636 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:19.582463 22453 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 17.
I20260709 12:12:19.492969 28781 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:19.585379 22603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2888) took 2558 ms. Trace:
I20260709 12:12:19.585985 22569 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:19.620471 22603 rpcz_store.cc:276] 0709 12:12:17.027288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:18.577077 (+1549789us) service_pool.cc:224] Handling call
0709 12:12:18.588107 (+ 11030us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:18.588293 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:12:19.345801 (+757508us) log.cc:844] Serialized 14 byte log entry
0709 12:12:19.584988 (+239187us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:19.585052 (+    64us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:19.585109 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:19.585189 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:19.585314 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3842,"raft.queue_time_us":3957,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":6079,"thread_start_us":234858,"threads_started":1}
I20260709 12:12:19.595096 28542 raft_consensus.cc:697] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:19.514524 28599 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:19.564302 28683 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:19.631211 28683 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:19.632186 23120 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:19.636500 28599 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:19.639184 22598 raft_consensus.cc:1240] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:19.640429 22598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3322) took 1109 ms. Trace:
I20260709 12:12:19.640781 22598 rpcz_store.cc:276] 0709 12:12:18.530774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.541766 (+1010992us) service_pool.cc:224] Handling call
0709 12:12:19.556427 (+ 14661us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:19.639607 (+ 83180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:19.640195 (+   588us) spinlock_profiling.cc:243] Waited 82.5 ms on lock 0x7b54002de954. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:19.640366 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":189824256}
I20260709 12:12:19.643462 23120 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 16.
W20260709 12:12:19.651836 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:19.600138 22454 raft_consensus.cc:606] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 LEADER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:12:19.590569 28762 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:19.587373 28658 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:19.550086 23123 rpcz_store.cc:276] 0709 12:12:18.533526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:18.533668 (+   142us) service_pool.cc:224] Handling call
0709 12:12:18.533968 (+   300us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:18.534320 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:18.534347 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:18.569008 (+ 34661us) log.cc:844] Serialized 52 byte log entry
0709 12:12:18.738475 (+169467us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:18.916742 (+178267us) log.cc:844] Serialized 14 byte log entry
0709 12:12:19.227406 (+310664us) spinlock_profiling.cc:243] Waited 3.79 ms on lock 0x7b1800078160. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc78413f3 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd 0000000000388634 0000000000388479 00007f9cc782483a
0709 12:12:19.352188 (+124782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:19.352255 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:19.396750 (+ 44495us) spinlock_profiling.cc:243] Waited 2.87 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:12:19.549484 (+152734us) raft_consensus.cc:1685] finished
0709 12:12:19.549504 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:19.549638 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3628,"prepare.queue_time_us":116399,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":62,"raft.queue_time_us":63494,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":18263,"spinlock_wait_cycles":15328896,"thread_start_us":573995,"threads_started":2,"wal-append.queue_time_us":266167}
I20260709 12:12:19.566807 28624 consensus_queue.cc:1048] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.040s
W20260709 12:12:19.607863 28700 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.027s	sys 0.054s
I20260709 12:12:19.591629 22496 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:19.622740 22569 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:19.625600 22603 raft_consensus.cc:1275] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:12:19.576318 28349 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:19.627701 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:19.614482 28751 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:19.628261 28780 raft_consensus.cc:2749] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:19.628762 22527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56940 (request call id 2586) took 1253 ms. Trace:
I20260709 12:12:19.629392 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:19.629760 28781 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:19.611495 28645 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:19.586853 28590 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:19.588299 28651 consensus_queue.cc:1048] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 12:12:19.661969 22495 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:19.663188 28762 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:19.666221 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:19.622109 28636 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:19.670588 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 79057.3us
I20260709 12:12:19.668097 28691 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.674193 22527 rpcz_store.cc:276] 0709 12:12:18.376253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:18.384099 (+  7846us) service_pool.cc:224] Handling call
0709 12:12:19.628575 (+1244476us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400231754. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:19.628694 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2379613440}
I20260709 12:12:19.674759 23124 raft_consensus.cc:2393] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 14: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
W20260709 12:12:19.663033 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 284728us
I20260709 12:12:19.682874 22495 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:19.683138 22597 raft_consensus.cc:1240] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:19.664178 28637 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.688238 22496 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:19.673805 28621 raft_consensus.cc:2804] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:19.685323 23123 raft_consensus.cc:2376] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 17. Re-sending same reply.
I20260709 12:12:19.669823 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:19.702973 22495 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:19.705323 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:19.691303 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:19.706272 22603 raft_consensus.cc:2393] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 13: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:19.693187 22606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43070 (request call id 1048) took 2612 ms. Trace:
I20260709 12:12:19.694002 22600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3292) took 3175 ms. Trace:
I20260709 12:12:19.706869 22606 rpcz_store.cc:276] 0709 12:12:17.080638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.064311 (+1983673us) service_pool.cc:224] Handling call
0709 12:12:19.298758 (+234447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:19.340220 (+ 41462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:19.692209 (+351989us) spinlock_profiling.cc:243] Waited 40.7 ms on lock 0x7b5400350cd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:19.693009 (+   800us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b5400350cd0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:19.693128 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":625687168}
I20260709 12:12:19.707167 22600 rpcz_store.cc:276] 0709 12:12:16.519026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.962761 (+1443735us) service_pool.cc:224] Handling call
0709 12:12:17.964081 (+  1320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:19.331137 (+1367056us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:19.693796 (+362659us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b540013b354. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:19.693950 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2713518976}
I20260709 12:12:19.694756 22452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 2390) took 1880 ms. Trace:
I20260709 12:12:19.708858 22452 rpcz_store.cc:276] 0709 12:12:17.813914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.941009 (+127095us) service_pool.cc:224] Handling call
0709 12:12:18.366268 (+425259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:18.570676 (+204408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:19.384679 (+814003us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b540037b254. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:19.694579 (+309900us) spinlock_profiling.cc:243] Waited 425 ms on lock 0x7b540037b250. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:19.694700 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1446016640}
I20260709 12:12:19.673637 28751 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:19.711102 28185 raft_consensus.cc:2749] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:12:19.711475 28591 consensus_queue.cc:1059] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:19.711808 28185 consensus_queue.cc:1059] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:12:19.699872 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:19.714411 22598 raft_consensus.cc:2393] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 14: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:19.715095 23124 raft_consensus.cc:1240] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:19.715227 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:19.715744 22598 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:19.717104 23089 leader_election.cc:336] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Timed out: RequestConsensusVote RPC to 127.20.196.131:37785 timed out after 1.855s (SENT)
I20260709 12:12:19.717672 23089 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:19.686704 28266 raft_consensus.cc:2749] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:19.719108 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:19.722635 23123 raft_consensus.cc:1275] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:12:19.752607 23124 raft_consensus.cc:1275] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:19.754878 22421 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:19.723299 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:19.725037 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:19.757709 22600 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:19.687089 28760 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:19.712859 28745 raft_consensus.cc:2749] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:19.757256 22606 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 18.
I20260709 12:12:19.765571 22603 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:19.761667 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 96450.4us
I20260709 12:12:19.771507 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:19.772243 22606 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:19.758371 22598 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 21.
I20260709 12:12:19.704111 28621 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:19.776503 28621 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:19.779193 28266 raft_consensus.cc:3055] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:19.779664 28266 raft_consensus.cc:740] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:19.779891 28802 raft_consensus.cc:2749] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:19.780351 28590 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:19.732880 28768 raft_consensus.cc:2749] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:19.783535 28683 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:19.784166 28765 leader_election.cc:290] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:19.784693 28782 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:12:19.785002 23118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57318 (request call id 1378) took 1266 ms (client timeout 1547 ms). Trace:
I20260709 12:12:19.768934 28721 consensus_queue.cc:1059] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
W20260709 12:12:19.785427 23118 rpcz_store.cc:269] 0709 12:12:18.518388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:18.518514 (+   126us) service_pool.cc:224] Handling call
0709 12:12:19.784837 (+1266323us) spinlock_profiling.cc:243] Waited 955 ms on lock 0x7b54004d71d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:19.784944 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2197198720}
I20260709 12:12:19.785748 28636 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:19.786213 28721 raft_consensus.cc:3055] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:19.786636 28721 raft_consensus.cc:740] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:19.787474 28721 consensus_queue.cc:260] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:19.788112 28651 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:19.788744 28721 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:19.788650 28651 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:19.789546 28776 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:19.790604 28651 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:19.790627 23125 raft_consensus.cc:1240] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:19.794283 22603 raft_consensus.cc:1275] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:12:19.719521 28542 consensus_queue.cc:237] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:19.795828 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:19.796180 28636 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:19.796487 22599 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 16.
I20260709 12:12:19.796650 28692 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:19.797170 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:19.797654 22599 raft_consensus.cc:1275] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:12:19.797744 22603 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 16.
I20260709 12:12:19.703171 28691 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:19.804261 28763 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:19.805315 28799 log.cc:927] Time spent T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:12:19.805456 28691 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:19.806118 28793 log.cc:927] Time spent T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 12:12:19.704082 28637 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:19.812407 22600 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 19.
W20260709 12:12:19.813654 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 46043.1us
I20260709 12:12:19.754184 28599 raft_consensus.cc:3055] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:19.754379 28624 raft_consensus.cc:2749] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:19.845088 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:19.855878 22452 raft_consensus.cc:2468] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 14.
I20260709 12:12:19.856887 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:19.857443 22452 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 18.
I20260709 12:12:19.858186 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:19.846127 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:19.852330 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:19.859486 23124 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 17.
I20260709 12:12:19.860327 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:19.861352 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:19.865983 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:19.785681 28626 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:19.867296 22454 raft_consensus.cc:2393] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 17: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:19.795830 28349 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:19.872135 23118 raft_consensus.cc:1275] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:12:19.873700 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:19.874306 22455 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 16.
I20260709 12:12:19.719655 28682 consensus_queue.cc:237] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:19.875826 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:19.878934 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:19.899207 22421 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:19.900959 28766 consensus_queue.cc:1059] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:12:19.901000 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:19.901872 28179 raft_consensus.cc:3055] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:19.901830 28766 consensus_queue.cc:1048] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:19.902379 28179 raft_consensus.cc:740] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:19.902674 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:19.903237 28179 consensus_queue.cc:260] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:19.903882 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:19.904495 28179 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:19.904971 28533 leader_election.cc:290] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:19.849768 28599 raft_consensus.cc:740] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:19.911263 22455 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
I20260709 12:12:19.915092 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:19.915977 22422 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:19.916589 22606 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 18.
I20260709 12:12:19.917621 22455 raft_consensus.cc:2393] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 13: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:19.862776 28691 consensus_queue.cc:1059] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 12:12:19.922238 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:19.855713 28337 consensus_queue.cc:1048] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.059s
I20260709 12:12:19.855984 28701 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:19.924556 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:19.927397 23121 raft_consensus.cc:1240] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 10. Current term is 11. Ops: []
W20260709 12:12:19.928036 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 221571us
I20260709 12:12:19.863955 28555 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:19.932088 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:19.932664 23118 raft_consensus.cc:1240] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 17 LEADER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:19.938524 23122 raft_consensus.cc:1240] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 12. Current term is 13. Ops: []
W20260709 12:12:19.939832 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 251673us
I20260709 12:12:19.939813 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:19.942283 23117 raft_consensus.cc:1240] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:12:19.934793 22495 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:19.944154 23124 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:19.929982 28691 consensus_queue.cc:1243] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer 1676e7af5e4a47cb86ee7db83e3d4881 log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 12:12:19.945597 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 189433us
I20260709 12:12:19.945007 22495 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:19.953810 22496 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:19.956476 22495 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:19.936784 28620 raft_consensus.cc:2749] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:12:19.935534 28590 raft_consensus.cc:2804] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:12:20.143011 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:20.169342 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:20.178412 23124 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 12.
I20260709 12:12:19.950101 28763 raft_consensus.cc:2804] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:19.938485 28745 consensus_queue.cc:1059] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.233s
I20260709 12:12:19.960332 28768 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.935784 28809 consensus_queue.cc:1059] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.244s
I20260709 12:12:20.207362 28266 consensus_queue.cc:260] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:20.209408 23119 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57328 (request call id 1603) took 1923 ms (client timeout 1986 ms). Trace:
W20260709 12:12:20.248781 23119 rpcz_store.cc:269] 0709 12:12:18.285624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:18.289386 (+  3762us) service_pool.cc:224] Handling call
0709 12:12:20.209162 (+1919776us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54006f04d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:20.209328 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2373816704}
I20260709 12:12:20.210309 23123 raft_consensus.cc:1275] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:12:20.219223 28800 log.cc:927] Time spent T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.354s	user 0.001s	sys 0.000s
I20260709 12:12:20.221405 28764 raft_consensus.cc:2749] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:12:20.224079 28751 consensus_meta.cc:287] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.514s	user 0.008s	sys 0.000s
W20260709 12:12:20.225328 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:20.225409 28805 log.cc:927] Time spent T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.327s	user 0.001s	sys 0.000s
I20260709 12:12:20.226083 28363 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.229012 22450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 1218) took 1197 ms. Trace:
W20260709 12:12:20.237385 28687 consensus_meta.cc:287] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.857s	user 0.008s	sys 0.000s
I20260709 12:12:20.238168 28776 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:20.241132 28811 log.cc:927] Time spent T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:12:20.241765 28637 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:19.945005 28803 consensus_queue.cc:1059] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.248s
I20260709 12:12:20.243856 28555 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:19.951324 28480 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:20.244910 28621 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:20.245883 28801 log.cc:927] Time spent T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.332s	user 0.000s	sys 0.000s
I20260709 12:12:20.187902 28763 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:20.246467 28768 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:19.961391 28651 consensus_queue.cc:1059] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.286s
I20260709 12:12:20.172017 28590 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:20.251309 22457 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 1221) took 1118 ms. Trace:
I20260709 12:12:20.253234 22604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3325) took 1558 ms. Trace:
W20260709 12:12:20.261355 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 307615us
I20260709 12:12:20.308571 22604 rpcz_store.cc:276] 0709 12:12:18.694499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.613657 (+919158us) service_pool.cc:224] Handling call
0709 12:12:19.614121 (+   464us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:19.624064 (+  9943us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:19.624110 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:19.630954 (+  6844us) log.cc:844] Serialized 26 byte log entry
0709 12:12:19.934721 (+303767us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:19.934757 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:19.934814 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:20.253029 (+318215us) raft_consensus.cc:1685] finished
0709 12:12:20.253049 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:20.253168 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2513,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":110,"thread_start_us":302870,"threads_started":1,"wal-append.queue_time_us":547609}
I20260709 12:12:20.248502 28266 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:12:20.256910 28733 consensus_meta.cc:287] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 1.296s	user 0.012s	sys 0.000s
I20260709 12:12:20.266916 22450 rpcz_store.cc:276] 0709 12:12:19.031813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.405909 (+374096us) service_pool.cc:224] Handling call
0709 12:12:19.406264 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:19.643914 (+237650us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:12:19.644169 (+   255us) log.cc:844] Serialized 14 byte log entry
0709 12:12:19.931645 (+287476us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:19.931694 (+    49us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:19.931740 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:20.228753 (+297013us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b5400241b54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:20.228813 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:20.228959 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8971,"prepare.queue_time_us":1665,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":35611,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":218919,"spinlock_wait_cycles":546015616,"thread_start_us":278069,"threads_started":1}
I20260709 12:12:20.323499 22450 raft_consensus.cc:1275] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:12:20.325141 22450 raft_consensus.cc:3055] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:20.325567 22450 raft_consensus.cc:740] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:20.281080 22451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 1213) took 1762 ms. Trace:
I20260709 12:12:20.327280 22451 rpcz_store.cc:276] 0709 12:12:18.518590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.401979 (+883389us) service_pool.cc:224] Handling call
0709 12:12:19.402324 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:19.520103 (+117779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:20.280829 (+760726us) spinlock_profiling.cc:243] Waited 73 ms on lock 0x7b54002206d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:20.281024 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":167863552}
W20260709 12:12:20.281680 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 365774us
I20260709 12:12:20.330045 22422 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:20.293311 28687 raft_consensus.cc:2804] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:20.293319 22454 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 17.
I20260709 12:12:20.297389 28763 raft_consensus.cc:3060] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:20.296221 28480 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:20.307353 22457 rpcz_store.cc:276] 0709 12:12:19.133273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.426606 (+293333us) service_pool.cc:224] Handling call
0709 12:12:19.426904 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:19.659898 (+232994us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:19.659941 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:19.659995 (+    54us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:19.660049 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:20.251086 (+591037us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b54003f48d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:20.251132 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:20.251257 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":535335808}
I20260709 12:12:20.334566 22601 raft_consensus.cc:1275] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:12:20.335065 22422 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:20.293933 28814 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:20.270114 28751 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:20.272430 28363 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:20.336247 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 454104us
I20260709 12:12:20.319864 28590 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:20.343333 22422 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:20.308869 28803 raft_consensus.cc:2749] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:20.326472 22450 consensus_queue.cc:260] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:20.348873 22450 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:20.351367 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 394958us
I20260709 12:12:20.347844 22422 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:20.352613 22495 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:12:20.332274 28692 raft_consensus.cc:2749] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:20.333894 28687 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:20.355696 22421 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:20.356690 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:20.357414 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:20.362695 22600 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 15.
I20260709 12:12:20.363179 22604 raft_consensus.cc:1275] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 12:12:20.359254 28817 log.cc:927] Time spent T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:12:20.362752 22606 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 18.
I20260709 12:12:20.305804 28813 consensus_queue.cc:1048] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 12:12:20.365386 22452 raft_consensus.cc:2393] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 18: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:20.367301 22495 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:20.376685 22602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3313) took 2505 ms. Trace:
I20260709 12:12:20.377996 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:12:20.353770 28762 consensus_meta.cc:287] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.651s	user 0.009s	sys 0.002s
I20260709 12:12:20.345228 28810 raft_consensus.cc:2804] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:20.378145 22602 rpcz_store.cc:276] 0709 12:12:17.871629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.420824 (+1549195us) service_pool.cc:224] Handling call
0709 12:12:19.443856 (+ 23032us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:19.444165 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:19.444198 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:19.444659 (+   461us) log.cc:844] Serialized 26 byte log entry
0709 12:12:19.705174 (+260515us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:19.738051 (+ 32877us) log.cc:844] Serialized 14 byte log entry
0709 12:12:20.222100 (+484049us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:20.222181 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:20.376496 (+154315us) raft_consensus.cc:1685] finished
0709 12:12:20.376514 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:20.376634 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":483792,"prepare.queue_time_us":32708,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":45,"raft.queue_time_us":484462,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":161,"thread_start_us":172053,"threads_started":1,"wal-append.queue_time_us":313570}
I20260709 12:12:20.354450 28620 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:20.397711 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:20.364180 28802 raft_consensus.cc:2804] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:20.380146 28803 raft_consensus.cc:3055] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:20.384186 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:20.396749 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:20.402467 23124 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:20.384670 22495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:20.398319 22451 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 16.
I20260709 12:12:20.376091 28687 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:20.347031 28809 consensus_queue.cc:1048] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 12:12:20.375130 28176 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:20.391328 22450 raft_consensus.cc:1275] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 12:12:20.385286 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:20.395695 28810 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:20.377465 28814 consensus_queue.cc:1048] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 12:12:20.400951 28812 raft_consensus.cc:2749] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:20.401741 28803 raft_consensus.cc:740] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:20.395787 28762 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:20.417702 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:20.422724 22451 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:20.421994 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 163923us
I20260709 12:12:20.425372 23124 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 18.
W20260709 12:12:20.426496 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 117074us
W20260709 12:12:20.427853 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 805198us
I20260709 12:12:20.429263 22569 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:20.410167 22450 pending_rounds.cc:85] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f: Aborting all ops after (but not including) 12
I20260709 12:12:20.430298 22450 pending_rounds.cc:107] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 12:12:20.430653 22450 raft_consensus.cc:2889] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:20.434741 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:20.436264 23124 raft_consensus.cc:1275] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:12:20.412567 28802 raft_consensus.cc:697] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:20.446237 22569 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:20.415594 28558 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:20.411525 28620 raft_consensus.cc:697] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:20.409881 28624 consensus_queue.cc:1048] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 12:12:20.462615 28363 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:20.413599 28721 consensus_queue.cc:1048] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
W20260709 12:12:20.467703 28808 log.cc:927] Time spent T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 12:12:20.468187 28751 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:20.468505 28816 log.cc:927] Time spent T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:12:20.471186 28768 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:20.475585 28620 consensus_queue.cc:237] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:20.477934 28804 log.cc:927] Time spent T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.698s	user 0.000s	sys 0.011s
I20260709 12:12:20.481333 28762 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:20.482223 23117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 1394) took 1154 ms. Trace:
I20260709 12:12:20.482599 23117 rpcz_store.cc:276] 0709 12:12:19.328076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.332940 (+  4864us) service_pool.cc:224] Handling call
0709 12:12:19.333235 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:19.944122 (+610887us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:20.481959 (+537837us) spinlock_profiling.cc:243] Waited 609 ms on lock 0x7b5400787dd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:20.482162 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1399968640}
I20260709 12:12:20.487254 28803 consensus_queue.cc:260] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:20.488395 28026 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:20.489006 28026 raft_consensus.cc:2749] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:20.489071 28813 consensus_queue.cc:1048] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:20.489745 28026 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:20.490247 28026 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:20.491602 28802 consensus_queue.cc:237] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:20.492717 22456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 1212) took 1974 ms. Trace:
I20260709 12:12:20.493098 22456 rpcz_store.cc:276] 0709 12:12:18.518111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.058945 (+540834us) service_pool.cc:224] Handling call
0709 12:12:19.059299 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:19.059536 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:12:19.361029 (+301493us) log.cc:844] Serialized 14 byte log entry
0709 12:12:20.492303 (+1131274us) spinlock_profiling.cc:243] Waited 5.01 ms on lock 0x7b18002c66e0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cca4d64bc 00007f9cc782448b 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc783e455 00007f9cca926060 00007f9cca938716 00007f9cca949287
0709 12:12:20.492395 (+    92us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:20.492446 (+    51us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:20.492489 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:20.492552 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:20.492663 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6470,"prepare.queue_time_us":540117,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":20121,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":4659,"spinlock_wait_cycles":11526016,"thread_start_us":789654,"threads_started":3,"wal-append.queue_time_us":487243}
I20260709 12:12:20.416033 28810 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:20.496829 28626 raft_consensus.cc:993] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f: : Instructing follower 8701cd5186a949538d8efafb5f987270 to start an election
I20260709 12:12:20.497344 28626 raft_consensus.cc:1081] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 LEADER]: Signalling peer 8701cd5186a949538d8efafb5f987270 to start an election
I20260709 12:12:20.456902 28621 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:20.455236 28825 raft_consensus.cc:2749] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:12:20.474761 28645 consensus_meta.cc:287] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.788s	user 0.008s	sys 0.000s
I20260709 12:12:20.503800 28624 consensus_queue.cc:1059] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:12:20.527179 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 81043.2us
I20260709 12:12:20.532238 22569 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:20.534097 22451 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 17.
I20260709 12:12:20.455503 28651 raft_consensus.cc:2804] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:12:20.523713 28179 consensus_meta.cc:287] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.619s	user 0.004s	sys 0.008s
I20260709 12:12:20.526337 28762 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:20.554879 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:20.530695 28363 raft_consensus.cc:2804] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:20.531286 28645 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:20.549160 28825 raft_consensus.cc:2749] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:20.530714 28826 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:20.549080 28804 log.cc:927] Time spent T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.070s	user 0.003s	sys 0.001s
I20260709 12:12:20.547992 28651 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:20.549481 28687 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:20.567374 22531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 2591) took 1855 ms. Trace:
I20260709 12:12:20.567932 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:20.569587 22456 raft_consensus.cc:2393] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 17: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:20.569072 22531 rpcz_store.cc:276] 0709 12:12:18.711482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:18.711630 (+   148us) service_pool.cc:224] Handling call
0709 12:12:19.446093 (+734463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:19.486961 (+ 40868us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:20.567096 (+1080135us) spinlock_profiling.cc:243] Waited 723 ms on lock 0x7b54004010d0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:20.567291 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1663461120}
I20260709 12:12:20.580828 28687 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:20.580940 28590 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:20.569785 28826 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:20.564095 28720 raft_consensus.cc:3055] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:20.565908 28363 raft_consensus.cc:697] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:20.583308 28720 raft_consensus.cc:740] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:20.585285 28720 consensus_queue.cc:260] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:20.586601 28720 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:20.587975 28590 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:20.583935 28363 consensus_queue.cc:237] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:20.591722 22453 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 2396) took 2388 ms (client timeout 1663 ms). Trace:
I20260709 12:12:20.582970 22605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3308) took 2740 ms. Trace:
I20260709 12:12:20.591876 28810 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:20.592571 28623 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:20.593927 28810 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:20.592312 22605 rpcz_store.cc:276] 0709 12:12:17.842728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.369312 (+1526584us) service_pool.cc:224] Handling call
0709 12:12:19.369621 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:19.371328 (+  1707us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:19.371358 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:19.371822 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 12:12:19.659376 (+287554us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:12:19.660371 (+   995us) log.cc:844] Serialized 14 byte log entry
0709 12:12:20.219999 (+559628us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b18002b9ae0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc77bbc0a 00007f9cd0efb219 00007f9cc7843a40 00007f9cc783e4e4 00007f9cc783e455 00007f9cca926060 00007f9cca938716 00007f9cca949287 00007f9cca949208
0709 12:12:20.362160 (+142161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:20.364202 (+  2042us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:20.477315 (+113113us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:12:20.557569 (+ 80254us) spinlock_profiling.cc:243] Waited 3.29 ms on lock 0x7b48000327d8. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9ccf857aa1 00007f9ccf84eb37 00007f9ccf84e9ca 00007f9ccf94626f 00007f9ccf945f37 00007f9ccf95a55c 00007f9ccf95a508 00007f9ccf95a488 00007f9ccf95a443 00007f9ccf9596ec 00007f9cce883a96
0709 12:12:20.582750 (+ 25181us) raft_consensus.cc:1685] finished
0709 12:12:20.582773 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:20.582909 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4984,"prepare.queue_time_us":3192,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":62,"raft.queue_time_us":562051,"raft.run_cpu_time_us":13008,"raft.run_wall_time_us":1184258,"spinlock_wait_cycles":42263424,"thread_start_us":429114,"threads_started":2,"wal-append.queue_time_us":388206}
W20260709 12:12:20.595363 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:20.595499 23120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57332 (request call id 1415) took 1103 ms. Trace:
I20260709 12:12:20.595849 23120 rpcz_store.cc:276] 0709 12:12:19.492180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.543964 (+ 51784us) service_pool.cc:224] Handling call
0709 12:12:20.595338 (+1051374us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b54006400d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:20.595443 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39414656}
I20260709 12:12:20.596295 28176 raft_consensus.cc:2749] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:20.598614 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:20.578136 28830 raft_consensus.cc:3055] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:20.600626 28830 raft_consensus.cc:740] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:20.600687 23122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 1400) took 1271 ms. Trace:
I20260709 12:12:20.602037 22448 raft_consensus.cc:1240] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:20.601688 28830 consensus_queue.cc:260] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:20.599687 22597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2881) took 3760 ms. Trace:
I20260709 12:12:20.603307 28026 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:20.603566 28830 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:20.568666 28651 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:20.603802 22448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 3065) took 2157 ms. Trace:
I20260709 12:12:20.560631 28762 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:20.603307 22597 rpcz_store.cc:276] 0709 12:12:16.839739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:18.557452 (+1717713us) service_pool.cc:224] Handling call
0709 12:12:18.557741 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:19.701308 (+1143567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:20.599389 (+898081us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54002de454. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:20.599607 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2587905280}
I20260709 12:12:20.604396 22448 rpcz_store.cc:276] 0709 12:12:18.446378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:18.698669 (+252291us) service_pool.cc:224] Handling call
0709 12:12:20.601806 (+1903137us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:20.602486 (+   680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:20.603565 (+  1079us) spinlock_profiling.cc:243] Waited 1.9 s on lock 0x7b5400241150. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:20.603732 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4376133504}
I20260709 12:12:20.601248 23122 rpcz_store.cc:276] 0709 12:12:19.329645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.336866 (+  7221us) service_pool.cc:224] Handling call
0709 12:12:19.337097 (+   231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:19.939113 (+602016us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:20.600456 (+661343us) spinlock_profiling.cc:243] Waited 601 ms on lock 0x7b5400135e54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:20.600604 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1382719872}
I20260709 12:12:20.606803 28762 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:12:20.592115 22453 rpcz_store.cc:269] 0709 12:12:18.203419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:18.220898 (+ 17479us) service_pool.cc:224] Handling call
0709 12:12:20.591478 (+2370580us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b5400241154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:20.591597 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2956312832}
W20260709 12:12:20.611691 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:20.611802 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:20.614025 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 217247us
I20260709 12:12:20.615641 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:20.616456 22453 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 17.
I20260709 12:12:20.618371 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:20.620582 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:20.622926 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:20.613551 28185 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.625865 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:20.561491 28829 consensus_queue.cc:1059] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 12:12:20.627168 22456 raft_consensus.cc:2393] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 14: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:20.614770 28621 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:20.628094 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 203942us
I20260709 12:12:20.616191 28026 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:12:20.633692 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 236803us
I20260709 12:12:20.635594 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:20.616537 28687 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:20.639236 22450 raft_consensus.cc:2393] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 17: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:20.636199 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:20.647468 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:20.651250 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:20.613658 28763 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:20.653963 28763 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:20.618104 28590 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
W20260709 12:12:20.660013 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 44270.5us
I20260709 12:12:20.638548 28185 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:20.668692 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:20.660365 28822 raft_consensus.cc:3055] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:20.669868 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:20.655092 28026 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:20.671866 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:20.673152 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:20.677810 22529 raft_consensus.cc:2393] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 16: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:20.673851 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:20.674475 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:20.678885 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:20.679078 22457 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:20.669855 22422 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:12:20.673851 22569 connection.cc:256] RPC call timeout handler was delayed by -1.7400288619999174s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1663s for a response
I20260709 12:12:20.638849 28621 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:20.682992 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:20.684193 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:12:20.690486 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 254846us
I20260709 12:12:20.681478 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:20.684726 22605 raft_consensus.cc:2376] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 18. Re-sending same reply.
I20260709 12:12:20.696784 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:20.697542 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:20.698120 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:20.698648 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:20.699579 22605 raft_consensus.cc:2368] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 18. Current term is 19.
I20260709 12:12:20.657855 28687 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:20.700791 22524 raft_consensus.cc:1240] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:20.659617 28590 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:20.706313 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:20.706542 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:20.707294 22602 raft_consensus.cc:2393] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 16: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:20.670409 28822 raft_consensus.cc:740] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:20.709977 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:20.710678 22497 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:20.703975 22570 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:20.722847 22525 raft_consensus.cc:2393] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 19: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:20.725713 28606 consensus_queue.cc:1048] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:20.724925 22422 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:20.669999 28830 consensus_queue.cc:1048] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 12:12:20.711095 22421 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:20.728273 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:20.695003 28762 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.731195 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:20.727545 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:20.734249 22457 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 18.
I20260709 12:12:20.734860 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:20.736198 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:20.737058 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:20.741411 22604 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 16.
I20260709 12:12:20.738907 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:20.745817 22495 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:20.747320 22449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 3059) took 2286 ms. Trace:
I20260709 12:12:20.747843 22449 rpcz_store.cc:276] 0709 12:12:18.444843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:18.590475 (+145632us) service_pool.cc:224] Handling call
0709 12:12:18.590848 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:19.615516 (+1024668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:20.731490 (+1115974us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54003f2fd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:20.731649 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2351158016}
W20260709 12:12:20.749414 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 45504.9us
I20260709 12:12:20.749770 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:20.751617 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:20.752292 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:20.754544 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:20.755363 22532 raft_consensus.cc:2393] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 17: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:20.756134 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:20.708761 28826 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:20.760516 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:20.773953 22524 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:20.774967 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:20.763173 22569 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:20.765671 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:12:20.766546 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 55520.2us
I20260709 12:12:20.766824 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:20.777572 23120 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 16.
I20260709 12:12:20.767570 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:20.778812 22602 raft_consensus.cc:2410] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 19 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:12:20.770769 22605 raft_consensus.cc:1240] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:12:20.771202 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:20.780889 22599 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:20.783056 23117 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0"
dest_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:57318
I20260709 12:12:20.783757 23117 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:20.784130 23117 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:20.771570 22603 raft_consensus.cc:1240] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:12:20.772477 22606 raft_consensus.cc:1240] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:20.764283 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:20.787264 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:20.787935 23119 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:20.788295 22570 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:12:20.788460 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 77874.7us
I20260709 12:12:20.724380 28720 raft_consensus.cc:2804] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:20.789983 22597 raft_consensus.cc:2393] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 18: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:20.788725 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:20.790640 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:20.803004 28834 log.cc:927] Time spent T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:12:20.804291 28810 raft_consensus.cc:2804] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:20.807062 22528 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 17.
I20260709 12:12:20.807121 28624 raft_consensus.cc:2804] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:20.806242 22599 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 19.
I20260709 12:12:20.788309 28691 raft_consensus.cc:2804] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:20.808881 28691 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:20.809237 28691 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:20.809626 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 63920.4us
I20260709 12:12:20.807467 28768 consensus_queue.cc:1059] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:20.725023 28645 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:20.810680 23120 raft_consensus.cc:1275] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:12:20.811887 22530 raft_consensus.cc:1275] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 12:12:20.827620 22530 raft_consensus.cc:1275] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:12:20.810534 22495 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:20.705657 28835 consensus_queue.cc:1059] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.111s
I20260709 12:12:20.841583 23088 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:20.832244 22497 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:20.768989 28176 raft_consensus.cc:2804] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:12:20.834100 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 71017.4us
I20260709 12:12:20.839018 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:20.807751 28624 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:20.883761 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 105009us
I20260709 12:12:20.769222 28827 consensus_queue.cc:1048] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 12:12:20.895668 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:20.896648 22599 raft_consensus.cc:2393] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 18: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:20.830062 28802 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:20.825099 28682 raft_consensus.cc:2804] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:20.810385 28720 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:20.887044 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:20.887467 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:20.788458 28639 consensus_queue.cc:1048] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.094s
I20260709 12:12:20.890223 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:20.890892 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:20.924680 22606 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:20.768817 28829 consensus_queue.cc:1048] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.079s
I20260709 12:12:20.813972 28626 consensus_queue.cc:1059] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 15.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.060s
I20260709 12:12:20.758533 28832 consensus_queue.cc:1059] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.137s
I20260709 12:12:20.760350 28762 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:20.839634 28810 raft_consensus.cc:697] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 12 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:20.844342 28558 raft_consensus.cc:2749] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:20.888887 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:20.953366 23120 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
I20260709 12:12:20.917403 22597 raft_consensus.cc:2393] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 17: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:20.865988 28756 raft_consensus.cc:3055] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:20.882189 28768 raft_consensus.cc:2804] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:20.882620 28624 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:20.929986 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:20.930444 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 94170.4us
I20260709 12:12:20.866745 22569 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:20.910682 28176 raft_consensus.cc:697] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:20.925426 23119 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 18.
I20260709 12:12:20.839892 28266 consensus_queue.cc:1048] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 12:12:20.871289 28838 raft_consensus.cc:2804] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:20.881387 28813 raft_consensus.cc:2804] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:20.955492 22570 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:20.922379 23117 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:20.967965 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:20.915606 28764 raft_consensus.cc:2804] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:20.975489 22528 raft_consensus.cc:2393] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 12: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:20.947670 28830 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:20.915306 28682 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:20.919448 28720 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:20.953106 28606 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:20.979522 22606 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 19.
I20260709 12:12:20.981038 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:20.973942 28745 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.927057 28825 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:20.869313 22524 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 18.
I20260709 12:12:20.978356 28841 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.965848 28756 raft_consensus.cc:740] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:20.953008 28826 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:20.985929 28768 raft_consensus.cc:697] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 17 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:20.999487 22497 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:21.003093 22530 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 16.
I20260709 12:12:21.005177 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:21.010087 22570 leader_election.cc:304] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:20.949383 28812 consensus_queue.cc:1048] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.053s
I20260709 12:12:20.979341 22603 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
W20260709 12:12:20.982141 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 114682us
I20260709 12:12:20.918921 28802 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:20.976789 28824 raft_consensus.cc:2749] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:20.986943 28558 raft_consensus.cc:2764] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:12:21.018004 23117 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:21.002620 28682 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:21.017665 28363 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:20.989820 28764 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:21.012751 28809 raft_consensus.cc:3055] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:12:21.013509 28830 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:21.097914 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 263776us
I20260709 12:12:21.083052 22569 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:21.081696 28590 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:21.029758 28825 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:21.049417 28826 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:21.019459 28606 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:21.086073 28768 consensus_queue.cc:237] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:21.049474 28639 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.031446 28645 raft_consensus.cc:2749] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:21.186245 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 128580us
I20260709 12:12:21.201020 22569 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:21.083473 28687 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:21.173069 28026 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:21.201263 22528 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:21.048807 28841 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:21.099221 28809 raft_consensus.cc:740] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
W20260709 12:12:21.194816 28846 log.cc:927] Time spent T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:12:21.204514 28599 consensus_queue.cc:260] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:21.206272 28853 log.cc:927] Time spent T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
W20260709 12:12:21.207155 28847 log.cc:927] Time spent T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 12:12:21.211663 28823 raft_consensus.cc:3055] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:21.212822 28606 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:21.213641 28843 log.cc:927] Time spent T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.291s	user 0.001s	sys 0.000s
W20260709 12:12:21.214372 28850 log.cc:927] Time spent T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 12:12:21.256560 23119 raft_consensus.cc:1275] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 12:12:21.024485 28745 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:21.099431 28764 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:21.091657 28542 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:21.050549 28185 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:21.190018 28842 log.cc:927] Time spent T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.371s	user 0.000s	sys 0.011s
I20260709 12:12:21.238389 22569 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:21.189136 28558 raft_consensus.cc:2749] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:21.289124 22421 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:21.196517 28776 consensus_queue.cc:1048] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 12:12:21.280097 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:21.254117 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:12:21.294596 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 56275.8us
I20260709 12:12:21.175565 28363 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:21.090484 28176 consensus_queue.cc:237] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:21.243569 28823 raft_consensus.cc:740] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
W20260709 12:12:21.291309 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 253632us
I20260709 12:12:21.084066 28810 consensus_queue.cc:237] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:21.244036 28645 raft_consensus.cc:2749] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:21.295856 22569 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:21.298192 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 299004us
I20260709 12:12:21.251360 28599 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:21.220446 28639 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:21.300954 22530 raft_consensus.cc:1240] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:12:21.302132 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:21.250813 22528 raft_consensus.cc:2468] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 15.
I20260709 12:12:21.239336 28860 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:21.303289 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:21.282434 28606 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.363794 28606 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:21.307924 22496 leader_election.cc:336] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Timed out: RequestConsensusVote RPC to 127.20.196.132:44353 timed out after 1.563s (SENT)
I20260709 12:12:21.364785 22496 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
W20260709 12:12:21.365724 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 57851.3us
I20260709 12:12:21.302352 28762 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:21.310181 22569 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:21.311743 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:21.369702 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 59616.3us
I20260709 12:12:21.298713 28824 raft_consensus.cc:2749] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:21.199430 28756 consensus_queue.cc:260] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:21.383958 28841 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:21.384164 28756 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:21.385658 28606 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:21.387580 28639 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:21.317976 28363 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:21.320273 28822 consensus_queue.cc:260] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:21.343482 22452 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 3081) took 1499 ms (client timeout 1777 ms). Trace:
W20260709 12:12:21.388924 22452 rpcz_store.cc:269] 0709 12:12:19.844386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.857992 (+ 13606us) service_pool.cc:224] Handling call
0709 12:12:21.343289 (+1485297us) spinlock_profiling.cc:243] Waited 507 ms on lock 0x7b54003f43d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:21.343419 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1165011840}
W20260709 12:12:21.350529 28651 consensus_meta.cc:287] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.746s	user 0.006s	sys 0.002s
I20260709 12:12:21.350909 28590 raft_consensus.cc:2749] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:21.271266 28813 raft_consensus.cc:697] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:21.310021 22497 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:21.313823 28558 raft_consensus.cc:2749] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:21.298506 28809 consensus_queue.cc:260] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:21.380481 28645 raft_consensus.cc:2749] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:21.369843 28814 raft_consensus.cc:2749] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:21.370148 28658 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:21.381094 28823 consensus_queue.cc:260] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:21.382651 28826 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:21.383272 28859 log.cc:927] Time spent T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:12:21.420801 28658 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:21.421895 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:21.422190 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:21.422569 22523 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 13.
I20260709 12:12:21.293488 28542 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:21.397076 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 87133.5us
I20260709 12:12:21.387769 28802 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:21.368531 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:21.404373 28841 consensus_queue.cc:1059] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 12:12:21.404517 28822 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:21.396548 28838 raft_consensus.cc:697] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:21.411559 28829 raft_consensus.cc:2804] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:21.404925 28026 consensus_queue.cc:1059] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 12:12:21.415411 28813 consensus_queue.cc:237] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:21.396880 28185 consensus_queue.cc:1048] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 12:12:21.467274 22569 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:21.419171 28701 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:21.388177 28762 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:21.452214 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:21.453070 22531 raft_consensus.cc:1240] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:21.453631 22601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43070 (request call id 1063) took 3440 ms. Trace:
I20260709 12:12:21.458448 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:21.494020 22601 rpcz_store.cc:276] 0709 12:12:18.013148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.473907 (+1460759us) service_pool.cc:224] Handling call
0709 12:12:19.474144 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:20.334928 (+860784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:21.453407 (+1118479us) spinlock_profiling.cc:243] Waited 857 ms on lock 0x7b54001c5cd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:21.453577 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1971704064}
I20260709 12:12:21.495384 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:21.371147 28855 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:21.463125 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:21.464422 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:21.464717 22570 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:21.503376 22605 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 15.
I20260709 12:12:21.504155 22570 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:21.422808 28658 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:21.381327 28825 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:21.435506 22454 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 3077) took 1592 ms (client timeout 1961 ms). Trace:
W20260709 12:12:21.512687 22454 rpcz_store.cc:269] 0709 12:12:19.843458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.878627 (+ 35169us) service_pool.cc:224] Handling call
0709 12:12:21.435338 (+1556711us) spinlock_profiling.cc:243] Waited 389 ms on lock 0x7b540019fd54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:21.435446 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":894223104}
I20260709 12:12:21.505479 22570 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:21.465613 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:21.514387 22598 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:21.397563 28824 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.509481 28762 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:21.510555 22452 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
mode: GRACEFUL
new_leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:44568
I20260709 12:12:21.480688 28623 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:21.510064 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:21.491338 28363 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:21.531263 22452 raft_consensus.cc:606] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Received request to transfer leadership to TS 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:21.535796 22452 raft_consensus.cc:614] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:21.485309 28695 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:12:21.534587 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 46217us
I20260709 12:12:21.531481 28829 raft_consensus.cc:697] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:21.539269 22598 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 19.
I20260709 12:12:21.490145 28538 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.542081 22497 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:21.539201 28829 consensus_queue.cc:237] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:21.519992 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:21.563021 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:21.563202 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 274173us
I20260709 12:12:21.398839 28651 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:21.509266 28721 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:21.544273 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:21.566111 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 72655.1us
I20260709 12:12:21.566939 23088 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:21.371228 28860 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:21.505560 28802 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:21.509135 28639 raft_consensus.cc:2749] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:21.539283 28855 raft_consensus.cc:2749] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:21.512665 28826 raft_consensus.cc:2749] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:21.568461 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:21.569079 22422 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:12:21.569168 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:21.569813 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:21.569897 22421 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:21.570557 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:21.571362 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:21.572724 22449 raft_consensus.cc:1240] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 12:12:21.618028 22456 raft_consensus.cc:2376] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 17. Re-sending same reply.
I20260709 12:12:21.618515 22526 raft_consensus.cc:1240] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:21.619071 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:21.620162 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:21.620721 22450 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 17.
I20260709 12:12:21.622534 22569 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:21.626613 22448 raft_consensus.cc:2410] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 12:12:21.627224 22453 raft_consensus.cc:2393] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 17: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
W20260709 12:12:21.622175 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 52367us
I20260709 12:12:21.574002 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:21.628805 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:21.629232 22421 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:21.519140 28621 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:21.514922 28856 consensus_queue.cc:1048] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 12:12:21.509953 28790 consensus_queue.cc:1048] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 12:12:21.583954 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:21.509266 28179 consensus_queue.cc:1048] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.055s
W20260709 12:12:21.627480 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 58483.8us
I20260709 12:12:21.629467 22457 raft_consensus.cc:2393] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 18: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:21.515744 28839 raft_consensus.cc:3055] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:21.623996 22495 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:21.619071 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:21.631031 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:21.531042 28803 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:21.621579 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:21.645236 22450 raft_consensus.cc:2376] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 17. Re-sending same reply.
I20260709 12:12:21.631145 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:21.641312 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:21.647042 22453 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
I20260709 12:12:21.648200 22453 raft_consensus.cc:1240] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:21.542742 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:21.579707 28363 raft_consensus.cc:697] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:21.644336 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:21.585407 28814 raft_consensus.cc:2804] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:21.562000 28841 consensus_queue.cc:1059] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.064s
W20260709 12:12:21.704393 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 52155.2us
I20260709 12:12:21.543828 28623 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:21.637676 28861 raft_consensus.cc:2804] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:21.725080 22495 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:21.565508 28825 consensus_queue.cc:1048] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.111s
W20260709 12:12:21.735783 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:21.632340 28819 raft_consensus.cc:2749] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:21.701951 28826 raft_consensus.cc:2804] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:21.565860 28538 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:21.562549 28695 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:21.646473 28821 raft_consensus.cc:2749] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:21.532401 28824 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:21.740074 28872 log.cc:927] Time spent T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 12:12:21.741981 28551 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:21.742760 28363 consensus_queue.cc:237] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:21.721407 28854 log.cc:927] Time spent T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.412s	user 0.000s	sys 0.001s
I20260709 12:12:21.585093 28606 consensus_queue.cc:1059] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.125s
I20260709 12:12:21.587697 28721 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:21.748986 28623 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:21.710587 28179 consensus_queue.cc:1243] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer 6c6fa11e8ee34711b3551f0c670442bc log is divergent from this leader: its last log entry 17.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
W20260709 12:12:21.736459 28691 consensus_meta.cc:287] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.927s	user 0.010s	sys 0.007s
I20260709 12:12:21.750801 22448 raft_consensus.cc:2468] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 14.
I20260709 12:12:21.581487 28591 consensus_queue.cc:1059] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.116s
I20260709 12:12:21.765451 28762 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:21.766312 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:21.640525 28701 raft_consensus.cc:2804] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:12:21.769898 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 44941.6us
I20260709 12:12:21.650456 28838 consensus_queue.cc:237] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:21.589186 28802 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:21.716856 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:21.649329 28839 raft_consensus.cc:740] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:21.783511 22450 raft_consensus.cc:1240] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:21.724195 28621 raft_consensus.cc:2804] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:21.646288 28558 consensus_queue.cc:1048] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.140s
I20260709 12:12:21.707760 28870 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:21.735487 28814 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:12:21.863580 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 295564us
I20260709 12:12:21.645920 28882 consensus_queue.cc:1048] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.154s
W20260709 12:12:21.801523 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 295505us
I20260709 12:12:21.806857 28538 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:21.791262 28826 raft_consensus.cc:697] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:21.853571 28542 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:21.798509 28639 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.843696 22452 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
I20260709 12:12:21.858695 28621 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:21.700289 28828 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.228s	user 0.008s	sys 0.032s
I20260709 12:12:21.781311 28835 raft_consensus.cc:2804] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:21.801646 28551 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:21.849541 28701 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:21.779795 28871 consensus_queue.cc:1059] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 12:12:21.885016 23089 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:21.850457 28695 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:21.861485 28825 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:21.838613 28691 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:21.869105 28814 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:21.863346 28762 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:12:21.888880 28828 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.417s	user 0.008s	sys 0.033s
I20260709 12:12:21.891821 28621 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:21.868151 28176 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:21.914433 23089 leader_election.cc:400] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 election: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 18. Current term is 19.
I20260709 12:12:21.904220 28701 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:21.888424 28651 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:21.923851 23089 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:21.893452 28542 raft_consensus.cc:3055] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:12:21.907234 28682 consensus_meta.cc:287] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.731s	user 0.011s	sys 0.000s
I20260709 12:12:21.924089 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:21.889075 28790 consensus_queue.cc:1048] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 12:12:21.905956 28835 raft_consensus.cc:697] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:21.920873 28695 raft_consensus.cc:2749] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:21.923528 28599 consensus_meta.cc:287] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.608s	user 0.009s	sys 0.001s
I20260709 12:12:21.893139 28639 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:21.871321 28870 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:21.913048 28860 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:21.923974 28874 raft_consensus.cc:3055] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:21.942904 23089 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:21.928781 28694 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:21.936278 28873 log.cc:927] Time spent T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 12:12:21.930218 28542 raft_consensus.cc:740] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:21.920821 28825 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:21.926133 28762 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:21.955451 28694 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:21.899561 28839 consensus_queue.cc:260] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:21.949046 28623 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:21.849934 22495 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:12:21.895673 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 331329us
I20260709 12:12:21.928119 28176 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:21.941560 28590 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.934680 28682 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:21.970096 28721 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:21.990636 28802 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:22.229784 28814 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:22.230751 28802 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.990407 28824 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:21.949065 28826 consensus_queue.cc:237] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:22.231653 28802 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:22.004247 28822 consensus_meta.cc:287] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.552s	user 0.010s	sys 0.000s
I20260709 12:12:21.985044 28835 consensus_queue.cc:237] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:22.235584 28812 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:22.238137 22531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 2594) took 1567 ms. Trace:
W20260709 12:12:22.239005 28764 consensus_meta.cc:287] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.940s	user 0.011s	sys 0.002s
I20260709 12:12:22.239601 28764 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:22.242486 28764 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:21.965260 28694 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:22.087852 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:22.236665 28812 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:22.238658 22531 rpcz_store.cc:276] 0709 12:12:20.670097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:20.670879 (+   782us) service_pool.cc:224] Handling call
0709 12:12:21.335686 (+664807us) spinlock_profiling.cc:243] Waited 998 us on lock 0x7b5800037898. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf907fc0 00007f9ccf8f2929 00007f9ccf8f23d2 00007f9cc8e69bd4
0709 12:12:21.452887 (+117201us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:21.493995 (+ 41108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:22.237681 (+743686us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b54001f3450. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:22.237915 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":271356416}
I20260709 12:12:22.249348 22598 raft_consensus.cc:2468] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 13.
I20260709 12:12:22.251821 28802 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:22.121608 28906 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.060357 22456 raft_consensus.cc:2393] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 19: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:22.192572 22604 raft_consensus.cc:1240] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 LEADER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:21.989241 28839 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:22.268543 22597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3342) took 1281 ms. Trace:
I20260709 12:12:21.946867 28861 raft_consensus.cc:697] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:22.271272 28906 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:22.272511 28861 consensus_queue.cc:237] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:21.949662 28874 raft_consensus.cc:740] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:22.276364 28874 consensus_queue.cc:260] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:21.988097 28875 log.cc:927] Time spent T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
W20260709 12:12:21.964798 28876 log.cc:927] Time spent T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:12:22.277959 28701 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:21.965236 28877 log.cc:927] Time spent T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:12:22.288216 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:22.289950 28701 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:22.290129 23117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 1401) took 1041 ms. Trace:
I20260709 12:12:22.290488 28687 raft_consensus.cc:3055] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:22.291076 28687 raft_consensus.cc:740] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
W20260709 12:12:21.964178 28879 log.cc:927] Time spent T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:12:22.087649 22600 raft_consensus.cc:1275] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:12:22.295480 28812 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:22.295883 28363 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.296482 28363 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:22.297855 28762 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:22.092990 22605 raft_consensus.cc:1240] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:22.095139 22606 raft_consensus.cc:1240] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 12:12:22.238739 28814 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:22.071162 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:22.267227 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:22.003803 28870 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:22.303325 28822 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:22.304184 28822 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:22.309306 28814 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.309587 28768 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:22.052991 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 412253us
I20260709 12:12:22.310022 28814 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:22.310334 28768 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:22.269126 22597 rpcz_store.cc:276] 0709 12:12:20.986611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:20.986906 (+   295us) service_pool.cc:224] Handling call
0709 12:12:20.987278 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:21.089061 (+101783us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:21.089094 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:21.089584 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 12:12:21.460041 (+370457us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:21.460076 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:22.267624 (+807548us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b54000e9f54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:22.267703 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:22.267796 (+    93us) raft_consensus.cc:1685] finished
0709 12:12:22.267817 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:22.268288 (+   471us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":143,"raft.queue_time_us":3727,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":52345,"spinlock_wait_cycles":232739072,"thread_start_us":370139,"threads_started":1,"wal-append.queue_time_us":526342}
I20260709 12:12:22.312618 28814 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:22.313510 22570 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:22.313659 22421 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:22.314153 28768 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:22.314726 28870 raft_consensus.cc:2749] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:22.222803 28756 consensus_meta.cc:287] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.838s	user 0.019s	sys 0.000s
I20260709 12:12:22.118323 28621 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:22.184455 28658 raft_consensus.cc:2749] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:22.204806 28691 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:22.106573 28551 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:22.284397 28893 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.285989 28620 raft_consensus.cc:3055] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:12:22.054220 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:22.058917 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 414800us
W20260709 12:12:22.097615 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 154674us
I20260709 12:12:22.314954 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:22.180160 28639 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:22.321362 22526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 1247) took 1648 ms. Trace:
I20260709 12:12:21.951601 28179 raft_consensus.cc:2749] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:22.326932 28812 raft_consensus.cc:2804] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:22.331017 28812 raft_consensus.cc:697] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:22.332428 28812 consensus_queue.cc:237] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:22.296504 28906 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:22.337764 23089 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:22.341148 28867 raft_consensus.cc:3055] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:22.341696 28867 raft_consensus.cc:740] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
W20260709 12:12:22.343634 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:22.344350 28551 raft_consensus.cc:2764] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:12:22.346370 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:22.346587 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 496610us
I20260709 12:12:22.348187 28864 raft_consensus.cc:2804] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:22.348584 28830 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:22.345512 28867 consensus_queue.cc:260] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:22.351787 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:22.320416 28621 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:22.351902 28867 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:22.352767 22525 raft_consensus.cc:1240] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:22.329466 22526 rpcz_store.cc:276] 0709 12:12:20.673111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:20.673562 (+   451us) service_pool.cc:224] Handling call
0709 12:12:20.699853 (+ 26291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:21.618942 (+919089us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:22.320717 (+701775us) spinlock_profiling.cc:243] Waited 918 ms on lock 0x7b54001f2054. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:22.321108 (+   391us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2112304000}
I20260709 12:12:22.356604 28823 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:22.329102 28620 raft_consensus.cc:740] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:22.359735 28620 consensus_queue.cc:260] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:22.350281 28590 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:22.360926 28620 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:22.361872 22455 raft_consensus.cc:1275] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 12:12:22.362253 22455 pending_rounds.cc:85] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f: Aborting all ops after (but not including) 9
I20260709 12:12:22.362488 22455 pending_rounds.cc:107] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 12:12:22.362771 22455 raft_consensus.cc:2889] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:22.350898 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:12:22.350821 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:22.349684 28830 consensus_queue.cc:1059] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:22.348645 28864 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:22.348205 22495 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:22.306901 28822 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:22.348783 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:22.292945 28687 consensus_queue.cc:260] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:22.315539 28363 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:22.352908 28682 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:22.096323 28542 consensus_queue.cc:260] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:22.367224 28864 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:22.379704 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:22.380517 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:22.381212 23089 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:22.381263 28551 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.290518 23117 rpcz_store.cc:276] 0709 12:12:21.248651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:21.250886 (+  2235us) service_pool.cc:224] Handling call
0709 12:12:21.251786 (+   900us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:21.252126 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:21.252157 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:21.281914 (+ 29757us) log.cc:844] Serialized 26 byte log entry
0709 12:12:21.632470 (+350556us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:21.632508 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:21.632568 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:22.289651 (+657083us) raft_consensus.cc:1685] finished
0709 12:12:22.289701 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:22.289910 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6117,"raft.queue_time_us":26555,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":8157,"thread_start_us":330116,"threads_started":1,"wal-append.queue_time_us":552075}
I20260709 12:12:22.388960 28763 raft_consensus.cc:2749] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:22.389686 28825 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:22.390436 28480 raft_consensus.cc:3055] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:22.382661 28687 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:22.330883 28893 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:22.396348 22495 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:22.403220 28591 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
W20260709 12:12:22.405328 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 86870.7us
I20260709 12:12:22.413542 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:22.407125 28480 raft_consensus.cc:740] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
W20260709 12:12:22.422058 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 108487us
I20260709 12:12:22.418262 28534 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:22.423575 28534 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:22.423637 28480 consensus_queue.cc:260] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:22.424198 28590 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:22.425137 28480 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:22.424889 28551 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:22.427469 28551 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:22.427515 28534 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:12:22.428613 28624 consensus_meta.cc:287] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 1.443s	user 0.008s	sys 0.015s
I20260709 12:12:22.429167 28624 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:22.430773 22529 raft_consensus.cc:1240] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:22.431272 22456 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 18.
W20260709 12:12:22.431785 28803 consensus_meta.cc:287] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.729s	user 0.015s	sys 0.003s
I20260709 12:12:22.431135 28591 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:22.435640 28542 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:22.436591 28623 raft_consensus.cc:2749] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:22.437623 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 56667.1us
I20260709 12:12:22.438632 23089 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:22.441179 23089 leader_election.cc:304] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:22.442061 28534 raft_consensus.cc:2749] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:22.442965 28534 raft_consensus.cc:2749] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:22.443274 22455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 3079) took 2599 ms. Trace:
I20260709 12:12:22.443836 28534 consensus_queue.cc:1059] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:22.444957 28266 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.445924 28179 raft_consensus.cc:3055] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:22.445665 28266 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:22.446360 28179 raft_consensus.cc:740] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:22.447532 28871 raft_consensus.cc:2804] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:22.448323 28871 raft_consensus.cc:697] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:22.447837 28179 consensus_queue.cc:260] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:22.449410 28179 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:22.449728 28871 consensus_queue.cc:237] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:22.452287 28856 raft_consensus.cc:2749] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:12:22.458446 28856 consensus_queue.cc:1059] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:12:22.459444 28534 raft_consensus.cc:3055] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:22.459887 28534 raft_consensus.cc:740] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:22.461074 28534 consensus_queue.cc:260] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:22.443707 22455 rpcz_store.cc:276] 0709 12:12:19.843939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.930852 (+ 86913us) service_pool.cc:224] Handling call
0709 12:12:19.935299 (+  4447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:22.379311 (+2444012us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:22.442929 (+ 63618us) spinlock_profiling.cc:243] Waited 2.43 s on lock 0x7b5400241654. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:22.443185 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5579387136}
I20260709 12:12:22.419646 28809 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:22.462512 28534 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:22.463474 28822 raft_consensus.cc:3055] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:22.463941 28822 raft_consensus.cc:740] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:22.464282 28855 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.464996 28855 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:22.465092 28822 consensus_queue.cc:260] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:22.466603 28822 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:22.462489 28720 consensus_meta.cc:287] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 1.389s	user 0.015s	sys 0.008s
I20260709 12:12:22.468896 28893 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:22.442821 23089 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:12:22.471169 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 58901.5us
I20260709 12:12:22.417241 28176 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:22.463950 28266 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:22.470638 28830 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:22.497653 28591 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:22.495362 22497 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:22.507758 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:22.519558 28900 log.cc:927] Time spent T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.428s	user 0.005s	sys 0.000s
I20260709 12:12:22.521741 22422 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:22.524365 28840 raft_consensus.cc:2804] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:22.524859 28840 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:22.525260 28840 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:22.527429 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:22.527872 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:22.529243 28830 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:22.533556 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:22.468942 28720 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:22.498624 28855 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:22.540144 22604 raft_consensus.cc:1275] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 12:12:22.542819 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 121055us
I20260709 12:12:22.510905 28551 raft_consensus.cc:2749] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:22.546206 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:22.556751 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:22.557922 22525 raft_consensus.cc:1275] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:12:22.562870 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:22.560777 22455 raft_consensus.cc:1275] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:22.506878 28812 consensus_queue.cc:1048] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.052s
I20260709 12:12:22.596591 28720 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:22.597481 22569 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:22.570261 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:22.562580 28624 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:22.602634 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 60090.7us
I20260709 12:12:22.576154 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:22.577489 28874 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:22.581100 28910 log.cc:927] Time spent T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.090s	user 0.002s	sys 0.000s
I20260709 12:12:22.583704 28745 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:22.611029 22600 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 22.
W20260709 12:12:22.584687 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 108390us
I20260709 12:12:22.570879 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:22.587836 22529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 2607) took 1286 ms. Trace:
I20260709 12:12:22.589041 22597 raft_consensus.cc:1275] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:12:22.571303 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:22.557626 28266 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:22.610140 22454 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 22.
I20260709 12:12:22.619693 22569 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:12:22.622897 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:22.616431 22529 rpcz_store.cc:276] 0709 12:12:21.301507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:21.301833 (+   326us) service_pool.cc:224] Handling call
0709 12:12:21.302199 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:22.431332 (+1129133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:22.587537 (+156205us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54000d4dd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:22.587773 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2594521728}
I20260709 12:12:22.628979 22450 raft_consensus.cc:2468] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11.
I20260709 12:12:22.629231 28176 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:22.629896 22600 raft_consensus.cc:1275] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 12:12:22.630000 28176 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:22.617092 28591 consensus_queue.cc:1048] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 12:12:22.627269 28893 raft_consensus.cc:2804] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:22.631601 28893 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:22.632002 28893 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:22.632575 28176 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:22.633315 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:22.634085 22600 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 16.
I20260709 12:12:22.629935 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:22.635226 22570 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:22.635942 22597 raft_consensus.cc:2393] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 19: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:22.636022 28591 consensus_queue.cc:1048] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:22.627923 22606 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 18.
I20260709 12:12:22.644974 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:22.645748 23120 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 15.
I20260709 12:12:22.647382 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:22.634917 28606 consensus_queue.cc:1059] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 12:12:22.638659 22421 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:22.640240 23117 raft_consensus.cc:1240] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:12:22.648557 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:22.647495 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:22.649235 22602 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 22.
I20260709 12:12:22.649473 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:22.650216 22598 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 17.
I20260709 12:12:22.651227 22599 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 18.
I20260709 12:12:22.651311 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:22.637372 22422 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:22.656409 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:22.656684 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:22.657238 22452 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 16.
I20260709 12:12:22.657413 28606 raft_consensus.cc:3055] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:22.657829 28606 raft_consensus.cc:740] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:22.658787 22451 raft_consensus.cc:1240] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 LEADER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 12:12:22.659065 28606 consensus_queue.cc:260] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:22.660495 28606 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:22.660588 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:22.661263 22598 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:22.656504 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:22.662953 22456 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:22.663348 28830 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:22.671245 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 228570us
I20260709 12:12:22.672690 23089 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:22.676505 28812 raft_consensus.cc:2749] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:22.678381 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:22.679267 22599 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 16.
W20260709 12:12:22.680097 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:22.681420 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:22.683414 28266 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.684067 28266 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:22.684800 23120 raft_consensus.cc:1240] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 18. Current term is 19. Ops: []
W20260709 12:12:22.688107 28911 log.cc:927] Time spent T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.089s	user 0.000s	sys 0.002s
I20260709 12:12:22.688735 28835 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.689410 28658 raft_consensus.cc:2804] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:22.689239 28835 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:22.689831 28658 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:22.690253 28658 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:22.691175 28266 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:22.696969 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:22.697219 28835 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:22.697839 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:22.699162 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:22.699822 22448 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 22.
I20260709 12:12:22.700538 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:22.701110 22526 raft_consensus.cc:2393] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 16: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:22.701130 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:22.702018 22448 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:22.701303 22525 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:22.718957 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 81719.4us
I20260709 12:12:22.719969 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:22.722913 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:22.727587 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:22.741498 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:22.742807 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:22.718845 28551 raft_consensus.cc:2749] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:22.726492 28909 log.cc:927] Time spent T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.066s	user 0.001s	sys 0.001s
I20260709 12:12:22.743747 22600 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 16.
I20260709 12:12:22.738216 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:22.755725 22599 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:22.727109 28809 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 12:12:22.759688 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 87116.1us
I20260709 12:12:22.766887 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:22.768347 22497 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:22.745085 28176 raft_consensus.cc:2804] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:12:22.771939 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:22.772660 22598 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 17.
I20260709 12:12:22.773123 22456 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 16.
I20260709 12:12:22.767059 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:22.780066 22497 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:22.779330 28838 consensus_queue.cc:1048] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
W20260709 12:12:22.783735 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:22.786391 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:22.761885 28809 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:22.789760 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:22.790704 22450 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:22.776357 28823 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:22.793550 22497 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:22.795655 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:22.796205 23119 raft_consensus.cc:1240] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:22.800981 22497 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:22.802928 22455 raft_consensus.cc:1275] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:22.791051 28809 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:22.789424 28871 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:22.810194 22422 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:22.811798 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:22.797791 28823 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:22.797384 28176 raft_consensus.cc:697] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:22.807217 28551 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.818272 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:22.806349 28480 raft_consensus.cc:2804] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:22.812882 28871 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:22.828107 22598 raft_consensus.cc:1240] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 16. Current term is 17. Ops: [16.10-16.10]
W20260709 12:12:22.829005 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:22.831276 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:22.815807 28687 raft_consensus.cc:2804] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:22.821686 28830 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:12:22.834559 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:22.875731 28918 log.cc:927] Time spent T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:12:22.876752 28830 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:22.877391 28915 log.cc:927] Time spent T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 12:12:22.878429 28913 log.cc:927] Time spent T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 12:12:22.868754 22456 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 17.
I20260709 12:12:22.834251 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:12:22.843405 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:22.890273 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 80277.6us
I20260709 12:12:22.891163 23089 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:22.883611 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:22.893409 22455 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 17.
I20260709 12:12:22.894928 22495 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:22.895126 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:22.896178 22495 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:22.899382 28855 raft_consensus.cc:2804] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:22.899438 28185 raft_consensus.cc:2749] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:22.899955 28855 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:22.900440 28855 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:22.900981 22569 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:22.901866 22569 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:22.902664 28558 consensus_queue.cc:1048] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:22.904162 28558 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:22.904508 28558 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:22.904897 28558 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:22.907323 28826 raft_consensus.cc:2804] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:22.907763 28826 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:22.908167 28826 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:22.908659 28687 raft_consensus.cc:697] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:22.909900 28687 consensus_queue.cc:237] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:22.913700 28825 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.914261 28825 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:22.832912 28871 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:22.916765 28825 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:22.806195 28701 consensus_queue.cc:1048] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:12:22.928099 28701 consensus_queue.cc:1243] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer 6c6fa11e8ee34711b3551f0c670442bc log is divergent from this leader: its last log entry 12.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 12:12:22.930501 28889 log.cc:927] Time spent T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 12:12:22.930502 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:22.931766 23123 raft_consensus.cc:2393] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 13: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:22.933612 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:22.934281 23122 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:22.935029 28830 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:22.936417 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:22.937366 23123 raft_consensus.cc:2410] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 22 because replica has last-logged OpId of term: 20 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 16.
I20260709 12:12:22.939011 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:22.940115 28751 consensus_queue.cc:1048] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.125s
I20260709 12:12:22.940395 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:12:22.942638 28914 log.cc:927] Time spent T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
W20260709 12:12:22.944638 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 111747us
I20260709 12:12:22.947189 28179 consensus_queue.cc:1048] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:22.948886 22452 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 12.
I20260709 12:12:22.951427 23122 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 17.
I20260709 12:12:22.827070 28480 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:22.954051 28480 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:22.956005 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:22.827495 28551 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:22.961786 28551 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:22.963621 28825 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.964514 28825 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:22.870810 22422 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:22.818208 28823 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:22.972545 22525 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 14.
I20260709 12:12:22.898754 22495 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:22.975270 22599 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 16.
W20260709 12:12:22.977125 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:22.981753 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:22.986624 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:22.982537 22452 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 19.
I20260709 12:12:22.988662 22448 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 18.
I20260709 12:12:22.989678 22455 raft_consensus.cc:1240] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:22.996019 23119 raft_consensus.cc:2393] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 18: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
W20260709 12:12:22.999887 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 101252us
I20260709 12:12:22.826083 28812 raft_consensus.cc:2804] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:23.001580 23122 raft_consensus.cc:2393] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 11: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:23.006524 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:23.009227 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 183214us
I20260709 12:12:23.010360 22600 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:23.002532 22495 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:23.012941 22495 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:23.014386 22495 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:22.826745 28861 consensus_queue.cc:1048] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.181s
I20260709 12:12:23.018858 22454 raft_consensus.cc:1275] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:23.019750 28720 raft_consensus.cc:2804] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:23.020186 28720 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:23.020574 28720 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:23.021775 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:23.022440 23120 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
I20260709 12:12:23.023587 28745 raft_consensus.cc:2804] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:23.023993 28745 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.024330 28745 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:23.027779 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:23.028992 28814 raft_consensus.cc:2804] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:23.029412 28814 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:23.029768 28814 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:23.032332 22597 raft_consensus.cc:1275] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:23.009323 22569 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:23.030324 28558 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:22.967079 28825 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:23.041036 23088 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:23.005648 28838 raft_consensus.cc:2804] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:23.067493 22598 raft_consensus.cc:1275] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:23.001111 28812 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.042444 22452 raft_consensus.cc:1275] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:23.063251 22422 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:23.037712 28822 raft_consensus.cc:2804] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:12:23.078562 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:23.079648 22450 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 17.
I20260709 12:12:23.096463 22455 raft_consensus.cc:1275] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:12:23.050961 28701 raft_consensus.cc:2804] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:23.097419 28701 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:23.097930 28701 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:23.047200 28176 consensus_queue.cc:237] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:23.107709 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 216663us
I20260709 12:12:23.108732 23089 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:23.111050 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:23.111857 23122 raft_consensus.cc:2410] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 17 because replica has last-logged OpId of term: 16 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 14.
I20260709 12:12:23.111159 28768 raft_consensus.cc:2804] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:23.112643 28768 raft_consensus.cc:697] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 19 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:23.113790 23120 raft_consensus.cc:1240] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:12:23.113682 28768 consensus_queue.cc:237] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:23.117133 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:23.117738 23122 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 16.
I20260709 12:12:23.119798 23123 raft_consensus.cc:1275] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:12:23.119920 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:12:23.120677 28898 log.cc:927] Time spent T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.235s	user 0.000s	sys 0.000s
I20260709 12:12:23.081574 28682 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.121083 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:23.121673 28682 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:23.122210 23124 raft_consensus.cc:1275] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:12:23.123788 28682 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:23.126340 28864 consensus_meta.cc:287] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.707s	user 0.007s	sys 0.002s
I20260709 12:12:23.127065 28822 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.127482 28822 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:23.142668 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:23.150766 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:23.145359 22347 catalog_manager.cc:5697] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:23.153051 22347 catalog_manager.cc:5697] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:22.998203 28658 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:23.159356 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 118439us
I20260709 12:12:23.083846 28825 raft_consensus.cc:2804] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:23.168159 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:23.008929 28835 consensus_queue.cc:1048] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.131s
W20260709 12:12:23.170526 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 160711us
I20260709 12:12:23.174135 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:23.073591 28812 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:23.170466 28825 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.166929 28179 raft_consensus.cc:2804] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:23.126755 28864 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:23.176550 28591 raft_consensus.cc:2804] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:23.176884 28861 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.175187 22495 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:23.177964 22605 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 12.
I20260709 12:12:23.181543 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:23.177423 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 433737us
I20260709 12:12:23.189642 22599 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 14.
I20260709 12:12:23.185279 22422 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:23.181941 28825 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:23.205027 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:23.193635 22495 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:23.207969 22527 raft_consensus.cc:1240] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:23.181623 28185 consensus_queue.cc:1048] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:12:23.187542 28591 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:23.218046 28591 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:23.199887 28835 raft_consensus.cc:2804] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:23.220537 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:23.221810 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:23.222158 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:23.222494 22526 raft_consensus.cc:2393] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 16: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:23.223078 28624 raft_consensus.cc:2749] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:23.158820 22347 catalog_manager.cc:5697] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 13 to 17, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 17 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:23.223296 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:23.223834 28624 consensus_queue.cc:1048] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:23.224179 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:23.224649 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:23.224504 22347 catalog_manager.cc:5697] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:23.225310 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:23.225644 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:23.227099 22532 raft_consensus.cc:1240] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:23.227391 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:23.226794 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:23.227883 28701 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:23.228914 22495 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:23.229895 28701 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:23.231370 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:23.231684 22531 raft_consensus.cc:1240] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:23.248720 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:23.169993 28830 consensus_queue.cc:1048] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
W20260709 12:12:23.208453 28893 consensus_meta.cc:287] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.571s	user 0.014s	sys 0.000s
W20260709 12:12:23.203234 28840 consensus_meta.cc:287] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.677s	user 0.014s	sys 0.000s
I20260709 12:12:23.226379 22347 catalog_manager.cc:5697] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:23.192677 28179 raft_consensus.cc:697] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 14 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:23.271018 28624 consensus_queue.cc:1048] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 12:12:23.272063 22605 raft_consensus.cc:1275] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:12:23.275110 28862 raft_consensus.cc:2804] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:23.275489 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:23.186412 28874 consensus_queue.cc:1059] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 12:12:23.279207 28682 raft_consensus.cc:2804] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:23.280979 28720 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:23.282055 22351 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55978 (request call id 335) took 48546 ms (client timeout 15000 ms). Trace:
I20260709 12:12:23.283792 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:23.281015 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:23.285495 22450 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 14.
I20260709 12:12:23.298719 23117 raft_consensus.cc:1240] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 17. Current term is 18. Ops: [15.11-17.12]
I20260709 12:12:23.298870 22600 raft_consensus.cc:1275] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:23.301590 22495 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:23.301270 28826 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:23.302520 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:23.303525 28179 consensus_queue.cc:237] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:23.305181 28720 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:23.300876 22526 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 21.
I20260709 12:12:23.278745 28822 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:23.313547 22448 raft_consensus.cc:1240] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 16. Current term is 17. Ops: [16.15-16.15]
W20260709 12:12:23.301512 28606 consensus_meta.cc:287] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.640s	user 0.009s	sys 0.004s
I20260709 12:12:23.214740 28861 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:23.324816 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:23.304936 22347 catalog_manager.cc:5697] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 12 to 14, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 14 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:23.290549 28867 consensus_queue.cc:1048] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:12:23.304597 28826 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:23.288669 28893 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:23.349696 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:23.311566 28862 raft_consensus.cc:697] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 16 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:23.355615 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:23.351501 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:23.290083 28840 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:23.292150 28814 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:23.364635 22529 raft_consensus.cc:2393] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 18: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:23.369953 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:23.312496 28825 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:23.372797 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:23.373605 22528 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:23.374090 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:23.384189 22528 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 17.
W20260709 12:12:23.366231 28809 consensus_meta.cc:287] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.542s	user 0.008s	sys 0.001s
I20260709 12:12:23.390614 22532 raft_consensus.cc:1240] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:23.393858 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:23.394630 22526 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:12:23.369668 28558 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 23 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:12:23.402498 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 393273us
I20260709 12:12:23.405501 23117 raft_consensus.cc:2393] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 14: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:23.431864 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:23.453869 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:12:23.471535 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:23.471691 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:23.474043 22604 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.001s	sys 0.017s
W20260709 12:12:23.474534 22604 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.001s	sys 0.017s
I20260709 12:12:23.477345 23123 raft_consensus.cc:1240] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:23.399911 28658 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:23.390100 28809 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:23.517725 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 442236us
I20260709 12:12:23.517894 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:23.519865 28591 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:23.521268 22448 raft_consensus.cc:1240] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:23.523895 28591 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:23.524274 28840 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:23.526114 22449 raft_consensus.cc:2468] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11.
I20260709 12:12:23.528069 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:23.533109 28620 raft_consensus.cc:3055] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:23.533571 28620 raft_consensus.cc:740] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:23.534392 28620 consensus_queue.cc:260] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:23.535679 28620 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:23.538625 28185 raft_consensus.cc:2804] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:23.539045 28185 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.539405 28185 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:23.542117 28864 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:23.543463 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:12:23.300060 22351 rpcz_store.cc:269] 0709 12:11:34.737600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.215633 (+478033us) service_pool.cc:224] Handling call
0709 12:12:23.281805 (+48066172us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:19.015728 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:19.016431 (+   703us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:19.016482 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:12:19.016500 (+    18us) tablet.cc:662] Decoding operations
0709 12:12:19.251831 (+235331us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:19.251982 (+   151us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:19.252023 (+    41us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:12:19.253182 (+  1159us) tablet.cc:701] Row locks acquired
0709 12:12:19.253246 (+    64us) write_op.cc:260] PREPARE: finished
0709 12:12:19.253477 (+   231us) write_op.cc:270] Start()
0709 12:12:19.253667 (+   190us) write_op.cc:276] Timestamp: P: 1783599139253396 usec, L: 0
0709 12:12:19.253717 (+    50us) op_driver.cc:348] REPLICATION: starting
0709 12:12:19.254629 (+   912us) log.cc:844] Serialized 3653 byte log entry
0709 12:12:20.284470 (+1029841us) op_driver.cc:464] REPLICATION: finished
0709 12:12:20.641217 (+356747us) write_op.cc:301] APPLY: starting
0709 12:12:20.641321 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:20.675389 (+ 34068us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:20.704050 (+ 28661us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:21.358266 (+654216us) spinlock_profiling.cc:243] Waited 3.99 ms on lock 0x7b18001abb40. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cca66d0ec 00007f9cca66faf7 00007f9cca670fb0 00007f9cce3851bb 00007f9cce3cc5d4 00007f9cce2788da 00007f9cce27b3cb 00007f9cce27afd3 00007f9cce379e34
0709 12:12:21.373210 (+ 14944us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:21.382152 (+  8942us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 12:12:21.382246 (+    94us) write_op.cc:312] APPLY: finished
0709 12:12:21.382756 (+   510us) log.cc:844] Serialized 89 byte log entry
0709 12:12:21.833856 (+451100us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:21.850133 (+ 16277us) write_op.cc:454] Released schema lock
0709 12:12:21.860814 (+ 10681us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:21.916942 (+ 56128us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:21.919309 (+  2367us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":49732,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":340682,"apply.run_cpu_time_us":74253,"apply.run_wall_time_us":1257937,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41747,"num_ops":9,"prepare.queue_time_us":352327,"prepare.run_cpu_time_us":25140,"prepare.run_wall_time_us":576949,"raft.queue_time_us":382074,"raft.run_cpu_time_us":14063,"raft.run_wall_time_us":288682,"replication_time_us":1013652,"spinlock_wait_cycles":9178496,"thread_start_us":1381383,"threads_started":5,"wal-append.queue_time_us":996003,"wal-append.run_cpu_time_us":20167,"wal-append.run_wall_time_us":2560276}]]}
W20260709 12:12:23.549417 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:23.477034 28480 consensus_meta.cc:287] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.522s	user 0.010s	sys 0.000s
I20260709 12:12:23.557848 23123 raft_consensus.cc:1240] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:23.405355 28823 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:23.563179 22453 raft_consensus.cc:2393] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 23: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:23.560235 22569 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:23.405210 28871 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:23.563684 28855 consensus_meta.cc:287] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.663s	user 0.011s	sys 0.001s
I20260709 12:12:23.589932 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:23.596565 22524 raft_consensus.cc:2393] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 23: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
W20260709 12:12:23.597512 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 434941us
I20260709 12:12:23.600311 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:23.575007 28826 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:23.607540 22531 raft_consensus.cc:2368] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 18. Current term is 19.
I20260709 12:12:23.606621 28185 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:23.611233 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:23.612380 28763 consensus_queue.cc:1048] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:23.612524 28768 consensus_queue.cc:1059] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:23.589561 28658 raft_consensus.cc:2804] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:12:23.557040 28480 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:23.560223 28558 consensus_queue.cc:1059] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 12:12:23.646629 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:23.631163 22454 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 19.
I20260709 12:12:23.631840 22528 raft_consensus.cc:1240] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:23.592744 28814 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:23.649170 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:23.549762 22347 catalog_manager.cc:5697] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:12:23.586035 22449 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
I20260709 12:12:23.652488 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:23.652369 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:23.655078 22532 raft_consensus.cc:1240] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:12:23.594511 28855 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:23.655615 22454 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:23.641012 22570 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:12:23.651686 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:23.659940 22448 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:23.660224 22525 raft_consensus.cc:1240] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 12:12:23.594913 28812 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:23.643193 28720 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.667027 22524 raft_consensus.cc:1275] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 12:12:23.563470 28862 consensus_queue.cc:237] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:23.671201 22524 pending_rounds.cc:85] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting all ops after (but not including) 11
I20260709 12:12:23.671485 22524 pending_rounds.cc:107] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 12:12:23.671736 22524 raft_consensus.cc:2889] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:23.636041 28838 raft_consensus.cc:697] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:23.651019 28893 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:23.654686 28861 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:23.643010 28826 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:23.682512 22450 raft_consensus.cc:1240] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:23.675069 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:23.667407 28551 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:23.667624 28825 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:23.694630 28814 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.663483 28682 raft_consensus.cc:697] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:23.694077 28893 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.717007 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:23.674674 28720 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:23.699568 28814 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:23.735047 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:23.726392 23118 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.009s	sys 0.017s
W20260709 12:12:23.736629 23118 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.009s	sys 0.017s
W20260709 12:12:23.752507 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:23.755685 22454 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 18.
I20260709 12:12:23.756948 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:23.757269 28185 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:23.758107 22449 raft_consensus.cc:2410] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 15 because replica has last-logged OpId of term: 13 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 12:12:23.758909 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:23.727692 28809 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 23 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:23.737174 28835 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.009s	sys 0.018s
I20260709 12:12:23.761646 22454 raft_consensus.cc:1240] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:23.765684 23117 raft_consensus.cc:2410] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 16 because replica has last-logged OpId of term: 15 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 14.
I20260709 12:12:23.773468 28929 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.773938 28930 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:12:23.774884 28932 log.cc:927] Time spent T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:12:23.775596 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:23.775840 28927 log.cc:927] Time spent T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:12:23.776573 28822 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:23.784168 28814 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:23.759596 28823 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 23 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:23.732937 28893 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:23.787398 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:23.731261 28551 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:23.770051 28871 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:23.812141 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:23.795843 22448 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 18.
W20260709 12:12:23.794095 28835 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.009s	sys 0.019s
W20260709 12:12:23.793989 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:23.857189 22449 raft_consensus.cc:1240] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
W20260709 12:12:23.859217 28745 consensus_meta.cc:287] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.834s	user 0.005s	sys 0.007s
I20260709 12:12:23.860070 28826 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:23.860832 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:23.883471 22605 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:12:23.861200 28830 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.863243 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:23.863983 28266 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.766568 22347 catalog_manager.cc:5697] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 11 to 14, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 14 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:23.864850 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:23.866943 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:23.867185 22421 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:12:23.868201 28933 log.cc:927] Time spent T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:12:23.868594 28855 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:23.868758 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:23.869539 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:23.824333 28480 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:23.870205 28812 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:23.871258 28825 raft_consensus.cc:2804] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:23.871898 28944 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:23.873040 28720 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:23.873663 28856 raft_consensus.cc:3055] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:23.873696 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:23.877565 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:23.878377 28928 log.cc:927] Time spent T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 12:12:23.839038 28929 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:23.837677 28682 consensus_queue.cc:237] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:23.881386 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:23.935613 23116 raft_consensus.cc:1275] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:12:23.935990 22455 raft_consensus.cc:1240] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:23.936707 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:23.927112 28856 raft_consensus.cc:740] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:23.795030 22597 raft_consensus.cc:1240] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:23.938616 28856 consensus_queue.cc:260] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:23.939152 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:23.939429 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:23.897075 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:23.940932 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:23.942241 22452 raft_consensus.cc:1240] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:23.941763 22347 catalog_manager.cc:5697] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 11 to 16. New cstate: current_term: 16 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
W20260709 12:12:23.943094 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:23.943295 28856 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:23.899078 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:23.943596 22347 catalog_manager.cc:5697] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:23.944780 22450 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 16.
I20260709 12:12:23.895757 23117 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 18.
I20260709 12:12:23.907642 22602 raft_consensus.cc:2393] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 23: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:23.945477 22347 catalog_manager.cc:5697] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 9 to 12, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 12 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:23.946363 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:23.946960 22602 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:23.948536 28929 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:23.909626 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:23.879829 28768 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.882128 28835 raft_consensus.cc:697] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:23.919514 22448 raft_consensus.cc:1240] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:23.903575 28266 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:23.921922 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 54874.4us
I20260709 12:12:23.922348 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:23.922544 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:23.963449 22599 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:23.923660 28944 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:23.925060 28551 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:23.925200 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:23.788318 28838 consensus_queue.cc:237] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:23.816352 28930 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:23.907763 28591 raft_consensus.cc:2749] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:23.937798 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:12:23.946789 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:23.951743 22495 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:23.939817 22597 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:12:23.953876 23124 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 16.
W20260709 12:12:23.957367 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:23.914078 28825 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:23.895920 28745 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:23.963439 23119 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:23.903340 28830 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:23.996740 22599 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
I20260709 12:12:23.992022 22495 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:23.964862 22605 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 19.
W20260709 12:12:23.986279 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:23.998490 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:23.958748 28768 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:24.001219 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 360350us
I20260709 12:12:23.965762 28658 raft_consensus.cc:697] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:24.013450 22422 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:23.969362 28551 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:24.002143 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:24.013899 22601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45576 (request call id 3360) took 1352 ms. Trace:
I20260709 12:12:24.042652 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:24.041945 22531 raft_consensus.cc:1240] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:24.067001 22455 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:24.044358 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:24.068089 22599 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 18.
I20260709 12:12:24.069064 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:24.069722 22599 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:24.021088 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:24.071527 22523 raft_consensus.cc:2393] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 13: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:24.042147 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:23.966487 28871 consensus_queue.cc:1059] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
W20260709 12:12:24.093394 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 95259.5us
I20260709 12:12:24.085345 22452 raft_consensus.cc:2393] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 23: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:24.080806 22601 rpcz_store.cc:276] 0709 12:12:22.645174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:22.646767 (+  1593us) service_pool.cc:224] Handling call
0709 12:12:23.991003 (+1344236us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b540013c254. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:23.997308 (+  6305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2897705472}
I20260709 12:12:24.050607 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:24.096952 22604 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 10.
I20260709 12:12:24.019165 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:24.015321 22497 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:23.995759 28823 raft_consensus.cc:2804] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:23.995968 28825 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:24.102965 22495 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:24.103650 22570 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:24.104151 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:24.113775 22604 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:24.097947 22453 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 18.
I20260709 12:12:24.047575 28867 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:24.108202 22602 raft_consensus.cc:2410] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:12:24.117887 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:24.118778 22602 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 18.
I20260709 12:12:24.014501 28822 raft_consensus.cc:2804] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:24.109006 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:12:24.123816 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 108614us
I20260709 12:12:23.996011 28864 consensus_queue.cc:1059] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.113s
I20260709 12:12:24.143860 28893 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:24.095208 28558 consensus_queue.cc:1059] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 12:12:24.144716 28946 raft_consensus.cc:3055] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:24.145697 28768 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:24.099818 28812 raft_consensus.cc:2804] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:24.148479 22421 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:24.174714 22421 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:12:24.176803 28940 log.cc:927] Time spent T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
W20260709 12:12:24.179922 28952 log.cc:927] Time spent T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 12:12:24.182080 28959 log.cc:927] Time spent T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:12:24.149328 22605 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:24.152169 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 66817.8us
W20260709 12:12:24.152437 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 49592.1us
I20260709 12:12:24.115249 28591 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:24.184508 22497 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:24.190546 22497 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:24.158349 22599 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 19.
I20260709 12:12:24.163583 28814 raft_consensus.cc:2749] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:12:24.164222 28822 raft_consensus.cc:697] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:24.164716 28624 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:24.165558 28864 raft_consensus.cc:3055] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:24.167344 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:24.155596 22569 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:24.114504 28720 consensus_queue.cc:1048] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.052s
I20260709 12:12:24.160064 28946 raft_consensus.cc:740] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:24.142783 28947 raft_consensus.cc:2804] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:24.142520 28929 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:24.237746 28929 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:24.243932 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 148461us
I20260709 12:12:24.244971 22570 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:24.246484 22570 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:24.139655 28835 consensus_queue.cc:237] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:24.247665 28930 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:24.248262 28930 raft_consensus.cc:2749] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:24.191628 22497 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:24.250444 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 58922.5us
I20260709 12:12:24.122215 28551 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:24.253036 28551 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:24.254278 28551 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:24.255239 28941 raft_consensus.cc:2749] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:24.256927 28947 raft_consensus.cc:697] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:24.257551 22604 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 19.
I20260709 12:12:24.240379 28929 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:24.254798 28551 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:24.261842 28944 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:24.262279 28551 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:23.996444 22347 catalog_manager.cc:5697] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:12:24.263577 28862 consensus_queue.cc:1059] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:24.193529 28620 raft_consensus.cc:2749] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:24.264418 22347 catalog_manager.cc:5697] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 12 to 14, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 14 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:24.266487 28822 consensus_queue.cc:237] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:24.273859 22597 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 18.
I20260709 12:12:24.275019 22497 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:24.275523 28266 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:24.276314 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:24.277321 28830 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:24.277612 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:24.278249 22604 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 17.
I20260709 12:12:24.217825 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:24.188987 28958 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:24.235116 28658 consensus_queue.cc:237] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:24.236073 22422 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:24.149631 28867 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:24.302515 22455 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
I20260709 12:12:24.260242 28941 consensus_queue.cc:1059] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:12:24.305769 22452 raft_consensus.cc:1275] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:12:24.307063 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:24.307404 28941 raft_consensus.cc:3055] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:24.307938 28941 raft_consensus.cc:740] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:24.308148 22453 raft_consensus.cc:2410] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 12:12:24.309057 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:24.260450 22496 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
W20260709 12:12:24.310600 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 50223.7us
I20260709 12:12:24.312211 28945 raft_consensus.cc:2749] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:24.313266 28745 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:24.314009 28809 raft_consensus.cc:3055] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:24.183517 28812 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:24.314639 28809 raft_consensus.cc:740] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:24.314960 28812 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:24.315793 28809 consensus_queue.cc:260] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:24.276253 28266 raft_consensus.cc:2804] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:24.172956 28823 raft_consensus.cc:697] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:24.318852 28266 raft_consensus.cc:697] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:24.319877 28266 consensus_queue.cc:237] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:24.319927 28823 consensus_queue.cc:237] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:24.325302 28867 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:24.268692 28624 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:24.192164 28763 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:24.269958 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:24.270088 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 114552us
I20260709 12:12:24.270709 28929 raft_consensus.cc:2804] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:24.267453 28944 raft_consensus.cc:2749] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:24.234933 22451 raft_consensus.cc:1240] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 16 LEADER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:24.278946 22600 raft_consensus.cc:2393] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 23: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:24.195075 28687 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:24.208099 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:24.382820 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:24.383392 22599 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:24.226996 28864 raft_consensus.cc:740] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:24.279735 22570 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:24.285748 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:24.287046 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:24.289671 22497 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:24.294325 23121 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 17.
I20260709 12:12:24.385392 23119 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 19.
I20260709 12:12:24.237085 28955 raft_consensus.cc:3055] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:24.330593 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:24.340232 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 104246us
I20260709 12:12:24.194741 28185 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:24.193771 28861 raft_consensus.cc:2749] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:24.339962 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 388570us
I20260709 12:12:24.383311 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:24.400763 22453 pending_rounds.cc:85] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f: Aborting all ops after (but not including) 9
I20260709 12:12:24.401141 22453 pending_rounds.cc:107] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 12:12:24.401422 22453 raft_consensus.cc:2889] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:24.381817 28687 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:24.396108 22523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56940 (request call id 2615) took 1163 ms. Trace:
I20260709 12:12:24.393930 22422 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:24.397430 22605 raft_consensus.cc:2468] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 14.
I20260709 12:12:24.399906 28838 raft_consensus.cc:2804] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:24.404068 22523 rpcz_store.cc:276] 0709 12:12:23.219846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:23.226489 (+  6643us) service_pool.cc:224] Handling call
0709 12:12:24.382845 (+1156356us) spinlock_profiling.cc:243] Waited 820 ms on lock 0x7b5400263754. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:24.382968 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1885440000}
I20260709 12:12:24.446226 28838 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:24.193795 28962 consensus_queue.cc:1059] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.211s
I20260709 12:12:24.446776 28838 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:24.457471 22604 raft_consensus.cc:1240] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 17. Current term is 18. Ops: []
W20260709 12:12:24.460122 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 180487us
I20260709 12:12:24.195712 28591 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:24.473489 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:24.473277 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 62032.2us
I20260709 12:12:24.384794 28826 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:24.489308 22605 raft_consensus.cc:1240] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 12:12:24.494293 22599 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 18.
W20260709 12:12:24.495355 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:24.495370 22601 raft_consensus.cc:1240] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:12:24.402061 28929 raft_consensus.cc:697] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 12 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:24.396848 28955 raft_consensus.cc:740] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:24.524133 22600 raft_consensus.cc:1240] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 12:12:24.524466 22448 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 16.
W20260709 12:12:24.482452 28939 log.cc:927] Time spent T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:12:24.408967 28893 raft_consensus.cc:2749] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:24.455958 28687 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:24.519125 22570 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:24.528523 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:24.455509 28185 raft_consensus.cc:697] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:24.531685 23089 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:24.384565 28763 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:24.396057 28558 consensus_queue.cc:1059] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.128s
I20260709 12:12:24.501026 28861 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:24.603953 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:24.612386 22531 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 13.
I20260709 12:12:24.297969 28958 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:24.484071 28962 raft_consensus.cc:3055] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:24.618932 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:24.667057 23090 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.002s	sys 0.066s
W20260709 12:12:24.674181 23090 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.003s	sys 0.067s
W20260709 12:12:24.674696 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:24.518891 28930 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:24.639472 22527 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56940 (request call id 2621) took 1417 ms (client timeout 1707 ms). Trace:
I20260709 12:12:24.287837 22347 catalog_manager.cc:5697] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:24.677959 28480 raft_consensus.cc:3055] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:24.644356 22451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 1234) took 1127 ms. Trace:
I20260709 12:12:24.678479 28480 raft_consensus.cc:740] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:24.678678 22451 rpcz_store.cc:276] 0709 12:12:23.478225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:23.533521 (+ 55296us) service_pool.cc:224] Handling call
0709 12:12:23.533882 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:24.392281 (+858399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:24.605197 (+212916us) spinlock_profiling.cc:243] Waited 699 ms on lock 0x7b54003f48d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:24.605407 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1608371712}
I20260709 12:12:24.675696 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:24.679697 28480 consensus_queue.cc:260] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:24.681080 28480 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:24.681602 22597 raft_consensus.cc:1240] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
W20260709 12:12:24.683358 22527 rpcz_store.cc:269] 0709 12:12:23.221800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:23.221931 (+   131us) service_pool.cc:224] Handling call
0709 12:12:24.609723 (+1387792us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54001f2054. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:24.639392 (+ 29669us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2704368512}
W20260709 12:12:24.643774 22598 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.004s	sys 0.008s
W20260709 12:12:24.691313 22598 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.005s	sys 0.008s
I20260709 12:12:24.691985 22602 raft_consensus.cc:1240] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 18. Current term is 19. Ops: [16.13-18.14]
I20260709 12:12:24.677752 28930 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:24.660602 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:24.695730 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:24.674813 28962 raft_consensus.cc:740] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:24.587611 28768 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:24.671398 28591 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:24.501688 28826 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:24.257912 28947 consensus_queue.cc:237] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:24.309043 28941 consensus_queue.cc:260] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:24.524716 28856 consensus_queue.cc:1059] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.169s
I20260709 12:12:24.784570 22449 raft_consensus.cc:1275] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 12:12:24.750860 22601 raft_consensus.cc:1275] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:24.785928 22605 raft_consensus.cc:1240] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 12:12:24.746762 23088 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:24.619800 28861 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:24.525988 28701 consensus_queue.cc:1059] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.180s
W20260709 12:12:24.749567 23122 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.004s	sys 0.019s
W20260709 12:12:24.754525 22421 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.021s	sys 0.056s
W20260709 12:12:24.804584 22421 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.022s	sys 0.056s
W20260709 12:12:24.804934 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 594754us
I20260709 12:12:24.776705 22451 raft_consensus.cc:1240] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:12:24.276400 28946 consensus_queue.cc:260] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:24.699750 28935 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.027s	sys 0.050s
W20260709 12:12:24.762001 22496 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.196.132:44353 timed out after 1.789s (SENT) [suppressed 17 similar messages]
W20260709 12:12:24.811586 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 49632us
I20260709 12:12:24.751956 22602 raft_consensus.cc:1240] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 13. Current term is 14. Ops: [11.9-13.10]
W20260709 12:12:24.816341 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 284738us
W20260709 12:12:24.806849 23122 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.004s	sys 0.019s
I20260709 12:12:24.807384 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:24.817652 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:12:24.809247 23087 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.040s	sys 0.045s
I20260709 12:12:24.818931 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:12:24.819247 23087 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.040s	sys 0.045s
I20260709 12:12:24.819376 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:24.819686 23124 raft_consensus.cc:2393] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 14: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:24.820266 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:24.820972 23119 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 10.
W20260709 12:12:24.824918 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:24.775542 28830 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:24.605535 28864 consensus_queue.cc:260] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:24.828877 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:24.831962 22421 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:24.781723 28822 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:24.785372 28591 raft_consensus.cc:2804] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:24.785033 28179 raft_consensus.cc:2749] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:12:24.811146 28935 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.027s	sys 0.050s
I20260709 12:12:24.804322 28929 consensus_queue.cc:237] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:24.833485 28956 consensus_queue.cc:1048] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:12:24.834028 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:24.803895 28861 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:24.835626 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:24.834519 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:24.837224 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:12:24.825919 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:24.833287 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 439262us
I20260709 12:12:24.904089 23116 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:24.872913 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:12:24.812590 28942 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.009s	sys 0.014s
I20260709 12:12:24.872902 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:12:24.815496 28835 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.007s	sys 0.017s
W20260709 12:12:24.901521 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 69661.1us
I20260709 12:12:24.909060 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:24.909808 23119 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 18.
W20260709 12:12:24.876437 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 475332us
I20260709 12:12:24.777130 28768 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:24.837628 28825 consensus_meta.cc:287] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.676s	user 0.008s	sys 0.003s
I20260709 12:12:24.903272 23118 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 12.
I20260709 12:12:24.903451 23120 raft_consensus.cc:2376] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 16. Re-sending same reply.
I20260709 12:12:24.905294 22422 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:24.823729 28954 raft_consensus.cc:2749] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:24.834954 28745 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:24.913473 23123 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 17.
W20260709 12:12:24.916656 22456 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.027s	sys 0.026s
W20260709 12:12:24.914310 28942 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.010s	sys 0.020s
I20260709 12:12:24.916977 28551 raft_consensus.cc:3055] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:12:24.912458 28835 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.008s	sys 0.025s
I20260709 12:12:24.678484 22347 catalog_manager.cc:5697] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 8 to 16, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 16 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:12:24.923779 22530 raft_consensus.cc:1275] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:24.833089 28620 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:24.874909 28591 raft_consensus.cc:697] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:24.901209 28864 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:24.921675 22456 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.027s	sys 0.026s
I20260709 12:12:24.908950 28830 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:24.925798 22497 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.003s	sys 0.015s
W20260709 12:12:24.947253 22497 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.003s	sys 0.015s
I20260709 12:12:24.918634 22569 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:24.937738 22422 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:24.912334 28624 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:24.916653 28179 raft_consensus.cc:2804] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:24.949697 28179 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:24.950145 28179 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:24.950805 28960 log.cc:927] Time spent T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.363s	user 0.000s	sys 0.001s
W20260709 12:12:24.953305 28969 log.cc:927] Time spent T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:12:24.954931 28945 consensus_queue.cc:1048] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:12:24.926350 28551 raft_consensus.cc:740] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:24.958817 28551 consensus_queue.cc:260] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:24.960330 28551 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:24.909216 28856 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:24.962073 28856 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:24.920393 28825 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:24.964310 28856 leader_election.cc:290] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:24.965643 28825 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:24.967049 23125 consensus_meta.cc:287] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.625s	user 0.007s	sys 0.003s
I20260709 12:12:24.967417 23125 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 16.
I20260709 12:12:24.945604 28620 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:24.978889 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 60467.4us
I20260709 12:12:24.979790 22457 raft_consensus.cc:2410] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:12:24.980823 23089 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:24.975435 28179 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:24.900496 28822 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:24.977672 23116 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 16.
I20260709 12:12:24.983503 23089 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:24.927767 28981 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:24.930225 28745 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:25.086161 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 102773us
I20260709 12:12:24.978564 28825 raft_consensus.cc:2804] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:24.991309 22598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2950) took 1730 ms. Trace:
W20260709 12:12:24.948597 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 658967us
W20260709 12:12:25.006788 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 259879us
I20260709 12:12:25.009002 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:25.057016 22495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:25.105967 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:25.106659 22601 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 12.
W20260709 12:12:25.106884 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:25.107738 22599 raft_consensus.cc:1275] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:12:25.095333 22598 rpcz_store.cc:276] 0709 12:12:23.261136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:23.263540 (+  2404us) service_pool.cc:224] Handling call
0709 12:12:23.293269 (+ 29729us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:23.678892 (+385623us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:23.678921 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:23.694715 (+ 15794us) log.cc:844] Serialized 52 byte log entry
0709 12:12:24.079243 (+384528us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:24.691668 (+612425us) log.cc:844] Serialized 14 byte log entry
0709 12:12:24.943648 (+251980us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:24.943763 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:24.984853 (+ 41090us) raft_consensus.cc:1685] finished
0709 12:12:24.984878 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:24.991225 (+  6347us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5869,"prepare.queue_time_us":175009,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":458440,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":43849,"thread_start_us":1562285,"threads_started":4,"wal-append.queue_time_us":686703}
I20260709 12:12:24.871155 28185 consensus_queue.cc:237] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:25.121183 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:25.127897 23089 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:25.004424 28968 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:25.130951 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 670107us
W20260709 12:12:25.133244 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 207984us
W20260709 12:12:25.108786 28971 log.cc:927] Time spent T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
W20260709 12:12:25.108882 28976 log.cc:927] Time spent T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.308s	user 0.000s	sys 0.001s
I20260709 12:12:25.141429 22570 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:12:25.121738 28965 log.cc:927] Time spent T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.307s	user 0.001s	sys 0.000s
I20260709 12:12:25.104159 28825 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:25.127174 28975 log.cc:927] Time spent T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.426s	user 0.001s	sys 0.000s
I20260709 12:12:25.099635 28944 raft_consensus.cc:2749] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:25.149366 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 50069.4us
I20260709 12:12:25.087287 28856 raft_consensus.cc:2749] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:25.108140 28720 raft_consensus.cc:2804] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:12:25.167737 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 230073us
I20260709 12:12:25.175668 23122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 1442) took 1385 ms. Trace:
I20260709 12:12:25.165859 22570 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:25.181164 22422 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:25.147584 28958 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:25.150496 28620 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:25.163272 28825 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:25.094445 28981 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:25.126171 28945 consensus_queue.cc:1048] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 12:12:25.130007 28701 consensus_queue.cc:1059] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
W20260709 12:12:25.224346 28983 log.cc:927] Time spent T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.136s	user 0.000s	sys 0.003s
I20260709 12:12:25.224992 28701 consensus_queue.cc:1059] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:25.225736 28701 consensus_queue.cc:1243] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer 6c6fa11e8ee34711b3551f0c670442bc log is divergent from this leader: its last log entry 17.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
W20260709 12:12:25.226177 22572 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.003s	sys 0.014s
W20260709 12:12:25.226487 22572 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.003s	sys 0.014s
I20260709 12:12:25.227738 22604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3394) took 1276 ms. Trace:
I20260709 12:12:25.164180 28930 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:25.178735 23122 rpcz_store.cc:276] 0709 12:12:23.766222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:23.766338 (+   116us) service_pool.cc:224] Handling call
0709 12:12:23.766609 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:23.788033 (+ 21424us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:23.967141 (+179108us) log.cc:844] Serialized 14 byte log entry
0709 12:12:25.139912 (+1172771us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:25.139982 (+    70us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:25.147654 (+  7672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:25.147749 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:25.147898 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24642,"prepare.queue_time_us":468266,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":125382,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":113254,"thread_start_us":1220223,"threads_started":3,"wal-append.queue_time_us":935846}
W20260709 12:12:25.222321 28967 log.cc:927] Time spent T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.262s	user 0.000s	sys 0.000s
I20260709 12:12:25.222505 23116 raft_consensus.cc:3055] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:25.234450 23116 raft_consensus.cc:740] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:25.223346 28768 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:25.228103 22604 rpcz_store.cc:276] 0709 12:12:23.951379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:24.481733 (+530354us) service_pool.cc:224] Handling call
0709 12:12:24.482057 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:24.748980 (+266923us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:24.749032 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:24.749097 (+    65us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:24.749149 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:25.227528 (+478379us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b5400044054. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:25.227573 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:25.227687 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":613289728}
I20260709 12:12:25.165174 28973 raft_consensus.cc:2749] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:25.183301 28720 raft_consensus.cc:697] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 19 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:25.258080 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:25.236336 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 132909us
I20260709 12:12:25.148275 28968 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:25.266782 22599 raft_consensus.cc:1240] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:25.274950 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:25.228343 28995 raft_consensus.cc:2804] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:25.283444 22606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3383) took 1494 ms. Trace:
W20260709 12:12:25.252005 28971 log.cc:927] Time spent T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 12:12:25.275120 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 127923us
I20260709 12:12:25.277864 22602 raft_consensus.cc:1240] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
W20260709 12:12:25.281239 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:25.282382 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:25.276958 23117 raft_consensus.cc:1275] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:25.287268 23116 consensus_queue.cc:260] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:25.296408 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:25.306202 23116 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:25.306866 28984 log.cc:927] Time spent T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.185s	user 0.000s	sys 0.000s
I20260709 12:12:25.308373 29001 raft_consensus.cc:2749] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:25.309489 29001 raft_consensus.cc:3055] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:25.309954 29001 raft_consensus.cc:740] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
W20260709 12:12:25.311373 22421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:25.311211 28972 consensus_queue.cc:1059] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.166s
I20260709 12:12:25.312091 28942 raft_consensus.cc:2804] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:25.312647 28942 raft_consensus.cc:697] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 18 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
W20260709 12:12:25.312798 28980 log.cc:927] Time spent T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 12:12:25.200536 28591 consensus_queue.cc:237] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:25.313602 28942 consensus_queue.cc:237] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:25.296774 28977 log.cc:927] Time spent T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 12:12:25.288669 28989 raft_consensus.cc:2749] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:25.318123 28978 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:25.318918 28978 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:25.320753 28999 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:25.320873 28955 consensus_queue.cc:260] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:25.321354 28999 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:25.322034 28955 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:25.318462 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:25.323834 22570 connection.cc:256] RPC call timeout handler was delayed by -1.1643491770000765s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1592s for a response
W20260709 12:12:25.324256 22570 connection.cc:256] RPC call timeout handler was delayed by -1.1301491770000212s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.163s for a response
W20260709 12:12:25.324584 22570 connection.cc:256] RPC call timeout handler was delayed by -1.1049491770002078s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1658s for a response
I20260709 12:12:25.325222 22570 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:25.326670 28930 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:25.329427 28930 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:25.327289 28658 raft_consensus.cc:2749] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:25.331086 29012 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:25.331604 29012 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:25.332306 22603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2951) took 2070 ms. Trace:
I20260709 12:12:25.333560 29012 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:25.316402 28962 consensus_queue.cc:260] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:25.335577 28962 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:25.207122 22347 catalog_manager.cc:5697] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:25.338575 22530 raft_consensus.cc:1240] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 LEADER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:25.322674 28994 raft_consensus.cc:2804] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:25.216792 28856 consensus_queue.cc:1048] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 12:12:25.339428 28994 raft_consensus.cc:697] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:25.340781 28856 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:25.340466 28994 consensus_queue.cc:237] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:25.341400 28856 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:25.342356 28763 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:25.339445 28809 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:25.334147 28720 consensus_queue.cc:237] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:25.344408 28176 raft_consensus.cc:3055] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:25.344851 28176 raft_consensus.cc:740] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:25.321938 28978 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:25.328812 22570 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:25.349357 23116 raft_consensus.cc:1275] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 12:12:25.353543 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 173521us
I20260709 12:12:25.283828 22606 rpcz_store.cc:276] 0709 12:12:23.789361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:23.789477 (+   116us) service_pool.cc:224] Handling call
0709 12:12:23.789757 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:23.968227 (+178470us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:23.968256 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:23.982913 (+ 14657us) log.cc:844] Serialized 26 byte log entry
0709 12:12:24.383076 (+400163us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:24.383137 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:24.383226 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:25.283235 (+900009us) raft_consensus.cc:1685] finished
0709 12:12:25.283255 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:25.283373 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":153764,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"thread_start_us":512543,"threads_started":2,"wal-append.queue_time_us":581487}
I20260709 12:12:25.312727 22421 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:25.337985 22347 catalog_manager.cc:5697] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 13 to 17, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 17 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:25.332821 22603 rpcz_store.cc:276] 0709 12:12:23.261454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:23.286090 (+ 24636us) service_pool.cc:224] Handling call
0709 12:12:23.295873 (+  9783us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:23.679872 (+383999us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:12:23.984587 (+304715us) log.cc:844] Serialized 14 byte log entry
0709 12:12:24.992158 (+1007571us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:25.098791 (+106633us) log.cc:844] Serialized 26 byte log entry
0709 12:12:25.098954 (+   163us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:12:25.099007 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:25.099082 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:25.332031 (+232949us) raft_consensus.cc:1685] finished
0709 12:12:25.332063 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:25.332230 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62564,"prepare.queue_time_us":448123,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":529232,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":16468,"thread_start_us":1517281,"threads_started":4,"wal-append.queue_time_us":766417}
W20260709 12:12:25.326905 28985 log.cc:927] Time spent T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.371s	user 0.000s	sys 0.001s
W20260709 12:12:25.393534 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 64783.5us
I20260709 12:12:25.394575 22570 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:25.232897 29003 consensus_queue.cc:1059] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.129s
I20260709 12:12:25.310572 28551 consensus_queue.cc:1059] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:12:25.283382 28995 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:25.271292 29015 raft_consensus.cc:2804] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:25.404491 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:25.312739 28972 raft_consensus.cc:3055] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:25.409472 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:25.412883 22454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 3129) took 1853 ms. Trace:
I20260709 12:12:25.413213 22526 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 17.
I20260709 12:12:25.415457 22570 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:25.413331 22454 rpcz_store.cc:276] 0709 12:12:23.559043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:23.819975 (+260932us) service_pool.cc:224] Handling call
0709 12:12:23.841137 (+ 21162us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:23.897230 (+ 56093us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:23.897260 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:23.912707 (+ 15447us) log.cc:844] Serialized 26 byte log entry
0709 12:12:24.173837 (+261130us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:24.173878 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:24.173945 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:25.412684 (+1238739us) raft_consensus.cc:1685] finished
0709 12:12:25.412705 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:25.412830 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23275,"raft.queue_time_us":38641,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":22645,"thread_start_us":214057,"threads_started":1,"wal-append.queue_time_us":767300}
I20260709 12:12:25.452438 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:25.453107 22531 raft_consensus.cc:1240] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 LEADER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 12:12:25.454478 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:25.455271 22527 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:25.459200 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 146571us
W20260709 12:12:25.459324 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 104252us
I20260709 12:12:25.460361 22496 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:25.408717 28558 raft_consensus.cc:2749] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:25.417760 28838 consensus_meta.cc:287] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.970s	user 0.011s	sys 0.000s
I20260709 12:12:25.396136 29002 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:25.410159 28978 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:25.416442 28972 raft_consensus.cc:740] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
W20260709 12:12:25.491346 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 284560us
I20260709 12:12:25.498819 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:25.467903 28930 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:25.415304 28995 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:25.500118 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 84740.5us
W20260709 12:12:25.504385 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 44106.2us
I20260709 12:12:25.411783 28830 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:25.452250 29015 raft_consensus.cc:697] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:25.501204 29003 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:25.463845 28958 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:25.415611 28179 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:25.499430 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:25.489425 28929 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.005s	sys 0.014s
W20260709 12:12:25.516678 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:25.345718 28176 consensus_queue.cc:260] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:25.513424 23117 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 16.
I20260709 12:12:25.491616 28745 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:25.533692 22570 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:25.544039 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:25.535522 23118 raft_consensus.cc:3055] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:25.549306 23116 raft_consensus.cc:2410] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
W20260709 12:12:25.505553 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 264936us
W20260709 12:12:25.550364 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 137749us
W20260709 12:12:25.542869 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:25.553714 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:25.549232 23118 raft_consensus.cc:740] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:25.554883 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:25.555714 22606 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
I20260709 12:12:25.552575 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:25.543725 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:25.557147 22603 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 18.
I20260709 12:12:25.561635 23088 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:12:25.545900 28929 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.006s	sys 0.014s
I20260709 12:12:25.564103 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:25.568852 23124 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 16.
I20260709 12:12:25.564311 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:25.540899 29003 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:25.565554 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:25.550436 29004 raft_consensus.cc:2749] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:25.566104 22570 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:12:25.569896 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:25.571296 23118 consensus_queue.cc:260] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:25.571926 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:25.507743 28838 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:25.540292 29007 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:25.396132 29001 consensus_queue.cc:260] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:25.541117 28958 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:25.581573 23124 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 10.
W20260709 12:12:25.585495 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 51051.5us
I20260709 12:12:25.590322 23120 raft_consensus.cc:1240] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 14 LEADER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:12:25.603941 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:25.566085 28944 raft_consensus.cc:2749] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:25.509408 29002 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:25.581480 28551 consensus_queue.cc:1243] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer 6c6fa11e8ee34711b3551f0c670442bc log is divergent from this leader: its last log entry 12.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:12:25.613544 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:25.614354 23124 raft_consensus.cc:2410] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 12:12:25.602447 28958 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:25.617511 22421 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
W20260709 12:12:25.619693 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 95037.5us
I20260709 12:12:25.620842 22421 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:25.606485 28930 raft_consensus.cc:2804] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:25.628332 28930 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:12:25.628454 29013 log.cc:927] Time spent T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:12:25.628823 28930 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:25.629827 23118 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:25.632156 29003 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:25.599822 28981 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:25.621268 29032 raft_consensus.cc:2804] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:25.616364 29005 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:25.606124 28993 raft_consensus.cc:2749] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:25.624166 28998 log.cc:927] Time spent T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 12:12:25.624809 28996 log.cc:927] Time spent T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 12:12:25.625255 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 59224us
I20260709 12:12:25.618005 28176 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:25.627081 28968 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317)
I20260709 12:12:25.627136 29015 consensus_queue.cc:237] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:25.627017 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:25.623600 22421 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:25.623557 22496 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:25.626731 28826 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:25.610718 28856 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:25.645215 29032 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:25.611352 28480 consensus_queue.cc:1059] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 12:12:25.582317 28991 consensus_queue.cc:1059] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.237s
I20260709 12:12:25.618199 29001 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:25.616614 28591 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:25.610334 28936 consensus_queue.cc:1048] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.235s
W20260709 12:12:25.623973 29022 log.cc:927] Time spent T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
W20260709 12:12:25.649443 28812 consensus_meta.cc:287] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 1.334s	user 0.006s	sys 0.007s
I20260709 12:12:25.668116 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:25.671295 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 93513us
I20260709 12:12:25.674716 28988 consensus_queue.cc:1048] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:25.676815 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:25.679234 22570 leader_election.cc:400] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 18. Current term is 19.
I20260709 12:12:25.683128 22570 leader_election.cc:403] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:25.677317 29023 raft_consensus.cc:2764] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:12:25.609041 29007 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:25.685920 22453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 3144) took 1351 ms. Trace:
I20260709 12:12:25.624174 29028 consensus_queue.cc:1059] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
I20260709 12:12:25.670203 29032 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:25.615260 28972 consensus_queue.cc:260] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:25.687748 22453 rpcz_store.cc:276] 0709 12:12:24.334162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:24.344607 (+ 10445us) service_pool.cc:224] Handling call
0709 12:12:24.400568 (+ 55961us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:24.455890 (+ 55322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:24.455936 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:24.474076 (+ 18140us) log.cc:844] Serialized 26 byte log entry
0709 12:12:24.910739 (+436663us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:24.910796 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:24.910885 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:25.685704 (+774819us) raft_consensus.cc:1685] finished
0709 12:12:25.685726 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:25.685858 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":305451,"threads_started":1,"wal-append.queue_time_us":928860}
I20260709 12:12:25.694042 29034 raft_consensus.cc:3055] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:25.648715 28825 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:25.583230 22347 catalog_manager.cc:5697] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:25.663887 28944 consensus_queue.cc:1048] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 12:12:25.651079 29005 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:25.700678 28993 raft_consensus.cc:2749] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 18. Current term is 19.
I20260709 12:12:25.701237 28838 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:25.703023 29034 raft_consensus.cc:740] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:25.679781 28591 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:25.722307 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 97845.5us
I20260709 12:12:25.718284 22527 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 14.
I20260709 12:12:25.699918 23118 raft_consensus.cc:1275] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 12:12:25.748521 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:25.696889 28864 consensus_meta.cc:287] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.731s	user 0.009s	sys 0.003s
W20260709 12:12:25.811160 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 145966us
I20260709 12:12:25.815011 22603 raft_consensus.cc:2393] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 17: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:25.816906 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:25.817942 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:12:25.819749 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:25.724948 29033 log.cc:927] Time spent T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:12:25.697156 28990 raft_consensus.cc:2749] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:25.724363 28988 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:25.824827 23122 raft_consensus.cc:1275] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:25.826320 23123 raft_consensus.cc:2410] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 19 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 12:12:25.826643 23119 raft_consensus.cc:2393] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 11: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:25.699532 29028 consensus_queue.cc:1243] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer 1676e7af5e4a47cb86ee7db83e3d4881 log is divergent from this leader: its last log entry 18.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:12:25.827958 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:25.828500 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:25.838974 22526 raft_consensus.cc:2368] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 12. Current term is 13.
I20260709 12:12:25.830832 23124 raft_consensus.cc:1275] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
W20260709 12:12:25.709369 28861 consensus_meta.cc:287] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.785s	user 0.007s	sys 0.003s
I20260709 12:12:25.873873 28861 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:25.716675 29007 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:25.718875 28972 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:25.840914 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:25.875501 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:25.876354 22524 raft_consensus.cc:2368] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 17. Current term is 18.
I20260709 12:12:25.876698 28987 raft_consensus.cc:3055] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:25.877079 28987 raft_consensus.cc:740] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:25.841198 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:25.841621 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:25.683346 28812 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:25.845367 28687 consensus_meta.cc:287] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 1.146s	user 0.010s	sys 0.002s
I20260709 12:12:25.840961 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:25.895195 23116 raft_consensus.cc:2376] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 17. Re-sending same reply.
W20260709 12:12:25.853653 28809 consensus_meta.cc:287] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.510s	user 0.004s	sys 0.004s
I20260709 12:12:25.855791 28978 raft_consensus.cc:2749] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:25.857342 28930 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:25.743171 28995 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:25.861236 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:25.840914 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:25.838176 29037 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:25.906752 22530 raft_consensus.cc:2393] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 23: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:25.864527 28591 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:25.874315 23120 raft_consensus.cc:3055] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:25.842279 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:25.878844 22525 raft_consensus.cc:2410] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
W20260709 12:12:25.879472 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 255927us
I20260709 12:12:25.913367 23123 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:25.883746 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:25.887001 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 55876.5us
I20260709 12:12:25.864028 28958 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:25.912761 23120 raft_consensus.cc:740] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:25.882050 29002 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:25.916692 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:25.903407 22450 raft_consensus.cc:2393] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 13: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:25.921422 22421 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:25.929272 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:25.917766 23120 consensus_queue.cc:260] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:25.964932 22570 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:25.966001 22598 raft_consensus.cc:1240] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:25.968263 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:25.969002 22526 raft_consensus.cc:2393] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 16: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:25.974598 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:25.974871 23117 raft_consensus.cc:1275] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:12:25.975327 22525 raft_consensus.cc:2393] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 23: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:25.978128 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:25.981947 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 57473.5us
I20260709 12:12:25.900454 28687 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:25.996897 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:25.982661 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:25.997556 22449 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 17.
I20260709 12:12:25.998039 22526 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 10.
W20260709 12:12:25.997104 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 72670.7us
I20260709 12:12:26.002203 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:26.003265 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:26.002843 22525 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 18.
I20260709 12:12:26.005554 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:26.003798 22453 raft_consensus.cc:2376] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 19. Re-sending same reply.
I20260709 12:12:26.003818 28929 raft_consensus.cc:2749] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:26.019110 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:26.022739 22456 raft_consensus.cc:1275] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:12:25.977835 28994 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:26.024168 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:26.020530 22526 raft_consensus.cc:1275] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:12:26.022132 22532 raft_consensus.cc:2393] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 19: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:26.022841 22530 raft_consensus.cc:2410] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 12:12:25.920822 28862 consensus_queue.cc:1048] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.079s
I20260709 12:12:25.967775 28978 consensus_queue.cc:1048] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.042s
I20260709 12:12:25.877874 28987 consensus_queue.cc:260] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:26.029737 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:26.032253 22526 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 18.
I20260709 12:12:26.038691 22526 raft_consensus.cc:1275] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 12:12:26.039055 22526 pending_rounds.cc:85] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting all ops after (but not including) 11
I20260709 12:12:26.039276 22526 pending_rounds.cc:107] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 12:12:26.039503 22526 raft_consensus.cc:2889] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:26.042908 29015 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.043478 29015 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:26.045686 29015 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:26.046288 23125 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57332 (request call id 1449) took 2179 ms (client timeout 1571 ms). Trace:
I20260709 12:12:26.046377 29035 consensus_queue.cc:1048] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.042s
W20260709 12:12:26.046828 23125 rpcz_store.cc:269] 0709 12:12:23.860885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:23.939151 (+ 78266us) service_pool.cc:224] Handling call
0709 12:12:26.040375 (+2101224us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b54004e4154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:26.040479 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":896121728}
I20260709 12:12:26.047427 28958 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:12:26.048566 29039 log.cc:927] Time spent T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:12:25.916589 29037 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:26.048466 28987 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:26.053056 22530 raft_consensus.cc:1275] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:12:26.054061 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:26.056680 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:26.057379 22526 raft_consensus.cc:2393] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 17: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:25.983682 22347 catalog_manager.cc:5697] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 10 to 14, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 14 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:26.061443 22347 catalog_manager.cc:5697] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 11 to 13, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 13 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
W20260709 12:12:26.051599 29009 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 12:12:26.064006 23122 raft_consensus.cc:2410] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:12:26.064141 28958 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:26.064746 28958 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:26.065546 28825 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:26.065482 29046 consensus_queue.cc:1048] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.084s
I20260709 12:12:26.067384 28930 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:25.998247 29034 consensus_queue.cc:260] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:26.070389 28946 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:26.075557 29044 log.cc:927] Time spent T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:12:26.051657 29016 raft_consensus.cc:2804] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:26.076186 29016 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:26.076545 29016 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:26.077252 29045 log.cc:927] Time spent T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:12:26.078063 28999 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:26.079874 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:26.080750 29037 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:26.081240 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:26.081792 22601 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:26.082499 23118 raft_consensus.cc:1275] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:12:26.046527 28961 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.093312 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:26.094870 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:12:26.058465 28955 consensus_meta.cc:287] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.736s	user 0.004s	sys 0.008s
I20260709 12:12:26.097774 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:26.099349 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:26.110634 22527 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 16.
I20260709 12:12:26.099268 28961 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:26.116916 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:26.118723 28961 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:26.028474 28994 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:26.123512 23117 raft_consensus.cc:1275] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:12:26.124240 28994 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:26.124280 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:26.125347 28995 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:26.126154 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:26.127435 23089 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:26.110311 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:26.129575 22497 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:26.066823 28958 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:26.130412 22497 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:26.131125 28973 raft_consensus.cc:2749] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:26.124336 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:26.131558 22600 raft_consensus.cc:1275] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 12:12:26.106331 28687 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:26.131971 22604 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:26.092715 28988 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:26.132771 28988 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:26.133837 22421 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:26.134856 28809 raft_consensus.cc:2749] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:12:26.135505 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:26.109577 22495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:26.131943 22600 pending_rounds.cc:85] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting all ops after (but not including) 11
I20260709 12:12:26.137806 22600 pending_rounds.cc:107] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 12:12:26.138047 22600 raft_consensus.cc:2889] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:26.138082 22421 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:26.139271 22604 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 19.
I20260709 12:12:26.113265 22570 leader_election.cc:400] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 17. Current term is 18.
I20260709 12:12:26.095872 29005 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:26.110700 22453 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 16.
I20260709 12:12:26.117041 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:26.225603 22531 raft_consensus.cc:2393] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 13: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
W20260709 12:12:26.100157 29043 log.cc:927] Time spent T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:12:26.131819 28973 consensus_queue.cc:1048] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:26.108878 23088 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:12:26.229511 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 120726us
I20260709 12:12:26.140321 22570 leader_election.cc:403] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:26.191164 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:26.093632 29046 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.179244 22421 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:26.231190 22526 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 18.
W20260709 12:12:26.231689 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 52562.9us
I20260709 12:12:26.184369 29016 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:26.186071 22527 raft_consensus.cc:1240] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 LEADER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 12:12:26.134877 28988 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:26.187773 29030 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:26.191887 23123 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 18.
I20260709 12:12:26.159961 22347 catalog_manager.cc:5697] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 13 to 14, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 14 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:26.188824 29055 log.cc:927] Time spent T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:12:26.192559 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:26.213204 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:26.216073 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:26.246752 22455 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 17.
W20260709 12:12:26.217425 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 80140.1us
I20260709 12:12:26.220057 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:26.256048 22456 raft_consensus.cc:2410] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 12:12:26.179203 28871 raft_consensus.cc:2804] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:26.214812 29002 raft_consensus.cc:2804] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:12:26.217168 28176 consensus_meta.cc:287] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.555s	user 0.007s	sys 0.003s
I20260709 12:12:26.275928 22497 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:26.227777 22601 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 18.
W20260709 12:12:26.232869 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 119797us
I20260709 12:12:26.279358 22570 leader_election.cc:400] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 election: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 12. Current term is 13.
I20260709 12:12:26.236471 22604 raft_consensus.cc:1275] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 12:12:26.233949 23088 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:26.280329 22570 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:26.235737 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:26.279235 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:26.282444 22455 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 15.
I20260709 12:12:26.271275 29002 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:26.235215 29046 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:26.270754 28871 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:26.283794 28955 raft_consensus.cc:2749] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:26.284130 28871 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:26.284669 29051 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:26.285164 29051 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:26.285542 29051 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:26.287254 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:26.289678 29032 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:26.239125 29005 raft_consensus.cc:2804] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:26.294520 29005 raft_consensus.cc:697] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 14 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:26.295145 28930 raft_consensus.cc:2749] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 17. Current term is 18.
I20260709 12:12:26.295500 29005 consensus_queue.cc:237] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:26.296770 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:26.296882 29052 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:26.297580 22605 raft_consensus.cc:1275] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 12:12:26.297477 29052 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:26.298664 29016 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:26.278582 29048 consensus_queue.cc:1048] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 12:12:26.299986 22347 catalog_manager.cc:5697] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 7 to 15, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 15 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
W20260709 12:12:26.301033 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 68796.4us
I20260709 12:12:26.283595 28991 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:26.297937 22605 pending_rounds.cc:85] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting all ops after (but not including) 11
I20260709 12:12:26.302279 22456 raft_consensus.cc:2393] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 17: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:26.302711 22605 pending_rounds.cc:107] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting uncommitted NO_OP operation due to leader change: 17.12
W20260709 12:12:26.301822 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:26.302268 22570 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:26.307397 22570 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:26.308871 22570 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:26.310007 22570 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:26.303118 22605 raft_consensus.cc:2889] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:26.297961 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:26.316660 22455 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 16.
I20260709 12:12:26.312932 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:26.315837 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:26.318107 22601 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 19.
I20260709 12:12:26.319636 22497 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:26.283788 29002 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:26.324173 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:26.338644 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:26.339555 22601 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 15.
I20260709 12:12:26.342008 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:26.343534 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:26.344288 22604 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 16.
I20260709 12:12:26.345279 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:26.345606 23089 leader_election.cc:304] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:26.345940 22604 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:26.346916 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:26.303344 29015 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.305820 28973 raft_consensus.cc:2804] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:26.271875 29030 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:26.322409 29048 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:26.311121 28930 raft_consensus.cc:2749] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:12:26.301808 28978 consensus_queue.cc:1048] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 12:12:26.319439 28946 raft_consensus.cc:2804] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:26.313728 28176 raft_consensus.cc:2749] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:26.363317 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:26.364216 22455 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 16.
I20260709 12:12:26.335784 28991 raft_consensus.cc:697] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:26.352216 28955 raft_consensus.cc:2804] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:26.315671 29016 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:26.335163 28620 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:26.350473 28867 raft_consensus.cc:2804] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:26.311321 28989 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:26.367300 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:26.571939 28947 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.572620 22601 raft_consensus.cc:2393] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 17: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
W20260709 12:12:26.356676 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 241456us
I20260709 12:12:26.370735 22604 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 14.
I20260709 12:12:26.319300 29037 consensus_queue.cc:1059] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 12:12:26.355979 28973 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:26.357795 28995 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.586858 23123 raft_consensus.cc:1275] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 12:12:26.373921 28955 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:12:26.425175 29053 log.cc:927] Time spent T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 12:12:26.357609 29048 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:26.362094 28994 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.357396 22347 catalog_manager.cc:5697] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 8 to 9, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 9 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:26.359406 29015 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:26.608501 28871 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:26.609074 29015 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:26.612916 22347 catalog_manager.cc:5697] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 9 to 11, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 11 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:12:26.613597 29002 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:26.615772 28994 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:26.617487 29048 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:26.589198 28867 raft_consensus.cc:697] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:26.464383 29016 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:26.617602 29002 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:26.621600 29002 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.622100 29016 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:26.590036 28973 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:26.573143 29036 raft_consensus.cc:2749] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:26.618093 28994 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:26.593160 29037 consensus_queue.cc:1243] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Peer 1676e7af5e4a47cb86ee7db83e3d4881 log is divergent from this leader: its last log entry 18.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:12:26.360860 28946 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:26.623724 28946 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:26.594718 28955 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:26.622300 29002 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:26.465926 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:26.626120 22455 raft_consensus.cc:2468] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 13.
W20260709 12:12:26.539593 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 202829us
I20260709 12:12:26.627061 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:26.628189 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:26.628592 22422 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:12:26.628880 29024 log.cc:927] Time spent T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 1.018s	user 0.001s	sys 0.001s
I20260709 12:12:26.629202 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:26.629918 22455 raft_consensus.cc:2393] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 19: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:26.630059 22422 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:12:26.544011 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 224192us
I20260709 12:12:26.549831 29052 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:26.373909 28809 raft_consensus.cc:2749] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:26.550880 29032 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:26.631307 29052 raft_consensus.cc:2749] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:26.551326 28620 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:26.632407 28990 raft_consensus.cc:2804] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:26.632818 28990 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:26.633188 28990 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:26.633340 28620 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:26.451747 28991 consensus_queue.cc:237] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:26.554953 29046 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:26.555991 29009 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.335376 28935 consensus_queue.cc:1048] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.030s
I20260709 12:12:26.635409 29009 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:26.594414 28995 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:26.557997 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:26.637275 22525 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:26.637467 29009 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:12:26.631313 28997 log.cc:927] Time spent T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 1.008s	user 0.000s	sys 0.003s
I20260709 12:12:26.355386 28944 consensus_queue.cc:1048] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:12:26.638520 28995 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:26.622442 22453 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 20.
I20260709 12:12:26.562652 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:26.640400 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:26.563716 28176 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.564586 22452 raft_consensus.cc:1240] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 LEADER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:26.642445 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:26.567315 28941 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:26.619601 28871 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:26.568701 29030 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:26.644351 22495 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:26.573905 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:26.621529 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:26.585386 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:26.583348 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:26.358256 28972 raft_consensus.cc:2804] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:26.588219 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:26.651633 22452 raft_consensus.cc:2468] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 11.
W20260709 12:12:26.591651 22496 leader_election.cc:336] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Timed out: RequestConsensusVote RPC to 127.20.196.132:44353 timed out after 1.977s (SENT)
I20260709 12:12:26.598053 22527 raft_consensus.cc:1275] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:12:26.630620 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:26.598970 22531 raft_consensus.cc:1240] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:26.571928 28989 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:26.572589 28947 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:26.606328 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 52313.2us
I20260709 12:12:26.640899 29002 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:26.573717 22529 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 16.
I20260709 12:12:26.575515 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:26.673700 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:26.654906 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:26.655233 22496 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:26.683856 22525 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 18.
I20260709 12:12:26.649561 22422 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:26.678449 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:12:26.685309 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 54422.6us
I20260709 12:12:26.686192 23088 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:26.678939 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:26.687968 22604 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:12:26.683040 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:26.683293 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:26.689245 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:26.689577 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:26.689869 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:26.695725 22569 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:26.697273 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:26.641204 28176 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:26.656644 28972 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:26.684000 23087 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:26.703068 22600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43070 (request call id 1103) took 1692 ms. Trace:
I20260709 12:12:26.704052 22569 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:26.705940 22598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3400) took 1469 ms. Trace:
I20260709 12:12:26.706302 22598 rpcz_store.cc:276] 0709 12:12:25.237014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:25.250564 (+ 13550us) service_pool.cc:224] Handling call
0709 12:12:25.250919 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:25.967222 (+716303us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:26.705729 (+738507us) spinlock_profiling.cc:243] Waited 713 ms on lock 0x7b54000e9f54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:26.705876 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1640908160}
I20260709 12:12:26.715615 22605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3408) took 1457 ms. Trace:
I20260709 12:12:26.698637 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:26.657860 29037 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.715996 22605 rpcz_store.cc:276] 0709 12:12:25.257968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:25.293838 (+ 35870us) service_pool.cc:224] Handling call
0709 12:12:25.383559 (+ 89721us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:26.310754 (+927195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:26.715406 (+404652us) spinlock_profiling.cc:243] Waited 914 ms on lock 0x7b54000e9a54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:26.715558 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2101328128}
I20260709 12:12:26.707516 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:26.703446 22600 rpcz_store.cc:276] 0709 12:12:25.010235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:25.012657 (+  2422us) service_pool.cc:224] Handling call
0709 12:12:25.094249 (+ 81592us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:26.165984 (+1071735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:26.702817 (+536833us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540013c754. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:26.703011 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2384934272}
I20260709 12:12:26.670611 28871 raft_consensus.cc:2804] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:26.724409 22569 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:26.731076 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:26.731292 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:26.737448 22527 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 17.
I20260709 12:12:26.729871 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:26.729949 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:26.656488 29051 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:26.740087 28994 raft_consensus.cc:2804] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:26.740547 28994 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:26.740893 28994 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:26.741220 28935 consensus_queue.cc:1059] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:26.741680 29051 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:26.742167 28935 raft_consensus.cc:3055] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:26.742408 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:26.743803 29002 raft_consensus.cc:2749] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:12:26.744964 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 153350us
I20260709 12:12:26.745702 28871 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:26.746275 28871 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:26.740891 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:26.747267 22452 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 18.
I20260709 12:12:26.748158 28989 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:26.748154 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:26.751292 28994 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:26.753813 22496 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:26.739809 22600 raft_consensus.cc:2393] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 17: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
W20260709 12:12:26.756739 29058 log.cc:927] Time spent T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:12:26.726742 28972 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:26.696975 29009 raft_consensus.cc:2804] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:26.742537 28935 raft_consensus.cc:740] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:26.733327 22569 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:12:26.846561 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 113321us
I20260709 12:12:26.723814 28995 raft_consensus.cc:2749] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:26.755703 28994 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:26.614806 22347 catalog_manager.cc:5697] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:12:26.784731 28176 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:26.699407 29016 raft_consensus.cc:2804] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:26.733747 29048 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:26.843864 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:26.788344 29037 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:26.789479 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 105574us
I20260709 12:12:26.727022 29032 raft_consensus.cc:2749] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:26.790894 28871 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:26.793553 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:26.620432 28867 consensus_queue.cc:237] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:26.881198 28871 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:26.850077 28930 raft_consensus.cc:2804] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:26.886607 28930 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:26.886996 28930 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:26.868832 29016 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:26.897403 29016 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:26.901835 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:26.902462 22451 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:26.905113 28994 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:26.905623 28994 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:26.907879 28994 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:26.877493 29048 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:26.911012 29048 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:26.912511 23087 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:26.913641 23087 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:26.915447 28701 raft_consensus.cc:2749] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:26.916159 28701 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:26.867422 28968 consensus_queue.cc:1048] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
W20260709 12:12:26.921909 29027 log.cc:927] Time spent T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 1.313s	user 0.001s	sys 0.000s
I20260709 12:12:26.798257 23120 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:26.799435 28864 raft_consensus.cc:2804] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:26.803983 28179 raft_consensus.cc:3055] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:12:26.804922 22450 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 3142) took 2519 ms (client timeout 2279 ms). Trace:
W20260709 12:12:26.811951 29020 log.cc:927] Time spent T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 1.179s	user 0.002s	sys 0.000s
I20260709 12:12:26.813763 28861 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:26.815371 22448 raft_consensus.cc:1240] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 12. Current term is 13. Ops: []
W20260709 12:12:26.806968 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:26.929756 22450 rpcz_store.cc:269] 0709 12:12:24.285323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:24.285463 (+   140us) service_pool.cc:224] Handling call
0709 12:12:26.804687 (+2519224us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b5400264dd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:26.804829 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3490795776}
I20260709 12:12:26.816340 22525 raft_consensus.cc:1240] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:26.818017 28812 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:26.820456 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:26.823172 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:26.824632 28682 consensus_queue.cc:1048] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:26.930873 28179 raft_consensus.cc:740] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:26.833321 23088 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:26.935993 28179 consensus_queue.cc:260] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:26.937107 28179 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:26.763367 28822 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:26.739205 22598 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 18.
I20260709 12:12:26.931123 28864 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:26.939854 28864 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:26.940001 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:26.941133 22598 raft_consensus.cc:2393] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 19: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:26.836045 22604 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 17.
I20260709 12:12:26.926844 22532 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 16.
I20260709 12:12:26.942570 28835 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.768159 22496 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:26.943786 22531 raft_consensus.cc:2368] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 13. Current term is 14.
I20260709 12:12:26.944120 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:26.930505 22497 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:26.940322 22529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56942 (request call id 2342) took 1107 ms. Trace:
I20260709 12:12:26.946132 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:26.946357 22529 rpcz_store.cc:276] 0709 12:12:25.833193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:25.907133 (+ 73940us) service_pool.cc:224] Handling call
0709 12:12:26.940168 (+1033035us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b540010c7d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:26.940267 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":500848000}
I20260709 12:12:26.947082 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:26.947657 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:26.948527 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:26.951373 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:26.952204 23123 raft_consensus.cc:2393] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 16: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:26.914788 23087 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:26.953799 22570 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:26.949112 23124 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 15.
I20260709 12:12:26.934713 22605 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 13.
I20260709 12:12:26.955966 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:26.956399 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:26.956605 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:26.957556 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:26.958186 22454 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:12:26.865999 29009 raft_consensus.cc:697] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 18 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:26.960384 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:26.943041 28835 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:26.962177 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 194324us
I20260709 12:12:26.966605 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:26.967193 22450 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 18.
I20260709 12:12:26.968243 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:26.968878 22496 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:26.969240 22602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3407) took 1717 ms. Trace:
I20260709 12:12:26.965023 22422 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:26.962466 22605 raft_consensus.cc:2393] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 20: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:26.963884 22497 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:26.972016 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:26.973563 23122 raft_consensus.cc:2393] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 11: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:26.975924 22598 raft_consensus.cc:2393] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 19: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:26.969779 22602 rpcz_store.cc:276] 0709 12:12:25.251429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:25.292260 (+ 40831us) service_pool.cc:224] Handling call
0709 12:12:25.367729 (+ 75469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:26.309334 (+941605us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:12:26.309363 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:26.309412 (+    49us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:26.309451 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:26.942122 (+632671us) spinlock_profiling.cc:243] Waited 2.25 ms on lock 0x7b1800446d40. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc780f2a6 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419
0709 12:12:26.968951 (+ 26829us) spinlock_profiling.cc:243] Waited 941 ms on lock 0x7b54003ae8d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:26.969023 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:26.969170 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1124,"raft.queue_time_us":285,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":8726,"spinlock_wait_cycles":2169971968}
I20260709 12:12:26.979488 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:26.982924 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:26.980310 23122 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 19.
I20260709 12:12:26.975581 28994 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:26.986672 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:26.966205 28995 consensus_queue.cc:1048] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:12:26.986964 28994 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:26.975873 28822 raft_consensus.cc:2804] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:26.988080 28822 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:26.988437 28822 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:26.989344 28994 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:26.987398 23118 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:26.990525 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:26.961915 28176 consensus_queue.cc:1048] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.013s
I20260709 12:12:26.994264 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:26.995069 22454 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:26.984894 22497 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:26.943822 28944 raft_consensus.cc:2764] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:12:26.955427 29032 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.955651 29001 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.975436 28682 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:27.003793 22605 raft_consensus.cc:1240] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 12:12:26.993264 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:26.963598 28701 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.021485 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:27.022575 23116 raft_consensus.cc:2410] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 18 because replica has last-logged OpId of term: 16 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 14.
I20260709 12:12:26.990052 28958 raft_consensus.cc:2749] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:26.983657 28861 raft_consensus.cc:2804] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:27.027486 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:27.029642 22454 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 18.
I20260709 12:12:27.035778 22598 raft_consensus.cc:1240] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 13. Current term is 14. Ops: [11.9-13.10]
I20260709 12:12:27.006839 28763 raft_consensus.cc:2804] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:27.008819 28855 raft_consensus.cc:2749] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:27.049755 22454 raft_consensus.cc:1275] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:26.983927 28871 consensus_queue.cc:1048] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
I20260709 12:12:27.055851 22454 raft_consensus.cc:1275] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:12:27.062909 23118 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 17.
I20260709 12:12:27.067489 22451 raft_consensus.cc:2468] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 14.
I20260709 12:12:26.997179 28941 consensus_queue.cc:1048] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.052s
I20260709 12:12:27.077119 22454 raft_consensus.cc:1275] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:27.077183 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:27.043490 28861 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:27.044529 29037 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:12:27.053798 29062 log.cc:927] Time spent T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:12:27.032145 28682 consensus_queue.cc:1048] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.036s
I20260709 12:12:27.054244 28763 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:27.058095 28624 raft_consensus.cc:2804] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:27.020869 29001 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:27.020637 29032 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:27.102576 22598 raft_consensus.cc:1275] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 12:12:27.079351 29066 log.cc:927] Time spent T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.407s	user 0.000s	sys 0.001s
I20260709 12:12:27.034745 28701 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:27.110549 22597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43070 (request call id 1095) took 2957 ms. Trace:
I20260709 12:12:27.106093 22454 raft_consensus.cc:1275] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:27.081151 28968 raft_consensus.cc:2804] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:27.143675 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:27.082633 29005 raft_consensus.cc:2749] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:27.083396 28861 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:27.049252 28946 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:27.135361 22597 rpcz_store.cc:276] 0709 12:12:24.145689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:24.682561 (+536872us) service_pool.cc:224] Handling call
0709 12:12:24.682944 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:25.127664 (+444720us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:25.127733 (+    69us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:25.139749 (+ 12016us) log.cc:844] Serialized 26 byte log entry
0709 12:12:25.406202 (+266453us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:25.464292 (+ 58090us) log.cc:844] Serialized 14 byte log entry
0709 12:12:25.464518 (+   226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:25.464596 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:26.288976 (+824380us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b1800357640. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc78413f3 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd 0000000000388634 0000000000388479 00007f9cc782483a
0709 12:12:26.811390 (+522414us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:12:27.102858 (+291468us) raft_consensus.cc:1685] finished
0709 12:12:27.102886 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:27.103104 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87511,"prepare.queue_time_us":62012,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":280084,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":20045,"spinlock_wait_cycles":86578304,"thread_start_us":595642,"threads_started":2,"wal-append.queue_time_us":432583}
I20260709 12:12:27.106797 28763 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:27.163846 22523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 1286) took 1816 ms. Trace:
I20260709 12:12:27.164244 22523 rpcz_store.cc:276] 0709 12:12:25.347140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:25.347257 (+   117us) service_pool.cc:224] Handling call
0709 12:12:25.396732 (+ 49475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:25.618965 (+222233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:25.619015 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:25.619060 (+    45us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:25.619096 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:27.163619 (+1544523us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b5400231254. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:27.163663 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:27.163788 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":510596352}
I20260709 12:12:27.166364 22570 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:27.168071 22570 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:27.159201 28812 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:27.134275 28624 raft_consensus.cc:697] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
W20260709 12:12:27.160195 29029 log.cc:927] Time spent T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 1.512s	user 0.001s	sys 0.004s
I20260709 12:12:27.177603 22570 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:27.104315 28955 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:27.149181 28968 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:27.191617 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:27.171490 29067 log.cc:927] Time spent T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 12:12:27.214632 22606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3414) took 1318 ms. Trace:
I20260709 12:12:27.224933 22598 raft_consensus.cc:1240] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 21. Current term is 22. Ops: []
W20260709 12:12:27.230764 29063 log.cc:927] Time spent T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.363s	user 0.000s	sys 0.003s
I20260709 12:12:27.230927 28624 consensus_queue.cc:237] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:27.136739 28973 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:27.233239 22457 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 3149) took 2480 ms (client timeout 2212 ms). Trace:
W20260709 12:12:27.238695 22457 rpcz_store.cc:269] 0709 12:12:24.753229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:24.753711 (+   482us) service_pool.cc:224] Handling call
0709 12:12:27.233014 (+2479303us) spinlock_profiling.cc:243] Waited 75.5 ms on lock 0x7b54003f3ed4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:27.233171 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":173585664}
I20260709 12:12:27.239997 22457 raft_consensus.cc:1240] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:27.240694 28946 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:27.241353 28946 raft_consensus.cc:2804] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:27.241726 28946 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:27.242091 28946 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:27.234678 22528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 1291) took 1825 ms. Trace:
I20260709 12:12:27.244057 22528 rpcz_store.cc:276] 0709 12:12:25.409092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:25.411870 (+  2778us) service_pool.cc:224] Handling call
0709 12:12:25.458893 (+ 47023us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:25.508942 (+ 50049us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:25.508976 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:25.539779 (+ 30803us) log.cc:844] Serialized 26 byte log entry
0709 12:12:26.311432 (+771653us) spinlock_profiling.cc:243] Waited 3.26 ms on lock 0x7b18000ddaa0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc7823e07 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc7840c02 00007f9cca4c820b 00007f9cca4cdd23 00007f9cca4ce0d1 00007f9cca8e9a0f
0709 12:12:26.571157 (+259725us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:26.571207 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:26.571350 (+   143us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:27.173199 (+601849us) spinlock_profiling.cc:243] Waited 2.07 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:12:27.234461 (+ 61262us) raft_consensus.cc:1685] finished
0709 12:12:27.234480 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:27.234612 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34071,"raft.queue_time_us":80726,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":16963,"spinlock_wait_cycles":12272768,"thread_start_us":259522,"threads_started":1,"wal-append.queue_time_us":1125836}
I20260709 12:12:27.234869 22449 raft_consensus.cc:1240] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:27.246325 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:27.182220 28958 raft_consensus.cc:2804] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:27.246889 22449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 2451) took 1148 ms. Trace:
I20260709 12:12:27.247160 23117 raft_consensus.cc:2393] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 17: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:27.247222 28958 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:27.247881 28958 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:27.249320 29034 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:27.235482 22456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 2458) took 1018 ms. Trace:
I20260709 12:12:27.236682 22455 raft_consensus.cc:1275] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:12:27.238273 28973 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:27.098845 29009 consensus_queue.cc:237] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:27.215268 28990 consensus_meta.cc:287] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.580s	user 0.007s	sys 0.004s
I20260709 12:12:27.253618 22606 rpcz_store.cc:276] 0709 12:12:25.896749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:26.091478 (+194729us) service_pool.cc:224] Handling call
0709 12:12:26.091761 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:26.098680 (+  6919us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:26.098712 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:26.136998 (+ 38286us) log.cc:844] Serialized 26 byte log entry
0709 12:12:26.363169 (+226171us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:26.363227 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:26.363316 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:27.214356 (+851040us) raft_consensus.cc:1685] finished
0709 12:12:27.214381 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:27.214569 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":116,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":52566,"thread_start_us":141367,"threads_started":1,"wal-append.queue_time_us":650154}
I20260709 12:12:27.254778 23124 raft_consensus.cc:2410] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 12:12:27.250432 22456 rpcz_store.cc:276] 0709 12:12:26.216815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:26.273912 (+ 57097us) service_pool.cc:224] Handling call
0709 12:12:27.235312 (+961400us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b54003f1bd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:27.235429 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32835840}
I20260709 12:12:27.247294 22449 rpcz_store.cc:276] 0709 12:12:26.098072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:26.098191 (+   119us) service_pool.cc:224] Handling call
0709 12:12:27.234705 (+1136514us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:27.245902 (+ 11197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:27.246722 (+   820us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54003f3ed0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:27.246838 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2613217664}
I20260709 12:12:27.179282 28994 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:27.257616 22599 raft_consensus.cc:2393] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 19: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
W20260709 12:12:27.264003 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 349257us
I20260709 12:12:27.254818 22421 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:12:27.264935 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 280133us
I20260709 12:12:27.265588 22421 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
W20260709 12:12:27.218545 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 227013us
W20260709 12:12:27.253381 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:27.267081 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:27.170904 28930 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:27.252468 29070 log.cc:927] Time spent T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 12:12:27.225678 28968 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:27.269461 22606 raft_consensus.cc:1275] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:27.270097 22496 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:27.211237 28812 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:27.288405 29069 log.cc:927] Time spent T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.558s	user 0.000s	sys 0.001s
I20260709 12:12:27.291081 22601 raft_consensus.cc:1240] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:27.182101 28988 consensus_queue.cc:1048] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.077s
I20260709 12:12:27.262528 28176 raft_consensus.cc:2749] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:27.284564 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 451325us
I20260709 12:12:27.296561 23087 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:27.293799 22421 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:27.325997 22603 raft_consensus.cc:1240] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:27.282454 29048 raft_consensus.cc:2749] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:12:27.332096 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:27.341475 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 71486.8us
I20260709 12:12:27.256558 28972 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:27.345425 23120 raft_consensus.cc:1275] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
W20260709 12:12:27.326916 29067 log.cc:927] Time spent T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:12:27.351266 23120 pending_rounds.cc:85] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270: Aborting all ops after (but not including) 13
I20260709 12:12:27.259799 28763 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:27.285529 28994 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:27.268764 28990 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:27.354085 23120 pending_rounds.cc:107] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270: Aborting uncommitted NO_OP operation due to leader change: 17.14
W20260709 12:12:27.332110 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 65757.2us
I20260709 12:12:27.388068 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:27.477576 23120 raft_consensus.cc:2889] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:27.355861 22531 raft_consensus.cc:1240] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:27.434108 23087 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:27.356464 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:27.363375 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:27.479642 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 45651.5us
I20260709 12:12:27.355314 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:27.384545 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:27.404064 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:27.395570 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:27.481763 22603 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 19.
I20260709 12:12:27.356178 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:27.363245 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:27.487850 23121 raft_consensus.cc:2468] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
I20260709 12:12:27.362504 22569 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:12:27.493788 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 131375us
I20260709 12:12:27.494920 23087 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:27.496484 22603 raft_consensus.cc:1240] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:27.496348 22497 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:27.500088 23120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 1472) took 1682 ms. Trace:
I20260709 12:12:27.502584 22569 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:27.500638 23120 rpcz_store.cc:276] 0709 12:12:25.817389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:25.836113 (+ 18724us) service_pool.cc:224] Handling call
0709 12:12:25.836417 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:26.797688 (+961271us) spinlock_profiling.cc:243] Waited 820 ms on lock 0x7b58009443d0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca88a0aa 00007f9cca90c447 00007f9cca924fe7 00007f9cca9267de 00007f9cca930b49 00007f9cca931416 00007f9cca92dd8f 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4
0709 12:12:27.499789 (+702101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:27.500024 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1886557440}
I20260709 12:12:27.504627 23087 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:27.343400 28814 raft_consensus.cc:2749] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:27.518831 22525 raft_consensus.cc:1240] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:27.519439 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:27.508836 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:27.356236 29075 log.cc:927] Time spent T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 12:12:27.374274 29074 log.cc:927] Time spent T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
I20260709 12:12:27.510696 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:27.388330 28822 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:27.373668 28812 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:27.518378 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:27.522392 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:27.359663 29001 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:27.530371 23120 raft_consensus.cc:2410] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 12:12:27.446295 29078 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.395315 29051 raft_consensus.cc:2749] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:27.524972 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:27.437043 28179 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:27.387591 28972 leader_election.cc:290] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:27.389147 28701 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:27.527489 22529 raft_consensus.cc:1240] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 12:12:27.512638 22603 raft_consensus.cc:1240] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 12:12:27.446329 28682 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.372674 28835 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:27.565290 22605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43070 (request call id 1114) took 1251 ms. Trace:
I20260709 12:12:27.565692 22605 rpcz_store.cc:276] 0709 12:12:26.313397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.023747 (+710350us) service_pool.cc:224] Handling call
0709 12:12:27.024143 (+   396us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:27.024595 (+   452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:27.024637 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:27.025257 (+   620us) log.cc:844] Serialized 52 byte log entry
0709 12:12:27.258655 (+233398us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:27.258700 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:27.258773 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:27.565078 (+306305us) raft_consensus.cc:1685] finished
0709 12:12:27.565106 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:27.565237 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2587,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":13673,"thread_start_us":212617,"threads_started":1,"wal-append.queue_time_us":463037}
I20260709 12:12:27.564548 28682 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:27.360759 29032 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:27.572135 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:27.385790 28930 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:27.392941 28947 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:27.373096 28955 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:12:27.518311 28966 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
I20260709 12:12:27.533054 28763 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:27.531535 29082 raft_consensus.cc:2749] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:27.576745 22598 raft_consensus.cc:1275] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:12:27.531231 22524 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 19.
I20260709 12:12:27.533337 28994 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:27.535104 28935 consensus_queue.cc:260] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:27.535894 28958 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:27.510185 28973 raft_consensus.cc:2749] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:27.536870 22601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2970) took 1234 ms. Trace:
I20260709 12:12:27.542035 22449 raft_consensus.cc:1275] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:12:27.502187 29084 raft_consensus.cc:2804] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:27.545404 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:27.593130 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:27.593873 23120 raft_consensus.cc:2376] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 16. Re-sending same reply.
I20260709 12:12:27.524245 28176 raft_consensus.cc:2804] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:27.599671 22602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2971) took 1289 ms. Trace:
I20260709 12:12:27.546537 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:27.549082 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:27.353019 28991 consensus_queue.cc:1048] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.175s
I20260709 12:12:27.370586 29016 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:27.359952 28864 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:27.552296 22495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:27.518226 29077 consensus_queue.cc:1048] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.060s
I20260709 12:12:27.547587 29078 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:27.561923 28822 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:27.562896 28812 consensus_queue.cc:1059] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:27.563076 22422 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:27.563369 28591 consensus_queue.cc:1048] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:27.529193 28942 raft_consensus.cc:2749] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:27.361565 28995 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:12:27.586376 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 408848us
I20260709 12:12:27.588603 22601 rpcz_store.cc:276] 0709 12:12:26.302125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:26.656722 (+354597us) service_pool.cc:224] Handling call
0709 12:12:27.290887 (+634165us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:27.304940 (+ 14053us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:27.536627 (+231687us) spinlock_profiling.cc:243] Waited 634 ms on lock 0x7b54000e8650. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:27.536795 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1457762176}
I20260709 12:12:27.638290 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:27.575055 28835 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.546746 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:27.616261 28935 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:27.546739 28687 consensus_queue.cc:1059] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 12:12:27.605592 23124 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 18.
I20260709 12:12:27.612016 22604 raft_consensus.cc:1240] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:27.613675 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:27.647492 23120 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 16.
W20260709 12:12:27.611968 22495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:27.560354 28179 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:27.650221 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:27.592046 29084 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:27.619977 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:27.653745 22598 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
I20260709 12:12:27.599148 29005 raft_consensus.cc:2749] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:27.599354 28176 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:27.603291 28955 raft_consensus.cc:2804] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:27.659159 28955 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:27.659009 28941 consensus_queue.cc:1048] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:27.659668 28955 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:27.660106 29016 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:27.661379 22496 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:27.623679 28861 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:27.646123 28835 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:27.663946 28941 raft_consensus.cc:2804] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:27.664534 28941 raft_consensus.cc:697] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:27.664974 28861 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:27.641332 28763 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:27.665431 28835 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:27.643528 28995 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:27.665441 28941 consensus_queue.cc:237] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:27.667738 28995 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:27.669195 28995 consensus_queue.cc:1048] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:27.670413 28995 consensus_queue.cc:1059] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:12:27.671283 22496 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:27.674247 22454 raft_consensus.cc:1240] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:27.655835 29084 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:27.677086 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 174569us
I20260709 12:12:27.677461 29078 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:27.678218 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:27.678362 22569 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:27.680016 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:27.632484 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:27.680650 23124 raft_consensus.cc:2376] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 18. Re-sending same reply.
W20260709 12:12:27.680963 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 176433us
I20260709 12:12:27.681444 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:27.681603 23087 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:27.682015 23124 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 10.
I20260709 12:12:27.638830 22601 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:27.638826 22452 raft_consensus.cc:2393] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 17: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:27.641191 22453 raft_consensus.cc:2393] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 19: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:27.600173 22602 rpcz_store.cc:276] 0709 12:12:26.310022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.004630 (+694608us) service_pool.cc:224] Handling call
0709 12:12:27.029545 (+ 24915us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:27.029795 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:12:27.251828 (+222033us) log.cc:844] Serialized 14 byte log entry
0709 12:12:27.599213 (+347385us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:27.599265 (+    52us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:27.599443 (+   178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:27.599516 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:27.599622 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8583,"prepare.queue_time_us":419811,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":3701,"thread_start_us":560168,"threads_started":2,"wal-append.queue_time_us":345395}
W20260709 12:12:27.643079 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 80117.6us
I20260709 12:12:27.591781 29025 consensus_queue.cc:1059] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 12:12:27.642753 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:27.644519 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:27.588380 28946 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:27.645594 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:27.651708 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:27.632176 29030 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.646497 28988 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
W20260709 12:12:27.681717 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:27.634207 22528 raft_consensus.cc:1240] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 12:12:27.693657 22601 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 19.
I20260709 12:12:27.695173 28987 raft_consensus.cc:2804] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:27.646690 28862 raft_consensus.cc:2749] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:27.698029 22523 raft_consensus.cc:2376] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 16. Re-sending same reply.
I20260709 12:12:27.658706 28176 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:27.703717 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:27.650063 29091 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.705626 22448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 3165) took 1322 ms. Trace:
I20260709 12:12:27.711673 23087 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:27.714076 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:28.045809 22599 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 19.
W20260709 12:12:28.046639 29105 log.cc:927] Time spent T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:12:28.047179 22599 raft_consensus.cc:1240] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 10. Current term is 11. Ops: []
I20260709 12:12:27.803653 22454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 3163) took 1446 ms. Trace:
I20260709 12:12:28.038437 29091 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:27.949930 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:27.665787 28763 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:27.819473 22495 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:28.038472 28930 consensus_queue.cc:1059] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
W20260709 12:12:27.935439 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:28.050427 28930 consensus_queue.cc:1048] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:27.719759 28987 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:27.873417 23119 raft_consensus.cc:1240] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 18 LEADER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:28.051234 28987 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:28.051415 29086 log.cc:927] Time spent T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
I20260709 12:12:28.048518 22599 raft_consensus.cc:1240] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:28.048527 28176 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:27.866657 22421 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.004s	sys 0.028s
W20260709 12:12:28.055220 22421 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.004s	sys 0.037s
W20260709 12:12:28.055485 29089 log.cc:927] Time spent T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.223s	user 0.000s	sys 0.000s
W20260709 12:12:28.055828 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 768345us
I20260709 12:12:28.056355 22597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3425) took 1405 ms. Trace:
I20260709 12:12:27.949061 22452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 3158) took 1632 ms. Trace:
I20260709 12:12:28.056777 28176 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:28.057624 28176 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:27.804490 28990 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:27.877290 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:28.061623 28990 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.676151 28864 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:27.737066 23124 raft_consensus.cc:1275] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:12:28.062098 28990 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:28.063247 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:28.063766 28987 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:28.064229 28990 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:27.819657 22598 raft_consensus.cc:1240] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:27.696362 29037 raft_consensus.cc:2749] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:27.812121 28856 raft_consensus.cc:2764] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:12:27.881719 23116 raft_consensus.cc:1275] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:27.695716 28179 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:27.796279 22601 raft_consensus.cc:1275] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:12:27.803370 28988 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:27.928498 29104 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.949434 29103 raft_consensus.cc:2804] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:27.964223 28862 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:27.961268 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:28.005297 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 354381us
I20260709 12:12:27.985153 28958 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:28.088227 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 376643us
W20260709 12:12:28.077862 29034 consensus_meta.cc:287] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.828s	user 0.010s	sys 0.001s
I20260709 12:12:28.038683 22531 raft_consensus.cc:2393] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 19: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:28.041189 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:28.016827 22448 rpcz_store.cc:276] 0709 12:12:26.383512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.166343 (+782831us) service_pool.cc:224] Handling call
0709 12:12:27.166628 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:27.166809 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:12:27.449884 (+283075us) log.cc:844] Serialized 14 byte log entry
0709 12:12:27.705250 (+255366us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:27.705297 (+    47us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:27.705336 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:27.705420 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:27.705560 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":45318,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":4373,"raft.queue_time_us":357,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":16236,"thread_start_us":537027,"threads_started":2,"wal-append.queue_time_us":538491}
I20260709 12:12:28.048883 22454 rpcz_store.cc:276] 0709 12:12:26.357648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.137675 (+780027us) service_pool.cc:224] Handling call
0709 12:12:27.138172 (+   497us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:27.674725 (+536553us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:27.803328 (+128603us) spinlock_profiling.cc:243] Waited 536 ms on lock 0x7b5400243954. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:27.803582 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1232375040}
I20260709 12:12:27.867267 28994 raft_consensus.cc:3055] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:28.075359 28990 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.710505 29030 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:28.054741 22603 raft_consensus.cc:1240] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 12:12:28.056818 22450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 3152) took 1822 ms. Trace:
I20260709 12:12:28.057261 22452 rpcz_store.cc:276] 0709 12:12:26.300512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:26.747920 (+447408us) service_pool.cc:224] Handling call
0709 12:12:27.931295 (+1183375us) spinlock_profiling.cc:243] Waited 885 ms on lock 0x7b5400199954. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:27.933209 (+  1914us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2035965824}
I20260709 12:12:27.808568 23125 raft_consensus.cc:1240] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 12:12:27.662550 28968 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:28.056718 22597 rpcz_store.cc:276] 0709 12:12:26.651119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.259707 (+608588us) service_pool.cc:224] Handling call
0709 12:12:27.260010 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:27.260387 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:27.260426 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:27.287228 (+ 26802us) log.cc:844] Serialized 26 byte log entry
0709 12:12:27.822488 (+535260us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:12:27.822554 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:27.822651 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:28.056139 (+233488us) raft_consensus.cc:1685] finished
0709 12:12:28.056160 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:28.056292 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22683,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":21168,"thread_start_us":479431,"threads_started":1,"wal-append.queue_time_us":746673}
I20260709 12:12:28.060039 29007 raft_consensus.cc:2749] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:12:28.050472 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 231098us
I20260709 12:12:28.062098 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:28.068745 22421 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:12:28.089753 29093 log.cc:927] Time spent T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
W20260709 12:12:28.048569 29087 log.cc:927] Time spent T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:12:28.080149 22606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2983) took 1347 ms. Trace:
I20260709 12:12:27.971324 28701 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.087811 22570 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:28.089038 23087 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:28.092099 22527 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 20.
I20260709 12:12:28.093453 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:28.097272 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 412677us
W20260709 12:12:28.075541 22600 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.020s	sys 0.060s
I20260709 12:12:28.109903 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:28.101388 22495 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:28.112118 23087 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:28.089572 29009 raft_consensus.cc:2804] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:28.096783 22450 rpcz_store.cc:276] 0709 12:12:26.234587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.049623 (+815036us) service_pool.cc:224] Handling call
0709 12:12:27.067474 (+ 17851us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:27.071846 (+  4372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:27.071876 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:27.087296 (+ 15420us) log.cc:844] Serialized 52 byte log entry
0709 12:12:27.527360 (+440064us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:27.527398 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:27.527467 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:28.056602 (+529135us) raft_consensus.cc:1685] finished
0709 12:12:28.056620 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:28.056763 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3914,"raft.queue_time_us":4503,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":26979,"thread_start_us":375304,"threads_started":1,"wal-append.queue_time_us":522620}
W20260709 12:12:28.110065 22600 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.020s	sys 0.060s
I20260709 12:12:28.114693 23118 raft_consensus.cc:2368] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 17. Current term is 18.
I20260709 12:12:28.117343 22421 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:28.120944 23089 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:28.123059 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:28.124908 28179 raft_consensus.cc:2804] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:28.118885 29034 raft_consensus.cc:2804] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:28.125432 28179 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:28.125555 29034 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:28.125973 28179 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:28.126078 29034 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:28.127229 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:28.128321 22495 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:12:28.093216 29103 raft_consensus.cc:697] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:28.128830 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:28.096695 28994 raft_consensus.cc:740] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:28.130214 22421 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:28.131700 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:28.085466 28176 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:28.131357 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:28.142582 22531 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:28.127138 28591 raft_consensus.cc:2749] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:28.143908 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:28.106508 28981 raft_consensus.cc:2749] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:28.145020 22597 raft_consensus.cc:2393] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 15: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:28.089425 28862 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:28.112174 28946 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:28.146447 22421 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:28.115089 29001 raft_consensus.cc:2749] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:28.149874 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:28.087239 29104 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:28.147356 22495 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:12:28.155417 22421 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:28.155449 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:12:28.132284 29099 log.cc:927] Time spent T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:12:28.101931 28990 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:28.143465 28835 raft_consensus.cc:2804] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:28.160980 22495 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:28.153025 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:28.144953 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 57194.7us
I20260709 12:12:28.161834 22601 pending_rounds.cc:85] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc: Aborting all ops after (but not including) 11
I20260709 12:12:28.133116 28973 raft_consensus.cc:2804] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:28.115615 29009 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:28.140544 28958 consensus_queue.cc:1059] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 12:12:28.176481 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:12:28.202898 29094 log.cc:927] Time spent T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.242s	user 0.001s	sys 0.000s
I20260709 12:12:28.118901 28701 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:28.131335 29098 consensus_queue.cc:1059] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.097s
I20260709 12:12:28.127498 28687 consensus_queue.cc:1048] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 12:12:28.162566 28814 raft_consensus.cc:2804] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:28.329087 28855 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:28.351219 28814 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:28.351681 28814 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:28.265841 28981 raft_consensus.cc:2804] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:12:28.241613 29101 log.cc:927] Time spent T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.132s	user 0.000s	sys 0.004s
I20260709 12:12:28.242081 28968 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:28.355288 28981 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:28.242861 29108 log.cc:927] Time spent T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:12:28.148787 28861 raft_consensus.cc:2749] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:28.152758 29109 raft_consensus.cc:2749] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:12:28.154564 29025 consensus_queue.cc:1059] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 12:12:28.164285 28947 consensus_queue.cc:1048] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:12:28.143101 28624 consensus_queue.cc:1048] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 12:12:28.358124 29121 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:28.145725 29036 consensus_queue.cc:1048] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 12:12:28.358632 29121 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:28.361856 23122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 1438) took 1197 ms. Trace:
I20260709 12:12:28.362238 23122 rpcz_store.cc:276] 0709 12:12:27.164855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.702534 (+537679us) service_pool.cc:224] Handling call
0709 12:12:27.702859 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:27.712407 (+  9548us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:27.712436 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:27.712868 (+   432us) log.cc:844] Serialized 26 byte log entry
0709 12:12:28.103823 (+390955us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:28.103867 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:28.103935 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:28.361639 (+257704us) raft_consensus.cc:1685] finished
0709 12:12:28.361658 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:28.361802 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31483,"raft.queue_time_us":106849,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":47347,"thread_start_us":226117,"threads_started":1,"wal-append.queue_time_us":384987}
I20260709 12:12:28.141870 29007 consensus_queue.cc:1048] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 12:12:28.161882 28978 raft_consensus.cc:2804] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:28.363901 28978 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:28.364401 28978 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:28.364866 23117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 1437) took 1200 ms. Trace:
I20260709 12:12:28.365851 29034 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:28.247555 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 124815us
I20260709 12:12:28.367949 29030 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:28.263465 28988 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:28.368254 28179 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:28.249045 29103 consensus_queue.cc:237] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:28.260560 28862 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:28.371402 29084 consensus_meta.cc:287] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.695s	user 0.004s	sys 0.009s
I20260709 12:12:28.371811 29084 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:28.264355 22531 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 19.
I20260709 12:12:28.141202 29114 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:28.266242 22601 pending_rounds.cc:107] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 12:12:28.265836 22570 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:28.374708 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 108954us
W20260709 12:12:28.375278 28935 consensus_meta.cc:287] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.726s	user 0.007s	sys 0.003s
I20260709 12:12:28.375877 22529 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 15.
I20260709 12:12:28.376757 22570 leader_election.cc:400] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 election: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 13. Current term is 14.
I20260709 12:12:28.377128 22570 leader_election.cc:403] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:12:28.158314 28994 consensus_queue.cc:260] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:28.378185 28994 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:28.378331 28958 raft_consensus.cc:2749] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:28.378575 28946 raft_consensus.cc:2749] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 13. Current term is 14.
W20260709 12:12:28.324906 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 163984us
I20260709 12:12:28.379129 28958 consensus_queue.cc:1059] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:28.380087 28946 raft_consensus.cc:3055] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:28.380506 28946 raft_consensus.cc:740] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:28.381449 28946 consensus_queue.cc:260] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:28.243286 28835 raft_consensus.cc:697] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:28.333943 29009 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:28.383917 23088 leader_election.cc:304] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:28.383752 28835 consensus_queue.cc:237] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:28.385463 29126 raft_consensus.cc:2749] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:28.331915 23123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 1436) took 1170 ms. Trace:
I20260709 12:12:28.242952 29104 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:28.339970 28176 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:28.340622 22523 raft_consensus.cc:1275] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:12:28.324150 29113 log.cc:927] Time spent T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.172s	user 0.002s	sys 0.000s
I20260709 12:12:28.260365 28990 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:28.355825 28981 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:28.373747 22601 raft_consensus.cc:2889] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:28.324769 28973 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:28.330325 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:28.476203 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:28.428787 23088 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:12:28.478642 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 49990.2us
I20260709 12:12:28.431638 28176 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.480361 28176 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:28.378925 22570 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:12:28.382762 28946 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:28.387110 23123 rpcz_store.cc:276] 0709 12:12:27.161608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.161749 (+   141us) service_pool.cc:224] Handling call
0709 12:12:27.162055 (+   306us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:27.162423 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:27.162463 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:27.163168 (+   705us) log.cc:844] Serialized 52 byte log entry
0709 12:12:27.625301 (+462133us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:27.625356 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:27.625443 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:28.331616 (+706173us) raft_consensus.cc:1685] finished
0709 12:12:28.331648 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:28.331834 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":49412,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":4720,"thread_start_us":461710,"threads_started":1,"wal-append.queue_time_us":640571}
I20260709 12:12:28.472681 28179 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:28.365211 23117 rpcz_store.cc:276] 0709 12:12:27.164309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.247845 (+ 83536us) service_pool.cc:224] Handling call
0709 12:12:27.248260 (+   415us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:27.249135 (+   875us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:27.249179 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:27.249874 (+   695us) log.cc:844] Serialized 52 byte log entry
0709 12:12:27.627587 (+377713us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:27.645855 (+ 18268us) log.cc:844] Serialized 14 byte log entry
0709 12:12:27.985786 (+339931us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:27.985979 (+   193us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:28.364658 (+378679us) raft_consensus.cc:1685] finished
0709 12:12:28.364679 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:28.364808 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":123229,"prepare.queue_time_us":17924,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":1191,"raft.queue_time_us":220364,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":12520,"thread_start_us":649489,"threads_started":2,"wal-append.queue_time_us":583184}
W20260709 12:12:28.482755 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 103891us
I20260709 12:12:28.490487 22597 raft_consensus.cc:2410] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 12:12:28.487093 22497 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:28.491077 22570 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:28.498086 29115 raft_consensus.cc:2749] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:28.500129 29121 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:28.373736 29114 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:28.508654 23123 raft_consensus.cc:1275] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:12:28.493968 22570 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:28.512457 22570 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:28.513882 22570 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:28.524226 28176 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:28.524425 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 369115us
I20260709 12:12:28.467336 28944 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.525243 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:28.525139 28176 raft_consensus.cc:2804] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:28.525926 22597 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:28.525970 28176 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:28.524637 22523 raft_consensus.cc:1275] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:12:28.526657 28176 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:28.529191 23121 raft_consensus.cc:1240] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 17. Current term is 18. Ops: [17.16-17.16]
I20260709 12:12:28.530308 23116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 1486) took 1013 ms. Trace:
I20260709 12:12:28.532819 22421 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:28.533767 23121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 1488) took 1016 ms. Trace:
I20260709 12:12:28.489264 29126 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:28.528330 29107 raft_consensus.cc:2749] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:28.535069 29126 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:28.531366 28624 raft_consensus.cc:2804] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:28.535573 29107 consensus_queue.cc:1059] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:28.536566 28944 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:28.537645 29126 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:28.530686 23116 rpcz_store.cc:276] 0709 12:12:27.517076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.067362 (+550286us) service_pool.cc:224] Handling call
0709 12:12:28.085905 (+ 18543us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:28.086240 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:12:28.086536 (+   296us) log.cc:844] Serialized 14 byte log entry
0709 12:12:28.523974 (+437438us) log.cc:844] Serialized 14 byte log entry
0709 12:12:28.530013 (+  6039us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:28.530062 (+    49us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:28.530099 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:28.530156 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:28.530257 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5814,"prepare.queue_time_us":17455,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":2437,"raft.queue_time_us":107100,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":140,"thread_start_us":419909,"threads_started":2}
W20260709 12:12:28.543725 29117 log.cc:927] Time spent T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.346s	user 0.003s	sys 0.007s
I20260709 12:12:28.543849 28944 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:28.544056 22597 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 20.
I20260709 12:12:28.544479 28944 raft_consensus.cc:3055] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:28.544848 28944 raft_consensus.cc:740] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:28.544971 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:28.494180 29109 raft_consensus.cc:2804] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:28.547197 29109 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:28.547263 23089 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:28.547667 29109 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:28.547825 22598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2991) took 1373 ms. Trace:
I20260709 12:12:28.548184 29037 raft_consensus.cc:2804] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:28.557705 29037 raft_consensus.cc:697] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 20 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:28.545760 28944 consensus_queue.cc:260] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:28.559458 22598 rpcz_store.cc:276] 0709 12:12:27.174163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.702686 (+528523us) service_pool.cc:224] Handling call
0709 12:12:27.809038 (+106352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:28.066033 (+256995us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:28.547546 (+481513us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b5400448754. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:28.547752 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7755136}
I20260709 12:12:28.560767 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:28.561798 29023 raft_consensus.cc:2749] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:28.562516 23120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 1658) took 1277 ms. Trace:
I20260709 12:12:28.562883 23120 rpcz_store.cc:276] 0709 12:12:27.285206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.704687 (+419481us) service_pool.cc:224] Handling call
0709 12:12:27.705038 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:27.713135 (+  8097us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:27.713167 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:27.808265 (+ 95098us) log.cc:844] Serialized 26 byte log entry
0709 12:12:28.037602 (+229337us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:28.037655 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:28.037735 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:28.543213 (+505478us) spinlock_profiling.cc:243] Waited 22.4 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:12:28.562236 (+ 19023us) raft_consensus.cc:1685] finished
0709 12:12:28.562257 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:28.562463 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7701,"raft.queue_time_us":104747,"spinlock_wait_cycles":127690752,"thread_start_us":142145,"threads_started":1,"wal-append.queue_time_us":261434}
I20260709 12:12:28.564108 22451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 3166) took 2135 ms. Trace:
I20260709 12:12:28.564446 22451 rpcz_store.cc:276] 0709 12:12:26.428779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.217138 (+788359us) service_pool.cc:224] Handling call
0709 12:12:27.257580 (+ 40442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:27.344712 (+ 87132us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:12:27.362724 (+ 18012us) log.cc:844] Serialized 14 byte log entry
0709 12:12:27.662212 (+299488us) log.cc:844] Serialized 14 byte log entry
0709 12:12:27.662396 (+   184us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:27.662446 (+    50us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:27.662499 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:28.563910 (+901411us) spinlock_profiling.cc:243] Waited 86.9 ms on lock 0x7b540019b4d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:28.563953 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:28.564059 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":31382,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":78,"raft.queue_time_us":1623,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"spinlock_wait_cycles":199879936,"thread_start_us":295546,"threads_started":1,"wal-append.queue_time_us":715551}
I20260709 12:12:28.528482 29115 raft_consensus.cc:2804] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:28.566949 28809 raft_consensus.cc:3055] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:28.567245 29115 raft_consensus.cc:697] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:28.567427 28809 raft_consensus.cc:740] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:28.568356 28809 consensus_queue.cc:260] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:28.569484 28809 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:28.571146 28176 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:28.573172 28176 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:28.545754 22597 raft_consensus.cc:2393] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 16: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:28.583663 22603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3434) took 1617 ms. Trace:
I20260709 12:12:28.583935 28701 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:28.584117 22603 rpcz_store.cc:276] 0709 12:12:26.965938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.556791 (+590853us) service_pool.cc:224] Handling call
0709 12:12:27.557071 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:28.099339 (+542268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:28.583348 (+484009us) spinlock_profiling.cc:243] Waited 497 ms on lock 0x7b54000e9a54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:28.583592 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1143972096}
I20260709 12:12:28.550084 22421 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:28.489475 28973 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:28.494311 29104 raft_consensus.cc:2804] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:28.551465 22605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2990) took 1432 ms. Trace:
I20260709 12:12:28.470606 29030 consensus_queue.cc:1059] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 12:12:28.553689 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:28.552634 29084 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:28.550050 23119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 1652) took 1599 ms. Trace:
I20260709 12:12:28.586444 22602 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 14.
I20260709 12:12:28.558584 29037 consensus_queue.cc:237] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:28.535600 29091 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:28.548929 22604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3433) took 1623 ms. Trace:
W20260709 12:12:28.590503 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 80172.1us
I20260709 12:12:28.590413 22604 rpcz_store.cc:276] 0709 12:12:26.925496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.526523 (+601027us) service_pool.cc:224] Handling call
0709 12:12:27.526840 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:27.647270 (+120430us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:28.548653 (+901383us) spinlock_profiling.cc:243] Waited 85 ms on lock 0x7b540013b354. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:28.548861 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":195443072}
I20260709 12:12:28.585872 22605 rpcz_store.cc:276] 0709 12:12:27.119378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.567206 (+447828us) service_pool.cc:224] Handling call
0709 12:12:27.567502 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:27.688897 (+121395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:27.688928 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:27.688979 (+    51us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:12:27.689014 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:28.551203 (+862189us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b5400043654. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:28.551263 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:28.551402 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":278757760}
I20260709 12:12:28.592116 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:28.534080 23121 rpcz_store.cc:276] 0709 12:12:27.517735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.491889 (+974154us) service_pool.cc:224] Handling call
0709 12:12:28.528944 (+ 37055us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:28.533577 (+  4633us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:28.533728 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:28.581178 29120 raft_consensus.cc:3055] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:28.587755 23119 rpcz_store.cc:276] 0709 12:12:26.950391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:26.950501 (+   110us) service_pool.cc:224] Handling call
0709 12:12:26.982614 (+ 32113us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:28.051526 (+1068912us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:28.549783 (+498257us) spinlock_profiling.cc:243] Waited 890 ms on lock 0x7b54006400d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:28.549973 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2048091904}
I20260709 12:12:28.574688 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:28.595502 22532 raft_consensus.cc:2393] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 16: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:28.592669 22605 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 23.
W20260709 12:12:28.596949 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 46940.5us
I20260709 12:12:28.598439 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:28.493948 28968 consensus_queue.cc:1048] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.096s
I20260709 12:12:28.603241 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:28.605538 22421 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:28.609072 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:28.609668 22523 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:28.615020 22531 raft_consensus.cc:1240] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:28.616611 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:28.612783 22497 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:28.618016 23088 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:28.618161 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:28.619156 23088 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:28.619802 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:28.616164 28864 consensus_queue.cc:1059] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 12:12:28.621907 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:28.616343 29036 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.622913 29036 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:28.623354 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:28.624151 22532 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 15.
I20260709 12:12:28.624374 29126 consensus_queue.cc:1048] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:28.625773 29126 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:28.627331 28763 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:28.628612 22528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 2642) took 1284 ms. Trace:
I20260709 12:12:28.628953 22528 rpcz_store.cc:276] 0709 12:12:27.344421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.344529 (+   108us) service_pool.cc:224] Handling call
0709 12:12:27.355181 (+ 10652us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:27.706257 (+351076us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:28.628376 (+922119us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b54004015d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:28.628558 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":641126656}
W20260709 12:12:28.629974 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:28.631690 23088 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:28.596300 29064 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.632788 23088 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:28.634135 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:28.636567 29036 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:28.597374 29120 raft_consensus.cc:740] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:28.633512 22497 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:28.602087 28990 raft_consensus.cc:2749] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:28.638603 22598 raft_consensus.cc:1275] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 12:12:28.643503 22598 pending_rounds.cc:85] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc: Aborting all ops after (but not including) 12
W20260709 12:12:28.616432 29090 log.cc:927] Time spent T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.783s	user 0.009s	sys 0.000s
I20260709 12:12:28.643743 22598 pending_rounds.cc:107] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 12:12:28.644097 22598 raft_consensus.cc:2889] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:28.640664 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:28.596728 29104 raft_consensus.cc:697] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 19 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:28.608343 28978 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:28.659813 23124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 1487) took 1142 ms. Trace:
I20260709 12:12:28.651196 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:28.619444 28862 raft_consensus.cc:2749] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:28.607403 29007 consensus_queue.cc:1048] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 12:12:28.655824 28855 raft_consensus.cc:2749] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:28.659544 28830 raft_consensus.cc:2804] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:28.678485 28830 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:28.678957 28830 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:28.568372 29115 consensus_queue.cc:237] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:28.664259 28701 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:28.665750 28978 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:28.669449 29109 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:28.671957 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:28.660241 23124 rpcz_store.cc:276] 0709 12:12:27.517402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.164518 (+647116us) service_pool.cc:224] Handling call
0709 12:12:28.245969 (+ 81451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:28.246365 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:28.246407 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:28.246926 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 12:12:28.599111 (+352185us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:28.599168 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:28.599258 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:28.659628 (+ 60370us) raft_consensus.cc:1685] finished
0709 12:12:28.659649 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:28.659762 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":110709,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":139,"thread_start_us":260482,"threads_started":1,"wal-append.queue_time_us":390778}
I20260709 12:12:28.645253 28946 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:28.709821 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:28.659898 29127 raft_consensus.cc:2804] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:28.677852 29129 consensus_queue.cc:1048] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:28.641306 29023 consensus_queue.cc:1048] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 12:12:28.743535 22603 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:28.642745 28988 consensus_queue.cc:1048] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 12:12:28.680064 28763 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:28.643743 29064 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:28.773218 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 242849us
I20260709 12:12:28.659487 29079 consensus_queue.cc:1059] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.094s
W20260709 12:12:28.745126 28955 consensus_meta.cc:287] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 1.085s	user 0.008s	sys 0.015s
I20260709 12:12:28.778568 22570 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:28.690151 29098 consensus_queue.cc:1059] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 12:12:28.751802 29127 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:28.752666 28968 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:28.765331 28988 consensus_queue.cc:1243] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer 6c6fa11e8ee34711b3551f0c670442bc log is divergent from this leader: its last log entry 17.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
W20260709 12:12:28.787201 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 145266us
I20260709 12:12:28.764693 28763 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:28.796043 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 204432us
I20260709 12:12:28.739725 28701 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:28.807672 23120 raft_consensus.cc:1240] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 20 LEADER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:28.766443 28624 raft_consensus.cc:697] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:28.816236 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:28.794608 28958 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:12:28.758912 28946 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:28.817443 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:28.819952 22597 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 16.
I20260709 12:12:28.795653 29127 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:28.796358 29103 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:28.805338 28763 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:28.797034 28994 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:28.814946 29091 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:12:28.823838 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 150403us
I20260709 12:12:28.825508 22497 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:28.813161 29036 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.793671 28955 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:28.779210 28814 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:28.826928 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:28.833695 22602 raft_consensus.cc:2393] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 17: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:28.805351 28968 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:28.837301 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:28.824453 29079 consensus_queue.cc:1059] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.015s
I20260709 12:12:28.840626 28701 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:28.841544 22524 raft_consensus.cc:1240] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:28.841567 28814 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:28.859612 29064 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:28.841895 29131 log.cc:927] Time spent T 00000000000000000000000000000000 P 136fd3da76544029a815aef59e698e17: Append to log took a long time: real 0.095s	user 0.002s	sys 0.000s
I20260709 12:12:28.766814 29120 consensus_queue.cc:260] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:28.860736 29120 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:28.841542 22523 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 18.
W20260709 12:12:28.862428 29123 log.cc:927] Time spent T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.319s	user 0.000s	sys 0.001s
I20260709 12:12:28.862900 23088 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:28.855857 22422 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
W20260709 12:12:28.843575 29130 log.cc:927] Time spent T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 12:12:28.845598 28861 raft_consensus.cc:3055] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:28.845717 28946 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:28.835963 29016 consensus_queue.cc:1059] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:12:28.846912 29034 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:28.833040 28994 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:28.788544 29104 consensus_queue.cc:237] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:28.823463 29009 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:28.931879 29107 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:28.854849 22597 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 23.
I20260709 12:12:28.823503 28624 consensus_queue.cc:237] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:28.962783 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 106988us
I20260709 12:12:28.965555 22422 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:28.967032 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:28.967921 22597 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:28.967902 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:28.834146 29007 raft_consensus.cc:2804] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:28.973454 29007 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:28.943720 29137 log.cc:927] Time spent T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 12:12:28.976387 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:28.973901 29007 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:28.831259 29103 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:28.941347 28988 raft_consensus.cc:2749] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:28.959072 29064 raft_consensus.cc:3055] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:12:28.958911 29107 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:28.985297 29148 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:29.007068 29148 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:29.007409 29148 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:29.011080 29109 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:28.995182 22603 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 17.
I20260709 12:12:29.013854 22597 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 20.
I20260709 12:12:28.996284 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:29.014765 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:28.999615 22525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 2644) took 1654 ms. Trace:
I20260709 12:12:29.015471 22597 raft_consensus.cc:2368] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 19. Current term is 20.
I20260709 12:12:29.015410 22525 rpcz_store.cc:276] 0709 12:12:27.344998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.345123 (+   125us) service_pool.cc:224] Handling call
0709 12:12:27.385942 (+ 40819us) spinlock_profiling.cc:243] Waited 29.6 ms on lock 0x7b5800037898. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf907fc0 00007f9ccf8f2929 00007f9ccf8f23d2 00007f9cc8e69bd4
0709 12:12:27.386126 (+   184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:27.519465 (+133339us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:28.999365 (+1479900us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b54002ec554. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:28.999554 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":372876928}
W20260709 12:12:28.980871 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 152086us
I20260709 12:12:28.955454 29079 raft_consensus.cc:3055] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:28.982066 23116 raft_consensus.cc:1240] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:12:28.953058 28968 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:28.961947 28861 raft_consensus.cc:740] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:28.847921 29023 consensus_queue.cc:1048] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.126s
I20260709 12:12:28.834800 29091 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:29.026938 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:29.027372 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:29.027935 22457 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 16.
I20260709 12:12:29.015079 22497 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:29.028249 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:29.029237 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:29.029728 22449 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:12:29.029881 29091 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:29.023154 22422 leader_election.cc:400] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 election: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 19. Current term is 20.
I20260709 12:12:29.025053 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:29.030864 22422 leader_election.cc:403] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:12:29.030896 22457 raft_consensus.cc:1240] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 12:12:29.031587 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:28.999225 28867 raft_consensus.cc:3055] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:29.039443 28867 raft_consensus.cc:740] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:29.039870 29023 consensus_queue.cc:1243] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer 6c6fa11e8ee34711b3551f0c670442bc log is divergent from this leader: its last log entry 12.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:12:29.039943 28830 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:29.040424 28867 consensus_queue.cc:260] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:28.108278 22606 rpcz_store.cc:276] 0709 12:12:26.732871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.300636 (+567765us) service_pool.cc:224] Handling call
0709 12:12:27.301016 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:27.301380 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:12:27.640184 (+338804us) log.cc:844] Serialized 14 byte log entry
0709 12:12:28.076675 (+436491us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:28.076744 (+    69us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:12:28.076791 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:28.076869 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:28.080073 (+  3204us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":225667,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":16700,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":4826,"thread_start_us":774273,"threads_started":2}
I20260709 12:12:29.041461 28867 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:29.017658 29079 raft_consensus.cc:740] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:29.042140 28830 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:29.001791 29064 raft_consensus.cc:740] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:29.043576 28955 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:29.044817 22532 raft_consensus.cc:1240] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:12:29.023196 28835 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:29.063521 23123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 1495) took 1257 ms. Trace:
I20260709 12:12:29.063853 28835 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:29.026789 22454 raft_consensus.cc:1240] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:29.030062 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:29.043776 29064 consensus_queue.cc:260] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:29.047206 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:29.047335 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:29.075834 22451 raft_consensus.cc:2410] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:12:29.063916 23123 rpcz_store.cc:276] 0709 12:12:27.806254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.530585 (+724331us) service_pool.cc:224] Handling call
0709 12:12:28.530869 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:28.531992 (+  1123us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:28.532040 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:28.532883 (+   843us) log.cc:844] Serialized 26 byte log entry
0709 12:12:28.738562 (+205679us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:28.753518 (+ 14956us) log.cc:844] Serialized 14 byte log entry
0709 12:12:29.062882 (+309364us) spinlock_profiling.cc:243] Waited 4.36 ms on lock 0x7b18001516c0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc77bbc0a 00007f9cd0efb219 00007f9cc7843a40 00007f9cc783e4e4 00007f9cc783e455 00007f9cca926060 00007f9cca938716 00007f9cca949287 00007f9cca949208
0709 12:12:29.063105 (+   223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:29.063187 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:29.063235 (+    48us) raft_consensus.cc:1685] finished
0709 12:12:29.063327 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:29.063460 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6132,"prepare.queue_time_us":20224,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":3917,"raft.queue_time_us":3921,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"spinlock_wait_cycles":10018176,"thread_start_us":202331,"threads_started":1,"wal-append.queue_time_us":261843}
I20260709 12:12:29.047982 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:29.054423 28763 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:29.049705 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:29.050019 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:12:29.054682 29128 log.cc:927] Time spent T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.515s	user 0.000s	sys 0.002s
I20260709 12:12:28.992304 29103 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:29.001658 28994 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:29.056914 22601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3437) took 1468 ms. Trace:
I20260709 12:12:28.974781 28981 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:29.088495 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:29.089811 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:29.089933 28981 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:29.058630 29002 raft_consensus.cc:3055] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:29.090637 29002 raft_consensus.cc:740] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:29.088495 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:28.995144 28946 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:29.006453 29107 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:29.069084 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 252828us
I20260709 12:12:29.069550 22598 raft_consensus.cc:1275] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 12:12:29.069561 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:29.069810 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 206988us
I20260709 12:12:29.077629 28591 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:29.102187 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:29.070724 28861 consensus_queue.cc:260] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:29.000203 29009 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:29.111770 28861 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:29.112931 29007 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:29.115164 29037 consensus_queue.cc:1059] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:29.116161 29037 raft_consensus.cc:3055] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:29.116544 29037 raft_consensus.cc:740] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:29.116868 29007 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:29.117193 23120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 1451) took 1030 ms. Trace:
I20260709 12:12:29.117386 29037 consensus_queue.cc:260] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:29.117594 23120 rpcz_store.cc:276] 0709 12:12:28.087304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.565125 (+477821us) service_pool.cc:224] Handling call
0709 12:12:28.565348 (+   223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:28.811380 (+246032us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:29.116964 (+305584us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b54005f19d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:29.117136 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":556765952}
I20260709 12:12:29.072885 29001 raft_consensus.cc:2749] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:29.073714 23117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 1490) took 1528 ms. Trace:
I20260709 12:12:29.073860 29035 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.074098 29126 raft_consensus.cc:2749] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:28.866611 29098 consensus_queue.cc:1059] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.159s
I20260709 12:12:28.839380 29036 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:29.022751 29016 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.048050 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:29.078181 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:29.042743 28830 raft_consensus.cc:2804] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:29.076889 22448 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 18.
W20260709 12:12:29.081140 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 58035us
I20260709 12:12:29.082957 22601 rpcz_store.cc:276] 0709 12:12:27.588273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.076007 (+487734us) service_pool.cc:224] Handling call
0709 12:12:28.076342 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:28.494834 (+418492us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:28.494876 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:28.495358 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 12:12:28.745929 (+250571us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:28.745971 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:29.056500 (+310529us) spinlock_profiling.cc:243] Waited 85.3 ms on lock 0x7b54003ae8d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:29.056544 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:29.056593 (+    49us) raft_consensus.cc:1685] finished
0709 12:12:29.056606 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:29.056834 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":196143872,"thread_start_us":196554,"threads_started":1,"wal-append.queue_time_us":244601}
I20260709 12:12:29.087546 22449 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 18.
I20260709 12:12:29.060758 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:29.131629 22602 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:29.090864 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:29.132071 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:29.132532 22457 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:29.132949 22601 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 16.
I20260709 12:12:29.135070 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:12:29.135392 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:29.135663 22598 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:29.026578 28988 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:28.990167 28973 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:29.094041 22527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56940 (request call id 2648) took 1746 ms. Trace:
I20260709 12:12:29.068413 29084 raft_consensus.cc:2749] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:29.143561 22523 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 16.
I20260709 12:12:29.070922 29005 raft_consensus.cc:2804] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:29.093631 29002 consensus_queue.cc:260] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:29.106806 28944 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:29.042646 29079 consensus_queue.cc:260] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.16, Last appended by leader: 16, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:29.072237 23087 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:29.083745 29023 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:29.135128 28763 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 24 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:29.118734 29037 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:29.093685 28946 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:29.135665 23089 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:29.140256 22600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43070 (request call id 1117) took 2211 ms. Trace:
I20260709 12:12:29.140403 22527 rpcz_store.cc:276] 0709 12:12:27.347230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.347342 (+   112us) service_pool.cc:224] Handling call
0709 12:12:29.093878 (+1746536us) spinlock_profiling.cc:243] Waited 605 ms on lock 0x7b540014f854. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:29.093985 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1391270784}
I20260709 12:12:29.140003 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:29.175843 22600 rpcz_store.cc:276] 0709 12:12:26.928456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.550875 (+622419us) service_pool.cc:224] Handling call
0709 12:12:27.551248 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:28.116206 (+564958us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:28.116250 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:28.116783 (+   533us) log.cc:844] Serialized 26 byte log entry
0709 12:12:28.472473 (+355690us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:28.472518 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:28.472585 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:29.054139 (+581554us) spinlock_profiling.cc:243] Waited 48.2 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:12:29.136130 (+ 81991us) raft_consensus.cc:1685] finished
0709 12:12:29.136151 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:29.140193 (+  4042us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":47457,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":1359,"spinlock_wait_cycles":110947584,"thread_start_us":883499,"threads_started":2,"wal-append.queue_time_us":396276}
I20260709 12:12:29.177620 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:29.177747 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:29.178231 22601 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:12:29.141657 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:29.147953 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:29.179471 22532 raft_consensus.cc:2393] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 24: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:29.151264 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:29.180058 22525 raft_consensus.cc:2393] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 19: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:29.121007 28968 consensus_queue.cc:1048] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 12:12:29.182788 28682 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:29.135336 29064 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:29.157186 29005 raft_consensus.cc:697] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 18 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:29.185835 29005 consensus_queue.cc:237] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:29.186354 22605 raft_consensus.cc:1240] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:29.122320 28591 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:29.188417 22601 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 24.
I20260709 12:12:29.188791 28591 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:29.173753 29127 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:29.123365 23117 rpcz_store.cc:276] 0709 12:12:27.544988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.496736 (+951748us) service_pool.cc:224] Handling call
0709 12:12:28.531714 (+ 34978us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:28.588385 (+ 56671us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 12:12:28.600059 (+ 11674us) log.cc:844] Serialized 14 byte log entry
0709 12:12:29.069992 (+469933us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:29.070451 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 12:12:29.070595 (+   144us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:12:29.070628 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:29.070698 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:29.073506 (+  2808us) raft_consensus.cc:1685] finished
0709 12:12:29.073524 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:29.073653 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":247729,"prepare.queue_time_us":11478,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":253529,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":132,"thread_start_us":182039,"threads_started":1,"wal-append.queue_time_us":366257}
I20260709 12:12:29.196380 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:29.197041 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:29.197676 22605 raft_consensus.cc:1240] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 12:12:29.198063 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:29.198326 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:29.198720 22523 raft_consensus.cc:2368] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 16. Current term is 17.
I20260709 12:12:29.198925 22605 raft_consensus.cc:1275] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:29.199517 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:29.199591 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:29.200084 22605 raft_consensus.cc:1275] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:12:29.200567 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:29.200668 22532 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:46680
I20260709 12:12:29.201324 22605 raft_consensus.cc:1240] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:12:29.201488 22532 raft_consensus.cc:606] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Received request to transfer leadership to TS 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:29.201932 22532 raft_consensus.cc:614] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:29.202567 22605 raft_consensus.cc:1240] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:29.203605 28981 raft_consensus.cc:3055] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:29.203989 28981 raft_consensus.cc:740] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:29.197711 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:29.204787 28981 consensus_queue.cc:260] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:29.205941 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:29.206122 28981 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:29.206539 23116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 1496) took 1393 ms. Trace:
I20260709 12:12:29.162465 29002 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:29.213696 28987 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:29.135227 29016 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:29.216912 29016 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:29.143373 28988 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:29.219391 28988 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:29.164582 29126 raft_consensus.cc:2804] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:29.220188 29126 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:29.220587 29126 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:29.220945 22532 raft_consensus.cc:1240] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 18. Current term is 19. Ops: [16.14-18.15]
I20260709 12:12:29.129267 28945 consensus_queue.cc:1048] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.027s
W20260709 12:12:29.164183 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:29.151546 28830 raft_consensus.cc:697] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:29.224076 28830 consensus_queue.cc:237] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:29.224956 22525 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:29.225099 22601 raft_consensus.cc:1240] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 12:12:29.226425 22601 raft_consensus.cc:1240] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 19. Current term is 20. Ops: [16.13-19.15]
W20260709 12:12:29.160833 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 88666.1us
I20260709 12:12:29.129947 29035 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:29.227612 22601 raft_consensus.cc:1275] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:29.224876 28946 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:29.228343 29036 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:29.229851 29035 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:29.172989 29079 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:29.181018 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:29.181567 29009 raft_consensus.cc:2804] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:29.231215 29009 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:29.231630 29009 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:29.206036 29148 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:29.234302 29148 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 24 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:29.235524 22495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:29.166798 28973 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:29.168864 28835 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:29.238133 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 58628.1us
I20260709 12:12:29.240082 28591 consensus_queue.cc:1048] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:29.241729 22527 raft_consensus.cc:2410] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:12:29.242120 28988 consensus_queue.cc:1059] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:29.243274 28988 consensus_queue.cc:1243] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer 6c6fa11e8ee34711b3551f0c670442bc log is divergent from this leader: its last log entry 17.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:12:29.243736 28988 raft_consensus.cc:3055] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:29.243891 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:29.245066 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:29.246104 22457 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 17.
I20260709 12:12:29.226727 22497 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:29.194875 29127 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:29.247871 28835 consensus_queue.cc:1059] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:12:29.251384 29145 consensus_queue.cc:1048] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:29.247871 29009 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:29.254191 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:29.254742 29127 consensus_queue.cc:1059] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:29.255400 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:29.255694 29127 consensus_queue.cc:1243] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer 1676e7af5e4a47cb86ee7db83e3d4881 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:12:29.255908 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:29.256259 22531 raft_consensus.cc:2410] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:12:29.256461 29009 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:29.256290 29127 raft_consensus.cc:3055] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:29.257541 29127 raft_consensus.cc:740] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:29.257678 22531 raft_consensus.cc:1240] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:29.258689 29127 consensus_queue.cc:260] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:29.259575 22524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 1299) took 1610 ms. Trace:
I20260709 12:12:29.259975 22524 rpcz_store.cc:276] 0709 12:12:27.649446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.145455 (+496009us) service_pool.cc:224] Handling call
0709 12:12:28.162554 (+ 17099us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:28.859552 (+696998us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:29.259335 (+399783us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b54001f2f54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:29.259519 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1561080704}
I20260709 12:12:29.261438 22524 raft_consensus.cc:1240] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:29.206936 23116 rpcz_store.cc:276] 0709 12:12:27.813067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.542419 (+729352us) service_pool.cc:224] Handling call
0709 12:12:28.542755 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:29.017883 (+475128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:29.206262 (+188379us) spinlock_profiling.cc:243] Waited 439 ms on lock 0x7b54004e6454. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:29.206482 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1009543552}
I20260709 12:12:29.241567 28591 consensus_queue.cc:1059] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:29.244037 28988 raft_consensus.cc:740] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:29.249378 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:29.246176 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:29.250255 22598 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 17.
I20260709 12:12:29.278281 22497 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:29.161602 22602 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
I20260709 12:12:29.227522 23087 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:29.260432 29127 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:29.201346 22523 raft_consensus.cc:2393] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 24: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:29.267290 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:29.271170 29035 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:29.270633 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:29.270557 22524 raft_consensus.cc:3055] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:29.263031 22605 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 19.
I20260709 12:12:29.286628 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:29.273218 22525 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 16.
I20260709 12:12:29.266518 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:29.280383 22601 raft_consensus.cc:1240] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:29.281700 22497 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:29.254756 29023 raft_consensus.cc:2749] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 19. Current term is 20.
I20260709 12:12:29.292317 22452 raft_consensus.cc:1240] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:12:29.260667 28835 consensus_queue.cc:1048] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 12:12:29.284678 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:29.285475 22524 raft_consensus.cc:740] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:29.306058 22524 consensus_queue.cc:260] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:29.307636 22524 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:29.307875 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 95689us
W20260709 12:12:29.308485 22570 leader_election.cc:336] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 1.690s (SENT)
I20260709 12:12:29.308859 22570 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:29.309578 28946 raft_consensus.cc:2749] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:29.289405 23088 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:29.288210 22422 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:12:29.282996 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 55540.1us
I20260709 12:12:29.293505 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:29.294337 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:29.295529 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:29.304458 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:29.313194 22598 raft_consensus.cc:2393] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 11: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:29.273432 29104 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:12:29.314842 23118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57318 (request call id 1430) took 2238 ms (client timeout 1510 ms). Trace:
I20260709 12:12:29.314838 22605 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:29.310969 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:29.316076 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:29.317065 22602 raft_consensus.cc:2393] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 24: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
W20260709 12:12:29.318480 22529 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38310 (request call id 1305) took 1499 ms (client timeout 1620 ms). Trace:
I20260709 12:12:29.285709 29145 raft_consensus.cc:2804] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:29.293156 29036 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 24 FOLLOWER]: Leader election won for term 24
W20260709 12:12:29.321590 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:29.304965 28945 raft_consensus.cc:2804] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:29.334021 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:29.282421 29009 consensus_queue.cc:1059] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.039s
I20260709 12:12:29.311892 29078 raft_consensus.cc:2804] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:29.337492 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:29.294023 29002 consensus_queue.cc:1059] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 12:12:29.318117 28968 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:29.343515 28968 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:29.345883 28968 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:29.336342 29145 raft_consensus.cc:697] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:29.348651 29145 consensus_queue.cc:237] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:29.350005 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:29.304050 29035 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:29.354069 22449 raft_consensus.cc:2410] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:12:29.323693 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:29.326085 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:29.355154 29035 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:29.291594 28973 raft_consensus.cc:2749] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:29.355464 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:29.355683 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:29.327930 23087 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:29.328226 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:12:29.315968 23118 rpcz_store.cc:269] 0709 12:12:27.076804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.076936 (+   132us) service_pool.cc:224] Handling call
0709 12:12:29.313984 (+2237048us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54007f0154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:29.314778 (+   794us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2383116032}
I20260709 12:12:29.331040 23124 raft_consensus.cc:1240] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:29.267072 29016 consensus_queue.cc:1059] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 12:12:29.366194 22524 raft_consensus.cc:1275] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 12:12:29.318917 22529 rpcz_store.cc:269] 0709 12:12:27.819121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.908274 (+ 89153us) service_pool.cc:224] Handling call
0709 12:12:29.318321 (+1410047us) spinlock_profiling.cc:243] Waited 326 ms on lock 0x7b540038fed4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:29.318424 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":749588736}
I20260709 12:12:29.366730 22523 raft_consensus.cc:1240] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:29.322672 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:29.368006 22602 raft_consensus.cc:2393] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 19: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:29.368860 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:29.370481 22602 raft_consensus.cc:1240] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:29.356702 23120 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 16.
W20260709 12:12:29.357872 22495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:29.355443 22454 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 20.
I20260709 12:12:29.356706 22457 raft_consensus.cc:2393] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 24: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:29.372156 22454 raft_consensus.cc:1275] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:29.366305 22605 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 17.
I20260709 12:12:29.359086 22598 pending_rounds.cc:85] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting all ops after (but not including) 8
I20260709 12:12:29.373368 22598 pending_rounds.cc:107] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 12:12:29.373643 22598 raft_consensus.cc:2889] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:29.373680 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:29.374883 22605 raft_consensus.cc:1240] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:29.376299 22605 raft_consensus.cc:1240] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 LEADER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:29.378103 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:29.386700 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:29.391937 23122 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:29.387097 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:29.393129 23119 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 18.
I20260709 12:12:29.394152 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:29.394994 23119 raft_consensus.cc:2393] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 16: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:29.389477 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:12:29.390638 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 62788.3us
I20260709 12:12:29.391948 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:29.395902 23087 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:29.390688 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:29.396761 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:29.397948 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:29.357134 29036 raft_consensus.cc:697] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 24 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:29.405269 22454 raft_consensus.cc:1275] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:12:29.358369 28945 raft_consensus.cc:697] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:29.440096 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:29.435601 22457 raft_consensus.cc:1240] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 17. Current term is 18. Ops: []
W20260709 12:12:29.441345 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:29.332100 29032 consensus_queue.cc:1059] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.053s
I20260709 12:12:29.445082 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:29.373483 29078 raft_consensus.cc:697] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 16 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
W20260709 12:12:29.450803 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 54973us
I20260709 12:12:29.450372 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:29.486923 23087 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:29.390826 29030 raft_consensus.cc:3055] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:29.488828 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:29.497424 22454 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 11.
I20260709 12:12:29.498517 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:29.499086 22454 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 16.
I20260709 12:12:29.495436 23122 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 20.
W20260709 12:12:29.501645 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 173726us
I20260709 12:12:29.334354 29104 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:29.504596 23087 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:29.502965 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:29.522106 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:29.507565 22421 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:29.509531 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:29.333215 28988 consensus_queue.cc:260] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:29.449294 28995 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.450925 29125 raft_consensus.cc:2749] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:29.509653 22570 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:29.524179 22457 raft_consensus.cc:2393] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 24: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:29.496913 29030 raft_consensus.cc:740] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:29.511451 29032 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:29.545769 22454 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 19.
I20260709 12:12:29.546932 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:29.548341 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:29.523602 29137 log.cc:927] Time spent T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:12:29.550587 22421 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:29.549702 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:29.545841 22570 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:29.557942 28958 raft_consensus.cc:2804] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:29.558599 28958 raft_consensus.cc:697] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:29.559559 28958 consensus_queue.cc:237] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:29.559993 23087 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:29.562355 28973 raft_consensus.cc:2804] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:29.521391 29023 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:29.564260 22421 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
W20260709 12:12:29.565644 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:29.566677 23122 raft_consensus.cc:1240] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:29.566962 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:29.569319 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:29.573833 23087 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:29.537155 29064 raft_consensus.cc:2749] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:12:29.543251 29037 raft_consensus.cc:2749] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:29.554592 29120 raft_consensus.cc:2804] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:29.596745 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:29.600891 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:12:29.610034 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:29.593976 28994 consensus_queue.cc:1059] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:12:29.550673 28995 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:29.562788 28973 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:29.567107 28862 raft_consensus.cc:2749] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:29.628060 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:29.635494 22570 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:29.579840 28809 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:29.651029 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:29.594797 29121 raft_consensus.cc:2804] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:29.566560 28990 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:29.644805 22453 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 17.
I20260709 12:12:29.659147 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:29.660393 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:29.664181 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:29.645745 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:29.648694 22570 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:29.667060 22570 leader_election.cc:400] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 election: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 16. Current term is 17.
I20260709 12:12:29.667469 22570 leader_election.cc:403] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:12:29.668819 22452 raft_consensus.cc:2393] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 14: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:29.602020 29120 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:29.655659 23124 raft_consensus.cc:1275] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 12:12:29.649379 28930 raft_consensus.cc:2749] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:12:29.656291 29157 log.cc:927] Time spent T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.278s	user 0.000s	sys 0.001s
W20260709 12:12:29.662724 29164 log.cc:927] Time spent T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 12:12:29.669339 22457 raft_consensus.cc:2393] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 24: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:29.671175 22570 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:29.673627 22530 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:46680
I20260709 12:12:29.693849 22530 raft_consensus.cc:606] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:12:29.694320 22530 raft_consensus.cc:614] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:29.656248 22523 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 18.
I20260709 12:12:29.643245 28973 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:29.721892 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:29.649148 29138 raft_consensus.cc:3055] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:12:29.656744 29158 log.cc:927] Time spent T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 12:12:29.725705 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 54604.6us
I20260709 12:12:29.583074 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:29.643525 28701 raft_consensus.cc:2749] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:29.699743 29165 log.cc:927] Time spent T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 12:12:29.702090 29104 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:29.707635 29166 log.cc:927] Time spent T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:12:29.624081 29030 consensus_queue.cc:260] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:29.710080 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:29.736009 22450 raft_consensus.cc:2468] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
I20260709 12:12:29.599449 29078 consensus_queue.cc:237] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:29.742456 22569 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:29.675595 29120 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:29.698318 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:29.568622 28945 consensus_queue.cc:237] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:29.673372 28994 raft_consensus.cc:2749] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 16. Current term is 17.
I20260709 12:12:29.720414 22605 raft_consensus.cc:1240] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 16. Current term is 17. Ops: [15.13-16.14]
I20260709 12:12:29.672351 29121 raft_consensus.cc:697] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 17 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:29.641392 29036 consensus_queue.cc:237] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:29.549858 28978 consensus_queue.cc:1175] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8701cd5186a949538d8efafb5f987270" responder_term: 20 status { last_received { term: 20 index: 15 } last_committed_idx: 14 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 19. Current term is 20. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:12:29.756511 22453 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 20.
I20260709 12:12:29.759886 22451 raft_consensus.cc:1275] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:29.792829 22450 raft_consensus.cc:1240] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:29.761466 29037 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.729434 22454 raft_consensus.cc:1240] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 11. Current term is 12. Ops: [11.9-11.9]
W20260709 12:12:29.762344 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:29.763760 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:29.767669 29149 log.cc:927] Time spent T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.612s	user 0.004s	sys 0.000s
I20260709 12:12:29.770401 29107 raft_consensus.cc:2804] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:29.809739 29107 raft_consensus.cc:697] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 19 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:29.773815 29104 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:29.811269 29104 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:29.813764 29104 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:29.730598 29103 raft_consensus.cc:2749] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:29.729198 29138 raft_consensus.cc:740] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
W20260709 12:12:29.786758 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 222581us
I20260709 12:12:29.793290 22453 raft_consensus.cc:1275] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 12:12:29.668495 28990 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:29.795782 29030 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:29.747802 28930 consensus_queue.cc:1048] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
W20260709 12:12:29.790969 29126 consensus_meta.cc:287] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.570s	user 0.008s	sys 0.004s
W20260709 12:12:29.807129 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:29.787564 29157 log.cc:927] Time spent T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:12:29.808116 22452 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9286627b6c59411d908ec035984616ac"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:44568
I20260709 12:12:29.826166 22421 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:29.810735 29107 consensus_queue.cc:237] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:29.834369 22421 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 1.534s (SENT) [suppressed 15 similar messages]
I20260709 12:12:29.837122 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:29.832170 22452 raft_consensus.cc:606] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 18 LEADER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:12:29.834141 28981 raft_consensus.cc:2804] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:29.807844 28994 consensus_queue.cc:1059] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 15.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.036s
I20260709 12:12:29.874439 29121 consensus_queue.cc:237] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:29.874615 28981 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:29.876775 28981 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:29.878335 29016 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.878849 29016 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:29.882529 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:29.836817 29126 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:29.834710 29138 consensus_queue.cc:260] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:29.883163 28958 raft_consensus.cc:3055] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:29.883983 29138 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:29.884516 28958 raft_consensus.cc:740] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:29.885120 29126 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:29.886025 23116 raft_consensus.cc:2393] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 17: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:29.887154 29032 raft_consensus.cc:2749] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:29.887931 23117 raft_consensus.cc:1240] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:29.885528 28958 consensus_queue.cc:260] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:29.840945 28591 raft_consensus.cc:3055] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:29.818620 29037 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:29.891304 28995 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:12:29.894454 29124 log.cc:927] Time spent T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 1.356s	user 0.004s	sys 0.000s
W20260709 12:12:29.895535 28991 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
W20260709 12:12:29.918768 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 176407us
I20260709 12:12:29.834276 28862 consensus_queue.cc:1059] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.056s
I20260709 12:12:29.887935 29016 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:29.919922 22530 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b955a164159b49b9bf083e35e340e323"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:46680
I20260709 12:12:29.927000 22530 raft_consensus.cc:606] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Received request to transfer leadership to TS 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:29.927471 22530 raft_consensus.cc:614] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:29.899636 22526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 2358) took 2270 ms. Trace:
W20260709 12:12:29.922268 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:29.922945 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:29.917313 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 177085us
I20260709 12:12:29.930353 22570 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:29.933141 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:29.933984 22523 raft_consensus.cc:2410] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 12:12:29.929348 22569 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:29.940424 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:29.941960 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:29.954185 22452 raft_consensus.cc:2410] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 12:12:29.955673 22569 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:29.957356 22569 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:29.902944 28591 raft_consensus.cc:740] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:29.976290 22569 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:29.977692 22569 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:29.928140 22526 rpcz_store.cc:276] 0709 12:12:27.629681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.629822 (+   141us) service_pool.cc:224] Handling call
0709 12:12:27.644221 (+ 14399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:28.115101 (+470880us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:12:28.141307 (+ 26206us) log.cc:844] Serialized 14 byte log entry
0709 12:12:28.845026 (+703719us) spinlock_profiling.cc:243] Waited 3.15 ms on lock 0x7b1800430fc0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc7841522 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd 0000000000388634 0000000000388479 00007f9cc782483a
0709 12:12:29.094516 (+249490us) spinlock_profiling.cc:243] Waited 1.21 ms on lock 0x7b1800430fc0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc7823e07 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc7840c02 00007f9cca4c820b 00007f9cca4cdd23 00007f9cca4ce23a 00007f9cca938a2a
0709 12:12:29.150464 (+ 55948us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:29.156336 (+  5872us) log.cc:844] Serialized 26 byte log entry
0709 12:12:29.156483 (+   147us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:29.156514 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:29.766362 (+609848us) spinlock_profiling.cc:243] Waited 469 ms on lock 0x7b54001f3454. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:29.766409 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:29.899403 (+132994us) raft_consensus.cc:1685] finished
0709 12:12:29.899422 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:29.899555 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5829,"prepare.queue_time_us":26180,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":4029,"raft.queue_time_us":5460,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":8608,"spinlock_wait_cycles":1088274304,"thread_start_us":38942,"threads_started":1,"wal-append.queue_time_us":1169024}
I20260709 12:12:29.975010 28995 raft_consensus.cc:2749] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:29.972905 29129 raft_consensus.cc:3055] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:29.974799 28990 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:29.920850 28973 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:29.978806 29103 raft_consensus.cc:2749] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:29.988308 29127 consensus_meta.cc:287] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.703s	user 0.012s	sys 0.001s
W20260709 12:12:30.005285 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:30.006026 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:30.001447 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 167083us
I20260709 12:12:30.007566 23118 raft_consensus.cc:2468] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 14.
I20260709 12:12:29.977079 28981 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:29.989233 29064 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.991837 29032 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.014087 22526 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:46680
I20260709 12:12:30.017895 22526 raft_consensus.cc:606] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 LEADER]: Received request to transfer leadership to TS 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:29.989063 29129 raft_consensus.cc:740] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:30.021207 29037 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:30.015364 28591 consensus_queue.cc:260] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:30.022677 28591 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:30.004189 28995 raft_consensus.cc:2749] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:30.028748 22604 raft_consensus.cc:1240] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:12:30.029840 22599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 2994) took 2634 ms. Trace:
I20260709 12:12:30.037822 22421 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:30.019225 29016 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.030350 22599 rpcz_store.cc:276] 0709 12:12:27.395385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.052671 (+657286us) service_pool.cc:224] Handling call
0709 12:12:28.053321 (+   650us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:28.088608 (+ 35287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:28.088640 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:28.092433 (+  3793us) log.cc:844] Serialized 52 byte log entry
0709 12:12:28.158447 (+ 66014us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:28.232269 (+ 73822us) log.cc:844] Serialized 14 byte log entry
0709 12:12:28.241273 (+  9004us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:29.767338 (+1526065us) spinlock_profiling.cc:243] Waited 34.9 ms on lock 0x7b5400075dd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:29.767408 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:29.893824 (+126416us) spinlock_profiling.cc:243] Waited 47.1 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:12:30.029573 (+135749us) raft_consensus.cc:1685] finished
0709 12:12:30.029604 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:30.029767 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2348,"prepare.queue_time_us":84477,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":6760,"raft.queue_time_us":19947,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":20440,"spinlock_wait_cycles":188675200,"thread_start_us":39548,"threads_started":1,"wal-append.queue_time_us":435208}
I20260709 12:12:30.042071 22526 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:46680
I20260709 12:12:30.043398 22526 raft_consensus.cc:606] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Received request to transfer leadership to TS 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:30.043736 22526 raft_consensus.cc:614] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:30.029204 29103 raft_consensus.cc:2804] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:30.009368 29183 consensus_queue.cc:1048] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.037s
I20260709 12:12:30.027298 29182 raft_consensus.cc:2749] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:30.056663 22421 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:30.019562 29064 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:30.042642 28990 raft_consensus.cc:2749] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:30.026329 29032 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:30.078707 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:12:30.080919 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:30.082023 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:30.053269 29103 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:30.087827 29103 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:30.041942 29098 consensus_queue.cc:1059] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 12:12:30.068958 28930 raft_consensus.cc:2749] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:30.073374 29181 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.047359 29016 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:30.105134 29016 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:30.106081 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:30.109073 28944 raft_consensus.cc:2749] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:30.112723 22528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56940 (request call id 2664) took 1281 ms. Trace:
I20260709 12:12:30.147287 22528 rpcz_store.cc:276] 0709 12:12:28.831000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.092380 (+261380us) service_pool.cc:224] Handling call
0709 12:12:30.112353 (+1019973us) spinlock_profiling.cc:243] Waited 443 ms on lock 0x7b5400231754. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:30.112641 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1019311872}
I20260709 12:12:30.116777 29005 raft_consensus.cc:3055] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 12:12:30.153712 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 163653us
W20260709 12:12:30.124534 29179 log.cc:927] Time spent T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 12:12:30.124851 28958 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:30.126446 29023 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:30.127658 29120 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:30.128991 28973 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:30.131160 29016 consensus_queue.cc:1059] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:12:30.132573 29163 log.cc:927] Time spent T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.624s	user 0.002s	sys 0.000s
I20260709 12:12:30.137596 29032 leader_election.cc:290] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:30.141278 29009 raft_consensus.cc:3055] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:30.143139 28981 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:30.143890 29183 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.144538 29107 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.144871 28990 raft_consensus.cc:2749] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:30.145006 28930 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.106122 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:30.148454 22597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3441) took 1559 ms. Trace:
I20260709 12:12:30.251819 22597 rpcz_store.cc:276] 0709 12:12:28.589296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.016147 (+426851us) service_pool.cc:224] Handling call
0709 12:12:29.016411 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:29.016622 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:12:29.046382 (+ 29760us) log.cc:844] Serialized 14 byte log entry
0709 12:12:29.776015 (+729633us) spinlock_profiling.cc:243] Waited 19.9 ms on lock 0x7b1800482620. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc7823e07 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc7840c02 00007f9cca4c820b 00007f9cca4cdd23 00007f9cca4ce23a 00007f9cca938a2a
0709 12:12:30.098927 (+322912us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:30.100465 (+  1538us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:30.100829 (+   364us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:30.101243 (+   414us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:30.148397 (+ 47154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25567,"prepare.queue_time_us":28263,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":2342,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":49521,"spinlock_wait_cycles":103107584,"thread_start_us":320197,"threads_started":1,"wal-append.queue_time_us":1143330}
I20260709 12:12:30.121796 29103 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:30.179211 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:30.181044 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:30.151190 29005 raft_consensus.cc:740] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
W20260709 12:12:30.212838 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 235236us
I20260709 12:12:30.143189 29181 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:30.153746 29141 consensus_queue.cc:1059] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 12:12:30.195730 29023 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:30.249313 29184 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.247399 29182 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:30.238333 28947 raft_consensus.cc:3055] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:30.257212 22569 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:30.237594 29009 raft_consensus.cc:740] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
W20260709 12:12:30.262959 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 127893us
I20260709 12:12:30.268412 22569 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:30.273649 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 217084us
I20260709 12:12:30.258745 29001 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:30.250253 29183 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:30.263688 28947 raft_consensus.cc:740] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:30.252653 29107 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:30.257212 28930 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:30.313846 28990 consensus_queue.cc:1059] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:30.314307 22421 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:30.273511 29198 raft_consensus.cc:2749] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:30.325295 28947 consensus_queue.cc:260] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:30.325789 29196 log.cc:927] Time spent T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:12:30.326327 28947 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:30.335115 29201 raft_consensus.cc:2749] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:30.266855 29184 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:30.349267 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:30.304421 29001 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:30.362910 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 94587.9us
I20260709 12:12:30.363869 22569 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:30.269795 29182 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:30.366488 22569 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:30.317571 29005 consensus_queue.cc:260] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:30.382195 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:30.347795 29197 raft_consensus.cc:2749] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:30.380621 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:30.404989 22528 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 19.
W20260709 12:12:30.379397 29200 log.cc:927] Time spent T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:12:30.406854 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:30.407015 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:30.350994 29064 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:30.409336 23118 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:30.382109 29120 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:30.411739 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:30.380556 28930 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:30.381757 29181 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:30.379133 29183 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:30.321575 29009 consensus_queue.cc:260] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:30.352309 29198 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.339459 29206 consensus_queue.cc:1059] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.088s
I20260709 12:12:30.417959 22570 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
W20260709 12:12:30.411047 29199 log.cc:927] Time spent T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:12:30.408811 29005 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:30.424243 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 110062us
I20260709 12:12:30.427950 22421 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:30.430558 22421 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:30.412453 29114 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:30.434964 23118 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 19.
I20260709 12:12:30.422465 29198 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:30.435870 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:30.425747 29206 consensus_queue.cc:1243] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer 1676e7af5e4a47cb86ee7db83e3d4881 log is divergent from this leader: its last log entry 17.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:12:30.425895 28930 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.431120 29009 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:30.438750 22570 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
W20260709 12:12:30.444392 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:30.434669 29064 raft_consensus.cc:2749] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:30.433624 29181 raft_consensus.cc:2804] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:30.431309 29183 raft_consensus.cc:2749] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:30.425573 29209 raft_consensus.cc:2749] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:30.436934 22421 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:30.433364 29103 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:12:30.452116 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 85733.3us
W20260709 12:12:30.452517 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:30.452925 22569 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:30.453469 29206 raft_consensus.cc:3055] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:30.453826 29206 raft_consensus.cc:740] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:30.439560 29207 raft_consensus.cc:2804] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:30.456279 22421 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:30.459555 29141 raft_consensus.cc:3055] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:30.460062 29141 raft_consensus.cc:740] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:30.467166 29103 raft_consensus.cc:2749] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:30.467574 29107 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:12:30.469010 29170 log.cc:927] Time spent T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.902s	user 0.001s	sys 0.000s
W20260709 12:12:30.472168 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:30.447098 29120 raft_consensus.cc:2804] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:30.449579 29181 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:30.481815 29181 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:30.483783 29172 log.cc:927] Time spent T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.773s	user 0.005s	sys 0.000s
I20260709 12:12:30.457901 22569 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:30.486557 29201 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:30.491127 28867 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:30.491690 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 1.19579e+06us
I20260709 12:12:30.491623 28867 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:30.496078 29120 raft_consensus.cc:697] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 19 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
W20260709 12:12:30.496469 22603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45576 (request call id 3450) took 1895 ms (client timeout 1535 ms). Trace:
W20260709 12:12:30.496850 22603 rpcz_store.cc:269] 0709 12:12:28.601073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.603032 (+  1959us) service_pool.cc:224] Handling call
0709 12:12:30.496264 (+1893232us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b5400002154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:30.496373 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":321382784}
I20260709 12:12:30.497032 29120 consensus_queue.cc:237] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:30.448308 28930 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:30.500278 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:30.500890 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:30.501356 28991 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.501803 28991 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:30.503580 23116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57318 (request call id 1453) took 1179 ms. Trace:
W20260709 12:12:30.503803 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:30.504014 29201 raft_consensus.cc:2749] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:30.457533 29207 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:30.504658 29207 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:30.505107 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 48917.6us
W20260709 12:12:30.505296 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:30.507438 22421 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:30.508648 22453 raft_consensus.cc:1240] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 13. Current term is 14. Ops: []
W20260709 12:12:30.508783 29187 log.cc:927] Time spent T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.421s	user 0.002s	sys 0.000s
I20260709 12:12:30.510389 22452 raft_consensus.cc:1275] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 12:12:30.510614 29202 log.cc:927] Time spent T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:12:30.511325 22601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3467) took 1249 ms. Trace:
I20260709 12:12:30.511683 22601 rpcz_store.cc:276] 0709 12:12:29.261964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.771665 (+509701us) service_pool.cc:224] Handling call
0709 12:12:29.771994 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:29.772323 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:29.772352 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:29.772811 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 12:12:29.985327 (+212516us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:29.985366 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:29.985434 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:30.508241 (+522807us) spinlock_profiling.cc:243] Waited 8.07 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:12:30.511050 (+  2809us) raft_consensus.cc:1685] finished
0709 12:12:30.511071 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:30.511263 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":43353,"raft.run_cpu_time_us":48,"raft.run_wall_time_us":48,"spinlock_wait_cycles":18551680,"thread_start_us":212152,"threads_started":1,"wal-append.queue_time_us":300601}
I20260709 12:12:30.512859 29211 raft_consensus.cc:2749] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:30.514859 29103 raft_consensus.cc:2804] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:30.515246 29103 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:30.515484 22598 raft_consensus.cc:1275] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 24 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:12:30.515638 29103 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:30.517427 29001 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:30.518515 28988 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:30.457510 28942 raft_consensus.cc:2749] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 12:12:30.521485 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 63638.2us
I20260709 12:12:30.522270 22569 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:30.523090 22495 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:30.525527 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:30.526749 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:30.528702 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:30.529112 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:30.529881 23122 raft_consensus.cc:1240] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:30.530750 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:30.531345 22455 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 11.
I20260709 12:12:30.531647 22454 raft_consensus.cc:2393] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 20: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:30.527357 23125 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 16.
I20260709 12:12:30.503978 23116 rpcz_store.cc:276] 0709 12:12:29.323914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.325989 (+  2075us) service_pool.cc:224] Handling call
0709 12:12:30.503370 (+1177381us) spinlock_profiling.cc:243] Waited 530 ms on lock 0x7b54004e4154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:30.503499 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1218224384}
W20260709 12:12:30.535772 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:30.535902 22495 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:30.503415 28930 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:30.536775 22601 raft_consensus.cc:1240] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:30.537618 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:30.540663 23121 raft_consensus.cc:1240] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 18. Current term is 19. Ops: [16.13-18.14]
I20260709 12:12:30.543725 22495 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:30.545154 28991 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:30.531476 29209 raft_consensus.cc:2749] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:30.548085 28861 raft_consensus.cc:3055] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:30.548492 28861 raft_consensus.cc:740] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:30.549319 28861 consensus_queue.cc:260] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:30.552489 22452 raft_consensus.cc:1275] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:30.552126 29129 consensus_queue.cc:260] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:30.553520 29129 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:30.553937 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:30.554513 22452 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:30.558465 22454 raft_consensus.cc:1240] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 12:12:30.541887 28945 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:30.560428 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:30.546893 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:30.562006 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:30.564311 23120 raft_consensus.cc:1240] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 16 LEADER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:30.575630 22569 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:30.576186 22450 raft_consensus.cc:2393] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 12: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:30.550719 28861 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:30.594640 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:30.533007 29079 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.600823 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:30.601462 22569 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:30.602773 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:30.602694 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:30.607223 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:30.607298 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:30.607734 23087 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:30.607894 22454 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:30.608393 23121 raft_consensus.cc:1240] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:30.609210 23118 raft_consensus.cc:2410] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:12:30.608431 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:30.610381 22448 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 22.
I20260709 12:12:30.612046 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:30.614101 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:30.614704 22451 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:12:30.620236 22421 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:30.612874 22448 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 11.
I20260709 12:12:30.564536 28947 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:30.623862 22449 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 3188) took 1354 ms (client timeout 1737 ms). Trace:
I20260709 12:12:30.627097 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:30.627517 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:30.627300 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:30.627794 22529 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 19.
W20260709 12:12:30.627266 22449 rpcz_store.cc:269] 0709 12:12:29.269097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.293198 (+ 24101us) service_pool.cc:224] Handling call
0709 12:12:30.623666 (+1330468us) spinlock_profiling.cc:243] Waited 41.3 ms on lock 0x7b540037a354. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:30.623805 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":95031552}
I20260709 12:12:30.563004 29036 raft_consensus.cc:2749] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:30.535934 28994 consensus_queue.cc:1048] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.079s
I20260709 12:12:30.600955 28945 raft_consensus.cc:2749] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:30.625916 22421 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:30.630471 22523 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:30.630615 22526 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 18.
I20260709 12:12:30.634898 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:30.635246 22450 raft_consensus.cc:1275] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:30.644346 22525 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 13.
I20260709 12:12:30.627840 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:30.645147 23119 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:30.641769 22454 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 18.
W20260709 12:12:30.642287 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:30.600823 28930 consensus_queue.cc:1048] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.023s
I20260709 12:12:30.621466 29209 raft_consensus.cc:2749] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:30.602722 29183 raft_consensus.cc:2749] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:30.648214 22454 raft_consensus.cc:1275] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:30.648804 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:12:30.647207 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:30.616297 29182 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:30.460865 29141 consensus_queue.cc:260] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:30.614228 28862 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.653357 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:30.674961 22451 raft_consensus.cc:2393] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 20: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:30.624251 29001 raft_consensus.cc:2749] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:12:30.652566 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:30.654042 22524 raft_consensus.cc:1240] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 12:12:30.655210 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:30.660389 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:30.676942 23123 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:30.677291 23124 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 16.
I20260709 12:12:30.636830 29148 raft_consensus.cc:2804] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:30.662906 23117 raft_consensus.cc:1240] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:30.619665 28701 consensus_queue.cc:1048] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 12:12:30.600668 29213 consensus_queue.cc:1059] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 12:12:30.538244 29206 consensus_queue.cc:260] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:30.663017 23121 raft_consensus.cc:2410] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:12:30.673537 23119 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 17.
I20260709 12:12:30.679153 22450 raft_consensus.cc:1275] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:12:30.679502 22497 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:30.622409 29079 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:30.685137 22530 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 14.
I20260709 12:12:30.685967 22523 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 17.
I20260709 12:12:30.653379 28990 raft_consensus.cc:2749] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:30.687960 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 144310us
I20260709 12:12:30.643280 28947 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:30.700863 23124 raft_consensus.cc:1275] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:12:30.705651 28946 raft_consensus.cc:3055] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:30.706195 28946 raft_consensus.cc:740] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:30.708693 29079 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:30.709717 29079 raft_consensus.cc:2804] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:30.710222 29079 raft_consensus.cc:697] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:30.676512 29114 consensus_queue.cc:1048] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 12:12:30.683221 29148 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:30.696504 29098 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.729571 23123 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 17.
I20260709 12:12:30.731389 23089 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:30.742209 29181 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:30.692807 29211 consensus_queue.cc:1175] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8701cd5186a949538d8efafb5f987270" responder_term: 19 status { last_received { term: 18 index: 12 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 18. Current term is 19. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:12:30.749050 29001 raft_consensus.cc:2804] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:30.680100 28862 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:30.719767 29114 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.723256 29148 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:30.766706 22452 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 17.
I20260709 12:12:30.755862 29001 raft_consensus.cc:697] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 17 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:30.754828 29198 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:30.798760 28867 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:30.799432 28867 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.799876 28867 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:30.800088 29207 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:30.801914 28867 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:30.802088 29207 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:30.747884 29098 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:30.804921 29098 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:30.807130 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:30.808570 29206 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:30.815749 23124 raft_consensus.cc:1275] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:12:30.816814 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:30.817939 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:30.818548 23119 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 20.
I20260709 12:12:30.823755 29141 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:30.755132 29103 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:30.828833 29103 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:30.829685 29001 consensus_queue.cc:237] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:30.832116 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:30.833835 29181 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:30.836838 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:30.837432 22601 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 19.
I20260709 12:12:30.838424 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:30.839010 22530 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 10.
I20260709 12:12:30.841293 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:30.843549 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:30.843645 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:30.844494 22601 raft_consensus.cc:2410] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:12:30.845728 23120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 1664) took 1462 ms. Trace:
I20260709 12:12:30.846086 23120 rpcz_store.cc:276] 0709 12:12:29.383529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.383684 (+   155us) service_pool.cc:224] Handling call
0709 12:12:29.384032 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:30.564752 (+1180720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:30.845510 (+280758us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b540059b354. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:30.845678 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2714084096}
I20260709 12:12:30.847821 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:12:30.848235 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 152180us
W20260709 12:12:30.848984 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:30.853957 22422 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:30.846006 22456 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 17.
I20260709 12:12:30.858388 22600 raft_consensus.cc:1240] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 19. Current term is 20. Ops: [16.13-19.15]
I20260709 12:12:30.779058 29184 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:30.861555 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:30.879714 22525 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:12:30.862555 22530 raft_consensus.cc:1275] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:30.880508 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:30.865463 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:12:30.881167 29210 log.cc:927] Time spent T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
I20260709 12:12:30.867523 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:30.881953 23120 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:30.881884 29198 consensus_queue.cc:1048] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:12:30.863168 29084 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:30.883070 29084 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:30.874399 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:30.885511 22527 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:30.861078 28981 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:30.899236 28981 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:30.899757 28947 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:30.900333 28947 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:30.900763 28947 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:30.901432 28981 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:30.902222 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:30.903456 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:30.771874 29114 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:30.913087 29114 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:30.915899 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:30.916539 22457 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 2474) took 1394 ms. Trace:
I20260709 12:12:30.875317 28867 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:30.876010 29035 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:30.877146 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:30.850317 29216 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:30.874250 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:30.887557 23119 raft_consensus.cc:1275] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 12:12:30.889050 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:30.725016 29079 consensus_queue.cc:237] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:30.890515 23120 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 17.
I20260709 12:12:30.870285 22570 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:30.940619 23117 raft_consensus.cc:2393] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 18: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
W20260709 12:12:30.941039 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 70861.1us
I20260709 12:12:30.891443 23125 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 21.
I20260709 12:12:30.892963 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:30.893961 22597 raft_consensus.cc:1240] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:30.895222 29084 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:30.896463 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:30.898571 28862 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:30.916460 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:30.944144 22598 raft_consensus.cc:2393] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 11: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:30.944382 22602 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 22.
I20260709 12:12:30.881266 22606 raft_consensus.cc:2393] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 20: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:30.924737 22527 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 20.
I20260709 12:12:30.934821 22600 raft_consensus.cc:1275] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:12:30.945161 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:30.915441 29023 consensus_meta.cc:287] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.648s	user 0.009s	sys 0.001s
I20260709 12:12:30.902768 28947 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:30.946058 22422 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:30.930017 23123 raft_consensus.cc:1275] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 12:12:30.948280 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:30.950220 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:30.950707 23123 pending_rounds.cc:85] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270: Aborting all ops after (but not including) 11
I20260709 12:12:30.950920 22599 raft_consensus.cc:2393] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 17: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:30.950961 23123 pending_rounds.cc:107] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 12:12:30.951385 23123 raft_consensus.cc:2889] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:30.771013 28946 consensus_queue.cc:260] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:30.954485 22603 raft_consensus.cc:1240] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 19 LEADER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 12:12:30.956025 28862 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:30.918443 22457 rpcz_store.cc:276] 0709 12:12:29.521994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.725140 (+203146us) service_pool.cc:224] Handling call
0709 12:12:30.624286 (+899146us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:30.624542 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:12:30.649751 (+ 25209us) log.cc:844] Serialized 14 byte log entry
0709 12:12:30.848682 (+198931us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:30.848731 (+    49us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:30.848772 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:30.848842 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:30.916380 (+ 67538us) spinlock_profiling.cc:243] Waited 881 ms on lock 0x7b540037a350. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:30.916483 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22064,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":411,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":54297,"spinlock_wait_cycles":2026096512,"thread_start_us":198594,"threads_started":1}
I20260709 12:12:30.929981 29035 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:30.962329 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:30.963306 22598 raft_consensus.cc:2393] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 16: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:30.948266 28995 raft_consensus.cc:2804] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:30.952383 29207 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:30.976847 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:30.979564 22606 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 15.
I20260709 12:12:30.961880 28862 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:30.969035 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:30.986413 22598 raft_consensus.cc:1275] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 16 index: 16. (index mismatch)
I20260709 12:12:30.964849 28947 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.986187 29120 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.989274 29207 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:30.991160 29120 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:30.993355 29207 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:30.994378 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:30.996901 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:30.997532 23122 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
I20260709 12:12:30.998243 29120 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:30.943650 29216 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:31.004662 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:31.005041 29216 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:31.005573 23116 raft_consensus.cc:2410] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 21 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 12:12:30.959981 29036 consensus_queue.cc:1059] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.030s
I20260709 12:12:30.951409 29148 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:30.968526 28995 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:31.008420 28995 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:31.009346 29148 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:31.010203 29216 raft_consensus.cc:3055] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:31.010715 29216 raft_consensus.cc:740] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:30.953966 29023 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:31.011761 29216 consensus_queue.cc:260] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:30.982893 23089 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:30.985512 23087 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:30.949784 29005 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:30.943567 28867 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:30.988736 28862 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:31.037870 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:31.040966 23121 raft_consensus.cc:2393] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 19: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:31.042920 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:31.044050 22457 raft_consensus.cc:2410] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 12:12:31.047456 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:31.048508 28867 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:31.030656 29211 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:31.050472 29211 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:31.030861 28973 raft_consensus.cc:2804] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:31.052069 28973 raft_consensus.cc:697] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 17 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:31.052978 28973 consensus_queue.cc:237] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:31.028048 28701 consensus_queue.cc:1059] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 12:12:30.962165 29035 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:31.059731 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 361806us
I20260709 12:12:31.062767 22569 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:31.072283 22495 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:31.077262 22570 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:12:31.056016 28988 consensus_meta.cc:287] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.537s	user 0.005s	sys 0.005s
I20260709 12:12:31.078351 28867 consensus_queue.cc:1048] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 12:12:31.114748 29198 raft_consensus.cc:2804] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:31.115248 29198 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:31.115598 29198 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:31.012261 28947 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:31.055536 28701 consensus_queue.cc:1243] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer 6c6fa11e8ee34711b3551f0c670442bc log is divergent from this leader: its last log entry 18.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
W20260709 12:12:31.118589 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:31.120287 22453 raft_consensus.cc:1275] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260709 12:12:31.034092 29084 consensus_queue.cc:1048] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.038s
W20260709 12:12:31.117148 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 247837us
I20260709 12:12:31.118639 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:31.034413 29005 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:31.122120 22453 pending_rounds.cc:85] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f: Aborting all ops after (but not including) 14
I20260709 12:12:31.073225 22569 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:31.136397 22453 pending_rounds.cc:107] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 12:12:31.136776 22453 raft_consensus.cc:2889] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:12:31.129088 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:31.138767 22600 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:31.078475 29207 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:31.119303 29223 raft_consensus.cc:2764] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:12:31.141778 29207 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:31.140478 29120 raft_consensus.cc:2804] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:31.143206 29120 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:31.143559 29120 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:31.142818 29207 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:12:31.136740 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 63622us
I20260709 12:12:31.160271 22569 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:31.120258 29023 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:31.164414 22569 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:31.136866 29084 consensus_queue.cc:1243] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer 6c6fa11e8ee34711b3551f0c670442bc log is divergent from this leader: its last log entry 17.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
W20260709 12:12:31.172331 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 296598us
I20260709 12:12:31.173938 23089 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:31.138140 29064 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.166663 29218 raft_consensus.cc:2749] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:31.189474 22496 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:31.121328 29225 consensus_queue.cc:1048] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 12:12:31.175150 29184 raft_consensus.cc:2804] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:31.139690 28995 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:31.203043 23124 raft_consensus.cc:1240] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 17 LEADER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:31.212009 22600 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 20.
W20260709 12:12:31.211838 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 202841us
W20260709 12:12:31.214097 22421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:31.179502 28944 consensus_queue.cc:1048] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:12:31.180586 28994 consensus_queue.cc:1048] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.018s
W20260709 12:12:31.216943 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 76954.5us
I20260709 12:12:31.214941 22422 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:31.230824 22495 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:31.203941 29009 raft_consensus.cc:2804] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:12:31.227424 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 87672.1us
I20260709 12:12:31.184146 29064 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:31.235214 29206 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:31.237635 28981 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.244881 29206 raft_consensus.cc:697] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:31.245863 29206 consensus_queue.cc:237] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:31.246600 29226 log.cc:927] Time spent T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:12:31.247843 28867 consensus_queue.cc:1059] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 12:12:31.199313 29207 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:31.224391 29184 raft_consensus.cc:697] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:31.236263 29009 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:31.272248 22600 raft_consensus.cc:1275] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:12:31.263543 22528 raft_consensus.cc:1240] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:31.268512 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:31.216120 28991 consensus_queue.cc:1059] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 12:12:31.256099 22599 raft_consensus.cc:1275] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 12:12:31.273391 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 45814.5us
I20260709 12:12:31.273511 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:31.286859 22421 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:31.287325 22606 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 20.
I20260709 12:12:31.275849 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:31.289179 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:31.290434 22599 raft_consensus.cc:1240] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:31.270486 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:31.242029 28981 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:31.280014 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:31.281034 23117 raft_consensus.cc:1240] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:31.242475 29218 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.240828 29211 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:31.274431 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:31.294310 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:31.297173 22530 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 15.
I20260709 12:12:31.297304 22599 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 16.
I20260709 12:12:31.300079 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:31.300832 22599 raft_consensus.cc:2368] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 22. Current term is 23.
I20260709 12:12:31.301429 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:31.278008 29009 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:31.303732 22421 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:31.306835 22421 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:31.282900 29225 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:31.279528 29221 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.308367 22606 raft_consensus.cc:1275] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:31.292326 29084 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:31.321352 29230 log.cc:927] Time spent T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:12:31.321449 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:31.322237 22602 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 19.
I20260709 12:12:31.324003 29207 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 23 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:31.324343 22531 raft_consensus.cc:1240] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:31.325934 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:31.327450 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:12:31.328213 29222 log.cc:927] Time spent T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.140s	user 0.002s	sys 0.000s
I20260709 12:12:31.329099 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:31.330890 29005 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:31.331722 29084 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:31.334026 29084 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:31.335520 28987 raft_consensus.cc:993] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881: : Instructing follower 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:12:31.335664 29242 raft_consensus.cc:3055] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:31.336141 29242 raft_consensus.cc:740] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:31.336251 28981 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:31.336428 29035 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:31.337208 29242 consensus_queue.cc:260] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:31.338465 29242 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:31.338542 29035 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:31.339884 29233 raft_consensus.cc:1081] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 LEADER]: Signalling peer 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:12:31.303676 28995 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:31.343557 23088 leader_election.cc:336] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 1.620s (SENT)
I20260709 12:12:31.344022 23088 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:31.350607 28862 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:31.308845 22421 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:31.352264 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:31.352819 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 44076.1us
I20260709 12:12:31.353840 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:31.354233 22421 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:31.354398 22528 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 16.
I20260709 12:12:31.286321 28947 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:31.355232 29016 raft_consensus.cc:2804] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:12:31.355446 29240 log.cc:927] Time spent T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:12:31.355701 28995 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.356413 28981 raft_consensus.cc:2749] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:31.356222 28995 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:31.357213 29219 log.cc:927] Time spent T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.182s	user 0.000s	sys 0.000s
I20260709 12:12:31.357825 29064 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:31.358367 22528 raft_consensus.cc:1275] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:31.355724 29016 raft_consensus.cc:697] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:31.360169 22528 raft_consensus.cc:1275] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 12:12:31.360504 22528 pending_rounds.cc:85] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting all ops after (but not including) 12
I20260709 12:12:31.360709 22528 pending_rounds.cc:107] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 12:12:31.360975 22528 raft_consensus.cc:2889] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:31.360838 29016 consensus_queue.cc:237] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:31.361563 22421 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:31.362310 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:31.363132 29184 consensus_queue.cc:237] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:31.330336 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:31.365264 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:31.365976 23124 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 17.
I20260709 12:12:31.314018 29220 raft_consensus.cc:2804] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:31.367624 29220 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:31.317368 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:31.367949 29229 log.cc:927] Time spent T 00000000000000000000000000000000 P 136fd3da76544029a815aef59e698e17: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:12:31.336019 28987 raft_consensus.cc:3055] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:31.368642 28995 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:31.367437 29030 consensus_queue.cc:1048] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:31.368137 22570 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:31.369562 28946 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:31.368673 28987 raft_consensus.cc:740] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:31.351971 29005 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:31.372048 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:31.372864 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:31.373795 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:31.373970 28987 consensus_queue.cc:260] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:31.375200 28987 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:31.379806 23116 raft_consensus.cc:1275] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:31.381181 23122 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 20.
I20260709 12:12:31.382618 22450 raft_consensus.cc:2393] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 23: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:31.382962 28995 raft_consensus.cc:2804] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:31.303790 29218 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:31.383421 28995 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:31.383860 28995 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:31.384915 29218 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:31.292862 28867 consensus_queue.cc:1048] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.078s
I20260709 12:12:31.389798 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:31.390255 29120 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:31.391415 22598 raft_consensus.cc:2393] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 14: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:31.392287 29120 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:31.392127 28867 consensus_queue.cc:1048] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:31.393258 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:31.393939 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:31.394912 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:31.395226 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:31.396716 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:31.397356 22603 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:31.400120 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:31.398607 22599 raft_consensus.cc:1240] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 LEADER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:31.401213 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:31.313506 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:31.402076 22597 raft_consensus.cc:2393] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 23: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
W20260709 12:12:31.317322 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 127949us
I20260709 12:12:31.402948 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:31.400439 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:31.404662 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:31.405385 23122 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:31.307864 29211 raft_consensus.cc:2804] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:31.393288 22497 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:31.398579 22570 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:31.400733 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:12:31.412493 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:31.412761 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:31.401052 28862 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 23 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:31.418087 23122 raft_consensus.cc:2468] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 15.
W20260709 12:12:31.419396 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 245536us
I20260709 12:12:31.318688 28988 raft_consensus.cc:2804] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:31.422719 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:31.428236 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:31.428555 22602 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 20.
I20260709 12:12:31.423516 22523 raft_consensus.cc:1275] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 16 index: 16. (index mismatch)
I20260709 12:12:31.423952 22603 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 20.
I20260709 12:12:31.424795 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:31.431125 22528 raft_consensus.cc:2410] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 19 because replica has last-logged OpId of term: 17 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 15.
I20260709 12:12:31.431311 22605 raft_consensus.cc:1275] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:12:31.368100 29220 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:31.426522 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:31.448576 23123 raft_consensus.cc:2410] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:12:31.363134 29141 raft_consensus.cc:2749] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:31.433878 22421 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:31.395140 29148 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.449982 22453 raft_consensus.cc:2393] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 20: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:31.397891 29078 raft_consensus.cc:3055] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:31.428237 23089 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:31.451215 22604 pending_rounds.cc:85] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc: Aborting all ops after (but not including) 12
I20260709 12:12:31.457527 22604 pending_rounds.cc:107] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 12:12:31.457875 22604 raft_consensus.cc:2889] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:12:31.452313 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 59096.7us
I20260709 12:12:31.453760 22597 raft_consensus.cc:1240] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 12:12:31.410785 29207 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:31.414439 29211 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:31.426215 29184 raft_consensus.cc:2804] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:31.413832 28987 consensus_queue.cc:1059] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 12:12:31.371505 28991 consensus_queue.cc:1048] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.077s
I20260709 12:12:31.469590 22422 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:12:31.471283 22421 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:31.414170 29084 consensus_queue.cc:1048] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.055s
I20260709 12:12:31.421734 29218 consensus_queue.cc:1048] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 12:12:31.450098 29148 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:31.446336 28981 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:31.481413 22496 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:31.371161 29221 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:31.483333 22422 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:31.460400 29243 raft_consensus.cc:2804] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:31.472683 29181 raft_consensus.cc:2749] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:31.461601 28988 raft_consensus.cc:697] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:31.455928 29078 raft_consensus.cc:740] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:31.473259 29211 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:31.489152 28862 raft_consensus.cc:2804] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:31.454504 28973 consensus_queue.cc:1048] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.039s
I20260709 12:12:31.490341 29184 raft_consensus.cc:697] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:31.493275 29001 raft_consensus.cc:2749] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:31.477877 29207 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:31.527292 29181 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:31.486701 29079 consensus_queue.cc:1048] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 12:12:31.522614 28862 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:31.522737 29120 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:31.531502 28988 consensus_queue.cc:237] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:31.478926 29198 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:31.502532 29224 consensus_queue.cc:1059] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 12:12:31.533102 29225 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:12:31.507838 29245 log.cc:927] Time spent T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 12:12:31.532711 29184 consensus_queue.cc:237] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:31.569240 29181 raft_consensus.cc:697] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:31.619714 22601 raft_consensus.cc:2393] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 16: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:31.473191 29249 consensus_queue.cc:1048] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 12:12:31.500726 29243 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:31.498198 28981 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:31.532155 28945 raft_consensus.cc:2804] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:31.520839 28995 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:31.520915 29206 raft_consensus.cc:2804] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:31.541188 29211 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:31.619014 22525 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 11.
I20260709 12:12:31.574815 28862 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:31.614775 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:31.621529 22569 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:31.783141 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 161737us
I20260709 12:12:31.785018 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:31.785763 22456 raft_consensus.cc:2368] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 22. Current term is 23.
I20260709 12:12:31.683408 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:31.786252 22453 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 19.
I20260709 12:12:31.787082 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:31.782409 22450 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 20.
I20260709 12:12:31.787213 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:31.789150 22450 raft_consensus.cc:1275] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:12:31.790282 22453 raft_consensus.cc:1275] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:12:31.680877 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:31.581542 29120 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:31.575945 29232 raft_consensus.cc:2749] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:31.609579 29114 raft_consensus.cc:2749] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:31.640673 29016 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.575971 28947 consensus_queue.cc:1048] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.105s
I20260709 12:12:31.685617 22606 raft_consensus.cc:2410] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:12:31.640260 29243 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:31.776331 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 305121us
I20260709 12:12:31.781384 29206 raft_consensus.cc:697] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 15 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
W20260709 12:12:31.685345 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 202106us
I20260709 12:12:31.791500 22455 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
I20260709 12:12:31.793664 22453 raft_consensus.cc:1240] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 LEADER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 19. Current term is 20. Ops: []
W20260709 12:12:31.774066 29245 log.cc:927] Time spent T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:12:31.681643 29009 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:31.825040 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 396881us
I20260709 12:12:31.807264 22450 raft_consensus.cc:1240] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 12:12:31.777868 28994 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.609854 29078 consensus_queue.cc:260] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:31.855324 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 396566us
I20260709 12:12:31.965122 29078 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:31.965502 22497 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:31.966497 22497 leader_election.cc:400] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 pre-election: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 22. Current term is 23.
I20260709 12:12:31.966761 22497 leader_election.cc:403] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:31.967295 29249 raft_consensus.cc:2804] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:31.967725 29249 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:31.967965 28995 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:31.968233 29249 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:31.969225 29148 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:31.856009 22448 raft_consensus.cc:2393] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 14: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:31.971410 23089 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:31.939873 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:31.786795 29197 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:31.972846 29207 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:31.972921 29197 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.796053 28945 raft_consensus.cc:697] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
W20260709 12:12:31.961591 29253 log.cc:927] Time spent T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.185s	user 0.000s	sys 0.000s
I20260709 12:12:31.979633 22497 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:31.905382 29181 consensus_queue.cc:237] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:31.964041 28981 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:31.975838 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:31.976214 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:31.984350 23122 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:31.952437 29252 log.cc:927] Time spent T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.211s	user 0.000s	sys 0.011s
I20260709 12:12:31.982867 29217 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Advancing to term 23
W20260709 12:12:31.974076 29250 log.cc:927] Time spent T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.458s	user 0.000s	sys 0.001s
I20260709 12:12:31.991406 29079 consensus_queue.cc:1048] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:31.945081 28701 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.992213 29260 raft_consensus.cc:2749] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:31.992264 29262 consensus_queue.cc:1048] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:31.973609 29197 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:31.967968 29211 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:31.995049 29225 raft_consensus.cc:2804] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:31.998034 29120 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:12:31.998580 29257 log.cc:927] Time spent T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.198s	user 0.000s	sys 0.000s
I20260709 12:12:31.999171 29247 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:12:32.012720 29220 consensus_meta.cc:287] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.550s	user 0.011s	sys 0.000s
W20260709 12:12:32.000432 29251 log.cc:927] Time spent T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.307s	user 0.000s	sys 0.001s
I20260709 12:12:32.000034 28945 consensus_queue.cc:237] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:32.003959 29206 consensus_queue.cc:237] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:32.005183 22495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:31.995085 23125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 1477) took 1011 ms. Trace:
I20260709 12:12:32.012154 23122 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 18.
W20260709 12:12:32.033761 23088 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.015s	sys 0.021s
W20260709 12:12:31.999801 29259 log.cc:927] Time spent T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.209s	user 0.000s	sys 0.000s
W20260709 12:12:32.061496 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.035660 29225 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:32.124270 22570 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:31.957758 29016 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:32.120281 23125 rpcz_store.cc:276] 0709 12:12:30.983944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.984770 (+   826us) service_pool.cc:224] Handling call
0709 12:12:30.985027 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:31.175424 (+190397us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:12:31.186237 (+ 10813us) log.cc:844] Serialized 14 byte log entry
0709 12:12:31.756187 (+569950us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:31.773023 (+ 16836us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:31.773073 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:31.994793 (+221720us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b540018fbd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:31.994852 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:31.995016 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":14924,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":31186,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":20110,"spinlock_wait_cycles":437367040,"thread_start_us":569504,"threads_started":2,"wal-append.queue_time_us":397226}
I20260709 12:12:32.055529 22603 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:45576
I20260709 12:12:32.130961 22603 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:32.115873 22604 raft_consensus.cc:1275] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:32.045818 28944 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:12:32.119938 23088 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.015s	sys 0.022s
W20260709 12:12:32.131829 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 704431us
I20260709 12:12:32.034298 29221 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:32.045858 29268 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.126659 22602 raft_consensus.cc:1275] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:12:32.131367 22603 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:32.038033 29207 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:32.094861 29001 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:12:32.154121 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.179275 29001 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:32.181396 23088 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:32.182029 29207 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:32.184110 29207 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:32.184216 29260 raft_consensus.cc:2749] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:32.184834 29207 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.137975 29263 consensus_queue.cc:1059] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 12:12:32.186141 29263 consensus_queue.cc:1243] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer 6c6fa11e8ee34711b3551f0c670442bc log is divergent from this leader: its last log entry 18.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:12:31.980317 28994 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:32.188494 28994 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:32.112040 29220 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:32.061904 29247 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:32.036989 28701 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:32.193164 28862 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:32.194692 28701 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:32.195431 29264 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:32.196034 29264 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:32.198045 29264 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:32.129580 29225 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:32.205463 29216 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:32.208367 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:32.210206 22457 raft_consensus.cc:1240] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
W20260709 12:12:32.220103 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 277677us
W20260709 12:12:32.177807 29255 log.cc:927] Time spent T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 12:12:32.181639 29001 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:32.185940 23088 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:32.224089 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:32.230458 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:32.231500 22600 raft_consensus.cc:2393] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 14: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:32.225051 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:32.151424 22603 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:32.171090 28944 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:32.172572 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:32.237484 22604 raft_consensus.cc:2393] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 16: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:32.189119 28994 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:32.195564 28862 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:32.176908 29254 log.cc:927] Time spent T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.241s	user 0.000s	sys 0.000s
W20260709 12:12:32.238534 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 52687.3us
I20260709 12:12:32.271255 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:32.272142 23088 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:12:32.239609 22496 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.002s	sys 0.014s
W20260709 12:12:32.273077 22496 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.003s	sys 0.014s
W20260709 12:12:32.273425 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 779302us
I20260709 12:12:32.247303 22603 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:32.250900 22454 raft_consensus.cc:2410] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 19 because replica has last-logged OpId of term: 17 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 15.
I20260709 12:12:32.254618 29249 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:32.292695 22601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45576 (request call id 3479) took 1017 ms. Trace:
I20260709 12:12:32.293094 22601 rpcz_store.cc:276] 0709 12:12:31.275423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.275580 (+   157us) service_pool.cc:224] Handling call
0709 12:12:32.292525 (+1016945us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b54000e9f54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:32.292642 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":761631488}
I20260709 12:12:32.222733 29198 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:32.256404 22457 raft_consensus.cc:1275] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
W20260709 12:12:32.239441 29034 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.009s	sys 0.007s
I20260709 12:12:32.285108 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:32.286232 23088 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:32.287525 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:32.288335 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:12:32.289470 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.221557 29120 raft_consensus.cc:2804] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:32.302098 22604 raft_consensus.cc:1275] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:12:32.185279 29207 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:32.260936 29016 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:32.223982 29269 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:32.227763 29221 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.347572 23119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 1686) took 1396 ms. Trace:
I20260709 12:12:32.347985 23119 rpcz_store.cc:276] 0709 12:12:30.951139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.951255 (+   116us) service_pool.cc:224] Handling call
0709 12:12:30.951560 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:30.955060 (+  3500us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:30.955106 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:30.955694 (+   588us) log.cc:844] Serialized 26 byte log entry
0709 12:12:31.340724 (+385030us) spinlock_profiling.cc:243] Waited 3.99 ms on lock 0x7b180043d020. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc7823e07 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc7840c02 00007f9cca4c820b 00007f9cca4cdd23 00007f9cca4ce0d1 00007f9cca8e9a0f
0709 12:12:31.586301 (+245577us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:12:31.586366 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:31.586459 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:32.334626 (+748167us) raft_consensus.cc:1685] finished
0709 12:12:32.334647 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:32.347515 (+ 12868us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3079,"raft.queue_time_us":3391,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":6427,"spinlock_wait_cycles":9170688,"thread_start_us":245373,"threads_started":1,"wal-append.queue_time_us":999223}
I20260709 12:12:32.325312 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:32.326000 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:32.327423 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:32.331914 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:32.349887 22530 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 19.
I20260709 12:12:32.350788 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:32.351897 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:32.281162 29114 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:12:32.336797 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 50676.3us
I20260709 12:12:32.337963 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:32.338281 23123 raft_consensus.cc:1240] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 12:12:32.344456 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:32.352447 22524 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 18.
I20260709 12:12:32.362233 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:32.362672 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:32.363051 22603 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 19.
I20260709 12:12:32.240928 29001 raft_consensus.cc:2749] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:32.353917 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:32.354416 22421 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:12:32.190653 29268 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:32.319051 29034 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.828s	user 0.010s	sys 0.007s
I20260709 12:12:32.354640 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:32.302459 29242 raft_consensus.cc:3055] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:32.364905 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:32.376971 22526 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:32.356758 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:32.302548 28701 raft_consensus.cc:2749] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:32.380314 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:32.384061 22600 raft_consensus.cc:2393] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 15: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:32.347075 29262 raft_consensus.cc:2804] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:32.270725 28994 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:32.347033 29275 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.403744 28994 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:32.391754 29262 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:32.376662 29242 raft_consensus.cc:740] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:32.406661 29009 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:32.410632 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:32.413618 22449 raft_consensus.cc:1240] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 15 LEADER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:12:32.405380 28944 leader_election.cc:290] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:32.379864 29120 raft_consensus.cc:697] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:32.391947 29023 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.420329 22529 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 16.
W20260709 12:12:32.455720 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 331568us
I20260709 12:12:32.445608 23124 raft_consensus.cc:1275] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:12:32.447113 22496 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:32.448704 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:32.520453 22600 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:32.523764 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 76790.6us
I20260709 12:12:32.490163 22495 leader_election.cc:400] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 pre-election: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 22. Current term is 23.
I20260709 12:12:32.407917 28701 consensus_queue.cc:1048] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.068s
I20260709 12:12:32.374219 29260 consensus_queue.cc:1048] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.050s
I20260709 12:12:32.414465 29274 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.410801 29275 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:32.535344 29223 raft_consensus.cc:2749] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:32.366137 29221 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:32.489773 29023 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:32.396139 29001 consensus_queue.cc:1048] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.056s
I20260709 12:12:32.412200 29034 raft_consensus.cc:3055] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:32.375264 29114 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:32.564262 29261 log.cc:927] Time spent T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.339s	user 0.001s	sys 0.001s
W20260709 12:12:32.500136 29005 consensus_meta.cc:287] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 1.102s	user 0.004s	sys 0.008s
I20260709 12:12:32.353538 29269 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:32.511931 29242 consensus_queue.cc:260] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:32.539579 29197 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:32.417196 29282 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:32.415587 29262 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:32.567354 29279 log.cc:927] Time spent T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:12:32.561499 29220 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:32.593711 29280 log.cc:927] Time spent T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:12:32.594082 29221 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:32.558175 29274 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:32.590193 29282 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:32.596347 29243 consensus_meta.cc:287] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.619s	user 0.010s	sys 0.000s
I20260709 12:12:32.596450 29274 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:32.596752 29243 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:32.588743 29247 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:32.597388 29242 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:32.604935 29225 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:32.594103 29269 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:32.639586 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 284990us
W20260709 12:12:32.518108 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 156599us
I20260709 12:12:32.649325 22422 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:32.659622 22451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 1290) took 1275 ms. Trace:
I20260709 12:12:32.660180 22451 rpcz_store.cc:276] 0709 12:12:31.384330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.384452 (+   122us) service_pool.cc:224] Handling call
0709 12:12:31.384791 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:31.416296 (+ 31505us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:31.416331 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:31.416784 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 12:12:31.683048 (+266264us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:31.683088 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:31.683158 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:32.659048 (+975890us) raft_consensus.cc:1685] finished
0709 12:12:32.659081 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:32.659401 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50799,"raft.queue_time_us":39428,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":21921,"thread_start_us":214624,"threads_started":1,"wal-append.queue_time_us":601792}
I20260709 12:12:32.662695 22454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34452 (request call id 1294) took 1268 ms. Trace:
I20260709 12:12:32.663203 22454 rpcz_store.cc:276] 0709 12:12:31.394599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.394697 (+    98us) service_pool.cc:224] Handling call
0709 12:12:32.662181 (+1267484us) spinlock_profiling.cc:243] Waited 855 ms on lock 0x7b5400389fd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:32.662473 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1966616448}
I20260709 12:12:32.665722 22452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 1289) took 1283 ms. Trace:
I20260709 12:12:32.666092 22452 rpcz_store.cc:276] 0709 12:12:31.383129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.396704 (+ 13575us) service_pool.cc:224] Handling call
0709 12:12:31.396978 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:31.516822 (+119844us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:31.516868 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:31.517382 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 12:12:31.773735 (+256353us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:31.773778 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:32.665166 (+891388us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b54002a5154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:32.665223 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:32.665283 (+    60us) raft_consensus.cc:1685] finished
0709 12:12:32.665290 (+     7us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:32.665593 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":53199,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":5256,"spinlock_wait_cycles":274597760,"thread_start_us":241901,"threads_started":1,"wal-append.queue_time_us":464217}
I20260709 12:12:32.672024 22449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 3216) took 1221 ms. Trace:
I20260709 12:12:32.672582 22449 rpcz_store.cc:276] 0709 12:12:31.450479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.997612 (+547133us) service_pool.cc:224] Handling call
0709 12:12:31.997936 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:32.420282 (+422346us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:32.671288 (+251006us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b54002648d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:32.671806 (+   518us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":955310336}
I20260709 12:12:32.684008 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:32.683800 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:32.685168 22456 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:32.685178 22457 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 17.
I20260709 12:12:32.539390 22495 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:32.538369 22496 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:32.705176 22421 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:12:32.723138 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:32.724123 22530 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:32.729430 22606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45562 (request call id 3041) took 1335 ms (client timeout 1663 ms). Trace:
W20260709 12:12:32.730121 22606 rpcz_store.cc:269] 0709 12:12:31.393691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.394797 (+  1106us) service_pool.cc:224] Handling call
0709 12:12:32.728802 (+1334005us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b54000ea954. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:32.729101 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":665279232}
I20260709 12:12:32.736358 22600 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 16.
W20260709 12:12:32.538343 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 179044us
I20260709 12:12:32.583915 29034 raft_consensus.cc:740] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
W20260709 12:12:32.758358 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 53430.5us
I20260709 12:12:32.592088 29207 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:32.758490 29114 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:32.569363 29120 consensus_queue.cc:237] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:32.776937 22598 raft_consensus.cc:1240] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:32.780732 22525 raft_consensus.cc:2368] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 20. Current term is 21.
I20260709 12:12:32.588322 29005 raft_consensus.cc:2749] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:32.801447 23125 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
W20260709 12:12:32.802556 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 264241us
W20260709 12:12:32.802711 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 44397.1us
I20260709 12:12:32.806267 29274 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:32.807420 28867 raft_consensus.cc:2749] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:32.807159 29274 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:32.811569 29036 consensus_queue.cc:1059] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:32.813167 29276 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:32.814023 29276 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:32.815901 23088 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:32.817909 29294 raft_consensus.cc:2804] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:32.816382 28701 consensus_queue.cc:1048] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.015s
I20260709 12:12:32.831337 29264 consensus_queue.cc:1048] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 12:12:32.814946 29079 raft_consensus.cc:3055] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:32.832877 29079 raft_consensus.cc:740] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:32.815095 28862 raft_consensus.cc:2749] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:32.834365 29197 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.836347 29197 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:32.839005 29197 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:32.844031 29247 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.845743 29247 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:32.849071 29269 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.850088 29269 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:32.829442 29294 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:32.856853 28701 raft_consensus.cc:2749] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:32.856868 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 317542us
I20260709 12:12:32.858659 22598 raft_consensus.cc:1240] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:32.860662 29294 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:32.879468 22495 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:32.880040 29286 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:32.881479 23123 raft_consensus.cc:1240] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:12:32.885012 29218 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.885809 22455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 3215) took 1435 ms. Trace:
I20260709 12:12:32.886330 22455 rpcz_store.cc:276] 0709 12:12:31.450217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.963682 (+513465us) service_pool.cc:224] Handling call
0709 12:12:31.964094 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:31.964330 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:12:32.321383 (+357053us) log.cc:844] Serialized 14 byte log entry
0709 12:12:32.875342 (+553959us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:32.885301 (+  9959us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:32.885366 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:32.885470 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:32.885643 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":27709,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":6085,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":236,"spinlock_wait_cycles":22666624,"thread_start_us":852002,"threads_started":2,"wal-append.queue_time_us":503282}
I20260709 12:12:32.887566 29263 consensus_queue.cc:1048] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:32.888492 29263 consensus_queue.cc:1243] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer c863116d91c14d1ca50d6e8a46a37a8f log is divergent from this leader: its last log entry 18.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:12:32.890260 29263 consensus_queue.cc:1048] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:12:32.890733 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 75019.6us
I20260709 12:12:32.881032 29286 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:32.914009 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 109561us
I20260709 12:12:32.882193 29198 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:32.890946 29030 raft_consensus.cc:2749] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:32.902365 29244 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.922506 29064 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
W20260709 12:12:32.923221 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 43960.7us
I20260709 12:12:32.923548 29064 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:32.940605 28862 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.941155 29249 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:32.941332 28862 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:32.942098 29249 consensus_queue.cc:1059] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:32.944521 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:32.944751 29198 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:32.945300 22455 raft_consensus.cc:2468] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
I20260709 12:12:32.947221 29206 raft_consensus.cc:2804] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:32.947373 29030 consensus_queue.cc:1059] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:12:32.948530 29303 log.cc:927] Time spent T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 12:12:32.952064 29244 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:32.954465 29244 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:32.955924 29247 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:32.958588 29286 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:32.958886 22570 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
W20260709 12:12:32.959499 22526 consensus_meta.cc:287] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.582s	user 0.012s	sys 0.008s
I20260709 12:12:32.960034 22526 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 20.
I20260709 12:12:32.961056 22570 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:32.961591 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:32.962875 29005 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.962973 29296 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:32.963531 29005 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:32.966279 29005 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:32.962901 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:32.967758 22526 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 16.
I20260709 12:12:32.968852 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:32.970111 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:32.970819 22526 raft_consensus.cc:2368] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 16. Current term is 17.
I20260709 12:12:32.963807 29296 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:32.971684 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:32.972288 22455 raft_consensus.cc:1275] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:12:32.972465 22526 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:32.973608 29296 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:32.979444 29247 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:32.980801 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:32.981472 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:32.981734 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:32.980237 29247 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:32.882092 29275 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:32.992774 22530 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 14.
I20260709 12:12:32.994717 22456 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 19.
W20260709 12:12:33.000567 29216 consensus_meta.cc:287] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.794s	user 0.014s	sys 0.004s
I20260709 12:12:33.003396 22531 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 17.
I20260709 12:12:33.003691 29197 raft_consensus.cc:2804] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:33.004226 29197 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:33.004596 29197 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:33.005961 22531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38310 (request call id 1331) took 1677 ms. Trace:
I20260709 12:12:33.008864 22531 rpcz_store.cc:276] 0709 12:12:31.328806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.328904 (+    98us) service_pool.cc:224] Handling call
0709 12:12:33.005644 (+1676740us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b5400262d54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:33.005853 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3848832384}
I20260709 12:12:33.008252 29223 raft_consensus.cc:2749] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:33.009696 29288 log.cc:927] Time spent T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.425s	user 0.003s	sys 0.000s
I20260709 12:12:33.011971 29233 consensus_queue.cc:1048] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 12:12:33.016204 29216 consensus_queue.cc:1059] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:33.017570 29224 raft_consensus.cc:3055] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:33.017992 29224 raft_consensus.cc:740] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:32.885756 29218 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:32.942895 29249 consensus_queue.cc:1243] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer c863116d91c14d1ca50d6e8a46a37a8f log is divergent from this leader: its last log entry 20.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
W20260709 12:12:33.022763 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 96205.8us
W20260709 12:12:33.034490 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 59197.8us
I20260709 12:12:33.039192 22569 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:32.946967 29198 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:33.028829 29286 raft_consensus.cc:2749] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:33.045397 28994 raft_consensus.cc:2804] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:33.045879 28994 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:33.046320 28994 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:33.043563 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 82703us
I20260709 12:12:33.049722 29286 consensus_queue.cc:1048] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:33.036144 29184 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:33.042071 29206 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:33.067206 29206 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:33.074132 22569 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:33.074520 28991 raft_consensus.cc:3055] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:33.074935 28991 raft_consensus.cc:740] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:33.075445 29198 raft_consensus.cc:2804] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:33.075868 29198 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:33.076267 29198 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:33.076022 28991 consensus_queue.cc:260] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:33.077301 22526 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 16.
I20260709 12:12:33.077464 28991 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:33.055397 29247 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:33.056779 29079 consensus_queue.cc:260] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:33.056864 29184 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:33.058454 29274 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:33.058357 29224 consensus_queue.cc:260] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:33.059623 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:33.059790 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:33.060371 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:33.060465 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:33.061467 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:33.062129 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:33.077076 29294 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:33.055693 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:12:33.080451 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 124137us
I20260709 12:12:33.087591 23117 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 19.
I20260709 12:12:33.087654 23120 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 12.
I20260709 12:12:33.088981 23118 raft_consensus.cc:2393] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 21: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:33.089022 23119 raft_consensus.cc:2393] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 18: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:33.090035 23124 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 18.
I20260709 12:12:33.091794 29224 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:33.090518 23122 raft_consensus.cc:2393] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 17: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:33.082903 29296 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.097229 22600 raft_consensus.cc:1240] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 LEADER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 12:12:33.078516 29064 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:33.081586 29286 consensus_queue.cc:1048] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 12:12:33.114308 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:33.115557 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:33.116219 22526 raft_consensus.cc:2376] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 16. Re-sending same reply.
I20260709 12:12:33.116088 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:33.115175 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:33.113885 22570 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:33.101553 29217 consensus_meta.cc:287] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 1.036s	user 0.009s	sys 0.007s
I20260709 12:12:33.119529 22569 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:33.194017 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:33.194876 22531 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 19.
I20260709 12:12:33.195448 29184 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:33.220338 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:12:33.221065 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 135148us
I20260709 12:12:33.222124 22570 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:12:33.222873 29217 raft_consensus.cc:2749] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 22. Current term is 23.
I20260709 12:12:33.237443 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:33.239312 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:33.243251 29184 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.244002 29184 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:33.246531 29184 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:33.121011 28862 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:33.228696 29079 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:33.283291 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 189301us
I20260709 12:12:33.290518 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:33.291141 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 51953us
I20260709 12:12:33.125339 29296 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:33.297864 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:33.301421 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:33.299757 22421 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:33.300313 28944 raft_consensus.cc:2749] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:33.299546 29278 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.297299 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:33.308647 22526 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 13.
I20260709 12:12:33.309772 28862 raft_consensus.cc:2804] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:33.310494 28862 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:33.313755 22457 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:12:33.324646 29294 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:33.327342 28947 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.328233 28947 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:33.331324 29313 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.332156 29313 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:33.335318 29242 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.336117 29242 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:33.343303 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:33.343972 22454 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:33.347633 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:33.349324 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:33.310928 28862 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:33.358595 29296 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:33.360055 23119 raft_consensus.cc:1275] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:33.360800 29278 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:33.364078 29197 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:33.365077 28947 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:33.338762 29242 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:33.334903 29313 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:33.367406 23089 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:33.369423 29084 raft_consensus.cc:2804] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:12:33.301074 29262 consensus_meta.cc:287] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.703s	user 0.007s	sys 0.004s
I20260709 12:12:33.370143 29084 raft_consensus.cc:697] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 16 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:33.370172 29262 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:33.372731 29262 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:33.373569 23123 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 16.
I20260709 12:12:33.376648 29084 consensus_queue.cc:237] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:33.381707 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:33.383325 22421 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:12:33.384037 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 76809.8us
I20260709 12:12:33.385360 22421 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:33.386188 29294 raft_consensus.cc:2804] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:33.386698 29294 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:33.387143 29064 raft_consensus.cc:2804] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:33.387693 29064 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:33.388141 29064 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:33.391165 22530 raft_consensus.cc:1275] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:12:33.393922 29278 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:33.397280 22457 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 17.
I20260709 12:12:33.309835 22528 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 23.
I20260709 12:12:33.406697 28862 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:33.387171 29294 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:33.433467 28862 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:33.442325 29294 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:33.451839 22452 raft_consensus.cc:1240] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 12:12:33.454808 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:33.455358 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:33.456185 22449 raft_consensus.cc:2393] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 20: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:33.457998 22452 raft_consensus.cc:1275] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:33.314838 28994 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:33.461447 28994 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:33.461568 29294 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:33.462216 28994 raft_consensus.cc:2804] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:33.462684 29184 raft_consensus.cc:2804] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:33.465361 22455 pending_rounds.cc:85] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f: Aborting all ops after (but not including) 10
I20260709 12:12:33.466241 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:33.508210 22456 raft_consensus.cc:2393] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 20: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:33.468638 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:33.470795 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:33.471771 22453 raft_consensus.cc:1275] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 24 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:12:33.509560 22454 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 20.
I20260709 12:12:33.475358 22531 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 18.
I20260709 12:12:33.476521 23125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57332 (request call id 1520) took 1192 ms. Trace:
I20260709 12:12:33.484467 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:33.488940 29034 consensus_queue.cc:260] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:33.492615 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:33.406019 29206 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:33.495348 29289 log.cc:927] Time spent T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.911s	user 0.015s	sys 0.022s
I20260709 12:12:33.496610 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:33.442171 29198 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:33.507546 22455 pending_rounds.cc:107] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 12:12:33.518137 22449 raft_consensus.cc:2368] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 13. Current term is 14.
I20260709 12:12:33.517445 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:33.518374 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:33.515048 23125 rpcz_store.cc:276] 0709 12:12:32.284029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.287220 (+  3191us) service_pool.cc:224] Handling call
0709 12:12:33.476215 (+1188995us) spinlock_profiling.cc:243] Waited 470 ms on lock 0x7b54006f04d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:33.476398 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1081661312}
I20260709 12:12:33.520565 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:33.526440 23124 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:12:33.519335 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:33.528419 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:33.529313 22456 raft_consensus.cc:2468] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 12.
I20260709 12:12:33.525264 22455 raft_consensus.cc:2889] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:33.534703 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:12:33.534312 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 289834us
I20260709 12:12:33.542176 22453 raft_consensus.cc:1240] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:33.545331 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:33.547304 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:33.545450 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:33.548664 23117 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:33.538465 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:33.520522 29184 raft_consensus.cc:697] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:33.551064 22598 raft_consensus.cc:2393] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 12: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:33.552223 23121 raft_consensus.cc:1275] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:12:33.552361 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:33.557332 22456 raft_consensus.cc:1240] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:33.558874 22453 raft_consensus.cc:2393] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 20: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:33.539812 29262 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.556145 22452 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:33.569250 22524 raft_consensus.cc:2410] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 12:12:33.569555 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:33.571302 29034 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:33.576272 29184 consensus_queue.cc:237] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:33.583257 28946 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:33.583458 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:33.584090 28946 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:33.584811 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:33.585599 22453 raft_consensus.cc:2393] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 21: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:33.533412 28994 raft_consensus.cc:697] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 19 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:33.587119 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:33.586575 28946 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:33.587472 28994 consensus_queue.cc:237] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:33.588402 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:33.589128 22531 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 11.
I20260709 12:12:33.590055 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:33.593184 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:33.593966 22601 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 16.
I20260709 12:12:33.596025 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:33.601054 22530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 2692) took 1262 ms. Trace:
I20260709 12:12:33.601507 22530 rpcz_store.cc:276] 0709 12:12:32.338700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.240419 (+901719us) service_pool.cc:224] Handling call
0709 12:12:33.240831 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:33.391532 (+150701us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:33.600756 (+209224us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54003f02d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:33.600963 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":344666368}
I20260709 12:12:33.602284 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:33.603240 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 56703.1us
I20260709 12:12:33.605934 29278 consensus_queue.cc:1059] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:33.607321 29282 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:33.609586 23087 leader_election.cc:400] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 13. Current term is 14.
I20260709 12:12:33.626753 23087 leader_election.cc:403] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:33.549715 29064 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:33.611694 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:33.612032 29198 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:33.614183 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:33.615248 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:33.616039 29005 consensus_queue.cc:1048] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:33.622131 23124 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 14.
I20260709 12:12:33.553282 29247 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.624935 22452 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 21.
I20260709 12:12:33.629633 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:33.625133 23088 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:33.629565 22527 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
I20260709 12:12:33.628600 28701 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:33.646579 22422 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:33.647950 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:33.652925 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:33.647032 22523 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 18.
I20260709 12:12:33.657133 22526 raft_consensus.cc:2393] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 13: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:33.658025 22495 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:33.660586 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:33.670850 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:33.671299 22570 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:12:33.671873 22526 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 17.
I20260709 12:12:33.679001 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:33.679091 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 44990.1us
I20260709 12:12:33.679955 22526 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 17.
I20260709 12:12:33.680370 22421 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:33.680904 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:33.681872 22526 raft_consensus.cc:2410] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:12:33.682041 22421 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:33.683403 22605 raft_consensus.cc:1275] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:33.682744 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:33.679235 22527 raft_consensus.cc:3055] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:33.641245 29262 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:33.679023 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 25 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:33.685251 22527 raft_consensus.cc:740] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:33.685040 22526 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 16.
I20260709 12:12:33.663120 29292 raft_consensus.cc:2749] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:33.687523 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:33.697680 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:33.699343 23117 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 20.
I20260709 12:12:33.716035 22531 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 16.
I20260709 12:12:33.717574 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:33.719159 22495 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:33.650628 29247 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:33.723172 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:33.723989 22526 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:33.727370 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:33.728740 22531 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:33.730118 23124 raft_consensus.cc:1240] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 16 LEADER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 12:12:33.696333 29304 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:33.696605 29198 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:33.720391 29264 raft_consensus.cc:2749] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:12:33.737784 22495 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:12:33.738022 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 128796us
I20260709 12:12:33.741027 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:33.745514 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 189772us
I20260709 12:12:33.747961 28945 raft_consensus.cc:2804] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:33.748615 28945 raft_consensus.cc:697] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
W20260709 12:12:33.750100 22495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:33.730149 29296 raft_consensus.cc:2749] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 13. Current term is 14.
I20260709 12:12:33.740653 22527 consensus_queue.cc:260] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:33.751896 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 69973.6us
I20260709 12:12:33.746117 29084 raft_consensus.cc:2749] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:33.753810 23117 raft_consensus.cc:1240] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 17 LEADER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:12:33.754004 22599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3494) took 1682 ms. Trace:
I20260709 12:12:33.755277 29265 raft_consensus.cc:2804] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:33.755576 29148 raft_consensus.cc:2749] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:33.754901 29198 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:33.755389 22530 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 20.
W20260709 12:12:33.757712 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 123340us
I20260709 12:12:33.709851 28701 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:33.757758 23087 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:33.738881 29285 raft_consensus.cc:2804] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:33.769409 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:33.770184 22523 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 16.
I20260709 12:12:33.771204 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:33.771806 22523 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 17.
I20260709 12:12:33.772709 28987 consensus_queue.cc:1059] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 12:12:33.775216 29084 raft_consensus.cc:2804] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:33.754498 22599 rpcz_store.cc:276] 0709 12:12:32.058283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.058404 (+   121us) service_pool.cc:224] Handling call
0709 12:12:32.058745 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:32.122240 (+ 63495us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:32.122273 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:32.135337 (+ 13064us) log.cc:844] Serialized 26 byte log entry
0709 12:12:32.415620 (+280283us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:12:32.415683 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:32.415801 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:33.494196 (+1078395us) spinlock_profiling.cc:243] Waited 1.86 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:12:33.727137 (+232941us) raft_consensus.cc:1685] finished
0709 12:12:33.727158 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:33.740241 (+ 13083us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63050,"raft.queue_time_us":125557,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":82,"spinlock_wait_cycles":4285312,"thread_start_us":235978,"threads_started":1,"wal-append.queue_time_us":364353}
I20260709 12:12:33.775729 29084 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:33.776247 29084 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:33.760716 29265 raft_consensus.cc:697] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:33.780694 29265 consensus_queue.cc:237] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:33.783602 29198 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:33.754822 28973 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:33.738766 29079 consensus_queue.cc:1048] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.047s
I20260709 12:12:33.785696 28973 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:33.787360 29064 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:33.790279 29247 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:12:33.792291 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 148920us
W20260709 12:12:33.792574 29301 log.cc:927] Time spent T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.967s	user 0.008s	sys 0.002s
I20260709 12:12:33.793256 22570 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:33.749585 28945 consensus_queue.cc:237] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:33.795882 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:33.796706 23117 raft_consensus.cc:2393] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 20: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:33.756507 29304 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:33.753834 29281 raft_consensus.cc:2804] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:33.806443 22526 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 20.
I20260709 12:12:33.801981 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 25 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:33.805411 22422 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:33.767125 29285 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:33.813572 29064 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:33.814051 22422 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:33.815055 29292 raft_consensus.cc:2749] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:33.815757 22570 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:33.817334 22570 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:12:33.817445 23116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 1695) took 2179 ms. Trace:
W20260709 12:12:33.823547 22525 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56940 (request call id 2680) took 1498 ms (client timeout 1942 ms). Trace:
I20260709 12:12:33.823808 29184 raft_consensus.cc:2749] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:12:33.824021 22525 rpcz_store.cc:269] 0709 12:12:32.324938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.325070 (+   132us) service_pool.cc:224] Handling call
0709 12:12:33.823302 (+1498232us) spinlock_profiling.cc:243] Waited 423 ms on lock 0x7b540014f854. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:33.823487 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":973145472}
I20260709 12:12:33.824702 29184 raft_consensus.cc:2804] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:33.824860 28701 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:33.825378 29184 raft_consensus.cc:697] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:33.825495 29281 raft_consensus.cc:697] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:33.826566 29281 consensus_queue.cc:237] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:33.827090 29269 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:33.826566 29184 consensus_queue.cc:237] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:33.805428 29247 consensus_queue.cc:1059] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 12:12:33.819375 29295 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:33.834318 29295 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:33.819909 22421 leader_election.cc:400] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 16. Current term is 17.
I20260709 12:12:33.836961 22421 leader_election.cc:403] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:33.800444 28994 raft_consensus.cc:2749] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 19 LEADER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:33.800808 23088 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:33.828189 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:33.833794 29247 raft_consensus.cc:3055] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:33.846398 22530 raft_consensus.cc:1275] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:33.812801 29285 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:33.842860 29247 raft_consensus.cc:740] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:33.850268 29247 consensus_queue.cc:260] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:33.854523 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 88808.9us
I20260709 12:12:33.855355 23088 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:33.855530 29304 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:33.856683 22421 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:33.857439 29264 raft_consensus.cc:2749] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 16. Current term is 17.
I20260709 12:12:33.858479 28701 raft_consensus.cc:2804] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:33.860659 29268 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:33.861641 29266 consensus_queue.cc:1048] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:33.863615 29247 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:33.864677 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:33.865350 22525 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 20.
I20260709 12:12:33.866366 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:33.822907 23116 rpcz_store.cc:276] 0709 12:12:31.637982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.639664 (+  1682us) service_pool.cc:224] Handling call
0709 12:12:31.697577 (+ 57913us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:31.773398 (+ 75821us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:31.773435 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:33.575027 (+1801592us) spinlock_profiling.cc:243] Waited 66.9 ms on lock 0x7b2c000a5ff8. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc9227a11 00007f9cc9237372 00007f9cca969a01 00007f9cca92e43a 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2
0709 12:12:33.575852 (+   825us) log.cc:844] Serialized 52 byte log entry
0709 12:12:33.719685 (+143833us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:33.719737 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:33.736661 (+ 16924us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:33.817010 (+ 80349us) raft_consensus.cc:1685] finished
0709 12:12:33.817029 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:33.817267 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75330,"raft.queue_time_us":75481,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":6206,"spinlock_wait_cycles":153940736,"thread_start_us":143353,"threads_started":1,"wal-append.queue_time_us":219605}
I20260709 12:12:33.869239 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:33.861693 22531 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 19.
I20260709 12:12:33.876380 22525 raft_consensus.cc:1275] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:33.878804 22496 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:33.880013 22523 raft_consensus.cc:1275] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260709 12:12:33.880456 22523 pending_rounds.cc:85] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting all ops after (but not including) 13
I20260709 12:12:33.880759 22523 pending_rounds.cc:107] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 12:12:33.881264 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:33.885629 28994 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:33.886348 28994 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:33.888911 28994 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:33.889503 22531 raft_consensus.cc:1275] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 12:12:33.890283 22531 pending_rounds.cc:85] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting all ops after (but not including) 12
I20260709 12:12:33.890621 22531 pending_rounds.cc:107] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 12:12:33.890938 22531 raft_consensus.cc:2889] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:33.892112 29276 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:33.892799 29278 raft_consensus.cc:2749] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:33.893532 22531 raft_consensus.cc:1240] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 12:12:33.894021 29264 raft_consensus.cc:2804] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:33.894685 29264 raft_consensus.cc:697] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 14 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:33.872113 28701 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:33.895378 28701 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:33.895730 29264 consensus_queue.cc:237] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:33.881088 22523 raft_consensus.cc:2889] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:33.899935 23088 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:33.901495 23088 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:33.905997 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 52234.1us
W20260709 12:12:33.934020 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 116800us
W20260709 12:12:33.934350 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 77827.3us
I20260709 12:12:33.931841 23088 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:33.935309 22526 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
I20260709 12:12:33.938403 22523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 2397) took 1594 ms. Trace:
I20260709 12:12:33.940635 22523 rpcz_store.cc:276] 0709 12:12:32.339673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.772554 (+1432881us) service_pool.cc:224] Handling call
0709 12:12:33.853084 (+ 80530us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:33.914731 (+ 61647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:33.933560 (+ 18829us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:33.940420 23088 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:33.935037 29278 raft_consensus.cc:2804] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:33.947324 28946 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:33.943897 29296 raft_consensus.cc:2804] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:33.937832 29313 raft_consensus.cc:2764] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
W20260709 12:12:33.953539 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 93581.5us
I20260709 12:12:33.950923 29296 raft_consensus.cc:697] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 16 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:33.956552 29296 consensus_queue.cc:237] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:33.948333 29278 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:33.966408 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:12:33.966820 22528 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56940 (request call id 2681) took 1641 ms (client timeout 2158 ms). Trace:
I20260709 12:12:33.967069 22606 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:33.967374 29304 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.967926 29304 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:33.970176 29304 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:33.967927 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:33.971854 22570 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:33.973255 22570 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:33.950708 28946 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:33.976598 28946 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:33.977102 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:33.977809 22597 raft_consensus.cc:3060] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:33.983234 22526 raft_consensus.cc:1275] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 12:12:33.983714 22526 pending_rounds.cc:85] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting all ops after (but not including) 10
I20260709 12:12:33.984071 22526 pending_rounds.cc:107] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 12:12:33.984395 22526 raft_consensus.cc:2889] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:33.980079 23088 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:33.986173 22421 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:33.986440 23088 leader_election.cc:304] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:12:33.967276 22528 rpcz_store.cc:269] 0709 12:12:32.325233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.327140 (+  1907us) service_pool.cc:224] Handling call
0709 12:12:33.966633 (+1639493us) spinlock_profiling.cc:243] Waited 879 ms on lock 0x7b54000d39d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:33.966761 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2020805504}
I20260709 12:12:33.992108 22421 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:33.993461 28862 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:33.993924 22421 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:12:33.994892 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:33.997308 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:33.997927 22603 raft_consensus.cc:3060] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:34.002151 28862 raft_consensus.cc:2749] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:34.003152 28862 raft_consensus.cc:2749] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:34.004106 28862 raft_consensus.cc:2804] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:34.004482 22599 raft_consensus.cc:1240] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 19 LEADER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:34.004797 28862 raft_consensus.cc:697] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:34.007319 29198 raft_consensus.cc:2749] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:12:34.008349 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:34.008769 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:34.009397 29327 raft_consensus.cc:2804] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:34.009836 29327 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:34.010203 29327 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:33.964977 29285 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:34.014043 29064 raft_consensus.cc:2749] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:34.014953 29285 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:33.960783 29332 raft_consensus.cc:2749] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:33.962261 29331 raft_consensus.cc:2749] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:33.961306 29084 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:34.019246 29084 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:34.023612 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:34.024343 22601 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:34.025578 22606 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 20.
I20260709 12:12:34.028000 22422 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:34.036866 22603 raft_consensus.cc:2468] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 21.
I20260709 12:12:34.037971 22523 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 19.
I20260709 12:12:34.039268 22597 raft_consensus.cc:2468] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 17.
I20260709 12:12:33.979310 29278 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:34.020082 28862 consensus_queue.cc:237] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.16, Last appended by leader: 16, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:34.041756 22421 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:34.051568 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:34.052294 22606 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 14.
I20260709 12:12:34.052999 22421 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:12:34.058090 22597 raft_consensus.cc:1275] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:34.063565 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:34.064500 22526 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 23.
I20260709 12:12:34.066056 22421 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:34.041765 29294 raft_consensus.cc:2804] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:12:34.071437 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 85104.7us
I20260709 12:12:33.998860 28701 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:34.062084 29064 raft_consensus.cc:2804] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:34.062229 29084 raft_consensus.cc:2804] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:34.076606 22421 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:34.051245 29269 consensus_queue.cc:1048] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 12:12:34.095144 29035 consensus_queue.cc:1048] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 12:12:34.098193 29197 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:34.100217 29206 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:34.100780 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:34.101728 29023 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:34.108526 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:34.110033 29120 raft_consensus.cc:2749] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:34.112593 29223 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:34.113229 29223 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:34.098881 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:34.098335 29221 raft_consensus.cc:2804] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:12:34.123991 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 150809us
I20260709 12:12:34.126178 22601 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 20.
I20260709 12:12:34.076359 29148 raft_consensus.cc:2749] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:34.135318 22456 raft_consensus.cc:1240] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:34.076587 29294 raft_consensus.cc:697] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 20 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:34.082895 29064 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:34.083316 29084 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:34.094707 29295 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:34.230813 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:34.235545 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:34.236565 23116 raft_consensus.cc:2393] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 13: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:34.237146 29332 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.237550 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:34.238451 23116 raft_consensus.cc:2393] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 13: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:34.237934 29332 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:34.239485 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:34.098232 29225 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:34.247359 22570 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:34.240980 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:34.077497 29247 consensus_queue.cc:1048] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.088s
I20260709 12:12:34.138195 29276 raft_consensus.cc:2749] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:34.260942 23117 raft_consensus.cc:1275] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:12:34.240960 29332 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:34.124779 29221 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:34.264164 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:34.223366 29064 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:34.270459 23120 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 17.
I20260709 12:12:34.264501 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:34.223654 29084 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:34.224104 29030 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.263793 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:12:34.290133 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 213604us
W20260709 12:12:34.292132 29342 log.cc:927] Time spent T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 12:12:34.276939 29120 raft_consensus.cc:2749] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:34.274667 29221 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:34.292871 29005 raft_consensus.cc:3055] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:34.299571 29005 raft_consensus.cc:740] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:34.300520 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:34.300676 29005 consensus_queue.cc:260] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:34.301975 29005 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:34.273300 29313 consensus_queue.cc:1048] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 12:12:34.306239 22600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3496) took 1542 ms. Trace:
I20260709 12:12:34.306663 22600 rpcz_store.cc:276] 0709 12:12:32.763618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.779769 (+ 16151us) service_pool.cc:224] Handling call
0709 12:12:32.828584 (+ 48815us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:33.106486 (+277902us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:34.305964 (+1199478us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b54000ec254. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:34.306173 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":614140800}
W20260709 12:12:34.308843 22495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:34.310631 29294 consensus_queue.cc:237] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:34.312861 22524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56942 (request call id 2402) took 1972 ms. Trace:
I20260709 12:12:34.313293 22524 rpcz_store.cc:276] 0709 12:12:32.340841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.055252 (+714411us) service_pool.cc:224] Handling call
0709 12:12:34.312613 (+1257361us) spinlock_profiling.cc:243] Waited 481 ms on lock 0x7b540010c7d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:34.312793 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1107396352}
I20260709 12:12:34.316325 28701 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:34.316876 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:34.317320 29223 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:34.317639 22598 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 16.
I20260709 12:12:34.317816 29264 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:34.291415 22421 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:34.328641 22527 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:34.331599 29262 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:34.318436 29264 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:34.335309 29264 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:34.339952 22570 leader_election.cc:304] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:12:34.340911 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:34.343349 22570 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:34.343999 29197 raft_consensus.cc:2804] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:34.336743 29295 raft_consensus.cc:2804] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:34.348681 22570 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:34.350246 22421 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:34.351454 29264 raft_consensus.cc:2749] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:12:34.352118 29184 raft_consensus.cc:2804] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:34.352396 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:34.353004 29120 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:34.353442 29120 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:34.353823 29120 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:34.352596 29184 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:34.347780 29295 raft_consensus.cc:697] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:34.361584 29295 consensus_queue.cc:237] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:34.362713 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:34.359314 29184 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:34.363441 29247 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.364065 29247 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:34.347992 29197 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:34.365073 29197 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:34.268764 29036 consensus_queue.cc:1048] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.071s
I20260709 12:12:34.350258 22570 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:34.372152 23121 raft_consensus.cc:1275] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 12:12:34.372663 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 78178.4us
I20260709 12:12:34.284953 29030 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:34.367655 22421 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:34.379560 22524 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 11.
I20260709 12:12:34.374751 28944 raft_consensus.cc:2804] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:34.381595 28701 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:34.383814 28944 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:34.383941 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:34.390548 23121 raft_consensus.cc:1275] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:12:34.384207 28701 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:34.393600 28701 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:34.394479 22525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 1348) took 1040 ms. Trace:
I20260709 12:12:34.394881 22525 rpcz_store.cc:276] 0709 12:12:33.354308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.885406 (+531098us) service_pool.cc:224] Handling call
0709 12:12:33.885727 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:33.938343 (+ 52616us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:33.938393 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:33.988623 (+ 50230us) log.cc:844] Serialized 26 byte log entry
0709 12:12:34.248998 (+260375us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:34.249041 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:34.249118 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:34.394258 (+145140us) raft_consensus.cc:1685] finished
0709 12:12:34.394281 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:34.394418 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45327,"raft.queue_time_us":57829,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":4858,"thread_start_us":186992,"threads_started":1,"wal-append.queue_time_us":245948}
I20260709 12:12:34.384326 28944 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:34.381839 29276 consensus_queue.cc:1048] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 12:12:34.399811 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:34.400437 23120 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Advancing to term 20
W20260709 12:12:34.401739 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:34.402513 29198 consensus_queue.cc:1048] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:34.379974 29035 raft_consensus.cc:2804] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:34.404016 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:34.405642 29313 consensus_queue.cc:1059] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:12:34.384274 29346 log.cc:927] Time spent T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:12:34.411195 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:34.412287 23122 raft_consensus.cc:2410] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 20 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 12:12:34.420073 22527 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 19.
I20260709 12:12:34.420852 22527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56942 (request call id 2408) took 1075 ms. Trace:
I20260709 12:12:34.423071 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:34.423620 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:34.424268 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:34.424295 22524 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 19.
I20260709 12:12:34.421301 22527 rpcz_store.cc:276] 0709 12:12:33.345427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.649165 (+303738us) service_pool.cc:224] Handling call
0709 12:12:34.323188 (+674023us) spinlock_profiling.cc:243] Waited 66.5 ms on lock 0x7b5400097020. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca8a3a1d 00007f9cca88a1a4 00007f9cca90c447 00007f9cca924fe7 00007f9cca9267de 00007f9cca93227c 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591
0709 12:12:34.420723 (+ 97535us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":152913664}
I20260709 12:12:34.426704 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:34.428007 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:34.429242 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:34.421681 28862 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:34.448549 28862 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:34.413389 28987 raft_consensus.cc:3055] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:34.448572 23118 raft_consensus.cc:2393] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 19: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:34.411463 29035 raft_consensus.cc:697] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:34.493978 23120 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 20.
I20260709 12:12:34.501329 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:34.502031 23120 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 11.
I20260709 12:12:34.424528 29247 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:34.499347 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:34.503338 23121 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:34.450673 28987 raft_consensus.cc:740] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:34.535029 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:34.435604 29218 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:34.535916 22421 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:34.491286 29023 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.535162 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:34.425536 28701 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:12:34.548493 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 57919.7us
I20260709 12:12:34.537778 22497 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:34.551710 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:34.552400 22456 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 21.
I20260709 12:12:34.552230 28944 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:34.552430 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:34.554373 28944 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:34.534775 29030 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:34.554306 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:34.568226 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:34.486169 29278 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:34.569662 23087 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:34.569929 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:34.491513 29084 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:34.577703 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:34.580627 22452 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 19.
I20260709 12:12:34.582280 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:34.430006 29351 consensus_queue.cc:1048] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.162s
I20260709 12:12:34.439424 29327 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:34.535218 29276 consensus_queue.cc:1048] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:12:34.549233 29264 raft_consensus.cc:2804] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:12:34.598922 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 61221.6us
I20260709 12:12:34.582048 29036 raft_consensus.cc:2749] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:34.598129 29064 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:34.605068 29278 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:34.606343 28987 consensus_queue.cc:260] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:34.607769 28987 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:34.611202 29035 consensus_queue.cc:237] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:34.578794 29005 raft_consensus.cc:2804] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:34.613042 29005 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:34.613391 29005 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:34.616415 22449 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:34.618559 22497 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:34.624526 29036 raft_consensus.cc:2804] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:34.624929 29036 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:34.625286 29036 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:34.623518 28862 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:34.621061 22570 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:34.566111 28701 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:34.623950 22454 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 11.
I20260709 12:12:34.633678 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:34.637687 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:34.568323 29023 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:34.602391 29264 raft_consensus.cc:697] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 14 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
W20260709 12:12:34.641032 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 77338.5us
I20260709 12:12:34.650229 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:34.634688 29198 raft_consensus.cc:2749] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:34.619307 29243 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:34.657517 22497 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:34.664886 22449 raft_consensus.cc:2468] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 13.
I20260709 12:12:34.662261 22448 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 20.
I20260709 12:12:34.668112 22600 raft_consensus.cc:1275] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:34.668001 29148 consensus_queue.cc:1048] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:34.663930 29225 raft_consensus.cc:2804] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:34.669598 29225 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:34.669970 29225 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:34.672000 29264 consensus_queue.cc:237] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:34.648718 29327 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:34.683279 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:34.687458 29084 leader_election.cc:290] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:34.688663 28701 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:34.689181 29120 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:34.690388 29023 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:34.718899 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 84531.8us
I20260709 12:12:34.719404 22602 raft_consensus.cc:1275] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:12:34.724119 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:34.732651 22600 raft_consensus.cc:1240] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 12:12:34.722647 29197 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:34.690861 29221 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:34.708072 29184 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:34.722904 28973 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:34.751258 23121 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
I20260709 12:12:34.752281 22451 raft_consensus.cc:1240] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:34.739066 29197 leader_election.cc:290] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:34.757385 29243 consensus_queue.cc:1048] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:34.757602 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:34.758410 23119 raft_consensus.cc:2368] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 17. Current term is 18.
I20260709 12:12:34.758706 29313 consensus_queue.cc:1048] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:34.759178 29243 consensus_queue.cc:1059] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:34.760365 29313 raft_consensus.cc:3055] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:34.762809 29313 raft_consensus.cc:740] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:34.772387 29120 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:34.774048 29221 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:34.782192 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:34.789247 22605 raft_consensus.cc:1275] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:34.764423 29036 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:34.821167 29036 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:34.823939 29345 log.cc:927] Time spent T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.465s	user 0.003s	sys 0.001s
I20260709 12:12:34.827577 29005 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:34.830370 29005 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:34.824478 29225 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:34.834147 29225 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:34.768060 29313 consensus_queue.cc:260] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:34.836779 29313 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:34.840188 29184 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:34.856542 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:34.860019 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:34.862016 22451 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:34.872560 22570 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:34.872427 29184 consensus_queue.cc:1048] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:12:34.873553 22421 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:34.874212 29184 raft_consensus.cc:2804] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:34.874692 29184 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:34.875243 29184 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:34.875651 29349 log.cc:927] Time spent T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.577s	user 0.000s	sys 0.008s
I20260709 12:12:34.880275 22451 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 22.
I20260709 12:12:34.890038 29198 consensus_queue.cc:1048] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:34.893748 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:34.901477 22421 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:34.912719 22421 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:34.915601 22570 leader_election.cc:400] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 election: Vote denied by peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353) with higher term. Message: Invalid argument: T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 17. Current term is 18.
I20260709 12:12:34.916129 22570 leader_election.cc:403] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:12:34.922186 22599 raft_consensus.cc:1240] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:34.928207 22421 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:34.914113 29276 raft_consensus.cc:2749] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:34.899958 29223 consensus_queue.cc:1048] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 12:12:34.921353 29351 raft_consensus.cc:2749] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:12:34.932556 22570 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 2.793s (SENT) [suppressed 10 similar messages]
I20260709 12:12:34.949690 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:34.950587 22604 raft_consensus.cc:2393] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 17: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:34.951372 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:34.952155 22603 raft_consensus.cc:2393] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 13: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:34.952332 29064 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:34.936228 29269 raft_consensus.cc:2749] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:34.931891 29221 raft_consensus.cc:2804] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:34.956604 29221 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:34.956975 29221 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:34.959327 23087 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:34.961064 28701 raft_consensus.cc:2804] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:34.961153 23087 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:34.961508 28701 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:34.961903 28701 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:34.962780 29332 raft_consensus.cc:2804] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:34.962915 29327 consensus_queue.cc:1059] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:34.963409 29332 raft_consensus.cc:697] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 13 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:34.964469 29084 raft_consensus.cc:3055] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:34.964393 29332 consensus_queue.cc:237] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:34.964907 29084 raft_consensus.cc:740] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:34.969308 22421 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:12:34.971701 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:34.972467 23087 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:34.992349 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:34.993012 22523 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:34.995271 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:34.933900 29286 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:34.966236 29084 consensus_queue.cc:260] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:34.997152 23087 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:34.999550 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:35.000352 22531 raft_consensus.cc:2410] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 12:12:35.001317 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:35.001784 29084 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:35.001947 22532 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:35.002664 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:35.009531 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:34.994834 29269 raft_consensus.cc:2804] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:35.010471 29269 raft_consensus.cc:697] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:35.011338 23125 raft_consensus.cc:1275] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 18 index: 17. (index mismatch)
I20260709 12:12:35.011669 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:35.012050 29207 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:35.012323 29036 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.029251 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:35.029253 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:35.030138 22526 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:35.013489 23120 raft_consensus.cc:1240] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:12:34.991770 29304 consensus_queue.cc:1048] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:12:35.041088 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:33.755098 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:35.025650 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:35.042363 22451 raft_consensus.cc:2468] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
I20260709 12:12:35.026945 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:35.039533 22454 raft_consensus.cc:1275] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:12:35.047868 22448 raft_consensus.cc:1240] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:35.050288 22530 raft_consensus.cc:1240] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:35.039700 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:35.063707 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:35.067293 23121 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 17.
I20260709 12:12:35.068346 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:35.068917 22453 raft_consensus.cc:1275] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:35.017453 28973 raft_consensus.cc:2804] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:35.074280 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:35.080809 22530 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:35.016227 29184 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:35.078712 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 50759.5us
I20260709 12:12:35.082089 22523 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 21.
I20260709 12:12:35.094074 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:35.094944 22531 raft_consensus.cc:2468] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 15.
I20260709 12:12:35.099514 22450 raft_consensus.cc:1275] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:35.103233 23088 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:35.105455 22604 raft_consensus.cc:1275] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 12:12:35.103056 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:35.105882 22604 pending_rounds.cc:85] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc: Aborting all ops after (but not including) 7
I20260709 12:12:35.106349 22604 pending_rounds.cc:107] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:12:35.106647 22531 raft_consensus.cc:1240] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:12:35.106616 22604 raft_consensus.cc:2889] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:35.108266 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:35.112764 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:35.119536 22600 raft_consensus.cc:1240] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 20. Current term is 21. Ops: []
W20260709 12:12:35.121081 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:35.122632 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:35.125438 22531 raft_consensus.cc:1275] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:12:35.108281 29079 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.050096 29036 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:35.109004 29206 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.076264 28701 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:35.158931 22603 raft_consensus.cc:1240] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:35.131029 29247 raft_consensus.cc:2764] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 12:12:35.129364 29005 raft_consensus.cc:2804] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:35.076962 29207 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:35.165030 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:35.176117 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:35.182533 22525 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 19.
I20260709 12:12:35.096616 29294 consensus_queue.cc:1059] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 12:12:35.185091 23118 raft_consensus.cc:1275] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 12:12:35.186029 29376 log.cc:927] Time spent T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 12:12:35.189291 29269 consensus_queue.cc:237] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:35.192179 29036 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:35.197011 22526 raft_consensus.cc:2468] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 18.
W20260709 12:12:35.164381 29364 log.cc:927] Time spent T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.408s	user 0.001s	sys 0.004s
I20260709 12:12:35.233112 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:35.199540 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:35.234614 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:35.214049 22523 raft_consensus.cc:1240] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:12:35.214179 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:35.214679 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:35.237468 22525 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:35.223253 22530 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 19.
I20260709 12:12:35.228523 29184 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:35.239005 23123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57332 (request call id 1536) took 1449 ms. Trace:
I20260709 12:12:35.248783 22528 raft_consensus.cc:1275] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 12:12:35.249179 22528 pending_rounds.cc:85] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting all ops after (but not including) 11
I20260709 12:12:35.249389 22528 pending_rounds.cc:107] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 12:12:35.249377 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:35.249840 22528 raft_consensus.cc:2889] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:35.211717 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:35.239993 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:35.240960 22529 raft_consensus.cc:1240] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:35.242081 22530 raft_consensus.cc:1240] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:35.157549 29079 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:35.253841 22600 raft_consensus.cc:2368] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 16. Current term is 17.
I20260709 12:12:35.255489 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:35.163916 29206 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:35.231093 29120 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.287848 29120 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:35.288357 29276 raft_consensus.cc:3055] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:35.288779 29276 raft_consensus.cc:740] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:35.289578 29276 consensus_queue.cc:260] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:35.290400 29120 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:35.296090 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:35.296314 29005 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:35.296746 29005 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:35.297392 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:35.297760 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:35.298127 22598 raft_consensus.cc:2368] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 11. Current term is 12.
I20260709 12:12:35.298944 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:35.299535 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:35.300513 22602 raft_consensus.cc:2393] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 13: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:35.300683 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:35.301401 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:35.301787 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:35.302127 22602 raft_consensus.cc:2393] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 13: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:35.302386 22603 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 19.
I20260709 12:12:35.299924 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:35.272361 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:35.304874 22600 raft_consensus.cc:1275] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:12:35.305640 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:35.306317 22529 raft_consensus.cc:2393] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 17: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:35.247331 23123 rpcz_store.cc:276] 0709 12:12:33.763653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:34.303678 (+540025us) service_pool.cc:224] Handling call
0709 12:12:34.304061 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:34.327730 (+ 23669us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:34.327782 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:34.341267 (+ 13485us) log.cc:844] Serialized 26 byte log entry
0709 12:12:34.955574 (+614307us) spinlock_profiling.cc:243] Waited 3.68 ms on lock 0x7b180045ce20. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc7823e07 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc7840c02 00007f9cca4c820b 00007f9cca4cdd23 00007f9cca4ce0d1 00007f9cca8e9a0f
0709 12:12:35.028152 (+ 72578us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:35.028191 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:35.028255 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:35.197017 (+168762us) raft_consensus.cc:1685] finished
0709 12:12:35.197049 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:35.212534 (+ 15485us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18758,"raft.queue_time_us":20817,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":12947,"spinlock_wait_cycles":8453376,"thread_start_us":72411,"threads_started":1,"wal-append.queue_time_us":759758}
I20260709 12:12:35.276679 29207 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:35.276813 29079 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:35.282179 22422 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:35.307066 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:35.308144 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:35.308681 22523 raft_consensus.cc:2376] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 19. Re-sending same reply.
I20260709 12:12:35.284423 29304 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.309114 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:35.309446 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:35.309326 29304 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:35.310180 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:35.304880 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:12:35.311211 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:35.311558 29304 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:35.313045 29035 raft_consensus.cc:2749] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:35.313887 29035 consensus_queue.cc:1048] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:12:35.314144 29276 raft_consensus.cc:3060] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:35.317266 29294 consensus_queue.cc:1059] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:35.318342 29064 raft_consensus.cc:3055] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:35.318744 29064 raft_consensus.cc:740] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:35.319602 29064 consensus_queue.cc:260] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:35.321477 29206 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:35.323006 22528 raft_consensus.cc:1275] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:12:35.323359 22531 raft_consensus.cc:1275] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:12:35.326865 29064 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:35.327291 28701 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:35.310758 22523 raft_consensus.cc:1275] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 12:12:35.331601 22523 pending_rounds.cc:85] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting all ops after (but not including) 11
I20260709 12:12:35.332057 22523 pending_rounds.cc:107] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 12:12:35.332247 22532 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 18.
I20260709 12:12:35.332410 22523 raft_consensus.cc:2889] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:35.339661 22525 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 12.
I20260709 12:12:35.347137 22529 raft_consensus.cc:1275] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 12:12:35.331362 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 61515.5us
I20260709 12:12:35.348088 22496 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:35.351704 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:35.352690 22526 raft_consensus.cc:2393] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 15: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:35.354053 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:35.359519 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:35.361431 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:35.366601 22496 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:35.371687 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:35.374861 22602 raft_consensus.cc:1240] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:35.364221 29030 raft_consensus.cc:2749] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:35.386996 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:35.389374 22602 raft_consensus.cc:1240] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:35.393940 22606 raft_consensus.cc:1275] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:12:35.396551 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:35.396610 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:35.397495 22453 raft_consensus.cc:1275] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:12:35.398152 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:35.399293 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:35.404497 22604 raft_consensus.cc:2368] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 16. Current term is 17.
W20260709 12:12:35.402226 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 272565us
W20260709 12:12:35.405840 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:35.408751 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 52601.7us
I20260709 12:12:35.412214 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:35.377955 29036 raft_consensus.cc:2749] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:35.414413 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:35.418797 22452 raft_consensus.cc:2393] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 13: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:35.414811 22496 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:35.430778 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:35.378823 29035 consensus_queue.cc:1048] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.038s
I20260709 12:12:35.438125 22569 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:35.439400 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:35.438324 22455 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 20.
I20260709 12:12:35.472092 22457 raft_consensus.cc:1240] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 18. Current term is 19. Ops: []
W20260709 12:12:35.508541 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 66572.4us
I20260709 12:12:35.513480 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:35.517189 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:35.514389 22456 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 24.
I20260709 12:12:35.523651 22457 raft_consensus.cc:1275] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:12:35.526369 23089 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:35.427980 28987 consensus_queue.cc:1048] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.079s
I20260709 12:12:35.474607 29206 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.529517 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:35.536300 22454 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 18.
I20260709 12:12:35.476792 29223 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:35.532491 23089 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:35.541404 22496 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:35.474305 29084 consensus_queue.cc:1059] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 16.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.057s
I20260709 12:12:35.439546 29265 consensus_queue.cc:1059] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.088s
I20260709 12:12:35.548708 23089 leader_election.cc:400] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 11 election: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 11. Current term is 12.
I20260709 12:12:35.521548 29036 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.553627 23089 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:12:35.542732 29221 consensus_meta.cc:287] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.585s	user 0.008s	sys 0.005s
I20260709 12:12:35.560678 29221 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:35.564327 22449 raft_consensus.cc:2393] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 12: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:35.564756 29221 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:35.567744 22601 raft_consensus.cc:1240] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 17. Current term is 18. Ops: []
W20260709 12:12:35.585680 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 463848us
I20260709 12:12:35.537570 29348 raft_consensus.cc:2749] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:35.547520 29224 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.545087 28973 raft_consensus.cc:697] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 22 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
W20260709 12:12:35.623396 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 69860.9us
I20260709 12:12:35.624771 23089 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:35.383898 22348 catalog_manager.cc:5697] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:35.529783 29327 consensus_queue.cc:1059] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.064s
I20260709 12:12:35.556079 28867 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.632447 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:35.555518 29388 raft_consensus.cc:2749] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:35.595872 29084 raft_consensus.cc:3055] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:35.544214 29206 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:35.643337 22601 raft_consensus.cc:2393] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 12: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:35.628968 29243 raft_consensus.cc:2749] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:35.629619 29278 raft_consensus.cc:2749] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:35.666963 22523 raft_consensus.cc:1275] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:35.643934 28701 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.600143 29036 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:35.592799 29223 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:35.647887 29304 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.643046 29084 raft_consensus.cc:740] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:35.646747 29120 raft_consensus.cc:2749] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:35.677606 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 239585us
I20260709 12:12:35.629753 29224 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:35.652271 29247 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:35.691565 22525 raft_consensus.cc:1275] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:12:35.693217 22569 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:35.675733 29030 raft_consensus.cc:2749] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:35.643113 28867 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:35.709865 22569 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:35.714644 22529 raft_consensus.cc:1275] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 18 index: 17. (index mismatch)
I20260709 12:12:35.652161 29221 consensus_queue.cc:1048] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 12:12:35.651717 29390 consensus_queue.cc:1059] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
I20260709 12:12:35.731285 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:35.734194 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:35.743260 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:35.744490 22525 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 16.
I20260709 12:12:35.753436 22569 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:35.764407 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 44891.8us
I20260709 12:12:35.698553 29247 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:35.794967 29247 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:35.690055 28701 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:35.713626 29400 raft_consensus.cc:2749] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:35.767007 29197 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:35.766170 29294 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.770372 29264 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.803048 29294 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:35.717854 29304 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:35.789230 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 164538us
I20260709 12:12:35.831378 23089 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:35.833197 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:35.804167 29264 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:35.859813 29393 log.cc:927] Time spent T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
W20260709 12:12:35.860620 29397 log.cc:927] Time spent T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
W20260709 12:12:35.861521 29395 log.cc:927] Time spent T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 12:12:35.712901 28973 consensus_queue.cc:237] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:35.826866 29390 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:35.874783 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 45169.6us
I20260709 12:12:35.788480 29403 consensus_queue.cc:1048] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 12:12:35.780716 29084 consensus_queue.cc:260] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 16.16, Last appended by leader: 16, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:35.878115 29084 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:35.862187 29327 raft_consensus.cc:2749] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:35.867345 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 114072us
W20260709 12:12:35.870473 29394 log.cc:927] Time spent T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
W20260709 12:12:35.872020 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 243945us
I20260709 12:12:35.895780 23088 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:35.889554 23089 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:35.890364 22569 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:35.905242 22569 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:35.907977 22569 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:35.869230 29402 raft_consensus.cc:2749] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:35.911016 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:35.912942 22421 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.012s	sys 0.008s
W20260709 12:12:35.913461 22421 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.012s	sys 0.008s
W20260709 12:12:35.913785 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 556182us
W20260709 12:12:35.891733 29389 log.cc:927] Time spent T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.265s	user 0.001s	sys 0.000s
I20260709 12:12:35.919121 23089 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:35.964226 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 68826.1us
I20260709 12:12:35.965103 23088 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:35.909363 29403 raft_consensus.cc:2749] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:35.913573 29351 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.007s	sys 0.015s
I20260709 12:12:35.912117 29404 raft_consensus.cc:2804] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:35.912339 29206 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:35.922739 29184 raft_consensus.cc:2749] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:35.889806 29265 consensus_queue.cc:1059] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.041s
W20260709 12:12:35.963590 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 87438.9us
I20260709 12:12:35.886624 29390 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:35.924222 29414 raft_consensus.cc:2749] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:35.914973 29120 consensus_queue.cc:1059] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
W20260709 12:12:35.975414 29351 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.007s	sys 0.015s
I20260709 12:12:35.966966 29223 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:35.979534 29287 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.996870 22495 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:35.978168 29398 consensus_queue.cc:1048] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:36.007301 22495 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:12:36.008018 29064 consensus_meta.cc:287] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.681s	user 0.010s	sys 0.001s
W20260709 12:12:35.986562 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 78671.5us
I20260709 12:12:36.008587 22495 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:36.009438 29005 consensus_meta.cc:287] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.712s	user 0.010s	sys 0.002s
I20260709 12:12:36.009382 22569 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:35.980144 29404 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:36.010669 29404 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:36.010234 29005 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:36.012269 23125 raft_consensus.cc:1240] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:36.014256 29005 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:35.999366 29396 log.cc:927] Time spent T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 12:12:36.015990 29403 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:12:36.016278 23117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 1520) took 1040 ms. Trace:
I20260709 12:12:36.016496 29403 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 24 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:12:35.999843 29407 log.cc:927] Time spent T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 12:12:36.017129 29403 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:36.000125 29387 consensus_queue.cc:1048] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.107s
W20260709 12:12:36.019585 29399 log.cc:927] Time spent T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 12:12:35.986922 29243 consensus_queue.cc:1048] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 12:12:36.020761 29421 raft_consensus.cc:2804] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:36.003486 29414 raft_consensus.cc:2804] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:35.996336 28701 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:36.021327 29421 raft_consensus.cc:697] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 21 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:36.021533 29414 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:36.004595 29264 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:35.993788 29036 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:36.021950 29414 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:36.023079 29005 raft_consensus.cc:2749] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:36.001171 29409 log.cc:927] Time spent T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:12:36.027069 22524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 2717) took 1027 ms. Trace:
I20260709 12:12:36.027465 22524 rpcz_store.cc:276] 0709 12:12:34.999546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.010532 (+ 10986us) service_pool.cc:224] Handling call
0709 12:12:35.010953 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:35.089474 (+ 78521us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:35.089502 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:35.112305 (+ 22803us) log.cc:844] Serialized 26 byte log entry
0709 12:12:35.401879 (+289574us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:35.401949 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:35.402034 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:36.026816 (+624782us) raft_consensus.cc:1685] finished
0709 12:12:36.026837 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:36.027006 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67940,"raft.queue_time_us":93360,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":16106,"thread_start_us":248290,"threads_started":1,"wal-append.queue_time_us":408404}
I20260709 12:12:35.999425 29265 raft_consensus.cc:3055] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:36.029054 29265 raft_consensus.cc:740] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:36.029960 29265 consensus_queue.cc:260] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:36.031188 29265 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:36.042204 22450 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 21.
I20260709 12:12:36.053027 29411 raft_consensus.cc:2749] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:36.016933 23117 rpcz_store.cc:276] 0709 12:12:34.975395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:34.975510 (+   115us) service_pool.cc:224] Handling call
0709 12:12:35.010161 (+ 34651us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:35.010502 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:35.010533 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:35.300793 (+290260us) spinlock_profiling.cc:243] Waited 5.91 ms on lock 0x7b2c000a5ff8. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc9227a11 00007f9cc9237372 00007f9cca969a01 00007f9cca92e43a 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2
0709 12:12:35.301173 (+   380us) log.cc:844] Serialized 26 byte log entry
0709 12:12:35.541504 (+240331us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:35.541570 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:35.541664 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:36.015978 (+474314us) raft_consensus.cc:1685] finished
0709 12:12:36.016000 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:36.016216 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1364,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"spinlock_wait_cycles":13586816,"thread_start_us":239064,"threads_started":1,"wal-append.queue_time_us":404893}
I20260709 12:12:36.022316 29421 consensus_queue.cc:237] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:36.066004 22495 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:36.061249 29392 raft_consensus.cc:2749] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:36.069311 29036 consensus_queue.cc:1048] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:36.070158 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:36.071328 29412 raft_consensus.cc:2804] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:36.071686 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:36.072225 29411 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:36.072444 29351 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:36.072957 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:36.071815 29412 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:36.073041 29351 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:36.073670 29412 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:36.072750 29411 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:36.077028 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 157963us
I20260709 12:12:36.085175 23089 leader_election.cc:400] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 election: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 16. Current term is 17.
I20260709 12:12:36.060286 29264 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:36.038755 29223 consensus_queue.cc:1048] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 12:12:36.072252 29313 raft_consensus.cc:3055] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:12:36.101356 22604 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.003s	sys 0.021s
W20260709 12:12:36.101830 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 136826us
I20260709 12:12:36.104853 23088 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:36.063488 29416 raft_consensus.cc:2804] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:36.105515 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:36.107733 22602 raft_consensus.cc:1240] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:36.083433 29304 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:36.057711 29400 consensus_queue.cc:1048] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
W20260709 12:12:36.108284 22604 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.003s	sys 0.022s
W20260709 12:12:36.110324 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:36.114187 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 197995us
I20260709 12:12:36.121994 28973 raft_consensus.cc:2804] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:36.122905 28973 raft_consensus.cc:697] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 18 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:36.124090 28973 consensus_queue.cc:237] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:36.143342 29036 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:36.144243 29036 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:36.148566 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:36.149240 22451 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 19.
I20260709 12:12:36.150332 22495 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:36.054039 29287 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:36.153887 23088 leader_election.cc:304] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:36.096240 28701 consensus_queue.cc:1059] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 12:12:36.104328 29313 raft_consensus.cc:740] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:36.110754 29197 raft_consensus.cc:2749] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:36.106061 29416 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:12:36.212327 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 96310.7us
I20260709 12:12:36.104221 29264 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:36.095721 29414 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:36.175681 29428 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.109236 29247 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:36.244690 22421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:36.158229 29390 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:36.212255 29351 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:36.249205 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:36.250391 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:36.215417 29413 raft_consensus.cc:2804] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:12:36.238781 29286 consensus_meta.cc:287] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 1.210s	user 0.006s	sys 0.008s
I20260709 12:12:36.226696 29416 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:36.274648 23123 raft_consensus.cc:1240] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 22 LEADER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 21. Current term is 22. Ops: [21.15-21.15]
W20260709 12:12:36.252419 29382 log.cc:927] Time spent T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:12:36.292371 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:36.258322 29413 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:36.266956 29036 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:36.320469 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:36.275653 29286 raft_consensus.cc:2749] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353) with higher term. Message: Invalid argument: T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 17. Current term is 18.
I20260709 12:12:36.325248 23117 raft_consensus.cc:1275] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:12:36.327581 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:36.328503 23117 raft_consensus.cc:2393] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 12: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:36.330766 23117 raft_consensus.cc:1275] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:12:36.335340 23121 raft_consensus.cc:1240] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:36.337844 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:12:36.339507 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 46205.8us
I20260709 12:12:36.296108 29390 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:36.347956 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:36.348904 23124 raft_consensus.cc:2410] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 12:12:36.318534 29084 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.317494 29413 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:36.254518 29428 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:36.365959 29287 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:36.368764 29411 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:36.369275 28867 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:36.370223 29264 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:36.357451 29439 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:36.371285 29439 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:36.373572 29439 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:36.331323 29313 consensus_queue.cc:260] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:36.375128 29313 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:36.375365 29442 consensus_queue.cc:1048] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.109s
I20260709 12:12:36.363659 29084 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:36.379851 29084 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:36.363834 29390 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:36.382637 29390 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:36.387032 29431 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.386761 29413 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:36.387562 29431 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:36.388962 29413 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:36.373986 29404 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:36.391587 22570 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:36.395058 22599 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 18.
I20260709 12:12:36.399121 29429 raft_consensus.cc:2804] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:36.393484 29400 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
W20260709 12:12:36.408618 29419 log.cc:927] Time spent T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
I20260709 12:12:36.395057 29431 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:36.408547 29414 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:36.411733 29403 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:36.414098 29403 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 25 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:36.419037 29429 raft_consensus.cc:697] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 18 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:36.420142 29429 consensus_queue.cc:237] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:36.424710 22527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 2716) took 1425 ms. Trace:
I20260709 12:12:36.426143 29294 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:36.425103 22527 rpcz_store.cc:276] 0709 12:12:34.999286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.003636 (+  4350us) service_pool.cc:224] Handling call
0709 12:12:35.003963 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:35.039545 (+ 35582us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:35.039580 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:35.069901 (+ 30321us) log.cc:844] Serialized 26 byte log entry
0709 12:12:35.546112 (+476211us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:35.621359 (+ 75247us) log.cc:844] Serialized 14 byte log entry
0709 12:12:35.652610 (+ 31251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:35.652823 (+   213us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:36.422634 (+769811us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b1800175cc0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc78413f3 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd 0000000000388634 0000000000388479 00007f9cc782483a
0709 12:12:36.424424 (+  1790us) raft_consensus.cc:1685] finished
0709 12:12:36.424507 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:36.424634 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71660,"prepare.queue_time_us":66388,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":96779,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":25822,"spinlock_wait_cycles":6991232,"thread_start_us":436908,"threads_started":1,"wal-append.queue_time_us":611103}
I20260709 12:12:36.407085 29286 raft_consensus.cc:2749] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:36.427909 22421 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:36.429131 22421 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:36.430320 22421 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:36.431084 29064 raft_consensus.cc:2749] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:36.432098 29430 consensus_queue.cc:1059] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.071s
I20260709 12:12:36.435679 29079 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.432430 29206 raft_consensus.cc:2749] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:36.400632 29400 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:36.501402 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:36.507381 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:36.514636 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:36.532522 22598 raft_consensus.cc:2410] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 12:12:36.536264 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:36.540407 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 54588us
I20260709 12:12:36.540441 22421 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:36.541255 22570 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:36.537185 22600 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 23.
I20260709 12:12:36.550738 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:36.551586 22600 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 19.
I20260709 12:12:36.539605 22496 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:36.559042 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:36.559752 23121 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
I20260709 12:12:36.563066 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:36.564822 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:36.566452 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:36.566545 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:36.567339 22530 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 23.
I20260709 12:12:36.567706 23124 raft_consensus.cc:2393] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 14: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:36.569348 22524 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:36.569600 29404 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:36.571352 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:36.573829 29440 consensus_queue.cc:1059] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 12:12:36.555998 29286 raft_consensus.cc:2749] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:36.555912 29447 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:36.575945 29447 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:36.578168 29447 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:36.578743 29286 raft_consensus.cc:476] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 19 LEADER]: Not starting pre-election -- already a leader
I20260709 12:12:36.579686 29403 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.580272 29403 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:36.580581 22570 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:36.581343 29438 consensus_queue.cc:1059] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:36.581766 22570 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:36.582322 29438 raft_consensus.cc:2749] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:36.575300 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:36.582851 22570 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:36.587844 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:12:36.586546 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 99700.4us
W20260709 12:12:36.597707 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 57267.2us
I20260709 12:12:36.585597 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:36.599655 22601 raft_consensus.cc:2468] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 15.
I20260709 12:12:36.602469 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:36.500103 28867 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:36.607272 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:36.609087 22525 raft_consensus.cc:1275] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:12:36.486312 29294 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:36.647514 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:36.647675 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:36.648535 22526 raft_consensus.cc:2393] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 12: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:36.632560 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:36.648622 23123 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 17.
I20260709 12:12:36.652504 22525 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 17.
I20260709 12:12:36.549256 29348 raft_consensus.cc:3055] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:12:36.655784 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 72999.5us
I20260709 12:12:36.549015 29411 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.556320 29413 raft_consensus.cc:2749] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:36.531298 29431 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:36.583207 29247 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:36.582921 29438 raft_consensus.cc:2749] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:36.663098 22524 raft_consensus.cc:1275] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:12:36.656212 22496 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:12:36.672550 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 73976.2us
I20260709 12:12:36.688133 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:12:36.672453 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 68631.4us
I20260709 12:12:36.690761 22496 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:36.691404 22421 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:36.585255 29400 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:36.606956 29447 raft_consensus.cc:2804] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:36.606247 28867 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:36.549319 29079 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:36.646756 29221 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
W20260709 12:12:36.696437 23088 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.033s	sys 0.070s
I20260709 12:12:36.696936 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:36.696746 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:36.701447 22456 raft_consensus.cc:2468] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 15.
I20260709 12:12:36.660645 29286 raft_consensus.cc:2749] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:12:36.703471 23088 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.034s	sys 0.071s
I20260709 12:12:36.707258 22454 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 17: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:36.659008 29348 raft_consensus.cc:740] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
W20260709 12:12:36.704299 22604 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.037s	sys 0.068s
I20260709 12:12:36.703012 22569 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:36.708998 22456 raft_consensus.cc:1240] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:36.660632 29430 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:12:36.707211 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 553390us
I20260709 12:12:36.699513 22422 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:36.693373 29403 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:12:36.702205 22457 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.000s	sys 0.027s
I20260709 12:12:36.721760 22527 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 19.
I20260709 12:12:36.705544 22570 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:36.601325 29412 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:36.707864 22604 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.038s	sys 0.068s
I20260709 12:12:36.692485 29432 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:12:36.721943 22457 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.000s	sys 0.028s
I20260709 12:12:36.702634 29287 raft_consensus.cc:2749] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:36.698392 29447 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:36.732151 22604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3536) took 1327 ms. Trace:
I20260709 12:12:36.693022 29294 consensus_queue.cc:1048] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:12:36.683943 29411 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:36.727259 29391 raft_consensus.cc:2804] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:36.724463 29435 raft_consensus.cc:2804] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:36.732867 22604 rpcz_store.cc:276] 0709 12:12:35.404493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.409768 (+  5275us) service_pool.cc:224] Handling call
0709 12:12:35.410037 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:35.410296 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:36.112177 (+701881us) log.cc:844] Serialized 14 byte log entry
0709 12:12:36.725404 (+613227us) log.cc:844] Serialized 14 byte log entry
0709 12:12:36.731659 (+  6255us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:36.731741 (+    82us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:36.731809 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:36.731906 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:36.732070 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68699,"prepare.queue_time_us":185351,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":189232,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":10987,"thread_start_us":1202101,"threads_started":2}
I20260709 12:12:36.727752 29332 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.716416 29438 consensus_queue.cc:1048] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 12:12:36.712749 29221 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:36.735540 29447 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:36.717819 29402 consensus_queue.cc:1048] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 12:12:36.734464 29414 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:36.758738 22523 raft_consensus.cc:2468] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 15.
I20260709 12:12:36.733626 29432 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:36.732082 29403 consensus_queue.cc:1048] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
W20260709 12:12:36.767701 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 43669.9us
I20260709 12:12:36.718189 29431 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:36.749298 29391 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:36.748909 29428 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:36.725135 29430 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:36.755336 29421 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:36.785645 22570 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:36.748678 29435 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:36.759307 29446 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.750051 29400 consensus_queue.cc:1059] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
W20260709 12:12:36.782693 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 91999.8us
I20260709 12:12:36.795243 22450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 2536) took 1315 ms. Trace:
I20260709 12:12:36.767848 29445 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:36.788439 29265 consensus_meta.cc:287] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.757s	user 0.007s	sys 0.006s
I20260709 12:12:36.880661 22496 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:36.804760 22450 rpcz_store.cc:276] 0709 12:12:35.480147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.480286 (+   139us) service_pool.cc:224] Handling call
0709 12:12:36.795029 (+1314743us) spinlock_profiling.cc:243] Waited 492 ms on lock 0x7b540038a4d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:36.795169 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1130627840}
W20260709 12:12:36.794086 29449 log.cc:927] Time spent T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:12:36.760658 29332 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:36.767864 29427 consensus_queue.cc:1059] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.187s
I20260709 12:12:36.796365 29391 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:36.783005 29455 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:36.775707 29414 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:36.887661 22348 catalog_manager.cc:5697] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 9 to 13, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 13 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:36.894415 22570 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:12:36.757910 29348 consensus_queue.cc:260] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:36.908213 29348 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:36.909714 29457 log.cc:927] Time spent T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 12:12:36.899256 29404 consensus_queue.cc:1048] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
W20260709 12:12:36.911778 29452 log.cc:927] Time spent T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:12:36.913234 29404 raft_consensus.cc:2804] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:36.915068 29404 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:36.916764 29430 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:36.802462 29435 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:36.902370 22496 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:36.786041 29416 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:36.842490 29421 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:36.917032 29404 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:36.921864 29079 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:36.921710 29432 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:36.938086 29278 raft_consensus.cc:3055] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:36.927592 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:36.929984 23117 raft_consensus.cc:1240] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 21 LEADER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:36.931408 22524 raft_consensus.cc:1240] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:36.932322 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:36.932523 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:36.933019 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:36.986145 22525 raft_consensus.cc:1240] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 12:12:36.986569 22532 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 16.
I20260709 12:12:36.934947 23124 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:36.936281 29265 raft_consensus.cc:2749] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:36.936515 22528 raft_consensus.cc:1240] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:36.904850 29406 raft_consensus.cc:2804] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:36.936861 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:36.921006 29221 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:36.944155 23120 raft_consensus.cc:1240] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 19. Current term is 20. Ops: []
W20260709 12:12:36.921743 29453 log.cc:927] Time spent T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 12:12:36.902523 29440 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:36.923507 22569 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:36.903272 28987 raft_consensus.cc:2749] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:36.988714 22530 raft_consensus.cc:1240] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:36.935017 29431 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:36.880215 29446 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:36.998886 29406 raft_consensus.cc:697] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:36.983557 29403 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:36.983083 29278 raft_consensus.cc:740] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:37.002437 29406 consensus_queue.cc:237] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:37.011194 29421 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:37.011797 29446 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:36.999521 29466 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:37.012661 29466 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:36.999754 29402 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:37.019326 29414 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:37.019475 29402 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:37.021843 29402 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:36.997496 29412 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:36.907334 29455 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:37.025139 29455 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:37.001456 29462 log.cc:927] Time spent T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:12:37.026147 29332 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:37.014746 29466 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:37.034142 29079 consensus_queue.cc:1059] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:12:37.035665 29437 raft_consensus.cc:3055] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:37.036168 29079 raft_consensus.cc:3055] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:37.036360 29437 raft_consensus.cc:740] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:37.036712 29079 raft_consensus.cc:740] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:37.037515 29437 consensus_queue.cc:260] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:37.040633 29079 consensus_queue.cc:260] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:37.041745 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.042459 22602 raft_consensus.cc:1240] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:37.044602 29079 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:37.046653 29391 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:37.051146 22524 raft_consensus.cc:1240] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:12:37.053016 29391 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:37.053167 29437 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:37.054224 22529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 2724) took 1400 ms. Trace:
I20260709 12:12:37.055444 29411 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:37.055958 29412 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.056252 29402 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:12:37.056481 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.057214 29416 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:37.059818 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:37.060866 29449 log.cc:927] Time spent T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:12:37.061290 22601 raft_consensus.cc:1240] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:37.103894 22529 rpcz_store.cc:276] 0709 12:12:35.654398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.661395 (+  6997us) service_pool.cc:224] Handling call
0709 12:12:35.683621 (+ 22226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:35.715203 (+ 31582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:37.053997 (+1338794us) spinlock_profiling.cc:243] Waited 30.5 ms on lock 0x7b54001f1b54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:37.054164 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70262144}
I20260709 12:12:37.062266 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:37.062577 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:37.135577 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:37.065802 23125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 1729) took 1412 ms. Trace:
I20260709 12:12:37.136351 23125 rpcz_store.cc:276] 0709 12:12:35.653087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.653343 (+   256us) service_pool.cc:224] Handling call
0709 12:12:35.672190 (+ 18847us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:36.012660 (+340470us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:37.065552 (+1052892us) spinlock_profiling.cc:243] Waited 340 ms on lock 0x7b5400750154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:37.065717 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":781668736}
I20260709 12:12:37.058732 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:37.138306 22602 raft_consensus.cc:2393] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 15: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:37.067621 29278 consensus_queue.cc:260] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:37.068403 29224 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:37.068457 29403 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:37.069444 29465 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.903450 29445 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:37.078260 29447 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:37.078652 29225 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.079991 29265 consensus_queue.cc:1059] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:37.081059 29425 raft_consensus.cc:3055] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:37.082141 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:37.086252 29304 raft_consensus.cc:2804] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:12:37.086411 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 395070us
I20260709 12:12:37.179698 22421 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:12:37.086683 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 387232us
I20260709 12:12:37.087147 22455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 3251) took 1019 ms. Trace:
I20260709 12:12:37.087301 29422 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:37.087546 29404 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:36.998252 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 74827.3us
I20260709 12:12:37.089238 28867 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:37.094198 22457 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 3255) took 1025 ms. Trace:
I20260709 12:12:37.089795 23124 raft_consensus.cc:1275] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:12:37.190862 29403 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:37.191720 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:37.192329 29447 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:37.192953 29064 raft_consensus.cc:2749] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:37.193140 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:37.189816 22457 rpcz_store.cc:276] 0709 12:12:36.068976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:36.073963 (+  4987us) service_pool.cc:224] Handling call
0709 12:12:36.074280 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:36.074682 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:36.075014 (+   332us) log.cc:844] Serialized 14 byte log entry
0709 12:12:37.087785 (+1012771us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:37.088237 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 12:12:37.088393 (+   156us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:37.088615 (+   222us) log.cc:844] Serialized 14 byte log entry
0709 12:12:37.093879 (+  5264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:37.093963 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:37.094000 (+    37us) raft_consensus.cc:1685] finished
0709 12:12:37.094013 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:37.094134 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":408699,"prepare.queue_time_us":5221,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":64,"raft.queue_time_us":366006,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":5051,"thread_start_us":653701,"threads_started":1,"wal-append.queue_time_us":706614}
I20260709 12:12:37.200534 29445 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:37.174688 29465 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:37.184950 29304 raft_consensus.cc:697] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:37.204101 29304 consensus_queue.cc:237] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:37.176075 29435 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:37.096823 22452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51844 (request call id 3249) took 1593 ms. Trace:
I20260709 12:12:37.207185 29435 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:37.110251 22496 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:12:37.208061 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 97892.9us
I20260709 12:12:37.207345 22452 rpcz_store.cc:276] 0709 12:12:35.503418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.504155 (+   737us) service_pool.cc:224] Handling call
0709 12:12:35.521680 (+ 17525us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:35.521906 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 12:12:35.538067 (+ 16161us) log.cc:844] Serialized 14 byte log entry
0709 12:12:36.338912 (+800845us) spinlock_profiling.cc:243] Waited 4.88 ms on lock 0x7b18003be060. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc7823e07 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc7840c02 00007f9cca4c820b 00007f9cca4cdd23 00007f9cca4ce23a 00007f9cca938a2a
0709 12:12:37.096431 (+757519us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:37.096517 (+    86us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:12:37.096592 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:37.096675 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:37.096773 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":369894,"prepare.queue_time_us":15976,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":5128,"raft.queue_time_us":370523,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":11227392,"thread_start_us":387310,"threads_started":1,"wal-append.queue_time_us":1224666}
W20260709 12:12:37.209209 22599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43070 (request call id 1183) took 1911 ms (client timeout 2006 ms). Trace:
W20260709 12:12:37.209570 22599 rpcz_store.cc:269] 0709 12:12:35.297409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.297521 (+   112us) service_pool.cc:224] Handling call
0709 12:12:37.209053 (+1911532us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400449154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:37.209144 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2399819136}
I20260709 12:12:37.210134 29269 consensus_queue.cc:1048] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:37.210471 29079 raft_consensus.cc:3055] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 12:12:37.097018 29460 log.cc:927] Time spent T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.195s	user 0.002s	sys 0.000s
I20260709 12:12:37.146036 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:37.210832 29079 raft_consensus.cc:740] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:37.211290 22604 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 18.
I20260709 12:12:37.091850 29427 raft_consensus.cc:3055] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:37.212153 29427 raft_consensus.cc:740] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:37.147923 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:37.212918 29404 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:37.134279 29440 raft_consensus.cc:2749] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:37.150795 29278 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:37.177063 29225 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:37.216677 29225 leader_election.cc:290] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:37.217204 29225 raft_consensus.cc:2804] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:37.176062 29425 raft_consensus.cc:740] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:37.217582 29225 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:37.218016 29225 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:37.218300 29425 consensus_queue.cc:260] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:37.219362 29425 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:37.159775 29442 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:37.219955 29442 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:37.221293 28867 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.221961 29442 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317)
I20260709 12:12:37.160913 22497 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:37.106062 29402 raft_consensus.cc:697] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:37.093665 29084 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:37.223027 29084 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:37.223388 29402 consensus_queue.cc:237] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:37.182727 29035 consensus_queue.cc:1048] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 12:12:37.225131 29084 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:37.162793 29387 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:37.225808 29387 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:37.095301 29221 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.227115 29221 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:37.227906 29387 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:37.105466 29412 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:37.229048 29221 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:37.146929 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:37.229848 29412 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:37.095157 29432 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:37.177392 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:37.230806 22597 raft_consensus.cc:2393] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 16: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:37.230535 29432 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:37.183082 23121 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 17: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:37.211760 29079 consensus_queue.cc:260] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:37.216771 22348 catalog_manager.cc:5697] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 8 to 14. New cstate: current_term: 14 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:37.232641 29432 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:37.232390 22348 catalog_manager.cc:5697] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:37.061831 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:37.232686 28987 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:37.235110 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 50982us
I20260709 12:12:37.221767 28867 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:37.239439 22421 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:12:37.239580 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 78740.7us
I20260709 12:12:37.239871 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:37.182389 22455 rpcz_store.cc:276] 0709 12:12:36.067693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:36.069416 (+  1723us) service_pool.cc:224] Handling call
0709 12:12:36.069729 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:36.277666 (+207937us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:36.297078 (+ 19412us) log.cc:844] Serialized 14 byte log entry
0709 12:12:36.328827 (+ 31749us) log.cc:844] Serialized 14 byte log entry
0709 12:12:36.433754 (+104927us) spinlock_profiling.cc:243] Waited 3.59 ms on lock 0x7b4800130d58. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9ccf857aa1 00007f9ccf84eb37 00007f9ccf84e9ca 00007f9ccf94626f 00007f9ccf945f37 00007f9ccf95a55c 00007f9ccf95a508 00007f9ccf95a488 00007f9ccf95a443 00007f9ccf9596ec 00007f9cce883a96
0709 12:12:36.505670 (+ 71916us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:36.505730 (+    60us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:36.505776 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:37.086943 (+581167us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b540019fd54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:37.087005 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:37.087101 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":45712,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":73,"raft.queue_time_us":54209,"raft.run_cpu_time_us":1017,"raft.run_wall_time_us":76710,"spinlock_wait_cycles":498813440,"thread_start_us":207694,"threads_started":2,"wal-append.queue_time_us":69687}
W20260709 12:12:37.235581 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.181710 22422 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:37.183140 22449 raft_consensus.cc:1240] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:37.238804 22598 raft_consensus.cc:2393] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 17: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
W20260709 12:12:37.242755 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 61130.4us
I20260709 12:12:37.243950 29221 consensus_queue.cc:1048] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:37.245781 29221 raft_consensus.cc:2804] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:37.246206 29221 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:37.246668 29221 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:37.241132 22497 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:37.250754 22422 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:37.241168 22421 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:37.254213 22421 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:37.255496 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:37.256747 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:37.257332 22457 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:37.258112 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:37.258703 22598 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 18.
I20260709 12:12:37.260083 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:37.260491 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:37.261888 22604 raft_consensus.cc:1240] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:12:37.262046 22600 raft_consensus.cc:1275] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:12:37.262612 22599 raft_consensus.cc:1240] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:37.263622 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:37.264209 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:37.264802 22598 raft_consensus.cc:2468] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 14.
W20260709 12:12:37.249423 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 250862us
I20260709 12:12:37.266651 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:37.268522 28867 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:37.269199 29079 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:37.256683 29269 raft_consensus.cc:2804] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:37.271535 29269 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:37.271953 29269 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:37.272130 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:37.275318 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:37.256875 29294 raft_consensus.cc:2804] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:37.279496 29294 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:37.280014 29294 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:37.253067 28987 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:37.281607 22524 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:46680
I20260709 12:12:37.184329 29422 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:37.283983 29422 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:37.286351 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:37.288769 22600 raft_consensus.cc:1275] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:12:37.261098 22605 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 21.
I20260709 12:12:37.265698 22497 leader_election.cc:304] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:37.291800 22530 raft_consensus.cc:1240] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:12:37.295658 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:37.297163 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:37.297571 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:37.299656 22421 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:37.302083 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:37.302950 22530 raft_consensus.cc:2410] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 19 because replica has last-logged OpId of term: 17 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 15.
I20260709 12:12:37.297775 22531 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 19.
I20260709 12:12:37.304908 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:37.305413 22531 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:37.249524 29465 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:37.253404 29224 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:37.306483 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:37.254573 29447 raft_consensus.cc:2749] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:37.292309 29412 raft_consensus.cc:2804] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:37.312193 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:37.317055 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:37.317939 22570 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:37.329391 22605 raft_consensus.cc:2393] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 18: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:37.326521 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:37.321342 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:37.330161 22527 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:37.331359 22600 raft_consensus.cc:2393] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 21: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:37.333604 23088 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:37.334023 22495 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:37.306908 29398 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:12:37.307191 29265 raft_consensus.cc:2804] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:37.353226 22495 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:37.353776 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:37.356110 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:37.356595 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:37.316371 29406 consensus_queue.cc:1059] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.034s
I20260709 12:12:37.357141 23118 raft_consensus.cc:2468] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
I20260709 12:12:37.362308 22457 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 20.
I20260709 12:12:37.350617 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:37.363190 22450 raft_consensus.cc:1240] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:37.338440 29148 consensus_queue.cc:1048] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 12:12:37.359508 29286 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:37.359508 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:37.351420 29387 raft_consensus.cc:2804] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:37.360414 22606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43070 (request call id 1193) took 1255 ms. Trace:
I20260709 12:12:37.360984 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:37.338280 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:37.326164 29351 raft_consensus.cc:2804] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:37.369590 22531 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 20.
I20260709 12:12:37.369513 22527 raft_consensus.cc:2468] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 20.
I20260709 12:12:37.282963 22348 catalog_manager.cc:5697] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 10 to 14, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 14 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:37.376341 22532 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 18.
I20260709 12:12:37.375567 22606 rpcz_store.cc:276] 0709 12:12:36.105500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:36.105633 (+   133us) service_pool.cc:224] Handling call
0709 12:12:36.105984 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:36.245895 (+139911us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:36.245931 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:36.250660 (+  4729us) log.cc:844] Serialized 26 byte log entry
0709 12:12:36.715539 (+464879us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:36.715576 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:36.715639 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:37.096343 (+380704us) spinlock_profiling.cc:243] Waited 4.29 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:12:37.349322 (+252979us) raft_consensus.cc:1685] finished
0709 12:12:37.349345 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:37.360342 (+ 10997us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":165148,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":11331,"spinlock_wait_cycles":9877760,"thread_start_us":530224,"threads_started":2,"wal-append.queue_time_us":494701}
I20260709 12:12:37.212970 29427 consensus_queue.cc:260] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:37.375651 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:37.383646 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:37.384842 22527 raft_consensus.cc:2468] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 15.
I20260709 12:12:37.316334 29401 consensus_queue.cc:1048] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 12:12:37.334515 29412 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
W20260709 12:12:37.387566 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 278379us
I20260709 12:12:37.386420 23088 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:37.388165 22528 raft_consensus.cc:2368] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 16. Current term is 17.
I20260709 12:12:37.390430 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:37.391467 23088 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:37.392395 23088 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:37.393133 23088 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:37.393800 29411 raft_consensus.cc:2749] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:37.394809 28701 raft_consensus.cc:2804] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:37.395360 28701 raft_consensus.cc:697] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 20 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:37.338112 29198 consensus_queue.cc:1048] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 12:12:37.338547 29472 consensus_queue.cc:1059] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 12:12:37.396363 28701 consensus_queue.cc:237] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:37.362434 28867 raft_consensus.cc:2749] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:37.399180 29348 raft_consensus.cc:2804] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:37.399659 29348 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:37.375195 29387 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:37.400058 29348 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:37.400442 29387 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:37.382159 29351 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:37.403499 29351 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:37.403537 29445 raft_consensus.cc:2804] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:37.404408 29445 raft_consensus.cc:697] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 20 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:37.405252 29445 consensus_queue.cc:237] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:37.361604 29265 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:37.410310 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:37.411032 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 52278.4us
I20260709 12:12:37.429441 22570 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:37.391602 22531 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:37.440577 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.458603 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:12:37.466668 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.470520 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:37.403203 29084 raft_consensus.cc:2804] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:37.475417 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:37.476259 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:37.476835 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:37.484627 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:37.485337 23124 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:37.484648 23125 raft_consensus.cc:1240] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:37.486666 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:37.493515 22531 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 17.
I20260709 12:12:37.394606 29269 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:37.408075 29412 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:37.420929 29391 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:37.505738 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:37.507128 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:37.507447 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:37.505125 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:37.512972 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:37.514439 29442 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.515224 29442 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:37.523909 22454 raft_consensus.cc:1275] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 12:12:37.524540 22454 pending_rounds.cc:85] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f: Aborting all ops after (but not including) 12
I20260709 12:12:37.524828 22454 pending_rounds.cc:107] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 12:12:37.525265 22454 raft_consensus.cc:2889] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:37.528086 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:37.529585 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:37.531239 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:37.531813 22449 raft_consensus.cc:1275] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:12:37.532981 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:37.533721 22449 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 21.
I20260709 12:12:37.488096 28987 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:37.460317 29265 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:37.374179 29404 consensus_queue.cc:1059] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.117s
I20260709 12:12:37.479274 29084 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:37.494549 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:37.475750 29440 consensus_queue.cc:1059] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 12:12:37.551647 23089 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:37.530843 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:37.537927 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:37.540217 22456 raft_consensus.cc:2393] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 16: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
W20260709 12:12:37.536896 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 107571us
I20260709 12:12:37.542757 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:37.555804 22452 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 17.
I20260709 12:12:37.540599 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:37.544070 28973 consensus_queue.cc:1048] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:37.557014 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:37.557132 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:37.544879 22348 catalog_manager.cc:5697] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 11 to 14, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 14 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:37.547137 29084 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:37.548055 29403 raft_consensus.cc:3055] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:37.548563 23088 leader_election.cc:400] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 16. Current term is 17.
I20260709 12:12:37.497105 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:37.556214 22570 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:37.562026 22454 raft_consensus.cc:1275] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:12:37.540293 29406 raft_consensus.cc:2749] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:12:37.560994 23124 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 17.
I20260709 12:12:37.567952 22531 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 16.
I20260709 12:12:37.572109 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:37.565236 23088 leader_election.cc:403] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:37.561909 22495 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:37.549998 29404 raft_consensus.cc:3055] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:37.578323 22530 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 14.
I20260709 12:12:37.585137 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:37.585713 22530 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 20.
I20260709 12:12:37.581403 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:37.587086 22532 raft_consensus.cc:3060] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:37.587162 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:37.583559 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:37.534546 29391 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:37.592561 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:37.593179 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 259637us
I20260709 12:12:37.559526 29472 raft_consensus.cc:3055] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:37.596163 22528 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 12.
I20260709 12:12:37.597812 22495 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:37.596226 22530 raft_consensus.cc:1240] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 12:12:37.599697 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:37.597939 29465 raft_consensus.cc:2749] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:37.602432 22531 raft_consensus.cc:1275] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 15. (term mismatch)
I20260709 12:12:37.602773 22531 pending_rounds.cc:85] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting all ops after (but not including) 14
I20260709 12:12:37.603004 22531 pending_rounds.cc:107] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting uncommitted NO_OP operation due to leader change: 21.15
I20260709 12:12:37.603227 22531 raft_consensus.cc:2889] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:37.597122 29472 raft_consensus.cc:740] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:37.604516 22531 raft_consensus.cc:1275] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:12:37.565127 29403 raft_consensus.cc:740] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:37.606137 23089 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:37.573280 29327 raft_consensus.cc:2804] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:37.629267 22570 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:37.579114 29440 raft_consensus.cc:2749] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:37.622325 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:37.632133 22448 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 22.
I20260709 12:12:37.553035 29351 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:37.606683 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 58263.2us
I20260709 12:12:37.606632 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:37.649348 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 357600us
I20260709 12:12:37.643411 23088 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:37.584591 29404 raft_consensus.cc:740] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:37.657989 22532 raft_consensus.cc:2468] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 16.
I20260709 12:12:37.624382 29468 raft_consensus.cc:2749] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 16. Current term is 17.
I20260709 12:12:37.660717 23088 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:37.673012 23088 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:37.648087 29473 raft_consensus.cc:2749] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:37.641688 29465 raft_consensus.cc:2804] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:37.585431 29431 consensus_queue.cc:1048] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.064s
I20260709 12:12:37.633270 29327 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:37.680716 28867 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:37.684405 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:37.639919 29471 consensus_queue.cc:1059] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 12:12:37.632263 29198 consensus_queue.cc:1059] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 12:12:37.667369 29416 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.644008 28987 consensus_queue.cc:1059] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.040s
I20260709 12:12:37.700034 28867 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:37.713093 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.714936 29225 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:37.698457 29278 raft_consensus.cc:2804] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:37.728196 29286 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:37.728545 28867 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:37.729264 29269 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:37.681026 29221 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:37.731550 29391 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:37.666052 29474 consensus_queue.cc:1059] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 12:12:37.662990 29472 consensus_queue.cc:260] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:37.772351 22529 raft_consensus.cc:1240] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:37.725126 29348 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:37.695549 29327 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:37.659456 29079 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.698779 29388 raft_consensus.cc:2749] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:37.785959 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:37.592177 29442 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:37.740586 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:37.794415 22457 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 12.
I20260709 12:12:37.747937 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:37.701987 29465 raft_consensus.cc:697] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:37.672542 29421 raft_consensus.cc:2804] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:37.679289 28973 raft_consensus.cc:2804] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:37.801954 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:37.758774 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:37.711880 29294 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:37.803503 29477 log.cc:927] Time spent T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:12:37.803707 22606 raft_consensus.cc:2393] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 16: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:37.805017 29294 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:37.774632 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:37.806377 22451 raft_consensus.cc:1240] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:37.749368 29278 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:37.754040 29425 raft_consensus.cc:3055] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:37.761585 29455 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.801265 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:37.802066 28973 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:37.802814 29481 log.cc:927] Time spent T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:12:37.768690 22605 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 17.
I20260709 12:12:37.738597 29416 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:37.835521 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.811956 22495 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:37.796433 29224 raft_consensus.cc:2749] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:37.803352 29422 consensus_meta.cc:287] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.519s	user 0.010s	sys 0.000s
I20260709 12:12:37.825431 23087 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:37.738399 29404 consensus_queue.cc:260] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:37.827445 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 177353us
I20260709 12:12:37.807075 29421 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:37.836962 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 164044us
I20260709 12:12:37.849644 22524 raft_consensus.cc:606] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Received request to transfer leadership to TS 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:37.850055 22524 raft_consensus.cc:614] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:37.825004 29278 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:37.845641 22497 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:37.848419 23087 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:37.832468 28973 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:37.850649 22523 raft_consensus.cc:1240] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:37.825551 29425 raft_consensus.cc:740] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:37.796536 29079 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:37.855510 23087 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:37.861373 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 255317us
W20260709 12:12:37.832305 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 203097us
I20260709 12:12:37.862650 22421 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:37.864537 22570 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:37.852891 29435 raft_consensus.cc:3055] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:37.855336 29468 raft_consensus.cc:2749] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:37.853940 29421 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:37.867441 22570 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:37.870704 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:37.831732 29455 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:37.863873 29442 raft_consensus.cc:2749] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:37.879076 22526 raft_consensus.cc:1240] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:37.880767 22528 raft_consensus.cc:1275] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 12:12:37.884665 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.862058 29224 raft_consensus.cc:2749] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:37.877532 22570 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:37.892176 23123 raft_consensus.cc:1240] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:12:37.853202 29422 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:37.869573 29351 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:37.849413 29304 consensus_queue.cc:1048] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 12:12:37.900261 23119 raft_consensus.cc:1240] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:37.900928 22600 raft_consensus.cc:1275] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 16. (term mismatch)
I20260709 12:12:37.871591 29483 raft_consensus.cc:2749] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:37.896287 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:37.856921 29431 consensus_queue.cc:1048] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 12:12:37.901319 22600 pending_rounds.cc:85] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting all ops after (but not including) 15
I20260709 12:12:37.892983 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:37.906391 22600 pending_rounds.cc:107] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting uncommitted NO_OP operation due to leader change: 20.16
I20260709 12:12:37.865008 29401 consensus_queue.cc:1059] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 12:12:37.870388 29435 raft_consensus.cc:740] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:37.858175 29265 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:37.883882 29286 raft_consensus.cc:2749] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:37.906584 22606 raft_consensus.cc:2376] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 18. Re-sending same reply.
I20260709 12:12:37.906767 22600 raft_consensus.cc:2889] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:37.872737 29471 raft_consensus.cc:2804] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:37.862002 29269 consensus_queue.cc:1048] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 12:12:37.884469 29402 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.874445 29388 consensus_queue.cc:1048] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 12:12:37.896698 28987 raft_consensus.cc:2749] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:37.897332 29406 raft_consensus.cc:2804] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:12:37.931739 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 76298.7us
I20260709 12:12:37.903573 29468 raft_consensus.cc:2749] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:37.934544 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 78223.8us
I20260709 12:12:37.874361 29387 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:37.939121 22496 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:37.956707 22496 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:12:37.931591 29479 log.cc:927] Time spent T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.174s	user 0.001s	sys 0.001s
I20260709 12:12:37.958199 22531 raft_consensus.cc:1240] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:37.884042 28701 consensus_queue.cc:1059] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 12:12:37.931173 29225 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:37.880138 29465 consensus_queue.cc:237] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:37.979558 23125 raft_consensus.cc:2393] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 20: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:37.903857 29425 consensus_queue.cc:260] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:38.001354 29225 raft_consensus.cc:2749] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:38.002357 29225 raft_consensus.cc:2804] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:38.002823 29225 raft_consensus.cc:697] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:37.933097 29402 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:38.032006 29422 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 24 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:38.033581 29497 consensus_queue.cc:1048] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:38.054409 29387 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:37.988759 29221 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:38.004907 29445 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:37.964105 29486 consensus_queue.cc:1048] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.091s
I20260709 12:12:38.116688 22570 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:38.120499 22570 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:38.125612 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 158370us
I20260709 12:12:38.131283 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:37.999508 29435 consensus_queue.cc:260] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:38.124517 29416 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:38.134462 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 191737us
I20260709 12:12:38.137853 23087 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:38.139663 29493 log.cc:927] Time spent T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:12:38.061821 29225 consensus_queue.cc:237] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:38.076335 29445 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:38.148005 22530 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:38.149591 23087 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:38.140678 29327 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:38.138361 29411 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.163442 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:38.141211 29287 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.168687 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:38.172185 22603 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:38.173542 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:38.175042 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:38.175621 22598 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 20.
I20260709 12:12:38.176676 22604 raft_consensus.cc:1240] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 25 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 24. Current term is 25. Ops: []
I20260709 12:12:38.178555 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:38.182137 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:38.182691 22598 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 17.
I20260709 12:12:38.186345 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:38.186926 22598 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:38.186887 23087 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:38.164390 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:38.202607 22530 raft_consensus.cc:1275] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:12:38.204648 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:38.192116 22497 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:38.206670 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:38.211759 22421 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:38.212836 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:38.213372 23117 raft_consensus.cc:1240] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:38.213487 22604 raft_consensus.cc:2393] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 17: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
W20260709 12:12:38.240159 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 47609.8us
I20260709 12:12:38.253726 23118 raft_consensus.cc:1240] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:38.254786 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:38.257901 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:38.259379 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:38.340210 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 85759.4us
I20260709 12:12:38.346132 23124 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 17.
I20260709 12:12:38.158676 29471 raft_consensus.cc:697] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
W20260709 12:12:38.353938 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 167133us
I20260709 12:12:38.370319 23087 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:38.362044 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:38.341028 22497 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:38.171020 29265 leader_election.cc:290] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:38.375938 29416 raft_consensus.cc:2804] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:38.214990 29487 raft_consensus.cc:2749] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:38.383193 29416 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:38.383671 29416 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:38.215768 29287 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:38.376068 29502 log.cc:927] Time spent T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.240s	user 0.000s	sys 0.000s
I20260709 12:12:38.377211 29506 raft_consensus.cc:2749] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:38.379597 29432 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:38.387032 29432 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:38.380365 29503 consensus_queue.cc:1059] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.028s
I20260709 12:12:38.276970 29495 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:38.277416 29490 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.381743 22598 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 19.
I20260709 12:12:38.382076 29510 consensus_queue.cc:1059] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:38.385962 29287 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:38.193599 29411 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:38.396636 28973 consensus_meta.cc:287] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.530s	user 0.010s	sys 0.000s
I20260709 12:12:38.381784 29513 raft_consensus.cc:2804] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:38.212491 29327 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:38.397279 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:38.423537 22526 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 21.
I20260709 12:12:38.339828 29489 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.399675 29416 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:38.400245 29198 raft_consensus.cc:3055] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:38.401300 22528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 1396) took 1079 ms. Trace:
I20260709 12:12:38.438547 22528 rpcz_store.cc:276] 0709 12:12:37.322145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:37.625409 (+303264us) service_pool.cc:224] Handling call
0709 12:12:37.669866 (+ 44457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:37.885467 (+215601us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:38.401077 (+515610us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b54004001d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:38.401243 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":484038016}
I20260709 12:12:38.415737 29495 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:38.185690 29486 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:38.407337 22603 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 24.
W20260709 12:12:38.411330 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 278585us
I20260709 12:12:38.412045 23087 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:38.204011 28701 raft_consensus.cc:2749] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:38.374485 29406 raft_consensus.cc:697] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:38.342628 29387 raft_consensus.cc:2804] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:38.279018 29447 raft_consensus.cc:2749] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 12:12:38.430040 29412 consensus_meta.cc:287] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.896s	user 0.006s	sys 0.004s
I20260709 12:12:38.415107 29506 raft_consensus.cc:2749] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:38.403941 29432 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:38.444465 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:38.444996 23087 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:38.534206 23124 raft_consensus.cc:2410] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 12:12:38.446329 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:38.446923 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:38.535845 22526 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 18.
I20260709 12:12:38.441140 29507 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:38.448246 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:38.448172 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:38.449559 29468 raft_consensus.cc:2749] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:38.474479 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 99116.8us
I20260709 12:12:38.420606 29511 consensus_queue.cc:1048] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.114s
W20260709 12:12:38.505072 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:38.438298 29198 raft_consensus.cc:740] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:38.443436 29495 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:38.422484 29513 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:38.568523 29513 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:38.419417 29490 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:38.538848 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:12:38.538190 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 93269.7us
I20260709 12:12:38.577746 23087 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:38.437377 28973 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:38.452500 29387 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:38.456786 29402 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:38.539345 29492 raft_consensus.cc:2749] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:38.440403 29489 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:38.587229 22526 raft_consensus.cc:2393] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 16: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
W20260709 12:12:38.581248 29421 consensus_meta.cc:287] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.687s	user 0.008s	sys 0.002s
I20260709 12:12:38.447978 29486 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:38.707677 29416 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:38.708680 29486 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:38.546700 29507 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:38.709023 29490 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:38.710645 28973 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:38.711051 29507 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:38.600451 29387 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:38.711614 29411 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:38.533905 29412 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:38.542637 22497 leader_election.cc:304] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
W20260709 12:12:38.718029 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 175446us
W20260709 12:12:38.628890 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 51242us
I20260709 12:12:38.545218 29471 consensus_queue.cc:237] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:38.721884 29412 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:38.722822 22527 raft_consensus.cc:1240] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:38.697235 29468 raft_consensus.cc:2804] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:38.724212 29468 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:38.724599 29468 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:38.725756 29421 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:38.727078 29411 raft_consensus.cc:2804] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:38.727622 29411 raft_consensus.cc:697] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:38.580897 29327 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.728730 29421 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:38.697525 29278 consensus_meta.cc:287] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.832s	user 0.007s	sys 0.008s
I20260709 12:12:38.728924 29327 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:38.729547 29278 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:38.731221 23121 raft_consensus.cc:1240] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 12:12:38.731757 29455 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:38.732260 29278 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:12:38.697769 29084 consensus_meta.cc:287] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 1.123s	user 0.012s	sys 0.002s
I20260709 12:12:38.539047 29515 consensus_queue.cc:1048] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.074s
I20260709 12:12:38.733207 29084 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:38.735246 23116 raft_consensus.cc:1240] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:38.607854 29198 consensus_queue.cc:260] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:38.736841 29198 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:38.737584 29084 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:38.598640 29403 consensus_queue.cc:260] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:38.741115 29513 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:38.742909 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:38.743680 22525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 2449) took 1809 ms. Trace:
I20260709 12:12:38.744119 22525 rpcz_store.cc:276] 0709 12:12:36.933865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:36.987136 (+ 53271us) service_pool.cc:224] Handling call
0709 12:12:37.079819 (+ 92683us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:37.080180 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:37.080210 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:37.080680 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 12:12:37.390971 (+310291us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:37.391120 (+   149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:37.391196 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:37.806996 (+415800us) raft_consensus.cc:1685] finished
0709 12:12:37.807021 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:38.743441 (+936420us) spinlock_profiling.cc:243] Waited 92.3 ms on lock 0x7b540030edd0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:38.743623 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":81,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"spinlock_wait_cycles":212319616,"thread_start_us":309918,"threads_started":1,"wal-append.queue_time_us":585103}
I20260709 12:12:38.746019 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:38.609637 29406 consensus_queue.cc:237] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:38.747021 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:38.743505 22601 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:38.747846 22604 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 19.
I20260709 12:12:38.749238 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:38.749897 22602 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 18.
I20260709 12:12:38.719483 23087 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:38.698449 29445 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:38.750873 29515 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.743408 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:38.751752 22603 raft_consensus.cc:2410] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:12:38.751389 29515 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:38.753532 29515 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:38.720752 29495 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:38.703991 23122 raft_consensus.cc:1240] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:38.755285 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:38.755694 29495 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:38.754009 29445 raft_consensus.cc:2749] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:38.761226 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:38.761953 22603 raft_consensus.cc:2393] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 24: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:38.762296 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:38.765287 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:38.734144 22348 catalog_manager.cc:5697] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:38.706418 29489 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:38.750474 29079 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:38.747264 29327 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:38.765394 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:38.775290 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:38.794687 22452 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 17.
I20260709 12:12:38.775990 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:38.796277 22598 raft_consensus.cc:2393] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 25: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:38.774544 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:38.728514 29411 consensus_queue.cc:237] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:38.768225 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:38.766834 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:38.766158 28867 raft_consensus.cc:3055] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:38.774762 22455 raft_consensus.cc:1275] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:12:38.777163 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:38.814476 22599 raft_consensus.cc:1275] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:12:38.814718 22525 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:38.779163 22601 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 18.
I20260709 12:12:38.815485 22457 raft_consensus.cc:2393] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 21: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:38.798031 22602 raft_consensus.cc:1240] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:38.799887 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:38.788586 22422 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:38.802641 29471 consensus_queue.cc:1059] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:38.804142 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:38.819492 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:38.754015 29515 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.797508 22456 raft_consensus.cc:2468] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:12:38.824424 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:38.785332 29505 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.819625 22449 raft_consensus.cc:1275] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:12:38.801028 22497 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:38.822103 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:38.828130 22455 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:38.829218 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:38.830765 22524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:46680 (request call id 11) took 1615 ms. Trace:
I20260709 12:12:38.831178 22524 rpcz_store.cc:276] 0709 12:12:37.209987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:37.248993 (+ 39006us) service_pool.cc:224] Handling call
0709 12:12:38.824753 (+1575760us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b5400263c54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca928853 00007f9ccf8f660a 00007f9cc8e7c7d4 00007f9cc8e7c762 00007f9cc8e7c691 00007f9cc8e7c60c 00007f9cc8e7b8c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:38.824861 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1304560000}
I20260709 12:12:38.827427 22497 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:38.833936 22524 raft_consensus.cc:1240] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:38.798530 29486 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:12:38.838101 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 61610.4us
I20260709 12:12:38.814240 28867 raft_consensus.cc:740] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:38.849206 28867 consensus_queue.cc:260] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:38.850373 28867 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:38.851344 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:12:38.851482 22347 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55962 (request call id 346) took 26451 ms (client timeout 15000 ms). Trace:
I20260709 12:12:38.852156 22604 raft_consensus.cc:2393] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 15: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:38.853049 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:38.854008 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:38.854178 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:38.842134 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:38.855845 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:38.822750 29351 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:12:38.844138 22601 raft_consensus.cc:1240] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 12:12:38.840363 29465 raft_consensus.cc:2804] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:38.793738 28973 consensus_queue.cc:1059] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 12:12:38.843344 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:38.854970 22604 raft_consensus.cc:2393] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 18: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:38.862120 22525 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 24.
I20260709 12:12:38.864346 22601 raft_consensus.cc:1240] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:38.813553 29278 consensus_queue.cc:1048] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.031s
I20260709 12:12:38.865747 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:38.870091 22529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 1374) took 1581 ms. Trace:
I20260709 12:12:38.879546 22529 rpcz_store.cc:276] 0709 12:12:37.288342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:37.292727 (+  4385us) service_pool.cc:224] Handling call
0709 12:12:37.319251 (+ 26524us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:37.783694 (+464443us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:38.869774 (+1086080us) spinlock_profiling.cc:243] Waited 443 ms on lock 0x7b5400262354. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:38.870010 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1017991552}
I20260709 12:12:38.871163 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:38.835317 29490 raft_consensus.cc:2804] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:38.879560 22599 raft_consensus.cc:3060] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:38.831799 29515 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:38.883601 29490 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:38.865586 29327 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.871690 29465 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:38.903824 29489 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:38.876044 29406 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:38.887403 29221 consensus_queue.cc:1059] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 12:12:38.880849 29278 consensus_queue.cc:1243] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer 6c6fa11e8ee34711b3551f0c670442bc log is divergent from this leader: its last log entry 18.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:12:38.858732 29486 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:38.878930 29513 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:38.909191 29327 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:38.838182 29505 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:38.879109 29401 consensus_queue.cc:1048] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 12:12:38.883767 29198 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:38.875447 29351 raft_consensus.cc:697] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 24 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:38.892957 29304 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.907488 22348 catalog_manager.cc:5697] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 4 to 14. New cstate: current_term: 14 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:38.919479 22603 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 15.
I20260709 12:12:38.916499 22523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 1376) took 1627 ms. Trace:
I20260709 12:12:38.957183 22497 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:38.940690 22495 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:12:38.977864 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:38.987149 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 46593us
I20260709 12:12:38.987284 22599 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 22.
W20260709 12:12:38.990234 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:38.962353 22523 rpcz_store.cc:276] 0709 12:12:37.288850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:37.291143 (+  2293us) service_pool.cc:224] Handling call
0709 12:12:37.298354 (+  7211us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:37.858093 (+559739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:38.916282 (+1058189us) spinlock_profiling.cc:243] Waited 552 ms on lock 0x7b5400263c54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:38.916441 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1269818112}
I20260709 12:12:38.992938 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:38.993592 22597 raft_consensus.cc:1240] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 25 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 24. Current term is 25. Ops: []
I20260709 12:12:39.000211 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:12:38.914441 29522 log.cc:927] Time spent T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.111s	user 0.002s	sys 0.003s
I20260709 12:12:38.990025 22495 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:39.002858 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 142292us
I20260709 12:12:38.915530 29221 raft_consensus.cc:3055] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:38.915992 29431 raft_consensus.cc:3055] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:38.911885 29490 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:38.921905 29482 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.922335 29465 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:39.032977 23089 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:38.917572 29486 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:38.920667 29515 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:38.947218 29327 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:39.013890 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:39.021106 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:39.027175 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:38.985960 29079 raft_consensus.cc:2804] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:39.001740 29495 raft_consensus.cc:2804] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:38.948882 29198 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:38.914922 29406 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:39.046401 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:39.046507 22599 pending_rounds.cc:85] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting all ops after (but not including) 14
I20260709 12:12:39.046703 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:38.914685 29489 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:39.010478 29287 raft_consensus.cc:2749] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:39.010035 29221 raft_consensus.cc:740] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:39.063838 29221 consensus_queue.cc:260] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:39.065250 29221 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:39.071226 23125 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57332 (request call id 1567) took 1568 ms (client timeout 1845 ms). Trace:
I20260709 12:12:38.951215 29387 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:39.071806 23125 rpcz_store.cc:269] 0709 12:12:37.502963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:37.503148 (+   185us) service_pool.cc:224] Handling call
0709 12:12:39.071036 (+1567888us) spinlock_profiling.cc:243] Waited 422 ms on lock 0x7b54007f0154. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:39.071159 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":971458432}
I20260709 12:12:39.074208 29387 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:39.074374 29476 log.cc:927] Time spent T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 1.444s	user 0.005s	sys 0.020s
I20260709 12:12:39.011535 29431 raft_consensus.cc:740] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:39.049682 29079 raft_consensus.cc:697] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:38.947484 29304 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:39.054459 22601 raft_consensus.cc:2393] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 18: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:38.943584 29468 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:39.055449 22599 pending_rounds.cc:107] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting uncommitted NO_OP operation due to leader change: 18.15
I20260709 12:12:39.037125 29482 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:38.851982 22347 rpcz_store.cc:269] 0709 12:12:12.370704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:12.370961 (+   257us) service_pool.cc:224] Handling call
0709 12:12:38.809245 (+26438284us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:28.046431 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:28.047086 (+   655us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:28.047151 (+    65us) write_op.cc:435] Acquired schema lock
0709 12:12:28.047172 (+    21us) tablet.cc:662] Decoding operations
0709 12:12:28.049077 (+  1905us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:28.049182 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:28.049209 (+    27us) tablet.cc:685] Acquiring locks for 25 operations
0709 12:12:28.065450 (+ 16241us) tablet.cc:701] Row locks acquired
0709 12:12:28.065497 (+    47us) write_op.cc:260] PREPARE: finished
0709 12:12:28.066181 (+   684us) write_op.cc:270] Start()
0709 12:12:28.066324 (+   143us) write_op.cc:276] Timestamp: P: 1783599148066111 usec, L: 0
0709 12:12:28.066371 (+    47us) op_driver.cc:348] REPLICATION: starting
0709 12:12:28.143954 (+ 77583us) log.cc:844] Serialized 9836 byte log entry
0709 12:12:29.180762 (+1036808us) op_driver.cc:464] REPLICATION: finished
0709 12:12:29.523384 (+342622us) write_op.cc:301] APPLY: starting
0709 12:12:29.551481 (+ 28097us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:30.380761 (+829280us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:30.380895 (+   134us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:30.814961 (+434066us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:30.815409 (+   448us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=50,key_file_lookups=50,delta_file_lookups=50,mrs_lookups=0
0709 12:12:30.815570 (+   161us) write_op.cc:312] APPLY: finished
0709 12:12:30.816098 (+   528us) log.cc:844] Serialized 220 byte log entry
0709 12:12:31.185135 (+369037us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:31.199262 (+ 14127us) write_op.cc:454] Released schema lock
0709 12:12:31.223364 (+ 24102us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:31.281516 (+ 58152us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:31.287257 (+  5741us) write_op.cc:454] Released schema lock
0709 12:12:31.367449 (+ 80192us) spinlock_profiling.cc:243] Waited 4.35 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
Metrics: {"mutex_wait_us":120481,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":301198,"apply.run_cpu_time_us":55187,"apply.run_wall_time_us":1744382,"cfile_cache_hit":102,"cfile_cache_hit_bytes":108627,"num_ops":25,"prepare.queue_time_us":612927,"prepare.run_cpu_time_us":30424,"prepare.run_wall_time_us":559481,"raft.queue_time_us":281627,"raft.run_cpu_time_us":15214,"raft.run_wall_time_us":174250,"replication_time_us":1091234,"spinlock_wait_cycles":10014592,"thread_start_us":1375919,"threads_started":5,"wal-append.queue_time_us":955167,"wal-append.run_cpu_time_us":122024,"wal-append.run_wall_time_us":2511045}]]}
I20260709 12:12:38.948891 22348 catalog_manager.cc:5697] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 6 to 8, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 8 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:12:39.059995 29533 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.045413 29278 consensus_queue.cc:1059] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.015s
I20260709 12:12:39.060873 29505 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:39.050177 29445 consensus_queue.cc:1059] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 12:12:39.051466 29495 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:39.071341 29198 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:38.948789 29351 consensus_queue.cc:237] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:39.103592 29495 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:39.004621 22524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 2744) took 1036 ms. Trace:
I20260709 12:12:39.081216 22455 raft_consensus.cc:2468] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 22.
I20260709 12:12:39.107677 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:39.108779 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:39.081928 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:39.108915 29489 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:39.034327 29412 consensus_queue.cc:1059] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.023s
I20260709 12:12:39.086694 22599 raft_consensus.cc:2889] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:39.050066 29084 raft_consensus.cc:2804] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:39.113647 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:39.114501 29278 raft_consensus.cc:3055] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:39.114687 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:39.115068 29278 raft_consensus.cc:740] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:39.115762 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:39.116371 29348 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:39.116775 29084 raft_consensus.cc:697] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 22 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:39.116840 29445 consensus_queue.cc:1243] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer 6c6fa11e8ee34711b3551f0c670442bc log is divergent from this leader: its last log entry 17.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:12:39.119411 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:39.121954 22453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 2540) took 2823 ms. Trace:
I20260709 12:12:39.116024 22524 rpcz_store.cc:276] 0709 12:12:37.968157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:38.834716 (+866559us) service_pool.cc:224] Handling call
0709 12:12:38.835011 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:38.835195 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:12:38.867316 (+ 32121us) log.cc:844] Serialized 14 byte log entry
0709 12:12:39.004328 (+137012us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:39.004374 (+    46us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:39.004415 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:39.004471 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:39.004571 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4859,"prepare.queue_time_us":32390,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":207,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":20965,"thread_start_us":148701,"threads_started":2,"wal-append.queue_time_us":245066}
I20260709 12:12:39.130892 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:39.132764 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:39.124236 22453 rpcz_store.cc:276] 0709 12:12:36.279343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:36.279536 (+   193us) service_pool.cc:224] Handling call
0709 12:12:36.279902 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:36.296421 (+ 16519us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:36.296459 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:37.069514 (+773055us) spinlock_profiling.cc:243] Waited 1.02 ms on lock 0x7b2c00033c98. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc9227a11 00007f9cc9237372 00007f9cca969a01 00007f9cca92e43a 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2
0709 12:12:37.069932 (+   418us) log.cc:844] Serialized 26 byte log entry
0709 12:12:37.184564 (+114632us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:37.184609 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:37.184741 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:39.073797 (+1889056us) spinlock_profiling.cc:243] Waited 69.1 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:12:39.102245 (+ 28448us) raft_consensus.cc:1685] finished
0709 12:12:39.102275 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:39.102464 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16096,"raft.queue_time_us":74316,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":5735,"spinlock_wait_cycles":161335808,"thread_start_us":114180,"threads_started":1,"wal-append.queue_time_us":483667}
I20260709 12:12:39.140861 22453 raft_consensus.cc:1240] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:39.129938 29489 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.143847 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:39.129765 29391 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:39.143949 22526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 2739) took 1177 ms. Trace:
I20260709 12:12:39.148205 22526 rpcz_store.cc:276] 0709 12:12:37.966893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:38.756253 (+789360us) service_pool.cc:224] Handling call
0709 12:12:38.757030 (+   777us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:38.763560 (+  6530us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:38.763589 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:38.764032 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 12:12:38.803493 (+ 39461us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:39.008613 (+205120us) log.cc:844] Serialized 14 byte log entry
0709 12:12:39.143540 (+134927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:39.143611 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:39.143647 (+    36us) raft_consensus.cc:1685] finished
0709 12:12:39.143662 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:39.143891 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":49046,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":21751,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":5975,"thread_start_us":342052,"threads_started":3,"wal-append.queue_time_us":38700}
I20260709 12:12:39.119784 29533 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:39.116281 29278 consensus_queue.cc:260] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:39.161033 29501 raft_consensus.cc:3055] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:12:39.164692 29533 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:12:39.167165 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:39.168275 22527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 1383) took 1877 ms. Trace:
I20260709 12:12:39.183562 22527 rpcz_store.cc:276] 0709 12:12:37.290678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:37.588321 (+297643us) service_pool.cc:224] Handling call
0709 12:12:37.628368 (+ 40047us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:38.723344 (+1094976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:39.168065 (+444721us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540030f7d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:39.168219 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2516557696}
I20260709 12:12:39.169080 29451 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:39.170678 29530 consensus_queue.cc:1059] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:39.146884 29079 consensus_queue.cc:237] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:39.149960 29391 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:39.173470 22495 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:39.175478 22524 raft_consensus.cc:1240] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 12:12:39.176182 23116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 1546) took 1394 ms. Trace:
I20260709 12:12:39.193029 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:39.195305 23122 raft_consensus.cc:1240] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 12:12:39.194875 23116 rpcz_store.cc:276] 0709 12:12:37.781706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:37.781940 (+   234us) service_pool.cc:224] Handling call
0709 12:12:37.797191 (+ 15251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:38.735763 (+938572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:39.175904 (+440141us) spinlock_profiling.cc:243] Waited 938 ms on lock 0x7b5400671bd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:39.176112 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2156808960}
I20260709 12:12:39.146572 29489 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:39.156891 29422 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:39.181932 29351 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:39.199126 22495 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:39.200227 22524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 2749) took 1222 ms. Trace:
I20260709 12:12:39.212355 22524 rpcz_store.cc:276] 0709 12:12:37.978253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.151807 (+1173554us) service_pool.cc:224] Handling call
0709 12:12:39.174863 (+ 23056us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:39.199874 (+ 25011us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:39.200152 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:39.179154 29501 raft_consensus.cc:740] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:39.216084 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:39.216847 23117 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 15.
I20260709 12:12:39.187456 29348 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:39.211539 23116 raft_consensus.cc:1240] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:39.197137 22569 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:39.219560 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:39.220214 23117 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 17.
I20260709 12:12:39.213470 22495 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:39.220847 22570 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:39.214847 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:39.205076 28867 raft_consensus.cc:2749] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:39.223702 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:39.218389 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:39.226635 22570 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:39.231427 29198 raft_consensus.cc:2804] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:39.231877 29198 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:39.232234 29348 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:39.232384 29501 consensus_queue.cc:260] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:39.232391 29530 raft_consensus.cc:2804] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:39.233636 29530 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:39.233734 29501 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:39.234019 29530 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:39.235453 29348 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:39.232255 29198 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:39.236261 29391 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:39.232542 29505 consensus_queue.cc:1048] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:39.212875 29422 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:39.236090 29527 raft_consensus.cc:2804] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:39.240095 29527 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:39.240445 29527 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:39.227288 22569 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:39.205958 29278 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:39.247329 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:39.248011 22448 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 17.
I20260709 12:12:39.253218 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:39.254168 22457 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 17.
I20260709 12:12:39.209208 29482 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:39.266181 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:39.246774 29422 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:39.223513 29516 raft_consensus.cc:2749] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:39.180352 29084 consensus_queue.cc:237] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:39.196334 29451 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:39.266650 22495 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:39.280256 23117 raft_consensus.cc:1240] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:39.217969 29535 raft_consensus.cc:2749] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:39.299074 29494 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:39.299685 29494 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:39.209198 22348 catalog_manager.cc:5697] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 14 to 17, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 17 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:39.301860 29494 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:39.301285 22348 catalog_manager.cc:5697] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
W20260709 12:12:39.302680 29528 log.cc:927] Time spent T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 12:12:39.298602 29516 raft_consensus.cc:2804] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:39.278362 29304 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:39.224582 29351 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:39.311872 29184 consensus_queue.cc:1059] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:39.255218 29474 consensus_queue.cc:1048] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 12:12:39.247007 29411 consensus_queue.cc:1059] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 12:12:39.314211 22525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 1399) took 1345 ms. Trace:
I20260709 12:12:39.608668 22525 rpcz_store.cc:276] 0709 12:12:37.969321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:38.877341 (+908020us) service_pool.cc:224] Handling call
0709 12:12:38.877622 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:38.878127 (+   505us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:12:38.893230 (+ 15103us) log.cc:844] Serialized 14 byte log entry
0709 12:12:39.069082 (+175852us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b18000cd000. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc78413f3 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd 0000000000388634 0000000000388479 00007f9cc782483a
0709 12:12:39.077485 (+  8403us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b18000cd000. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc7823e07 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc7840c02 00007f9cca4c820b 00007f9cca4cdd23 00007f9cca4ce23a 00007f9cca938a2a
0709 12:12:39.313594 (+236109us) log.cc:844] Serialized 14 byte log entry
0709 12:12:39.313858 (+   264us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:39.313907 (+    49us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:39.313960 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:39.314023 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:39.314149 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":15655,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":75,"raft.queue_time_us":254,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":8983,"spinlock_wait_cycles":68641920,"thread_start_us":226922,"threads_started":1,"wal-append.queue_time_us":710669}
I20260709 12:12:39.308535 29516 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
W20260709 12:12:39.427721 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:39.606958 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:39.303920 22348 catalog_manager.cc:5697] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 10 to 17, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 17 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
W20260709 12:12:39.597631 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 350891us
W20260709 12:12:39.608278 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:39.355525 29406 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:39.618085 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:39.622409 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:39.606338 29348 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.604485 29511 raft_consensus.cc:3055] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:39.610882 29304 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:39.623624 29534 log.cc:927] Time spent T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.354s	user 0.003s	sys 0.006s
W20260709 12:12:39.616447 29537 log.cc:927] Time spent T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.332s	user 0.000s	sys 0.009s
I20260709 12:12:39.607759 29287 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:39.615916 29541 log.cc:927] Time spent T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.308s	user 0.008s	sys 0.010s
I20260709 12:12:39.632691 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:39.615929 29516 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:39.616591 29539 log.cc:927] Time spent T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.369s	user 0.002s	sys 0.007s
I20260709 12:12:39.619935 28973 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.630088 28867 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:39.651265 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:39.656715 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:39.672230 22448 raft_consensus.cc:2468] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 16.
W20260709 12:12:39.659415 29221 consensus_meta.cc:287] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.594s	user 0.014s	sys 0.005s
I20260709 12:12:39.673837 22495 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:39.644304 29304 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:39.637895 29348 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:39.632625 29511 raft_consensus.cc:740] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:39.644629 29505 raft_consensus.cc:2804] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:39.660089 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:39.675921 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:39.652252 29468 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:39.688164 22570 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:39.678738 29030 raft_consensus.cc:2804] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:39.681361 29402 raft_consensus.cc:3055] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:39.702306 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:39.651782 29287 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:39.674929 29530 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:39.675345 28973 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:39.703305 29030 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:39.719573 22529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 2745) took 1742 ms. Trace:
I20260709 12:12:39.698134 29489 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:39.723922 29030 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:39.724949 29530 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:39.726127 29530 raft_consensus.cc:2749] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:39.703328 29402 raft_consensus.cc:740] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:39.723927 22529 rpcz_store.cc:276] 0709 12:12:37.977237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:38.880481 (+903244us) service_pool.cc:224] Handling call
0709 12:12:38.930211 (+ 49730us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:38.943718 (+ 13507us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:38.943749 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:38.951057 (+  7308us) log.cc:844] Serialized 52 byte log entry
0709 12:12:39.129993 (+178936us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:39.130036 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:39.130107 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:39.719316 (+589209us) raft_consensus.cc:1685] finished
0709 12:12:39.719340 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:39.719503 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9773,"raft.queue_time_us":9940,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":6296,"thread_start_us":116969,"threads_started":1,"wal-append.queue_time_us":191054}
I20260709 12:12:39.695540 28867 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:39.709651 29451 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:39.742755 22529 raft_consensus.cc:1275] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 12:12:39.751318 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 57995.2us
I20260709 12:12:39.752530 22523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 2746) took 1775 ms. Trace:
I20260709 12:12:39.752912 22523 rpcz_store.cc:276] 0709 12:12:37.977506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.003697 (+1026191us) service_pool.cc:224] Handling call
0709 12:12:39.004028 (+   331us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:39.007375 (+  3347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:39.007405 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:39.011617 (+  4212us) log.cc:844] Serialized 52 byte log entry
0709 12:12:39.135201 (+123584us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:39.136606 (+  1405us) log.cc:844] Serialized 14 byte log entry
0709 12:12:39.141830 (+  5224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:39.141908 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:39.752333 (+610425us) raft_consensus.cc:1685] finished
0709 12:12:39.752352 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:39.752472 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6525,"prepare.queue_time_us":969,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":12611,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":115,"spinlock_wait_cycles":43405696,"thread_start_us":105035,"threads_started":1,"wal-append.queue_time_us":168845}
W20260709 12:12:39.742478 29198 consensus_meta.cc:287] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.506s	user 0.010s	sys 0.001s
I20260709 12:12:39.731611 29556 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:39.759599 29501 consensus_meta.cc:287] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.525s	user 0.006s	sys 0.007s
W20260709 12:12:39.760563 29490 consensus_meta.cc:287] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.716s	user 0.010s	sys 0.006s
W20260709 12:12:39.765691 29495 consensus_meta.cc:287] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.661s	user 0.013s	sys 0.005s
W20260709 12:12:39.767076 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 44859.9us
W20260709 12:12:39.773448 29552 log.cc:927] Time spent T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.076s	user 0.002s	sys 0.000s
I20260709 12:12:39.776295 28973 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:39.779587 29546 log.cc:927] Time spent T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:12:39.762470 29558 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:39.720008 29511 consensus_queue.cc:260] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:39.763505 29465 consensus_meta.cc:287] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.717s	user 0.017s	sys 0.001s
I20260709 12:12:39.783569 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:39.765637 29527 consensus_meta.cc:287] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.525s	user 0.007s	sys 0.016s
I20260709 12:12:39.761839 29351 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:39.780402 29553 log.cc:927] Time spent T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:12:39.758875 29406 consensus_queue.cc:1059] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 12:12:39.817126 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:39.812155 29304 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:39.766959 29198 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:39.822734 29547 log.cc:927] Time spent T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 12:12:39.781136 29490 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:39.770823 29556 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:39.834584 29483 raft_consensus.cc:3055] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:39.854203 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:39.813450 29495 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:39.837868 29511 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:39.860841 22448 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 17: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:39.859737 22526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 2750) took 1881 ms. Trace:
I20260709 12:12:39.867511 22526 rpcz_store.cc:276] 0709 12:12:37.978491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.153858 (+1175367us) service_pool.cc:224] Handling call
0709 12:12:39.154411 (+   553us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:39.154847 (+   436us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:12:39.154876 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:39.155547 (+   671us) log.cc:844] Serialized 26 byte log entry
0709 12:12:39.485317 (+329770us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:39.485379 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:39.485481 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:39.859421 (+373940us) raft_consensus.cc:1685] finished
0709 12:12:39.859451 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:39.859659 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":70,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":20756,"thread_start_us":235951,"threads_started":1,"wal-append.queue_time_us":121395}
I20260709 12:12:39.869377 22524 raft_consensus.cc:1240] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:39.821393 29465 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:39.824357 29527 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:39.868978 29348 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:39.738337 22348 catalog_manager.cc:5697] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 9 to 11, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 11 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:39.771988 29402 consensus_queue.cc:260] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:39.875634 29402 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:39.851655 29483 raft_consensus.cc:740] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:39.881454 29483 consensus_queue.cc:260] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:39.882491 29483 raft_consensus.cc:3060] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:39.884285 28867 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:39.885054 29480 log.cc:927] Time spent T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 2.252s	user 0.001s	sys 0.015s
I20260709 12:12:39.888669 29490 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:39.890506 29465 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:39.902400 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:12:39.904562 22605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43070 (request call id 1209) took 2400 ms (client timeout 2111 ms). Trace:
I20260709 12:12:39.905577 22525 raft_consensus.cc:1240] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 22. Current term is 23. Ops: [22.15-22.15]
W20260709 12:12:39.905007 22605 rpcz_store.cc:269] 0709 12:12:37.503858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:37.504899 (+  1041us) service_pool.cc:224] Handling call
0709 12:12:39.904352 (+2399453us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b54000eae54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:39.904461 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":593778560}
W20260709 12:12:39.911087 29559 log.cc:927] Time spent T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 12:12:39.820991 29558 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:39.921761 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:39.945741 29198 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:39.937817 29556 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:39.952015 29561 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.952575 29561 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:39.953836 29542 log.cc:927] Time spent T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.328s	user 0.003s	sys 0.000s
I20260709 12:12:39.914852 29287 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:39.954797 29561 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:39.960819 29495 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 23 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:39.960472 29431 consensus_queue.cc:260] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:39.961712 29505 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:39.962203 29505 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:39.962268 29527 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:39.949302 29440 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:39.963227 29440 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:39.961954 29431 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:39.965757 22603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43070 (request call id 1226) took 1118 ms. Trace:
I20260709 12:12:39.966120 22603 rpcz_store.cc:276] 0709 12:12:38.847173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:38.853766 (+  6593us) service_pool.cc:224] Handling call
0709 12:12:39.965601 (+1111835us) spinlock_profiling.cc:243] Waited 64.8 ms on lock 0x7b540013c754. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:39.965698 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":149139328}
I20260709 12:12:39.972788 29084 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:39.973078 29348 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:39.973346 29084 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:39.978737 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:39.979487 22526 raft_consensus.cc:2368] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 18. Current term is 19.
I20260709 12:12:39.979445 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:39.973681 29348 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:39.989745 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:39.980444 22523 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 15.
I20260709 12:12:39.992718 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:39.965369 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:39.993530 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:39.994457 22448 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:39.995275 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:39.996053 22523 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 20.
I20260709 12:12:39.997010 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:39.997618 22523 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:12:39.999047 22531 raft_consensus.cc:1240] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 12:12:39.956161 22569 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:12:40.000313 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:12:40.000833 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 152561us
I20260709 12:12:40.001119 23088 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:40.001638 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:40.000849 22529 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:40.002400 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 51028.3us
I20260709 12:12:40.003064 29421 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.991561 28973 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:40.005923 29421 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:40.009552 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:40.012036 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:40.013214 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:40.013527 22605 raft_consensus.cc:1217] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Deduplicated request from leader. Original: 12.11->[16.12-16.12]   Dedup: 16.12->[]
I20260709 12:12:40.014127 22605 raft_consensus.cc:1240] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 12:12:40.014376 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:40.014969 22457 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:12:40.015417 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:40.016978 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:40.016392 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:40.018766 22451 raft_consensus.cc:1275] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:40.006896 29564 raft_consensus.cc:2804] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:40.019521 23089 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:12:40.022496 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:40.025876 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:40.027453 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:40.030097 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:40.030727 22455 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 20.
I20260709 12:12:40.035187 22604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3587) took 1027 ms. Trace:
I20260709 12:12:40.035588 22604 rpcz_store.cc:276] 0709 12:12:39.008228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.008343 (+   115us) service_pool.cc:224] Handling call
0709 12:12:39.010560 (+  2217us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:39.078612 (+ 68052us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:39.078744 (+   132us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:39.078807 (+    63us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:39.078843 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:40.030959 (+952116us) spinlock_profiling.cc:243] Waited 67.8 ms on lock 0x7b54000e9a54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:40.031038 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:40.035131 (+  4093us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":156013952}
I20260709 12:12:40.038003 22457 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 19.
I20260709 12:12:40.038308 23120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57328 (request call id 1740) took 2147 ms. Trace:
I20260709 12:12:40.039469 23120 rpcz_store.cc:276] 0709 12:12:37.890647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:37.890762 (+   115us) service_pool.cc:224] Handling call
0709 12:12:40.037650 (+2146888us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b5800110198. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7809b71 00007f9cc7809a22 00007f9cd07228d9 00007f9ccf87cee0 00007f9ccf9460ab 00007f9ccf946131 00007f9ccf907fc0 00007f9ccf8f2929 00007f9ccf8f23d2 00007f9cc8e69bd4
0709 12:12:40.037859 (+   209us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:40.038025 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:40.038049 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:40.038088 (+    39us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:12:40.038116 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:40.038163 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:40.038258 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5684480}
I20260709 12:12:40.031109 29387 raft_consensus.cc:2804] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:40.040715 29387 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:40.041102 29387 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:40.043296 29440 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:40.046737 29084 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:40.024407 29445 consensus_queue.cc:1048] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 12:12:40.039637 29278 consensus_queue.cc:1059] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 12:12:40.049693 29445 raft_consensus.cc:3055] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:40.050040 29445 raft_consensus.cc:740] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:40.052430 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:40.052704 29533 raft_consensus.cc:3055] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:40.053117 29533 raft_consensus.cc:740] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:40.050717 29387 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:40.053936 29533 consensus_queue.cc:260] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:40.055394 29533 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:40.056553 22528 raft_consensus.cc:2393] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 16: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:40.061465 22529 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 13.
I20260709 12:12:40.066314 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:40.020737 29527 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:40.073669 22523 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 18.
I20260709 12:12:40.075685 22605 raft_consensus.cc:2393] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 16: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:40.077531 22448 raft_consensus.cc:2468] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 23.
W20260709 12:12:40.082125 29548 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.770s	user 0.003s	sys 0.005s
W20260709 12:12:40.082547 29548 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.003s	sys 0.005s
W20260709 12:12:40.082855 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 50475.9us
I20260709 12:12:40.021006 29566 raft_consensus.cc:2749] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:40.021809 29564 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:40.006675 28973 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:40.027073 29120 consensus_queue.cc:1048] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 12:12:40.080785 29387 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:40.096267 29421 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:40.087035 29564 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:40.097429 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:40.103024 29404 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:40.084718 29527 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:40.105284 29527 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:40.106266 29472 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:40.091460 29030 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:40.106835 29516 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:40.108915 29516 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:40.109421 29030 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:40.109561 22526 raft_consensus.cc:1240] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 17. Current term is 18. Ops: []
W20260709 12:12:40.111599 22528 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56940 (request call id 2752) took 2130 ms (client timeout 2155 ms). Trace:
W20260709 12:12:40.111999 22528 rpcz_store.cc:269] 0709 12:12:37.981660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:38.439567 (+457907us) service_pool.cc:224] Handling call
0709 12:12:40.111399 (+1671832us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b54000d3ed4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:40.111541 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3477696384}
I20260709 12:12:40.113109 28973 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:40.091432 29558 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:40.091634 29348 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:40.117383 23088 leader_election.cc:400] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 18. Current term is 19.
I20260709 12:12:40.117434 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:40.117913 23088 leader_election.cc:403] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:40.118294 22606 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 18.
I20260709 12:12:40.118755 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:40.122764 29427 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:40.120870 22605 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 17.
I20260709 12:12:40.127462 22598 raft_consensus.cc:1275] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 12:12:40.128077 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:40.050832 29445 consensus_queue.cc:260] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:40.129612 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:40.130198 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:40.129662 29515 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.131474 29515 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:40.128903 29445 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:40.132884 22603 raft_consensus.cc:2410] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:12:40.135737 29406 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.136318 29406 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:40.137861 22600 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 21.
I20260709 12:12:40.141819 22569 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:40.142709 22569 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:40.142928 29348 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:12:40.145267 29527 raft_consensus.cc:2804] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:40.145653 29527 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:40.146020 29527 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:40.147524 23089 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:40.148299 28973 raft_consensus.cc:2804] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:40.148386 29404 raft_consensus.cc:2804] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:40.153242 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:40.155342 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:40.155929 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:40.156567 23088 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:40.156896 22454 raft_consensus.cc:1240] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:40.157526 23120 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:40.161206 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:40.163622 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:40.164549 29404 raft_consensus.cc:697] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:40.165428 29404 consensus_queue.cc:237] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:40.166482 29402 consensus_queue.cc:1059] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:40.167486 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:40.168238 29574 raft_consensus.cc:3055] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:40.168628 29574 raft_consensus.cc:740] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:40.169445 29574 consensus_queue.cc:260] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:40.170456 29574 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:40.170843 23088 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:40.171774 23118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 1544) took 2391 ms. Trace:
I20260709 12:12:40.172341 23088 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:40.173305 29421 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:40.173707 29421 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:40.174049 29421 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:40.174814 29492 raft_consensus.cc:2749] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:40.175971 29571 log.cc:927] Time spent T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:12:40.172111 23118 rpcz_store.cc:276] 0709 12:12:37.780326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:37.780547 (+   221us) service_pool.cc:224] Handling call
0709 12:12:37.780875 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:38.254192 (+473317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:40.171563 (+1917371us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b540018fbd4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:40.171721 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":992864512}
I20260709 12:12:40.184109 23120 raft_consensus.cc:2410] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 12:12:40.187453 23117 raft_consensus.cc:1275] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:40.182516 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:40.121233 29566 consensus_queue.cc:1048] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.042s
I20260709 12:12:40.186450 29348 raft_consensus.cc:2749] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 18. Current term is 19.
I20260709 12:12:40.192534 23122 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 19.
I20260709 12:12:40.193940 29527 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:40.200685 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:40.200953 22449 raft_consensus.cc:2410] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:12:40.201381 29432 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.201663 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:40.202253 23123 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:40.201932 29432 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:40.192963 29421 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:40.201956 22449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51844 (request call id 3282) took 1256 ms. Trace:
I20260709 12:12:40.204782 29432 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:40.204942 22449 rpcz_store.cc:276] 0709 12:12:38.945494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.119153 (+173659us) service_pool.cc:224] Handling call
0709 12:12:40.201780 (+1082627us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400243954. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:40.201901 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2476131584}
I20260709 12:12:40.206380 23087 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:40.210757 23087 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:40.201503 23119 raft_consensus.cc:2393] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 16: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:40.212152 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:40.208526 29511 raft_consensus.cc:2749] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:40.213285 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:40.213629 23119 raft_consensus.cc:1240] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 20 LEADER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 12:12:40.213845 23118 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 21.
I20260709 12:12:40.215848 29505 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:40.216311 29515 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:40.218106 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:40.218555 29505 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:40.219688 22524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 2753) took 2232 ms. Trace:
I20260709 12:12:40.220182 29421 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:40.220067 22524 rpcz_store.cc:276] 0709 12:12:37.987743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.213091 (+1225348us) service_pool.cc:224] Handling call
0709 12:12:39.223067 (+  9976us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:39.871155 (+648088us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:40.219461 (+348306us) spinlock_profiling.cc:243] Waited 646 ms on lock 0x7b54001f2a54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:40.219630 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1486010624}
I20260709 12:12:40.220979 29421 raft_consensus.cc:2749] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:40.222294 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:40.223083 23123 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 18.
W20260709 12:12:40.223793 23089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:40.223857 22598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3590) took 1059 ms. Trace:
I20260709 12:12:40.225239 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:40.236593 22457 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 20.
I20260709 12:12:40.225626 29425 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:40.226554 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:40.228137 22525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 1402) took 1220 ms. Trace:
I20260709 12:12:40.239444 22525 rpcz_store.cc:276] 0709 12:12:39.008206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.623742 (+615536us) service_pool.cc:224] Handling call
0709 12:12:39.637266 (+ 13524us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:39.906052 (+268786us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:40.227922 (+321870us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b54001f2f54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:40.228081 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":616523136}
I20260709 12:12:40.229898 23124 raft_consensus.cc:1275] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:40.230451 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:40.230947 29527 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:40.231127 23118 raft_consensus.cc:1275] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 12:12:40.231894 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:40.244071 22456 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:12:40.233220 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:40.245286 23122 raft_consensus.cc:2368] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 17. Current term is 18.
I20260709 12:12:40.158360 28973 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:40.223110 23120 raft_consensus.cc:2393] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 19: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:40.234544 23123 raft_consensus.cc:1275] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 15. (term mismatch)
I20260709 12:12:40.247084 23123 pending_rounds.cc:85] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270: Aborting all ops after (but not including) 14
I20260709 12:12:40.247339 23123 pending_rounds.cc:107] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270: Aborting uncommitted NO_OP operation due to leader change: 18.15
I20260709 12:12:40.247555 23123 raft_consensus.cc:2889] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:12:40.233637 22496 connection.cc:256] RPC call timeout handler was delayed by -1.2205043430001297s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1845s for a response
I20260709 12:12:40.248626 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:40.248924 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:40.251142 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:40.251714 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:40.234786 23087 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:40.235494 22598 rpcz_store.cc:276] 0709 12:12:39.164586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.164851 (+   265us) service_pool.cc:224] Handling call
0709 12:12:39.165109 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:40.127856 (+962747us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:40.223650 (+ 95794us) spinlock_profiling.cc:243] Waited 962 ms on lock 0x7b54000e8654. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:40.223800 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2212370176}
I20260709 12:12:40.252328 22523 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 15.
I20260709 12:12:40.245831 23118 pending_rounds.cc:85] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270: Aborting all ops after (but not including) 12
I20260709 12:12:40.252944 23118 pending_rounds.cc:107] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 12:12:40.253202 23118 raft_consensus.cc:2889] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:40.253414 22529 raft_consensus.cc:1240] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:40.253856 29421 raft_consensus.cc:2749] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:40.253261 23087 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:40.246059 22421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:40.255964 29497 raft_consensus.cc:2749] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:40.254376 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:40.256938 22532 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 17.
I20260709 12:12:40.258390 22455 raft_consensus.cc:1240] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:40.258462 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:40.259317 22525 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 18.
I20260709 12:12:40.258405 29313 raft_consensus.cc:3055] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:40.260056 29313 raft_consensus.cc:740] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:40.260892 29313 consensus_queue.cc:260] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:40.261616 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:40.261992 29313 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:40.262126 22529 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:40.266848 22523 raft_consensus.cc:1275] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:40.267117 23087 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:40.267271 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:40.267812 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:40.268432 29421 raft_consensus.cc:2749] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:40.268899 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:40.269495 22523 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 21.
I20260709 12:12:40.270272 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:40.271329 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:40.271832 22526 raft_consensus.cc:3060] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:40.271929 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:40.272509 22525 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 15.
I20260709 12:12:40.273700 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:40.267838 22531 raft_consensus.cc:3060] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:40.277014 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:40.269032 29403 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:40.294500 22529 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 16.
I20260709 12:12:40.277496 22449 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 20.
I20260709 12:12:40.277669 22523 raft_consensus.cc:3060] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:40.294803 23123 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 19.
I20260709 12:12:40.291916 22496 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:40.278100 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:40.255268 22421 connection.cc:256] RPC call timeout handler was delayed by -1.0181117750000794s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1563s for a response
I20260709 12:12:40.285421 22570 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:40.297515 22530 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 25.
I20260709 12:12:40.298254 22570 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:40.254354 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:40.289846 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:40.276439 22569 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:40.289471 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:40.299391 22570 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:40.298821 22530 raft_consensus.cc:1240] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 15. Current term is 17. Ops: []
I20260709 12:12:40.301792 22421 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:40.296583 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:40.303493 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:40.237746 29499 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.243086 29431 raft_consensus.cc:2749] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:40.319308 22496 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:40.248544 28973 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:40.309731 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:40.312335 23118 raft_consensus.cc:2393] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 16: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:40.308120 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:40.315479 23122 raft_consensus.cc:2393] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 21: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:40.317214 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:40.242918 29489 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.273586 29030 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.328804 22421 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
W20260709 12:12:40.331993 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:40.237924 29406 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:40.334089 22570 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:40.350970 22421 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:40.352133 22421 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:40.317934 29487 raft_consensus.cc:2749] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:40.358366 22421 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:40.333077 29507 raft_consensus.cc:2749] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:40.339673 23119 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 18: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:40.327004 22526 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 22.
I20260709 12:12:40.348575 22456 raft_consensus.cc:2468] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 22.
I20260709 12:12:40.334549 29473 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:40.337271 22496 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:40.359520 22421 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:40.343892 29435 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:40.340008 29504 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:40.353148 29030 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:40.369562 29148 raft_consensus.cc:2764] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:12:40.391417 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:40.392580 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:40.392604 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:40.393657 22603 raft_consensus.cc:2393] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 16: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:40.353895 29432 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:40.357582 29505 raft_consensus.cc:2749] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:40.344388 29516 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:40.353185 29472 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:40.357463 29401 raft_consensus.cc:2749] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:40.343161 29558 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.343045 29508 raft_consensus.cc:2804] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:40.378127 29294 raft_consensus.cc:2764] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 12:12:40.360949 29304 raft_consensus.cc:2749] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:40.380992 22421 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:40.411044 29432 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:40.420120 29508 raft_consensus.cc:697] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:40.421031 29432 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:40.384343 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 47194.7us
I20260709 12:12:40.422756 22496 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:40.392639 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:40.423237 29558 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:40.372845 22523 raft_consensus.cc:2468] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 18.
I20260709 12:12:40.392098 22598 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 19.
I20260709 12:12:40.398602 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:40.398303 29487 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.380110 22531 raft_consensus.cc:2468] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 19.
I20260709 12:12:40.425103 22604 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 17.
I20260709 12:12:40.425305 29558 leader_election.cc:290] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:40.415592 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:40.425987 22606 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:40.426111 29495 raft_consensus.cc:2764] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader election decision vote started in defunct term 17: won
I20260709 12:12:40.339988 29527 raft_consensus.cc:2804] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:40.427186 29527 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:40.427616 29527 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:40.421123 29508 consensus_queue.cc:237] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.16, Last appended by leader: 16, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:40.431136 29532 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.431658 29532 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:40.433029 22601 raft_consensus.cc:1275] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 12:12:40.433430 22601 pending_rounds.cc:85] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting all ops after (but not including) 12
I20260709 12:12:40.433650 22601 pending_rounds.cc:107] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 12:12:40.433909 22601 raft_consensus.cc:2889] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:40.411377 29503 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.434737 29503 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:40.411592 29391 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:40.335458 29499 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:40.386042 29427 raft_consensus.cc:2749] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:40.438730 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:40.447448 23119 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 19.
I20260709 12:12:40.448910 22570 leader_election.cc:304] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:40.351147 29489 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:40.387027 29224 raft_consensus.cc:2749] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:40.441023 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 60167.8us
I20260709 12:12:40.437635 29503 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:40.444902 29148 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.460785 29148 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:40.462654 29148 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:40.425135 29487 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:40.442206 29304 raft_consensus.cc:2749] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:40.442098 29391 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:40.442849 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:40.444211 22606 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 19.
I20260709 12:12:40.379626 29473 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:40.399533 29504 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:40.457671 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 51329.6us
W20260709 12:12:40.458132 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:40.470441 22532 raft_consensus.cc:1275] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:40.459499 29583 raft_consensus.cc:2749] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:40.457999 29505 raft_consensus.cc:2804] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:40.385444 29564 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:40.480273 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:40.480909 23119 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 18.
I20260709 12:12:40.465374 22496 leader_election.cc:400] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353) with higher term. Message: Invalid argument: T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 17. Current term is 18.
I20260709 12:12:40.481750 22496 leader_election.cc:403] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:40.415949 29472 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:40.470188 22421 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:40.482908 22570 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:40.459824 29432 consensus_queue.cc:1059] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:40.515991 23088 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:40.516759 29432 raft_consensus.cc:3055] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:40.517190 29432 raft_consensus.cc:740] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:40.518057 29432 consensus_queue.cc:260] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:40.518656 29511 raft_consensus.cc:2749] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:40.519423 29511 consensus_queue.cc:1059] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 12:12:40.473986 29551 log.cc:927] Time spent T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.771s	user 0.005s	sys 0.000s
I20260709 12:12:40.520200 29566 consensus_queue.cc:1059] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:40.520478 29511 raft_consensus.cc:3055] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:40.520840 29511 raft_consensus.cc:740] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:40.521241 29566 raft_consensus.cc:3055] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:40.521592 29566 raft_consensus.cc:740] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
W20260709 12:12:40.521795 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 51704.1us
I20260709 12:12:40.521659 29511 consensus_queue.cc:260] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:40.522596 22421 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:40.474824 28973 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:40.522473 29566 consensus_queue.cc:260] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:40.523200 29583 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353) with higher term. Message: Invalid argument: T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 17. Current term is 18.
I20260709 12:12:40.523763 29566 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:40.524086 23117 raft_consensus.cc:2393] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 19: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:40.524693 29563 raft_consensus.cc:2749] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:40.524780 28973 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:40.525491 29563 raft_consensus.cc:2749] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:40.525537 29483 consensus_queue.cc:1059] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:40.526000 22527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 2751) took 2547 ms. Trace:
I20260709 12:12:40.526337 29563 consensus_queue.cc:1059] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:40.535826 29563 raft_consensus.cc:3055] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:40.478111 29391 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:40.488772 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:40.536091 29569 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:40.536675 22606 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 15.
I20260709 12:12:40.490191 22605 raft_consensus.cc:1275] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 24 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:12:40.536892 29569 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:40.538832 29447 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:40.539381 29447 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:40.540455 22452 raft_consensus.cc:1275] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:12:40.544503 22601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3588) took 1462 ms. Trace:
I20260709 12:12:40.544891 22601 rpcz_store.cc:276] 0709 12:12:39.081910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.088745 (+  6835us) service_pool.cc:224] Handling call
0709 12:12:39.089125 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:40.434352 (+1345227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:40.544286 (+109934us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54000e9f54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:40.544446 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3089783168}
I20260709 12:12:40.546176 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:40.546736 22450 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:40.548372 29569 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:40.491508 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:40.492200 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:40.551769 22569 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:12:40.496651 29499 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:40.503149 29030 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:40.503163 22599 raft_consensus.cc:1240] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:40.536214 29563 raft_consensus.cc:740] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:40.552872 22569 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:40.553098 29455 raft_consensus.cc:2804] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:40.505103 29508 raft_consensus.cc:2804] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:40.553483 29455 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:40.553754 29508 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:40.553665 29563 consensus_queue.cc:260] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:40.554417 29508 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:40.555054 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:40.555639 22449 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:40.554528 29524 raft_consensus.cc:2804] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:40.558139 29524 raft_consensus.cc:697] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:40.470223 29473 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:40.555086 29563 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:40.559248 29524 consensus_queue.cc:237] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:40.506168 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:40.547128 29447 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:40.512545 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:40.512682 29445 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.562671 29445 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:40.512104 29489 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:40.472782 29465 consensus_queue.cc:1048] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 12:12:40.467003 29503 consensus_queue.cc:1048] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 12:12:40.564004 29492 consensus_queue.cc:1059] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:12:40.515753 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:40.474915 29504 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:40.479826 29505 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:40.565784 29505 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:40.544384 29532 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:40.527405 29304 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.476418 29487 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:40.526536 22527 rpcz_store.cc:276] 0709 12:12:37.978808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.189428 (+1210620us) service_pool.cc:224] Handling call
0709 12:12:39.189750 (+   322us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:39.190080 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:39.190109 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:39.663258 (+473149us) spinlock_profiling.cc:243] Waited 4.72 ms on lock 0x7b2c000010a8. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc9227a11 00007f9cc9237372 00007f9cca969a01 00007f9cca92e43a 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2
0709 12:12:39.663847 (+   589us) log.cc:844] Serialized 52 byte log entry
0709 12:12:39.846839 (+182992us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:40.005093 (+158254us) log.cc:844] Serialized 14 byte log entry
0709 12:12:40.005313 (+   220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:40.005388 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:40.514396 (+509008us) spinlock_profiling.cc:243] Waited 3.08 ms on lock 0x7b1800367780. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc78413f3 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd 0000000000388634 0000000000388479 00007f9cc782483a
0709 12:12:40.525717 (+ 11321us) raft_consensus.cc:1685] finished
0709 12:12:40.525740 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:40.525945 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":157221,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":2367,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":24102,"spinlock_wait_cycles":17928320,"thread_start_us":321380,"threads_started":2,"wal-append.queue_time_us":348579}
I20260709 12:12:40.528713 29437 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:40.567289 29304 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:40.567713 22604 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 19.
I20260709 12:12:40.567957 29437 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:40.569108 22599 raft_consensus.cc:1275] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:12:40.569398 29304 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:40.569641 29555 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.529134 29472 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:12:40.529613 22495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:40.570118 29555 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:40.571377 22602 raft_consensus.cc:1275] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:12:40.572477 22602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43070 (request call id 1232) took 1326 ms. Trace:
W20260709 12:12:40.572613 22570 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.196.130:42733 timed out after 1.609s (SENT) [suppressed 5 similar messages]
I20260709 12:12:40.572798 22602 rpcz_store.cc:276] 0709 12:12:39.245704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.683189 (+437485us) service_pool.cc:224] Handling call
0709 12:12:39.687735 (+  4546us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:40.571712 (+883977us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:40.572277 (+   565us) spinlock_profiling.cc:243] Waited 883 ms on lock 0x7b54003502d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:40.572426 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2031452032}
I20260709 12:12:40.573784 29432 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:40.575675 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:40.576304 22601 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:40.577499 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:40.577765 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:40.578200 22523 raft_consensus.cc:2393] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 16: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:40.578595 29402 consensus_queue.cc:1048] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:40.580087 29555 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:40.510268 23121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57318 (request call id 1554) took 1329 ms. Trace:
W20260709 12:12:40.552009 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:40.580971 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:40.502149 29564 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:40.582585 23125 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 19.
I20260709 12:12:40.559720 22422 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:40.565145 29445 leader_election.cc:290] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:40.565178 29492 raft_consensus.cc:3055] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:12:40.515187 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 49944.6us
I20260709 12:12:40.633659 22496 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:40.506883 29527 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:40.584052 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:40.635444 23119 raft_consensus.cc:2368] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 20. Current term is 21.
I20260709 12:12:40.586058 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:40.580631 23121 rpcz_store.cc:276] 0709 12:12:39.180731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.181679 (+   948us) service_pool.cc:224] Handling call
0709 12:12:39.181937 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:39.182129 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 12:12:40.112150 (+930021us) spinlock_profiling.cc:243] Waited 2.89 ms on lock 0x7b18002b1080. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cca4d64bc 00007f9cc782448b 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc783e455 00007f9cce3263c7 00007f9cca9389a7 00007f9cca9480bf
0709 12:12:40.112297 (+   147us) log.cc:844] Serialized 14 byte log entry
0709 12:12:40.247185 (+134888us) log.cc:844] Serialized 14 byte log entry
0709 12:12:40.509789 (+262604us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b18002b1080. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc77bbc0a 00007f9cd0efb219 00007f9cc7843a40 00007f9cc783e4e4 00007f9cc783e455 00007f9cca926060 00007f9cca938716 00007f9cca949287 00007f9cca949208
0709 12:12:40.509944 (+   155us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:40.509992 (+    48us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:12:40.510038 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:40.510103 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:40.510213 (+   110us) inbound_call.cc:177] Queueing success response
0709 12:12:40.516678 (+  6465us) spinlock_profiling.cc:243] Waited 7.26 ms on lock 0x7b18002b1080. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc780f2a6 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc78413f3 00007f9cc78437c1
0709 12:12:40.517138 (+   460us) spinlock_profiling.cc:243] Waited 24.6 ms on lock 0x7b18002b1080. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc78413f3 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd 0000000000388634 0000000000388479 00007f9cc782483a
0709 12:12:40.542783 (+ 25645us) spinlock_profiling.cc:243] Waited 7.12 ms on lock 0x7b18002b1080. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc7841522 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd 0000000000388634 0000000000388479 00007f9cc782483a
0709 12:12:40.548881 (+  6098us) spinlock_profiling.cc:243] Waited 44.9 ms on lock 0x7b18002b1080. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc78413f3 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd 0000000000388634 0000000000388479 00007f9cc782483a
Metrics: {"mutex_wait_us":33735,"prepare.queue_time_us":123312,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":71,"raft.queue_time_us":268768,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":192,"spinlock_wait_cycles":230277632,"thread_start_us":419394,"threads_started":2,"wal-append.queue_time_us":139542}
I20260709 12:12:40.636467 22449 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 18.
I20260709 12:12:40.570127 29437 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:40.588516 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:40.522926 29511 raft_consensus.cc:3060] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:40.589972 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:40.650090 22455 raft_consensus.cc:2410] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 21 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
W20260709 12:12:40.649026 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 124697us
I20260709 12:12:40.590803 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:40.592617 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:40.595577 29473 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:40.596994 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:40.597239 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:40.597641 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:40.597848 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:40.598170 29278 consensus_queue.cc:1048] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:12:40.598759 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:40.599404 29421 consensus_queue.cc:1048] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:12:40.600828 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:40.600960 29508 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:40.601356 29554 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.553877 29455 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:40.602135 29516 raft_consensus.cc:2749] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:40.570441 22605 raft_consensus.cc:1240] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:40.605494 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:40.661046 22531 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:40.662372 29421 consensus_queue.cc:1059] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:40.663270 29421 raft_consensus.cc:3055] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:40.663154 29554 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:40.663704 29421 raft_consensus.cc:740] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:40.607355 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:40.607990 22495 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:40.664598 29421 consensus_queue.cc:260] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:40.665031 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 57125.8us
I20260709 12:12:40.665740 29421 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:40.665815 22495 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:40.666055 29499 consensus_queue.cc:1048] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.013s
I20260709 12:12:40.666675 22600 raft_consensus.cc:2468] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 16.
I20260709 12:12:40.666287 29554 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:40.649257 29492 raft_consensus.cc:740] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:40.671555 29492 consensus_queue.cc:260] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:40.672822 29492 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:40.658278 29508 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:40.620254 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 62940.1us
I20260709 12:12:40.611441 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:40.682593 29278 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:40.683014 29505 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:40.683265 29278 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:40.682549 22422 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:40.685262 29505 leader_election.cc:290] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:40.685663 29304 raft_consensus.cc:2804] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:40.636475 23117 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 17.
I20260709 12:12:40.652823 22457 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 18.
I20260709 12:12:40.652844 22454 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:40.653528 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:40.667455 29287 raft_consensus.cc:2804] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:40.667896 29584 raft_consensus.cc:2749] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:40.667951 22598 raft_consensus.cc:1240] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:40.698655 29445 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:40.668357 29473 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:40.668243 22495 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:40.699193 29294 consensus_queue.cc:1059] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 12:12:40.668926 29489 consensus_queue.cc:1048] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:40.705210 29294 raft_consensus.cc:3055] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:40.705669 29294 raft_consensus.cc:740] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:40.706185 22496 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:40.686022 22602 raft_consensus.cc:2393] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 20: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:40.699832 29566 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:40.707546 29566 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:40.690222 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:40.707993 22422 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:40.627561 22601 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 19.
I20260709 12:12:40.708912 29483 raft_consensus.cc:2804] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:40.709337 29483 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:40.709718 29483 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:40.710320 29566 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:40.632360 29447 raft_consensus.cc:2804] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:40.711050 29447 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:40.707567 29589 consensus_queue.cc:1048] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 12:12:40.715883 29455 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:40.626183 22450 raft_consensus.cc:2468] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 17.
I20260709 12:12:40.654546 29503 raft_consensus.cc:2804] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:40.685739 29278 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:40.689882 29304 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:40.686942 29030 consensus_queue.cc:1048] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 12:12:40.711479 29447 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:40.719194 29304 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:40.720952 29527 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:40.723591 22454 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 18.
I20260709 12:12:40.726505 29455 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:40.703644 29445 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:40.690824 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 118242us
I20260709 12:12:40.695700 22569 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:40.734616 29527 raft_consensus.cc:2804] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:40.735103 29527 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:40.735504 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:40.735647 23089 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:40.736634 29287 raft_consensus.cc:697] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
W20260709 12:12:40.737399 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 69219.2us
I20260709 12:12:40.737524 29287 consensus_queue.cc:237] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:40.739491 29499 raft_consensus.cc:2804] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:40.740036 29499 raft_consensus.cc:697] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:40.741350 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:40.740927 29499 consensus_queue.cc:237] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:40.742810 23088 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:40.743300 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:40.697261 22531 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 21.
I20260709 12:12:40.744315 29584 raft_consensus.cc:2804] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:40.744887 29584 raft_consensus.cc:697] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:40.745456 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:40.745736 29584 consensus_queue.cc:237] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:40.744455 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:40.747007 22532 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 18: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:40.744890 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:40.736653 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:40.729132 29445 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:40.727121 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:40.748914 29445 raft_consensus.cc:2749] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:40.749375 22602 raft_consensus.cc:2393] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 14: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:40.749236 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:40.749621 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:40.726963 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:40.706421 29294 consensus_queue.cc:260] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:40.743969 23088 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:40.754210 22495 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:12:40.757568 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 287830us
I20260709 12:12:40.747727 22523 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 25.
I20260709 12:12:40.734822 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:40.759321 22598 raft_consensus.cc:2468] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 15.
I20260709 12:12:40.753721 22451 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 21.
I20260709 12:12:40.754513 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:40.755739 22455 raft_consensus.cc:2393] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 17: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:40.758299 22497 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:40.756305 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 68247.6us
I20260709 12:12:40.751312 22569 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:40.781231 23088 leader_election.cc:304] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:40.788010 23088 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:40.789531 29473 raft_consensus.cc:2804] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:40.790096 29473 raft_consensus.cc:697] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 18 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:40.791028 29473 consensus_queue.cc:237] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:40.796674 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 45429.2us
I20260709 12:12:40.803680 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:40.804543 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:40.805694 23121 raft_consensus.cc:2410] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:12:40.806771 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:40.807662 22532 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 18.
I20260709 12:12:40.747674 29492 raft_consensus.cc:2804] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:40.814282 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:40.814410 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:40.815032 22527 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 19.
I20260709 12:12:40.815228 22523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:46680
I20260709 12:12:40.735553 29527 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:40.816574 22570 leader_election.cc:400] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Vote denied by peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353) with higher term. Message: Invalid argument: T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 20. Current term is 21.
I20260709 12:12:40.816438 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:40.827649 22570 leader_election.cc:403] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:12:40.812131 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 53922.3us
I20260709 12:12:40.815917 22523 raft_consensus.cc:606] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:12:40.780795 29511 raft_consensus.cc:2749] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:40.823446 29586 raft_consensus.cc:2749] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:40.808446 29566 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:40.826095 22496 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:40.829115 22527 raft_consensus.cc:1275] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:40.820317 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:40.812211 29492 raft_consensus.cc:697] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 19 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:40.828591 22497 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:40.830114 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:40.780544 29503 raft_consensus.cc:697] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:40.832094 23088 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:40.796226 29489 raft_consensus.cc:2804] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:40.823520 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:40.833330 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:40.834093 22570 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:40.855188 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:40.858963 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:40.859567 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:40.727789 29589 consensus_queue.cc:1059] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 21.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.098s
I20260709 12:12:40.813026 29348 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:40.726562 29304 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:40.841828 29583 raft_consensus.cc:2749] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:40.842288 29030 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:40.849103 22497 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:12:40.785296 29563 consensus_queue.cc:1059] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.052s
I20260709 12:12:40.850533 22528 raft_consensus.cc:2368] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 20. Current term is 21.
I20260709 12:12:40.833492 29294 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:40.860446 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:40.860528 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:40.879956 23124 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:40.861167 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:12:40.857311 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:40.881858 22570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:40.882822 22570 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:40.861792 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:40.862442 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:40.863210 22525 raft_consensus.cc:2393] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 21: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:40.850991 29586 raft_consensus.cc:2749] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:40.864903 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:40.839138 29474 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:12:40.877431 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:40.902894 22570 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:40.931484 29563 raft_consensus.cc:3055] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:40.910787 29505 consensus_queue.cc:1048] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:12:40.878846 29224 raft_consensus.cc:2804] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:40.943967 22570 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:40.953738 29455 raft_consensus.cc:2804] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:40.954133 29455 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:40.954473 29455 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:40.960336 29304 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:40.961141 29492 consensus_queue.cc:237] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:40.962544 29455 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:40.867934 29406 raft_consensus.cc:2804] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:12:40.886402 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 105066us
I20260709 12:12:40.941524 23124 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 22.
I20260709 12:12:40.979873 22570 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:41.010743 22570 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
W20260709 12:12:40.982232 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 136155us
W20260709 12:12:41.019363 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:41.030961 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 155113us
I20260709 12:12:40.871848 29489 raft_consensus.cc:697] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:41.033900 22570 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:41.037144 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:41.038170 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:41.038594 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:41.043589 22606 raft_consensus.cc:1275] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:12:41.037828 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:41.046676 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 265479us
I20260709 12:12:40.884979 29388 raft_consensus.cc:2804] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:40.946228 29505 raft_consensus.cc:2749] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:40.943189 29563 raft_consensus.cc:740] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:41.083304 22598 raft_consensus.cc:1240] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:41.054325 22421 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:40.878618 29348 raft_consensus.cc:697] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 21 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:40.906278 29524 raft_consensus.cc:2749] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:41.094167 22603 raft_consensus.cc:1240] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:41.057241 22497 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:40.950755 29401 raft_consensus.cc:3055] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 LEADER]: Stepping down as leader of term 20
W20260709 12:12:41.053390 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:40.948343 29224 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:41.096396 22497 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:41.057047 22422 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:40.921494 29589 raft_consensus.cc:3055] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:40.988152 29406 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:41.098790 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 44607.3us
I20260709 12:12:41.044323 29556 raft_consensus.cc:2804] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:40.878341 29030 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:40.878151 29483 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:41.103482 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 46538.5us
I20260709 12:12:41.055866 29388 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:41.040288 29435 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:12:41.083132 29564 raft_consensus.cc:2749] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:41.051946 29535 consensus_queue.cc:1048] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 12:12:41.082583 29455 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:40.928246 29503 consensus_queue.cc:237] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:41.101011 29501 raft_consensus.cc:2749] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:41.133167 22569 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:41.097554 29224 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:41.152464 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:41.114130 29427 raft_consensus.cc:2804] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:41.102468 29589 raft_consensus.cc:740] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:41.157184 22598 raft_consensus.cc:2393] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 16: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:41.101163 29401 raft_consensus.cc:740] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:41.157155 22421 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:41.105178 29603 raft_consensus.cc:2749] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:41.133496 29388 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:41.132746 29406 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:41.133828 29435 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:41.135426 29556 raft_consensus.cc:697] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:41.152127 29412 raft_consensus.cc:2749] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:41.158221 29427 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:41.105774 29583 consensus_queue.cc:1048] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 12:12:41.162150 29569 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:41.135536 29505 consensus_queue.cc:1048] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 12:12:41.192580 23118 raft_consensus.cc:1240] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 19 LEADER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:41.184581 29435 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:41.196058 29148 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:41.189587 29427 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:41.138693 29563 consensus_queue.cc:260] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:41.186079 29605 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:41.190745 29569 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:41.199697 29483 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:41.209349 29599 log.cc:927] Time spent T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 12:12:41.210597 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:41.180706 29348 consensus_queue.cc:237] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:41.211608 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:41.202257 29569 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:41.213941 29600 log.cc:927] Time spent T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 12:12:41.202809 29474 raft_consensus.cc:2749] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353) with higher term. Message: Invalid argument: T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 20. Current term is 21.
W20260709 12:12:41.245410 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:41.161167 29489 consensus_queue.cc:237] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:41.219784 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:41.257839 22454 raft_consensus.cc:2393] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 16: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:41.193657 29401 consensus_queue.cc:260] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:41.257054 22455 raft_consensus.cc:1275] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:41.238670 29563 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:41.199744 29605 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:41.265789 22457 raft_consensus.cc:1275] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
W20260709 12:12:41.267051 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 170760us
I20260709 12:12:41.269943 22497 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:41.261773 29483 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:41.264569 29602 log.cc:927] Time spent T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.128s	user 0.007s	sys 0.000s
W20260709 12:12:41.266211 29601 log.cc:927] Time spent T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 12:12:41.289554 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:41.290246 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 205115us
I20260709 12:12:41.239506 29556 consensus_queue.cc:237] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:41.267987 29401 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:41.292261 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:41.295871 22570 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:41.308866 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:41.277750 29474 consensus_queue.cc:1048] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 12:12:41.289165 29030 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:41.314152 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:41.286578 29483 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:41.319453 29612 log.cc:927] Time spent T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:12:41.320358 29610 log.cc:927] Time spent T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:12:41.320536 29483 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:41.321079 29605 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:41.335455 29609 log.cc:927] Time spent T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
W20260709 12:12:41.339444 29606 log.cc:927] Time spent T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:12:41.342314 22598 raft_consensus.cc:1240] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:41.342679 29412 consensus_queue.cc:1059] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:12:41.343885 29495 raft_consensus.cc:3055] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:41.344231 29495 raft_consensus.cc:740] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:41.345082 29495 consensus_queue.cc:260] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:41.346443 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 189377us
W20260709 12:12:41.347049 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 69516.8us
W20260709 12:12:41.347870 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 52092.9us
I20260709 12:12:41.353277 22601 raft_consensus.cc:1240] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:41.355229 22605 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:41.355391 22570 leader_election.cc:400] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 20. Current term is 21.
I20260709 12:12:41.355444 22451 raft_consensus.cc:1275] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260709 12:12:41.355980 22451 pending_rounds.cc:85] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f: Aborting all ops after (but not including) 14
I20260709 12:12:41.356209 22451 pending_rounds.cc:107] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 12:12:41.356453 22451 raft_consensus.cc:2889] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:41.356890 22570 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:41.311548 29591 log.cc:927] Time spent T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 12:12:41.280056 29499 raft_consensus.cc:2749] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:41.362136 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:41.363364 22456 raft_consensus.cc:1240] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:41.364518 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:41.365871 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:41.368623 22453 raft_consensus.cc:1240] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 12:12:41.370690 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:41.371240 22453 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:41.372529 22570 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:41.358115 29564 raft_consensus.cc:2749] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:41.394320 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:41.395556 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:41.396606 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:41.398109 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:41.398692 29614 log.cc:927] Time spent T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:12:41.399521 23121 raft_consensus.cc:1275] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:12:41.400735 29495 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:41.363827 29030 consensus_queue.cc:1059] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 12:12:41.401204 29388 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:41.399706 29474 raft_consensus.cc:2749] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:12:41.368098 29447 consensus_meta.cc:287] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.649s	user 0.008s	sys 0.003s
I20260709 12:12:41.390259 29148 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:41.409049 22455 raft_consensus.cc:2468] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 16.
I20260709 12:12:41.410347 22523 raft_consensus.cc:3055] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:41.450049 23121 raft_consensus.cc:1240] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 12:12:41.450726 22523 raft_consensus.cc:740] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:41.413143 22570 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:41.443608 22421 connection.cc:256] RPC call timeout handler was delayed by -1.1126590569997461s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2089s for a response
I20260709 12:12:41.450724 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:41.414960 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:41.359624 29524 consensus_queue.cc:1048] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 12:12:41.407428 29623 raft_consensus.cc:2749] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:41.415627 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:41.456988 23119 raft_consensus.cc:2468] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 15.
I20260709 12:12:41.456902 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:41.416375 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:41.417132 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:41.415504 22453 raft_consensus.cc:2410] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:12:41.366736 29287 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:12:41.393882 29566 consensus_meta.cc:287] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.555s	user 0.011s	sys 0.000s
W20260709 12:12:41.424031 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:41.458401 22570 leader_election.cc:304] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:41.431125 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:41.433722 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:41.454957 22421 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:41.448921 23087 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:41.425302 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:41.459580 23124 raft_consensus.cc:2393] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 13: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:41.460237 22452 raft_consensus.cc:2410] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:12:41.459095 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:41.483716 22421 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:41.457425 22523 consensus_queue.cc:260] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:41.487519 22421 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:41.479974 22453 raft_consensus.cc:1240] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:41.489282 22421 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:41.464881 22570 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:41.401204 29613 consensus_queue.cc:1059] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 21.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.055s
I20260709 12:12:41.463699 22448 raft_consensus.cc:1275] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:12:41.495237 22570 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:41.496457 22523 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:41.502070 22448 raft_consensus.cc:1275] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:12:41.442456 29620 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:41.506836 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:41.479598 29566 raft_consensus.cc:2749] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:41.463364 29564 raft_consensus.cc:2749] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:12:41.448184 29572 consensus_queue.cc:1048] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.052s
I20260709 12:12:41.515269 22448 raft_consensus.cc:1275] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 12:12:41.523079 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 74221.8us
I20260709 12:12:41.488454 29474 raft_consensus.cc:2749] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 12:12:41.509214 29584 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.000s	sys 0.020s
I20260709 12:12:41.532562 23125 raft_consensus.cc:1240] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 12:12:41.498955 29605 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:12:41.517364 22456 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 18.
W20260709 12:12:41.499884 29421 consensus_meta.cc:287] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.834s	user 0.011s	sys 0.001s
I20260709 12:12:41.450784 29554 consensus_queue.cc:1048] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 12:12:41.491443 29294 raft_consensus.cc:2749] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:41.491303 29622 raft_consensus.cc:2749] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:41.462687 29483 consensus_queue.cc:1059] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 12:12:41.497104 29148 raft_consensus.cc:2749] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:41.523880 23087 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:41.540668 23123 raft_consensus.cc:2468] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 14.
I20260709 12:12:41.494570 29556 raft_consensus.cc:2749] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:41.453919 29447 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:41.542482 22523 raft_consensus.cc:1275] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:12:41.544551 23087 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:41.522799 29527 consensus_meta.cc:287] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.689s	user 0.009s	sys 0.002s
I20260709 12:12:41.492776 29287 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:41.546072 22448 raft_consensus.cc:1275] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
W20260709 12:12:41.532797 29584 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.000s	sys 0.021s
I20260709 12:12:41.510473 29508 raft_consensus.cc:2804] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Leader election won for term 22
W20260709 12:12:41.549113 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 53948.1us
I20260709 12:12:41.538121 29605 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 24 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:41.552224 29605 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:41.540162 29566 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:41.546969 29483 raft_consensus.cc:3055] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 LEADER]: Stepping down as leader of term 19
W20260709 12:12:41.565375 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 64754us
I20260709 12:12:41.566080 22450 raft_consensus.cc:3060] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:41.539844 29499 consensus_queue.cc:1048] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 12:12:41.557926 28973 raft_consensus.cc:2749] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:41.544729 29472 consensus_queue.cc:1048] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.022s
I20260709 12:12:41.519759 29620 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:41.578215 29427 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:41.601095 29608 log.cc:927] Time spent T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.339s	user 0.000s	sys 0.003s
I20260709 12:12:41.601310 29620 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:41.579668 29435 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:41.553105 29527 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:41.566228 29483 raft_consensus.cc:740] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:41.602913 29589 consensus_queue.cc:260] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:41.603770 29527 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:41.603642 29483 consensus_queue.cc:260] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:41.604318 22598 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 13.
I20260709 12:12:41.604552 22599 raft_consensus.cc:2393] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 20: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:41.604988 29483 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:41.569419 29634 raft_consensus.cc:2749] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:41.608256 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:41.608829 22597 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:41.610328 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:41.612174 22523 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:41.580138 29287 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:41.565543 29501 consensus_queue.cc:1048] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.015s
I20260709 12:12:41.565075 29508 raft_consensus.cc:697] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:41.567546 29566 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:41.585968 29224 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:41.586805 29633 consensus_queue.cc:1048] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:12:41.587272 29572 raft_consensus.cc:2749] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:41.588166 29556 consensus_queue.cc:1048] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:12:41.591643 29388 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:41.592549 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:41.642346 22451 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 21.
I20260709 12:12:41.643342 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:41.644151 22451 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:12:41.645160 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:41.645843 22451 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:41.601106 29427 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:41.631608 22523 raft_consensus.cc:2468] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 19.
W20260709 12:12:41.647786 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 103295us
I20260709 12:12:41.648545 22495 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:41.652184 23087 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:41.604352 29589 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:41.665889 23087 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:41.667662 29388 raft_consensus.cc:2749] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:41.651322 23088 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:41.626744 29391 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:41.670534 23087 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:41.673456 22597 raft_consensus.cc:2468] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 16.
W20260709 12:12:41.674439 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:41.679450 23087 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:41.679953 22450 raft_consensus.cc:2468] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 22.
I20260709 12:12:41.681941 22422 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:41.684798 23087 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:41.662818 29572 raft_consensus.cc:2749] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:41.663383 29465 raft_consensus.cc:2804] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:41.716797 22451 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 20.
I20260709 12:12:41.720371 22569 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:12:41.700309 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 215833us
I20260709 12:12:41.728030 22597 raft_consensus.cc:1240] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 12:12:41.683497 29348 raft_consensus.cc:2804] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:12:41.687021 29406 consensus_meta.cc:287] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.502s	user 0.010s	sys 0.000s
I20260709 12:12:41.736248 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:41.686192 28973 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:41.686687 29435 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 26 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:41.724406 29465 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:41.740885 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:41.715368 29427 raft_consensus.cc:2804] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:41.682626 29431 raft_consensus.cc:2749] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:41.744069 29465 raft_consensus.cc:3060] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:41.801935 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 84814.7us
I20260709 12:12:41.682960 29508 consensus_queue.cc:237] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:41.805682 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 63773.5us
I20260709 12:12:41.731348 29572 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:41.725375 29527 raft_consensus.cc:2804] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:41.679145 29391 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:41.741178 29348 raft_consensus.cc:697] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 19 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
W20260709 12:12:41.806159 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 65337.5us
W20260709 12:12:41.805162 22421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:41.816105 29563 consensus_meta.cc:287] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.545s	user 0.010s	sys 0.000s
I20260709 12:12:41.826292 29527 raft_consensus.cc:697] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:41.738570 29633 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:41.810338 29499 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:12:41.841094 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:41.824301 29427 raft_consensus.cc:697] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:41.785146 29644 consensus_queue.cc:1048] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.053s
I20260709 12:12:41.809625 29287 consensus_queue.cc:1059] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 12:12:41.834782 29447 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:41.848608 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:41.739310 29406 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:41.875435 22597 raft_consensus.cc:1240] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:41.861847 29445 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:41.862972 29566 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:12:41.904968 29643 log.cc:927] Time spent T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:12:41.907735 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
W20260709 12:12:41.908329 29642 log.cc:927] Time spent T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:12:41.908843 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:41.909435 22453 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 18.
W20260709 12:12:41.910256 29648 log.cc:927] Time spent T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 12:12:41.897991 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:41.911927 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:41.902266 22497 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:41.902559 22604 raft_consensus.cc:1240] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:12:41.903929 22531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56942 (request call id 2489) took 1043 ms. Trace:
I20260709 12:12:41.913497 22531 rpcz_store.cc:276] 0709 12:12:40.860799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:40.861554 (+   755us) service_pool.cc:224] Handling call
0709 12:12:41.901209 (+1039655us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b54001f3454. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:41.903882 (+  2673us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1127131008}
I20260709 12:12:41.916522 23124 raft_consensus.cc:1275] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 16 index: 16. Preceding OpId from leader: term: 18 index: 17. (index mismatch)
I20260709 12:12:41.913250 29445 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:41.841861 29348 consensus_queue.cc:237] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 18.17, Last appended by leader: 17, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:41.892030 29527 consensus_queue.cc:237] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:41.924530 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:12:41.933966 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:41.937547 22602 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 19.
I20260709 12:12:41.950173 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:41.950723 23087 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:41.953751 29500 raft_consensus.cc:2804] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:41.954193 29500 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:41.954541 29500 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:41.950943 23124 raft_consensus.cc:2368] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 21. Current term is 22.
I20260709 12:12:41.864018 29499 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:41.864742 29633 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:41.925437 29554 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:41.962903 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:41.978511 23124 raft_consensus.cc:1240] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 19 LEADER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:41.978662 23117 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:41.965648 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:41.966833 22421 leader_election.cc:400] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 election: Vote denied by peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353) with higher term. Message: Invalid argument: T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 21. Current term is 22.
I20260709 12:12:41.979460 22421 leader_election.cc:403] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
W20260709 12:12:41.933821 29569 consensus_meta.cc:287] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.686s	user 0.001s	sys 0.006s
I20260709 12:12:41.980943 29483 raft_consensus.cc:2749] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353) with higher term. Message: Invalid argument: T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 21. Current term is 22.
I20260709 12:12:41.981192 29569 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:41.982307 22599 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 21.
I20260709 12:12:41.983379 29569 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:41.904244 29224 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:41.925127 29445 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:41.924304 29507 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:41.965444 22497 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:41.889317 29619 consensus_queue.cc:1059] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.068s
I20260709 12:12:41.929159 29391 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:41.987187 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:41.919597 29620 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:42.003268 29620 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:42.006147 29620 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:12:42.007699 29647 log.cc:927] Time spent T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 12:12:41.999063 29287 raft_consensus.cc:2804] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:42.013154 29499 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:42.019723 29605 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:42.021786 29406 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:42.025352 22570 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:42.064000 29605 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 25 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:41.976677 29427 consensus_queue.cc:237] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:42.036249 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:12:42.038362 29495 consensus_meta.cc:287] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881: Time spent flushing consensus metadata: real 0.615s	user 0.003s	sys 0.007s
I20260709 12:12:42.038938 29465 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:42.040138 29616 raft_consensus.cc:3055] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:41.917021 29635 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:42.043859 22605 raft_consensus.cc:1275] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:12:41.989018 29554 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:42.044682 22450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51836 (request call id 2603) took 1310 ms. Trace:
I20260709 12:12:42.099681 22450 rpcz_store.cc:276] 0709 12:12:40.734360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:40.751530 (+ 17170us) service_pool.cc:224] Handling call
0709 12:12:42.044494 (+1292964us) spinlock_profiling.cc:243] Waited 762 ms on lock 0x7b54003f39d4. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:42.044623 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1751604096}
I20260709 12:12:42.044886 29507 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:42.042899 22603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3608) took 1005 ms. Trace:
I20260709 12:12:42.048297 29633 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:42.047151 23117 raft_consensus.cc:2468] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 16.
I20260709 12:12:42.101626 22603 rpcz_store.cc:276] 0709 12:12:41.037430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.041039 (+  3609us) service_pool.cc:224] Handling call
0709 12:12:41.041357 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:41.094646 (+ 53289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.042691 (+948045us) spinlock_profiling.cc:243] Waited 52.6 ms on lock 0x7b54000e9054. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:42.042843 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120970112}
I20260709 12:12:42.052927 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:42.103399 22457 raft_consensus.cc:2393] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 20: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:42.056003 29634 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.058933 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:42.104418 23118 raft_consensus.cc:2393] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 16: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:41.964008 29474 consensus_queue.cc:1048] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.062s
I20260709 12:12:42.065708 22451 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:42.122762 22599 raft_consensus.cc:3060] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:42.127413 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:42.069416 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:42.128589 22454 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 22.
I20260709 12:12:42.129737 23087 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:42.130086 22454 raft_consensus.cc:1275] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:42.072856 23120 raft_consensus.cc:1275] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 23 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 15. (term mismatch)
I20260709 12:12:42.131232 23120 pending_rounds.cc:85] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270: Aborting all ops after (but not including) 14
I20260709 12:12:42.081844 22453 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 21.
I20260709 12:12:42.131726 23120 pending_rounds.cc:107] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270: Aborting uncommitted NO_OP operation due to leader change: 22.15
I20260709 12:12:42.131990 23120 raft_consensus.cc:2889] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:42.118791 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:42.133695 22450 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 21.
I20260709 12:12:42.119920 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:42.140374 22451 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 26.
I20260709 12:12:42.141501 23119 raft_consensus.cc:2393] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 21: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:42.149652 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:42.150444 23117 raft_consensus.cc:2393] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 19: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
W20260709 12:12:42.150060 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 124796us
W20260709 12:12:42.152000 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:42.154104 22603 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 20.
I20260709 12:12:42.154456 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:42.154748 22495 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:42.154011 22523 raft_consensus.cc:1275] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 24 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:12:42.155378 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:42.156018 22531 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 15.
I20260709 12:12:42.156816 22599 raft_consensus.cc:1275] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:42.157003 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:42.157536 22526 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 20.
I20260709 12:12:42.158671 22525 raft_consensus.cc:1240] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:42.159922 22532 raft_consensus.cc:1240] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:42.161046 22528 raft_consensus.cc:1240] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:42.165974 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:42.166658 22598 raft_consensus.cc:2368] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 25. Current term is 26.
I20260709 12:12:42.168303 22422 leader_election.cc:400] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 25 election: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 25. Current term is 26.
I20260709 12:12:42.168589 22422 leader_election.cc:403] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 25 election: Cancelling election due to peer responding with higher term
I20260709 12:12:42.170523 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:42.100150 29566 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:42.089311 29616 raft_consensus.cc:740] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:42.099148 29492 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.173368 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:42.175005 22497 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:42.175719 22597 raft_consensus.cc:1275] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 12:12:42.184209 22457 raft_consensus.cc:2393] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 20: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:42.176257 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:42.184913 22600 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 19.
I20260709 12:12:42.182299 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:42.186465 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:42.188163 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:12:42.188695 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:42.188974 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:42.188709 22524 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:42.145023 29287 raft_consensus.cc:697] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:42.149380 29633 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:42.190325 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:42.194272 22532 raft_consensus.cc:2393] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 13: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:42.170276 29472 raft_consensus.cc:2749] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:42.200428 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:42.198585 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:42.201411 22525 raft_consensus.cc:2376] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 16. Re-sending same reply.
I20260709 12:12:42.180449 29569 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.172726 29483 raft_consensus.cc:2749] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 26 FOLLOWER]: Leader election lost for term 25. Reason: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 25. Current term is 26.
I20260709 12:12:42.197165 22598 raft_consensus.cc:2393] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 22: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:42.179419 29501 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.179278 29224 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.220346 22526 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 25.
I20260709 12:12:42.182206 29499 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:42.188457 29503 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:42.146888 29634 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:42.271051 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:42.271649 22526 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:42.199471 29584 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:42.226464 22525 raft_consensus.cc:1275] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:12:42.227455 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:42.231420 22524 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 16.
I20260709 12:12:42.273814 22529 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:12:42.274591 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:12:42.232699 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 50970us
I20260709 12:12:42.195293 29495 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.192803 29618 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:42.187492 29566 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:42.264081 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:42.195065 29633 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:42.276340 22569 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:42.279870 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:42.205358 29313 raft_consensus.cc:2804] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:42.193648 29492 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:42.228744 29391 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:42.290107 22524 raft_consensus.cc:2393] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 21: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:42.289959 22526 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 26.
I20260709 12:12:42.203363 29516 consensus_queue.cc:1059] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.078s
I20260709 12:12:42.291962 23121 raft_consensus.cc:1275] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:42.301108 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:42.300427 23089 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:12:42.307648 29665 log.cc:927] Time spent T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.073s	user 0.001s	sys 0.003s
I20260709 12:12:42.225378 29569 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:42.318002 29554 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:42.318544 29030 consensus_queue.cc:1048] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:12:42.300724 29287 consensus_queue.cc:237] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:42.299052 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 90368.5us
I20260709 12:12:42.285600 29633 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:42.286731 29313 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:42.293748 29391 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:42.262193 29501 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:42.267218 29224 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:42.289229 29535 consensus_queue.cc:1048] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:12:42.288488 29618 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:42.328810 29653 log.cc:927] Time spent T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:12:42.272897 29499 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:42.286203 29495 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:42.412186 29495 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:42.335835 29654 log.cc:927] Time spent T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 12:12:42.295598 29639 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.413345 29639 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:42.416105 29639 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:42.314131 29348 consensus_queue.cc:1048] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.087s
I20260709 12:12:42.416779 29639 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.417404 29639 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:42.399605 29664 log.cc:927] Time spent T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 12:12:42.418251 29661 log.cc:927] Time spent T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:12:42.342852 22604 raft_consensus.cc:1240] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 12:12:42.422066 29499 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:42.422582 29631 log.cc:927] Time spent T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.883s	user 0.006s	sys 0.009s
I20260709 12:12:42.309096 29620 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:42.340461 29313 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:42.423424 29620 raft_consensus.cc:697] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:42.424705 29620 consensus_queue.cc:237] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:42.339373 29391 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:42.282907 29584 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:42.308220 29660 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:42.281198 29503 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:42.394018 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 56447.6us
I20260709 12:12:42.397702 22606 raft_consensus.cc:1275] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:12:42.323113 29650 raft_consensus.cc:2804] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:12:42.392333 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 47383.5us
I20260709 12:12:42.279286 29616 consensus_queue.cc:260] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:42.407523 22523 raft_consensus.cc:1275] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 16 index: 16. Preceding OpId from leader: term: 18 index: 17. (index mismatch)
I20260709 12:12:42.304373 29644 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.432786 22525 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 20.
I20260709 12:12:42.445500 29500 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:42.409417 29618 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:42.485087 29224 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:42.393847 29388 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:42.487540 23125 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 13.
I20260709 12:12:42.481577 29497 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.482085 29584 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:42.440999 29465 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:42.482649 29507 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:42.478134 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:42.532464 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:42.479425 29569 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:42.499569 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:42.498370 22497 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:42.502262 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:42.497655 29650 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:42.519820 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:42.534255 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:42.540509 22603 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 20.
I20260709 12:12:42.541725 22422 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:12:42.535773 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:42.503284 29635 raft_consensus.cc:2749] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:42.538667 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:42.550110 22601 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 19.
W20260709 12:12:42.550972 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 52676.9us
I20260709 12:12:42.505926 29673 consensus_queue.cc:1059] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 12:12:42.558777 22527 raft_consensus.cc:2368] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 19. Current term is 20.
W20260709 12:12:42.562785 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 249832us
I20260709 12:12:42.503719 29644 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:42.538556 28973 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.525341 29388 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:42.549896 29445 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.555735 29507 raft_consensus.cc:2804] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:42.550897 29650 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:42.556066 29535 raft_consensus.cc:2804] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:42.580225 22497 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:42.530603 29497 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:42.589144 23120 raft_consensus.cc:1275] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:12:42.589879 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:42.592200 23119 raft_consensus.cc:1275] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:42.594527 23123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57318 (request call id 1564) took 1180 ms. Trace:
I20260709 12:12:42.503732 29660 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:42.594892 23123 rpcz_store.cc:276] 0709 12:12:41.414220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.414420 (+   200us) service_pool.cc:224] Handling call
0709 12:12:42.594376 (+1179956us) spinlock_profiling.cc:243] Waited 82.6 ms on lock 0x7b5400690354. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:42.594472 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":190025472}
I20260709 12:12:42.581974 29507 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:42.596997 22570 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:42.561407 29224 consensus_queue.cc:1048] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.025s
I20260709 12:12:42.584092 29566 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317)
I20260709 12:12:42.587117 29535 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:42.588680 29492 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:42.617129 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:42.577828 28973 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:42.609099 22570 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:42.588558 29634 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:42.604938 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:42.583359 29445 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:42.605304 29507 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:42.681221 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:42.693868 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:42.694408 23122 raft_consensus.cc:2393] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 21: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:42.616529 29564 raft_consensus.cc:2749] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:42.676793 23120 raft_consensus.cc:2368] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 18. Current term is 19.
I20260709 12:12:42.607366 29675 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.704232 29675 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:42.706435 29675 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:42.707736 29313 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:42.710064 29313 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:42.710722 28973 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:42.683988 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:42.712955 29500 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:42.689033 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:42.713835 23118 raft_consensus.cc:2393] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 15: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:42.713682 29391 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:42.683164 29618 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:42.689590 29677 log.cc:927] Time spent T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:12:42.689917 22529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:46680
I20260709 12:12:42.724785 22529 raft_consensus.cc:606] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:12:42.725152 22529 raft_consensus.cc:614] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:42.690094 29388 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:42.615998 29535 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:42.602595 29678 raft_consensus.cc:2804] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:12:42.692454 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 83440.1us
I20260709 12:12:42.681989 29583 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.696722 29674 raft_consensus.cc:2804] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:42.626389 29501 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:42.701987 29633 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:42.703691 29644 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:42.715976 29391 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:42.718362 22602 raft_consensus.cc:1240] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:12:42.721242 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:42.728036 22605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43070 (request call id 1255) took 1302 ms. Trace:
I20260709 12:12:42.741052 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:42.743839 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:42.748121 22570 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:42.756430 22605 rpcz_store.cc:276] 0709 12:12:41.425380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.426570 (+  1190us) service_pool.cc:224] Handling call
0709 12:12:42.043533 (+616963us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:42.089707 (+ 46174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.727796 (+638089us) spinlock_profiling.cc:243] Waited 617 ms on lock 0x7b54000e9050. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92d8ad 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:42.727962 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1418212608}
I20260709 12:12:42.757350 23122 raft_consensus.cc:2393] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 16: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:42.757627 22570 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:42.740389 29678 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:42.724709 29624 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:42.750314 29674 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:42.736160 29618 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:42.748203 29620 consensus_queue.cc:1048] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 12:12:42.784858 29633 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:42.785848 29660 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:42.786198 29497 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:42.787209 29445 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:42.762831 29554 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:12:42.795374 29224 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
W20260709 12:12:42.796875 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 614294us
I20260709 12:12:42.770658 29564 raft_consensus.cc:2749] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:42.798635 29619 raft_consensus.cc:3055] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:42.772974 29674 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:42.760800 29678 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:42.770828 29624 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:42.820184 29624 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:42.749303 29583 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:42.804836 22496 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:42.817358 29586 raft_consensus.cc:993] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881: : Instructing follower 8701cd5186a949538d8efafb5f987270 to start an election
I20260709 12:12:42.806102 29554 raft_consensus.cc:697] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 26 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:42.827888 22496 leader_election.cc:400] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353) with higher term. Message: Invalid argument: T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 18. Current term is 19.
I20260709 12:12:42.830134 22496 leader_election.cc:403] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:42.804821 29619 raft_consensus.cc:740] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:42.790791 22570 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:42.835508 22452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 1369) took 1440 ms. Trace:
W20260709 12:12:42.836414 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 45742.1us
I20260709 12:12:42.806871 29675 consensus_queue.cc:1048] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.023s
I20260709 12:12:42.811306 29501 consensus_queue.cc:1048] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 12:12:42.839488 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:42.805743 29224 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:42.822252 29583 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:42.846263 29656 log.cc:927] Time spent T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.831s	user 0.003s	sys 0.000s
I20260709 12:12:42.848996 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:42.833242 29287 raft_consensus.cc:2749] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:42.816372 29617 consensus_queue.cc:1048] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 12:12:42.831303 29030 raft_consensus.cc:1081] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Signalling peer 8701cd5186a949538d8efafb5f987270 to start an election
I20260709 12:12:42.864735 29586 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.865346 23119 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab"
dest_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:57332
I20260709 12:12:42.865288 29586 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:42.865994 23119 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:42.866343 23119 raft_consensus.cc:3060] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:42.866556 29224 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:42.837291 29527 raft_consensus.cc:2804] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:42.867498 29527 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:42.867894 29586 leader_election.cc:290] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:42.867980 29527 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:42.870167 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:42.871685 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:42.872267 23124 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 20.
I20260709 12:12:42.849447 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:42.875660 29507 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:42.876224 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:42.879237 29637 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.879911 29637 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:42.882279 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:42.882495 29637 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:42.855031 22528 raft_consensus.cc:2393] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 20: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:42.858007 29554 consensus_queue.cc:237] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:42.867055 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:42.885634 29406 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.891491 22456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34452 (request call id 1379) took 1060 ms. Trace:
I20260709 12:12:42.898145 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:42.833377 29412 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:12:42.901039 29618 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:42.902647 29639 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:42.914544 22602 raft_consensus.cc:1240] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 12:12:42.920075 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:42.923822 22496 leader_election.cc:304] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:42.927141 23122 raft_consensus.cc:1275] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:12:42.938409 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:42.942662 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:42.959419 22605 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 21.
I20260709 12:12:42.951438 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:42.958807 22528 raft_consensus.cc:2410] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 12:12:42.917160 29516 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.949209 29406 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:42.936589 29619 consensus_queue.cc:260] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:42.836387 22452 rpcz_store.cc:276] 0709 12:12:41.394760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.460951 (+ 66191us) service_pool.cc:224] Handling call
0709 12:12:41.494619 (+ 33668us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:41.494827 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:12:41.513458 (+ 18631us) log.cc:844] Serialized 14 byte log entry
0709 12:12:42.740457 (+1226999us) spinlock_profiling.cc:243] Waited 2.13 ms on lock 0x7b18001fcde0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc7823e07 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc7840c02 00007f9cca4c820b 00007f9cca4cdd23 00007f9cca4ce23a 00007f9cca938a2a
0709 12:12:42.833980 (+ 93523us) log.cc:844] Serialized 14 byte log entry
0709 12:12:42.834146 (+   166us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:42.834187 (+    41us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:42.834725 (+   538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.834801 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:42.834917 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":19199,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":9928,"raft.queue_time_us":1101,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":4373,"spinlock_wait_cycles":9908992,"thread_start_us":91912,"threads_started":1}
I20260709 12:12:42.939880 22456 rpcz_store.cc:276] 0709 12:12:41.831035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.914083 (+ 83048us) service_pool.cc:224] Handling call
0709 12:12:41.914349 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:41.914639 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:41.914666 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:41.915066 (+   400us) log.cc:844] Serialized 26 byte log entry
0709 12:12:42.333931 (+418865us) spinlock_profiling.cc:243] Waited 2.95 ms on lock 0x7b1800432220. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc780f2a6 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cca4d64bc 00007f9cc782448b
0709 12:12:42.335398 (+  1467us) spinlock_profiling.cc:243] Waited 9.37 ms on lock 0x7b1800432220. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cca4d64bc 00007f9cc782448b 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc7840c02 00007f9cca4c820b 00007f9cca4cdd23 00007f9cca4ce0d1
0709 12:12:42.335579 (+   181us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:12:42.335839 (+   260us) log.cc:844] Serialized 14 byte log entry
0709 12:12:42.336040 (+   201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.336118 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:42.888634 (+552516us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b1800432220. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc78413f3 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd 0000000000388634 0000000000388479 00007f9cc782483a
0709 12:12:42.891293 (+  2659us) raft_consensus.cc:1685] finished
0709 12:12:42.891315 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:42.891433 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31,"prepare.queue_time_us":4979,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":4043,"raft.queue_time_us":6396,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":67444,"spinlock_wait_cycles":71060608,"thread_start_us":41412,"threads_started":1,"wal-append.queue_time_us":40463}
W20260709 12:12:42.967358 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 43649.7us
I20260709 12:12:42.968670 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:43.080667 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:43.089284 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:43.087208 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:43.091018 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:43.092257 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:43.092357 22530 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:46680
I20260709 12:12:42.972360 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:43.093321 22529 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 16.
I20260709 12:12:43.094494 22528 raft_consensus.cc:2468] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 16.
W20260709 12:12:43.069308 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:42.970000 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:43.100731 22601 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 20.
I20260709 12:12:43.093338 22530 raft_consensus.cc:606] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
W20260709 12:12:43.106442 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:42.970045 29507 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:43.106775 29294 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:42.971848 23119 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:43.108858 29294 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:42.973908 29516 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:43.110675 29556 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:43.112179 29294 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:43.111843 29556 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:42.981287 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:42.976166 29535 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:43.115708 22603 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 19.
I20260709 12:12:43.014379 29503 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:43.117738 29556 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:43.111900 29527 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:43.112316 23119 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:43.103632 22530 raft_consensus.cc:614] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:42.998683 29678 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:43.108868 29507 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:43.003991 29675 consensus_queue.cc:1059] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.130s
I20260709 12:12:42.979265 29489 raft_consensus.cc:3055] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 12:12:43.132544 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 47797.2us
I20260709 12:12:43.134959 22529 raft_consensus.cc:1275] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 12:12:42.970799 29403 consensus_queue.cc:1048] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.168s
W20260709 12:12:43.025666 29621 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.991s	user 0.009s	sys 0.009s
I20260709 12:12:43.141225 29604 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:43.141742 29406 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:43.142002 29604 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:43.142853 29645 consensus_queue.cc:1048] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:43.145277 22526 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 20.
I20260709 12:12:42.971227 29224 raft_consensus.cc:2804] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:43.151178 29224 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:43.151643 29224 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:43.151901 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:43.153412 23124 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 18: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:43.154238 29507 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:43.154492 29617 consensus_queue.cc:1059] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:43.014076 29674 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:43.157377 29507 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:43.158399 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:43.159235 22606 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:43.159310 29489 raft_consensus.cc:740] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:43.161407 29489 consensus_queue.cc:260] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:43.163128 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:42.998265 29650 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:43.164228 22448 raft_consensus.cc:2393] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 18: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:43.165294 22525 raft_consensus.cc:2410] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 21 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 12:12:43.167254 29650 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:43.167819 22525 raft_consensus.cc:1275] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 18 index: 17. Preceding OpId from leader: term: 19 index: 18. (index mismatch)
I20260709 12:12:43.172525 29527 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:12:43.173828 29621 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.139s	user 0.009s	sys 0.009s
I20260709 12:12:43.177004 29678 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:43.178509 29535 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:43.185624 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:43.187269 23124 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:43.154240 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 68683us
I20260709 12:12:43.195619 29489 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:43.203985 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:43.193073 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:43.210355 29676 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:43.211335 29676 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:43.216873 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:43.219743 29674 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:43.222757 29604 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:43.242817 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:43.246064 22451 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
I20260709 12:12:43.246511 29619 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:43.250388 22523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 2497) took 1046 ms. Trace:
I20260709 12:12:43.251293 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:43.252101 22448 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 21.
I20260709 12:12:43.234731 29676 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:43.250855 22523 rpcz_store.cc:276] 0709 12:12:42.215244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:42.215394 (+   150us) service_pool.cc:224] Handling call
0709 12:12:42.215744 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:42.500941 (+285197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:43.249853 (+748912us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b5400262354. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:43.250172 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":440274688}
I20260709 12:12:43.261839 29445 consensus_queue.cc:1048] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:12:43.264711 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:43.269260 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:43.270078 23118 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 20.
I20260709 12:12:43.270471 22606 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 21.
I20260709 12:12:43.273165 22497 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
W20260709 12:12:43.280421 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 54348.4us
W20260709 12:12:43.282078 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:43.282994 29672 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:43.283533 29672 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:43.283927 29672 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:43.282749 22497 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:12:43.287333 29584 raft_consensus.cc:2804] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:43.289907 29584 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:43.290410 29584 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:43.276430 22421 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:43.278141 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:43.292479 29563 raft_consensus.cc:2804] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:43.292899 29563 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:43.293248 29563 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:43.297020 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:43.301013 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:43.302517 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:43.302661 22532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 2493) took 1104 ms. Trace:
I20260709 12:12:43.303154 22602 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:43.304090 29563 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:43.303146 22532 rpcz_store.cc:276] 0709 12:12:42.198248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:42.199775 (+  1527us) service_pool.cc:224] Handling call
0709 12:12:42.241494 (+ 41719us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:42.294954 (+ 53460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:42.295018 (+    64us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:42.345302 (+ 50284us) log.cc:844] Serialized 26 byte log entry
0709 12:12:42.614271 (+268969us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:42.724554 (+110283us) log.cc:844] Serialized 14 byte log entry
0709 12:12:42.724816 (+   262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.724891 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:43.185689 (+460798us) spinlock_profiling.cc:243] Waited 2.38 ms on lock 0x7b18000b6860. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc78413f3 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd 0000000000388634 0000000000388479 00007f9cc782483a
0709 12:12:43.277647 (+ 91958us) spinlock_profiling.cc:243] Waited 4.66 ms on lock 0x7b18000b6860. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc780f2a6 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc78413f3 00007f9cc78437c1
0709 12:12:43.278173 (+   526us) spinlock_profiling.cc:243] Waited 3.88 ms on lock 0x7b18000b6860. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc78413f3 00007f9cc78437c1 00007f9cc7843779 00007f9cc7843709 00007f9cc78436d1 00007f9cc78429cd 0000000000388634 0000000000388479 00007f9cc782483a
0709 12:12:43.302191 (+ 24018us) raft_consensus.cc:1685] finished
0709 12:12:43.302227 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:43.302440 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":132269,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":89,"raft.queue_time_us":46028,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":26015,"spinlock_wait_cycles":25127296,"thread_start_us":244774,"threads_started":3,"wal-append.queue_time_us":335019}
I20260709 12:12:43.308733 29604 consensus_queue.cc:1059] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:12:43.309576 29604 consensus_queue.cc:1243] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer 8701cd5186a949538d8efafb5f987270 log is divergent from this leader: its last log entry 19.18 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 17
I20260709 12:12:43.310351 29447 raft_consensus.cc:3055] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:43.311599 29447 raft_consensus.cc:740] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:43.312770 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:43.312888 29447 consensus_queue.cc:260] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 18.17, Last appended by leader: 17, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:43.314726 29447 raft_consensus.cc:3060] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:43.304574 29616 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:43.277486 29401 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:43.304183 29516 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:43.289062 22570 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
W20260709 12:12:43.332844 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 44106.4us
I20260709 12:12:43.326963 22602 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 21.
I20260709 12:12:43.336683 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:43.331290 29563 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:43.348862 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:43.353823 23088 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:43.354727 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:43.335750 29556 raft_consensus.cc:2764] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 12:12:43.355356 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:43.361542 22456 raft_consensus.cc:2468] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 16.
I20260709 12:12:43.358736 22421 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:43.358255 22497 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:43.330739 29401 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:43.401778 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:43.407210 22448 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 20.
I20260709 12:12:43.408563 23088 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:43.408861 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:43.409631 29505 consensus_queue.cc:1048] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:12:43.410573 22451 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:43.411656 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:43.440960 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 82838.5us
I20260709 12:12:43.441654 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:43.442314 22597 raft_consensus.cc:2468] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 14.
I20260709 12:12:43.442584 29673 raft_consensus.cc:2804] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:43.411791 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:43.446038 22449 raft_consensus.cc:2468] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 21.
I20260709 12:12:43.423403 29412 raft_consensus.cc:2749] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353) with higher term. Message: Invalid argument: T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 18. Current term is 19.
I20260709 12:12:43.424645 29624 raft_consensus.cc:2804] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:43.447100 29624 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:43.447376 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:43.447563 29624 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:43.448112 22532 raft_consensus.cc:3055] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:43.448477 22532 raft_consensus.cc:740] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
W20260709 12:12:43.424286 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 85110.7us
I20260709 12:12:43.449365 22532 consensus_queue.cc:260] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:43.450052 22421 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:43.450414 22532 raft_consensus.cc:3060] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:43.451537 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:43.427002 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:43.427312 23119 raft_consensus.cc:1240] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 14. Current term is 15. Ops: []
W20260709 12:12:43.453135 22496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:43.428783 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:43.427544 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:43.454360 22601 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:43.455041 22604 raft_consensus.cc:2393] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 14: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:43.440004 29497 raft_consensus.cc:2804] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:43.456292 29497 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:43.429010 29674 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:43.446079 29675 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:43.456842 29497 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:43.457062 29674 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:43.457422 29675 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:43.435307 22605 raft_consensus.cc:2393] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 21: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:43.427901 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:43.448134 22531 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 19.
I20260709 12:12:43.424922 29604 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:43.427489 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:43.461252 22600 raft_consensus.cc:2393] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 22: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:43.460933 29604 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:43.464236 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 55893.5us
I20260709 12:12:43.465432 29431 raft_consensus.cc:2804] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:43.465900 29431 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:43.466297 29431 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:43.443109 29673 raft_consensus.cc:697] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:43.468994 29639 consensus_queue.cc:1048] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:43.470670 29505 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:43.471367 29505 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:43.426244 23125 raft_consensus.cc:1275] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:12:43.477567 29556 consensus_queue.cc:1048] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:12:43.479460 29675 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:43.480718 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:43.453132 29563 raft_consensus.cc:2749] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:43.481587 22602 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 17.
I20260709 12:12:43.482225 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:43.469782 29673 consensus_queue.cc:237] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:43.483496 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:43.477811 29604 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:43.487278 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:43.487908 22457 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:43.488235 22453 raft_consensus.cc:2368] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 20. Current term is 21.
I20260709 12:12:43.461570 22422 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:43.489579 29524 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:43.490476 29524 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:43.491434 29603 raft_consensus.cc:2804] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:43.491935 29603 raft_consensus.cc:697] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 21 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:43.492858 29603 consensus_queue.cc:237] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:43.493340 29524 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:43.495680 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:12:43.496943 29705 log.cc:927] Time spent T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 12:12:43.497282 22525 raft_consensus.cc:1275] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:12:43.487936 23121 raft_consensus.cc:1240] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:43.501153 29589 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:43.501806 29589 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:43.505532 29507 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:43.506176 29507 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:43.507764 29584 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:43.508623 29507 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:43.510200 29584 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:43.511132 22524 raft_consensus.cc:1240] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:43.511056 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:43.512975 22530 raft_consensus.cc:1240] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:43.515232 22532 raft_consensus.cc:2468] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 15.
I20260709 12:12:43.515538 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:43.510216 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:43.519321 22529 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 18: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
W20260709 12:12:43.536150 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:43.542272 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:43.514096 29709 log.cc:927] Time spent T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.110s	user 0.003s	sys 0.000s
I20260709 12:12:43.550577 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:43.557395 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:43.560803 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:43.571583 22451 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 22.
I20260709 12:12:43.575603 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:43.572223 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:43.426468 29224 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:43.585261 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:43.585647 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:43.592360 23124 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
I20260709 12:12:43.599210 22529 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:43.600709 22449 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 18.
I20260709 12:12:43.567209 29604 consensus_queue.cc:1048] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 12:12:43.608356 29401 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:43.615108 29403 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:43.615887 29589 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:43.615806 29403 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:43.624742 22457 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 21.
I20260709 12:12:43.602492 29672 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:43.624794 29445 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:43.627624 29445 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:43.628240 29672 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:43.629776 29445 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:43.630175 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:43.630306 29445 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:43.593652 29650 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:43.638186 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:43.638386 29650 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:43.639346 23124 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 22.
I20260709 12:12:43.640666 29650 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:43.642112 29505 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:43.643949 22495 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:43.645664 22495 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:12:43.653640 29619 raft_consensus.cc:2749] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:12:43.654389 29619 raft_consensus.cc:2804] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:12:43.655869 29708 log.cc:927] Time spent T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:12:43.665786 29650 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:43.654760 29619 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:43.667738 29619 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:43.666402 29650 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:43.673166 29624 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:43.676069 22454 raft_consensus.cc:2393] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 21: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:43.676960 22529 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
I20260709 12:12:43.677814 22495 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:43.679699 22495 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:43.680375 29489 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:43.680850 29489 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:43.681185 29489 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:43.684154 29645 raft_consensus.cc:2749] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:12:43.686007 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:43.688019 22570 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:43.597744 29563 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:43.690738 29524 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:43.691251 29524 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:43.691602 29524 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:43.696861 29624 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:43.700726 29524 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:43.704234 29524 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 23 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:43.705276 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:43.706655 23124 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:43.714250 29224 leader_election.cc:290] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:43.714241 23124 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 23.
I20260709 12:12:43.716387 22570 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:43.717187 29524 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:43.717662 29524 raft_consensus.cc:697] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:43.718544 29524 consensus_queue.cc:237] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:43.719388 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 146340us
I20260709 12:12:43.720304 22421 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:43.721077 29497 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:43.695943 29563 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:43.723950 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:43.724516 22602 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:43.725221 29563 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:43.625546 29674 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:43.763942 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 84384.4us
I20260709 12:12:43.764937 22601 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 20.
I20260709 12:12:43.768801 22598 raft_consensus.cc:1240] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:43.739756 29624 raft_consensus.cc:2764] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 12:12:43.776428 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:43.780452 22529 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 19.
I20260709 12:12:43.783973 29507 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:43.788507 22602 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 21.
I20260709 12:12:43.795056 22497 leader_election.cc:304] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:43.761620 29431 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:43.798645 22495 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:12:43.738642 29445 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:43.786312 29507 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:43.797520 29650 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:43.824712 22496 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:43.827848 22421 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:43.829233 22421 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:43.830430 22421 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:43.832191 29507 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:43.833052 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 48400.2us
I20260709 12:12:43.814635 29516 raft_consensus.cc:2804] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:43.801155 29584 raft_consensus.cc:2804] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:43.840643 22421 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:43.842695 29619 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:43.845893 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 173385us
I20260709 12:12:43.850237 23089 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:43.852618 22495 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
W20260709 12:12:43.852265 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 385686us
I20260709 12:12:43.837677 29645 raft_consensus.cc:2749] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:43.847348 29604 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:43.848423 29650 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:43.866775 23089 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:43.869201 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:43.851441 29563 raft_consensus.cc:2749] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:43.854162 29516 raft_consensus.cc:697] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:43.859037 29584 raft_consensus.cc:697] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:43.872507 22529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf783936508640219af47375c444da09"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:46680
I20260709 12:12:43.874105 29403 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:43.874555 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:43.838824 29224 consensus_queue.cc:1059] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 12:12:43.906224 22524 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 20.
I20260709 12:12:43.875157 22452 raft_consensus.cc:1275] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:12:43.875499 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:43.908782 22456 raft_consensus.cc:2468] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
I20260709 12:12:43.909178 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:43.910070 22457 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 22.
I20260709 12:12:43.876430 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:43.877368 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:43.910907 22528 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:43.911039 22450 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 20.
I20260709 12:12:43.878796 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:43.912123 22449 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 18: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:43.879272 29501 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:43.913674 29619 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:43.913565 29501 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:43.914731 29715 log.cc:927] Time spent T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:12:43.915508 23089 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:43.915750 29501 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:43.854455 29507 raft_consensus.cc:2749] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:43.879833 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:43.916942 22448 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:43.917060 29713 log.cc:927] Time spent T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:12:43.918527 29718 raft_consensus.cc:2749] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:43.881083 22454 raft_consensus.cc:1240] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:43.882201 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:43.919397 22453 raft_consensus.cc:1275] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:12:43.883832 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:43.883710 29569 consensus_queue.cc:1048] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 12:12:43.884575 29616 raft_consensus.cc:2804] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:43.884949 29447 raft_consensus.cc:2804] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:43.885238 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:43.886389 29707 log.cc:927] Time spent T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.488s	user 0.002s	sys 0.001s
I20260709 12:12:43.886719 23088 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:43.847420 29489 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:43.861524 29676 raft_consensus.cc:2804] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:43.909698 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:43.949221 22456 raft_consensus.cc:2368] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 20. Current term is 21.
I20260709 12:12:43.882627 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:43.910308 29711 log.cc:927] Time spent T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 12:12:43.923971 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:43.930367 22448 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
I20260709 12:12:43.933907 22523 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 20.
I20260709 12:12:43.950098 22531 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 21.
W20260709 12:12:43.953284 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 66648.9us
I20260709 12:12:43.950845 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:43.957728 22524 raft_consensus.cc:2410] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 12:12:43.948743 29676 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:43.959034 29714 log.cc:927] Time spent T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 12:12:43.958904 29403 consensus_queue.cc:1059] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:43.960119 29489 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:43.960788 29676 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:43.968962 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 128421us
I20260709 12:12:43.972172 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:43.972702 22448 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:43.942812 29619 raft_consensus.cc:3055] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 12:12:43.974960 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 140609us
I20260709 12:12:43.919322 29650 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:43.979849 22495 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:43.982769 22528 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 21.
I20260709 12:12:43.984040 29722 consensus_queue.cc:1048] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.028s
I20260709 12:12:43.986037 29722 raft_consensus.cc:2804] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:43.986631 29722 raft_consensus.cc:697] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 15 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:44.007774 29722 consensus_queue.cc:237] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:43.970777 29676 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:44.021076 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:44.021422 29676 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:44.022465 22495 leader_election.cc:400] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 election: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 20. Current term is 21.
I20260709 12:12:44.022912 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:44.022840 22495 leader_election.cc:403] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 12:12:44.024263 29635 raft_consensus.cc:2749] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 20. Current term is 21.
I20260709 12:12:44.026217 22495 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:44.027184 29501 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:44.027734 29501 raft_consensus.cc:697] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:44.028048 29650 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:44.028244 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:43.979185 29619 raft_consensus.cc:740] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:44.028867 29501 consensus_queue.cc:237] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:43.988668 29717 log.cc:927] Time spent T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:12:43.991247 23116 raft_consensus.cc:1240] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:43.991505 29455 raft_consensus.cc:3055] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:43.992743 29445 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:43.993359 29584 consensus_queue.cc:237] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:44.036888 29455 raft_consensus.cc:740] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:44.037909 29455 consensus_queue.cc:260] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:43.993848 29516 consensus_queue.cc:237] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:43.975518 29716 log.cc:927] Time spent T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 12:12:43.998044 29718 raft_consensus.cc:2749] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:43.954216 29447 raft_consensus.cc:697] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:43.956724 29616 raft_consensus.cc:697] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:43.951280 29431 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:12:43.998958 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 43585.2us
I20260709 12:12:44.051999 22569 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:12:44.057031 29674 raft_consensus.cc:2804] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:44.057587 29674 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:44.058043 29674 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:44.000116 22526 raft_consensus.cc:1275] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 26 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 12:12:44.000531 22454 raft_consensus.cc:1275] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 26 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 12:12:44.002560 29313 consensus_queue.cc:1059] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:44.002862 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:44.002573 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:44.069682 22603 raft_consensus.cc:2410] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 21 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 12:12:44.005997 22530 raft_consensus.cc:1275] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:12:44.006764 22421 leader_election.cc:400] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 19. Current term is 20.
I20260709 12:12:44.023051 29495 raft_consensus.cc:2749] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:44.071686 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 65153.3us
I20260709 12:12:43.988250 29497 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:44.074285 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:44.074793 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:44.075918 22455 raft_consensus.cc:2393] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 21: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:44.077495 22453 raft_consensus.cc:1275] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 18 index: 17. Preceding OpId from leader: term: 19 index: 18. (index mismatch)
I20260709 12:12:44.079150 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:44.083845 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:44.084196 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:44.084623 22456 raft_consensus.cc:2468] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 16.
I20260709 12:12:44.085486 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:44.085544 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:44.086220 22449 raft_consensus.cc:3060] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:44.086323 22456 raft_consensus.cc:2468] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 14.
I20260709 12:12:44.087352 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:44.087523 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:44.088581 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:44.049034 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:44.089424 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:44.090194 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:44.091075 22457 raft_consensus.cc:2410] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 22 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 12:12:44.089429 22606 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 19.
I20260709 12:12:44.088581 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:44.092170 22450 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:44.088642 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:44.093220 22456 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 18.
I20260709 12:12:44.093472 29637 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:44.094050 29637 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:44.096202 22449 raft_consensus.cc:2468] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 15.
I20260709 12:12:44.096361 29637 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:44.103466 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:44.104295 22453 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:44.107651 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:44.108858 22455 raft_consensus.cc:2410] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
W20260709 12:12:44.122908 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 71066.9us
I20260709 12:12:44.124738 22569 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:44.125833 29505 raft_consensus.cc:2804] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:44.126340 29505 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:44.126860 29505 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:44.132051 29569 consensus_queue.cc:1048] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:12:44.041425 22495 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:44.157142 22569 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:44.163187 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 121869us
W20260709 12:12:44.169823 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:44.191526 29447 consensus_queue.cc:237] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:44.197923 29619 consensus_queue.cc:260] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:44.204813 29616 consensus_queue.cc:237] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:44.208761 22348 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48412 (request call id 244) took 32140 ms (client timeout 15000 ms). Trace:
I20260709 12:12:44.209978 22347 catalog_manager.cc:5697] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 16 to 24, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 24 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:12:44.223687 22347 catalog_manager.cc:5697] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 11 to 15, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 15 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:44.169308 29569 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:44.225741 22347 catalog_manager.cc:5697] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 14 to 17, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 17 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:44.227396 22347 catalog_manager.cc:5697] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 17 to 19, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 19 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:44.229105 22347 catalog_manager.cc:5697] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 13 to 18, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 18 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:12:44.231204 29637 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:44.231904 29637 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:44.234351 29637 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:44.169737 29313 raft_consensus.cc:2804] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:44.222402 29619 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:44.245131 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 86740.9us
I20260709 12:12:44.248780 22448 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 23.
I20260709 12:12:44.251258 22569 leader_election.cc:400] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 election: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 20. Current term is 21.
I20260709 12:12:44.256315 22569 leader_election.cc:403] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 12:12:44.269392 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:44.257613 22450 raft_consensus.cc:2468] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 17.
I20260709 12:12:44.286242 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:44.286923 22524 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:44.278434 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:44.290345 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:44.285200 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:44.292891 22448 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:44.277525 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:44.294792 22526 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 20.
I20260709 12:12:44.263216 29313 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:44.269264 29556 consensus_queue.cc:1059] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 12:12:44.310907 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:44.301602 23116 raft_consensus.cc:2368] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 14. Current term is 15.
I20260709 12:12:44.312999 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:44.314195 22451 raft_consensus.cc:2410] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 21 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 12:12:44.314970 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:44.309486 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:44.305999 22453 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 19.
I20260709 12:12:44.230782 22347 catalog_manager.cc:5697] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 14 to 19, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 19 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:44.363122 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:44.347695 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:44.312000 29313 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:44.364102 22525 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 18.
I20260709 12:12:44.367533 22523 raft_consensus.cc:1275] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:12:44.370930 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:44.374045 22531 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 26.
I20260709 12:12:44.377362 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:44.319248 29412 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:44.394408 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ed4486435d4f82978c5cb544504999" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:44.394871 29412 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:44.397136 22421 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:44.397980 29569 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:44.398342 29563 raft_consensus.cc:2749] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:44.398252 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:44.380298 29663 raft_consensus.cc:2749] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 20. Current term is 21.
I20260709 12:12:44.376969 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:44.401491 22421 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:44.420403 23119 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:44.425112 22448 raft_consensus.cc:2468] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 15.
I20260709 12:12:44.425680 22524 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 21.
W20260709 12:12:44.434041 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 486284us
W20260709 12:12:44.442636 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 527204us
I20260709 12:12:44.436399 22347 catalog_manager.cc:5697] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 14 to 19, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 19 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:12:44.450495 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 281664us
I20260709 12:12:44.456632 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:44.449877 22570 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:44.367955 29718 consensus_queue.cc:1059] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.078s
I20260709 12:12:44.434924 29563 raft_consensus.cc:2804] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:44.406881 29505 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:44.467015 23121 raft_consensus.cc:2393] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 23: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:44.468468 22529 raft_consensus.cc:606] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 LEADER]: Received request to transfer leadership to TS 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:44.461826 22347 catalog_manager.cc:5697] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 16 to 20, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 20 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:44.468058 22422 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:44.473631 22421 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:44.470469 29663 raft_consensus.cc:2749] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:44.468617 29563 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:44.490587 22570 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:44.508134 22454 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
I20260709 12:12:44.513720 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:44.514240 22570 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
W20260709 12:12:44.518538 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 44993.2us
I20260709 12:12:44.519361 22421 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:44.521423 22421 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:44.522722 22421 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:44.535939 23089 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:44.500365 29624 raft_consensus.cc:2804] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:44.507421 29563 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:44.545532 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 294471us
I20260709 12:12:44.513695 29604 raft_consensus.cc:2749] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:44.525164 29637 raft_consensus.cc:2749] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:44.519374 22347 catalog_manager.cc:5697] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:12:44.543368 29663 raft_consensus.cc:2804] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:44.543905 29624 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:44.546113 29603 raft_consensus.cc:2749] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:44.547053 29524 raft_consensus.cc:2804] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:44.552501 22569 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:44.555534 29676 raft_consensus.cc:2804] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:12:44.571264 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:44.544174 29674 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:44.571822 22347 catalog_manager.cc:5697] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 14 to 18, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 18 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:44.573762 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:44.571388 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 206129us
I20260709 12:12:44.562661 29663 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:44.565070 29624 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:44.581988 22347 catalog_manager.cc:5697] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 16 to 19, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 19 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:12:44.589555 22603 raft_consensus.cc:1275] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:12:44.590827 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:44.591542 22532 raft_consensus.cc:1240] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 21. Current term is 22. Ops: [21.18-21.18]
I20260709 12:12:44.588769 23088 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:44.579682 29497 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:44.599110 29497 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:44.595454 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:44.601352 29497 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:44.601995 29730 consensus_queue.cc:1048] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:44.603396 22347 catalog_manager.cc:5697] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:44.606451 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:44.609179 22530 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:44.586952 29663 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:44.618214 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:44.615460 22347 catalog_manager.cc:5697] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 11 to 17. New cstate: current_term: 17 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:12:44.619415 29497 raft_consensus.cc:2804] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:44.619942 29497 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:44.620339 29497 raft_consensus.cc:3060] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:44.621074 29731 raft_consensus.cc:3055] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:44.621570 29731 raft_consensus.cc:740] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:44.623347 29720 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:12:44.623769 29720 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:44.624075 29720 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:12:44.601356 29569 raft_consensus.cc:2749] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:44.626109 29569 consensus_queue.cc:1048] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:12:44.627545 29732 log.cc:927] Time spent T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:12:44.575830 29556 consensus_queue.cc:1048] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.028s
I20260709 12:12:44.591506 29639 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:44.590521 29676 raft_consensus.cc:697] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 20 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
W20260709 12:12:44.644030 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 290925us
I20260709 12:12:44.646051 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:44.651499 29676 consensus_queue.cc:237] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:44.653115 29735 consensus_queue.cc:1048] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:12:44.657896 29736 log.cc:927] Time spent T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:12:44.661494 23119 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 21.
I20260709 12:12:44.667420 22495 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:44.628487 29412 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:44.633386 22347 catalog_manager.cc:5697] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:44.683096 22495 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:44.622619 29731 consensus_queue.cc:260] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:44.638814 29505 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:44.690917 29645 raft_consensus.cc:2749] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:44.686736 29731 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:44.690660 29507 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:44.692994 22495 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:44.695154 22347 catalog_manager.cc:5697] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
W20260709 12:12:44.692090 29726 log.cc:927] Time spent T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
W20260709 12:12:44.716051 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 193376us
I20260709 12:12:44.699913 29645 raft_consensus.cc:2749] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:12:44.725138 22421 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:44.723129 22347 catalog_manager.cc:5697] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 14 to 17, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 17 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:44.664882 29313 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:44.642937 29639 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:44.729899 29603 consensus_queue.cc:1048] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:44.717516 29507 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:44.734424 22454 raft_consensus.cc:1275] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:12:44.719873 29495 raft_consensus.cc:2804] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:44.734946 22347 catalog_manager.cc:5697] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 17 to 19, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 19 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:12:44.733026 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 135299us
W20260709 12:12:44.735463 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 181149us
I20260709 12:12:44.748665 22532 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 19: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:44.734493 29584 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
W20260709 12:12:44.759780 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 113688us
I20260709 12:12:44.759931 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:44.778523 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:44.785311 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:44.753369 22347 catalog_manager.cc:5697] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 14 to 17, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 17 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:44.788231 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:44.790282 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:44.786057 23116 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 18.
I20260709 12:12:44.792448 22347 catalog_manager.cc:5697] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 19 to 21, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 21 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:44.795513 22457 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:44568
I20260709 12:12:44.796268 22457 raft_consensus.cc:606] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:12:44.796701 22457 raft_consensus.cc:614] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:44.749352 29495 raft_consensus.cc:697] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:44.801242 22421 leader_election.cc:400] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 election: Vote denied by peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353) with higher term. Message: Invalid argument: T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 14. Current term is 15.
I20260709 12:12:44.801295 23123 raft_consensus.cc:2393] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 21: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:44.747635 29524 raft_consensus.cc:697] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:44.808449 22421 leader_election.cc:403] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260709 12:12:44.815598 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:44.815987 22598 raft_consensus.cc:1275] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:12:44.760842 29447 raft_consensus.cc:2804] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:44.783234 29674 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:44.819854 22347 catalog_manager.cc:5697] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 8 to 14. New cstate: current_term: 14 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:44.824153 22497 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:44.831945 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 257967us
I20260709 12:12:44.835358 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:44.817734 23087 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:44.758811 29501 consensus_queue.cc:1048] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 12:12:44.839783 22604 raft_consensus.cc:1275] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:12:44.780390 29584 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:44.846127 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 50948.8us
I20260709 12:12:44.847802 22570 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:44.811132 29294 raft_consensus.cc:2749] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353) with higher term. Message: Invalid argument: T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 14. Current term is 15.
I20260709 12:12:44.808712 29722 consensus_queue.cc:1059] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 19.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.034s
W20260709 12:12:44.843405 29734 log.cc:927] Time spent T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 12:12:44.853837 29676 raft_consensus.cc:2749] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:44.857161 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:44.857398 29224 raft_consensus.cc:2749] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:44.858530 29748 consensus_queue.cc:1048] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:12:44.844157 29447 raft_consensus.cc:697] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:44.859575 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:44.862248 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:44.859001 29455 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:44.877737 23120 raft_consensus.cc:2393] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 15: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
W20260709 12:12:44.874282 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 50151.5us
W20260709 12:12:44.879995 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 55919.7us
W20260709 12:12:44.910866 29727 log.cc:927] Time spent T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.350s	user 0.002s	sys 0.000s
I20260709 12:12:44.920537 22604 raft_consensus.cc:1275] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:12:44.928272 29505 raft_consensus.cc:2749] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:44.929754 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 82119.7us
I20260709 12:12:44.930447 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:44.930946 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:12:44.931248 23116 raft_consensus.cc:2393] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 15: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:44.854627 29674 consensus_queue.cc:1059] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.077s
W20260709 12:12:44.931532 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 124883us
W20260709 12:12:44.938241 29746 log.cc:927] Time spent T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 12:12:44.938706 29738 log.cc:927] Time spent T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 12:12:44.869606 22347 catalog_manager.cc:5697] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 10 to 15, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 15 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
W20260709 12:12:44.941704 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 61007.9us
I20260709 12:12:45.002265 22456 raft_consensus.cc:1275] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:12:44.951697 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:44.957594 29447 consensus_queue.cc:237] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:44.958904 23123 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:44.973899 22530 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 17.
I20260709 12:12:44.931013 29507 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:44.940721 29497 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:45.004666 22455 raft_consensus.cc:1240] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:44.981830 23125 raft_consensus.cc:1240] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:44.984395 22451 raft_consensus.cc:1275] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:12:44.991415 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:44.994417 22526 raft_consensus.cc:1240] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:45.001296 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:45.001518 23121 raft_consensus.cc:1240] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 20 LEADER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 12:12:45.010118 22532 raft_consensus.cc:1240] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:12:45.007294 22527 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 19.
I20260709 12:12:45.012177 22525 raft_consensus.cc:2393] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 20: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:45.012318 22523 raft_consensus.cc:1275] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 12:12:45.014950 23087 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:45.029727 22347 catalog_manager.cc:5697] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 12 to 19, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 19 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:12:45.044087 29505 raft_consensus.cc:3055] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:45.044579 29505 raft_consensus.cc:740] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:45.045555 29505 consensus_queue.cc:260] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:45.046720 29505 raft_consensus.cc:3060] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:45.055502 23123 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 21.
I20260709 12:12:45.051103 22347 catalog_manager.cc:5697] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 17 to 20, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 20 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:45.063220 23119 raft_consensus.cc:1275] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
W20260709 12:12:45.064019 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:44.946748 29495 consensus_queue.cc:237] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:45.070480 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 206157us
I20260709 12:12:45.076714 22421 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:45.056150 29728 raft_consensus.cc:2749] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:45.089143 22347 catalog_manager.cc:5697] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 16 to 19, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 19 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:12:45.036319 29507 consensus_queue.cc:1048] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:12:45.095166 22421 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:45.098026 23087 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:45.117257 22421 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:45.122653 23087 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:45.007936 29524 consensus_queue.cc:237] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:45.063218 29753 consensus_queue.cc:1048] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.054s
I20260709 12:12:45.127930 22347 catalog_manager.cc:5697] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 14 to 17, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 17 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:45.091766 29748 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:45.115564 29749 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.122665 29676 raft_consensus.cc:2749] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:45.116459 29603 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.119606 29604 raft_consensus.cc:2749] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:45.142577 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:45.125255 29584 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:45.139322 23122 raft_consensus.cc:1275] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:12:45.128360 29556 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.117233 29742 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:45.133121 29313 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:45.153828 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:45.144176 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:45.160429 22602 raft_consensus.cc:2393] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 15: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:45.086421 29624 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:45.154011 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:45.154502 22347 catalog_manager.cc:5697] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: config changed from index 5 to 8, term changed from 8 to 12, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to <none>, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New cstate: current_term: 12 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:45.135421 29637 raft_consensus.cc:2749] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:45.158291 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:45.166363 22601 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 18.
I20260709 12:12:45.163262 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:45.168485 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 46550.6us
I20260709 12:12:45.169355 22421 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:45.159019 23087 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:45.132733 29728 raft_consensus.cc:2749] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:12:45.177546 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:45.180192 22448 raft_consensus.cc:2368] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 20. Current term is 21.
I20260709 12:12:45.186719 22347 catalog_manager.cc:5697] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 13 to 15, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 15 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:45.195021 23087 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:45.145072 29603 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:45.180305 29294 raft_consensus.cc:2749] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:45.195293 29563 consensus_meta.cc:287] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.639s	user 0.012s	sys 0.000s
I20260709 12:12:45.207484 29431 raft_consensus.cc:3055] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 21 LEADER]: Stepping down as leader of term 21
W20260709 12:12:45.208101 29773 log.cc:927] Time spent T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:12:45.191469 29676 raft_consensus.cc:2749] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:45.213088 23087 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
W20260709 12:12:44.235417 22348 rpcz_store.cc:269] 0709 12:12:12.068834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:12.193874 (+125040us) service_pool.cc:224] Handling call
0709 12:12:44.208467 (+32014593us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:40.143391 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:40.144066 (+   675us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:40.144118 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:12:40.144136 (+    18us) tablet.cc:662] Decoding operations
0709 12:12:40.412421 (+268285us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:40.442142 (+ 29721us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:40.442180 (+    38us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:12:40.443485 (+  1305us) tablet.cc:701] Row locks acquired
0709 12:12:40.443536 (+    51us) write_op.cc:260] PREPARE: finished
0709 12:12:40.443722 (+   186us) write_op.cc:270] Start()
0709 12:12:40.443877 (+   155us) write_op.cc:276] Timestamp: P: 1783599160443654 usec, L: 0
0709 12:12:40.443914 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 12:12:40.473773 (+ 29859us) log.cc:844] Serialized 5236 byte log entry
0709 12:12:40.948644 (+474871us) spinlock_profiling.cc:243] Waited 2.06 ms on lock 0x7b5400198a54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca929e28 00007f9cce364581 00007f9cce363d58 00007f9cce3689f1 00007f9cce3689a9 00007f9cce368939 00007f9cce368901 00007f9cce367b2d 0000000000388634 0000000000388479
0709 12:12:41.098108 (+149464us) op_driver.cc:464] REPLICATION: finished
0709 12:12:41.390857 (+292749us) write_op.cc:301] APPLY: starting
0709 12:12:41.390949 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:41.554365 (+163416us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:41.554408 (+    43us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:42.033611 (+479203us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:42.034052 (+   441us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 12:12:42.034145 (+    93us) write_op.cc:312] APPLY: finished
0709 12:12:42.034678 (+   533us) log.cc:844] Serialized 121 byte log entry
0709 12:12:43.018426 (+983748us) spinlock_profiling.cc:243] Waited 8.05 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cc78240ac 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc7840c02 00007f9cca4c820b
0709 12:12:43.174661 (+156235us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:43.180247 (+  5586us) write_op.cc:454] Released schema lock
0709 12:12:43.180389 (+   142us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:43.210458 (+ 30069us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:43.210498 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4039993,"reported_tablets":41,"spinlock_wait_cycles":2432,"child_traces":[["op",{"apply.queue_time_us":262977,"apply.run_cpu_time_us":40680,"apply.run_wall_time_us":1819447,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58467,"num_ops":13,"prepare.queue_time_us":13927,"prepare.run_cpu_time_us":32053,"prepare.run_wall_time_us":807326,"raft.queue_time_us":284221,"raft.run_cpu_time_us":13584,"raft.run_wall_time_us":305567,"replication_time_us":607521,"spinlock_wait_cycles":23252096,"thread_start_us":1676683,"threads_started":5,"wal-append.queue_time_us":1158580,"wal-append.run_cpu_time_us":67492,"wal-append.run_wall_time_us":2275035}]]}
I20260709 12:12:45.202601 29497 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:45.216143 29563 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:45.219457 29769 log.cc:927] Time spent T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 12:12:45.220202 29755 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:45.208380 29747 raft_consensus.cc:2749] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:45.163654 29556 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:45.239612 29556 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:12:45.240469 29775 log.cc:927] Time spent T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:12:45.139261 29748 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:45.243985 29748 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:45.151928 29749 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:45.246202 29749 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:45.236361 29745 log.cc:927] Time spent T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.506s	user 0.003s	sys 0.000s
I20260709 12:12:45.213126 29431 raft_consensus.cc:740] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:45.249229 29431 consensus_queue.cc:260] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:45.250669 29431 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:45.168938 29742 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:45.212915 29728 raft_consensus.cc:2749] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:45.253266 29624 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:45.253824 29563 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:45.254308 23087 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:45.255002 29755 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:45.255458 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:45.255811 22597 raft_consensus.cc:2393] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 18: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:45.257122 29639 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:45.199676 29764 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:45.252081 29753 raft_consensus.cc:2804] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:45.276239 29603 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:45.277174 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 47037.6us
I20260709 12:12:45.277845 23087 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:45.278556 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:45.280580 29755 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:45.281241 29755 raft_consensus.cc:2804] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:12:45.282908 29720 consensus_meta.cc:287] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.658s	user 0.009s	sys 0.003s
I20260709 12:12:45.283607 29742 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:45.283363 29720 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:45.267978 29731 consensus_meta.cc:287] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.547s	user 0.009s	sys 0.002s
I20260709 12:12:45.294020 29753 raft_consensus.cc:697] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 17 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
W20260709 12:12:45.298008 29663 consensus_meta.cc:287] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc: Time spent flushing consensus metadata: real 0.661s	user 0.011s	sys 0.000s
I20260709 12:12:45.313922 29663 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:45.314224 29753 consensus_queue.cc:237] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:45.316507 29663 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:45.303294 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:45.317788 23121 raft_consensus.cc:2410] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:12:45.304045 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:45.281781 29755 raft_consensus.cc:697] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 19 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:45.312773 29720 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 27 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:45.284420 29728 raft_consensus.cc:2804] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:45.332825 29728 raft_consensus.cc:697] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 15 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:45.334111 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:45.335951 22452 raft_consensus.cc:1275] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 12:12:45.336491 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:45.337906 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:12:45.321534 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 166171us
W20260709 12:12:45.338948 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 336281us
I20260709 12:12:45.340085 29535 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.340538 29535 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:45.342458 29535 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:45.343700 29489 consensus_queue.cc:1048] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:45.332820 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:45.345417 29516 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:45.345310 29489 consensus_queue.cc:1048] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:12:45.345908 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:45.346271 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:45.345960 29516 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:45.330332 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:45.347057 22600 raft_consensus.cc:2410] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 17 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:12:45.347391 22449 raft_consensus.cc:2393] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 15: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:45.347888 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:45.348431 22599 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:45.349196 22449 raft_consensus.cc:1240] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 27 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 26. Current term is 27. Ops: [26.17-26.17]
W20260709 12:12:45.349341 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 331232us
I20260709 12:12:45.350639 22496 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:45.350744 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:45.351346 22454 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:45.351778 29772 raft_consensus.cc:2749] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:45.351928 22496 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:45.325652 22605 raft_consensus.cc:2468] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 17.
I20260709 12:12:45.344743 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:45.357090 23087 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:45.358572 23087 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:45.359304 29497 consensus_queue.cc:1048] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:12:45.359865 29722 raft_consensus.cc:2749] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:45.362920 23088 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:45.363926 23088 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:45.328262 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:45.365361 22453 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 17.
I20260709 12:12:45.333811 29728 consensus_queue.cc:237] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:45.366580 22347 catalog_manager.cc:5697] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 14 to 20. New cstate: current_term: 20 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:45.370039 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:45.370442 22599 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 19.
I20260709 12:12:45.376309 22454 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 19.
I20260709 12:12:45.376624 23117 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 20.
I20260709 12:12:45.376597 23089 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:45.361284 29673 raft_consensus.cc:2749] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:12:45.379478 22569 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:45.382759 23089 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:45.378705 29497 consensus_queue.cc:1048] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.010s
I20260709 12:12:45.389289 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:45.390136 29497 raft_consensus.cc:2749] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:45.392105 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:45.392706 22599 raft_consensus.cc:2368] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 19. Current term is 20.
I20260709 12:12:45.376034 29639 raft_consensus.cc:2804] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:45.395943 23087 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:45.399478 22347 catalog_manager.cc:5697] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:45.400975 22347 catalog_manager.cc:5697] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 10 to 17, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 17 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:12:45.402236 22347 catalog_manager.cc:5697] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 15 to 20. New cstate: current_term: 20 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:45.402596 29753 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.403651 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:45.403407 29753 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:45.376781 29676 raft_consensus.cc:2804] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:45.408272 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:45.408998 22599 raft_consensus.cc:2393] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 18: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:45.411511 22347 catalog_manager.cc:5697] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 9 to 14, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 14 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:45.413327 22347 catalog_manager.cc:5697] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 11 to 14, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 14 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:45.349220 29645 consensus_queue.cc:1048] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
I20260709 12:12:45.385017 29722 raft_consensus.cc:2749] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:45.408094 29676 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:45.437543 29676 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:45.418215 29792 raft_consensus.cc:2804] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:45.420527 22452 raft_consensus.cc:1275] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
I20260709 12:12:45.433272 29753 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:45.443323 29792 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:45.454685 29792 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:45.475113 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 79230.3us
I20260709 12:12:45.410908 29563 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.476451 29729 raft_consensus.cc:2804] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:12:45.560029 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 192870us
I20260709 12:12:45.405673 29783 raft_consensus.cc:2749] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:45.561864 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:45.555585 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:45.562436 22602 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:45.562866 22448 raft_consensus.cc:2410] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for term 15 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
W20260709 12:12:45.563321 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 201094us
W20260709 12:12:45.552551 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 144933us
W20260709 12:12:45.556202 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 139838us
W20260709 12:12:45.557734 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:45.557766 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 200532us
W20260709 12:12:45.555400 29746 log.cc:927] Time spent T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.110s	user 0.000s	sys 0.023s
I20260709 12:12:45.295804 29764 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:45.557351 29743 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.560415 29729 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:45.591464 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:45.574941 22569 leader_election.cc:400] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 election: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 20. Current term is 21.
I20260709 12:12:45.592207 22569 leader_election.cc:403] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 12:12:45.576377 22497 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:45.581301 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:45.582774 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:45.583482 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:45.586930 22532 raft_consensus.cc:1275] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:12:45.595306 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:45.608376 29447 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:45.608980 29447 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:45.589128 23119 raft_consensus.cc:1275] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 23 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
I20260709 12:12:45.589635 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:45.612910 22529 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:45.615439 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:45.624395 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:45.627478 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:45.627966 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:12:45.630084 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 57802.6us
I20260709 12:12:45.631011 22527 raft_consensus.cc:2468] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 18.
W20260709 12:12:45.632319 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 56064.4us
I20260709 12:12:45.632985 22497 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:45.639128 22603 raft_consensus.cc:2393] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 21: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:45.646602 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:45.568270 29516 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:45.659525 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:45.649600 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:45.653262 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:45.647526 22531 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 14.
I20260709 12:12:45.612764 29729 raft_consensus.cc:3060] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:45.561806 29673 consensus_queue.cc:1059] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.079s
W20260709 12:12:45.684598 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 53149.5us
I20260709 12:12:45.564419 29556 consensus_queue.cc:1059] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.077s
I20260709 12:12:45.686575 22602 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 21.
I20260709 12:12:45.671135 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:45.566088 29563 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:45.703653 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:45.704142 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:45.704504 22524 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 16.
I20260709 12:12:45.704982 22527 raft_consensus.cc:2410] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:12:45.647002 29224 raft_consensus.cc:2749] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:45.647158 29635 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:45.708742 22529 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 21.
W20260709 12:12:45.709745 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 327030us
I20260709 12:12:45.664486 29772 raft_consensus.cc:2804] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:45.722090 22422 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:45.704646 22421 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:45.721827 23089 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:45.564240 29755 consensus_queue.cc:237] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:45.697860 29455 raft_consensus.cc:2749] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 20. Current term is 21.
I20260709 12:12:45.698441 29447 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:45.710158 29639 raft_consensus.cc:697] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 17 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:45.764572 23089 leader_election.cc:400] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 19. Current term is 20.
W20260709 12:12:45.764705 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 65472.5us
W20260709 12:12:45.768625 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 55680.2us
I20260709 12:12:45.778427 22570 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:45.763587 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:45.778427 23089 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:45.779503 29731 raft_consensus.cc:2749] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:45.780011 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:45.780174 29731 raft_consensus.cc:2749] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:45.780776 22524 raft_consensus.cc:2393] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 22: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:45.614274 29743 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:45.684092 29742 consensus_queue.cc:1059] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.074s
I20260709 12:12:45.807660 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:45.808480 29742 raft_consensus.cc:3055] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:45.808859 29742 raft_consensus.cc:740] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
W20260709 12:12:45.810135 29431 consensus_meta.cc:287] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.543s	user 0.007s	sys 0.000s
I20260709 12:12:45.810312 29563 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:45.809873 29742 consensus_queue.cc:260] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:45.810738 23122 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 22.
I20260709 12:12:45.730834 29792 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:45.821895 29792 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317)
W20260709 12:12:45.823704 29791 log.cc:927] Time spent T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:12:45.825075 29767 consensus_queue.cc:1059] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.104s
I20260709 12:12:45.826700 29639 consensus_queue.cc:237] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:45.818076 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:45.829002 22524 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:45.829496 29768 consensus_queue.cc:1048] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.239s
I20260709 12:12:45.830276 29412 consensus_queue.cc:1048] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:12:45.831496 29759 log.cc:927] Time spent T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.517s	user 0.005s	sys 0.007s
W20260709 12:12:45.833217 29793 log.cc:927] Time spent T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.276s	user 0.001s	sys 0.000s
I20260709 12:12:45.838514 29764 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:45.767599 29772 raft_consensus.cc:697] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:45.840039 29772 consensus_queue.cc:237] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:45.787326 29505 raft_consensus.cc:2749] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:45.783504 22570 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:45.844820 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 61429.4us
I20260709 12:12:45.845734 22570 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:45.723831 29672 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:45.789064 22422 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:12:45.776122 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 71537.5us
I20260709 12:12:45.755903 29294 consensus_queue.cc:1048] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:12:45.731859 29635 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:45.865501 22605 raft_consensus.cc:1275] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:45.874177 22496 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:12:45.875041 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 86082.4us
I20260709 12:12:45.876063 22422 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:45.786798 29447 raft_consensus.cc:2749] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:45.887888 22495 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:45.866926 29505 raft_consensus.cc:2804] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:45.904359 22524 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 20.
I20260709 12:12:45.908226 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:45.908488 22570 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:45.910190 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:45.910917 22524 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 20.
I20260709 12:12:45.912271 22570 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:45.885998 29563 raft_consensus.cc:2804] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:45.880088 29603 raft_consensus.cc:2749] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:12:45.891206 29313 raft_consensus.cc:2804] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:45.882263 29764 raft_consensus.cc:2749] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:45.886399 29535 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:45.925437 29676 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:45.907274 29505 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:45.927227 23120 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:45.927407 29505 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:45.930023 29676 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:45.868427 29672 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:45.949448 29752 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.950352 22531 raft_consensus.cc:1275] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 13. (term mismatch)
I20260709 12:12:45.948798 29798 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:45.946400 29663 raft_consensus.cc:2804] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:45.953624 22531 pending_rounds.cc:85] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting all ops after (but not including) 12
I20260709 12:12:45.886171 29768 consensus_queue.cc:1048] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.036s
I20260709 12:12:45.969990 29663 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:45.968046 22531 pending_rounds.cc:107] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 12:12:45.976856 22531 raft_consensus.cc:2889] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:45.953815 23120 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 20.
I20260709 12:12:46.002947 29619 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.003634 29619 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:45.957494 29783 raft_consensus.cc:2804] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:46.023355 22523 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 21.
I20260709 12:12:45.967131 29735 raft_consensus.cc:2749] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:46.031656 29672 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:46.036332 29635 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:45.969322 29799 raft_consensus.cc:2749] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:45.980692 29663 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:46.053175 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:46.053954 23089 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:46.075457 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:46.078455 22451 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:46.076926 22448 raft_consensus.cc:1275] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:12:46.086319 22451 raft_consensus.cc:2468] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 18.
I20260709 12:12:46.026446 29616 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.969769 29752 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:45.950892 29535 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:46.041329 29771 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:46.042428 29783 raft_consensus.cc:697] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 20 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:46.110498 22421 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:46.117442 29720 raft_consensus.cc:2804] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:46.092796 29729 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:46.170634 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:46.026571 29798 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:46.105468 29616 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:46.228892 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 316681us
I20260709 12:12:46.233354 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:46.131300 29743 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:46.233950 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 360760us
W20260709 12:12:46.235419 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 156155us
I20260709 12:12:46.236975 23117 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 19: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:46.127189 29505 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:46.220784 29728 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:46.238257 23088 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:46.112437 29771 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:46.224103 29720 raft_consensus.cc:697] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 21 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:46.227736 29563 raft_consensus.cc:697] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
W20260709 12:12:46.243237 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 155431us
I20260709 12:12:46.248050 29720 consensus_queue.cc:237] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:46.248534 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:46.230320 29313 raft_consensus.cc:697] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
W20260709 12:12:46.251541 29805 log.cc:927] Time spent T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
W20260709 12:12:46.252435 29803 log.cc:927] Time spent T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
W20260709 12:12:46.253196 29804 log.cc:927] Time spent T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
I20260709 12:12:46.253894 29639 consensus_queue.cc:1048] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:46.256824 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:46.257481 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:46.256728 29802 log.cc:927] Time spent T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.289s	user 0.000s	sys 0.001s
I20260709 12:12:46.276345 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:46.293184 29798 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:46.293879 29798 consensus_queue.cc:1048] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:46.283560 29815 consensus_queue.cc:1048] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 12:12:46.273865 29728 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:46.313481 29505 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:46.318701 29771 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:46.319427 29752 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:46.257014 29783 consensus_queue.cc:237] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:46.319975 29807 log.cc:927] Time spent T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:12:46.289567 29792 raft_consensus.cc:2804] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:12:46.324110 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 74656.8us
I20260709 12:12:46.307801 29412 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:46.370131 22452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51836 (request call id 2650) took 1041 ms. Trace:
I20260709 12:12:46.372370 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:46.375896 29619 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:46.376142 29313 consensus_queue.cc:237] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:46.378161 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:46.405432 22532 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 20.
I20260709 12:12:46.385190 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:46.389918 29813 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.390044 29743 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:46.390864 22497 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:46.353556 29728 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:46.413810 29728 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:46.326143 29812 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:46.414673 29812 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:46.417058 22531 raft_consensus.cc:1275] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:12:46.417529 29812 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:46.403333 29412 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:46.420498 29813 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:46.421651 29412 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:46.422482 29810 raft_consensus.cc:493] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.423170 29810 raft_consensus.cc:515] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:46.380672 22452 rpcz_store.cc:276] 0709 12:12:45.328994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:45.336643 (+  7649us) service_pool.cc:224] Handling call
0709 12:12:45.336943 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:45.438942 (+101999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:46.369883 (+930941us) spinlock_profiling.cc:243] Waited 83.3 ms on lock 0x7b540037b254. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:46.370069 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":191500032}
I20260709 12:12:46.410856 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:46.435628 22532 raft_consensus.cc:2368] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 19. Current term is 20.
I20260709 12:12:46.436980 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:46.418637 22531 raft_consensus.cc:3055] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:46.440357 22531 raft_consensus.cc:740] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
W20260709 12:12:46.443996 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 53213.4us
I20260709 12:12:46.445272 22497 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:46.445986 23088 leader_election.cc:400] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 election: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 19. Current term is 20.
I20260709 12:12:46.446434 23088 leader_election.cc:403] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:12:46.441344 22531 consensus_queue.cc:260] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:46.451407 22531 raft_consensus.cc:3060] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:46.454600 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:46.398406 29792 raft_consensus.cc:697] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 18 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:46.457703 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:46.459800 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:46.466035 22597 pending_rounds.cc:85] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting all ops after (but not including) 13
I20260709 12:12:46.466379 22597 pending_rounds.cc:107] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting uncommitted NO_OP operation due to leader change: 21.14
I20260709 12:12:46.466634 22597 raft_consensus.cc:2889] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:46.449103 29412 raft_consensus.cc:2749] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:46.449668 29813 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:46.486434 29810 leader_election.cc:290] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:46.357425 29563 consensus_queue.cc:237] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:46.442405 29743 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:46.472731 29815 raft_consensus.cc:2749] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 19. Current term is 20.
I20260709 12:12:46.488130 29818 raft_consensus.cc:2749] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:46.510221 29808 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:46.511859 29808 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:46.511978 29663 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:46.513098 22601 raft_consensus.cc:1275] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:46.515848 29663 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:46.517369 29743 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:46.524346 29792 consensus_queue.cc:237] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:46.529554 22530 raft_consensus.cc:1275] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:12:46.542368 23122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57328 (request call id 1814) took 1216 ms. Trace:
I20260709 12:12:46.542892 23120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57328 (request call id 1816) took 1156 ms. Trace:
I20260709 12:12:46.547909 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:46.549523 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:46.545084 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:46.555233 23120 rpcz_store.cc:276] 0709 12:12:45.386263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:45.386392 (+   129us) service_pool.cc:224] Handling call
0709 12:12:46.542749 (+1156357us) spinlock_profiling.cc:243] Waited 537 ms on lock 0x7b540074fc54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:46.542842 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1235796736}
I20260709 12:12:46.557461 22605 raft_consensus.cc:1240] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:46.557857 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:46.553970 23122 rpcz_store.cc:276] 0709 12:12:45.326150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:45.326321 (+   171us) service_pool.cc:224] Handling call
0709 12:12:46.542175 (+1215854us) spinlock_profiling.cc:243] Waited 472 ms on lock 0x7b540055f854. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca9322fa 00007f9ccf8f3b17 00007f9cc8e6e6d4 00007f9cc8e6e662 00007f9cc8e6e591 00007f9cc8e6e50c 00007f9cc8e6d7c2 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:46.542277 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1085983616}
I20260709 12:12:46.526805 29750 raft_consensus.cc:3055] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:12:46.566867 22495 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:46.570123 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:46.570353 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:46.572434 22448 raft_consensus.cc:1240] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 12:12:46.544343 22531 raft_consensus.cc:1275] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 12:12:46.574199 22454 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 19.
I20260709 12:12:46.574432 22531 pending_rounds.cc:85] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting all ops after (but not including) 11
I20260709 12:12:46.574882 22531 pending_rounds.cc:107] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 12:12:46.576005 22453 raft_consensus.cc:1275] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:46.530915 29742 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:46.581579 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:46.583127 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 19 index: 18 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:46.583562 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:46.585410 22451 raft_consensus.cc:1275] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:12:46.556762 29731 consensus_queue.cc:1048] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 12:12:46.559157 29808 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:46.582412 22455 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 21.
I20260709 12:12:46.598026 22570 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:46.599298 22531 raft_consensus.cc:2889] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:46.573774 29750 raft_consensus.cc:740] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:46.543008 29821 consensus_queue.cc:1048] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 12:12:46.605141 29798 consensus_queue.cc:1048] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 12:12:46.605521 22495 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:46.608892 29535 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:46.581671 29767 raft_consensus.cc:2749] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:46.575556 29603 consensus_queue.cc:1059] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:12:46.600561 29812 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:46.604844 29783 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:46.626475 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:46.624043 22495 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:46.627351 29783 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:46.687430 29783 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:46.690536 23117 raft_consensus.cc:1275] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:12:46.690740 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:46.601704 29749 consensus_queue.cc:1048] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.022s
I20260709 12:12:46.619169 29224 raft_consensus.cc:2804] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:46.698233 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:46.623067 29811 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:12:46.711570 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 87646.6us
I20260709 12:12:46.709374 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:46.688812 29718 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:46.718358 22525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 2532) took 1076 ms. Trace:
I20260709 12:12:46.694690 29224 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:46.725291 22495 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:46.727440 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:46.736061 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:46.701508 29447 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.741153 29771 raft_consensus.cc:3055] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:46.745196 29501 raft_consensus.cc:2749] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:12:46.685179 29812 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:46.748593 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:46.722298 22525 rpcz_store.cc:276] 0709 12:12:45.642117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:45.642246 (+   129us) service_pool.cc:224] Handling call
0709 12:12:45.672165 (+ 29919us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:45.880352 (+208187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:45.880383 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:45.892742 (+ 12359us) log.cc:844] Serialized 52 byte log entry
0709 12:12:46.118667 (+225925us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:46.224445 (+105778us) log.cc:844] Serialized 14 byte log entry
0709 12:12:46.224716 (+   271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:46.704987 (+480271us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b5400181854. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:46.705059 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:46.705135 (+    76us) raft_consensus.cc:1685] finished
0709 12:12:46.714636 (+  9501us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:46.718277 (+  3641us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12064,"prepare.queue_time_us":102806,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":14517,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":16321,"spinlock_wait_cycles":449305472,"thread_start_us":162584,"threads_started":1,"wal-append.queue_time_us":604255}
I20260709 12:12:46.751629 22495 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:46.759768 29821 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:46.760155 29821 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:46.760555 29821 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:46.724210 29535 raft_consensus.cc:2749] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:46.753705 29771 raft_consensus.cc:740] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:46.766235 29771 consensus_queue.cc:260] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:46.767448 29771 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:46.769266 22523 raft_consensus.cc:1275] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:12:46.735805 29224 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:46.713578 29811 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:46.788360 29810 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.693440 29750 consensus_queue.cc:260] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:46.788926 29810 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:46.790113 29811 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:46.791059 29810 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:46.792299 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:46.794824 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:46.795226 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:46.796417 22453 raft_consensus.cc:2393] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 19: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:46.796586 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:46.764464 29834 log.cc:927] Time spent T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.068s	user 0.000s	sys 0.002s
W20260709 12:12:46.764919 29837 log.cc:927] Time spent T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:12:46.798899 23087 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:46.806936 29731 raft_consensus.cc:2804] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:46.731356 29718 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:46.807421 23116 raft_consensus.cc:1275] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:12:46.809542 29718 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:46.810155 23121 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 19.
I20260709 12:12:46.811272 29729 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:46.824720 22454 raft_consensus.cc:1275] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:46.825217 23087 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:46.726263 29801 consensus_queue.cc:1048] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 12:12:46.797864 29750 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:12:46.757026 29820 consensus_queue.cc:1048] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.071s
I20260709 12:12:46.764741 29447 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:46.873461 29808 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:46.844833 29814 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:46.873761 29735 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.873231 29811 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:46.881342 29821 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:46.828190 29731 raft_consensus.cc:697] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 18 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:46.834887 29431 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:46.904461 29821 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 23 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:46.905077 29812 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:46.842236 29810 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:46.906008 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:46.906594 29810 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:46.908986 29810 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:46.909364 29838 log.cc:927] Time spent T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 12:12:46.911633 29731 consensus_queue.cc:237] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:46.901619 29823 consensus_queue.cc:1048] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
W20260709 12:12:46.896543 29837 log.cc:927] Time spent T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:12:46.930778 29616 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:46.931799 22604 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 22.
I20260709 12:12:46.936815 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:46.937687 22604 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 20.
I20260709 12:12:46.940611 22497 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:46.942301 29767 raft_consensus.cc:2804] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:46.942833 29767 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:46.943378 29767 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:46.894027 29749 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:46.952136 29749 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:46.954162 22526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56942 (request call id 2531) took 1312 ms. Trace:
I20260709 12:12:46.900544 29811 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:46.978091 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.983891 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62319c9e82134e7daf8a46f78c124bff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:46.900326 29735 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:46.898746 29814 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:46.898893 29808 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:46.970695 29783 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:47.204876 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:47.127256 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 367121us
W20260709 12:12:47.129868 22524 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.017s	sys 0.026s
I20260709 12:12:46.883558 29563 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:46.956826 22526 rpcz_store.cc:276] 0709 12:12:45.641492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:45.641620 (+   128us) service_pool.cc:224] Handling call
0709 12:12:45.647473 (+  5853us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:45.900359 (+252886us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:45.900405 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:45.900462 (+    57us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:12:45.900508 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:46.950798 (+1050290us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b5400262354. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:46.950849 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:46.950980 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":581080960}
I20260709 12:12:47.159746 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:47.183399 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:12:47.132217 29673 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 12:12:47.156051 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:12:47.187832 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:47.205755 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:47.182437 29770 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:47.241221 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:47.206590 22524 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.018s	sys 0.026s
I20260709 12:12:47.212142 22570 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:47.205811 22527 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
I20260709 12:12:47.255762 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:47.256474 23124 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 15.
I20260709 12:12:47.191502 29747 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.261662 22528 raft_consensus.cc:1275] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:12:47.264564 22524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56940 (request call id 2800) took 1142 ms. Trace:
I20260709 12:12:47.268859 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:47.277056 23116 raft_consensus.cc:1275] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:47.278088 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 19 index: 18 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:47.265187 22524 rpcz_store.cc:276] 0709 12:12:46.122404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:46.379262 (+256858us) service_pool.cc:224] Handling call
0709 12:12:46.379558 (+   296us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:46.387054 (+  7496us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:46.387089 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:46.387707 (+   618us) log.cc:844] Serialized 52 byte log entry
0709 12:12:46.576597 (+188890us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:47.243087 (+666490us) log.cc:844] Serialized 14 byte log entry
0709 12:12:47.264103 (+ 21016us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:47.264216 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:47.264295 (+    79us) raft_consensus.cc:1685] finished
0709 12:12:47.264316 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:47.264486 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27610,"prepare.queue_time_us":117925,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":8903,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"thread_start_us":808835,"threads_started":2,"wal-append.queue_time_us":225400}
I20260709 12:12:47.220765 29730 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:47.222517 29810 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:47.234740 29753 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.299628 29753 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:47.259860 29497 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:47.301200 29497 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:47.301846 29753 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:47.254541 29624 raft_consensus.cc:493] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:47.234835 29224 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:47.304454 29224 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:47.287089 29674 raft_consensus.cc:493] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.272828 29747 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:47.305229 29674 raft_consensus.cc:515] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:47.305783 29857 log.cc:927] Time spent T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:12:47.278144 29812 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.269711 29524 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:47.243429 29584 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:47.307089 29812 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:47.307312 29524 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:47.307730 29584 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:47.261428 29770 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:47.299381 29810 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:47.289693 29767 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:47.283789 29818 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.299357 29730 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:47.286476 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:12:47.316845 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 77171.6us
I20260709 12:12:47.319370 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:47.302562 29624 raft_consensus.cc:515] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:47.346419 23123 raft_consensus.cc:1275] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
W20260709 12:12:47.337144 29834 log.cc:927] Time spent T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:12:47.234683 29563 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:47.315172 29749 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:47.319909 29781 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:47.372879 29624 leader_election.cc:290] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:47.373510 29619 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:47.374246 29750 raft_consensus.cc:2804] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:47.374677 29855 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:47.374775 29535 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:47.405191 29855 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:47.405817 29849 log.cc:927] Time spent T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:12:47.407680 29855 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:47.408038 29770 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:47.410498 29735 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:47.379105 29495 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:47.393800 22532 raft_consensus.cc:1240] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:47.411254 29495 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:47.411971 29747 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:47.412954 29811 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:47.414127 29810 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:47.415292 29619 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:47.416165 29808 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:47.417335 29783 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:47.417560 29497 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:47.417725 29619 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:47.419477 29563 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:47.419976 29447 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:47.421625 29730 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:47.387270 29820 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:47.423769 22496 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:47.402130 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:47.403333 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:47.404440 22529 raft_consensus.cc:1275] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:47.405277 29535 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:47.377492 29856 log.cc:927] Time spent T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:12:47.436312 22527 raft_consensus.cc:1240] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:47.347379 29818 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:47.422952 29750 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:47.451798 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 254231us
I20260709 12:12:47.450783 22496 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:47.455693 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:47.456413 22455 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:47.467669 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:47.452814 29750 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:47.469732 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:47.470386 22450 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Advancing to term 23
I20260709 12:12:47.470485 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:47.474094 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:47.392979 29781 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:47.478052 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 24 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:47.445183 29731 consensus_queue.cc:1059] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 12:12:47.452870 29855 raft_consensus.cc:2749] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:47.445214 29431 consensus_queue.cc:1048] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 12:12:47.479245 22602 raft_consensus.cc:1275] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:12:47.490072 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:47.432004 29645 consensus_queue.cc:1048] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 12:12:47.492957 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:47.493752 23116 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 19.
I20260709 12:12:47.494676 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:47.496131 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:47.496956 23123 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 14.
I20260709 12:12:47.491870 23122 raft_consensus.cc:1275] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:12:47.473860 29778 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:47.475867 29801 raft_consensus.cc:2749] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:47.505326 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:47.506093 22527 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 14.
I20260709 12:12:47.473824 29767 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:47.500785 22604 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:47.501422 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:47.429840 29820 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:47.506418 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:47.507491 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:47.508181 22527 raft_consensus.cc:1275] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:12:47.512145 22453 raft_consensus.cc:1275] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:12:47.513087 29820 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:47.516958 29818 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:47.483364 29797 consensus_queue.cc:1059] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.088s
I20260709 12:12:47.519922 29797 raft_consensus.cc:3055] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:47.520254 29814 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:47.521903 29778 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:47.523381 29524 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:47.534230 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:47.534591 29535 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:47.535390 22606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45576 (request call id 3685) took 2173 ms. Trace:
I20260709 12:12:47.536659 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:47.535863 22606 rpcz_store.cc:276] 0709 12:12:45.362372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:45.363125 (+   753us) service_pool.cc:224] Handling call
0709 12:12:45.383303 (+ 20178us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:45.410104 (+ 26801us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:45.410136 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:45.427582 (+ 17446us) log.cc:844] Serialized 52 byte log entry
0709 12:12:46.926584 (+1499002us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b180047e840. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc7823e07 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc7840c02 00007f9cca4c820b 00007f9cca4cdd23 00007f9cca4ce0d1 00007f9cca8e9a0f
0709 12:12:47.337684 (+411100us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:47.337753 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:47.337858 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:47.535054 (+197196us) raft_consensus.cc:1685] finished
0709 12:12:47.535077 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:47.535306 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":121241,"raft.queue_time_us":21847,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":7562,"spinlock_wait_cycles":36329216,"thread_start_us":410860,"threads_started":1,"wal-append.queue_time_us":2024375}
I20260709 12:12:47.538538 22527 raft_consensus.cc:1275] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:12:47.544948 22453 raft_consensus.cc:1240] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 27 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 26. Current term is 27. Ops: [26.17-26.17]
I20260709 12:12:47.545890 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:47.539862 22602 raft_consensus.cc:1275] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:12:47.549194 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:47.480744 29673 consensus_queue.cc:1048] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.057s
I20260709 12:12:47.545984 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:47.546554 22450 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 23.
I20260709 12:12:47.562955 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fd922979743428612619e8de33af1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:47.565137 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:47.530802 22454 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 17.
I20260709 12:12:47.552350 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:47.568684 22532 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 20.
I20260709 12:12:47.573320 22532 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:46680
I20260709 12:12:47.574000 22532 raft_consensus.cc:606] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:12:47.574389 22532 raft_consensus.cc:614] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:47.575531 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:47.520275 29797 raft_consensus.cc:740] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:47.580978 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:47.582324 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:47.588691 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 24 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:47.590690 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:47.592003 22456 raft_consensus.cc:1240] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:47.592578 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 23 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:47.593365 23119 raft_consensus.cc:2410] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 23 because replica has last-logged OpId of term: 21 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 17.
I20260709 12:12:47.602341 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:47.601787 22495 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:47.595963 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:47.607978 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:47.609829 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:12:47.612236 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 400151us
I20260709 12:12:47.622720 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:47.608490 22496 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:47.644183 29635 raft_consensus.cc:2749] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:47.656909 22570 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:47.607775 29818 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:47.659415 29818 raft_consensus.cc:697] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:47.660482 29818 consensus_queue.cc:237] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:47.661947 29811 raft_consensus.cc:2804] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:47.662539 29811 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:47.663197 29749 consensus_queue.cc:1048] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:47.605731 29778 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:47.666728 29811 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:47.670298 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:47.671619 29764 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:47.641723 29868 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:47.686486 29868 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:47.682958 22598 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 21.
I20260709 12:12:47.676219 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 23 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:47.687945 22606 raft_consensus.cc:2410] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 23 because replica has last-logged OpId of term: 21 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 17.
I20260709 12:12:47.676887 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:47.689011 29868 leader_election.cc:290] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:47.681423 22604 raft_consensus.cc:1275] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
W20260709 12:12:47.681866 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:47.641517 29783 consensus_queue.cc:1048] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:12:47.685722 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:47.682123 22455 raft_consensus.cc:2468] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 20.
I20260709 12:12:47.601706 29765 consensus_queue.cc:1048] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 12:12:47.690611 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:47.692612 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:47.683233 29797 consensus_queue.cc:260] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:47.693727 22525 raft_consensus.cc:2410] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 12:12:47.693989 29797 raft_consensus.cc:3060] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:47.694259 22495 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:12:47.695490 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:47.683008 29764 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:47.696060 22531 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:46680
I20260709 12:12:47.695490 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:47.699805 22531 raft_consensus.cc:606] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:12:47.700270 22531 raft_consensus.cc:614] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:47.698730 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:47.703064 22497 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:47.707623 22525 raft_consensus.cc:2393] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 22: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
W20260709 12:12:47.707836 23089 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.196.131:37785 timed out after 1.654s (SENT) [suppressed 7 similar messages]
I20260709 12:12:47.715207 22497 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:12:47.701951 29800 raft_consensus.cc:2804] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:47.695761 29524 consensus_queue.cc:1048] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.021s
W20260709 12:12:47.725683 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:47.692803 29783 consensus_queue.cc:1048] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:12:47.743196 22497 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
W20260709 12:12:47.747417 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 275314us
I20260709 12:12:47.721597 29767 raft_consensus.cc:2749] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:12:47.798439 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 55377.4us
W20260709 12:12:47.816957 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 119681us
I20260709 12:12:47.819348 22497 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:47.748840 29800 raft_consensus.cc:697] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:47.747093 29635 raft_consensus.cc:2804] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:47.744586 29779 consensus_queue.cc:1048] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.092s
I20260709 12:12:47.821022 29672 raft_consensus.cc:2749] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:47.821296 29447 raft_consensus.cc:493] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:47.744783 29563 consensus_queue.cc:1048] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.092s
I20260709 12:12:47.796149 29868 consensus_queue.cc:1048] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.093s
I20260709 12:12:47.836315 29635 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:47.841967 29224 raft_consensus.cc:2749] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:47.842748 29765 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.751507 29750 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:47.865382 29800 consensus_queue.cc:237] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:47.869467 29781 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:47.876506 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:47.882812 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 174989us
I20260709 12:12:47.864286 29635 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:47.851032 29412 consensus_queue.cc:1048] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.027s
I20260709 12:12:47.907810 22597 raft_consensus.cc:2393] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 21: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:47.862742 29447 raft_consensus.cc:515] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:47.892395 29765 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:47.928342 29584 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:47.972325 29750 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:47.956339 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 270559us
I20260709 12:12:47.979028 22569 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:47.980966 22569 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:47.985502 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:47.993407 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 310719us
I20260709 12:12:47.998091 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:47.998766 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:48.000160 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:48.001161 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:47.989279 29870 raft_consensus.cc:2749] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:12:48.015419 29875 log.cc:927] Time spent T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 12:12:48.016803 29812 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:48.018045 29674 leader_election.cc:290] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:47.992719 29730 consensus_queue.cc:1059] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 17.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.026s
I20260709 12:12:48.019866 29730 raft_consensus.cc:3055] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:48.020244 29730 raft_consensus.cc:740] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:48.027339 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:48.029034 22598 raft_consensus.cc:1275] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:12:48.034624 29447 leader_election.cc:290] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:48.035970 29872 log.cc:927] Time spent T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 12:12:48.036757 29876 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:48.004699 29672 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.038487 29672 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:48.038962 29890 log.cc:927] Time spent T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 12:12:47.993188 29750 raft_consensus.cc:2804] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:48.040172 29750 raft_consensus.cc:697] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:48.040373 22531 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:46680
I20260709 12:12:48.041007 22531 raft_consensus.cc:606] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 LEADER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:12:48.041178 29750 consensus_queue.cc:237] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:48.037446 29876 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:48.052489 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:48.007009 22570 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:48.052670 29779 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:48.060036 22448 raft_consensus.cc:1275] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 18 index: 17. (index mismatch)
I20260709 12:12:48.063313 22453 raft_consensus.cc:1240] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:48.068872 29876 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:48.081552 22421 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:48.086119 22421 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:48.098644 22606 raft_consensus.cc:1275] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 12:12:48.112785 23090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:48.115969 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:48.116976 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:48.085747 29447 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:12:48.119974 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 113056us
I20260709 12:12:48.056762 29779 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:48.124984 23118 raft_consensus.cc:1275] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:12:48.126019 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:48.126291 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:48.127242 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:48.127568 23122 raft_consensus.cc:1240] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 18 LEADER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:48.130240 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:48.108677 29866 raft_consensus.cc:2749] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:48.100591 29604 raft_consensus.cc:2749] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:48.120916 22570 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:48.119096 29663 raft_consensus.cc:2749] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:48.140990 22606 raft_consensus.cc:1275] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 12:12:48.139918 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 136881us
I20260709 12:12:48.144481 23119 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 22.
I20260709 12:12:48.133924 29412 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:12:48.153239 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 48593.5us
I20260709 12:12:48.154013 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:48.123603 29781 consensus_queue.cc:1048] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 12:12:48.142700 29524 raft_consensus.cc:2804] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:48.159251 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:48.128557 29447 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:48.161388 22603 raft_consensus.cc:1240] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:48.163128 22421 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:48.164311 22421 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:48.168391 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:48.169432 22528 raft_consensus.cc:2393] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 21: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:48.169691 22421 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:48.174170 29603 raft_consensus.cc:2804] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:48.174649 29603 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:48.175133 29603 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:48.175545 29811 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:48.177824 29811 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:48.152801 29635 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:48.180100 29604 raft_consensus.cc:2749] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:48.159041 29524 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:48.180857 29635 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:48.181254 29524 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:48.183032 29779 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:48.184057 29603 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:48.156203 29412 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:48.185022 29447 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:48.186221 29603 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:48.186336 29412 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:48.187285 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:48.188560 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:48.195875 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:48.196882 22525 raft_consensus.cc:1240] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:48.197654 22453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:48.198063 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:48.198871 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:48.199222 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:48.199290 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:48.200428 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:48.202817 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:48.207638 22569 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:48.209813 29893 log.cc:927] Time spent T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:12:48.209893 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:48.212865 29811 raft_consensus.cc:2749] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:48.214071 22569 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:48.214915 29811 raft_consensus.cc:2749] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:48.168066 29771 raft_consensus.cc:2749] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:48.227012 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:48.227754 22606 raft_consensus.cc:2468] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 14.
W20260709 12:12:48.262600 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 120611us
W20260709 12:12:48.262810 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:48.260438 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 90818.9us
I20260709 12:12:48.267887 22421 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:48.264312 22497 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:48.253034 29674 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.270879 22421 leader_election.cc:304] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
W20260709 12:12:48.274712 29900 log.cc:927] Time spent T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
W20260709 12:12:48.275588 29850 log.cc:927] Time spent T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 1.082s	user 0.005s	sys 0.000s
I20260709 12:12:48.276074 29764 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:48.278010 29918 raft_consensus.cc:2749] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:48.279090 22530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38310 (request call id 1487) took 1680 ms. Trace:
I20260709 12:12:48.279461 29495 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:48.281311 29797 consensus_meta.cc:287] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270: Time spent flushing consensus metadata: real 0.587s	user 0.013s	sys 0.000s
W20260709 12:12:48.277498 29895 log.cc:927] Time spent T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 12:12:48.272125 29771 raft_consensus.cc:2749] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:48.283154 29447 consensus_queue.cc:1048] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:48.283609 22421 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:48.284595 29447 raft_consensus.cc:2749] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:48.286180 22421 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:48.279479 22530 rpcz_store.cc:276] 0709 12:12:46.598407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:46.598885 (+   478us) service_pool.cc:224] Handling call
0709 12:12:46.604752 (+  5867us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:46.620887 (+ 16135us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:46.620933 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:46.626664 (+  5731us) log.cc:844] Serialized 52 byte log entry
0709 12:12:46.834417 (+207753us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:46.835911 (+  1494us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:46.835995 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:48.263456 (+1427461us) spinlock_profiling.cc:243] Waited 5.98 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:12:48.277039 (+ 13583us) raft_consensus.cc:1685] finished
0709 12:12:48.277072 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:48.279021 (+  1949us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":427,"raft.queue_time_us":11558,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":1287,"spinlock_wait_cycles":13762944,"thread_start_us":118443,"threads_started":1,"wal-append.queue_time_us":196149}
I20260709 12:12:48.287528 22421 leader_election.cc:304] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:48.287864 29447 consensus_queue.cc:1048] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:48.288157 29763 raft_consensus.cc:2749] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:48.288772 29771 raft_consensus.cc:2749] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:48.289417 29447 consensus_queue.cc:1048] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:48.289465 22421 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:48.290555 29918 raft_consensus.cc:2749] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:48.291170 29818 raft_consensus.cc:2749] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:48.291051 22421 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:48.297035 22421 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:48.298623 22421 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:48.272370 29674 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:48.302052 29771 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:48.302660 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:48.303793 29674 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:48.304539 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 19 index: 18 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:48.305404 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:48.305727 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:48.306062 22450 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 27.
I20260709 12:12:48.298074 29603 raft_consensus.cc:2749] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:48.306879 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:48.306357 22529 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 26.
I20260709 12:12:48.308022 22569 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:48.298672 29813 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:48.313197 29813 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:48.300683 29918 raft_consensus.cc:2804] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:48.315282 29918 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:48.315543 29813 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:48.297830 29763 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:48.318172 29763 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:48.312376 29524 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:48.320369 29763 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:48.309289 29771 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.321504 29524 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:48.321442 29771 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:48.315647 29918 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:48.327872 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:48.334196 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:48.339419 29672 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:48.344247 22570 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:48.349741 29764 raft_consensus.cc:2749] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:48.355365 22529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74d6480c61e542d583f6f89899989553"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:46680
I20260709 12:12:48.360522 29771 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:48.323876 29674 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:12:48.361461 29674 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.361814 29674 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:12:48.356071 22529 raft_consensus.cc:606] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Received request to transfer leadership to TS 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:48.369804 22529 raft_consensus.cc:614] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:48.384975 22600 raft_consensus.cc:1240] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:48.389688 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:48.390388 22604 raft_consensus.cc:2468] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 15.
I20260709 12:12:48.391316 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:48.393188 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:48.393576 22422 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:48.407078 29865 consensus_queue.cc:1059] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:12:48.403380 29603 raft_consensus.cc:2804] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:48.416326 29603 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:48.416906 29603 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:48.381343 29918 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:48.437476 22450 raft_consensus.cc:1240] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:48.440321 29918 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:48.449103 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:48.454651 29765 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:48.455574 29674 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:48.458587 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:48.459365 22454 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:12:48.460944 29674 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 28 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:48.464905 29603 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:48.487385 22454 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 28.
I20260709 12:12:48.489629 22569 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:48.491964 29674 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:12:48.510821 22601 raft_consensus.cc:1240] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 12:12:48.530346 29674 raft_consensus.cc:697] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 28 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:48.531497 29742 consensus_queue.cc:1059] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.004s
I20260709 12:12:48.549213 22421 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:48.549938 23089 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:48.552342 23089 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:48.552927 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:48.554340 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b50f0bec71f4924aa1781b9818f1d73" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 19 index: 18 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:48.556165 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:48.560735 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:48.536139 29797 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:48.562307 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:48.574124 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:48.578645 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:48.579787 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:48.582243 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:48.585604 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:48.585687 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:48.586771 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:48.530490 29730 consensus_queue.cc:260] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:48.544070 29828 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:48.589524 23123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:48.556746 29876 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.597803 22421 leader_election.cc:304] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:48.599502 22421 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:48.561393 29866 raft_consensus.cc:2804] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:48.602837 29771 raft_consensus.cc:2749] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:48.608521 29911 raft_consensus.cc:2749] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:48.615542 29927 log.cc:927] Time spent T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 12:12:48.608590 22421 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:48.620378 29749 raft_consensus.cc:3055] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:48.620527 29771 raft_consensus.cc:2749] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:48.620942 29749 raft_consensus.cc:740] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:48.621822 29749 consensus_queue.cc:260] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:48.623139 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 76865us
I20260709 12:12:48.624343 22570 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:48.624955 29763 raft_consensus.cc:3055] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:48.625348 29763 raft_consensus.cc:740] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:48.625571 22570 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:48.626164 29763 consensus_queue.cc:260] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:48.626552 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:48.627240 22526 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 26 FOLLOWER]: Advancing to term 28
I20260709 12:12:48.629602 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:48.630750 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:48.631430 22457 raft_consensus.cc:2368] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 27. Current term is 28.
I20260709 12:12:48.636415 22524 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:46680
I20260709 12:12:48.621840 22421 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:48.637063 22524 raft_consensus.cc:606] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Received request to transfer leadership to TS 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:48.577209 29881 raft_consensus.cc:2749] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:48.637554 22524 raft_consensus.cc:614] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:48.651739 22570 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:48.651904 22421 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:48.641027 22526 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 28.
I20260709 12:12:48.644804 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:48.585181 29792 raft_consensus.cc:2749] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:48.647429 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:48.658010 22455 raft_consensus.cc:2393] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 17: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:48.664117 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:48.586464 29639 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:48.561527 29753 consensus_queue.cc:1048] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 12:12:48.668967 29639 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:48.670862 29603 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:48.671681 29639 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:48.671851 29730 raft_consensus.cc:3060] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:48.672549 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:12:48.674758 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:48.579064 29431 consensus_queue.cc:1048] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.075s
I20260709 12:12:48.656596 29911 raft_consensus.cc:2749] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:48.662449 29865 raft_consensus.cc:2749] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:48.677786 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:48.626176 29868 raft_consensus.cc:2749] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:48.697145 22570 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:48.636639 29866 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:48.695649 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:48.698859 22606 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:48.584069 29797 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:48.706678 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:48.702735 22497 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
W20260709 12:12:48.702433 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 44811.3us
I20260709 12:12:48.662145 29749 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:48.708539 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:48.703838 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:48.662441 29750 raft_consensus.cc:2749] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:48.713712 22602 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:48.637256 29828 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:48.698426 29811 raft_consensus.cc:2749] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:48.712880 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:48.716485 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:48.660614 29885 consensus_queue.cc:1048] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 12:12:48.700848 29866 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:48.725155 23124 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 20.
W20260709 12:12:48.731808 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 169711us
I20260709 12:12:48.650269 29876 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:48.707422 29535 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:48.757757 23089 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:48.762099 22606 raft_consensus.cc:2468] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 16.
I20260709 12:12:48.764590 23119 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 18.
I20260709 12:12:48.657812 29674 consensus_queue.cc:237] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.17, Last appended by leader: 17, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:48.713143 29753 consensus_queue.cc:1059] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.043s
I20260709 12:12:48.737579 29313 raft_consensus.cc:2749] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 12:12:48.791498 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 94430us
I20260709 12:12:48.793031 22602 raft_consensus.cc:1275] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
W20260709 12:12:48.779975 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 245748us
I20260709 12:12:48.783438 23089 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:48.785471 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 47057.4us
I20260709 12:12:48.793706 22570 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:48.816454 22570 leader_election.cc:304] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:48.763880 29873 raft_consensus.cc:2749] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:48.820115 22456 raft_consensus.cc:1275] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:48.827906 29763 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:48.837077 29936 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:48.837888 29936 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:48.841609 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 45840.1us
W20260709 12:12:48.841920 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 58561.6us
I20260709 12:12:48.842114 29431 raft_consensus.cc:2749] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:48.843075 29937 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:48.843590 23089 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:48.797483 29809 raft_consensus.cc:2749] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:12:48.854905 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 59214.9us
I20260709 12:12:48.773589 29639 consensus_queue.cc:1059] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.052s
I20260709 12:12:48.815356 29792 raft_consensus.cc:3055] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:48.756512 29535 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:48.814972 29892 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.872383 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:48.843406 29431 consensus_queue.cc:1048] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.007s
I20260709 12:12:48.840812 29936 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:48.853888 29524 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Leader election won for term 22
W20260709 12:12:48.912796 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 46672.7us
I20260709 12:12:48.914551 22495 leader_election.cc:400] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 27 pre-election: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 27. Current term is 28.
I20260709 12:12:48.870095 29868 raft_consensus.cc:2749] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:48.870674 29792 raft_consensus.cc:740] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:48.848542 29663 consensus_queue.cc:1048] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.056s
I20260709 12:12:48.924405 22422 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:48.914886 22495 leader_election.cc:403] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 27 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:12:48.919595 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 76078.8us
W20260709 12:12:48.915043 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 139179us
I20260709 12:12:48.843590 29937 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:48.930150 22421 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:12:48.921778 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 72097.3us
I20260709 12:12:48.929901 22456 raft_consensus.cc:1240] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:48.930065 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
W20260709 12:12:48.936236 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 119897us
I20260709 12:12:48.916406 29809 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:48.918015 29524 raft_consensus.cc:697] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
W20260709 12:12:48.951484 29932 log.cc:927] Time spent T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.244s	user 0.002s	sys 0.000s
I20260709 12:12:48.934506 29943 raft_consensus.cc:2804] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:48.965359 22603 raft_consensus.cc:1275] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 18 index: 17. (index mismatch)
W20260709 12:12:48.967698 29941 log.cc:927] Time spent T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:12:48.916662 29942 consensus_queue.cc:1048] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 12:12:48.972054 29797 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:48.974078 29535 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:48.973713 29792 consensus_queue.cc:260] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:48.883701 29892 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:48.986953 22570 leader_election.cc:304] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:48.932085 29584 raft_consensus.cc:2749] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 28 FOLLOWER]: Leader pre-election lost for term 27. Reason: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 27. Current term is 28.
I20260709 12:12:48.995118 29563 raft_consensus.cc:2804] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:48.995263 29828 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:48.996904 22599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45562 (request call id 3280) took 1071 ms. Trace:
I20260709 12:12:49.003087 29809 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:49.007874 29524 consensus_queue.cc:237] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:48.951509 29935 log.cc:927] Time spent T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
W20260709 12:12:49.038607 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 95383.8us
W20260709 12:12:49.072650 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 148357us
I20260709 12:12:48.991891 29943 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:49.047143 22526 raft_consensus.cc:1240] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:49.047595 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a2fbce096642eb849b1a143f8e7bb9" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:49.044338 22599 rpcz_store.cc:276] 0709 12:12:47.925751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:47.925950 (+   199us) service_pool.cc:224] Handling call
0709 12:12:47.957199 (+ 31249us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:47.957611 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:47.957645 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:47.964441 (+  6796us) log.cc:844] Serialized 26 byte log entry
0709 12:12:48.445565 (+481124us) spinlock_profiling.cc:243] Waited 7.92 ms on lock 0x7b18003b6fe0. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc7823e07 00007f9cd067e9a9 00007f9cc784069b 00007f9cc783e93f 00007f9cc7840c02 00007f9cca4c820b 00007f9cca4cdd23 00007f9cca4ce0d1 00007f9cca8e9a0f
0709 12:12:48.491221 (+ 45656us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:48.491418 (+   197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:48.492565 (+  1147us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:48.996535 (+503970us) raft_consensus.cc:1685] finished
0709 12:12:48.996564 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:48.996818 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":130,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":4576,"spinlock_wait_cycles":18227456,"thread_start_us":44990,"threads_started":1,"wal-append.queue_time_us":630705}
W20260709 12:12:49.051939 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 65052.6us
I20260709 12:12:49.065286 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:49.083567 22524 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 17.
I20260709 12:12:49.062687 22497 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:48.995258 29604 raft_consensus.cc:2749] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:49.082870 22570 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:49.049657 29792 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:49.108668 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:49.112388 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 49846us
I20260709 12:12:49.113343 22524 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 22.
I20260709 12:12:49.117254 22570 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:49.088251 29563 raft_consensus.cc:697] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 16 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:49.118434 22570 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:49.127810 29563 consensus_queue.cc:237] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:49.131153 29952 raft_consensus.cc:2749] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:49.133420 29809 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:49.134173 29809 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:49.134517 29757 raft_consensus.cc:3055] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:49.135075 29757 raft_consensus.cc:740] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:49.136092 29757 consensus_queue.cc:260] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:49.137490 29757 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:49.119819 29868 raft_consensus.cc:2749] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:49.088425 29942 raft_consensus.cc:2749] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:49.120617 29603 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.111413 29535 raft_consensus.cc:2749] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:49.082113 29828 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:49.142064 29603 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:49.142638 29828 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:49.126260 29949 raft_consensus.cc:2749] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:49.138193 29937 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:49.088191 29943 raft_consensus.cc:3060] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:49.146188 29911 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.146834 29911 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:49.149343 29911 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:49.149505 29937 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:49.150106 29937 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:49.134784 29809 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:49.152876 29937 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:49.145200 29828 leader_election.cc:290] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:49.050143 29497 consensus_queue.cc:1175] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6c6fa11e8ee34711b3551f0c670442bc" responder_term: 21 status { last_received { term: 18 index: 12 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 20. Current term is 21. Ops: [20.13-20.13]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:12:49.161691 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:49.162364 22523 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 16.
I20260709 12:12:49.166886 22497 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:49.162223 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:49.145232 29603 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:49.174520 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 241666us
I20260709 12:12:49.182406 22526 raft_consensus.cc:1240] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 21. Current term is 22. Ops: []
W20260709 12:12:49.189930 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:49.191349 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:49.191788 22456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:49.194479 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:49.200269 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:49.174535 29772 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:49.210320 22597 raft_consensus.cc:1240] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 12:12:49.229830 22421 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:49.230170 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:49.232806 29313 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:49.234052 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:49.252897 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:49.260030 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:49.188830 29224 consensus_queue.cc:1048] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.056s
I20260709 12:12:49.302577 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:49.275265 22448 raft_consensus.cc:2468] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 19.
I20260709 12:12:49.233459 29313 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:49.250684 29809 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:49.253787 29939 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:49.299435 29957 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:49.345628 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:49.340180 29663 raft_consensus.cc:493] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.304965 29954 consensus_queue.cc:1059] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 12:12:49.370230 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:49.341315 29603 raft_consensus.cc:2804] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:49.366279 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:49.366760 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:49.375240 22597 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 23.
I20260709 12:12:49.383785 22456 raft_consensus.cc:1240] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:49.398113 23088 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:49.403175 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:49.335556 29939 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:49.400707 23088 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:49.340543 29957 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:49.393086 29639 raft_consensus.cc:3055] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:49.421125 23088 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:49.405640 29809 raft_consensus.cc:2749] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:49.426849 29965 log.cc:927] Time spent T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:12:49.434651 29772 raft_consensus.cc:2749] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:49.436342 22526 raft_consensus.cc:1275] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 12:12:49.437279 29956 log.cc:927] Time spent T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 12:12:49.440376 29603 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:49.440894 29603 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:49.402563 29866 consensus_meta.cc:287] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f: Time spent flushing consensus metadata: real 0.659s	user 0.012s	sys 0.000s
I20260709 12:12:49.374262 29663 raft_consensus.cc:515] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:49.399474 29584 consensus_queue.cc:1059] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 12:12:49.418056 29639 raft_consensus.cc:740] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
W20260709 12:12:49.449838 29962 log.cc:927] Time spent T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 12:12:49.447414 29940 raft_consensus.cc:2804] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:49.472635 29809 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:49.486712 23088 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:49.491884 23088 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:49.468640 29873 consensus_queue.cc:1048] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:12:49.482581 29772 raft_consensus.cc:3055] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:49.506911 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:49.481643 29940 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:49.494482 29742 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:49.471565 29866 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:49.512076 29749 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:49.512338 29811 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:49.493391 29954 raft_consensus.cc:2749] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:49.487762 29809 raft_consensus.cc:493] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.513324 29828 raft_consensus.cc:2749] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:49.515319 29940 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:49.530510 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:49.513713 29772 raft_consensus.cc:740] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:49.524511 29749 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:49.532429 29957 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:49.534390 29749 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:49.525357 29811 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:49.536422 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:49.536944 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:49.538071 29811 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:49.539124 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:49.539898 22530 raft_consensus.cc:2393] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 22: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:49.541929 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:49.546598 29940 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:49.551931 29972 log.cc:927] Time spent T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:12:49.553429 29866 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:49.527595 29809 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:49.555059 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:49.521198 29742 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:49.558193 29781 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:49.522043 29639 consensus_queue.cc:260] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:49.565696 29939 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:49.566583 29663 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:49.567271 29971 log.cc:927] Time spent T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:12:49.568760 29954 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:49.568775 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:49.570384 29828 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.571192 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:49.572482 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:49.579506 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:49.580770 29943 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:49.582422 29603 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:49.583876 23117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:49.586189 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:49.588254 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:49.589339 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:49.591276 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:49.594102 23120 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 22.
I20260709 12:12:49.592094 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:49.608019 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:49.608412 22598 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 21.
I20260709 12:12:49.597399 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:49.609994 23088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:49.598424 22421 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:49.610297 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:49.601080 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:49.603852 23087 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:49.612347 29939 raft_consensus.cc:2749] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:49.612782 22421 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:49.613680 29447 raft_consensus.cc:2804] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:49.614096 29447 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:49.578820 29876 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:49.619575 29447 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:49.602409 29781 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:49.606415 29828 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:49.669631 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:49.670364 23121 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 20.
I20260709 12:12:49.670482 29828 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:49.606694 29954 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:49.677060 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:49.605288 29772 consensus_queue.cc:260] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:49.638729 23119 raft_consensus.cc:1240] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:49.640398 29603 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:49.687393 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:49.638784 29938 raft_consensus.cc:3055] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:49.642254 29742 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:49.596848 29313 leader_election.cc:290] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:49.643167 29639 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:49.700372 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:49.643836 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:49.619866 29958 raft_consensus.cc:2804] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:49.604471 23089 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:49.655035 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:49.657780 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:49.598887 29885 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:12:49.709019 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 104605us
I20260709 12:12:49.661448 22603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43070 (request call id 1307) took 1475 ms. Trace:
I20260709 12:12:49.676312 23116 raft_consensus.cc:1275] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 14. (term mismatch)
I20260709 12:12:49.711282 23116 pending_rounds.cc:85] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270: Aborting all ops after (but not including) 13
I20260709 12:12:49.678772 22526 raft_consensus.cc:1275] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 28 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 12:12:49.678900 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:49.679852 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aebfd8b04a4461ab6bc979eee23a2bc" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:49.690903 22570 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:49.713155 22570 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:49.695887 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:12:49.697104 23087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:49.703938 29772 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:49.706514 22602 raft_consensus.cc:1240] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:49.711688 23116 pending_rounds.cc:107] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270: Aborting uncommitted NO_OP operation due to leader change: 19.14
I20260709 12:12:49.713794 23089 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:49.720883 23116 raft_consensus.cc:2889] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:49.714962 29885 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:49.717268 29954 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:49.718394 29892 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:49.711191 22603 rpcz_store.cc:276] 0709 12:12:48.186203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:48.205420 (+ 19217us) service_pool.cc:224] Handling call
0709 12:12:48.205779 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:48.992083 (+786304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:49.636019 (+643936us) spinlock_profiling.cc:243] Waited 759 ms on lock 0x7b54002de454. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca92ee01 00007f9cca92d83e 00007f9ccf8f2419 00007f9cc8e69bd4 00007f9cc8e69b62 00007f9cc8e69a91 00007f9cc8e69a0c 00007f9cc8e68cc2 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:49.661369 (+ 25350us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1746079488}
I20260709 12:12:49.727245 23088 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:49.727351 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:49.730727 23089 leader_election.cc:304] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:49.692636 29938 raft_consensus.cc:740] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:49.733973 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:49.735891 22452 raft_consensus.cc:2393] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 16: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:49.738667 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:49.743338 23089 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:49.708729 29958 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:49.744635 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:49.753204 23089 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:49.722095 29730 raft_consensus.cc:2804] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:49.757159 23089 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:49.720090 29313 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:49.761061 23089 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:49.723886 29957 raft_consensus.cc:2749] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:49.735515 29949 consensus_queue.cc:1048] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.024s
I20260709 12:12:49.735860 29828 raft_consensus.cc:2749] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:49.739360 29876 raft_consensus.cc:2749] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:49.753960 29940 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:49.759763 29939 raft_consensus.cc:2749] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:49.759604 29937 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:49.777818 22496 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:49.755771 29731 raft_consensus.cc:2804] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:49.756095 29958 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:49.766300 29431 raft_consensus.cc:2749] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:49.781339 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b205f960deef48f8bc84127a8b47faf4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:49.738698 29224 consensus_queue.cc:1059] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.038s
W20260709 12:12:49.787974 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 105794us
I20260709 12:12:49.760010 29730 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:49.809103 29958 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:49.815758 29958 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:49.825951 29781 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:49.827024 29938 consensus_queue.cc:260] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:49.828518 29938 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:49.829077 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 51373.6us
I20260709 12:12:49.829716 29616 raft_consensus.cc:2749] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:49.829883 22496 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:49.831180 22496 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
W20260709 12:12:49.844187 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 45318.3us
I20260709 12:12:49.846158 22422 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:49.765851 29881 raft_consensus.cc:2749] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:49.785776 29943 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:49.833258 29730 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:49.832046 29663 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.849291 22422 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:49.787302 29731 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:49.860746 29731 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:49.766952 29313 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:49.864910 29313 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:49.834081 29855 raft_consensus.cc:2749] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:49.844934 29584 raft_consensus.cc:2749] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:49.852524 29603 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:49.951074 29535 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:49.879021 22422 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:49.951886 29535 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:49.954557 29535 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:49.960354 29730 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:49.965224 22601 raft_consensus.cc:1240] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:49.881510 29603 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.881230 29911 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:12:49.967314 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 88419.6us
I20260709 12:12:49.972425 22606 raft_consensus.cc:1275] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:12:49.974398 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:49.975967 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:49.871852 29663 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:49.968685 29771 raft_consensus.cc:2749] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:50.028960 29809 raft_consensus.cc:515] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:49.971226 29603 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:50.055445 22570 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:50.066119 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:50.067283 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:50.069897 23116 raft_consensus.cc:1240] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:50.084717 29959 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.085258 29959 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:50.086613 29867 consensus_queue.cc:1059] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:50.083335 29742 raft_consensus.cc:2749] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:50.089422 29663 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:50.051592 29968 consensus_queue.cc:1048] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 12:12:50.091315 29968 raft_consensus.cc:3055] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:50.091499 29616 raft_consensus.cc:3055] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:50.092211 29616 raft_consensus.cc:740] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:50.093264 29616 consensus_queue.cc:260] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:50.096635 29885 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:50.091689 29968 raft_consensus.cc:740] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:50.044453 29447 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:50.104579 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:50.105418 29937 consensus_queue.cc:1048] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:12:50.105686 29959 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:50.106472 29968 consensus_queue.cc:260] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:50.077745 29809 leader_election.cc:290] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:50.081542 29869 raft_consensus.cc:2804] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:50.099807 29811 consensus_queue.cc:1059] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 12:12:50.117412 29730 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:50.119027 29869 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
W20260709 12:12:50.130133 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 105895us
I20260709 12:12:50.112406 29731 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:50.141194 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:50.143563 23116 raft_consensus.cc:1240] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 23 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 22. Current term is 23. Ops: []
W20260709 12:12:50.160953 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 314993us
I20260709 12:12:50.161901 22496 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:50.131192 29869 raft_consensus.cc:3060] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:50.168021 29892 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.160542 29952 consensus_queue.cc:1059] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.017s
I20260709 12:12:50.190407 22523 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 16.
I20260709 12:12:50.236904 29945 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:50.261076 29635 consensus_queue.cc:1059] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:12:50.262226 30001 log.cc:927] Time spent T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:12:50.181891 29998 raft_consensus.cc:2749] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:12:50.263170 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:50.267022 29731 leader_election.cc:290] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:50.267767 29447 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:50.268360 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:50.281298 29616 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:50.285893 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:50.291816 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:50.303140 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:50.304751 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:12:50.309135 22498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:50.312124 22452 raft_consensus.cc:1275] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 28 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 12:12:50.312187 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:50.313555 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:50.329049 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:50.345706 22604 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 21.
I20260709 12:12:50.352644 22524 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:50.353668 22455 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 15.
I20260709 12:12:50.351109 22600 raft_consensus.cc:2393] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 15: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:50.351210 22451 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 20.
I20260709 12:12:50.341331 29945 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:50.369381 29945 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:50.377668 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:50.362236 22497 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
W20260709 12:12:50.378428 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 320502us
W20260709 12:12:50.386584 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 153743us
I20260709 12:12:50.386843 29673 consensus_queue.cc:1048] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:50.391960 22496 leader_election.cc:304] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:50.344233 29635 raft_consensus.cc:3055] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:50.402333 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ebc1d824844e688d0bd61c3fd2258" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:50.402758 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:50.394315 23116 raft_consensus.cc:1275] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:12:50.401754 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:50.403363 22604 raft_consensus.cc:3060] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:50.398468 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:50.393900 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:50.405428 22524 raft_consensus.cc:2468] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 23.
I20260709 12:12:50.408219 23088 leader_election.cc:304] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:50.409051 22451 raft_consensus.cc:2393] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 21: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:50.411773 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:50.412406 22449 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
I20260709 12:12:50.416405 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:50.419317 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:50.420114 23089 leader_election.cc:304] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:50.392890 29899 raft_consensus.cc:2804] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:50.402448 29635 raft_consensus.cc:740] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:50.432659 23088 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:50.427402 22604 raft_consensus.cc:2468] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 15.
I20260709 12:12:50.385178 29447 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:50.428784 29899 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:50.341105 29892 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:50.413617 29535 raft_consensus.cc:2749] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:50.416297 29792 raft_consensus.cc:2804] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:50.428812 23089 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:50.463263 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:50.501937 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:50.467604 29949 raft_consensus.cc:3055] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:50.468286 30012 raft_consensus.cc:493] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:50.452064 29797 raft_consensus.cc:2804] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:12:50.508757 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 80021.2us
I20260709 12:12:50.422786 30003 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.518533 30003 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:50.519227 29811 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:12:50.483385 22631 heartbeater.cc:646] Failed to heartbeat to 127.20.196.190:44877 (5 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.20.196.190:44877 timed out after 15.000s (SENT)
I20260709 12:12:50.486462 29603 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:50.461488 29447 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:50.447726 29753 raft_consensus.cc:2749] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:12:50.490134 29892 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:50.502835 23122 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 21.
I20260709 12:12:50.490706 29899 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:50.511845 30012 raft_consensus.cc:515] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:50.512656 29797 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:12:50.516705 29977 log.cc:927] Time spent T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:12:50.506474 29949 raft_consensus.cc:740] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:50.559708 29869 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:50.560920 29949 consensus_queue.cc:260] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:50.561812 29869 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:50.561934 29949 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:50.520100 29939 raft_consensus.cc:2749] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:50.559428 30003 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:50.559890 29797 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:50.568396 29938 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.568907 29938 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:50.580277 22570 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:50.582907 29873 raft_consensus.cc:2804] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:50.583343 29873 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.583393 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:50.583877 23124 raft_consensus.cc:1240] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:50.583741 29873 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:50.519769 29811 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:50.589943 29811 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:50.591843 30012 leader_election.cc:290] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:50.593077 23122 raft_consensus.cc:2468] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 22.
I20260709 12:12:50.595244 22454 raft_consensus.cc:1240] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 24 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 23. Current term is 24. Ops: []
I20260709 12:12:50.599736 23122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:50.546059 29792 raft_consensus.cc:697] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 23 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:50.601603 22570 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:50.570863 29938 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:50.610399 22457 raft_consensus.cc:1240] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:50.610621 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:50.614061 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:50.614888 22605 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 21.
I20260709 12:12:50.616138 23089 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:50.633875 23089 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:50.635337 22569 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:50.636845 29809 raft_consensus.cc:2804] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:50.637588 29809 raft_consensus.cc:697] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 15 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:50.639792 29792 consensus_queue.cc:237] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:50.644665 22569 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:50.617651 29811 raft_consensus.cc:2804] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:50.652480 22569 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:50.650821 29743 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.648010 29674 raft_consensus.cc:2749] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:50.605805 29873 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:50.658736 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 197823us
I20260709 12:12:50.643388 29939 raft_consensus.cc:2749] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:50.660938 30018 log.cc:927] Time spent T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:12:50.661337 29768 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:50.638826 29809 consensus_queue.cc:237] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:50.651196 29945 consensus_queue.cc:1048] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.012s
I20260709 12:12:50.709118 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272afea078f74bf19baefd3c1300644d" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
W20260709 12:12:50.707770 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 55395.1us
I20260709 12:12:50.669668 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:50.673743 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:50.663030 29616 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:50.734143 29768 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:50.734573 29616 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:50.713025 29674 raft_consensus.cc:2804] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:50.735932 29674 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.737197 22495 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:50.655535 29811 raft_consensus.cc:697] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:50.727469 22569 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:50.740487 22421 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:50.740921 22524 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 14.
I20260709 12:12:50.746009 22421 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:50.750120 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:50.670423 30020 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:50.679344 29938 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:50.748631 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:50.755601 22531 raft_consensus.cc:1240] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:50.754272 22569 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:50.780494 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:50.781267 22524 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 20.
W20260709 12:12:50.782547 22569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:50.784207 23089 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:50.746129 29742 raft_consensus.cc:3055] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:50.662353 29743 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:50.746716 29447 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:50.695037 30021 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:50.679402 29584 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.739116 29783 raft_consensus.cc:2749] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:50.683851 29797 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:50.802587 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a58204e5354d61a3b5db01e879dce9" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:50.672381 29603 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 24 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:50.753032 30007 raft_consensus.cc:2749] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:50.750492 30003 raft_consensus.cc:2749] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:50.814816 29645 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:50.815485 29743 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:50.815377 29645 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:50.816350 29811 consensus_queue.cc:237] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:50.801025 29731 raft_consensus.cc:2804] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:50.817760 29645 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:50.810925 30021 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:50.787835 30020 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:50.820055 29616 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:50.820235 30021 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:50.801609 29938 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:50.820950 30020 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:50.801436 29939 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.808344 30014 consensus_queue.cc:1048] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 12:12:50.821713 29939 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:50.823926 29939 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:50.800264 29742 raft_consensus.cc:740] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:50.825721 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:50.825596 29742 consensus_queue.cc:260] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.19, Last appended by leader: 19, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:50.815331 29873 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:50.826270 23116 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:50.747869 29674 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:50.748435 30019 raft_consensus.cc:2804] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:50.776772 29892 raft_consensus.cc:2804] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:50.802047 22421 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:50.826779 29742 raft_consensus.cc:3060] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:50.845108 29771 raft_consensus.cc:2749] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 12:12:50.813014 30022 log.cc:927] Time spent T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:12:50.830693 23122 raft_consensus.cc:1240] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:50.837669 29797 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:50.788187 29942 raft_consensus.cc:2749] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:50.817756 29731 raft_consensus.cc:493] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.851090 29731 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:50.851188 30019 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:50.851755 30019 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:50.822758 29938 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:50.811681 22531 raft_consensus.cc:2393] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 22: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:50.855998 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:50.861102 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:50.861656 22531 raft_consensus.cc:3060] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:12:50.861776 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:50.862361 22529 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 16.
I20260709 12:12:50.864614 29768 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:50.776167 29952 consensus_queue.cc:1059] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.066s
I20260709 12:12:50.870144 29952 raft_consensus.cc:3055] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:50.870491 29952 raft_consensus.cc:740] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:50.871363 29952 consensus_queue.cc:260] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:50.828614 29584 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:50.872795 29952 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:50.873713 29584 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:50.377797 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:50.880265 22531 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 22.
I20260709 12:12:50.841306 29892 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:50.887517 29892 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:50.870452 29731 raft_consensus.cc:515] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:50.896214 29731 leader_election.cc:290] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:50.898141 29899 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:50.902850 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:50.904378 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:50.905129 23124 raft_consensus.cc:2393] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 22: Already voted for candidate 8701cd5186a949538d8efafb5f987270 in this term.
I20260709 12:12:50.905061 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:50.906209 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:50.907903 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:50.905261 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:50.911021 23116 raft_consensus.cc:2468] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 22.
W20260709 12:12:50.923899 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 162591us
I20260709 12:12:50.926062 22421 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:50.927526 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:50.927819 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:50.930181 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:50.931003 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:50.932551 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:50.932544 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:50.934402 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:50.936550 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19773e9e6aec446eb719d3d53d49812b" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:50.937430 22598 raft_consensus.cc:2368] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 21. Current term is 22.
I20260709 12:12:50.938824 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:50.939522 22605 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 21.
I20260709 12:12:50.942168 22455 raft_consensus.cc:2393] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 16: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:50.944024 22605 raft_consensus.cc:1240] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:50.949740 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:50.906682 30020 consensus_queue.cc:1059] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.017s
I20260709 12:12:50.950347 22531 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 21.
I20260709 12:12:50.894409 29635 consensus_queue.cc:260] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:50.956528 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:12:50.961467 22423 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:50.971196 29635 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:50.973390 22421 leader_election.cc:304] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:50.979452 29563 raft_consensus.cc:2749] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:50.980165 29968 raft_consensus.cc:3060] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:50.981062 29892 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:50.985533 29674 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:50.991549 22422 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:50.993052 22422 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:50.994814 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:51.000798 22599 raft_consensus.cc:1240] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:51.010304 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:51.011286 22451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:51.012729 22449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:51.010905 22454 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 28.
I20260709 12:12:51.021364 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:51.009714 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:50.960150 29961 raft_consensus.cc:2804] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:50.982813 29899 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:51.023389 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:51.024744 22454 raft_consensus.cc:2393] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 21: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:51.025804 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:51.028002 22532 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:51.035605 29674 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:51.025911 29961 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:51.040441 29961 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:51.061456 30024 raft_consensus.cc:3055] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:51.061992 30024 raft_consensus.cc:740] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:51.016515 30012 raft_consensus.cc:2749] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:12:51.070259 30019 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:51.071791 22571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:51.072559 22497 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:12:50.999210 29892 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:51.025027 29447 raft_consensus.cc:2749] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:51.087715 22497 leader_election.cc:400] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 21. Current term is 22.
I20260709 12:12:51.088056 22497 leader_election.cc:403] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:51.056771 22525 raft_consensus.cc:2468] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 21.
I20260709 12:12:51.004997 22531 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 16.
I20260709 12:12:51.098555 22532 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 22.
I20260709 12:12:51.100991 22450 raft_consensus.cc:1240] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:51.101686 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:51.107255 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:51.107877 22599 raft_consensus.cc:1240] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:51.113044 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:51.114621 22455 raft_consensus.cc:1240] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 18. Current term is 19. Ops: []
W20260709 12:12:51.113546 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 287451us
I20260709 12:12:51.116878 22451 raft_consensus.cc:1240] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 17. Current term is 18. Ops: []
W20260709 12:12:51.124565 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 95101.5us
I20260709 12:12:51.120592 22570 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:51.125854 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:51.126573 22448 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:51.104619 30034 raft_consensus.cc:2764] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 12:12:51.107049 29673 raft_consensus.cc:2749] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 21. Current term is 22.
I20260709 12:12:51.131987 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:51.132174 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263d51d0b43744d899e37466045af890" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:51.134151 23089 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:51.142874 22495 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:51.147675 22598 raft_consensus.cc:3060] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:51.145531 22605 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 21.
I20260709 12:12:51.144588 22570 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:51.062842 30024 consensus_queue.cc:260] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:51.153580 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:51.155391 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:51.161237 22532 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:51.162552 29869 raft_consensus.cc:2804] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:51.163174 29869 raft_consensus.cc:697] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 22 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:51.164103 29869 consensus_queue.cc:237] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:51.163199 29749 consensus_queue.cc:1059] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.004s
W20260709 12:12:51.167526 30030 log.cc:927] Time spent T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:12:51.167778 22495 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:51.169616 29768 raft_consensus.cc:2749] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:51.169731 22495 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:51.170297 29768 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:12:51.170667 29768 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 28 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:51.171036 29768 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:12:51.172181 30034 raft_consensus.cc:2749] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:51.174111 22495 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:51.174892 29645 raft_consensus.cc:2749] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:12:51.179193 30028 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.179738 30028 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:51.181871 30028 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:51.184509 29742 consensus_queue.cc:1059] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:12:51.185680 29749 raft_consensus.cc:3055] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:51.186093 29749 raft_consensus.cc:740] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:51.186749 29998 consensus_queue.cc:1059] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:51.188177 29749 consensus_queue.cc:260] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:51.189054 29584 raft_consensus.cc:3055] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:51.189611 29584 raft_consensus.cc:740] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:51.190434 29584 consensus_queue.cc:260] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:51.191879 29584 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:51.193687 22598 raft_consensus.cc:2468] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 22.
I20260709 12:12:51.198330 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:51.199255 22532 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 16.
I20260709 12:12:51.200996 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:51.186787 22495 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:51.198879 22570 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:12:51.203617 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 52941us
I20260709 12:12:51.204878 23089 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:51.198997 22526 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 20.
I20260709 12:12:51.210026 23089 leader_election.cc:304] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:51.211097 23088 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:51.154129 29953 raft_consensus.cc:2749] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:51.211917 29535 raft_consensus.cc:2749] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:51.217290 29938 raft_consensus.cc:2804] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:51.158067 29885 raft_consensus.cc:2749] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:51.217839 29938 raft_consensus.cc:697] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 16 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:51.147094 30021 consensus_queue.cc:1059] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.072s
I20260709 12:12:51.202292 29731 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:51.219853 29753 raft_consensus.cc:2804] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:51.229997 29892 raft_consensus.cc:2749] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:51.245343 29749 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:51.257038 22572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:51.229029 29783 consensus_queue.cc:1059] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:12:51.264134 30019 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:51.265336 29945 raft_consensus.cc:3055] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:51.265725 29945 raft_consensus.cc:740] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:51.266575 29945 consensus_queue.cc:260] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:51.251500 29912 raft_consensus.cc:3055] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:12:51.269208 29912 raft_consensus.cc:740] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:51.270272 29912 consensus_queue.cc:260] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:51.271548 29912 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:51.267930 29938 consensus_queue.cc:237] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:51.249577 29731 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:51.279927 23124 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 19.
I20260709 12:12:51.281019 29731 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:51.285264 29961 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:51.243785 22448 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 16.
I20260709 12:12:51.295575 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:51.302772 22599 raft_consensus.cc:2393] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 20: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
W20260709 12:12:51.314616 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 60597.4us
I20260709 12:12:51.317813 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:51.318455 22532 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 20.
I20260709 12:12:51.319989 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:51.320675 22452 raft_consensus.cc:2368] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 15. Current term is 16.
I20260709 12:12:51.313814 22569 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:51.325227 29749 raft_consensus.cc:2804] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:51.331163 23088 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:51.332424 29797 raft_consensus.cc:2749] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:51.333585 29753 raft_consensus.cc:697] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 22 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:51.337975 29749 raft_consensus.cc:697] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 16 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:51.331014 29768 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:51.347122 29961 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:51.365891 29749 consensus_queue.cc:237] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:51.371886 22353 catalog_manager.cc:5697] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 14 to 15, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 15 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:51.375980 29945 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:51.380710 30009 raft_consensus.cc:3055] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:51.381119 30009 raft_consensus.cc:740] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:51.382025 30009 consensus_queue.cc:260] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:51.364393 30047 raft_consensus.cc:2804] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:51.383391 30047 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:51.383752 30047 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:51.386415 30009 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:51.386859 29768 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 29 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:51.394394 22570 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:12:51.395936 29873 raft_consensus.cc:2804] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:51.396450 29873 raft_consensus.cc:697] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 21 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:51.396615 22570 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:51.397336 29873 consensus_queue.cc:237] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:51.398320 29742 raft_consensus.cc:2804] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:51.398711 29742 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:51.399065 29742 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:51.401574 22525 raft_consensus.cc:1240] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 29 FOLLOWER]: Rejecting Update request from peer 6c6fa11e8ee34711b3551f0c670442bc for earlier term 28. Current term is 29. Ops: []
I20260709 12:12:51.403163 30037 consensus_queue.cc:1059] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 28.18, Next index: 19, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 12:12:51.413029 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 90902.2us
I20260709 12:12:51.418351 22605 raft_consensus.cc:1275] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 22 index: 19. Preceding OpId from leader: term: 23 index: 19. (term mismatch)
I20260709 12:12:51.418752 22605 pending_rounds.cc:85] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting all ops after (but not including) 18
I20260709 12:12:51.418953 22605 pending_rounds.cc:107] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc: Aborting uncommitted NO_OP operation due to leader change: 22.19
I20260709 12:12:51.419198 22605 raft_consensus.cc:2889] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:51.418387 22599 raft_consensus.cc:1275] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:51.375950 22448 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:44568
I20260709 12:12:51.427027 22495 leader_election.cc:400] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 election: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 15. Current term is 16.
I20260709 12:12:51.431239 22495 leader_election.cc:403] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
W20260709 12:12:51.432686 22495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:51.431348 22448 raft_consensus.cc:606] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 LEADER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:12:51.433709 30020 raft_consensus.cc:2749] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 15. Current term is 16.
I20260709 12:12:51.434928 30002 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.435427 30002 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:51.437460 30002 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:51.438197 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:51.439468 22525 raft_consensus.cc:1275] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
I20260709 12:12:51.442394 29731 consensus_queue.cc:1048] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:12:51.443367 22353 catalog_manager.cc:5697] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:51.443898 29731 consensus_queue.cc:1048] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:12:51.445624 29731 consensus_queue.cc:1048] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:51.430766 30024 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:51.427560 22497 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:51.450322 29673 raft_consensus.cc:2804] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:51.450830 29673 raft_consensus.cc:697] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:51.451045 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:51.451714 29673 consensus_queue.cc:237] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:51.455755 22452 raft_consensus.cc:1275] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:51.456338 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:51.463253 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:51.463940 22600 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 21.
I20260709 12:12:51.467265 22450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:51.445410 22353 catalog_manager.cc:5697] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 10 to 12, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 12 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:12:51.473184 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:51.481436 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:51.482017 22523 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:51.484797 22422 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:51.501657 22450 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:44568
I20260709 12:12:51.502288 22450 raft_consensus.cc:606] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:12:51.502590 22450 raft_consensus.cc:614] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:51.518996 22523 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 17.
I20260709 12:12:51.521871 22421 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:12:51.494191 29958 raft_consensus.cc:2804] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:51.525282 30013 raft_consensus.cc:2804] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:12:51.541705 30054 log.cc:927] Time spent T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 12:12:51.549786 30053 log.cc:927] Time spent T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 12:12:51.554687 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 49516.4us
I20260709 12:12:51.555668 22495 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:51.572561 23120 raft_consensus.cc:1275] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:12:51.571137 22347 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55962 (request call id 347) took 11191 ms. Trace:
I20260709 12:12:51.527864 29958 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:51.572989 22523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b955a164159b49b9bf083e35e340e323"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:46680
I20260709 12:12:51.507316 29731 consensus_queue.cc:1048] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
I20260709 12:12:51.588932 22523 raft_consensus.cc:606] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Received request to transfer leadership to TS 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:51.589327 22523 raft_consensus.cc:614] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:51.575665 22347 rpcz_store.cc:276] 0709 12:12:40.373792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:40.373986 (+   194us) service_pool.cc:224] Handling call
0709 12:12:51.565435 (+11191449us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:46.104241 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:46.320231 (+215990us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:46.320286 (+    55us) write_op.cc:435] Acquired schema lock
0709 12:12:46.320303 (+    17us) tablet.cc:662] Decoding operations
0709 12:12:46.385919 (+ 65616us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:46.386020 (+   101us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:46.386052 (+    32us) tablet.cc:685] Acquiring locks for 33 operations
0709 12:12:46.537712 (+151660us) tablet.cc:701] Row locks acquired
0709 12:12:46.537768 (+    56us) write_op.cc:260] PREPARE: finished
0709 12:12:46.537956 (+   188us) write_op.cc:270] Start()
0709 12:12:46.538111 (+   155us) write_op.cc:276] Timestamp: P: 1783599166537896 usec, L: 0
0709 12:12:46.538148 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 12:12:46.538844 (+   696us) log.cc:844] Serialized 12979 byte log entry
0709 12:12:47.859657 (+1320813us) op_driver.cc:464] REPLICATION: finished
0709 12:12:48.160068 (+300411us) write_op.cc:301] APPLY: starting
0709 12:12:48.161378 (+  1310us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:48.442722 (+281344us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:48.442867 (+   145us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:49.433424 (+990557us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:49.433914 (+   490us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=66,key_file_lookups=66,delta_file_lookups=66,mrs_lookups=0
0709 12:12:49.433988 (+    74us) write_op.cc:312] APPLY: finished
0709 12:12:49.434755 (+   767us) log.cc:844] Serialized 284 byte log entry
0709 12:12:49.502566 (+ 67811us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:49.512460 (+  9894us) write_op.cc:454] Released schema lock
0709 12:12:49.512530 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:49.512936 (+   406us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:49.512967 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":22419,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":287802,"apply.run_cpu_time_us":59961,"apply.run_wall_time_us":1355301,"cfile_cache_hit":134,"cfile_cache_hit_bytes":142067,"num_ops":33,"prepare.queue_time_us":196288,"prepare.run_cpu_time_us":26800,"prepare.run_wall_time_us":842411,"raft.queue_time_us":498968,"raft.run_cpu_time_us":41765,"raft.run_wall_time_us":278707,"replication_time_us":1305277,"thread_start_us":853202,"threads_started":5,"wal-append.queue_time_us":904165,"wal-append.run_cpu_time_us":29011,"wal-append.run_wall_time_us":2292971}]]}
I20260709 12:12:51.586374 29958 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:51.604656 22523 raft_consensus.cc:1275] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:12:51.553465 29753 consensus_queue.cc:237] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:51.594949 29998 raft_consensus.cc:2749] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 12:12:51.614724 22451 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:44568
I20260709 12:12:51.619129 22451 raft_consensus.cc:606] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:12:51.619292 23120 raft_consensus.cc:1275] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:12:51.619468 22451 raft_consensus.cc:614] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:51.595824 29749 consensus_queue.cc:1048] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.024s
I20260709 12:12:51.628243 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:12:51.629981 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:51.630532 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:51.623904 29953 consensus_queue.cc:1048] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.020s
I20260709 12:12:51.643227 29958 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:51.645372 29958 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 22 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:51.651546 30059 raft_consensus.cc:993] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f: : Instructing follower 8701cd5186a949538d8efafb5f987270 to start an election
I20260709 12:12:51.652143 30059 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.620718 30047 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:51.652598 30059 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:51.653635 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:51.654256 22599 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:51.654671 30059 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:51.656008 29563 raft_consensus.cc:1081] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 LEADER]: Signalling peer 8701cd5186a949538d8efafb5f987270 to start an election
I20260709 12:12:51.660562 23116 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6"
dest_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:57318
I20260709 12:12:51.661171 23116 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:51.661486 23116 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:51.664126 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:51.665174 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:51.667018 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:51.656847 29869 raft_consensus.cc:3055] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:12:51.683557 22421 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:51.657855 30047 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:51.670794 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:51.672056 29873 consensus_queue.cc:1048] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:12:51.660569 29742 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:51.675837 22599 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 22.
I20260709 12:12:51.705098 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:51.707109 30013 raft_consensus.cc:697] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 17 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:51.683029 29869 raft_consensus.cc:740] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:51.693910 30014 raft_consensus.cc:2749] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:51.725432 22598 raft_consensus.cc:2368] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 20. Current term is 21.
I20260709 12:12:51.727464 29742 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:51.729465 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:51.730221 23120 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:51.729758 29869 consensus_queue.cc:260] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 28.18, Last appended by leader: 18, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:51.731333 29869 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:12:51.742357 23120 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 21.
I20260709 12:12:51.747820 30013 consensus_queue.cc:237] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:51.750151 22570 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:51.751256 29953 raft_consensus.cc:2804] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:51.751873 29953 raft_consensus.cc:697] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 21 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:51.753006 29953 consensus_queue.cc:237] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:51.724490 23116 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:51.774603 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 96827.3us
W20260709 12:12:51.776151 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 69487.5us
I20260709 12:12:51.776474 22532 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 20.
I20260709 12:12:51.779021 23116 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:12:51.780555 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 62566.4us
I20260709 12:12:51.784952 22523 raft_consensus.cc:1275] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:12:51.791491 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:51.792063 22524 raft_consensus.cc:3060] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:51.792181 23088 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:51.804262 22524 raft_consensus.cc:2468] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 21.
I20260709 12:12:51.806421 22422 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:51.800757 30051 raft_consensus.cc:2764] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Leader election decision vote started in defunct term 20: won
I20260709 12:12:51.798230 29524 consensus_queue.cc:1048] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.022s
I20260709 12:12:51.813778 29771 raft_consensus.cc:2804] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:51.838675 29771 raft_consensus.cc:697] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:51.839709 29771 consensus_queue.cc:237] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:51.847424 23089 leader_election.cc:400] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 election: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 20. Current term is 21.
I20260709 12:12:51.857613 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:51.858273 22448 raft_consensus.cc:3055] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:51.858477 22448 raft_consensus.cc:740] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:51.862495 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:51.863322 22597 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:51.852231 29958 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.870406 22448 consensus_queue.cc:260] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:51.881155 22448 raft_consensus.cc:3060] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:51.889496 22448 raft_consensus.cc:2468] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 17.
I20260709 12:12:51.885895 29958 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:51.903446 23087 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:51.904752 29939 raft_consensus.cc:2804] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:51.905043 29958 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:51.905326 29939 raft_consensus.cc:697] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 17 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:51.906239 29939 consensus_queue.cc:237] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:51.913470 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:51.914194 22600 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 15.
I20260709 12:12:51.921213 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:51.922363 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:51.923040 22524 raft_consensus.cc:1275] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:12:51.933182 22421 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:51.945485 22525 raft_consensus.cc:1240] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:51.945755 29869 consensus_queue.cc:1048] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:51.949709 29753 consensus_queue.cc:1059] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:12:51.950608 29753 raft_consensus.cc:3055] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:51.965130 22452 raft_consensus.cc:1275] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:12:51.991179 23116 raft_consensus.cc:3060] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:52.000067 22597 raft_consensus.cc:2468] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 17.
I20260709 12:12:51.934625 29911 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:52.034732 23116 raft_consensus.cc:1275] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 12:12:52.035516 22448 raft_consensus.cc:1240] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 LEADER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:51.950943 29753 raft_consensus.cc:740] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:52.047852 22457 raft_consensus.cc:1240] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 17 LEADER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:52.014309 29945 consensus_queue.cc:1048] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
W20260709 12:12:52.075740 30067 log.cc:927] Time spent T 00000000000000000000000000000000 P 136fd3da76544029a815aef59e698e17: Append to log took a long time: real 0.252s	user 0.005s	sys 0.000s
I20260709 12:12:52.078572 29753 consensus_queue.cc:260] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:52.079871 29753 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:52.041108 29873 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.083645 29873 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:52.086045 29873 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:52.087275 30023 consensus_queue.cc:1059] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 12:12:52.088064 30023 consensus_queue.cc:1243] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Peer c863116d91c14d1ca50d6e8a46a37a8f log is divergent from this leader: its last log entry 22.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:12:52.088454 29768 raft_consensus.cc:3055] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:52.088835 29768 raft_consensus.cc:740] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:52.089666 29768 consensus_queue.cc:260] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:52.087553 30048 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:52.093752 30048 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:52.054767 29892 consensus_queue.cc:1048] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.040s
I20260709 12:12:52.094805 22597 raft_consensus.cc:1240] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:52.099190 22532 raft_consensus.cc:1275] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 12:12:52.100800 22524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:52.102843 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:52.105525 23124 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 18.
I20260709 12:12:52.111521 22570 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:52.130328 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:52.131121 22448 raft_consensus.cc:2393] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 21: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:52.136077 30048 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:52.138298 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:52.139181 22597 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 21.
I20260709 12:12:52.140818 23089 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:52.127380 30009 raft_consensus.cc:2804] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:52.142537 30009 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.146595 30009 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:52.146946 30049 raft_consensus.cc:2804] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:52.147382 30049 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:52.147733 30049 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:52.160097 30009 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:52.128018 29524 consensus_queue.cc:1048] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.029s
I20260709 12:12:52.162158 30009 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:52.168705 30024 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:52.153573 29768 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:52.169308 30024 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:52.182467 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:52.183107 23116 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:52.185688 22523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:52.196390 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:52.200687 22454 raft_consensus.cc:2393] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 15: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:52.208228 23116 raft_consensus.cc:2468] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 19.
I20260709 12:12:52.209484 22570 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:52.217825 22597 raft_consensus.cc:1275] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:12:52.201267 30014 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.235200 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:52.235918 22597 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
I20260709 12:12:52.240916 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:52.229760 29722 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.230094 29742 raft_consensus.cc:2804] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:52.257647 22496 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:52.242175 30024 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:52.235114 29792 consensus_queue.cc:1048] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 12:12:52.278632 22525 raft_consensus.cc:1275] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:12:52.233983 30014 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:52.258813 29801 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:52.265161 29635 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:52.299194 22525 raft_consensus.cc:1275] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:12:52.299244 23118 raft_consensus.cc:1275] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:12:52.263789 29722 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:52.277114 29742 raft_consensus.cc:697] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:52.300653 30037 consensus_queue.cc:1048] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 12:12:52.290022 29801 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:52.329594 22525 raft_consensus.cc:1275] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:12:52.317504 29768 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:52.308790 29797 consensus_queue.cc:1048] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 12:12:52.338286 29742 consensus_queue.cc:237] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:52.332053 29524 consensus_queue.cc:1048] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.011s
I20260709 12:12:52.344486 29801 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:52.351087 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:52.345548 29722 leader_election.cc:290] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:52.352576 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:52.353085 22525 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 22.
I20260709 12:12:52.354285 23088 leader_election.cc:304] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:52.356227 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:52.362250 23124 raft_consensus.cc:2368] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 18. Current term is 19.
I20260709 12:12:52.374099 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:52.336536 29961 consensus_queue.cc:1048] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 12:12:52.337085 29768 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:52.362545 29809 raft_consensus.cc:2804] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:52.372812 29801 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.389810 29801 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:52.405342 29768 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:52.407279 29959 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.407804 29959 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:52.409977 29959 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:52.387346 29809 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.411604 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:52.412227 22454 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 19.
I20260709 12:12:52.412690 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:52.411653 29809 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:52.418798 22454 raft_consensus.cc:1275] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:52.425766 29722 consensus_queue.cc:1048] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:52.406517 29801 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:52.425962 29635 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:52.435207 30014 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:52.437541 29809 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:52.441731 30077 log.cc:927] Time spent T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 12:12:52.453217 22569 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 8701cd5186a949538d8efafb5f987270
I20260709 12:12:52.456682 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:52.457551 22599 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 18.
I20260709 12:12:52.458825 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:52.459627 22598 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 21.
I20260709 12:12:52.463320 22497 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:52.464396 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:52.465153 22600 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 18.
I20260709 12:12:52.472180 22422 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:52.473304 22497 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
W20260709 12:12:52.475121 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 86454.3us
I20260709 12:12:52.477422 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:52.478350 22448 raft_consensus.cc:2393] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 18: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:52.479506 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:52.479890 23116 raft_consensus.cc:1275] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 15. (term mismatch)
I20260709 12:12:52.480254 23116 pending_rounds.cc:85] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270: Aborting all ops after (but not including) 14
I20260709 12:12:52.480469 23116 pending_rounds.cc:107] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270: Aborting uncommitted NO_OP operation due to leader change: 16.15
I20260709 12:12:52.480724 23116 raft_consensus.cc:2889] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:52.483404 29783 raft_consensus.cc:493] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:52.487088 29783 raft_consensus.cc:515] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:52.489287 29783 leader_election.cc:290] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:52.491223 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:52.493167 23124 raft_consensus.cc:2368] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 22. Current term is 23.
I20260709 12:12:52.493414 29809 leader_election.cc:290] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:52.478282 29635 raft_consensus.cc:2804] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:52.494024 29635 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:52.478700 29801 raft_consensus.cc:2804] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:52.494449 29635 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:52.494686 29801 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.495095 29801 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:52.482168 30049 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:52.503340 22570 leader_election.cc:400] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Vote denied by peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353) with higher term. Message: Invalid argument: T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 22. Current term is 23.
I20260709 12:12:52.503683 22570 leader_election.cc:403] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:52.483664 30014 raft_consensus.cc:2804] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:52.504848 30014 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.504959 30049 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:52.505251 30014 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:52.505951 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:52.506670 22455 raft_consensus.cc:2393] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 21: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:52.510673 22605 raft_consensus.cc:1275] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:52.511171 29674 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Advancing to term 23
I20260709 12:12:52.514884 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:52.515090 29742 raft_consensus.cc:2804] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:52.515466 29742 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.515820 29742 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:52.533800 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:52.534690 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:52.535292 22531 raft_consensus.cc:3060] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:52.539143 29797 consensus_queue.cc:1048] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:52.539655 22605 raft_consensus.cc:1275] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:12:52.553202 29991 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:52.553725 29991 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:52.555423 29674 raft_consensus.cc:2749] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353) with higher term. Message: Invalid argument: T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 22. Current term is 23.
I20260709 12:12:52.556202 30013 consensus_queue.cc:1048] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:12:52.555739 29991 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:52.562670 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf783936508640219af47375c444da09" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:52.567415 22531 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 23.
I20260709 12:12:52.562192 22496 leader_election.cc:400] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353) with higher term. Message: Invalid argument: T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 18. Current term is 19.
I20260709 12:12:52.576454 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:52.578150 30012 consensus_queue.cc:1048] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:12:52.579521 23088 leader_election.cc:304] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:52.569829 22598 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 21.
I20260709 12:12:52.595705 22599 raft_consensus.cc:2393] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 21: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
I20260709 12:12:52.569916 22496 leader_election.cc:403] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:52.600446 29797 raft_consensus.cc:2804] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:52.607590 29797 raft_consensus.cc:697] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 23 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:52.608572 29797 consensus_queue.cc:237] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:52.609055 29801 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:52.621102 29635 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:52.617456 30014 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:52.622939 22600 raft_consensus.cc:2468] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 23.
I20260709 12:12:52.625170 29801 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:52.626848 30033 raft_consensus.cc:3060] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:12:52.677850 29742 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:52.627013 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 64952.3us
I20260709 12:12:52.638438 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:52.679543 22604 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:52.681607 22532 raft_consensus.cc:1275] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 15. (term mismatch)
I20260709 12:12:52.628067 29635 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:52.682241 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:52.682931 22530 raft_consensus.cc:2368] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 21. Current term is 22.
I20260709 12:12:52.642187 22457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:52.683488 22527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:52.683887 22457 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:12:52.684041 22527 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:52.685348 22353 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55980 (request call id 376) took 44126 ms (client timeout 15000 ms). Trace:
I20260709 12:12:52.628986 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:52.689613 30033 raft_consensus.cc:2749] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353) with higher term. Message: Invalid argument: T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 18. Current term is 19.
W20260709 12:12:52.686874 22353 rpcz_store.cc:269] 0709 12:12:08.559229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.559449 (+   220us) service_pool.cc:224] Handling call
0709 12:12:52.685263 (+44125814us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:51.661182 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:51.661712 (+   530us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:51.661741 (+    29us) write_op.cc:435] Acquired schema lock
0709 12:12:51.661758 (+    17us) tablet.cc:662] Decoding operations
0709 12:12:51.662289 (+   531us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:51.662344 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:51.662368 (+    24us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:12:51.663155 (+   787us) tablet.cc:701] Row locks acquired
0709 12:12:51.663176 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:12:51.663316 (+   140us) write_op.cc:270] Start()
0709 12:12:51.663419 (+   103us) write_op.cc:276] Timestamp: P: 1783599171663267 usec, L: 0
0709 12:12:51.663438 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:12:51.757591 (+ 94153us) log.cc:844] Serialized 1316 byte log entry
0709 12:12:51.984353 (+226762us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b18002e5280. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cc780f2a6 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db
0709 12:12:51.986151 (+  1798us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b4400022b4c. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cc76c9db1 00007f9cc7767c85 00007f9cc77686a2 00007f9cca4da1db 00007f9cca4d5aaf 00007f9cca4c986e 00007f9cca4c8bb6 00007f9cca4c87d8 00007f9cca4d2221 00007f9cca4d21d9 00007f9cca4d2169
0709 12:12:52.136970 (+150819us) op_driver.cc:464] REPLICATION: finished
0709 12:12:52.258944 (+121974us) write_op.cc:301] APPLY: starting
0709 12:12:52.263478 (+  4534us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:52.474622 (+211144us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:52.478154 (+  3532us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:52.641119 (+162965us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:52.641309 (+   190us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 12:12:52.641353 (+    44us) write_op.cc:312] APPLY: finished
0709 12:12:52.641561 (+   208us) log.cc:844] Serialized 41 byte log entry
0709 12:12:52.641726 (+   165us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:52.641814 (+    88us) write_op.cc:454] Released schema lock
0709 12:12:52.641857 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:52.642282 (+   425us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:52.642310 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":296510,"reported_tablets":47,"spinlock_wait_cycles":2816,"child_traces":[["op",{"apply.queue_time_us":99346,"apply.run_cpu_time_us":7267,"apply.run_wall_time_us":397742,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16667,"num_ops":3,"prepare.queue_time_us":124180,"prepare.run_cpu_time_us":28097,"prepare.run_wall_time_us":161456,"raft.queue_time_us":59851,"raft.run_cpu_time_us":6853,"raft.run_wall_time_us":19484,"replication_time_us":473376,"spinlock_wait_cycles":43601152,"thread_start_us":167555,"threads_started":4,"wal-append.queue_time_us":62334}]]}
I20260709 12:12:52.693033 22527 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 19.
I20260709 12:12:52.654028 23089 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:52.635433 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:52.681514 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:12:52.707240 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 53298.2us
I20260709 12:12:52.707428 22531 raft_consensus.cc:2376] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 19. Re-sending same reply.
I20260709 12:12:52.682026 22532 pending_rounds.cc:85] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting all ops after (but not including) 14
I20260709 12:12:52.708281 22532 pending_rounds.cc:107] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881: Aborting uncommitted NO_OP operation due to leader change: 21.15
I20260709 12:12:52.708535 22532 raft_consensus.cc:2889] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:52.708920 29809 raft_consensus.cc:2804] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:52.709470 29809 raft_consensus.cc:697] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 21 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:52.664885 22455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:52.710350 29809 consensus_queue.cc:237] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:52.634413 30014 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:52.701608 22421 leader_election.cc:400] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 21. Current term is 22.
I20260709 12:12:52.713791 22421 leader_election.cc:403] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:52.693080 22457 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 22.
I20260709 12:12:52.716112 22598 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:52.716408 29961 raft_consensus.cc:2749] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733) with higher term. Message: Invalid argument: T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for earlier term 21. Current term is 22.
I20260709 12:12:52.716741 22495 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:52.710415 22455 raft_consensus.cc:2368] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 18. Current term is 19.
I20260709 12:12:52.706234 22604 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 19.
I20260709 12:12:52.719703 22495 leader_election.cc:400] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 election: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 18. Current term is 19.
I20260709 12:12:52.720927 22495 leader_election.cc:403] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:12:52.720700 22422 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:52.721654 30024 raft_consensus.cc:2804] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:52.722131 30024 raft_consensus.cc:697] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:52.722919 30024 consensus_queue.cc:237] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:52.724267 30033 raft_consensus.cc:2749] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 18. Current term is 19.
I20260709 12:12:52.726285 30014 raft_consensus.cc:2804] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:52.743635 29809 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:52.739157 29961 consensus_queue.cc:1048] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.008s
I20260709 12:12:52.749941 22598 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 22.
I20260709 12:12:52.726835 30014 raft_consensus.cc:697] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:52.763096 29809 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:52.769038 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:52.769788 22454 raft_consensus.cc:2393] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 19: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:52.771198 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:52.773262 22598 raft_consensus.cc:2368] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 19. Current term is 20.
I20260709 12:12:52.773710 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:52.774459 22448 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:52.775008 29809 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:52.779407 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:52.780026 23119 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:12:52.783285 29742 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:52.785552 22448 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 20.
I20260709 12:12:52.788293 22569 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:52.791464 30014 consensus_queue.cc:237] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:52.793344 29945 raft_consensus.cc:2804] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:52.793829 29945 raft_consensus.cc:697] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 20 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:52.794644 29945 consensus_queue.cc:237] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:52.795686 29635 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.796198 29635 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:52.800009 29635 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:52.803397 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:52.811723 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:52.812427 22448 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 24.
I20260709 12:12:52.813325 22495 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:52.822924 23089 leader_election.cc:400] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 19. Current term is 20.
I20260709 12:12:52.823302 23089 leader_election.cc:403] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:52.824661 23119 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 20.
I20260709 12:12:52.827018 29635 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:12:52.830873 29635 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.832281 29635 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:52.832883 29938 raft_consensus.cc:2749] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785) with higher term. Message: Invalid argument: T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 for earlier term 19. Current term is 20.
I20260709 12:12:52.864648 23124 raft_consensus.cc:1275] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:52.866084 29959 consensus_queue.cc:1048] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:52.869475 22354 catalog_manager.cc:5697] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 7 to 6, leader changed from <none> to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 6 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:52.879758 29635 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:52.886242 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:52.886780 22448 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:52.901333 22448 raft_consensus.cc:2468] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 25.
I20260709 12:12:52.905912 22495 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:52.909866 30024 raft_consensus.cc:2804] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:12:52.924445 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:52.955160 29635 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 25 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:52.921195 30024 raft_consensus.cc:697] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 25 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:52.959095 29892 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:52.961918 29892 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:52.964116 29892 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:52.965613 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:52.966042 29961 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:52.966351 22454 raft_consensus.cc:2368] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 24. Current term is 25.
I20260709 12:12:52.967646 22569 leader_election.cc:400] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 24 pre-election: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 24. Current term is 25.
I20260709 12:12:52.967934 22569 leader_election.cc:403] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 24 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:52.968676 29961 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:52.972434 29961 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:52.973361 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:52.974385 22528 raft_consensus.cc:2393] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 29: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:52.976838 29809 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:52.977435 29809 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:52.979336 30024 consensus_queue.cc:237] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:52.980142 29809 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:52.981819 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:52.982571 22601 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 29.
I20260709 12:12:52.981885 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:52.982750 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:52.983294 22526 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 15.
I20260709 12:12:52.983467 22454 raft_consensus.cc:2393] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 15: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:52.984815 22422 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:52.985643 30014 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:12:52.986007 30014 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 28 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:52.976980 29674 raft_consensus.cc:3060] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Advancing to term 25
I20260709 12:12:52.992733 22526 raft_consensus.cc:1275] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:52.994244 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:52.994777 22601 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 15.
I20260709 12:12:52.993640 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:53.005687 23089 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:52.999541 29958 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.009196 29958 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:53.009755 22525 raft_consensus.cc:1275] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:12:53.013448 29753 consensus_queue.cc:1048] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:12:53.013887 22601 raft_consensus.cc:1275] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:12:53.022634 29958 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:53.024559 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:53.025193 22598 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 21.
I20260709 12:12:53.027455 22422 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:53.028479 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:52.986637 30014 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:12:53.032333 30063 raft_consensus.cc:2804] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:53.032753 30063 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.033090 30063 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:53.024587 29809 raft_consensus.cc:2804] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:53.033670 29809 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:12:53.034050 29809 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:53.034713 29753 consensus_queue.cc:1048] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:12:53.036267 29749 consensus_queue.cc:1048] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:53.077510 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:12:53.112620 30099 log.cc:927] Time spent T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:12:53.168644 30014 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:53.144800 29809 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:53.174432 29809 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:53.176571 29674 raft_consensus.cc:2749] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: Vote denied by peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317) with higher term. Message: Invalid argument: T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc for earlier term 24. Current term is 25.
I20260709 12:12:53.178889 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:53.180433 22454 raft_consensus.cc:2393] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8701cd5186a949538d8efafb5f987270 in current term 15: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:53.165134 30063 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:53.182796 22448 raft_consensus.cc:1240] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Rejecting Update request from peer 8701cd5186a949538d8efafb5f987270 for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:53.183645 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:53.187156 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:53.192075 22598 raft_consensus.cc:1275] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:12:53.198896 22532 raft_consensus.cc:2393] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 29: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
W20260709 12:12:53.208247 30104 log.cc:927] Time spent T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:12:53.211584 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:53.215828 22598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:53.216516 22598 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:53.223109 22600 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 29.
I20260709 12:12:53.224385 22422 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
W20260709 12:12:53.224910 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 64543.8us
I20260709 12:12:53.206228 30014 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 29 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:53.227952 29991 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:12:53.237375 30063 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 22 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:53.205606 29885 consensus_queue.cc:1059] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.030s
I20260709 12:12:53.239681 29885 raft_consensus.cc:3055] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:53.240056 29885 raft_consensus.cc:740] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:53.233819 22598 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 22.
I20260709 12:12:53.234575 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:53.254294 22422 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:53.205895 30033 consensus_queue.cc:1048] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 12:12:53.259109 29991 raft_consensus.cc:697] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 29 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:53.269784 29885 consensus_queue.cc:260] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.18, Last appended by leader: 18, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:53.270386 29991 consensus_queue.cc:237] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 28.18, Last appended by leader: 18, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:53.276503 29885 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:53.280184 22454 raft_consensus.cc:1275] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:12:53.283613 23118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:53.289399 22525 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 15.
I20260709 12:12:53.261173 22601 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 15.
I20260709 12:12:53.299320 23089 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:53.333827 22601 raft_consensus.cc:1275] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:12:53.295027 29911 raft_consensus.cc:2804] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Leader election won for term 22
W20260709 12:12:53.381515 30104 log.cc:927] Time spent T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:12:53.307054 29809 raft_consensus.cc:2804] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:53.295258 30024 consensus_queue.cc:1048] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.070s
W20260709 12:12:53.415186 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 75133.5us
I20260709 12:12:53.427162 29911 raft_consensus.cc:697] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
W20260709 12:12:53.386246 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 48991.3us
I20260709 12:12:53.400018 29809 raft_consensus.cc:697] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 15 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:53.398168 30013 consensus_queue.cc:1048] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 12:12:53.493233 29809 consensus_queue.cc:237] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:53.511049 29911 consensus_queue.cc:237] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:53.543283 23118 raft_consensus.cc:2410] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f for term 22 because replica has last-logged OpId of term: 21 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 17.
I20260709 12:12:53.553618 22451 raft_consensus.cc:1275] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 25 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 12:12:53.599951 30033 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.600808 30033 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:53.616401 30123 consensus_queue.cc:1048] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:53.642091 30033 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:53.680226 22526 raft_consensus.cc:1275] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:12:53.701439 22599 raft_consensus.cc:1275] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 25 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
W20260709 12:12:53.704682 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 358345us
I20260709 12:12:53.708582 23118 raft_consensus.cc:1275] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:12:53.711678 29749 consensus_queue.cc:1048] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 12:12:53.731952 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 79950.5us
I20260709 12:12:53.739055 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:53.768131 22448 raft_consensus.cc:1275] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:12:53.779563 22605 raft_consensus.cc:1275] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 29 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 28 index: 18. Preceding OpId from leader: term: 29 index: 19. (index mismatch)
I20260709 12:12:53.792083 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:53.792860 22605 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 29.
I20260709 12:12:53.799300 30106 consensus_queue.cc:1048] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:53.813097 22497 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:53.815169 30106 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:12:53.815639 30106 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.816048 30106 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:12:53.820152 29674 consensus_queue.cc:1048] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:12:53.825555 22448 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40384260c96247e0ac31ade25baddaff"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:44568
I20260709 12:12:53.826571 22448 raft_consensus.cc:606] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:12:53.827098 22448 raft_consensus.cc:614] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:53.843995 30120 consensus_queue.cc:1048] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:12:53.878284 30012 consensus_queue.cc:1048] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 12:12:53.950850 22353 catalog_manager.cc:5697] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 17 to 22, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 22 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
W20260709 12:12:53.989444 30130 log.cc:927] Time spent T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.121s	user 0.002s	sys 0.000s
I20260709 12:12:54.008162 22605 raft_consensus.cc:1275] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:12:54.014525 22526 raft_consensus.cc:1275] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:12:54.037942 30117 consensus_queue.cc:1048] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:54.037498 30106 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:54.056023 30106 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 30 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:54.066273 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:54.053086 30118 consensus_queue.cc:1048] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 12:12:54.123711 22529 raft_consensus.cc:1240] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 30 FOLLOWER]: Rejecting Update request from peer c863116d91c14d1ca50d6e8a46a37a8f for earlier term 29. Current term is 30. Ops: []
I20260709 12:12:54.125348 22526 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e5929206e89419f978fa0283f6bb931"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:46680
I20260709 12:12:54.132948 22526 raft_consensus.cc:606] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:12:54.133376 22526 raft_consensus.cc:614] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:12:54.135510 30140 log.cc:927] Time spent T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 12:12:54.156682 30012 consensus_queue.cc:1059] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 19, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:12:54.157665 30012 raft_consensus.cc:3055] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:12:54.158008 30012 raft_consensus.cc:740] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 29 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:54.165642 22599 raft_consensus.cc:1275] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 12:12:54.169828 22353 catalog_manager.cc:5697] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 24 to 28, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 28 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:12:54.218204 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:54.172631 30012 consensus_queue.cc:260] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 29.19, Last appended by leader: 19, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:54.269212 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 62977.5us
I20260709 12:12:54.281424 30115 consensus_queue.cc:1048] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.098s
I20260709 12:12:54.295179 22353 catalog_manager.cc:5697] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 15 to 17, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 17 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:54.296957 22353 catalog_manager.cc:5697] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 17 to 18, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 18 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
W20260709 12:12:54.309288 22354 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48412 (request call id 241) took 108515 ms (client timeout 15000 ms). Trace:
I20260709 12:12:54.322937 30013 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.323768 30013 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:54.326754 30013 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:54.298746 22353 catalog_manager.cc:5697] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 18 to 22, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 22 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:54.350199 30012 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:12:54.354964 22353 catalog_manager.cc:5697] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 15 to 20, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 20 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:54.356581 22353 catalog_manager.cc:5697] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:54.358119 22353 catalog_manager.cc:5697] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:54.361023 23116 raft_consensus.cc:1275] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 22 index: 18. (term mismatch)
I20260709 12:12:54.369966 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:54.375002 22451 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:44568
I20260709 12:12:54.388671 22451 raft_consensus.cc:606] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:12:54.388998 22451 raft_consensus.cc:614] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:12:54.319943 22354 rpcz_store.cc:269] 0709 12:11:05.779378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.803476 (+ 24098us) service_pool.cc:224] Handling call
0709 12:12:54.294727 (+108491251us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:52.983576 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:52.984116 (+   540us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:52.984150 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:12:52.984168 (+    18us) tablet.cc:662] Decoding operations
0709 12:12:52.984684 (+   516us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:52.984753 (+    69us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:52.984780 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:12:52.984960 (+   180us) tablet.cc:701] Row locks acquired
0709 12:12:52.984978 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:12:52.985109 (+   131us) write_op.cc:270] Start()
0709 12:12:52.985214 (+   105us) write_op.cc:276] Timestamp: P: 1783599172985067 usec, L: 0
0709 12:12:52.985236 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:12:52.985841 (+   605us) log.cc:844] Serialized 539 byte log entry
0709 12:12:53.211848 (+226007us) op_driver.cc:464] REPLICATION: finished
0709 12:12:53.385126 (+173278us) write_op.cc:301] APPLY: starting
0709 12:12:53.385213 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:53.404673 (+ 19460us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:53.404742 (+    69us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:53.405326 (+   584us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:53.405465 (+   139us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:12:53.405492 (+    27us) write_op.cc:312] APPLY: finished
0709 12:12:53.405646 (+   154us) log.cc:844] Serialized 25 byte log entry
0709 12:12:53.405821 (+   175us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:53.405903 (+    82us) write_op.cc:454] Released schema lock
0709 12:12:53.405943 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:53.406328 (+   385us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:53.406347 (+    19us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1008758,"reported_tablets":39,"spinlock_wait_cycles":2304,"child_traces":[["op",{"apply.queue_time_us":170550,"apply.run_cpu_time_us":2954,"apply.run_wall_time_us":21189,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8307,"num_ops":1,"prepare.queue_time_us":70151,"prepare.run_cpu_time_us":2401,"prepare.run_wall_time_us":2584,"replication_time_us":226391,"thread_start_us":153615,"threads_started":2}]]}
I20260709 12:12:54.388327 23116 pending_rounds.cc:85] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270: Aborting all ops after (but not including) 17
I20260709 12:12:54.391680 23116 pending_rounds.cc:107] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270: Aborting uncommitted NO_OP operation due to leader change: 21.18
I20260709 12:12:54.395922 23116 raft_consensus.cc:2889] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:12:54.418851 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 108190us
I20260709 12:12:54.423382 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:54.431136 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:54.444666 22451 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74d6480c61e542d583f6f89899989553"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
mode: GRACEFUL
new_leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:44568
I20260709 12:12:54.445297 22451 raft_consensus.cc:606] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 LEADER]: Received request to transfer leadership to TS 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:54.448130 22525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:46680
I20260709 12:12:54.448755 22525 raft_consensus.cc:606] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 LEADER]: Received request to transfer leadership to TS 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:54.450384 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:12:54.454420 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:54.455627 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:54.417232 22353 catalog_manager.cc:5697] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 20 to 22, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 22 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:12:54.462119 22353 catalog_manager.cc:5697] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 14 to 15, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 15 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:54.463503 22353 catalog_manager.cc:5697] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 16 to 24. New cstate: current_term: 24 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:54.468240 30033 raft_consensus.cc:993] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881: : Instructing follower 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:12:54.468892 30033 raft_consensus.cc:1081] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 LEADER]: Signalling peer 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:12:54.471172 22604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:45576
I20260709 12:12:54.471764 22604 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:54.472080 22604 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:54.494385 22421 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:54.495025 30120 consensus_queue.cc:1048] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:12:54.464923 22353 catalog_manager.cc:5697] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 18 to 19, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 19 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:54.500332 22353 catalog_manager.cc:5697] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 19 to 21, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 21 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:54.506520 22353 catalog_manager.cc:5697] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 14 to 15, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 15 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:54.508142 22454 raft_consensus.cc:2410] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 for term 30 because replica has last-logged OpId of term: 29 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 28 index: 18.
I20260709 12:12:54.508004 22353 catalog_manager.cc:5697] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 21 to 23, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 23 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:54.509589 22604 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:54.524314 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:54.525002 22454 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:54.524659 22604 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:54.532619 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:54.533241 22525 raft_consensus.cc:3055] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:54.533538 22525 raft_consensus.cc:740] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:54.509418 22353 catalog_manager.cc:5697] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 17 to 20, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 20 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:54.511420 22495 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:54.541056 22353 catalog_manager.cc:5697] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:54.550303 30024 raft_consensus.cc:2749] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 12:12:54.520692 30012 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:54.553574 22452 raft_consensus.cc:1275] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:12:54.554610 22353 catalog_manager.cc:5697] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 15 to 17, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 17 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:12:54.558545 22353 catalog_manager.cc:5697] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 19 to 21, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 21 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:54.534379 22525 consensus_queue.cc:260] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:54.558596 22454 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 22.
I20260709 12:12:54.569473 22525 raft_consensus.cc:3060] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:54.571175 22569 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:54.571981 29749 raft_consensus.cc:2804] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:54.572500 29749 raft_consensus.cc:697] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 22 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:54.573484 29749 consensus_queue.cc:237] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:54.584837 22353 catalog_manager.cc:5697] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:12:54.596246 22353 catalog_manager.cc:5697] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 17 to 18, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 18 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:54.599685 22353 catalog_manager.cc:5697] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 17 to 21, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 21 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:12:54.600492 30051 consensus_queue.cc:1048] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:54.609050 22353 catalog_manager.cc:5697] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 10 to 18, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 18 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:54.611541 22525 raft_consensus.cc:2468] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 22.
I20260709 12:12:54.631946 22353 catalog_manager.cc:5697] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 9 to 21. New cstate: current_term: 21 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:54.635166 22353 catalog_manager.cc:5697] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 18 to 23, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 23 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:54.639137 22353 catalog_manager.cc:5697] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 12 to 16, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 16 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:12:54.645553 22353 catalog_manager.cc:5697] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 20 to 21, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 21 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:54.662287 22353 catalog_manager.cc:5697] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 17 to 19, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 19 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:12:54.664901 30012 raft_consensus.cc:993] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f: : Instructing follower 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:12:54.666741 30012 raft_consensus.cc:1081] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 LEADER]: Signalling peer 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:12:54.667137 22353 catalog_manager.cc:5697] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 20 to 22, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 22 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:12:54.668463 22604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74d6480c61e542d583f6f89899989553"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:45562
I20260709 12:12:54.673318 22604 raft_consensus.cc:493] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:54.673698 22604 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:54.673758 22353 catalog_manager.cc:5697] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:54.693981 22604 raft_consensus.cc:515] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:54.695147 22353 catalog_manager.cc:5697] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 10 to 19, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 19 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:54.704613 22604 leader_election.cc:290] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:54.706295 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:54.706882 22525 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:54.705250 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d6480c61e542d583f6f89899989553" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:54.708112 22448 raft_consensus.cc:3055] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:54.708470 22448 raft_consensus.cc:740] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:54.709321 22448 consensus_queue.cc:260] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:54.710934 22448 raft_consensus.cc:3060] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:54.719666 22525 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 20.
I20260709 12:12:54.728964 22570 leader_election.cc:304] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:54.729820 29749 raft_consensus.cc:2804] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:54.730320 29749 raft_consensus.cc:697] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:54.731284 29749 consensus_queue.cc:237] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:54.761526 22448 raft_consensus.cc:2468] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 20.
I20260709 12:12:55.021184 22525 raft_consensus.cc:1275] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:12:55.022665 29749 consensus_queue.cc:1048] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:55.062829 22448 raft_consensus.cc:1275] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:12:55.068547 29749 consensus_queue.cc:1048] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:55.100173 22352 catalog_manager.cc:5697] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:55.108008 22352 catalog_manager.cc:5697] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: config changed from index 8 to -1, term changed from 12 to 6, leader changed from <none> to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129), VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) evicted. New cstate: current_term: 6 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:12:55.112918 22353 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55962 (request call id 348) took 2977 ms. Trace:
I20260709 12:12:55.113350 22353 rpcz_store.cc:276] 0709 12:12:52.135594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:52.691864 (+556270us) service_pool.cc:224] Handling call
0709 12:12:55.112843 (+2420979us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:54.779558 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:54.780265 (+   707us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:54.780316 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:12:54.780335 (+    19us) tablet.cc:662] Decoding operations
0709 12:12:54.783370 (+  3035us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:54.783483 (+   113us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:54.783513 (+    30us) tablet.cc:685] Acquiring locks for 31 operations
0709 12:12:54.797123 (+ 13610us) tablet.cc:701] Row locks acquired
0709 12:12:54.797179 (+    56us) write_op.cc:260] PREPARE: finished
0709 12:12:54.797385 (+   206us) write_op.cc:270] Start()
0709 12:12:54.797569 (+   184us) write_op.cc:276] Timestamp: P: 1783599174797311 usec, L: 0
0709 12:12:54.797610 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 12:12:54.798491 (+   881us) log.cc:844] Serialized 12245 byte log entry
0709 12:12:54.857395 (+ 58904us) op_driver.cc:464] REPLICATION: finished
0709 12:12:54.880900 (+ 23505us) write_op.cc:301] APPLY: starting
0709 12:12:54.881027 (+   127us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:54.936389 (+ 55362us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:54.936528 (+   139us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:54.999593 (+ 63065us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:55.000022 (+   429us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=62,key_file_lookups=62,delta_file_lookups=62,mrs_lookups=0
0709 12:12:55.000085 (+    63us) write_op.cc:312] APPLY: finished
0709 12:12:55.000660 (+   575us) log.cc:844] Serialized 268 byte log entry
0709 12:12:55.000848 (+   188us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:55.001076 (+   228us) write_op.cc:454] Released schema lock
0709 12:12:55.001158 (+    82us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:55.023851 (+ 22693us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:55.023900 (+    49us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":257309,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":23202,"apply.run_cpu_time_us":39519,"apply.run_wall_time_us":142930,"cfile_cache_hit":126,"cfile_cache_hit_bytes":133707,"num_ops":31,"prepare.queue_time_us":14275,"prepare.run_cpu_time_us":8658,"prepare.run_wall_time_us":45106,"raft.queue_time_us":25086,"raft.run_cpu_time_us":2511,"raft.run_wall_time_us":26105,"replication_time_us":59608,"thread_start_us":75124,"threads_started":4,"wal-append.queue_time_us":17127}]]}
I20260709 12:12:55.251595 22525 raft_consensus.cc:1275] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:55.254474 29749 consensus_queue.cc:1048] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:55.265007 22448 raft_consensus.cc:1275] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:55.266436 29749 consensus_queue.cc:1048] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:55.290297 22355 catalog_manager.cc:5697] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:55.292048 22355 catalog_manager.cc:5697] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: config changed from index -1 to 5, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New cstate: current_term: 6 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:12:55.306394 22355 catalog_manager.cc:5697] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
W20260709 12:12:55.311153 22352 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55980 (request call id 374) took 91350 ms (client timeout 15000 ms). Trace:
W20260709 12:12:55.311651 22352 rpcz_store.cc:269] 0709 12:11:23.960562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.960830 (+   268us) service_pool.cc:224] Handling call
0709 12:12:55.311043 (+91350213us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:55.147921 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:55.148561 (+   640us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:55.148611 (+    50us) write_op.cc:435] Acquired schema lock
0709 12:12:55.148629 (+    18us) tablet.cc:662] Decoding operations
0709 12:12:55.149109 (+   480us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:55.149169 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:55.149194 (+    25us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:12:55.149565 (+   371us) tablet.cc:701] Row locks acquired
0709 12:12:55.149584 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:12:55.149741 (+   157us) write_op.cc:270] Start()
0709 12:12:55.149865 (+   124us) write_op.cc:276] Timestamp: P: 1783599175149698 usec, L: 0
0709 12:12:55.149885 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:12:55.150624 (+   739us) log.cc:844] Serialized 930 byte log entry
0709 12:12:55.152439 (+  1815us) op_driver.cc:464] REPLICATION: finished
0709 12:12:55.154727 (+  2288us) write_op.cc:301] APPLY: starting
0709 12:12:55.154822 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:55.156323 (+  1501us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:55.156422 (+    99us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:55.157804 (+  1382us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:55.157969 (+   165us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 12:12:55.158019 (+    50us) write_op.cc:312] APPLY: finished
0709 12:12:55.158213 (+   194us) log.cc:844] Serialized 33 byte log entry
0709 12:12:55.158383 (+   170us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:55.158473 (+    90us) write_op.cc:454] Released schema lock
0709 12:12:55.158529 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:55.158876 (+   347us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:55.158907 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":212,"mutex_wait_us":213723,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":2042,"apply.run_cpu_time_us":4109,"apply.run_wall_time_us":4110,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8360,"num_ops":2,"prepare.queue_time_us":5074,"prepare.run_cpu_time_us":2961,"prepare.run_wall_time_us":2962,"replication_time_us":2403}]]}
I20260709 12:12:55.345755 23115 tablet_service.cc:1558] Processing DeleteTablet for tablet 82e7db06c6ff4d96853c60f0f42c09a8 with delete_type TABLET_DATA_TOMBSTONED (TS 8701cd5186a949538d8efafb5f987270 not found in new config with opid_index -1) from {username='slave'} at 127.0.0.1:60778
I20260709 12:12:55.372723 29749 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 29 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:55.373400 29749 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:55.376314 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:55.376999 22454 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 30.
I20260709 12:12:55.378347 22569 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:55.379635 30037 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:12:55.380045 30037 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 29 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:12:55.380430 30037 raft_consensus.cc:3060] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:12:55.385469 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:55.386269 22525 raft_consensus.cc:2393] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 30: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:55.387042 29749 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:55.400890 22353 catalog_manager.cc:5697] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:12:55.402392 22353 catalog_manager.cc:5697] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 17 to 20, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 20 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:55.403926 30172 tablet_replica.cc:333] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270: stopping tablet replica
I20260709 12:12:55.403721 22353 catalog_manager.cc:5697] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 14 to 16, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 16 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:12:55.405048 22353 catalog_manager.cc:5697] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 20 to 22, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 22 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:55.407038 22353 catalog_manager.cc:5697] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 21 to 22, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 22 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:12:55.408775 22353 catalog_manager.cc:5697] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 16 to 25, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 25 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:12:55.410511 22353 catalog_manager.cc:5697] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 14 to 17, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 17 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:55.414773 30037 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:55.418860 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:55.419620 22353 catalog_manager.cc:5697] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: config changed from index 5 to 8, term changed from 6 to 15, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132), 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:55.431510 30172 raft_consensus.cc:2243] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:12:55.433032 30172 raft_consensus.cc:2272] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:55.438201 22454 raft_consensus.cc:2468] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 30.
I20260709 12:12:55.439523 30037 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 30 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:55.441027 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:55.441798 22525 raft_consensus.cc:2393] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 30: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:55.439473 22569 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:55.445935 30172 ts_tablet_manager.cc:1916] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:12:55.444166 30037 raft_consensus.cc:2804] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:12:55.462340 30037 raft_consensus.cc:697] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 30 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:55.463467 30037 consensus_queue.cc:237] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 29.19, Last appended by leader: 19, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:12:55.482079 22355 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55980 (request call id 375) took 70493 ms (client timeout 15000 ms). Trace:
I20260709 12:12:55.507965 22350 catalog_manager.cc:5697] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 11 to 13, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 13 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:12:55.487937 22355 rpcz_store.cc:269] 0709 12:11:44.988222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:44.988463 (+   241us) service_pool.cc:224] Handling call
0709 12:12:55.363813 (+70375350us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:55.363842 (+    29us) write_op.cc:454] Released schema lock
0709 12:12:55.482001 (+118159us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:55.353671 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:55.354208 (+   537us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:55.354244 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:12:55.354261 (+    17us) tablet.cc:662] Decoding operations
0709 12:12:55.354767 (+   506us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:55.354822 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:55.354848 (+    26us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:12:55.355193 (+   345us) tablet.cc:701] Row locks acquired
0709 12:12:55.355212 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:12:55.355338 (+   126us) write_op.cc:270] Start()
0709 12:12:55.355451 (+   113us) write_op.cc:276] Timestamp: P: 1783599175355295 usec, L: 0
0709 12:12:55.355476 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:12:55.356116 (+   640us) log.cc:844] Serialized 1375 byte log entry
0709 12:12:55.358080 (+  1964us) op_driver.cc:464] REPLICATION: finished
0709 12:12:55.358507 (+   427us) write_op.cc:301] APPLY: starting
0709 12:12:55.358585 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:55.360383 (+  1798us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:55.360468 (+    85us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:55.362167 (+  1699us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:55.362332 (+   165us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 12:12:55.362376 (+    44us) write_op.cc:312] APPLY: finished
0709 12:12:55.362566 (+   190us) log.cc:844] Serialized 41 byte log entry
0709 12:12:55.362715 (+   149us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:55.362807 (+    92us) write_op.cc:454] Released schema lock
0709 12:12:55.362847 (+    40us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":64342,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":221,"apply.run_cpu_time_us":4644,"apply.run_wall_time_us":5167,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12540,"num_ops":3,"prepare.queue_time_us":21284,"prepare.run_cpu_time_us":2729,"prepare.run_wall_time_us":2729,"replication_time_us":2483}]]}
I20260709 12:12:55.516635 22350 catalog_manager.cc:5697] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:55.555155 22353 catalog_manager.cc:5697] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 14 to 20, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 20 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:12:55.560599 30172 ts_tablet_manager.cc:1929] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.11
I20260709 12:12:55.561192 30172 log.cc:1199] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270: Deleting WAL directory at /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-3-root/wals/82e7db06c6ff4d96853c60f0f42c09a8
I20260709 12:12:55.563158 22340 catalog_manager.cc:5028] TS 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): tablet 82e7db06c6ff4d96853c60f0f42c09a8 (table test-workload [id=1e73b97ba677488c8829a696096f4885]) successfully deleted
I20260709 12:12:55.582571 22346 catalog_manager.cc:5697] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 15 to 18, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 18 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:55.586561 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:55.585052 22346 catalog_manager.cc:5697] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 17 to 18, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 18 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:55.608489 22346 catalog_manager.cc:5697] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 13 to 18, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 18 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:55.623556 22346 catalog_manager.cc:5697] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 16 to 19, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 19 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:55.626840 22346 catalog_manager.cc:5697] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 14 to 19, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 19 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:55.628324 22346 catalog_manager.cc:5697] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 12 to 14, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 14 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:55.630527 22346 catalog_manager.cc:5697] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 10 to 18. New cstate: current_term: 18 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
W20260709 12:12:55.754071 22350 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55978 (request call id 336) took 55805 ms (client timeout 15000 ms). Trace:
W20260709 12:12:55.754470 22350 rpcz_store.cc:269] 0709 12:12:00.001533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.028327 (+ 26794us) service_pool.cc:224] Handling call
0709 12:12:55.541619 (+55513292us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:55.541645 (+    26us) write_op.cc:454] Released schema lock
0709 12:12:55.753656 (+212011us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:55.527519 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:55.528186 (+   667us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:55.528227 (+    41us) write_op.cc:435] Acquired schema lock
0709 12:12:55.528240 (+    13us) tablet.cc:662] Decoding operations
0709 12:12:55.528776 (+   536us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:55.528848 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:55.528898 (+    50us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:12:55.529329 (+   431us) tablet.cc:701] Row locks acquired
0709 12:12:55.529351 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:12:55.529535 (+   184us) write_op.cc:270] Start()
0709 12:12:55.529677 (+   142us) write_op.cc:276] Timestamp: P: 1783599175529483 usec, L: 0
0709 12:12:55.529701 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:12:55.530478 (+   777us) log.cc:844] Serialized 925 byte log entry
0709 12:12:55.532933 (+  2455us) op_driver.cc:464] REPLICATION: finished
0709 12:12:55.533476 (+   543us) write_op.cc:301] APPLY: starting
0709 12:12:55.533545 (+    69us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:55.534807 (+  1262us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:55.534890 (+    83us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:55.536916 (+  2026us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:55.537137 (+   221us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 12:12:55.537211 (+    74us) write_op.cc:312] APPLY: finished
0709 12:12:55.537482 (+   271us) log.cc:844] Serialized 33 byte log entry
0709 12:12:55.537693 (+   211us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:55.537810 (+   117us) write_op.cc:454] Released schema lock
0709 12:12:55.537866 (+    56us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":556316,"reported_tablets":46,"spinlock_wait_cycles":99200,"child_traces":[["op",{"apply.queue_time_us":315,"apply.run_cpu_time_us":4352,"apply.run_wall_time_us":4719,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8360,"num_ops":2,"prepare.queue_time_us":110,"prepare.run_cpu_time_us":3306,"prepare.run_wall_time_us":14010,"replication_time_us":3114,"spinlock_wait_cycles":2816}]]}
I20260709 12:12:55.764751 22349 catalog_manager.cc:5697] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 13 to 14, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 14 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:55.781940 22349 catalog_manager.cc:5697] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 14 to 16, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 16 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:55.784580 22349 catalog_manager.cc:5697] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 14 to 15, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 15 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:55.799849 22349 catalog_manager.cc:5697] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 15 to 19, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 19 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:55.811143 22528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00284432759445f6a017e6ddb9ec1689"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:46680
I20260709 12:12:55.811797 22528 raft_consensus.cc:606] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Received request to transfer leadership to TS 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:55.812127 22528 raft_consensus.cc:614] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:55.816057 22528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "041a72bc20f246bdb6e7cc6423d67e62"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:46680
I20260709 12:12:55.816743 22528 raft_consensus.cc:606] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Received request to transfer leadership to TS 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:55.817092 22528 raft_consensus.cc:614] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:55.824958 22528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13854b1cf45740e680c203d064295c78"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:46680
I20260709 12:12:55.826133 22528 raft_consensus.cc:606] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 LEADER]: Received request to transfer leadership to TS 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:55.827509 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
W20260709 12:12:55.832574 22346 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55980 (request call id 377) took 20161 ms (client timeout 15000 ms). Trace:
I20260709 12:12:55.844625 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:55.845953 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:12:55.913601 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 55369.8us
W20260709 12:12:55.916390 22349 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48412 (request call id 245) took 24523 ms (client timeout 15000 ms). Trace:
I20260709 12:12:55.935324 22448 raft_consensus.cc:1275] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 30 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 29 index: 19. Preceding OpId from leader: term: 30 index: 20. (index mismatch)
W20260709 12:12:55.833096 22346 rpcz_store.cc:269] 0709 12:12:35.772840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.838144 (+ 65304us) service_pool.cc:224] Handling call
0709 12:12:37.044472 (+1206328us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b54002eff38. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd06ece43 00007f9cd07eb04e 00007f9ccecac2a4 00007f9ccecac232 00007f9ccecac161 00007f9ccecac0dc 00007f9ccecab392 00007f9cc8c6948c 00007f9cc8c688c6 00007f9cc8c6826f
0709 12:12:55.832460 (+18787988us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:55.657862 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:55.658369 (+   507us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:55.658405 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:12:55.658428 (+    23us) tablet.cc:662] Decoding operations
0709 12:12:55.659248 (+   820us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:55.659304 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:55.659330 (+    26us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:12:55.659922 (+   592us) tablet.cc:701] Row locks acquired
0709 12:12:55.659941 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:12:55.660074 (+   133us) write_op.cc:270] Start()
0709 12:12:55.660182 (+   108us) write_op.cc:276] Timestamp: P: 1783599175660034 usec, L: 0
0709 12:12:55.660205 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:12:55.660816 (+   611us) log.cc:844] Serialized 2856 byte log entry
0709 12:12:55.662731 (+  1915us) op_driver.cc:464] REPLICATION: finished
0709 12:12:55.663148 (+   417us) write_op.cc:301] APPLY: starting
0709 12:12:55.663224 (+    76us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:55.683262 (+ 20038us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:55.683414 (+   152us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:55.695832 (+ 12418us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:55.696106 (+   274us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 12:12:55.696180 (+    74us) write_op.cc:312] APPLY: finished
0709 12:12:55.696537 (+   357us) log.cc:844] Serialized 73 byte log entry
0709 12:12:55.699238 (+  2701us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:55.699400 (+   162us) write_op.cc:454] Released schema lock
0709 12:12:55.699476 (+    76us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:55.726094 (+ 26618us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:55.726132 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":165142,"reported_tablets":47,"spinlock_wait_cycles":5357440,"child_traces":[["op",{"apply.queue_time_us":219,"apply.run_cpu_time_us":11929,"apply.run_wall_time_us":36676,"cfile_cache_hit":28,"cfile_cache_hit_bytes":29260,"num_ops":7,"prepare.queue_time_us":449,"prepare.run_cpu_time_us":3245,"prepare.run_wall_time_us":4783,"replication_time_us":2408}]]}
I20260709 12:12:55.940454 22351 catalog_manager.cc:5697] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:55.941095 22528 consensus_queue.cc:237] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:55.942924 22351 catalog_manager.cc:5697] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:55.945389 30037 consensus_queue.cc:1048] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:12:55.946925 22351 catalog_manager.cc:5697] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:12:55.916818 22349 rpcz_store.cc:269] 0709 12:12:31.387263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.387580 (+   317us) service_pool.cc:224] Handling call
0709 12:12:55.910415 (+24522835us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:55.805191 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:55.805842 (+   651us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:55.805890 (+    48us) write_op.cc:435] Acquired schema lock
0709 12:12:55.805910 (+    20us) tablet.cc:662] Decoding operations
0709 12:12:55.806653 (+   743us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:55.806711 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:55.806737 (+    26us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:12:55.807123 (+   386us) tablet.cc:701] Row locks acquired
0709 12:12:55.807141 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:12:55.807301 (+   160us) write_op.cc:270] Start()
0709 12:12:55.807776 (+   475us) write_op.cc:276] Timestamp: P: 1783599175807252 usec, L: 0
0709 12:12:55.807807 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 12:12:55.809904 (+  2097us) log.cc:844] Serialized 1698 byte log entry
0709 12:12:55.817792 (+  7888us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b18002b4f20. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cd0709ab1 00007f9cd0716281 00007f9cce36541d 00007f9cce36771a 00007f9cce3676a8 00007f9cce367628 00007f9cce3675e3 00007f9cce3667fc 00007f9cd07992f6 00007f9cd0793aa8 00007f9cca93a310
0709 12:12:55.817848 (+    56us) op_driver.cc:464] REPLICATION: finished
0709 12:12:55.818263 (+   415us) write_op.cc:301] APPLY: starting
0709 12:12:55.818358 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:55.821142 (+  2784us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:55.821174 (+    32us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:55.826632 (+  5458us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:55.826837 (+   205us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 12:12:55.826888 (+    51us) write_op.cc:312] APPLY: finished
0709 12:12:55.827153 (+   265us) log.cc:844] Serialized 49 byte log entry
0709 12:12:55.827937 (+   784us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:55.828045 (+   108us) write_op.cc:454] Released schema lock
0709 12:12:55.828088 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:55.830726 (+  2638us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:55.830761 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1135679,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":121,"apply.run_cpu_time_us":6454,"apply.run_wall_time_us":12402,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16720,"num_ops":4,"prepare.queue_time_us":106,"prepare.run_cpu_time_us":3756,"prepare.run_wall_time_us":8087,"replication_time_us":5780,"spinlock_wait_cycles":4202240}]]}
W20260709 12:12:55.991946 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 112660us
I20260709 12:12:56.044760 30123 raft_consensus.cc:993] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881: : Instructing follower 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:12:56.045324 30033 raft_consensus.cc:1081] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 LEADER]: Signalling peer 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:12:56.054559 22597 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13854b1cf45740e680c203d064295c78"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:45576
I20260709 12:12:56.055146 22597 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:56.055482 22597 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:56.097829 22349 catalog_manager.cc:5697] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 28 to 30. New cstate: current_term: 30 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } }
I20260709 12:12:56.098341 22597 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:56.221062 23124 raft_consensus.cc:1275] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:12:56.222342 22347 catalog_manager.cc:5697] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 14 to 18, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 18 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:56.257441 22597 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:56.258811 22351 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55978 (request call id 337) took 29638 ms (client timeout 15000 ms). Trace:
W20260709 12:12:56.259224 22351 rpcz_store.cc:269] 0709 12:12:26.621020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:26.621226 (+   206us) service_pool.cc:224] Handling call
0709 12:12:56.258744 (+29637518us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:55.969918 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:55.970606 (+   688us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:55.970655 (+    49us) write_op.cc:435] Acquired schema lock
0709 12:12:55.970676 (+    21us) tablet.cc:662] Decoding operations
0709 12:12:55.971474 (+   798us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:55.971535 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:55.971560 (+    25us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:12:55.971896 (+   336us) tablet.cc:701] Row locks acquired
0709 12:12:55.971908 (+    12us) write_op.cc:260] PREPARE: finished
0709 12:12:55.972037 (+   129us) write_op.cc:270] Start()
0709 12:12:55.972138 (+   101us) write_op.cc:276] Timestamp: P: 1783599175971995 usec, L: 0
0709 12:12:55.972154 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 12:12:55.972701 (+   547us) log.cc:844] Serialized 1311 byte log entry
0709 12:12:55.975839 (+  3138us) op_driver.cc:464] REPLICATION: finished
0709 12:12:55.976306 (+   467us) write_op.cc:301] APPLY: starting
0709 12:12:55.976377 (+    71us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:55.978173 (+  1796us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:55.978269 (+    96us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:55.980122 (+  1853us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:55.980300 (+   178us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 12:12:55.980345 (+    45us) write_op.cc:312] APPLY: finished
0709 12:12:55.980562 (+   217us) log.cc:844] Serialized 41 byte log entry
0709 12:12:55.991403 (+ 10841us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:55.991516 (+   113us) write_op.cc:454] Released schema lock
0709 12:12:55.991561 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:56.001085 (+  9524us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:56.003601 (+  2516us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6379,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":283,"apply.run_cpu_time_us":5029,"apply.run_wall_time_us":23605,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12540,"mutex_wait_us":6492,"num_ops":3,"prepare.queue_time_us":131,"prepare.run_cpu_time_us":2812,"prepare.run_wall_time_us":3070,"replication_time_us":3563}]]}
I20260709 12:12:56.290566 22525 raft_consensus.cc:1275] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 30 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 28 index: 18. Preceding OpId from leader: term: 30 index: 20. (index mismatch)
I20260709 12:12:56.313506 22347 catalog_manager.cc:5697] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 16 to 18, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 18 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:56.355528 29749 consensus_queue.cc:1048] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:12:56.362874 22347 catalog_manager.cc:5697] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:56.390990 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:56.401369 23124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13854b1cf45740e680c203d064295c78" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: true dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:56.370841 22347 catalog_manager.cc:5697] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:56.403827 22347 catalog_manager.cc:5697] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 18 to 20, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 20 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
W20260709 12:12:56.419883 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 44436.2us
I20260709 12:12:56.427423 22530 raft_consensus.cc:3055] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:56.427851 22530 raft_consensus.cc:740] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:56.429009 23124 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:56.406433 22347 catalog_manager.cc:5697] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 18 to 19, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 19 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:56.472275 22530 consensus_queue.cc:260] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:56.473379 22530 raft_consensus.cc:3060] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:56.475265 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 105137us
I20260709 12:12:56.485713 22530 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 20.
W20260709 12:12:56.487972 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 269369us
W20260709 12:12:56.492143 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 145878us
I20260709 12:12:56.501727 22347 catalog_manager.cc:5697] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:56.508500 22452 raft_consensus.cc:1275] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 12:12:56.586124 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 51550.5us
I20260709 12:12:56.591965 22347 catalog_manager.cc:5697] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 16 to 21. New cstate: current_term: 21 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:56.530787 30194 consensus_queue.cc:1048] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 12:12:56.644876 22347 catalog_manager.cc:5697] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
W20260709 12:12:56.648442 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 226433us
I20260709 12:12:56.649930 22347 catalog_manager.cc:5697] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:12:56.655191 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 67565.6us
I20260709 12:12:56.646522 30211 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:56.670248 23124 raft_consensus.cc:2468] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 20.
I20260709 12:12:56.689339 22570 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:56.722661 30024 consensus_queue.cc:1048] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:56.681105 30211 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:56.716557 30218 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:56.721446 30182 raft_consensus.cc:2804] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:12:56.766858 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 44456.3us
I20260709 12:12:56.750207 30218 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:12:56.788182 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 268235us
I20260709 12:12:56.791081 30199 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:56.791705 30199 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:56.792385 30218 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:56.794283 30199 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:56.797377 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:56.798014 22604 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 15.
I20260709 12:12:56.779395 30182 raft_consensus.cc:697] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:56.815685 30182 consensus_queue.cc:237] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:56.816565 30211 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:12:56.819790 22497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:56.821496 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:12:56.823765 22604 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
I20260709 12:12:56.841210 23116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:56.841809 23116 raft_consensus.cc:1803] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: voting while tombstoned based on last-logged opid 15.11
I20260709 12:12:56.842178 23116 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 15.
I20260709 12:12:56.843446 23124 raft_consensus.cc:1240] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Rejecting Update request from peer 1676e7af5e4a47cb86ee7db83e3d4881 for earlier term 19. Current term is 20. Ops: []
W20260709 12:12:56.911325 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 54459.8us
I20260709 12:12:56.917382 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:56.918215 22528 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 15.
I20260709 12:12:56.920552 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:56.921185 22454 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
I20260709 12:12:56.925369 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:56.925951 23121 raft_consensus.cc:1803] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: voting while tombstoned based on last-logged opid 15.11
I20260709 12:12:56.926311 23121 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 15.
I20260709 12:12:56.933830 22495 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:56.939198 30190 raft_consensus.cc:2804] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:56.939694 30190 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:56.940141 30190 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:56.948803 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 184435us
I20260709 12:12:56.949796 22421 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:56.951359 30185 raft_consensus.cc:2804] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:56.951798 30185 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:12:56.952176 30185 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:56.959259 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:56.967474 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:56.968232 23121 raft_consensus.cc:1803] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: voting while tombstoned based on last-logged opid 15.11
W20260709 12:12:56.968370 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 188318us
I20260709 12:12:56.968739 23121 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 15.
I20260709 12:12:56.970849 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:57.036569 30190 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:57.099711 22529 raft_consensus.cc:2393] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 16: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:57.101619 30190 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:57.104592 30185 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:57.107439 22454 raft_consensus.cc:2393] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 16: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:57.123039 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:57.123642 22604 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:57.130020 30179 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:12:57.156123 22604 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 16.
I20260709 12:12:57.157871 30185 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:57.130785 30179 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:57.164321 22526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:12:57.172014 30204 raft_consensus.cc:2955] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 LEADER]: Committing config change with OpId 19.12: config changed from index 4 to 12, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:57.176227 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:57.182024 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:57.182763 22604 raft_consensus.cc:2393] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 16: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:57.188318 22454 raft_consensus.cc:2393] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 16: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:57.189642 22570 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:57.192453 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:57.193214 22525 raft_consensus.cc:2393] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c863116d91c14d1ca50d6e8a46a37a8f in current term 16: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:12:57.194005 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:57.194519 23121 raft_consensus.cc:1803] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: voting while tombstoned based on last-logged opid 15.11
I20260709 12:12:57.194866 23121 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:57.203580 23120 raft_consensus.cc:2955] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index 4 to 12, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:57.207273 23121 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 16.
I20260709 12:12:57.214702 30223 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:57.221287 22452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" is_pre_election: true
I20260709 12:12:57.223618 22454 raft_consensus.cc:2955] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index 4 to 12, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:57.229439 22421 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:57.231153 30185 raft_consensus.cc:2804] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:57.231643 30185 raft_consensus.cc:697] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:57.232600 30185 consensus_queue.cc:237] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:57.250101 30179 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:57.255290 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:57.256337 22497 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:57.258576 30207 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:57.256074 23125 raft_consensus.cc:1803] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: voting while tombstoned based on last-logged opid 15.11
I20260709 12:12:57.260872 23125 raft_consensus.cc:2393] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 16: Already voted for candidate c863116d91c14d1ca50d6e8a46a37a8f in this term.
I20260709 12:12:57.263808 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:12:57.269204 22570 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:12:57.271004 30192 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:57.286720 30204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:46290 (request call id 0) took 1368 ms. Trace:
I20260709 12:12:57.287184 30204 rpcz_store.cc:276] 0709 12:12:55.917936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:55.918433 (+   497us) service_pool.cc:224] Handling call
0709 12:12:55.958666 (+ 40233us) log.cc:844] Serialized 508 byte log entry
0709 12:12:57.286621 (+1327955us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":160822,"raft.run_cpu_time_us":1158,"raft.run_wall_time_us":22876,"thread_start_us":283227,"threads_started":3,"wal-append.queue_time_us":349535}
I20260709 12:12:57.288856 22340 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 67b097456aac41edb06c5a4efd504ca1 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:12:57.299703 23120 raft_consensus.cc:1275] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:12:57.302440 22347 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48412 (request call id 246) took 5935 ms. Trace:
I20260709 12:12:57.309131 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:57.308332 22347 rpcz_store.cc:276] 0709 12:12:51.367214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:51.620672 (+253458us) service_pool.cc:224] Handling call
0709 12:12:51.829669 (+208997us) spinlock_profiling.cc:243] Waited 98.7 ms on lock 0x7b5400198a54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca898090 00007f9cca936f3a 00007f9cd06ece9c 00007f9cd07eb04e 00007f9ccecac2a4 00007f9ccecac232 00007f9ccecac161 00007f9ccecac0dc 00007f9ccecab392 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:57.302356 (+5472687us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:56.797873 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:56.799361 (+  1488us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:56.799397 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:12:56.799415 (+    18us) tablet.cc:662] Decoding operations
0709 12:12:56.957766 (+158351us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:56.962195 (+  4429us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:56.963806 (+  1611us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:12:57.108584 (+144778us) tablet.cc:701] Row locks acquired
0709 12:12:57.108605 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:12:57.108746 (+   141us) write_op.cc:270] Start()
0709 12:12:57.108878 (+   132us) write_op.cc:276] Timestamp: P: 1783599177108702 usec, L: 0
0709 12:12:57.108901 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:12:57.109460 (+   559us) log.cc:844] Serialized 4014 byte log entry
0709 12:12:57.130411 (+ 20951us) op_driver.cc:464] REPLICATION: finished
0709 12:12:57.131695 (+  1284us) write_op.cc:301] APPLY: starting
0709 12:12:57.131783 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:57.137233 (+  5450us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:57.147014 (+  9781us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:57.194971 (+ 47957us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:57.195263 (+   292us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 12:12:57.195317 (+    54us) write_op.cc:312] APPLY: finished
0709 12:12:57.195653 (+   336us) log.cc:844] Serialized 97 byte log entry
0709 12:12:57.199143 (+  3490us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:57.199271 (+   128us) write_op.cc:454] Released schema lock
0709 12:12:57.199321 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:57.222806 (+ 23485us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:57.222840 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":81351,"reported_tablets":41,"spinlock_wait_cycles":227000576,"child_traces":[["op",{"apply.queue_time_us":1055,"apply.run_cpu_time_us":13863,"apply.run_wall_time_us":79704,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45927,"num_ops":10,"prepare.queue_time_us":13968,"prepare.run_cpu_time_us":4968,"prepare.run_wall_time_us":311911,"replication_time_us":21355,"thread_start_us":45964,"threads_started":2}]]}
I20260709 12:12:57.311168 30215 consensus_queue.cc:1048] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:12:57.332336 22348 catalog_manager.cc:5697] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 12 to 17, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 17 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:57.334913 22348 catalog_manager.cc:5697] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 19 to 20, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 20 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:57.375208 22349 catalog_manager.cc:5697] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 15 to 16, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 16 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:57.379442 22349 catalog_manager.cc:5697] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: config changed from index 4 to 12, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New cstate: current_term: 19 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:57.428699 22525 raft_consensus.cc:1275] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:12:57.432046 30215 consensus_queue.cc:1048] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:12:57.436283 22354 catalog_manager.cc:5697] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 20 to 21, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 21 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:57.470110 22354 catalog_manager.cc:5697] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 19 to 23, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 23 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:57.545061 22354 catalog_manager.cc:5697] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 20 to 22, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 22 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:57.552815 22348 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55978 (request call id 338) took 11063 ms. Trace:
I20260709 12:12:57.548174 22354 catalog_manager.cc:5697] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 19 to 21, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 21 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:57.553239 22348 rpcz_store.cc:276] 0709 12:12:46.489969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:46.491376 (+  1407us) service_pool.cc:224] Handling call
0709 12:12:46.938973 (+447597us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b5400198a54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca898090 00007f9cca936f3a 00007f9cd06ece9c 00007f9cd07eb04e 00007f9ccecac2a4 00007f9ccecac232 00007f9ccecac161 00007f9ccecac0dc 00007f9ccecab392 00007f9cc8c6948c 00007f9cc8c688c6
0709 12:12:57.552738 (+10613765us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:57.341937 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:57.342482 (+   545us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:57.342510 (+    28us) write_op.cc:435] Acquired schema lock
0709 12:12:57.342523 (+    13us) tablet.cc:662] Decoding operations
0709 12:12:57.342907 (+   384us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:57.342960 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:57.343013 (+    53us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:12:57.343344 (+   331us) tablet.cc:701] Row locks acquired
0709 12:12:57.343365 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:12:57.343495 (+   130us) write_op.cc:270] Start()
0709 12:12:57.343593 (+    98us) write_op.cc:276] Timestamp: P: 1783599177343452 usec, L: 0
0709 12:12:57.343608 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 12:12:57.346210 (+  2602us) log.cc:844] Serialized 925 byte log entry
0709 12:12:57.348128 (+  1918us) op_driver.cc:464] REPLICATION: finished
0709 12:12:57.348441 (+   313us) write_op.cc:301] APPLY: starting
0709 12:12:57.348517 (+    76us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:57.348959 (+   442us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b5400198a54. stack: 00007f9cc780f343 00007f9cc780f240 00007f9cc719e1d4 00007f9cd0edc304 00007f9cd0edc299 00007f9cca897571 00007f9cca929e28 00007f9cce364581 00007f9cce363d58 00007f9cce3689f1 00007f9cce3689a9 00007f9cce368939 00007f9cce368901 00007f9cce367b2d 0000000000388634 0000000000388479
0709 12:12:57.349783 (+   824us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:57.349808 (+    25us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:57.350965 (+  1157us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:57.351172 (+   207us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 12:12:57.351214 (+    42us) write_op.cc:312] APPLY: finished
0709 12:12:57.351413 (+   199us) log.cc:844] Serialized 33 byte log entry
0709 12:12:57.351574 (+   161us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:57.351661 (+    87us) write_op.cc:454] Released schema lock
0709 12:12:57.351697 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:57.351981 (+   284us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:57.352006 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":38712,"reported_tablets":46,"spinlock_wait_cycles":684169472,"child_traces":[["op",{"apply.queue_time_us":95,"apply.run_cpu_time_us":3510,"apply.run_wall_time_us":3519,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8360,"num_ops":2,"prepare.queue_time_us":115,"prepare.run_cpu_time_us":5116,"prepare.run_wall_time_us":7263,"replication_time_us":4406,"spinlock_wait_cycles":4494208}]]}
I20260709 12:12:57.555405 22354 catalog_manager.cc:5697] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 21 to 22, leader changed from 8701cd5186a949538d8efafb5f987270 (127.20.196.132) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 22 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:57.612428 22594 tablet_service.cc:1558] Processing DeleteTablet for tablet 67b097456aac41edb06c5a4efd504ca1 with delete_type TABLET_DATA_TOMBSTONED (TS 6c6fa11e8ee34711b3551f0c670442bc not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:45354
I20260709 12:12:57.638214 22604 raft_consensus.cc:1275] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:12:57.642791 30203 consensus_queue.cc:1048] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:57.650915 22532 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ba02be77861491da7dbcfee1161e46c"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:46680
I20260709 12:12:57.651726 22532 raft_consensus.cc:606] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:12:57.652169 22532 raft_consensus.cc:614] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:57.659889 22349 catalog_manager.cc:5697] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 19 to 20, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 20 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:57.662257 22349 catalog_manager.cc:5697] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:57.663895 22349 catalog_manager.cc:5697] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 18 to 22, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 22 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:57.670099 22349 catalog_manager.cc:5697] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 21 to 23, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 23 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:57.669118 22354 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55980 (request call id 378) took 5494 ms. Trace:
I20260709 12:12:57.675381 22354 rpcz_store.cc:276] 0709 12:12:52.175170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:54.411132 (+2235962us) service_pool.cc:224] Handling call
0709 12:12:57.669049 (+3257917us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:57.583196 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:57.583967 (+   771us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:57.584000 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:12:57.584015 (+    15us) tablet.cc:662] Decoding operations
0709 12:12:57.584780 (+   765us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:57.584857 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:57.584897 (+    40us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:12:57.585638 (+   741us) tablet.cc:701] Row locks acquired
0709 12:12:57.585665 (+    27us) write_op.cc:260] PREPARE: finished
0709 12:12:57.585846 (+   181us) write_op.cc:270] Start()
0709 12:12:57.586000 (+   154us) write_op.cc:276] Timestamp: P: 1783599177585786 usec, L: 0
0709 12:12:57.586037 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 12:12:57.591043 (+  5006us) log.cc:844] Serialized 2084 byte log entry
0709 12:12:57.593132 (+  2089us) op_driver.cc:464] REPLICATION: finished
0709 12:12:57.593607 (+   475us) write_op.cc:301] APPLY: starting
0709 12:12:57.593708 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:57.596901 (+  3193us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:57.597106 (+   205us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:57.601072 (+  3966us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:57.601237 (+   165us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 12:12:57.601280 (+    43us) write_op.cc:312] APPLY: finished
0709 12:12:57.601511 (+   231us) log.cc:844] Serialized 57 byte log entry
0709 12:12:57.605557 (+  4046us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:57.612738 (+  7181us) write_op.cc:454] Released schema lock
0709 12:12:57.616124 (+  3386us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:57.628931 (+ 12807us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:57.628987 (+    56us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":64869,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":274,"apply.run_cpu_time_us":8517,"apply.run_wall_time_us":31267,"cfile_cache_hit":20,"cfile_cache_hit_bytes":20900,"num_ops":5,"prepare.queue_time_us":9656,"prepare.run_cpu_time_us":4080,"prepare.run_wall_time_us":8164,"replication_time_us":6971}]]}
I20260709 12:12:57.687029 22531 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
 from {username='slave'} at 127.0.0.1:46680
I20260709 12:12:57.687723 22531 raft_consensus.cc:606] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 LEADER]: Received request to transfer leadership to TS c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:57.701735 30237 tablet_replica.cc:333] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:12:57.702889 30237 raft_consensus.cc:2243] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:57.705000 30237 raft_consensus.cc:2272] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:57.745195 30237 ts_tablet_manager.cc:1916] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:12:57.750162 22531 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b955a164159b49b9bf083e35e340e323"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
mode: GRACEFUL
new_leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:46680
I20260709 12:12:57.750903 22531 raft_consensus.cc:606] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 LEADER]: Received request to transfer leadership to TS 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:12:57.754128 22532 raft_consensus.cc:1275] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:12:57.761647 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:12:57.768215 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:57.769117 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:57.785928 30176 consensus_queue.cc:1048] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
W20260709 12:12:57.853750 22421 consensus_peers.cc:597] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:57.872339 30190 raft_consensus.cc:993] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881: : Instructing follower c863116d91c14d1ca50d6e8a46a37a8f to start an election
I20260709 12:12:57.873219 30204 raft_consensus.cc:1081] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 LEADER]: Signalling peer c863116d91c14d1ca50d6e8a46a37a8f to start an election
I20260709 12:12:57.877445 22454 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
 from {username='slave'} at 127.0.0.1:51844
I20260709 12:12:57.877957 22454 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:57.878278 22454 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:57.912047 22454 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:57.915071 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:57.915668 22530 raft_consensus.cc:3055] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:57.916240 22530 raft_consensus.cc:740] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:57.917356 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:57.917971 23125 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:57.917361 22530 consensus_queue.cc:260] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:57.920044 22530 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:57.935365 23125 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 19.
I20260709 12:12:57.937631 22421 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:57.938532 30185 raft_consensus.cc:2804] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:57.939073 30185 raft_consensus.cc:697] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:57.939960 30185 consensus_queue.cc:237] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:57.939167 22530 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 19.
I20260709 12:12:57.937959 22454 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:57.991586 30237 ts_tablet_manager.cc:1929] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.11
I20260709 12:12:57.992081 30237 log.cc:1199] T 67b097456aac41edb06c5a4efd504ca1 P 6c6fa11e8ee34711b3551f0c670442bc: Deleting WAL directory at /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-2-root/wals/67b097456aac41edb06c5a4efd504ca1
I20260709 12:12:57.994052 22341 catalog_manager.cc:5028] TS 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): tablet 67b097456aac41edb06c5a4efd504ca1 (table test-workload [id=1e73b97ba677488c8829a696096f4885]) successfully deleted
I20260709 12:12:58.001312 22349 catalog_manager.cc:5697] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 18 to 19, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 19 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:58.169273 30211 raft_consensus.cc:993] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881: : Instructing follower 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:12:58.169816 30211 raft_consensus.cc:1081] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 LEADER]: Signalling peer 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:12:58.172276 22604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b955a164159b49b9bf083e35e340e323"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:45576
I20260709 12:12:58.172763 22604 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:58.173080 22604 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:58.188318 22604 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:58.214875 22454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:58.215571 22454 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:58.233368 22454 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 23.
I20260709 12:12:58.238185 22604 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 23 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:12:58.239071 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: true dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:12:58.239691 22525 raft_consensus.cc:3055] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:58.239990 22525 raft_consensus.cc:740] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:58.240056 22569 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:58.240978 30215 raft_consensus.cc:2804] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:58.240805 22525 consensus_queue.cc:260] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:58.242357 30215 raft_consensus.cc:697] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:58.243275 30215 consensus_queue.cc:237] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:58.248941 22525 raft_consensus.cc:3060] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:58.266379 22525 raft_consensus.cc:2468] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 23.
I20260709 12:12:58.330263 22348 catalog_manager.cc:5697] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 22 to 23, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 23 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:58.429534 30249 ts_tablet_manager.cc:933] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317)
I20260709 12:12:58.441666 30249 tablet_copy_client.cc:323] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270: tablet copy: Beginning tablet copy session from remote peer at address 127.20.196.129:42317
I20260709 12:12:58.443559 22467 tablet_copy_service.cc:140] P c863116d91c14d1ca50d6e8a46a37a8f: Received BeginTabletCopySession request for tablet 82e7db06c6ff4d96853c60f0f42c09a8 from peer 8701cd5186a949538d8efafb5f987270 ({username='slave'} at 127.0.0.1:34452)
I20260709 12:12:58.444110 22467 tablet_copy_service.cc:161] P c863116d91c14d1ca50d6e8a46a37a8f: Beginning new tablet copy session on tablet 82e7db06c6ff4d96853c60f0f42c09a8 from peer 8701cd5186a949538d8efafb5f987270 at {username='slave'} at 127.0.0.1:34452: session id = 8701cd5186a949538d8efafb5f987270-82e7db06c6ff4d96853c60f0f42c09a8
I20260709 12:12:58.478152 22467 tablet_copy_source_session.cc:215] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:12:58.481776 30249 ts_tablet_manager.cc:1916] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260709 12:12:58.500999 23120 raft_consensus.cc:1275] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:12:58.505867 30243 consensus_queue.cc:1048] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 12:12:58.517199 22525 raft_consensus.cc:1275] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:12:58.521281 30203 consensus_queue.cc:1048] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:12:58.623879 30249 ts_tablet_manager.cc:1929] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 15.11
I20260709 12:12:58.648015 22531 raft_consensus.cc:1275] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:12:58.657699 30222 consensus_queue.cc:1048] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:12:58.663439 30249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82e7db06c6ff4d96853c60f0f42c09a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:58.732796 22454 raft_consensus.cc:1275] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:12:58.737924 30179 consensus_queue.cc:1048] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:12:58.828552 30249 tablet_copy_client.cc:806] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 0 data blocks...
I20260709 12:12:58.829305 30249 tablet_copy_client.cc:670] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 1 WAL segments...
I20260709 12:12:58.839076 30249 tablet_copy_client.cc:538] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:12:58.877888 30249 tablet_bootstrap.cc:492] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270: Bootstrap starting.
I20260709 12:12:59.018862 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:59.239023 22454 consensus_queue.cc:237] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:59.261749 22531 raft_consensus.cc:1275] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:12:59.263724 30243 consensus_queue.cc:1048] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:12:59.269474 22421 consensus_peers.cc:597] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:59.276083 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 62057.7us
I20260709 12:12:59.284693 22605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1143406a95dd472688b2fe621abd815f"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:12:59.285321 22605 raft_consensus.cc:606] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 16 LEADER]: Received request to transfer leadership to TS 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:59.288198 22605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:12:59.288681 30249 tablet_bootstrap.cc:492] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:59.288718 22605 raft_consensus.cc:606] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 20 LEADER]: Received request to transfer leadership to TS 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:12:59.297950 22600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6334366811764682b0a491c130c68eed"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:12:59.298646 22600 raft_consensus.cc:606] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 20 LEADER]: Received request to transfer leadership to TS 8701cd5186a949538d8efafb5f987270
I20260709 12:12:59.301246 22600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
mode: GRACEFUL
new_leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
 from {username='slave'} at 127.0.0.1:60938
I20260709 12:12:59.301810 22600 raft_consensus.cc:606] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 LEADER]: Received request to transfer leadership to TS c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:12:59.301409 30249 tablet_bootstrap.cc:492] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270: Bootstrap complete.
I20260709 12:12:59.303104 30249 ts_tablet_manager.cc:1403] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270: Time spent bootstrapping tablet: real 0.425s	user 0.044s	sys 0.015s
I20260709 12:12:59.303251 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:12:59.311257 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:59.312043 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:59.336359 30249 raft_consensus.cc:359] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:59.337667 30249 raft_consensus.cc:740] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.338454 30249 consensus_queue.cc:260] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:59.348069 30271 raft_consensus.cc:2955] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 8 to 13, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:59.350224 22531 raft_consensus.cc:2955] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 8 to 13, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:59.359813 30249 ts_tablet_manager.cc:1434] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270: Time spent starting tablet: real 0.041s	user 0.003s	sys 0.004s
I20260709 12:12:59.365991 22467 tablet_copy_service.cc:342] P c863116d91c14d1ca50d6e8a46a37a8f: Request end of tablet copy session 8701cd5186a949538d8efafb5f987270-82e7db06c6ff4d96853c60f0f42c09a8 received from {username='slave'} at 127.0.0.1:34452
I20260709 12:12:59.366475 22467 tablet_copy_service.cc:434] P c863116d91c14d1ca50d6e8a46a37a8f: ending tablet copy session 8701cd5186a949538d8efafb5f987270-82e7db06c6ff4d96853c60f0f42c09a8 on tablet 82e7db06c6ff4d96853c60f0f42c09a8 with peer 8701cd5186a949538d8efafb5f987270
I20260709 12:12:59.416229 30264 raft_consensus.cc:993] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc: : Instructing follower 1676e7af5e4a47cb86ee7db83e3d4881 to start an election
I20260709 12:12:59.416752 30264 raft_consensus.cc:1081] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 20 LEADER]: Signalling peer 1676e7af5e4a47cb86ee7db83e3d4881 to start an election
I20260709 12:12:59.418561 22531 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:56942
I20260709 12:12:59.419170 22531 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:59.419684 22531 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:59.420320 22339 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 82e7db06c6ff4d96853c60f0f42c09a8 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:12:59.422585 22354 catalog_manager.cc:5697] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: config changed from index 8 to 13, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New cstate: current_term: 16 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:12:59.439735 30264 raft_consensus.cc:993] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc: : Instructing follower 1676e7af5e4a47cb86ee7db83e3d4881 to start an election
I20260709 12:12:59.440274 30264 raft_consensus.cc:993] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc: : Instructing follower 8701cd5186a949538d8efafb5f987270 to start an election
I20260709 12:12:59.440649 30264 raft_consensus.cc:1081] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 16 LEADER]: Signalling peer 1676e7af5e4a47cb86ee7db83e3d4881 to start an election
I20260709 12:12:59.440837 30265 raft_consensus.cc:1081] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 20 LEADER]: Signalling peer 8701cd5186a949538d8efafb5f987270 to start an election
I20260709 12:12:59.443708 22530 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1143406a95dd472688b2fe621abd815f"
dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
 from {username='slave'} at 127.0.0.1:56942
I20260709 12:12:59.444212 22530 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:59.444548 22530 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:59.450675 23120 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6334366811764682b0a491c130c68eed"
dest_uuid: "8701cd5186a949538d8efafb5f987270"
 from {username='slave'} at 127.0.0.1:57328
I20260709 12:12:59.451246 23120 raft_consensus.cc:493] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:59.451568 23120 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:59.459777 23120 raft_consensus.cc:515] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:59.463361 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: true dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:59.464010 22604 raft_consensus.cc:3055] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:59.464326 22604 raft_consensus.cc:740] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:59.463303 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6334366811764682b0a491c130c68eed" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:59.465672 22448 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:59.465052 22604 consensus_queue.cc:260] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:59.468508 22604 raft_consensus.cc:3060] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:59.473176 22448 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 21.
I20260709 12:12:59.475349 22531 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:59.480049 23120 leader_election.cc:290] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:59.481235 22530 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:59.485649 23087 leader_election.cc:304] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:59.486548 30266 raft_consensus.cc:2804] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:59.487146 30266 raft_consensus.cc:697] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 21 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:12:59.487963 30266 consensus_queue.cc:237] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:59.492748 22604 raft_consensus.cc:2468] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 21.
I20260709 12:12:59.495317 22531 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:59.495260 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: true dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:59.496052 22600 raft_consensus.cc:3055] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:59.496356 22600 raft_consensus.cc:740] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:59.497152 22600 consensus_queue.cc:260] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:59.498414 22600 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:59.496781 22530 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:12:59.495066 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:12:59.505967 22448 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:59.510725 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1143406a95dd472688b2fe621abd815f" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:59.511336 22597 raft_consensus.cc:3055] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:59.511617 22597 raft_consensus.cc:740] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:59.512302 22597 consensus_queue.cc:260] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:59.512543 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: true dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:59.513128 23120 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:59.513386 22597 raft_consensus.cc:3060] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:59.520870 22597 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 17.
I20260709 12:12:59.521925 22497 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:12:59.522768 30267 raft_consensus.cc:2804] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:59.523284 30267 raft_consensus.cc:697] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:59.524145 30267 consensus_queue.cc:237] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:12:59.530500 22600 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 21.
I20260709 12:12:59.531365 23120 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 21.
I20260709 12:12:59.532660 22496 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:12:59.533417 30261 raft_consensus.cc:2804] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:59.533949 30261 raft_consensus.cc:697] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:12:59.534566 22448 raft_consensus.cc:2468] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 17.
I20260709 12:12:59.534879 30261 consensus_queue.cc:237] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:59.571612 22349 catalog_manager.cc:5697] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 20 to 21, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 21 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:59.588568 22594 tablet_service.cc:1558] Processing DeleteTablet for tablet 82e7db06c6ff4d96853c60f0f42c09a8 with delete_type TABLET_DATA_TOMBSTONED (TS 6c6fa11e8ee34711b3551f0c670442bc not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:45354
I20260709 12:12:59.610327 22354 catalog_manager.cc:5697] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 16 to 17, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 17 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:59.612378 22354 catalog_manager.cc:5697] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 20 to 21, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 21 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:59.671921 30284 tablet_replica.cc:333] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:12:59.673889 30284 raft_consensus.cc:2243] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:59.674464 30284 raft_consensus.cc:2272] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.687748 30284 ts_tablet_manager.cc:1916] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:12:59.726370 30284 ts_tablet_manager.cc:1929] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.12
I20260709 12:12:59.740631 30284 log.cc:1199] T 82e7db06c6ff4d96853c60f0f42c09a8 P 6c6fa11e8ee34711b3551f0c670442bc: Deleting WAL directory at /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0/minicluster-data/ts-2-root/wals/82e7db06c6ff4d96853c60f0f42c09a8
I20260709 12:12:59.743575 22341 catalog_manager.cc:5028] TS 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): tablet 82e7db06c6ff4d96853c60f0f42c09a8 (table test-workload [id=1e73b97ba677488c8829a696096f4885]) successfully deleted
I20260709 12:12:59.784969 30270 raft_consensus.cc:993] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc: : Instructing follower c863116d91c14d1ca50d6e8a46a37a8f to start an election
I20260709 12:12:59.785668 30270 raft_consensus.cc:1081] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 LEADER]: Signalling peer c863116d91c14d1ca50d6e8a46a37a8f to start an election
I20260709 12:12:59.790828 22448 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
 from {username='slave'} at 127.0.0.1:51836
I20260709 12:12:59.791397 22448 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:59.791774 22448 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:59.782191 23125 raft_consensus.cc:2955] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 8 to 13, VOTER 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
W20260709 12:12:59.850517 30286 log.cc:927] Time spent T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:12:59.860981 22448 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:59.863960 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: true dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:12:59.864568 22597 raft_consensus.cc:3055] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:12:59.864877 22597 raft_consensus.cc:740] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:12:59.865599 22597 consensus_queue.cc:260] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 23.19, Last appended by leader: 19, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:59.874606 22597 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:59.931454 23120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: true dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:12:59.932161 23120 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:59.944219 23120 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 24.
I20260709 12:12:59.945406 22421 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:12:59.947269 22597 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c863116d91c14d1ca50d6e8a46a37a8f in term 24.
I20260709 12:12:59.947561 30269 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:12:59.948071 30269 raft_consensus.cc:697] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 24 LEADER]: Becoming Leader. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:12:59.949164 30269 consensus_queue.cc:237] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 23.19, Last appended by leader: 19, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:12:59.948107 22448 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 24 election: Requested vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:12:59.965342 23125 raft_consensus.cc:1275] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:12:59.968437 30261 consensus_queue.cc:1048] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:12:59.990830 22354 catalog_manager.cc:5697] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: term changed from 23 to 24, leader changed from 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131) to c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129). New cstate: current_term: 24 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:59.995329 22600 raft_consensus.cc:1275] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:59.999053 30261 consensus_queue.cc:1048] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:13:00.002626 22600 raft_consensus.cc:1275] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 12:13:00.004294 30266 consensus_queue.cc:1048] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:00.080037 22448 raft_consensus.cc:1275] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:13:00.087455 30291 consensus_queue.cc:1048] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:13:00.095665 22448 raft_consensus.cc:1275] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 12:13:00.099299 30251 consensus_queue.cc:1048] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:13:00.117180 22600 raft_consensus.cc:1275] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:13:00.128877 30261 consensus_queue.cc:1048] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:00.487186 22600 raft_consensus.cc:1275] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 24 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 23 index: 19. Preceding OpId from leader: term: 24 index: 20. (index mismatch)
I20260709 12:13:00.490155 30269 consensus_queue.cc:1048] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 12:13:00.571646 23120 raft_consensus.cc:1275] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 24 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 23 index: 19. Preceding OpId from leader: term: 24 index: 20. (index mismatch)
I20260709 12:13:00.581514 30271 consensus_queue.cc:1048] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 12:13:00.605338 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:00.738184 22454 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308"
dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
mode: GRACEFUL
new_leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:44568
I20260709 12:13:00.738797 22454 raft_consensus.cc:606] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 LEADER]: Received request to transfer leadership to TS 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:13:00.744365 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:13:00.746484 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:00.747264 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:13:00.795271 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 95398.4us
I20260709 12:13:00.879709 22454 consensus_queue.cc:237] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
W20260709 12:13:00.904824 22421 consensus_peers.cc:597] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0da3e85670e74df8af94383289960785. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:00.927325 22604 raft_consensus.cc:1275] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:13:00.933004 30302 consensus_queue.cc:1048] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:13:00.947664 22531 raft_consensus.cc:1275] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:13:00.949522 30203 consensus_queue.cc:1048] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:13:00.961090 30203 raft_consensus.cc:2955] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 LEADER]: Committing config change with OpId 22.16: config changed from index -1 to 16, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:13:00.967378 22604 raft_consensus.cc:2955] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index -1 to 16, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:13:00.972227 22531 raft_consensus.cc:2955] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index -1 to 16, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:13:01.008857 22354 catalog_manager.cc:5697] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: config changed from index -1 to 16, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New cstate: current_term: 22 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:13:01.095108 22454 consensus_queue.cc:237] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:13:01.127359 22604 raft_consensus.cc:1275] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
W20260709 12:13:01.129307 22421 consensus_peers.cc:597] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 174e3ddf6ee147d9b066ce86d1318882. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:01.129958 30269 consensus_queue.cc:1048] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:13:01.166819 22531 raft_consensus.cc:1275] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:13:01.169394 30269 consensus_queue.cc:1048] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:13:01.174049 30302 raft_consensus.cc:993] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f: : Instructing follower 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:13:01.174583 30302 raft_consensus.cc:1081] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 LEADER]: Signalling peer 6c6fa11e8ee34711b3551f0c670442bc to start an election
I20260709 12:13:01.178145 22600 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308"
dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
 from {username='slave'} at 127.0.0.1:45562
I20260709 12:13:01.178665 22600 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:01.179026 22600 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:01.187292 22600 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:01.190366 22448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "c863116d91c14d1ca50d6e8a46a37a8f"
I20260709 12:13:01.191026 22448 raft_consensus.cc:3055] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:01.191349 22448 raft_consensus.cc:740] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c863116d91c14d1ca50d6e8a46a37a8f, State: Running, Role: LEADER
I20260709 12:13:01.192200 22448 consensus_queue.cc:260] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:01.193780 22448 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:01.201885 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:13:01.202692 23125 raft_consensus.cc:3060] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:01.205233 22600 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:13:01.209980 22448 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 20.
I20260709 12:13:01.209899 22604 raft_consensus.cc:2955] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index -1 to 15, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:13:01.211511 22569 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f; no voters: 
I20260709 12:13:01.227602 22531 raft_consensus.cc:2955] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index -1 to 15, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:13:01.231139 30179 raft_consensus.cc:2804] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:01.201009 30269 raft_consensus.cc:2955] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 LEADER]: Committing config change with OpId 21.15: config changed from index -1 to 15, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:13:01.231771 30179 raft_consensus.cc:697] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:13:01.232781 30179 consensus_queue.cc:237] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:13:01.300829 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 52859.8us
I20260709 12:13:01.304880 23125 raft_consensus.cc:2468] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 20.
W20260709 12:13:01.337417 22422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 57875.5us
I20260709 12:13:01.353327 22348 catalog_manager.cc:5697] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f reported cstate change: config changed from index -1 to 15, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New cstate: current_term: 21 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:01.438014 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 57931.2us
I20260709 12:13:01.442473 22354 catalog_manager.cc:5697] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 19 to 20, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 20 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:01.467931 22531 consensus_queue.cc:237] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:13:01.479696 30329 ts_tablet_manager.cc:933] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317)
W20260709 12:13:01.491212 22496 consensus_peers.cc:597] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353): Couldn't send request to peer 8701cd5186a949538d8efafb5f987270. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5cd56edb2a504be8a2de859108bea8e2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:01.492350 22448 raft_consensus.cc:1275] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:13:01.494052 22604 raft_consensus.cc:1275] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:13:01.495458 30305 consensus_queue.cc:1048] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:01.506084 30305 consensus_queue.cc:1048] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:13:01.519872 30329 tablet_copy_client.cc:323] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270: tablet copy: Beginning tablet copy session from remote peer at address 127.20.196.129:42317
I20260709 12:13:01.524438 22467 tablet_copy_service.cc:140] P c863116d91c14d1ca50d6e8a46a37a8f: Received BeginTabletCopySession request for tablet 0da3e85670e74df8af94383289960785 from peer 8701cd5186a949538d8efafb5f987270 ({username='slave'} at 127.0.0.1:34452)
I20260709 12:13:01.524953 22467 tablet_copy_service.cc:161] P c863116d91c14d1ca50d6e8a46a37a8f: Beginning new tablet copy session on tablet 0da3e85670e74df8af94383289960785 from peer 8701cd5186a949538d8efafb5f987270 at {username='slave'} at 127.0.0.1:34452: session id = 8701cd5186a949538d8efafb5f987270-0da3e85670e74df8af94383289960785
I20260709 12:13:01.536684 22467 tablet_copy_source_session.cc:215] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:01.540778 30329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0da3e85670e74df8af94383289960785. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:01.539758 30294 raft_consensus.cc:2955] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 LEADER]: Committing config change with OpId 22.15: config changed from index -1 to 15, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:13:01.547574 22600 raft_consensus.cc:2955] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index -1 to 15, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:13:01.558923 22448 raft_consensus.cc:2955] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index -1 to 15, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:13:01.575547 30329 tablet_copy_client.cc:806] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:01.579370 30329 tablet_copy_client.cc:670] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:01.577831 22348 catalog_manager.cc:5697] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: config changed from index -1 to 15, NON_VOTER 8701cd5186a949538d8efafb5f987270 (127.20.196.132) added. New cstate: current_term: 22 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } } }
I20260709 12:13:01.588155 30329 tablet_copy_client.cc:538] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:01.614645 30329 tablet_bootstrap.cc:492] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270: Bootstrap starting.
I20260709 12:13:01.745028 30336 ts_tablet_manager.cc:933] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317)
I20260709 12:13:01.745112 22448 raft_consensus.cc:1275] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:13:01.767783 30325 consensus_queue.cc:1048] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:13:01.789194 23125 raft_consensus.cc:1275] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:13:01.790846 30310 consensus_queue.cc:1048] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:01.805197 30336 tablet_copy_client.cc:323] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270: tablet copy: Beginning tablet copy session from remote peer at address 127.20.196.129:42317
I20260709 12:13:01.807555 22467 tablet_copy_service.cc:140] P c863116d91c14d1ca50d6e8a46a37a8f: Received BeginTabletCopySession request for tablet 174e3ddf6ee147d9b066ce86d1318882 from peer 8701cd5186a949538d8efafb5f987270 ({username='slave'} at 127.0.0.1:34452)
I20260709 12:13:01.808049 22467 tablet_copy_service.cc:161] P c863116d91c14d1ca50d6e8a46a37a8f: Beginning new tablet copy session on tablet 174e3ddf6ee147d9b066ce86d1318882 from peer 8701cd5186a949538d8efafb5f987270 at {username='slave'} at 127.0.0.1:34452: session id = 8701cd5186a949538d8efafb5f987270-174e3ddf6ee147d9b066ce86d1318882
I20260709 12:13:01.819802 22467 tablet_copy_source_session.cc:215] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:01.823534 30336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 174e3ddf6ee147d9b066ce86d1318882. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:01.849495 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:01.872272 30336 tablet_copy_client.cc:806] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:01.873067 30336 tablet_copy_client.cc:670] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:01.884928 30336 tablet_copy_client.cc:538] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:01.896260 30329 tablet_bootstrap.cc:492] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270: Bootstrap replayed 1/1 log segments. Stats: ops{read=17 overwritten=1 applied=16 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:01.898104 30329 tablet_bootstrap.cc:492] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270: Bootstrap complete.
I20260709 12:13:01.903550 30329 ts_tablet_manager.cc:1403] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270: Time spent bootstrapping tablet: real 0.289s	user 0.046s	sys 0.015s
I20260709 12:13:01.925930 30329 raft_consensus.cc:359] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270 [term 22 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:13:01.926934 30329 raft_consensus.cc:740] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270 [term 22 LEARNER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Initialized, Role: LEARNER
I20260709 12:13:01.937263 30329 consensus_queue.cc:260] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:13:01.953151 30329 ts_tablet_manager.cc:1434] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:13:01.948848 30336 tablet_bootstrap.cc:492] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270: Bootstrap starting.
I20260709 12:13:01.956667 22467 tablet_copy_service.cc:342] P c863116d91c14d1ca50d6e8a46a37a8f: Request end of tablet copy session 8701cd5186a949538d8efafb5f987270-0da3e85670e74df8af94383289960785 received from {username='slave'} at 127.0.0.1:34452
I20260709 12:13:01.957254 22467 tablet_copy_service.cc:434] P c863116d91c14d1ca50d6e8a46a37a8f: ending tablet copy session 8701cd5186a949538d8efafb5f987270-0da3e85670e74df8af94383289960785 on tablet 0da3e85670e74df8af94383289960785 with peer 8701cd5186a949538d8efafb5f987270
I20260709 12:13:01.990080 30329 ts_tablet_manager.cc:933] T 5cd56edb2a504be8a2de859108bea8e2 P 8701cd5186a949538d8efafb5f987270: Initiating tablet copy from peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:13:02.007159 23121 raft_consensus.cc:1217] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270 [term 22 LEARNER]: Deduplicated request from leader. Original: 22.15->[22.16-22.16]   Dedup: 22.16->[]
I20260709 12:13:02.023357 30329 tablet_copy_client.cc:323] T 5cd56edb2a504be8a2de859108bea8e2 P 8701cd5186a949538d8efafb5f987270: tablet copy: Beginning tablet copy session from remote peer at address 127.20.196.130:42733
I20260709 12:13:02.025242 22542 tablet_copy_service.cc:140] P 1676e7af5e4a47cb86ee7db83e3d4881: Received BeginTabletCopySession request for tablet 5cd56edb2a504be8a2de859108bea8e2 from peer 8701cd5186a949538d8efafb5f987270 ({username='slave'} at 127.0.0.1:38310)
I20260709 12:13:02.025871 22542 tablet_copy_service.cc:161] P 1676e7af5e4a47cb86ee7db83e3d4881: Beginning new tablet copy session on tablet 5cd56edb2a504be8a2de859108bea8e2 from peer 8701cd5186a949538d8efafb5f987270 at {username='slave'} at 127.0.0.1:38310: session id = 8701cd5186a949538d8efafb5f987270-5cd56edb2a504be8a2de859108bea8e2
I20260709 12:13:02.036132 22542 tablet_copy_source_session.cc:215] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:02.059868 30329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cd56edb2a504be8a2de859108bea8e2. 1 dirs total, 0 dirs full, 0 dirs failed
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:461: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 1
I20260709 12:13:02.112036 21266 tablet_server.cc:179] TabletServer@127.20.196.129:0 shutting down...
I20260709 12:13:02.131124 30329 tablet_copy_client.cc:806] T 5cd56edb2a504be8a2de859108bea8e2 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:02.135133 30329 tablet_copy_client.cc:670] T 5cd56edb2a504be8a2de859108bea8e2 P 8701cd5186a949538d8efafb5f987270: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:02.141196 30329 tablet_copy_client.cc:538] T 5cd56edb2a504be8a2de859108bea8e2 P 8701cd5186a949538d8efafb5f987270: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:13:02.141533 22495 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
I20260709 12:13:02.182322 30329 tablet_bootstrap.cc:492] T 5cd56edb2a504be8a2de859108bea8e2 P 8701cd5186a949538d8efafb5f987270: Bootstrap starting.
W20260709 12:13:02.198351 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 53182.2us
W20260709 12:13:02.215755 22495 consensus_peers.cc:597] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:02.217180 21266 tablet_copy_service.cc:362] P c863116d91c14d1ca50d6e8a46a37a8f: Destroying tablet copy session 8701cd5186a949538d8efafb5f987270-174e3ddf6ee147d9b066ce86d1318882 due to service shutdown
I20260709 12:13:02.217679 21266 tablet_copy_service.cc:434] P c863116d91c14d1ca50d6e8a46a37a8f: ending tablet copy session 8701cd5186a949538d8efafb5f987270-174e3ddf6ee147d9b066ce86d1318882 on tablet 174e3ddf6ee147d9b066ce86d1318882 with peer 8701cd5186a949538d8efafb5f987270
W20260709 12:13:02.237424 23087 consensus_peers.cc:597] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:02.239286 23087 consensus_peers.cc:597] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:02.245138 23087 consensus_peers.cc:597] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:02.255424 23087 consensus_peers.cc:597] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:02.321831 30336 tablet_bootstrap.cc:492] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=1 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:02.325383 30336 tablet_bootstrap.cc:492] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270: Bootstrap complete.
W20260709 12:13:02.332996 22495 consensus_peers.cc:597] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:02.311357 22569 consensus_peers.cc:597] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:02.336401 30336 ts_tablet_manager.cc:1403] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270: Time spent bootstrapping tablet: real 0.388s	user 0.041s	sys 0.035s
W20260709 12:13:02.365602 22495 consensus_peers.cc:597] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:02.368427 30336 raft_consensus.cc:359] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270 [term 21 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:13:02.375339 30336 raft_consensus.cc:740] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270 [term 21 LEARNER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Initialized, Role: LEARNER
W20260709 12:13:02.381726 22569 consensus_peers.cc:597] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:02.383582 30336 consensus_queue.cc:260] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:13:02.389499 30336 ts_tablet_manager.cc:1434] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.001s
W20260709 12:13:02.403724 23087 consensus_peers.cc:597] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:02.404953 23087 consensus_peers.cc:597] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:02.414824 22569 consensus_peers.cc:597] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:02.382313 22495 consensus_peers.cc:597] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:02.431046 22569 consensus_peers.cc:597] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:02.434473 22569 consensus_peers.cc:597] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:02.435544 22495 consensus_peers.cc:597] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:02.446285 22569 consensus_peers.cc:597] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:02.454010 22569 consensus_peers.cc:597] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:02.464417 23087 consensus_peers.cc:597] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:02.473019 22495 consensus_peers.cc:597] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:02.499251 23087 consensus_peers.cc:597] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:02.509359 22495 consensus_peers.cc:597] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:02.513839 21266 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:02.517632 21266 tablet_replica.cc:333] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
W20260709 12:13:02.517755 22495 consensus_peers.cc:597] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:02.521435 21266 raft_consensus.cc:2243] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:02.523008 30203 raft_consensus.cc:1064] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
I20260709 12:13:02.525619 21266 raft_consensus.cc:2272] T 6334366811764682b0a491c130c68eed P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:02.526006 30203 consensus_queue.cc:237] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 14, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:13:02.531759 23087 consensus_peers.cc:597] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:02.549803 21266 tablet_replica.cc:333] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
W20260709 12:13:02.553706 22495 consensus_peers.cc:597] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:02.554080 22569 consensus_peers.cc:597] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:02.554517 21266 raft_consensus.cc:2243] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 24 LEADER]: Raft consensus shutting down.
W20260709 12:13:02.554811 22569 consensus_peers.cc:597] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:02.555883 21266 raft_consensus.cc:2272] T b41723f4983d46d0bf385fae671d9a04 P c863116d91c14d1ca50d6e8a46a37a8f [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:02.557991 23125 raft_consensus.cc:1217] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270 [term 21 LEARNER]: Deduplicated request from leader. Original: 21.14->[21.15-21.15]   Dedup: 21.15->[]
I20260709 12:13:02.561808 21266 tablet_replica.cc:333] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:13:02.562806 21266 raft_consensus.cc:2243] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:02.564646 21266 raft_consensus.cc:2272] T 62319c9e82134e7daf8a46f78c124bff P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:02.575004 22495 consensus_peers.cc:597] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:02.578593 22495 consensus_peers.cc:597] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:02.587760 22604 raft_consensus.cc:1275] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:13:02.589797 22532 raft_consensus.cc:1275] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:13:02.594265 23125 raft_consensus.cc:1275] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270 [term 22 LEARNER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:13:02.596246 30271 consensus_queue.cc:1048] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:02.601300 21266 tablet_replica.cc:333] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:13:02.609006 21266 raft_consensus.cc:2243] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:02.610445 30352 consensus_queue.cc:1048] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:02.613665 30329 tablet_bootstrap.cc:492] T 5cd56edb2a504be8a2de859108bea8e2 P 8701cd5186a949538d8efafb5f987270: Bootstrap replayed 1/1 log segments. Stats: ops{read=17 overwritten=2 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:02.616680 30203 consensus_queue.cc:1048] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:13:02.620036 30329 tablet_bootstrap.cc:492] T 5cd56edb2a504be8a2de859108bea8e2 P 8701cd5186a949538d8efafb5f987270: Bootstrap complete.
I20260709 12:13:02.620868 30329 ts_tablet_manager.cc:1403] T 5cd56edb2a504be8a2de859108bea8e2 P 8701cd5186a949538d8efafb5f987270: Time spent bootstrapping tablet: real 0.439s	user 0.048s	sys 0.012s
I20260709 12:13:02.622823 21266 raft_consensus.cc:2272] T bb7fd922979743428612619e8de33af1 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:02.626389 21266 tablet_replica.cc:333] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:13:02.628643 30329 raft_consensus.cc:359] T 5cd56edb2a504be8a2de859108bea8e2 P 8701cd5186a949538d8efafb5f987270 [term 22 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:13:02.636823 30329 raft_consensus.cc:740] T 5cd56edb2a504be8a2de859108bea8e2 P 8701cd5186a949538d8efafb5f987270 [term 22 LEARNER]: Becoming Follower/Learner. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Initialized, Role: LEARNER
I20260709 12:13:02.637871 30329 consensus_queue.cc:260] T 5cd56edb2a504be8a2de859108bea8e2 P 8701cd5186a949538d8efafb5f987270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:13:02.640879 21266 raft_consensus.cc:2243] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:02.675161 21266 raft_consensus.cc:2272] T 1143406a95dd472688b2fe621abd815f P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:02.689447 30329 ts_tablet_manager.cc:1434] T 5cd56edb2a504be8a2de859108bea8e2 P 8701cd5186a949538d8efafb5f987270: Time spent starting tablet: real 0.068s	user 0.006s	sys 0.000s
W20260709 12:13:02.693109 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 43638.7us
I20260709 12:13:02.699309 22542 tablet_copy_service.cc:342] P 1676e7af5e4a47cb86ee7db83e3d4881: Request end of tablet copy session 8701cd5186a949538d8efafb5f987270-5cd56edb2a504be8a2de859108bea8e2 received from {username='slave'} at 127.0.0.1:38310
I20260709 12:13:02.726609 22542 tablet_copy_service.cc:434] P 1676e7af5e4a47cb86ee7db83e3d4881: ending tablet copy session 8701cd5186a949538d8efafb5f987270-5cd56edb2a504be8a2de859108bea8e2 on tablet 5cd56edb2a504be8a2de859108bea8e2 with peer 8701cd5186a949538d8efafb5f987270
I20260709 12:13:02.769795 21266 tablet_replica.cc:333] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:13:02.771126 21266 raft_consensus.cc:2243] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:02.771857 21266 raft_consensus.cc:2272] T 5b50f0bec71f4924aa1781b9818f1d73 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:02.816921 21266 tablet_replica.cc:333] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:13:02.817780 21266 raft_consensus.cc:2243] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:13:02.885850 21266 raft_consensus.cc:2272] T f00721a4978a43d1af483d9f52de30bc P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:02.889140 21266 tablet_replica.cc:333] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:13:02.914891 21266 raft_consensus.cc:2243] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:02.951187 21266 raft_consensus.cc:2272] T 3aebfd8b04a4461ab6bc979eee23a2bc P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:02.956996 30354 raft_consensus.cc:2955] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 LEADER]: Committing config change with OpId 22.17: config changed from index 16 to 17, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
W20260709 12:13:03.031209 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 253907us
I20260709 12:13:03.101320 21266 tablet_replica.cc:333] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:13:03.102532 21266 raft_consensus.cc:2243] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 12:13:03.113575 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 402859us
I20260709 12:13:03.117833 23125 raft_consensus.cc:2955] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Committing config change with OpId 22.17: config changed from index 16 to 17, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
W20260709 12:13:03.153823 23087 consensus_peers.cc:597] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:03.167199 21266 raft_consensus.cc:2272] T 10ed4486435d4f82978c5cb544504999 P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:03.169185 22420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:03.170331 21266 tablet_replica.cc:333] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:13:03.183442 21266 raft_consensus.cc:2243] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:03.184114 21266 raft_consensus.cc:2272] T 74d6480c61e542d583f6f89899989553 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:03.171301 22597 raft_consensus.cc:2955] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Committing config change with OpId 22.17: config changed from index 16 to 17, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
W20260709 12:13:03.208187 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 85541.9us
I20260709 12:13:03.261107 30243 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:03.261854 30243 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:13:03.263814 30271 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:03.264343 30243 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:13:03.264364 30271 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:13:03.267086 30271 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:13:03.269254 30351 raft_consensus.cc:493] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:13:03.269775 30351 raft_consensus.cc:515] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:03.272087 30351 leader_election.cc:290] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:13:03.277700 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:13:03.279109 30271 raft_consensus.cc:493] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:13:03.279762 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:13:03.281749 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b196b03fbcb045da91c663d6595b2775" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:13:03.282998 30271 raft_consensus.cc:515] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:03.286198 30352 raft_consensus.cc:493] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:13:03.286733 30352 raft_consensus.cc:515] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:13:03.288935 30352 leader_election.cc:290] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:13:03.290911 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:13:03.293645 22421 leader_election.cc:304] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:13:03.299934 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:13:03.307843 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:13:03.298658 30203 raft_consensus.cc:2749] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:03.310768 30351 raft_consensus.cc:493] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:13:03.311373 30351 raft_consensus.cc:515] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:03.313736 30353 raft_consensus.cc:1064] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
I20260709 12:13:03.291750 30271 leader_election.cc:290] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:13:03.316457 30353 consensus_queue.cc:237] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 13, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:03.319657 21266 tablet_replica.cc:333] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:13:03.320678 21266 raft_consensus.cc:2243] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:13:03.321702 21266 raft_consensus.cc:2272] T a2337c1c696448c287a9a1885624d3d0 P c863116d91c14d1ca50d6e8a46a37a8f [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:03.327555 30351 leader_election.cc:290] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:13:03.328671 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:13:03.334766 21266 tablet_replica.cc:333] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:13:03.336632 30352 raft_consensus.cc:493] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:13:03.337160 30352 raft_consensus.cc:515] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:13:03.337947 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7e3d0e753849fcb1514dc105ababfd" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:13:03.338958 30203 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:13:03.339476 30203 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:03.341488 30203 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:13:03.344303 30351 raft_consensus.cc:493] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:13:03.344411 22422 leader_election.cc:304] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:13:03.344817 30351 raft_consensus.cc:515] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:03.346078 30243 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:03.346551 30243 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:13:03.348129 30368 raft_consensus.cc:2749] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:03.348531 30243 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:13:03.350493 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:13:03.350889 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:13:03.351215 22498 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.20.196.190:44877, user_credentials={real_user=slave}} blocked reactor thread for 111089us
I20260709 12:13:03.352763 30351 leader_election.cc:290] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:13:03.352972 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:13:03.354523 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c23033521664ca6a0c00a6f0f552308" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:13:03.356338 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384260c96247e0ac31ade25baddaff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:13:03.357654 21266 raft_consensus.cc:2243] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:03.359419 21266 raft_consensus.cc:2272] T 4e5929206e89419f978fa0283f6bb931 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:03.368285 21266 tablet_replica.cc:333] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:13:03.362141 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:13:03.358156 30352 leader_election.cc:290] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:13:03.362596 30203 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:03.363274 30354 raft_consensus.cc:493] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:13:03.387521 30203 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:03.387897 30354 raft_consensus.cc:515] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:13:03.390199 30354 leader_election.cc:290] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:13:03.391590 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:13:03.360858 22422 leader_election.cc:304] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
W20260709 12:13:03.371254 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 131491us
I20260709 12:13:03.393482 30203 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:13:03.393958 30354 raft_consensus.cc:2749] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:13:03.393381 22422 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:13:03.396987 30354 raft_consensus.cc:2749] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:03.401213 23121 raft_consensus.cc:1275] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270 [term 21 LEARNER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:13:03.406649 21266 raft_consensus.cc:2243] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:03.383054 22525 raft_consensus.cc:2955] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Committing config change with OpId 22.17: config changed from index 16 to 17, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:13:03.413120 22605 raft_consensus.cc:1275] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:13:03.410693 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5dc015a7ef4e1daba3ed653d8ce7f9" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:13:03.418242 22348 catalog_manager.cc:5697] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270 reported cstate change: config changed from index 16 to 17, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New cstate: current_term: 22 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:13:03.409386 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:13:03.421052 30354 consensus_queue.cc:1048] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:13:03.422583 30203 raft_consensus.cc:493] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:13:03.423178 30203 raft_consensus.cc:515] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:13:03.425252 30203 leader_election.cc:290] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:13:03.428304 30203 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
W20260709 12:13:03.371098 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 155331us
I20260709 12:13:03.432328 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 31 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:13:03.436105 21266 raft_consensus.cc:2272] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:03.438489 22531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19a99176cd014d618ba1793fbb19aeab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:13:03.439636 22532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d328826e9a04a61be5bfb46dcfa77ab" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:13:03.440526 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88417720c1014406ad04d7fb6b8f7ab4" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:13:03.440578 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8d73c903fd41f7b207be9ca1cada33" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:13:03.441989 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871e4d35e385425cb2fe5d84b8d4fd45" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:13:03.442947 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36f3a080ce7465b8491197cc6189444" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:13:03.443511 22422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:03.428860 30203 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:13:03.448666 30203 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:13:03.449184 30353 consensus_queue.cc:1048] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:13:03.457404 30352 raft_consensus.cc:493] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:13:03.457926 30352 raft_consensus.cc:515] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:13:03.461130 30352 leader_election.cc:290] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:13:03.468928 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254fb9df2b39405996039a40091b4875" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:13:03.471573 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:13:03.477169 30203 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:13:03.478024 30203 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:03.497781 30203 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:13:03.488749 30360 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:03.492621 22529 raft_consensus.cc:1275] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Refusing update from remote peer c863116d91c14d1ca50d6e8a46a37a8f: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:13:03.494055 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b2392d4861b4d40b63dcdab54e716de" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 31 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:13:03.453855 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:13:03.498698 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:13:03.500149 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc6a19d6fc4ae7b122bc59c5d22aa0" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:13:03.501155 30354 raft_consensus.cc:493] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:13:03.502280 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b3fe7a04b74137b559ad33a85cddff" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:13:03.503614 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b955a164159b49b9bf083e35e340e323" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:13:03.504585 23125 raft_consensus.cc:1217] T 5cd56edb2a504be8a2de859108bea8e2 P 8701cd5186a949538d8efafb5f987270 [term 22 LEARNER]: Deduplicated request from leader. Original: 22.14->[22.15-22.15]   Dedup: 22.15->[]
I20260709 12:13:03.520977 30352 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:03.540673 30352 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:03.541046 22422 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:13:03.541947 30363 raft_consensus.cc:2749] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:03.542862 30352 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:13:03.521703 30353 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:03.543598 30353 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: NON_VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: true } }
I20260709 12:13:03.545827 30353 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:13:03.528774 22604 raft_consensus.cc:2955] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Committing config change with OpId 21.16: config changed from index 15 to 16, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:13:03.523519 30271 raft_consensus.cc:2955] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 LEADER]: Committing config change with OpId 21.16: config changed from index 15 to 16, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:13:03.548573 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:13:03.550014 22421 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:13:03.534525 30360 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:03.551721 30203 raft_consensus.cc:2749] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:03.552966 30360 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:13:03.553231 22421 leader_election.cc:304] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:13:03.554420 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:13:03.554703 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 25 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:13:03.554405 30353 raft_consensus.cc:2749] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:03.556542 22421 leader_election.cc:304] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:13:03.557605 30353 raft_consensus.cc:2749] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:13:03.559357 22421 leader_election.cc:304] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:13:03.561857 30353 raft_consensus.cc:2749] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:03.539803 30354 raft_consensus.cc:515] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:13:03.560660 22569 leader_election.cc:336] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:03.563570 22569 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:03.560879 22421 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:13:03.564330 30360 raft_consensus.cc:2749] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:03.564584 30354 leader_election.cc:290] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:13:03.565120 30354 raft_consensus.cc:2749] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:03.565274 22421 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
W20260709 12:13:03.569283 22421 raft_consensus.cc:2686] T b36f3a080ce7465b8491197cc6189444 P c863116d91c14d1ca50d6e8a46a37a8f: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:13:03.572011 23121 raft_consensus.cc:2955] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Committing config change with OpId 21.16: config changed from index 15 to 16, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:13:03.575892 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:13:03.593905 30353 raft_consensus.cc:493] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8701cd5186a949538d8efafb5f987270)
I20260709 12:13:03.594558 30353 raft_consensus.cc:515] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:03.597745 22600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:13:03.598312 22421 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:13:03.599378 30352 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:03.599505 22421 leader_election.cc:304] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:13:03.599874 30352 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:03.600343 30368 raft_consensus.cc:2749] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:03.601971 30352 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:13:03.599762 30354 raft_consensus.cc:2749] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:03.605059 30353 leader_election.cc:290] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:13:03.634027 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3ba2f54b0343bea5e3a5364c372a89" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:13:03.635706 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:13:03.638072 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897c484d3dec40a296e097e6b8d26d39" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:13:03.639379 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:13:03.452106 21266 tablet_replica.cc:333] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:13:03.676836 21266 raft_consensus.cc:2243] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:03.679388 21266 raft_consensus.cc:2272] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:03.704926 21266 tablet_replica.cc:333] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:13:03.706857 21266 raft_consensus.cc:2243] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:13:03.709728 21266 raft_consensus.cc:2272] T aeff0fdef6b04a46975756455aba1a98 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:03.714140 21266 tablet_replica.cc:333] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
W20260709 12:13:03.715199 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 72532.5us
I20260709 12:13:03.721571 21266 raft_consensus.cc:2243] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:03.726239 21266 raft_consensus.cc:2272] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:03.718761 22421 leader_election.cc:304] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:13:03.746802 22421 raft_consensus.cc:2686] T 1b2392d4861b4d40b63dcdab54e716de P c863116d91c14d1ca50d6e8a46a37a8f: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:13:03.749439 22421 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:13:03.746793 30352 consensus_queue.cc:1048] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.007s
I20260709 12:13:03.756311 30307 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:03.757375 30307 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:03.767403 21266 tablet_replica.cc:333] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:13:03.779093 30354 raft_consensus.cc:2749] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:03.799943 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b097456aac41edb06c5a4efd504ca1" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:13:03.801151 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746b2a18bc684213bde228ac6cc37ef6" candidate_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:13:03.814639 21266 raft_consensus.cc:2243] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:03.815817 21266 raft_consensus.cc:2272] T 40384260c96247e0ac31ade25baddaff P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:03.819597 21266 tablet_replica.cc:333] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:13:03.820711 21266 raft_consensus.cc:2243] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 LEADER]: Raft consensus shutting down.
W20260709 12:13:03.823800 22421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 74695.6us
W20260709 12:13:03.826846 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 49915.7us
I20260709 12:13:03.828676 22354 catalog_manager.cc:5697] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: config changed from index 15 to 16, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New cstate: current_term: 21 leader_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:13:03.836176 30307 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:13:03.840646 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 25 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:13:03.841674 22599 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 24.
I20260709 12:13:03.825464 22421 leader_election.cc:304] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:13:03.844990 22421 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:13:03.846567 30271 raft_consensus.cc:2749] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:03.846787 22421 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:13:03.850083 30353 raft_consensus.cc:2749] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:03.856237 23089 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:13:03.857988 30378 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:03.858479 30378 raft_consensus.cc:493] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 24 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:03.858919 30378 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:03.865249 30353 raft_consensus.cc:2749] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:03.867255 22421 leader_election.cc:304] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:13:03.876652 21266 raft_consensus.cc:2272] T 05f9fdee21394d6e97e0554e30632be7 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:03.877343 30353 raft_consensus.cc:2749] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:03.889618 22421 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
W20260709 12:13:03.890534 22421 raft_consensus.cc:2686] T 67b097456aac41edb06c5a4efd504ca1 P c863116d91c14d1ca50d6e8a46a37a8f: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:13:03.891779 22421 leader_election.cc:304] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c863116d91c14d1ca50d6e8a46a37a8f; no voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270
I20260709 12:13:03.892764 30353 raft_consensus.cc:2749] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:03.903627 21266 tablet_replica.cc:333] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:13:03.905128 21266 raft_consensus.cc:2243] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Raft consensus shutting down.
W20260709 12:13:03.911164 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 53615.1us
I20260709 12:13:03.912676 21266 raft_consensus.cc:2272] T 88417720c1014406ad04d7fb6b8f7ab4 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:03.916786 21266 tablet_replica.cc:333] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:13:03.917847 21266 raft_consensus.cc:2243] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:13:03.937639 30378 raft_consensus.cc:515] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:03.957636 30378 leader_election.cc:290] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 25 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:13:03.973022 21266 raft_consensus.cc:2272] T 174e3ddf6ee147d9b066ce86d1318882 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:03.978840 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41723f4983d46d0bf385fae671d9a04" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 25 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:13:03.979584 22599 raft_consensus.cc:3060] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:03.987171 21266 tablet_replica.cc:333] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:13:03.988597 21266 raft_consensus.cc:2243] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:13:03.991019 21266 raft_consensus.cc:2272] T 8efee6d07e5841fdb6b0d7ed673b49cb P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:03.994366 21266 tablet_replica.cc:333] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
W20260709 12:13:03.997754 23087 leader_election.cc:336] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:04.004638 21266 raft_consensus.cc:2243] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.014951 22525 raft_consensus.cc:2955] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Committing config change with OpId 21.16: config changed from index 15 to 16, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:13:04.040293 21266 raft_consensus.cc:2272] T ee3ba2f54b0343bea5e3a5364c372a89 P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.044031 21266 tablet_replica.cc:333] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:13:04.059877 21266 raft_consensus.cc:2243] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 21 LEADER]: Raft consensus shutting down.
W20260709 12:13:04.061121 23087 leader_election.cc:336] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:04.063722 22599 raft_consensus.cc:2468] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 25.
I20260709 12:13:04.092649 21266 raft_consensus.cc:2272] T effbc980be0840c9891d7e7b22d3c3ef P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.095890 23089 leader_election.cc:304] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:04.098054 30378 raft_consensus.cc:2804] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:04.100581 30382 raft_consensus.cc:1064] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881: attempting to promote NON_VOTER 8701cd5186a949538d8efafb5f987270 to VOTER
I20260709 12:13:04.102290 30378 raft_consensus.cc:697] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 25 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:13:04.103590 30378 consensus_queue.cc:237] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 24.20, Last appended by leader: 20, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:04.136746 21266 tablet_replica.cc:333] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:13:04.137718 21266 raft_consensus.cc:2243] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:13:04.127545 30382 consensus_queue.cc:237] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 13, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:04.151297 21266 raft_consensus.cc:2272] T 60b63fe1f8174bdab922fc97591f1860 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.171787 21266 tablet_replica.cc:333] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:13:04.177078 21266 raft_consensus.cc:2243] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.192142 21266 raft_consensus.cc:2272] T b955a164159b49b9bf083e35e340e323 P c863116d91c14d1ca50d6e8a46a37a8f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.196250 21266 tablet_replica.cc:333] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:13:04.197173 21266 raft_consensus.cc:2243] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.198004 21266 raft_consensus.cc:2272] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.201608 21266 tablet_replica.cc:333] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:13:04.202560 21266 raft_consensus.cc:2243] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.203958 21266 raft_consensus.cc:2272] T ee8d73c903fd41f7b207be9ca1cada33 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.215749 22354 catalog_manager.cc:5697] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 24 to 25, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 25 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:04.246495 21266 tablet_replica.cc:333] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:13:04.247529 21266 raft_consensus.cc:2243] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.248643 21266 raft_consensus.cc:2272] T 19a99176cd014d618ba1793fbb19aeab P c863116d91c14d1ca50d6e8a46a37a8f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.261328 23125 raft_consensus.cc:1275] T 5cd56edb2a504be8a2de859108bea8e2 P 8701cd5186a949538d8efafb5f987270 [term 22 LEARNER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:13:04.263701 30383 consensus_queue.cc:1048] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:04.267881 21266 tablet_replica.cc:333] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:13:04.268996 21266 raft_consensus.cc:2243] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.271950 21266 raft_consensus.cc:2272] T 746b2a18bc684213bde228ac6cc37ef6 P c863116d91c14d1ca50d6e8a46a37a8f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.272380 22604 raft_consensus.cc:1275] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:13:04.275414 21266 tablet_replica.cc:333] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:13:04.275692 30383 consensus_queue.cc:1048] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:13:04.276497 21266 raft_consensus.cc:2243] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:13:04.278162 21266 raft_consensus.cc:2272] T 0da3e85670e74df8af94383289960785 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.302426 21266 tablet_replica.cc:333] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
W20260709 12:13:04.306484 22495 consensus_peers.cc:597] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:04.310658 21266 raft_consensus.cc:2243] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.316336 21266 raft_consensus.cc:2272] T 897c484d3dec40a296e097e6b8d26d39 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.319633 21266 tablet_replica.cc:333] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:13:04.320466 21266 raft_consensus.cc:2243] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:13:04.321729 21266 raft_consensus.cc:2272] T 9b31ce17d24644c19dbf9469c435d149 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.321426 30383 raft_consensus.cc:2955] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 LEADER]: Committing config change with OpId 22.16: config changed from index 15 to 16, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:13:04.325073 21266 tablet_replica.cc:333] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:13:04.326007 21266 raft_consensus.cc:2243] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.326874 21266 raft_consensus.cc:2272] T b196b03fbcb045da91c663d6595b2775 P c863116d91c14d1ca50d6e8a46a37a8f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.330438 21266 tablet_replica.cc:333] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:13:04.331270 21266 raft_consensus.cc:2243] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.332029 21266 raft_consensus.cc:2272] T 9d328826e9a04a61be5bfb46dcfa77ab P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.326056 23121 raft_consensus.cc:2955] T 5cd56edb2a504be8a2de859108bea8e2 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index 15 to 16, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:13:04.335047 21266 tablet_replica.cc:333] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:13:04.337973 21266 raft_consensus.cc:2243] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.340770 21266 raft_consensus.cc:2272] T cf7e3d0e753849fcb1514dc105ababfd P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.347142 21266 tablet_replica.cc:333] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:13:04.348055 21266 raft_consensus.cc:2243] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.349287 21266 raft_consensus.cc:2272] T 871e4d35e385425cb2fe5d84b8d4fd45 P c863116d91c14d1ca50d6e8a46a37a8f [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.357992 21266 tablet_replica.cc:333] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:13:04.367987 21266 raft_consensus.cc:2243] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.368844 21266 raft_consensus.cc:2272] T 5cd56edb2a504be8a2de859108bea8e2 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.370000 22604 raft_consensus.cc:2955] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index 15 to 16, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:13:04.385082 22354 catalog_manager.cc:5697] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: config changed from index 15 to 16, 8701cd5186a949538d8efafb5f987270 (127.20.196.132) changed from NON_VOTER to VOTER. New cstate: current_term: 22 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:04.419116 22525 consensus_queue.cc:237] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:04.430776 23125 raft_consensus.cc:1275] T 5cd56edb2a504be8a2de859108bea8e2 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:13:04.432999 22599 raft_consensus.cc:1275] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:13:04.434655 30383 consensus_queue.cc:1048] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:13:04.437577 30383 consensus_queue.cc:1048] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:13:04.446271 30294 raft_consensus.cc:2955] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 LEADER]: Committing config change with OpId 22.17: config changed from index 16 to 17, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:13:04.460189 22605 raft_consensus.cc:2955] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Committing config change with OpId 22.17: config changed from index 16 to 17, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:13:04.460381 23125 raft_consensus.cc:2955] T 5cd56edb2a504be8a2de859108bea8e2 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Committing config change with OpId 22.17: config changed from index 16 to 17, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:13:04.491330 22340 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5cd56edb2a504be8a2de859108bea8e2 with cas_config_opid_index 16: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:04.497784 21266 tablet_replica.cc:333] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:13:04.498697 21266 raft_consensus.cc:2243] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.501459 22348 catalog_manager.cc:5697] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: config changed from index 16 to 17, VOTER c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) evicted. New cstate: current_term: 22 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
I20260709 12:13:04.507159 21266 raft_consensus.cc:2272] T 30b3fe7a04b74137b559ad33a85cddff P c863116d91c14d1ca50d6e8a46a37a8f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.510535 21266 tablet_replica.cc:333] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:13:04.511363 21266 raft_consensus.cc:2243] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.512288 21266 raft_consensus.cc:2272] T 254fb9df2b39405996039a40091b4875 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.515380 21266 tablet_replica.cc:333] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:13:04.556342 21266 raft_consensus.cc:2243] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:13:04.557969 21266 raft_consensus.cc:2272] T f007f8ed533640a9a25704c288c49f3c P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:04.594497 22339 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 74978us
I20260709 12:13:04.568746 21266 tablet_replica.cc:333] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:13:04.664655 21266 raft_consensus.cc:2243] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:13:04.671288 21266 raft_consensus.cc:2272] T 6445cf83e0b646428e39f19d21ca6c44 P c863116d91c14d1ca50d6e8a46a37a8f [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:04.683208 23087 consensus_peers.cc:597] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:04.676468 22339 catalog_manager.cc:4755] TS c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 5cd56edb2a504be8a2de859108bea8e2: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 12:13:04.687690 30356 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:04.688271 30356 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:13:04.690441 30356 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:13:04.692495 30179 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:04.693064 30179 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:13:04.690588 21266 tablet_replica.cc:333] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:13:04.694439 21266 raft_consensus.cc:2243] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 LEADER]: Raft consensus shutting down.
W20260709 12:13:04.684113 23087 consensus_peers.cc:597] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:04.704066 21266 raft_consensus.cc:2272] T 82e7db06c6ff4d96853c60f0f42c09a8 P c863116d91c14d1ca50d6e8a46a37a8f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.704659 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:13:04.707441 21266 tablet_replica.cc:333] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:13:04.698891 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:13:04.711697 21266 raft_consensus.cc:2243] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:13:04.697577 30179 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:13:04.713047 21266 raft_consensus.cc:2272] T 9286627b6c59411d908ec035984616ac P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.718044 21266 tablet_replica.cc:333] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
W20260709 12:13:04.726274 22495 consensus_peers.cc:597] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:04.736302 22604 raft_consensus.cc:1275] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 25 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 24 index: 20. Preceding OpId from leader: term: 25 index: 21. (index mismatch)
W20260709 12:13:04.737800 23087 consensus_peers.cc:597] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:04.738461 21266 raft_consensus.cc:2243] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.739596 21266 raft_consensus.cc:2272] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P c863116d91c14d1ca50d6e8a46a37a8f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.742861 21266 tablet_replica.cc:333] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f: stopping tablet replica
I20260709 12:13:04.747500 21266 raft_consensus.cc:2243] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.750814 30370 consensus_queue.cc:1048] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260709 12:13:04.748281 21266 raft_consensus.cc:2272] T 4c23033521664ca6a0c00a6f0f552308 P c863116d91c14d1ca50d6e8a46a37a8f [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:04.824054 23087 consensus_peers.cc:597] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:04.835049 22569 leader_election.cc:336] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:04.841711 22569 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:04.843853 30356 raft_consensus.cc:2749] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:13:04.845325 22569 leader_election.cc:336] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:04.845774 22569 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:04.848263 30356 raft_consensus.cc:2749] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:04.866953 30401 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:04.867659 30401 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:04.870366 30401 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:13:04.873211 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:13:04.881083 30383 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:04.881718 30383 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:13:04.883940 30383 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:13:04.888579 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:13:04.889202 22599 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 21.
I20260709 12:13:04.890842 22497 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
W20260709 12:13:04.894176 22495 leader_election.cc:336] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:04.895059 30383 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:04.895697 30383 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:04.898841 30334 raft_consensus.cc:2804] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:04.899309 30334 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:04.899729 30334 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:13:04.903318 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 58027.9us
I20260709 12:13:04.905982 30294 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:04.906477 30294 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:13:04.908715 30294 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:13:04.912300 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:13:04.912923 22599 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 24.
I20260709 12:13:04.914714 22497 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:13:04.916524 30382 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:04.916901 30382 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 24 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:04.917250 30382 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:13:04.943707 22495 leader_election.cc:336] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:04.945626 22495 leader_election.cc:336] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:04.948926 22495 consensus_peers.cc:597] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:04.951529 30383 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:13:04.952646 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:13:04.954535 22496 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:04.956336 30383 raft_consensus.cc:2749] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:13:04.960981 22569 leader_election.cc:336] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:04.968990 30334 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:13:04.971912 30370 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:04.972543 30370 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:04.973276 30382 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:13:04.963258 22569 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:04.975383 30370 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:13:04.975991 30356 raft_consensus.cc:2749] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:04.977926 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2337c1c696448c287a9a1885624d3d0" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:13:04.978458 22605 raft_consensus.cc:3060] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:04.989514 22605 raft_consensus.cc:2468] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 25.
W20260709 12:13:04.990095 22569 consensus_peers.cc:597] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:04.991127 22497 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:13:04.992089 30405 raft_consensus.cc:2804] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:04.992584 30405 raft_consensus.cc:697] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 25 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:13:04.993515 30405 consensus_queue.cc:237] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:13:04.996075 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:13:04.996750 22528 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 21.
W20260709 12:13:05.001088 23087 consensus_peers.cc:597] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:05.001761 23087 consensus_peers.cc:597] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:05.004231 23088 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:13:05.005147 30370 raft_consensus.cc:2804] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:05.005543 30370 raft_consensus.cc:493] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:05.005915 30370 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:04.975442 30382 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 25 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:13:05.014228 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00721a4978a43d1af483d9f52de30bc" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:13:05.014854 22604 raft_consensus.cc:3060] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:05.015887 30334 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:13:05.071857 22495 leader_election.cc:336] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:05.084033 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 81744.4us
I20260709 12:13:05.086964 30307 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:05.087774 30307 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:05.090255 30307 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:13:05.095672 22604 raft_consensus.cc:2468] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 22.
I20260709 12:13:05.116938 22497 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:13:05.129264 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:13:05.129915 22605 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 22.
W20260709 12:13:05.130352 22495 leader_election.cc:336] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:05.111897 30356 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
W20260709 12:13:05.140792 22495 consensus_peers.cc:597] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:05.130671 30383 raft_consensus.cc:2804] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 12:13:05.157954 22495 consensus_peers.cc:597] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:05.158808 22569 consensus_peers.cc:597] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:05.160876 22495 consensus_peers.cc:597] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:05.166038 22569 consensus_peers.cc:597] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:05.183085 30328 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:05.183809 30328 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:05.186173 30328 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:13:05.175901 22495 consensus_peers.cc:597] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:05.200129 22495 consensus_peers.cc:597] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:05.167817 30383 raft_consensus.cc:697] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:13:05.199368 30307 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:05.205366 30307 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:05.159756 30356 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:13:05.206718 23087 leader_election.cc:336] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:05.195616 30370 raft_consensus.cc:515] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:13:05.211895 22569 consensus_peers.cc:597] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:05.220523 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:13:05.222235 30383 consensus_queue.cc:237] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:13:05.231997 30328 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:05.238953 30328 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:05.241129 30328 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:13:05.248551 30307 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:13:05.260243 22569 consensus_peers.cc:597] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:05.268258 30370 leader_election.cc:290] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:13:05.268961 22569 consensus_peers.cc:597] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:05.269682 22569 consensus_peers.cc:597] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:05.274797 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 43823.4us
W20260709 12:13:05.275550 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 68460.8us
I20260709 12:13:05.270900 30356 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:13:05.283193 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:13:05.288196 22569 leader_election.cc:336] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:05.307374 22348 catalog_manager.cc:5697] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 24 to 25, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 25 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:05.325840 22495 consensus_peers.cc:597] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:05.326745 22495 consensus_peers.cc:597] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:05.330394 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:13:05.310245 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 90862.3us
I20260709 12:13:05.330941 23125 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 21.
I20260709 12:13:05.315799 22570 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:05.332687 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:13:05.347869 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
W20260709 12:13:05.350942 22569 consensus_peers.cc:597] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:05.343487 30416 raft_consensus.cc:2749] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:05.361363 30416 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:05.361995 30416 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:13:05.364303 30416 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:13:05.368569 23089 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:13:05.369732 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeff0fdef6b04a46975756455aba1a98" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:13:05.370385 22525 raft_consensus.cc:3060] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:05.371766 30415 raft_consensus.cc:2804] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:05.372205 30415 raft_consensus.cc:493] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:05.372562 30415 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:05.377609 22525 raft_consensus.cc:2468] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 22.
I20260709 12:13:05.380369 30415 raft_consensus.cc:515] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:05.441529 30417 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:05.442153 30417 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:05.443375 30415 leader_election.cc:290] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:13:05.391513 22569 leader_election.cc:336] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:05.444396 30417 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:13:05.421586 23087 leader_election.cc:336] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:05.394629 22495 consensus_peers.cc:597] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:05.446254 23087 consensus_peers.cc:597] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:05.434337 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 90004.4us
I20260709 12:13:05.446878 30334 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:05.447692 30334 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:13:05.435292 30382 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:05.450691 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:13:05.451349 22528 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 21.
I20260709 12:13:05.451130 30382 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:13:05.446184 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 51589us
I20260709 12:13:05.453797 30382 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:13:05.454578 23088 leader_election.cc:304] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:13:05.444320 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 52854us
I20260709 12:13:05.457298 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:13:05.458123 22604 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 21.
I20260709 12:13:05.460616 22497 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:13:05.462193 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:13:05.462850 22597 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 21.
I20260709 12:13:05.463107 30294 raft_consensus.cc:2804] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:05.463611 30383 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:05.463663 30294 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:05.464406 30294 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:05.464380 30383 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:05.467227 30415 raft_consensus.cc:2804] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:05.467856 30415 raft_consensus.cc:697] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 22 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:13:05.468765 30415 consensus_queue.cc:237] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:05.471112 30334 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:13:05.472631 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:13:05.473206 23119 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 17.
I20260709 12:13:05.476094 30414 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:05.476656 30414 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:05.481419 22570 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:05.483803 30383 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:13:05.485901 30369 raft_consensus.cc:2804] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:05.486306 30369 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:05.486670 30369 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:05.484854 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:13:05.490935 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:13:05.490289 22496 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:13:05.493971 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:13:05.491562 23119 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 21.
I20260709 12:13:05.494553 23121 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 19.
I20260709 12:13:05.490731 22597 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 21.
W20260709 12:13:05.491531 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 44562.9us
W20260709 12:13:05.499830 23087 leader_election.cc:336] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:05.501391 30294 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:13:05.500242 23087 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:05.504951 30294 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:13:05.478863 30414 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:13:05.506017 22599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f9fdee21394d6e97e0554e30632be7" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:13:05.520903 22599 raft_consensus.cc:3060] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:05.508823 30418 raft_consensus.cc:2749] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:05.512147 22570 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:13:05.523339 30179 raft_consensus.cc:2804] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:05.523707 30179 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:05.503873 22497 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:13:05.524049 30179 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:05.524591 30383 raft_consensus.cc:2804] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:05.525025 30383 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:05.525523 30383 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:05.528688 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:13:05.529266 22495 leader_election.cc:336] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:05.529493 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:13:05.530161 22495 leader_election.cc:336] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:05.531659 22495 consensus_peers.cc:597] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:05.532194 22495 leader_election.cc:336] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:05.541031 22495 leader_election.cc:336] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:05.543149 22605 raft_consensus.cc:1275] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 25 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 12:13:05.538544 30179 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:05.550287 22599 raft_consensus.cc:2468] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 23.
I20260709 12:13:05.499972 30334 raft_consensus.cc:2804] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:13:05.552000 23087 consensus_peers.cc:597] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:05.551750 30334 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:05.550225 30405 consensus_queue.cc:1048] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.004s
I20260709 12:13:05.554231 30334 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:05.556794 30179 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:13:05.567358 30405 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:05.568022 30405 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:05.568693 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b63fe1f8174bdab922fc97591f1860" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:13:05.569295 23119 raft_consensus.cc:3060] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:05.569604 23089 leader_election.cc:304] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:13:05.571180 30417 raft_consensus.cc:2804] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:05.571677 30417 raft_consensus.cc:697] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 23 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:13:05.571916 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:13:05.572089 30405 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:13:05.572726 30417 consensus_queue.cc:237] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:05.581956 23119 raft_consensus.cc:2468] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 20.
W20260709 12:13:05.584153 23087 leader_election.cc:336] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:05.584887 23087 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:13:05.586078 23087 leader_election.cc:336] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:05.587188 30418 raft_consensus.cc:2749] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:05.603636 30383 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:05.590299 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:13:05.586935 23087 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:05.629196 22605 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 22.
I20260709 12:13:05.609207 22570 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:13:05.589802 22348 catalog_manager.cc:5697] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 21 to 22, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 22 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:05.614713 22495 leader_election.cc:336] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:05.630321 22495 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:13:05.631407 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 45361.8us
W20260709 12:13:05.634078 23087 leader_election.cc:336] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:05.634584 30401 raft_consensus.cc:2804] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:05.635798 30409 raft_consensus.cc:2749] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:05.588902 30414 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:05.638103 30414 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:05.639400 30405 raft_consensus.cc:2749] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:13:05.631776 22569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 45096.8us
W20260709 12:13:05.641311 22569 consensus_peers.cc:597] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:05.643571 22569 leader_election.cc:336] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:05.638226 22349 catalog_manager.cc:5697] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 21 to 22, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 22 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:05.643596 30334 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:05.649688 30414 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:13:05.652107 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:13:05.652426 30334 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:13:05.652870 23121 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 19.
I20260709 12:13:05.653038 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efee6d07e5841fdb6b0d7ed673b49cb" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
W20260709 12:13:05.655958 23087 consensus_peers.cc:597] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:05.661129 23119 raft_consensus.cc:3060] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:05.620151 30369 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:13:05.658463 23087 connection.cc:769] client connection to 127.20.196.129:42317 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 12:13:05.653756 22569 connection.cc:769] client connection to 127.20.196.129:42317 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260709 12:13:05.672013 22570 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:13:05.678356 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
W20260709 12:13:05.672348 23087 leader_election.cc:336] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: sendmsg error: Broken pipe (error 32)
I20260709 12:13:05.679157 22605 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:13:05.677620 22569 leader_election.cc:336] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: sendmsg error: Broken pipe (error 32)
I20260709 12:13:05.684603 22604 raft_consensus.cc:2393] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 1676e7af5e4a47cb86ee7db83e3d4881 in current term 22: Already voted for candidate 6c6fa11e8ee34711b3551f0c670442bc in this term.
W20260709 12:13:05.681352 23087 consensus_peers.cc:597] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: sendmsg error: Broken pipe (error 32). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:05.686517 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:13:05.688524 23121 raft_consensus.cc:3060] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:05.672931 30401 raft_consensus.cc:697] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:13:05.684682 30383 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:13:05.685982 30356 raft_consensus.cc:2804] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:05.705549 22599 raft_consensus.cc:1275] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:13:05.712459 22605 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 22.
I20260709 12:13:05.714537 23119 raft_consensus.cc:2468] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 18.
I20260709 12:13:05.715899 30383 consensus_queue.cc:1048] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:13:05.703197 30356 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:05.718147 30356 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:05.726150 30405 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:05.727820 30405 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:13:05.729874 22495 leader_election.cc:336] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:05.729981 30405 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:13:05.730883 22495 leader_election.cc:336] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:05.731482 30369 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:13:05.734967 22495 consensus_peers.cc:597] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:05.742223 30401 consensus_queue.cc:237] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:05.743953 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:13:05.745029 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:13:05.745859 22529 raft_consensus.cc:2393] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c6fa11e8ee34711b3551f0c670442bc in current term 22: Already voted for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in this term.
I20260709 12:13:05.761364 23121 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 22.
I20260709 12:13:05.771368 22497 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:13:05.771946 22495 leader_election.cc:336] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:05.772541 30334 raft_consensus.cc:2749] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:05.772579 22495 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:05.779078 22496 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:05.782658 22496 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:05.780324 30334 raft_consensus.cc:2749] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:05.787992 30405 raft_consensus.cc:2804] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:13:05.788924 30405 raft_consensus.cc:697] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:13:05.788937 30334 raft_consensus.cc:2804] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:05.752823 30356 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:05.797608 30334 raft_consensus.cc:697] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:13:05.811014 30334 consensus_queue.cc:237] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:05.790215 30405 consensus_queue.cc:237] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:05.801677 22348 catalog_manager.cc:5697] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 22 to 23, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 23 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:05.808305 30409 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:05.827003 30409 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:05.808077 30415 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:05.858044 30421 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:05.858913 30421 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:05.872963 30294 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:05.880051 30294 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:05.883664 30294 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:13:05.883756 30421 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:13:05.889814 22569 leader_election.cc:336] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:05.890314 22569 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:05.852084 30415 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:05.893749 30427 raft_consensus.cc:2749] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:05.901698 22349 catalog_manager.cc:5697] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 19 to 20, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 20 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:05.903653 30356 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:13:05.906347 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:13:05.913867 23087 leader_election.cc:336] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:05.914526 23087 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:13:05.924840 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 60981.1us
I20260709 12:13:05.917079 30418 raft_consensus.cc:2749] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:05.933305 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:13:05.936225 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b31ce17d24644c19dbf9469c435d149" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:13:05.936750 23119 raft_consensus.cc:3060] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:05.937656 30415 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:13:05.990128 23119 raft_consensus.cc:2468] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 20.
W20260709 12:13:05.990757 30433 log.cc:927] Time spent T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:13:05.993180 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
W20260709 12:13:05.995507 22569 leader_election.cc:336] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
W20260709 12:13:06.010768 22569 leader_election.cc:336] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
W20260709 12:13:06.011574 22569 leader_election.cc:336] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
W20260709 12:13:06.012063 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 59184.6us
I20260709 12:13:06.023438 22570 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:06.026408 30438 raft_consensus.cc:2749] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:06.032116 22570 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:13:06.045624 22495 leader_election.cc:336] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:06.046247 22495 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881; no voters: 8701cd5186a949538d8efafb5f987270, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:06.055156 30403 raft_consensus.cc:2804] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:06.060531 30403 raft_consensus.cc:697] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:13:06.061264 30438 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:06.061865 30438 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:06.061561 30403 consensus_queue.cc:237] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:06.064488 30438 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:13:06.068969 23119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:13:06.070744 30382 raft_consensus.cc:2749] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:13:06.074690 30336 tablet_copy_client.cc:1131] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270: tablet copy: Unable to close tablet copy session: Network error: failure ending tablet copy session: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
W20260709 12:13:06.075294 23087 leader_election.cc:336] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:06.075745 23087 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:06.078857 23119 raft_consensus.cc:2468] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 16.
W20260709 12:13:06.079291 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 49381.5us
I20260709 12:13:06.079998 22570 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:13:06.089823 30409 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:13:06.079696 30417 raft_consensus.cc:2749] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:06.096940 22597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:13:06.095605 22348 catalog_manager.cc:5697] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 17 to 18, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 18 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:06.083180 30356 raft_consensus.cc:2804] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:13:06.101285 22597 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 22.
I20260709 12:13:06.100260 30356 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:06.104146 30356 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:13:06.102669 23087 consensus_peers.cc:597] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:06.106474 23087 leader_election.cc:336] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
W20260709 12:13:06.109227 23087 consensus_peers.cc:597] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:06.111023 22569 leader_election.cc:336] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:06.113123 30356 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:13:06.130013 23087 consensus_peers.cc:597] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:06.131568 30356 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:13:06.132531 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f007f8ed533640a9a25704c288c49f3c" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:13:06.133096 23121 raft_consensus.cc:3060] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:06.141000 23121 raft_consensus.cc:2468] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 17.
W20260709 12:13:06.142033 22569 leader_election.cc:336] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:06.141399 22348 catalog_manager.cc:5697] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 19 to 20, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 20 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:06.142727 22570 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:13:06.144968 22339 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 68862.4us
I20260709 12:13:06.146631 30356 raft_consensus.cc:2804] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:13:06.147415 30356 raft_consensus.cc:697] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:13:06.148295 30356 consensus_queue.cc:237] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:13:06.159452 22339 catalog_manager.cc:4755] TS c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 5cd56edb2a504be8a2de859108bea8e2: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:06.165566 22348 catalog_manager.cc:5697] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 21 to 22, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 22 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:06.170354 30415 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:06.170957 30415 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:06.173585 30415 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:13:06.180074 23087 leader_election.cc:336] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:06.181823 30409 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:06.183193 30409 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:06.185302 30409 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:13:06.180902 22349 catalog_manager.cc:5697] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 16 to 17, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 17 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:06.192535 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 146961us
I20260709 12:13:06.194193 22597 raft_consensus.cc:1275] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
I20260709 12:13:06.195238 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:13:06.195868 22604 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 20.
I20260709 12:13:06.210700 30378 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:06.211313 30378 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:06.211536 30444 consensus_queue.cc:1048] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:13:06.213388 30378 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:13:06.214406 23089 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:13:06.220433 23087 leader_election.cc:336] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:06.223706 30417 raft_consensus.cc:2804] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:06.224174 30417 raft_consensus.cc:493] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:06.224587 30417 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:13:06.226588 23087 leader_election.cc:336] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
W20260709 12:13:06.235494 22569 consensus_peers.cc:597] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:06.244086 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:13:06.244745 22528 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 22.
I20260709 12:13:06.244855 22530 raft_consensus.cc:1275] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:13:06.252079 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:13:06.252830 22528 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 16.
I20260709 12:13:06.254130 22530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" is_pre_election: true
I20260709 12:13:06.254778 22530 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 19.
I20260709 12:13:06.260993 23088 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:06.264048 30418 raft_consensus.cc:2804] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:06.264500 30418 raft_consensus.cc:493] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:06.264871 30418 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:06.267486 30415 consensus_queue.cc:1048] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:13:06.262741 23088 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:06.287607 30417 raft_consensus.cc:515] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:06.290009 30417 leader_election.cc:290] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:13:06.292394 23088 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:06.293407 30412 raft_consensus.cc:2804] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:13:06.293830 30412 raft_consensus.cc:493] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:06.294214 30412 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:06.299355 30436 raft_consensus.cc:2804] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:06.299827 30436 raft_consensus.cc:493] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting leader election (detected failure of leader c863116d91c14d1ca50d6e8a46a37a8f)
I20260709 12:13:06.300252 30436 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:06.305540 30418 raft_consensus.cc:515] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:06.323549 23121 raft_consensus.cc:1275] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:13:06.325556 30403 consensus_queue.cc:1048] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 12:13:06.330643 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 50612.6us
I20260709 12:13:06.335973 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9286627b6c59411d908ec035984616ac" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:13:06.336546 22604 raft_consensus.cc:3060] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:13:06.340694 23087 leader_election.cc:336] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:06.341542 22605 raft_consensus.cc:1275] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:13:06.343923 30447 consensus_queue.cc:1048] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:06.344374 30412 raft_consensus.cc:515] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:06.346005 30436 raft_consensus.cc:515] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:13:06.348045 22495 consensus_peers.cc:597] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:06.356204 30436 leader_election.cc:290] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:13:06.357003 30412 leader_election.cc:290] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:13:06.359311 22528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6445cf83e0b646428e39f19d21ca6c44" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:13:06.359916 22528 raft_consensus.cc:3060] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:06.369613 22604 raft_consensus.cc:2468] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 21.
I20260709 12:13:06.373339 22528 raft_consensus.cc:2468] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 20.
I20260709 12:13:06.376065 23089 leader_election.cc:304] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:06.377149 22529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e7db06c6ff4d96853c60f0f42c09a8" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:13:06.377302 30412 raft_consensus.cc:2804] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:06.377734 22529 raft_consensus.cc:3060] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:06.378016 30412 raft_consensus.cc:697] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 21 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
W20260709 12:13:06.379004 23087 leader_election.cc:336] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:06.379187 30412 consensus_queue.cc:237] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:06.380488 22525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "1676e7af5e4a47cb86ee7db83e3d4881"
I20260709 12:13:06.381039 22525 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:06.384944 23121 raft_consensus.cc:1275] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:13:06.388253 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da3e85670e74df8af94383289960785" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:13:06.389353 22604 raft_consensus.cc:3060] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:06.390195 22525 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 23.
I20260709 12:13:06.400635 22529 raft_consensus.cc:2468] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 17.
I20260709 12:13:06.401295 30383 consensus_queue.cc:1048] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:13:06.406265 23087 leader_election.cc:336] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
W20260709 12:13:06.406951 23087 leader_election.cc:336] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:06.375990 30418 leader_election.cc:290] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:13:06.409339 23088 leader_election.cc:304] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:06.411897 23125 raft_consensus.cc:1275] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:13:06.411877 23088 leader_election.cc:304] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:06.412714 22604 raft_consensus.cc:2468] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 23.
I20260709 12:13:06.415516 23089 leader_election.cc:304] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:06.420620 30409 raft_consensus.cc:2804] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:13:06.413184 30378 raft_consensus.cc:2804] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:06.421415 30418 raft_consensus.cc:2804] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:06.422960 30409 raft_consensus.cc:697] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 17 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:13:06.420441 30383 consensus_queue.cc:1048] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.024s
I20260709 12:13:06.463737 30418 raft_consensus.cc:697] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270 [term 23 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:13:06.510043 30418 consensus_queue.cc:237] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:06.519497 30409 consensus_queue.cc:237] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:06.490314 30378 raft_consensus.cc:697] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 20 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:13:06.527992 30378 consensus_queue.cc:237] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:13:06.548506 22495 consensus_peers.cc:597] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:06.644925 23121 raft_consensus.cc:1275] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:13:06.669569 30401 consensus_queue.cc:1048] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:13:06.713809 21266 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 22478)
W20260709 12:13:06.755218 22569 consensus_peers.cc:597] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:06.756167 23088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:42733, user_credentials={real_user=slave}} blocked reactor thread for 162807us
W20260709 12:13:06.803071 22569 consensus_peers.cc:597] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:06.864733 23119 raft_consensus.cc:1275] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:13:06.866608 30416 consensus_queue.cc:1048] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:13:06.958765 23089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 47845.6us
W20260709 12:13:06.965452 22496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:44353, user_credentials={real_user=slave}} blocked reactor thread for 59992.3us
W20260709 12:13:06.987661 23087 consensus_peers.cc:597] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:07.008232 23087 consensus_peers.cc:597] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:07.039218 22529 raft_consensus.cc:1275] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:13:07.064395 30464 consensus_queue.cc:1048] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:07.077272 22604 raft_consensus.cc:1275] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:13:07.078069 22530 raft_consensus.cc:1275] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 12:13:07.082396 22604 raft_consensus.cc:1275] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 12:13:07.090384 22354 catalog_manager.cc:5697] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 20 to 21, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 21 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:07.092334 22354 catalog_manager.cc:5697] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 16 to 17, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 17 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:07.094187 22354 catalog_manager.cc:5697] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 19 to 20, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 20 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:13:07.100903 23087 consensus_peers.cc:597] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:07.117890 30464 consensus_queue.cc:1048] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:07.122874 30412 consensus_queue.cc:1048] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.002s
I20260709 12:13:07.126334 30460 consensus_queue.cc:1048] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 12:13:07.171653 23087 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111) [suppressed 355 similar messages]
I20260709 12:13:07.192513 22349 catalog_manager.cc:5697] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 22 to 23, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 23 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } attrs { replace: true } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } } }
W20260709 12:13:07.200909 23087 consensus_peers.cc:597] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:07.280833 23087 consensus_peers.cc:597] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:07.329015 23087 consensus_peers.cc:597] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:07.373306 22530 raft_consensus.cc:1275] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:13:07.378556 30378 consensus_queue.cc:1048] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:13:07.432964 22339 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 61888.4us
W20260709 12:13:07.454244 23087 consensus_peers.cc:597] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:07.455816 22495 consensus_peers.cc:597] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:07.463515 22495 consensus_peers.cc:597] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:07.478055 22339 catalog_manager.cc:4755] TS c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 5cd56edb2a504be8a2de859108bea8e2: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
W20260709 12:13:07.488996 23087 consensus_peers.cc:597] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:07.513873 22569 consensus_peers.cc:597] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:07.514441 22569 consensus_peers.cc:597] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:07.517310 30382 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:07.518049 30382 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:13:07.520476 30382 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:13:07.523232 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:13:07.523936 22604 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 22.
I20260709 12:13:07.525625 22497 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:13:07.526643 30382 raft_consensus.cc:2804] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:07.527172 30382 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:07.527594 30382 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:07.536517 30382 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:13:07.545720 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effbc980be0840c9891d7e7b22d3c3ef" candidate_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:13:07.546380 22604 raft_consensus.cc:3060] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:07.555361 22604 raft_consensus.cc:2468] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1676e7af5e4a47cb86ee7db83e3d4881 in term 23.
I20260709 12:13:07.563930 22497 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc; no voters: 
I20260709 12:13:07.566177 30440 raft_consensus.cc:2804] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:07.566735 30440 raft_consensus.cc:697] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 LEADER]: Becoming Leader. State: Replica: 1676e7af5e4a47cb86ee7db83e3d4881, State: Running, Role: LEADER
I20260709 12:13:07.567651 30440 consensus_queue.cc:237] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:13:07.573597 23087 consensus_peers.cc:597] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:07.576010 22569 consensus_peers.cc:597] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:07.579035 22495 leader_election.cc:336] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:07.588249 22354 catalog_manager.cc:5697] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 reported cstate change: term changed from 21 to 23, leader changed from c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129) to 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130). New cstate: current_term: 23 leader_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:07.612540 23087 consensus_peers.cc:597] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:07.613602 22495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 53300.6us
W20260709 12:13:07.614173 22495 leader_election.cc:336] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:07.573662 30382 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [CANDIDATE]: Term 23 election: Requested vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:13:07.662043 22569 consensus_peers.cc:597] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:07.668891 23087 consensus_peers.cc:597] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:07.680086 22495 consensus_peers.cc:597] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:07.680589 22495 consensus_peers.cc:597] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:07.714357 21266 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 22478)
W20260709 12:13:07.724231 22569 consensus_peers.cc:597] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:07.742238 22495 consensus_peers.cc:597] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:07.755420 22495 consensus_peers.cc:597] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:07.773510 22495 consensus_peers.cc:597] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:07.798262 22569 consensus_peers.cc:597] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:07.821131 22569 consensus_peers.cc:597] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:07.843340 22569 consensus_peers.cc:597] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:07.860580 22495 consensus_peers.cc:597] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:07.949371 23087 consensus_peers.cc:597] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:07.968367 22569 consensus_peers.cc:597] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:07.969874 22495 consensus_peers.cc:597] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:08.004871 22495 consensus_peers.cc:597] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:08.006368 23087 consensus_peers.cc:597] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:08.031276 22604 raft_consensus.cc:1275] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Refusing update from remote peer 1676e7af5e4a47cb86ee7db83e3d4881: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:13:08.033207 30440 consensus_queue.cc:1048] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 12:13:08.078702 22495 consensus_peers.cc:597] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:08.103014 22495 consensus_peers.cc:597] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:08.244665 23087 consensus_peers.cc:597] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:08.451733 22495 consensus_peers.cc:597] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:08.527402 23087 consensus_peers.cc:597] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:08.564656 22495 consensus_peers.cc:597] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:08.702788 22569 consensus_peers.cc:597] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:08.704718 23087 consensus_peers.cc:597] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:08.714859 21266 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 22478)
W20260709 12:13:08.879807 23087 consensus_peers.cc:597] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:09.071319 22495 consensus_peers.cc:597] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:09.169662 23087 consensus_peers.cc:597] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:09.188089 22569 consensus_peers.cc:597] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:09.510052 22569 consensus_peers.cc:597] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:09.563472 22339 catalog_manager.cc:4755] TS c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 5cd56edb2a504be8a2de859108bea8e2: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
W20260709 12:13:09.640439 23087 consensus_peers.cc:597] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:09.679543 23087 consensus_peers.cc:597] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:09.715430 21266 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 22478)
W20260709 12:13:09.749622 22569 consensus_peers.cc:597] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:09.762036 23087 consensus_peers.cc:597] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:09.876986 23087 consensus_peers.cc:597] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:09.877465 23087 consensus_peers.cc:597] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:09.885879 22495 consensus_peers.cc:597] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:09.894789 22569 consensus_peers.cc:597] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:09.983539 23087 consensus_peers.cc:597] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:10.011623 23087 consensus_peers.cc:597] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:10.040728 22569 consensus_peers.cc:597] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:10.044544 22495 consensus_peers.cc:597] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:10.052090 23087 consensus_peers.cc:597] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:10.095999 23087 consensus_peers.cc:597] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:10.101675 22569 consensus_peers.cc:597] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:10.119397 23087 consensus_peers.cc:597] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:10.120457 22495 consensus_peers.cc:597] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:10.148506 22495 consensus_peers.cc:597] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:10.203671 22495 consensus_peers.cc:597] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:10.231752 22495 consensus_peers.cc:597] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:10.233232 23087 consensus_peers.cc:597] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:10.233493 22495 consensus_peers.cc:597] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:10.251049 22495 consensus_peers.cc:597] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:10.281405 22495 consensus_peers.cc:597] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:10.363255 22569 consensus_peers.cc:597] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:10.364207 22569 consensus_peers.cc:597] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:10.371855 22569 consensus_peers.cc:597] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:10.372749 22495 consensus_peers.cc:597] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:10.466168 22569 consensus_peers.cc:597] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:10.541508 22495 consensus_peers.cc:597] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:10.563800 22569 consensus_peers.cc:597] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:10.617537 22495 consensus_peers.cc:597] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:10.684602 23087 consensus_peers.cc:597] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:10.701589 22495 consensus_peers.cc:597] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:10.716064 21266 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 22478)
W20260709 12:13:10.734077 23087 consensus_peers.cc:597] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:10.875805 23087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:42317, user_credentials={real_user=slave}} blocked reactor thread for 110716us
W20260709 12:13:10.919430 22495 consensus_peers.cc:597] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:11.030707 23087 consensus_peers.cc:597] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:11.071195 22569 consensus_peers.cc:597] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:11.334275 22495 consensus_peers.cc:597] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:11.451910 23087 consensus_peers.cc:597] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:11.557025 23087 consensus_peers.cc:597] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:11.716542 21266 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 22478)
W20260709 12:13:11.720343 23087 consensus_peers.cc:597] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:12.030252 22569 consensus_peers.cc:597] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:12.059616 23087 consensus_peers.cc:597] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:12.174218 22495 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111) [suppressed 445 similar messages]
W20260709 12:13:12.325812 22569 consensus_peers.cc:597] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:12.376258 23087 consensus_peers.cc:597] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:12.393786 22569 consensus_peers.cc:597] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:12.393885 23087 consensus_peers.cc:597] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:12.401170 22495 consensus_peers.cc:597] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:12.413293 22569 consensus_peers.cc:597] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:12.492861 23087 consensus_peers.cc:597] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:12.493400 23087 consensus_peers.cc:597] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:12.519348 23087 consensus_peers.cc:597] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:12.525856 22495 consensus_peers.cc:597] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:12.541261 23087 consensus_peers.cc:597] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:12.550671 23087 consensus_peers.cc:597] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:12.561169 23087 consensus_peers.cc:597] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:12.567497 22569 consensus_peers.cc:597] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:12.606117 22495 consensus_peers.cc:597] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:12.620743 23087 consensus_peers.cc:597] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:12.632536 22495 consensus_peers.cc:597] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:12.648663 22495 consensus_peers.cc:597] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:12.676548 22495 consensus_peers.cc:597] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:12.717121 21266 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 22478)
W20260709 12:13:12.741093 23087 consensus_peers.cc:597] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:12.766530 22569 consensus_peers.cc:597] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:12.859973 22569 consensus_peers.cc:597] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:12.865399 22569 consensus_peers.cc:597] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:12.868871 22569 consensus_peers.cc:597] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:12.897907 22495 consensus_peers.cc:597] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:12.906824 22495 consensus_peers.cc:597] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:12.930315 22495 consensus_peers.cc:597] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:12.961776 22569 consensus_peers.cc:597] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:12.988557 23087 consensus_peers.cc:597] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:12.989538 22495 consensus_peers.cc:597] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:13.057341 22495 consensus_peers.cc:597] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:13.145053 22495 consensus_peers.cc:597] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:13.179185 22386 debug-util.cc:398] Leaking SignalData structure 0x7b080031f100 after lost signal to thread 21269
W20260709 12:13:13.180490 22386 debug-util.cc:398] Leaking SignalData structure 0x7b0800362ca0 after lost signal to thread 22389
W20260709 12:13:13.181917 22386 debug-util.cc:398] Leaking SignalData structure 0x7b0800382740 after lost signal to thread 22556
W20260709 12:13:13.183131 22386 debug-util.cc:398] Leaking SignalData structure 0x7b0800092860 after lost signal to thread 22630
W20260709 12:13:13.184564 22386 debug-util.cc:398] Leaking SignalData structure 0x7b08002af160 after lost signal to thread 23149
W20260709 12:13:13.258200 22569 consensus_peers.cc:597] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:13.269601 22495 consensus_peers.cc:597] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:13.308163 22569 consensus_peers.cc:597] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:13.462373 23087 consensus_peers.cc:597] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:13.583879 23087 consensus_peers.cc:597] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:13.653224 22495 consensus_peers.cc:597] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:13.717649 21266 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 22478)
W20260709 12:13:13.725888 22339 catalog_manager.cc:4755] TS c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 5cd56edb2a504be8a2de859108bea8e2: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
W20260709 12:13:13.979138 22495 consensus_peers.cc:597] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:14.016258 23087 consensus_peers.cc:597] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:14.327222 23087 consensus_peers.cc:597] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:14.529994 23087 consensus_peers.cc:597] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:14.551054 22569 consensus_peers.cc:597] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:14.593770 23087 consensus_peers.cc:597] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:14.636375 22569 consensus_peers.cc:597] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:14.650218 23087 consensus_peers.cc:597] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:14.718298 21266 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 22478)
W20260709 12:13:14.719239 22569 consensus_peers.cc:597] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:14.796032 23087 consensus_peers.cc:597] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:14.834044 23087 consensus_peers.cc:597] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:14.899942 22569 consensus_peers.cc:597] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:14.906453 23087 consensus_peers.cc:597] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:14.969436 23087 consensus_peers.cc:597] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:14.995076 23087 consensus_peers.cc:597] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:15.007259 22495 consensus_peers.cc:597] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:15.011253 22495 consensus_peers.cc:597] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:15.107462 23087 consensus_peers.cc:597] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:15.158119 22495 consensus_peers.cc:597] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:15.196775 22569 consensus_peers.cc:597] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:15.222221 22495 consensus_peers.cc:597] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:15.239064 23087 consensus_peers.cc:597] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:15.254153 22495 consensus_peers.cc:597] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:15.310628 23087 consensus_peers.cc:597] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:15.380441 22569 consensus_peers.cc:597] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:15.383740 22495 consensus_peers.cc:597] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:15.385046 22569 consensus_peers.cc:597] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:15.396159 22495 consensus_peers.cc:597] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:15.422554 23087 consensus_peers.cc:597] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:15.463106 22569 consensus_peers.cc:597] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:15.477066 22569 consensus_peers.cc:597] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:15.482479 23087 consensus_peers.cc:597] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:15.520726 22495 consensus_peers.cc:597] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:15.638919 22495 consensus_peers.cc:597] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:15.707010 22495 consensus_peers.cc:597] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:15.718798 21266 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 22478)
W20260709 12:13:15.770972 22569 consensus_peers.cc:597] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:15.777396 22495 consensus_peers.cc:597] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:15.806463 22569 consensus_peers.cc:597] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:15.866112 22495 consensus_peers.cc:597] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:15.885296 22495 consensus_peers.cc:597] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:15.901662 22495 consensus_peers.cc:597] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:15.909891 22569 consensus_peers.cc:597] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:16.133648 23087 consensus_peers.cc:597] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:16.237231 23087 consensus_peers.cc:597] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:16.719338 21266 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 22478)
W20260709 12:13:16.872795 22495 consensus_peers.cc:597] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:16.919742 22497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:37785, user_credentials={real_user=slave}} blocked reactor thread for 82796.1us
W20260709 12:13:16.998457 23087 consensus_peers.cc:597] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:17.178288 22569 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111) [suppressed 404 similar messages]
W20260709 12:13:17.192971 22569 consensus_peers.cc:597] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:17.259160 22569 consensus_peers.cc:597] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:17.316361 22569 consensus_peers.cc:597] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:17.334532 22386 debug-util.cc:398] Leaking SignalData structure 0x7b0800170f20 after lost signal to thread 21269
W20260709 12:13:17.337414 22386 debug-util.cc:398] Leaking SignalData structure 0x7b08001bea20 after lost signal to thread 22389
W20260709 12:13:17.338790 22386 debug-util.cc:398] Leaking SignalData structure 0x7b0800034d20 after lost signal to thread 22556
W20260709 12:13:17.343429 22386 debug-util.cc:398] Leaking SignalData structure 0x7b08000f6f60 after lost signal to thread 22630
W20260709 12:13:17.339125 23087 consensus_peers.cc:597] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:17.346468 23087 consensus_peers.cc:597] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:17.345579 22386 debug-util.cc:398] Leaking SignalData structure 0x7b0800258320 after lost signal to thread 23149
W20260709 12:13:17.374816 23087 consensus_peers.cc:597] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:17.391798 23087 consensus_peers.cc:597] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:17.463660 23087 consensus_peers.cc:597] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:17.648687 22495 consensus_peers.cc:597] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:17.653609 22495 consensus_peers.cc:597] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:17.696133 22569 consensus_peers.cc:597] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:17.761397 22495 consensus_peers.cc:597] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:17.762044 23087 consensus_peers.cc:597] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:17.787453 22569 consensus_peers.cc:597] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:17.799780 23087 consensus_peers.cc:597] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:17.805306 23087 consensus_peers.cc:597] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:13:17.814615 21266 tablet_server.cc:196] TabletServer@127.20.196.129:0 shutdown complete.
W20260709 12:13:17.842340 22495 consensus_peers.cc:597] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:17.880385 22495 consensus_peers.cc:597] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:17.895427 23087 consensus_peers.cc:597] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:17.908950 23087 consensus_peers.cc:597] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:17.931932 23087 consensus_peers.cc:597] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:17.946503 23087 consensus_peers.cc:597] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:18.026782 22495 consensus_peers.cc:597] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:18.035910 22495 consensus_peers.cc:597] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:18.056106 22495 consensus_peers.cc:597] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:18.056586 22495 consensus_peers.cc:597] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:18.062086 22569 consensus_peers.cc:597] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:18.088617 22569 consensus_peers.cc:597] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:18.134889 23087 consensus_peers.cc:597] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:18.196509 22569 consensus_peers.cc:597] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:18.270694 22495 consensus_peers.cc:597] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:18.297232 22495 consensus_peers.cc:597] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:18.311229 23087 consensus_peers.cc:597] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:13:18.496554 21266 tablet_server.cc:179] TabletServer@127.20.196.130:0 shutting down...
W20260709 12:13:18.520990 22495 consensus_peers.cc:597] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:18.531666 22569 consensus_peers.cc:597] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:18.533528 22495 consensus_peers.cc:597] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:18.554718 22570 consensus_peers.cc:597] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:18.598927 23088 consensus_peers.cc:597] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:18.602506 22570 consensus_peers.cc:597] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:18.621106 22570 consensus_peers.cc:597] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:18.680080 22570 consensus_peers.cc:597] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:18.686060 23088 consensus_peers.cc:597] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:18.708441 22570 consensus_peers.cc:597] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:18.718411 22570 consensus_peers.cc:597] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:18.723867 23087 consensus_peers.cc:597] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:18.724792 23088 consensus_peers.cc:597] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270 -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:18.736791 21266 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:18.741402 21266 tablet_replica.cc:333] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:13:18.742585 21266 raft_consensus.cc:2243] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:18.743553 21266 raft_consensus.cc:2272] T bb7fd922979743428612619e8de33af1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.747089 21266 tablet_replica.cc:333] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
W20260709 12:13:18.748633 22570 consensus_peers.cc:597] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:18.761245 23088 consensus_peers.cc:597] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:18.762339 21266 raft_consensus.cc:2243] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:18.764108 21266 raft_consensus.cc:2272] T 0da3e85670e74df8af94383289960785 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.770699 21266 tablet_replica.cc:333] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
W20260709 12:13:18.771486 22570 consensus_peers.cc:597] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:18.776234 21266 raft_consensus.cc:2243] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Raft consensus shutting down.
W20260709 12:13:18.781145 23088 consensus_peers.cc:597] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:18.786286 21266 raft_consensus.cc:2272] T 9d328826e9a04a61be5bfb46dcfa77ab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.791128 21266 tablet_replica.cc:333] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:13:18.792128 21266 raft_consensus.cc:2243] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:18.792888 21266 raft_consensus.cc:2272] T b955a164159b49b9bf083e35e340e323 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.800298 21266 tablet_replica.cc:333] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:13:18.803750 21266 raft_consensus.cc:2243] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:18.809669 21266 raft_consensus.cc:2272] T 5b50f0bec71f4924aa1781b9818f1d73 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:18.811590 22569 consensus_peers.cc:597] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:18.812696 22569 consensus_peers.cc:597] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:18.817806 23088 consensus_peers.cc:597] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:18.814026 21266 tablet_replica.cc:333] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:13:18.819814 21266 raft_consensus.cc:2243] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 LEADER]: Raft consensus shutting down.
W20260709 12:13:18.820262 22569 consensus_peers.cc:597] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:13:18.825598 21266 raft_consensus.cc:2272] T 1143406a95dd472688b2fe621abd815f P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.844372 21266 tablet_replica.cc:333] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
W20260709 12:13:18.847187 22495 consensus_peers.cc:597] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:13:18.857235 21266 raft_consensus.cc:2243] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:18.859750 21266 raft_consensus.cc:2272] T 19773e9e6aec446eb719d3d53d49812b P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:18.875434 22570 consensus_peers.cc:597] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:18.876312 21266 tablet_replica.cc:333] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:13:18.878309 21266 raft_consensus.cc:2243] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:13:18.880695 21266 raft_consensus.cc:2272] T 10ed4486435d4f82978c5cb544504999 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.887094 21266 tablet_replica.cc:333] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:13:18.893579 21266 raft_consensus.cc:2243] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:18.894439 21266 raft_consensus.cc:2272] T 74d6480c61e542d583f6f89899989553 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.897625 21266 tablet_replica.cc:333] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
W20260709 12:13:18.903858 23088 consensus_peers.cc:597] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:18.907624 23088 consensus_peers.cc:597] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:18.914644 21266 raft_consensus.cc:2243] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:13:18.925544 21266 raft_consensus.cc:2272] T a2337c1c696448c287a9a1885624d3d0 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:18.927982 23088 consensus_peers.cc:597] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:18.933918 21266 tablet_replica.cc:333] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:13:18.934732 21266 raft_consensus.cc:2243] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:18.935382 21266 raft_consensus.cc:2272] T ea8ebc1d824844e688d0bd61c3fd2258 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.943238 21266 tablet_replica.cc:333] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
W20260709 12:13:18.949440 23088 consensus_peers.cc:597] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:18.949581 21266 raft_consensus.cc:2243] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:13:18.950997 21266 raft_consensus.cc:2272] T b36f3a080ce7465b8491197cc6189444 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:18.954310 23088 consensus_peers.cc:597] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:18.956357 21266 tablet_replica.cc:333] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:13:18.961297 21266 raft_consensus.cc:2243] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:18.965934 21266 raft_consensus.cc:2272] T 4e5929206e89419f978fa0283f6bb931 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:18.962301 22570 consensus_peers.cc:597] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:18.968822 21266 tablet_replica.cc:333] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:13:18.976739 21266 raft_consensus.cc:2243] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:18.978876 21266 raft_consensus.cc:2272] T 62319c9e82134e7daf8a46f78c124bff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:19.002121 22570 consensus_peers.cc:597] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:19.003186 22570 consensus_peers.cc:597] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:19.010409 21266 tablet_replica.cc:333] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
W20260709 12:13:19.012254 23088 consensus_peers.cc:597] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:19.023416 21266 raft_consensus.cc:2243] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 30 FOLLOWER]: Raft consensus shutting down.
W20260709 12:13:19.024909 23088 consensus_peers.cc:597] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:19.024441 21266 raft_consensus.cc:2272] T 1b2392d4861b4d40b63dcdab54e716de P 1676e7af5e4a47cb86ee7db83e3d4881 [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:19.055030 21266 tablet_replica.cc:333] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:13:19.056025 21266 raft_consensus.cc:2243] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:13:19.057240 21266 raft_consensus.cc:2272] T 67b097456aac41edb06c5a4efd504ca1 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:19.062462 22570 consensus_peers.cc:597] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:19.067898 21266 tablet_replica.cc:333] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:13:19.070901 21266 raft_consensus.cc:2243] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:19.081117 21266 raft_consensus.cc:2272] T aeff0fdef6b04a46975756455aba1a98 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:19.087644 21266 tablet_replica.cc:333] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
W20260709 12:13:19.094082 22570 consensus_peers.cc:597] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:19.095695 23088 consensus_peers.cc:597] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:19.097929 23087 consensus_peers.cc:597] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:13:19.100585 21266 raft_consensus.cc:2243] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:19.101438 21266 raft_consensus.cc:2272] T 00284432759445f6a017e6ddb9ec1689 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:19.109025 21266 tablet_replica.cc:333] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:13:19.109874 21266 raft_consensus.cc:2243] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:13:19.111083 21266 raft_consensus.cc:2272] T 5cd56edb2a504be8a2de859108bea8e2 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:19.115792 21266 tablet_replica.cc:333] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
W20260709 12:13:19.117660 22495 consensus_peers.cc:597] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:13:19.135334 21266 raft_consensus.cc:2243] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:13:19.138720 21266 raft_consensus.cc:2272] T 871e4d35e385425cb2fe5d84b8d4fd45 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:19.160539 21266 tablet_replica.cc:333] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:13:19.161418 21266 raft_consensus.cc:2243] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:19.162038 21266 raft_consensus.cc:2272] T 254fb9df2b39405996039a40091b4875 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:19.172928 21266 tablet_replica.cc:333] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:13:19.174101 21266 raft_consensus.cc:2243] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:19.174865 21266 raft_consensus.cc:2272] T 08a2fbce096642eb849b1a143f8e7bb9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:19.185629 21266 tablet_replica.cc:333] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:13:19.193118 21266 raft_consensus.cc:2243] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:19.201558 21266 raft_consensus.cc:2272] T b205f960deef48f8bc84127a8b47faf4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:19.211418 21266 tablet_replica.cc:333] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:13:19.212357 21266 raft_consensus.cc:2243] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:19.213827 21266 raft_consensus.cc:2272] T 88417720c1014406ad04d7fb6b8f7ab4 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:19.222746 21266 tablet_replica.cc:333] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:13:19.223675 21266 raft_consensus.cc:2243] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:19.225342 21266 raft_consensus.cc:2272] T 1ba02be77861491da7dbcfee1161e46c P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:19.236708 21266 tablet_replica.cc:333] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:13:19.242925 21266 raft_consensus.cc:2243] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:13:19.244963 21266 raft_consensus.cc:2272] T 174e3ddf6ee147d9b066ce86d1318882 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:19.257937 21266 tablet_replica.cc:333] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:13:19.258762 21266 raft_consensus.cc:2243] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:13:19.264436 21266 raft_consensus.cc:2272] T 8efee6d07e5841fdb6b0d7ed673b49cb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:19.267405 21266 tablet_replica.cc:333] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:13:19.268143 21266 raft_consensus.cc:2243] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:19.268786 21266 raft_consensus.cc:2272] T d7a58204e5354d61a3b5db01e879dce9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:19.289602 21266 tablet_replica.cc:333] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:13:19.290575 21266 raft_consensus.cc:2243] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:13:19.291772 21266 raft_consensus.cc:2272] T 538826f1cb47443eb083fb9360e7b1fb P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:19.294628 21266 tablet_replica.cc:333] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:13:19.295473 21266 raft_consensus.cc:2243] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:19.296101 21266 raft_consensus.cc:2272] T 041a72bc20f246bdb6e7cc6423d67e62 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:19.298724 21266 tablet_replica.cc:333] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:13:19.299475 21266 raft_consensus.cc:2243] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:13:19.300741 21266 raft_consensus.cc:2272] T f00721a4978a43d1af483d9f52de30bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:19.303748 21266 tablet_replica.cc:333] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:13:19.304564 21266 raft_consensus.cc:2243] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:13:19.305861 21266 raft_consensus.cc:2272] T 3aebfd8b04a4461ab6bc979eee23a2bc P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:19.308998 23087 consensus_peers.cc:597] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:13:19.320773 21266 tablet_replica.cc:333] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:13:19.321699 21266 raft_consensus.cc:2243] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:13:19.322923 21266 raft_consensus.cc:2272] T 8c3000c4a87f46b69b5da41dc1115486 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:19.326447 21266 tablet_replica.cc:333] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:13:19.342419 21266 raft_consensus.cc:2243] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:13:19.343302 21266 raft_consensus.cc:2272] T ee3ba2f54b0343bea5e3a5364c372a89 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:19.355214 21266 tablet_replica.cc:333] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:13:19.356221 21266 raft_consensus.cc:2243] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:13:19.357421 21266 raft_consensus.cc:2272] T effbc980be0840c9891d7e7b22d3c3ef P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:19.360713 21266 tablet_replica.cc:333] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:13:19.361577 21266 raft_consensus.cc:2243] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:19.362255 21266 raft_consensus.cc:2272] T 263d51d0b43744d899e37466045af890 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:19.375298 21266 tablet_replica.cc:333] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:13:19.376164 21266 raft_consensus.cc:2243] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:19.376843 21266 raft_consensus.cc:2272] T 13854b1cf45740e680c203d064295c78 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:19.380028 21266 tablet_replica.cc:333] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:13:19.380849 21266 raft_consensus.cc:2243] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:13:19.381974 21266 raft_consensus.cc:2272] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:19.388697 21266 tablet_replica.cc:333] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:13:19.389494 21266 raft_consensus.cc:2243] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:13:19.390650 21266 raft_consensus.cc:2272] T ee8d73c903fd41f7b207be9ca1cada33 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:19.397503 21266 tablet_replica.cc:333] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:13:19.398195 21266 raft_consensus.cc:2243] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:19.398774 21266 raft_consensus.cc:2272] T 19a99176cd014d618ba1793fbb19aeab P 1676e7af5e4a47cb86ee7db83e3d4881 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:19.416508 21266 tablet_replica.cc:333] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:13:19.417243 21266 raft_consensus.cc:2243] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:19.417852 21266 raft_consensus.cc:2272] T 272afea078f74bf19baefd3c1300644d P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:19.420465 21266 tablet_replica.cc:333] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:13:19.421152 21266 raft_consensus.cc:2243] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:19.421788 21266 raft_consensus.cc:2272] T 6445cf83e0b646428e39f19d21ca6c44 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:19.424471 21266 tablet_replica.cc:333] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:13:19.425117 21266 raft_consensus.cc:2243] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:19.426278 21266 raft_consensus.cc:2272] T 82e7db06c6ff4d96853c60f0f42c09a8 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:19.428954 21266 tablet_replica.cc:333] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:13:19.429669 21266 raft_consensus.cc:2243] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:19.430251 21266 raft_consensus.cc:2272] T bf783936508640219af47375c444da09 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:19.432986 21266 tablet_replica.cc:333] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:13:19.433682 21266 raft_consensus.cc:2243] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:13:19.434782 21266 raft_consensus.cc:2272] T 30b3fe7a04b74137b559ad33a85cddff P 1676e7af5e4a47cb86ee7db83e3d4881 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:19.449841 21266 tablet_replica.cc:333] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881: stopping tablet replica
I20260709 12:13:19.450438 21266 raft_consensus.cc:2243] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:19.451020 21266 raft_consensus.cc:2272] T 897c484d3dec40a296e097e6b8d26d39 P 1676e7af5e4a47cb86ee7db83e3d4881 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:19.676422 23087 consensus_peers.cc:597] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:19.694917 22569 consensus_peers.cc:597] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:19.719228 23087 consensus_peers.cc:597] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:19.790529 22569 consensus_peers.cc:597] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:19.806231 23087 consensus_peers.cc:597] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:13:19.819484 30541 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:19.820065 30541 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:19.822666 30541 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:13:19.829547 23088 leader_election.cc:336] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
W20260709 12:13:19.840332 23087 leader_election.cc:336] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:19.840775 23087 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:19.842654 30541 raft_consensus.cc:2749] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:13:19.883263 22569 consensus_peers.cc:597] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:13:20.155275 30542 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:20.155848 30542 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:20.163097 30542 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:13:20.169667 23088 leader_election.cc:336] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
I20260709 12:13:20.215046 30542 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:20.215596 30542 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:20.220681 30543 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:20.221297 30543 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:13:20.222605 23088 leader_election.cc:336] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
I20260709 12:13:20.224470 30543 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:13:20.227480 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:13:20.218044 30542 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:13:20.232266 22570 leader_election.cc:336] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
I20260709 12:13:20.233294 22570 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
W20260709 12:13:20.235486 22569 leader_election.cc:336] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:20.236263 30546 raft_consensus.cc:2749] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:20.268498 30543 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:20.269039 30543 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:13:20.271205 30543 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:13:20.277541 22570 leader_election.cc:336] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
W20260709 12:13:20.278354 22569 leader_election.cc:336] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:20.278782 22569 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:20.279597 30546 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:20.280089 30546 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:13:20.282219 30546 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:13:20.282706 30546 raft_consensus.cc:2749] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:13:20.289923 22570 leader_election.cc:336] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
W20260709 12:13:20.295416 22569 leader_election.cc:336] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:20.295969 22569 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:20.296780 30546 raft_consensus.cc:2749] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:20.300468 30546 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:20.301092 30546 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:13:20.305636 30546 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:13:20.311889 22570 leader_election.cc:336] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
W20260709 12:13:20.315228 22569 leader_election.cc:336] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:20.315768 22569 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:20.316769 30546 raft_consensus.cc:2749] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:20.342630 30520 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:20.343261 30520 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:20.346174 30520 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:13:20.350914 23088 leader_election.cc:336] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
I20260709 12:13:20.352201 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:13:20.354525 23089 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:13:20.355785 30520 raft_consensus.cc:2749] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:20.358242 30546 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:20.358847 30546 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:13:20.361053 30546 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:13:20.361760 30520 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:20.362293 30520 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:13:20.365828 22570 leader_election.cc:336] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
W20260709 12:13:20.372743 23088 leader_election.cc:336] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
I20260709 12:13:20.381189 30520 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:13:20.396075 22569 leader_election.cc:336] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:20.396502 22569 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:20.400107 30543 raft_consensus.cc:2749] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:13:20.401280 22569 consensus_peers.cc:597] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:13:20.404731 30520 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:20.405498 30520 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:13:20.419996 22569 consensus_peers.cc:597] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:20.422449 23088 leader_election.cc:336] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
I20260709 12:13:20.426276 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:13:20.426954 22601 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 22.
I20260709 12:13:20.425756 30520 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:13:20.468446 30546 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:20.469002 30546 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:20.471071 30546 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:13:20.474418 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:13:20.475072 23125 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 18.
I20260709 12:13:20.476688 22570 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:13:20.478202 30520 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:20.478719 30520 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:13:20.480284 22570 leader_election.cc:336] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
I20260709 12:13:20.481860 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:13:20.480764 30546 raft_consensus.cc:2804] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:20.483008 30546 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:20.483541 30546 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:20.490509 30520 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:13:20.491097 23088 leader_election.cc:336] T 5cd56edb2a504be8a2de859108bea8e2 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
I20260709 12:13:20.491542 23088 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:13:20.492663 30520 raft_consensus.cc:2749] T 5cd56edb2a504be8a2de859108bea8e2 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:20.496712 30543 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:20.497215 30543 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:13:20.499210 30543 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:13:20.503326 22569 leader_election.cc:336] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
W20260709 12:13:20.507061 22570 leader_election.cc:336] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
I20260709 12:13:20.507516 22570 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:20.507704 30520 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:20.508319 30543 raft_consensus.cc:2749] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:20.508203 30520 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:20.512931 30520 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:13:20.518939 23088 leader_election.cc:336] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
I20260709 12:13:20.496107 30546 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:13:20.525447 22570 leader_election.cc:336] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
I20260709 12:13:20.527426 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3000c4a87f46b69b5da41dc1115486" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:13:20.527958 23125 raft_consensus.cc:3060] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:20.530838 30543 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:20.531409 30543 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:20.533401 30543 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:13:20.538632 23125 raft_consensus.cc:2468] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 19.
I20260709 12:13:20.542178 23121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
W20260709 12:13:20.544838 22570 leader_election.cc:336] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
I20260709 12:13:20.547173 30546 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:13:20.546602 22570 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:13:20.551992 22570 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 8701cd5186a949538d8efafb5f987270
I20260709 12:13:20.552685 30543 raft_consensus.cc:2804] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:20.555781 30546 raft_consensus.cc:2749] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:20.565649 30543 raft_consensus.cc:697] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:13:20.566792 30543 consensus_queue.cc:237] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:13:20.602918 22569 consensus_peers.cc:597] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:13:20.608759 22348 catalog_manager.cc:5697] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 18 to 19, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 19 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:20.618431 30546 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:20.619024 30546 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:20.621019 30546 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:13:20.623843 30551 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:20.624401 30551 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:13:20.626508 30551 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:13:20.629024 22569 consensus_peers.cc:597] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:20.633620 22569 leader_election.cc:336] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:20.639727 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:13:20.640316 23125 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 22.
I20260709 12:13:20.642201 22570 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:13:20.644112 30551 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:20.644485 30551 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:20.644888 30551 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:20.653716 30551 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Starting leader election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:13:20.657954 21266 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 22553)
I20260709 12:13:20.655807 30551 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 23 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
I20260709 12:13:20.672199 30551 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:20.672744 30551 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:13:20.683507 22570 leader_election.cc:336] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
I20260709 12:13:20.690188 30551 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:13:20.690871 22570 leader_election.cc:336] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
I20260709 12:13:20.691409 22570 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:20.693696 30551 raft_consensus.cc:2749] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:20.695662 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd56edb2a504be8a2de859108bea8e2" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270"
I20260709 12:13:20.696329 23125 raft_consensus.cc:3060] T 5cd56edb2a504be8a2de859108bea8e2 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:20.704468 23125 raft_consensus.cc:2468] T 5cd56edb2a504be8a2de859108bea8e2 P 8701cd5186a949538d8efafb5f987270 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 23.
I20260709 12:13:20.709663 22570 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
W20260709 12:13:20.714833 22569 consensus_peers.cc:597] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:13:20.716019 30551 raft_consensus.cc:2804] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:20.718000 30551 raft_consensus.cc:697] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 LEADER]: Becoming Leader. State: Replica: 6c6fa11e8ee34711b3551f0c670442bc, State: Running, Role: LEADER
I20260709 12:13:20.718938 30551 consensus_queue.cc:237] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:13:20.719563 22570 leader_election.cc:336] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
W20260709 12:13:20.721669 22570 leader_election.cc:336] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
W20260709 12:13:20.726246 22569 leader_election.cc:336] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:20.726642 22569 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:20.728040 30549 raft_consensus.cc:2749] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:20.757625 22348 catalog_manager.cc:5697] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc reported cstate change: term changed from 22 to 23, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131). New cstate: current_term: 23 leader_uuid: "6c6fa11e8ee34711b3551f0c670442bc" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:20.765569 30541 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:20.766243 30541 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:20.770597 30546 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:20.771165 30546 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:13:20.773275 30546 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:13:20.774972 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc" is_pre_election: true
I20260709 12:13:20.775600 22601 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 21.
I20260709 12:13:20.776796 23089 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 
I20260709 12:13:20.777704 30520 raft_consensus.cc:2804] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:20.778106 30520 raft_consensus.cc:493] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:20.778499 30520 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:13:20.780371 22569 leader_election.cc:336] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
W20260709 12:13:20.785534 23088 leader_election.cc:336] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
I20260709 12:13:20.794641 30541 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:13:20.797752 22570 leader_election.cc:336] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
I20260709 12:13:20.802536 22570 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:20.807127 30551 raft_consensus.cc:2749] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:20.824750 30520 raft_consensus.cc:515] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:13:20.832953 23088 leader_election.cc:336] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
I20260709 12:13:20.835532 30520 leader_election.cc:290] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 election: Requested vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:13:20.835696 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "538826f1cb47443eb083fb9360e7b1fb" candidate_uuid: "8701cd5186a949538d8efafb5f987270" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "6c6fa11e8ee34711b3551f0c670442bc"
I20260709 12:13:20.836318 22601 raft_consensus.cc:3060] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:20.843626 22601 raft_consensus.cc:2468] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8701cd5186a949538d8efafb5f987270 in term 22.
I20260709 12:13:20.845036 23089 leader_election.cc:304] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881
I20260709 12:13:20.846155 30520 raft_consensus.cc:2804] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:20.846668 30520 raft_consensus.cc:697] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 22 LEADER]: Becoming Leader. State: Replica: 8701cd5186a949538d8efafb5f987270, State: Running, Role: LEADER
I20260709 12:13:20.847582 30520 consensus_queue.cc:237] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:20.854389 30541 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:20.854960 30541 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:20.856959 30541 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:13:20.868043 23088 leader_election.cc:336] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
I20260709 12:13:20.874137 22348 catalog_manager.cc:5697] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 reported cstate change: term changed from 21 to 22, leader changed from 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130) to 8701cd5186a949538d8efafb5f987270 (127.20.196.132). New cstate: current_term: 22 leader_uuid: "8701cd5186a949538d8efafb5f987270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:13:20.900777 22569 consensus_peers.cc:597] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:20.996950 22570 consensus_peers.cc:597] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:21.037185 22570 consensus_peers.cc:597] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:21.052991 23088 consensus_peers.cc:597] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:21.064208 22570 consensus_peers.cc:597] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:21.074352 22570 consensus_peers.cc:597] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:21.086377 23088 consensus_peers.cc:597] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:21.106536 23088 consensus_peers.cc:597] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:21.124261 23125 raft_consensus.cc:1275] T 5cd56edb2a504be8a2de859108bea8e2 P 8701cd5186a949538d8efafb5f987270 [term 23 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 12:13:21.125952 30549 consensus_queue.cc:1048] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 12:13:21.134830 22570 consensus_peers.cc:597] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:21.142740 23121 raft_consensus.cc:1275] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Refusing update from remote peer 6c6fa11e8ee34711b3551f0c670442bc: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:13:21.144276 30549 consensus_queue.cc:1048] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:13:21.150887 23087 consensus_peers.cc:597] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:21.165052 23087 leader_election.cc:336] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:21.171495 23087 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:21.173406 30558 raft_consensus.cc:2749] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:13:21.174571 23087 consensus_peers.cc:597] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:21.175825 23087 consensus_peers.cc:597] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:21.176833 23087 leader_election.cc:336] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:21.177858 23087 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:21.182199 30558 raft_consensus.cc:2749] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:13:21.182564 22570 consensus_peers.cc:597] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:21.183454 23087 consensus_peers.cc:597] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:21.189760 23087 consensus_peers.cc:597] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:21.190310 23087 consensus_peers.cc:597] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:21.195303 23088 consensus_peers.cc:597] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:21.195508 23087 leader_election.cc:336] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:21.204160 23087 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:21.211417 30558 raft_consensus.cc:2749] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:13:21.214105 22569 consensus_peers.cc:597] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:21.215351 23087 leader_election.cc:336] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:21.216436 23087 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:21.218072 30558 raft_consensus.cc:2749] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:13:21.228595 23087 leader_election.cc:336] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:21.239157 23087 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:21.240012 30558 raft_consensus.cc:2749] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:13:21.240975 23087 consensus_peers.cc:597] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:21.244804 23087 leader_election.cc:336] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:21.245235 23087 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:21.245981 30558 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:13:21.252228 23088 consensus_peers.cc:597] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:21.253145 23087 consensus_peers.cc:597] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:21.256364 22570 consensus_peers.cc:597] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:21.282641 22569 consensus_peers.cc:597] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:21.292809 22570 consensus_peers.cc:597] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:21.299083 23087 consensus_peers.cc:597] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:21.300556 23088 consensus_peers.cc:597] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:21.327076 22570 consensus_peers.cc:597] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:21.354373 22570 consensus_peers.cc:597] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:21.359036 22569 consensus_peers.cc:597] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:21.367020 23087 consensus_peers.cc:597] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:21.385973 23087 consensus_peers.cc:597] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:21.395977 23088 consensus_peers.cc:597] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270 -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:21.401808 30520 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:21.402277 30520 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:21.404146 30520 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:13:21.406306 22601 raft_consensus.cc:1275] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Refusing update from remote peer 8701cd5186a949538d8efafb5f987270: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
W20260709 12:13:21.409607 23087 leader_election.cc:336] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:21.411157 30520 consensus_queue.cc:1048] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 12:13:21.413091 23088 leader_election.cc:336] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
I20260709 12:13:21.415275 23088 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:21.416551 30520 raft_consensus.cc:2749] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:13:21.429584 22570 consensus_peers.cc:597] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:21.467931 23088 consensus_peers.cc:597] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:21.468562 23088 consensus_peers.cc:597] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:21.478899 22570 consensus_peers.cc:597] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:21.515776 23088 consensus_peers.cc:597] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:21.588796 22570 consensus_peers.cc:597] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:21.604431 23088 consensus_peers.cc:597] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:21.608474 23088 consensus_peers.cc:597] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:21.622797 23088 consensus_peers.cc:597] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:21.635409 22570 consensus_peers.cc:597] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:21.658442 21266 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 22553)
W20260709 12:13:21.708978 23088 consensus_peers.cc:597] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:21.714329 23087 consensus_peers.cc:597] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:21.724110 22570 consensus_peers.cc:597] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:21.798418 23088 consensus_peers.cc:597] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:21.803316 30543 raft_consensus.cc:493] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:21.803892 30543 raft_consensus.cc:515] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
W20260709 12:13:21.812623 22569 leader_election.cc:336] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:21.814126 30543 leader_election.cc:290] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:13:21.823472 22570 leader_election.cc:336] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
I20260709 12:13:21.823938 22570 leader_election.cc:304] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:21.826918 30543 raft_consensus.cc:2749] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:13:21.836031 22570 consensus_peers.cc:597] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:21.900795 30546 raft_consensus.cc:493] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:21.901345 30546 raft_consensus.cc:515] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:13:21.919552 30546 leader_election.cc:290] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:13:21.924655 22569 leader_election.cc:336] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
W20260709 12:13:21.948302 22570 leader_election.cc:336] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
I20260709 12:13:21.948740 22570 leader_election.cc:304] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:21.957358 30549 raft_consensus.cc:2749] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:13:21.975709 23087 consensus_peers.cc:597] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:21.984108 22339 catalog_manager.cc:4755] TS c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 5cd56edb2a504be8a2de859108bea8e2: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
W20260709 12:13:22.058840 22569 consensus_peers.cc:597] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:13:22.108794 30549 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:22.109460 30549 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:22.120522 30549 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 8701cd5186a949538d8efafb5f987270 (127.20.196.132:44353)
W20260709 12:13:22.129765 22569 leader_election.cc:336] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:22.132264 23125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174e3ddf6ee147d9b066ce86d1318882" candidate_uuid: "6c6fa11e8ee34711b3551f0c670442bc" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "8701cd5186a949538d8efafb5f987270" is_pre_election: true
I20260709 12:13:22.133047 23125 raft_consensus.cc:2468] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6fa11e8ee34711b3551f0c670442bc in term 22.
W20260709 12:13:22.167749 22570 leader_election.cc:336] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
I20260709 12:13:22.168213 22570 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc, 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:13:22.181468 22569 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111) [suppressed 590 similar messages]
I20260709 12:13:22.182595 30568 raft_consensus.cc:2749] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:13:22.272840 22569 consensus_peers.cc:597] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:13:22.280249 21266 tablet_server.cc:196] TabletServer@127.20.196.130:0 shutdown complete.
W20260709 12:13:22.322950 23087 consensus_peers.cc:597] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:13:22.331485 30568 raft_consensus.cc:493] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:22.332140 30568 raft_consensus.cc:515] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:13:22.334460 30568 leader_election.cc:290] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:13:22.341055 22570 leader_election.cc:336] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
W20260709 12:13:22.375703 22569 consensus_peers.cc:597] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:22.376256 22569 leader_election.cc:336] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:22.376675 22569 leader_election.cc:304] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:22.377457 30549 raft_consensus.cc:2749] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:22.443526 30568 raft_consensus.cc:493] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:22.444083 30568 raft_consensus.cc:515] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:13:22.446133 30568 leader_election.cc:290] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:13:22.457793 22570 leader_election.cc:336] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
I20260709 12:13:22.462942 30549 raft_consensus.cc:493] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:22.463474 30549 raft_consensus.cc:515] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:13:22.465639 30549 leader_election.cc:290] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:13:22.469208 22569 leader_election.cc:336] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:22.469640 22569 leader_election.cc:304] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:22.471653 30549 raft_consensus.cc:2749] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:22.475204 21266 tablet_server.cc:179] TabletServer@127.20.196.131:0 shutting down...
W20260709 12:13:22.475059 22570 leader_election.cc:336] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
W20260709 12:13:22.481863 22569 leader_election.cc:336] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:22.482856 22569 leader_election.cc:304] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:22.486495 30549 raft_consensus.cc:2749] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:13:22.491937 23089 consensus_peers.cc:597] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 -> Peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Couldn't send request to peer 6c6fa11e8ee34711b3551f0c670442bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:22.492765 23089 consensus_peers.cc:597] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 -> Peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Couldn't send request to peer 6c6fa11e8ee34711b3551f0c670442bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:22.525817 23089 consensus_peers.cc:597] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 -> Peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Couldn't send request to peer 6c6fa11e8ee34711b3551f0c670442bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:22.575708 23089 consensus_peers.cc:597] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 -> Peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Couldn't send request to peer 6c6fa11e8ee34711b3551f0c670442bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.585753 30549 raft_consensus.cc:493] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:22.586318 30549 raft_consensus.cc:515] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:13:22.591253 30549 leader_election.cc:290] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:13:22.596058 22569 leader_election.cc:336] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:22.597474 21266 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:22.599709 21266 tablet_replica.cc:333] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:13:22.601001 21266 raft_consensus.cc:2243] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.602108 21266 raft_consensus.cc:2272] T bb7fd922979743428612619e8de33af1 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:22.608107 23089 consensus_peers.cc:597] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 -> Peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Couldn't send request to peer 6c6fa11e8ee34711b3551f0c670442bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.610610 21266 tablet_replica.cc:333] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:13:22.611280 30571 raft_consensus.cc:493] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:22.613973 30571 raft_consensus.cc:515] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:13:22.615031 30568 raft_consensus.cc:493] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:22.615542 30568 raft_consensus.cc:515] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } }
I20260709 12:13:22.617471 30568 leader_election.cc:290] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:13:22.614343 22570 leader_election.cc:336] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
I20260709 12:13:22.619298 22570 leader_election.cc:304] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:22.620124 30568 raft_consensus.cc:2749] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:13:22.620955 22569 leader_election.cc:336] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
W20260709 12:13:22.621497 22569 leader_election.cc:336] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:22.622452 30571 leader_election.cc:290] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:13:22.623464 21266 raft_consensus.cc:2243] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.624128 21266 raft_consensus.cc:2272] T 6334366811764682b0a491c130c68eed P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.627239 21266 tablet_replica.cc:333] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:13:22.628084 21266 raft_consensus.cc:2243] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.628726 21266 raft_consensus.cc:2272] T 746b2a18bc684213bde228ac6cc37ef6 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.631747 21266 tablet_replica.cc:333] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:13:22.632607 21266 raft_consensus.cc:2243] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.633327 21266 raft_consensus.cc:2272] T 0da3e85670e74df8af94383289960785 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.637355 21266 tablet_replica.cc:333] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:13:22.638199 21266 raft_consensus.cc:2243] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.639611 21266 raft_consensus.cc:2272] T 538826f1cb47443eb083fb9360e7b1fb P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:22.642001 23089 consensus_peers.cc:597] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 -> Peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Couldn't send request to peer 6c6fa11e8ee34711b3551f0c670442bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.644088 21266 tablet_replica.cc:333] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:13:22.645099 21266 raft_consensus.cc:2243] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.646181 21266 raft_consensus.cc:2272] T d7a58204e5354d61a3b5db01e879dce9 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.656265 21266 tablet_replica.cc:333] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:13:22.657373 21266 raft_consensus.cc:2243] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.659344 21266 raft_consensus.cc:2272] T 1143406a95dd472688b2fe621abd815f P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.662292 21266 tablet_replica.cc:333] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:13:22.663173 21266 raft_consensus.cc:2243] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.664330 21266 raft_consensus.cc:2272] T 19773e9e6aec446eb719d3d53d49812b P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.667533 21266 tablet_replica.cc:333] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:13:22.668749 21266 raft_consensus.cc:2243] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 LEADER]: Raft consensus shutting down.
W20260709 12:13:22.673835 22570 leader_election.cc:336] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
I20260709 12:13:22.674466 22570 leader_election.cc:304] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:22.675041 21266 raft_consensus.cc:2272] T 74d6480c61e542d583f6f89899989553 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.675297 30571 raft_consensus.cc:2749] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:13:22.676390 22570 leader_election.cc:336] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
I20260709 12:13:22.676836 22570 leader_election.cc:304] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c6fa11e8ee34711b3551f0c670442bc; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:22.677528 30571 raft_consensus.cc:2749] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:22.677956 21266 tablet_replica.cc:333] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:13:22.678794 21266 raft_consensus.cc:2243] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.679471 21266 raft_consensus.cc:2272] T a2337c1c696448c287a9a1885624d3d0 P 6c6fa11e8ee34711b3551f0c670442bc [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.682148 21266 tablet_replica.cc:333] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:13:22.682950 21266 raft_consensus.cc:2243] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.684167 21266 raft_consensus.cc:2272] T ea8ebc1d824844e688d0bd61c3fd2258 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.686885 21266 tablet_replica.cc:333] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:13:22.687628 21266 raft_consensus.cc:2243] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 30 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.688735 21266 raft_consensus.cc:2272] T 1b2392d4861b4d40b63dcdab54e716de P 6c6fa11e8ee34711b3551f0c670442bc [term 30 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:22.689867 23089 consensus_peers.cc:597] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 -> Peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Couldn't send request to peer 6c6fa11e8ee34711b3551f0c670442bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.691267 21266 tablet_replica.cc:333] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:13:22.692121 21266 raft_consensus.cc:2243] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.693521 21266 raft_consensus.cc:2272] T 00284432759445f6a017e6ddb9ec1689 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.695886 21266 tablet_replica.cc:333] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:13:22.696626 21266 raft_consensus.cc:2243] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.697288 21266 raft_consensus.cc:2272] T effbc980be0840c9891d7e7b22d3c3ef P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.699661 21266 tablet_replica.cc:333] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:13:22.700350 21266 raft_consensus.cc:2243] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.700865 21266 raft_consensus.cc:2272] T 40384260c96247e0ac31ade25baddaff P 6c6fa11e8ee34711b3551f0c670442bc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.702786 21266 tablet_replica.cc:333] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:13:22.703339 21266 raft_consensus.cc:2243] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.703781 21266 raft_consensus.cc:2272] T 05f9fdee21394d6e97e0554e30632be7 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.705837 21266 tablet_replica.cc:333] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:13:22.706357 21266 raft_consensus.cc:2243] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.707196 21266 raft_consensus.cc:2272] T 88417720c1014406ad04d7fb6b8f7ab4 P 6c6fa11e8ee34711b3551f0c670442bc [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.708961 21266 tablet_replica.cc:333] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:13:22.709523 21266 raft_consensus.cc:2243] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.710103 21266 raft_consensus.cc:2272] T b205f960deef48f8bc84127a8b47faf4 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.711987 21266 tablet_replica.cc:333] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:13:22.713505 21266 raft_consensus.cc:2243] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.714097 21266 raft_consensus.cc:2272] T b41723f4983d46d0bf385fae671d9a04 P 6c6fa11e8ee34711b3551f0c670442bc [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.716569 21266 tablet_replica.cc:333] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:13:22.717295 21266 raft_consensus.cc:2243] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.717942 21266 raft_consensus.cc:2272] T 041a72bc20f246bdb6e7cc6423d67e62 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.720270 21266 tablet_replica.cc:333] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:13:22.721976 21266 raft_consensus.cc:2243] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.722635 21266 raft_consensus.cc:2272] T f00721a4978a43d1af483d9f52de30bc P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.725149 21266 tablet_replica.cc:333] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:13:22.725860 21266 raft_consensus.cc:2243] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.726915 21266 raft_consensus.cc:2272] T 8c3000c4a87f46b69b5da41dc1115486 P 6c6fa11e8ee34711b3551f0c670442bc [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.729314 21266 tablet_replica.cc:333] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:13:22.729847 21266 raft_consensus.cc:2243] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.730736 21266 raft_consensus.cc:2272] T 1ba02be77861491da7dbcfee1161e46c P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.732525 21266 tablet_replica.cc:333] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:13:22.733217 21266 raft_consensus.cc:2243] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.733841 21266 raft_consensus.cc:2272] T 174e3ddf6ee147d9b066ce86d1318882 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.736222 21266 tablet_replica.cc:333] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:13:22.736912 21266 raft_consensus.cc:2243] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.737478 21266 raft_consensus.cc:2272] T 263d51d0b43744d899e37466045af890 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.739679 21266 tablet_replica.cc:333] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:13:22.740221 21266 raft_consensus.cc:2243] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.741060 21266 raft_consensus.cc:2272] T 13854b1cf45740e680c203d064295c78 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.743077 21266 tablet_replica.cc:333] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:13:22.743636 21266 raft_consensus.cc:2243] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.744451 21266 raft_consensus.cc:2272] T 60b63fe1f8174bdab922fc97591f1860 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.746261 21266 tablet_replica.cc:333] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:13:22.746762 21266 raft_consensus.cc:2243] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.747527 21266 raft_consensus.cc:2272] T b955a164159b49b9bf083e35e340e323 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.749589 21266 tablet_replica.cc:333] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:13:22.750257 21266 raft_consensus.cc:2243] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.750762 21266 raft_consensus.cc:2272] T 7c5dc015a7ef4e1daba3ed653d8ce7f9 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.753208 21266 tablet_replica.cc:333] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:13:22.753995 21266 raft_consensus.cc:2243] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.754684 21266 raft_consensus.cc:2272] T ee8d73c903fd41f7b207be9ca1cada33 P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.756752 21266 tablet_replica.cc:333] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:13:22.757431 21266 raft_consensus.cc:2243] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.758499 21266 raft_consensus.cc:2272] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.760987 21266 tablet_replica.cc:333] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:13:22.761698 21266 raft_consensus.cc:2243] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.762676 21266 raft_consensus.cc:2272] T 4c23033521664ca6a0c00a6f0f552308 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.765062 21266 tablet_replica.cc:333] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
W20260709 12:13:22.765021 23089 consensus_peers.cc:597] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 -> Peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Couldn't send request to peer 6c6fa11e8ee34711b3551f0c670442bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.766021 21266 raft_consensus.cc:2243] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.767268 21266 raft_consensus.cc:2272] T 254fb9df2b39405996039a40091b4875 P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.769600 21266 tablet_replica.cc:333] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:13:22.770247 21266 raft_consensus.cc:2243] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.771512 21266 raft_consensus.cc:2272] T f007f8ed533640a9a25704c288c49f3c P 6c6fa11e8ee34711b3551f0c670442bc [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.773944 21266 tablet_replica.cc:333] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:13:22.774739 21266 raft_consensus.cc:2243] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.775799 21266 raft_consensus.cc:2272] T 08a2fbce096642eb849b1a143f8e7bb9 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:22.776974 23089 consensus_peers.cc:597] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 -> Peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Couldn't send request to peer 6c6fa11e8ee34711b3551f0c670442bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.778321 21266 tablet_replica.cc:333] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:13:22.780066 21266 raft_consensus.cc:2243] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.781219 21266 raft_consensus.cc:2272] T 9b31ce17d24644c19dbf9469c435d149 P 6c6fa11e8ee34711b3551f0c670442bc [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:22.782058 23087 consensus_peers.cc:597] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:13:22.783982 21266 tablet_replica.cc:333] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:13:22.784929 21266 raft_consensus.cc:2243] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.785486 21266 raft_consensus.cc:2272] T b196b03fbcb045da91c663d6595b2775 P 6c6fa11e8ee34711b3551f0c670442bc [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.787873 21266 tablet_replica.cc:333] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:13:22.788579 21266 raft_consensus.cc:2243] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.789170 21266 raft_consensus.cc:2272] T 871e4d35e385425cb2fe5d84b8d4fd45 P 6c6fa11e8ee34711b3551f0c670442bc [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.791671 21266 tablet_replica.cc:333] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:13:22.792337 21266 raft_consensus.cc:2243] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.793704 21266 raft_consensus.cc:2272] T 5cd56edb2a504be8a2de859108bea8e2 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.795921 21266 tablet_replica.cc:333] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:13:22.796489 21266 raft_consensus.cc:2243] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.797281 21266 raft_consensus.cc:2272] T 272afea078f74bf19baefd3c1300644d P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.799357 21266 tablet_replica.cc:333] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:13:22.800040 21266 raft_consensus.cc:2243] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.801029 21266 raft_consensus.cc:2272] T 9d328826e9a04a61be5bfb46dcfa77ab P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.803390 21266 tablet_replica.cc:333] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:13:22.804023 21266 raft_consensus.cc:2243] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.804616 21266 raft_consensus.cc:2272] T cf7e3d0e753849fcb1514dc105ababfd P 6c6fa11e8ee34711b3551f0c670442bc [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.806967 21266 tablet_replica.cc:333] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:13:22.807590 21266 raft_consensus.cc:2243] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.808178 21266 raft_consensus.cc:2272] T 30b3fe7a04b74137b559ad33a85cddff P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:22.809186 23089 consensus_peers.cc:597] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 -> Peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Couldn't send request to peer 6c6fa11e8ee34711b3551f0c670442bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.810510 21266 tablet_replica.cc:333] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:13:22.811110 21266 raft_consensus.cc:2243] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.811635 21266 raft_consensus.cc:2272] T bf783936508640219af47375c444da09 P 6c6fa11e8ee34711b3551f0c670442bc [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.813670 21266 tablet_replica.cc:333] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc: stopping tablet replica
I20260709 12:13:22.814136 21266 raft_consensus.cc:2243] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.814726 21266 raft_consensus.cc:2272] T 9286627b6c59411d908ec035984616ac P 6c6fa11e8ee34711b3551f0c670442bc [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:22.820631 23089 consensus_peers.cc:597] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 -> Peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Couldn't send request to peer 6c6fa11e8ee34711b3551f0c670442bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:22.834640 23089 consensus_peers.cc:597] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 -> Peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Couldn't send request to peer 6c6fa11e8ee34711b3551f0c670442bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:22.850386 23089 consensus_peers.cc:597] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 -> Peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Couldn't send request to peer 6c6fa11e8ee34711b3551f0c670442bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:22.861020 23089 consensus_peers.cc:597] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 -> Peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Couldn't send request to peer 6c6fa11e8ee34711b3551f0c670442bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:22.912091 23087 consensus_peers.cc:597] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:13:22.925673 30566 raft_consensus.cc:493] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:22.926316 30566 raft_consensus.cc:515] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:13:22.938926 23088 leader_election.cc:336] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
W20260709 12:13:22.940124 23087 leader_election.cc:336] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:22.940516 23087 leader_election.cc:304] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:22.941250 30566 leader_election.cc:290] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:13:22.941947 30520 raft_consensus.cc:2749] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:13:22.964061 23089 consensus_peers.cc:597] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270 -> Peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Couldn't send request to peer 6c6fa11e8ee34711b3551f0c670442bc. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.131:37785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:23.010010 30566 raft_consensus.cc:493] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:23.011142 30566 raft_consensus.cc:515] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:13:23.019845 23087 leader_election.cc:336] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
W20260709 12:13:23.026328 23088 leader_election.cc:336] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
I20260709 12:13:23.026865 23088 leader_election.cc:304] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:23.028275 30520 raft_consensus.cc:2749] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:23.033293 30566 leader_election.cc:290] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:13:23.033917 30520 raft_consensus.cc:493] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:23.034739 30520 raft_consensus.cc:515] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:23.036896 30520 leader_election.cc:290] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:13:23.046406 23088 leader_election.cc:336] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
W20260709 12:13:23.086100 23087 leader_election.cc:336] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:23.102310 23087 leader_election.cc:304] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:23.105867 30573 raft_consensus.cc:2749] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:23.086117 30575 raft_consensus.cc:493] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:23.110827 30575 raft_consensus.cc:515] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:23.113111 30575 leader_election.cc:290] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
I20260709 12:13:23.086722 30566 raft_consensus.cc:493] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:23.113924 30566 raft_consensus.cc:515] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:23.116182 30566 leader_election.cc:290] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:13:23.123800 23087 consensus_peers.cc:597] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:13:23.125578 23088 leader_election.cc:336] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
I20260709 12:13:23.129096 30566 raft_consensus.cc:493] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:23.129595 30566 raft_consensus.cc:515] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:23.131619 30566 leader_election.cc:290] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733)
W20260709 12:13:23.135895 23087 leader_election.cc:336] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:23.137301 23087 leader_election.cc:304] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:13:23.136876 23088 leader_election.cc:336] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
I20260709 12:13:23.138811 30566 raft_consensus.cc:2749] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:13:23.139729 23087 leader_election.cc:336] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:23.141702 23087 leader_election.cc:304] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:13:23.141275 23088 leader_election.cc:336] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
I20260709 12:13:23.142784 30566 raft_consensus.cc:2749] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:13:23.156565 23087 leader_election.cc:336] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:23.157083 23087 leader_election.cc:304] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:23.158596 30566 raft_consensus.cc:2749] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:13:23.226994 23087 consensus_peers.cc:597] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:23.254535 23087 consensus_peers.cc:597] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:13:23.255163 23087 consensus_peers.cc:597] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:13:23.259814 23087 consensus_peers.cc:597] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:23.269289 23088 consensus_peers.cc:597] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:23.325464 23087 consensus_peers.cc:597] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:13:23.515897 23087 consensus_peers.cc:597] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:13:23.574539 23087 consensus_peers.cc:597] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:13:23.575259 23087 consensus_peers.cc:597] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:23.608657 23088 consensus_peers.cc:597] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:23.682439 23088 consensus_peers.cc:597] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:23.699005 30574 raft_consensus.cc:493] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:13:23.699700 30574 raft_consensus.cc:515] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:23.701732 30574 leader_election.cc:290] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:13:23.707741 23089 leader_election.cc:336] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Network error: Client connection negotiation failed: client connection to 127.20.196.131:37785: connect: Connection refused (error 111)
W20260709 12:13:23.716599 23087 consensus_peers.cc:597] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:13:23.717074 23088 consensus_peers.cc:597] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:23.718863 23088 consensus_peers.cc:597] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:23.724225 23088 leader_election.cc:336] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
I20260709 12:13:23.724686 23088 leader_election.cc:304] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:13:23.725541 30574 raft_consensus.cc:2749] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:13:23.734025 23088 consensus_peers.cc:597] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:23.778167 30574 raft_consensus.cc:493] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:13:23.778864 30574 raft_consensus.cc:515] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:13:23.791164 23089 leader_election.cc:336] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Network error: Client connection negotiation failed: client connection to 127.20.196.131:37785: connect: Connection refused (error 111)
I20260709 12:13:23.798646 30574 leader_election.cc:290] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:13:23.801173 30574 raft_consensus.cc:493] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:13:23.802729 30574 raft_consensus.cc:515] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:23.807000 30574 leader_election.cc:290] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:13:23.813860 23087 consensus_peers.cc:597] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:23.820896 23089 leader_election.cc:336] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Network error: Client connection negotiation failed: client connection to 127.20.196.131:37785: connect: Connection refused (error 111)
W20260709 12:13:23.821518 23088 leader_election.cc:336] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
I20260709 12:13:23.822297 23088 leader_election.cc:304] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:13:23.823125 30574 raft_consensus.cc:2749] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:13:23.824075 23088 consensus_peers.cc:597] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:23.827121 23088 leader_election.cc:336] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
I20260709 12:13:23.827580 23088 leader_election.cc:304] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:13:23.828258 30574 raft_consensus.cc:2749] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:23.901016 30574 raft_consensus.cc:493] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:13:23.901646 30574 raft_consensus.cc:515] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:13:23.910256 23087 leader_election.cc:336] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:23.911736 30574 leader_election.cc:290] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:13:23.924194 30574 raft_consensus.cc:493] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:13:23.925473 30574 raft_consensus.cc:515] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:13:23.930301 23089 leader_election.cc:336] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Network error: Client connection negotiation failed: client connection to 127.20.196.131:37785: connect: Connection refused (error 111)
I20260709 12:13:23.931644 23089 leader_election.cc:304] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:13:23.938766 23088 leader_election.cc:336] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
I20260709 12:13:23.940940 30574 leader_election.cc:290] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:13:23.941926 30566 raft_consensus.cc:2749] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:23.970608 30566 raft_consensus.cc:493] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:13:23.971114 30566 raft_consensus.cc:515] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:23.973034 30566 leader_election.cc:290] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
I20260709 12:13:23.962265 30520 raft_consensus.cc:493] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:13:23.973825 30520 raft_consensus.cc:515] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:23.979486 30520 leader_election.cc:290] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:13:23.985980 23087 leader_election.cc:336] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
W20260709 12:13:23.994691 23088 leader_election.cc:336] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
W20260709 12:13:23.998188 23088 consensus_peers.cc:597] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270 -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:24.013399 23089 leader_election.cc:336] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Network error: Client connection negotiation failed: client connection to 127.20.196.131:37785: connect: Connection refused (error 111)
I20260709 12:13:24.013542 30520 raft_consensus.cc:493] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:13:24.014019 23089 leader_election.cc:304] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:13:24.014124 30520 raft_consensus.cc:515] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:24.014797 30577 raft_consensus.cc:2749] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:24.017019 30520 leader_election.cc:290] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:13:24.020807 23089 leader_election.cc:336] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Network error: Client connection negotiation failed: client connection to 127.20.196.131:37785: connect: Connection refused (error 111)
I20260709 12:13:24.021201 23089 leader_election.cc:304] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:24.022272 30574 raft_consensus.cc:2749] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:13:24.023576 23089 leader_election.cc:336] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Network error: Client connection negotiation failed: client connection to 127.20.196.131:37785: connect: Connection refused (error 111)
I20260709 12:13:24.024501 23089 leader_election.cc:304] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:13:24.025767 30574 raft_consensus.cc:2749] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:13:24.028431 23089 leader_election.cc:336] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Network error: Client connection negotiation failed: client connection to 127.20.196.131:37785: connect: Connection refused (error 111)
W20260709 12:13:24.075687 23088 leader_election.cc:336] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
I20260709 12:13:24.076789 23088 leader_election.cc:304] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:13:24.082079 30577 raft_consensus.cc:2749] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:13:24.098500 23087 consensus_peers.cc:597] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:13:24.104651 30574 raft_consensus.cc:493] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:13:24.105660 30574 raft_consensus.cc:515] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:24.110237 30574 leader_election.cc:290] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:13:24.110881 23088 consensus_peers.cc:597] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:24.111685 30577 raft_consensus.cc:493] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:13:24.119292 30577 raft_consensus.cc:515] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:24.121668 30577 leader_election.cc:290] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:13:24.126732 23087 leader_election.cc:336] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:24.127481 30577 raft_consensus.cc:493] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:13:24.132066 30577 raft_consensus.cc:515] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:24.134483 30577 leader_election.cc:290] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:13:24.137650 23088 consensus_peers.cc:597] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:24.138280 23088 consensus_peers.cc:597] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:24.139050 23089 leader_election.cc:336] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Network error: Client connection negotiation failed: client connection to 127.20.196.131:37785: connect: Connection refused (error 111)
I20260709 12:13:24.143111 23089 leader_election.cc:304] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
W20260709 12:13:24.145751 23087 consensus_peers.cc:597] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:13:24.148950 30577 raft_consensus.cc:2749] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:13:24.149463 23088 consensus_peers.cc:597] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:24.149946 23088 leader_election.cc:336] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
W20260709 12:13:24.154402 23089 leader_election.cc:336] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Network error: Client connection negotiation failed: client connection to 127.20.196.131:37785: connect: Connection refused (error 111)
W20260709 12:13:24.162118 23089 leader_election.cc:336] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Network error: Client connection negotiation failed: client connection to 127.20.196.131:37785: connect: Connection refused (error 111)
I20260709 12:13:24.164198 23089 leader_election.cc:304] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
W20260709 12:13:24.163727 23088 leader_election.cc:336] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
I20260709 12:13:24.164970 23088 leader_election.cc:304] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:13:24.165570 30577 raft_consensus.cc:2749] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:24.169345 30574 raft_consensus.cc:2749] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:24.174206 30574 raft_consensus.cc:493] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:13:24.174897 30574 raft_consensus.cc:515] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:13:24.188459 23087 leader_election.cc:336] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:24.184904 30574 leader_election.cc:290] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:13:24.193001 23088 consensus_peers.cc:597] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:24.196167 23089 leader_election.cc:336] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Network error: Client connection negotiation failed: client connection to 127.20.196.131:37785: connect: Connection refused (error 111)
I20260709 12:13:24.196607 23089 leader_election.cc:304] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:24.197700 30574 raft_consensus.cc:2749] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:13:24.202153 23088 consensus_peers.cc:597] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:24.202826 23088 consensus_peers.cc:597] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 -> Peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Couldn't send request to peer 1676e7af5e4a47cb86ee7db83e3d4881. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:24.224820 30574 raft_consensus.cc:493] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:13:24.232357 30574 raft_consensus.cc:515] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
W20260709 12:13:24.239832 23087 leader_election.cc:336] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:24.247933 30574 leader_election.cc:290] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:13:24.256744 23089 leader_election.cc:336] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Network error: Client connection negotiation failed: client connection to 127.20.196.131:37785: connect: Connection refused (error 111)
I20260709 12:13:24.257264 23089 leader_election.cc:304] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:24.258631 30574 raft_consensus.cc:2749] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:24.280603 30574 raft_consensus.cc:493] T 5cd56edb2a504be8a2de859108bea8e2 P 8701cd5186a949538d8efafb5f987270 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 6c6fa11e8ee34711b3551f0c670442bc)
I20260709 12:13:24.281414 30574 raft_consensus.cc:515] T 5cd56edb2a504be8a2de859108bea8e2 P 8701cd5186a949538d8efafb5f987270 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:24.283787 30574 leader_election.cc:290] T 5cd56edb2a504be8a2de859108bea8e2 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:13:24.291352 23088 leader_election.cc:336] T 5cd56edb2a504be8a2de859108bea8e2 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
W20260709 12:13:24.296764 23089 leader_election.cc:336] T 5cd56edb2a504be8a2de859108bea8e2 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Network error: Client connection negotiation failed: client connection to 127.20.196.131:37785: connect: Connection refused (error 111)
I20260709 12:13:24.297269 23089 leader_election.cc:304] T 5cd56edb2a504be8a2de859108bea8e2 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 1676e7af5e4a47cb86ee7db83e3d4881, 6c6fa11e8ee34711b3551f0c670442bc
I20260709 12:13:24.299489 30574 raft_consensus.cc:2749] T 5cd56edb2a504be8a2de859108bea8e2 P 8701cd5186a949538d8efafb5f987270 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:13:24.414418 23087 consensus_peers.cc:597] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:13:24.604995 23087 consensus_peers.cc:597] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 -> Peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Couldn't send request to peer c863116d91c14d1ca50d6e8a46a37a8f. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:13:24.624981 21266 tablet_server.cc:196] TabletServer@127.20.196.131:0 shutdown complete.
I20260709 12:13:24.666419 30520 raft_consensus.cc:493] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1676e7af5e4a47cb86ee7db83e3d4881)
I20260709 12:13:24.667176 30520 raft_consensus.cc:515] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c863116d91c14d1ca50d6e8a46a37a8f" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 42317 } } peers { permanent_uuid: "1676e7af5e4a47cb86ee7db83e3d4881" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 42733 } } peers { permanent_uuid: "6c6fa11e8ee34711b3551f0c670442bc" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37785 } attrs { replace: true } } peers { permanent_uuid: "8701cd5186a949538d8efafb5f987270" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 44353 } attrs { promote: false } }
I20260709 12:13:24.669926 30520 leader_election.cc:290] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317), 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733), 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785)
W20260709 12:13:24.676779 23087 leader_election.cc:336] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
W20260709 12:13:24.677629 23089 leader_election.cc:336] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Network error: Client connection negotiation failed: client connection to 127.20.196.131:37785: connect: Connection refused (error 111)
I20260709 12:13:24.679960 23089 leader_election.cc:304] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8701cd5186a949538d8efafb5f987270; no voters: 6c6fa11e8ee34711b3551f0c670442bc, c863116d91c14d1ca50d6e8a46a37a8f
I20260709 12:13:24.680739 30574 raft_consensus.cc:2749] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:13:24.682708 23088 leader_election.cc:336] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1676e7af5e4a47cb86ee7db83e3d4881 (127.20.196.130:42733): Network error: Client connection negotiation failed: client connection to 127.20.196.130:42733: connect: Connection refused (error 111)
I20260709 12:13:24.807503 21266 tablet_server.cc:179] TabletServer@127.20.196.132:0 shutting down...
W20260709 12:13:24.822453 23089 consensus_peers.cc:597] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 -> Peer 6c6fa11e8ee34711b3551f0c670442bc (127.20.196.131:37785): Couldn't send request to peer 6c6fa11e8ee34711b3551f0c670442bc. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.131:37785: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:24.883728 21266 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:24.886763 21266 tablet_replica.cc:333] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270: stopping tablet replica
I20260709 12:13:24.888114 21266 raft_consensus.cc:2243] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.890341 21266 raft_consensus.cc:2272] T 67b097456aac41edb06c5a4efd504ca1 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.893769 21266 tablet_replica.cc:333] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270: stopping tablet replica
I20260709 12:13:24.894876 21266 raft_consensus.cc:2243] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:13:24.896409 21266 raft_consensus.cc:2272] T 19a99176cd014d618ba1793fbb19aeab P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.899689 21266 tablet_replica.cc:333] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270: stopping tablet replica
I20260709 12:13:24.900592 21266 raft_consensus.cc:2243] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:13:24.902257 21266 raft_consensus.cc:2272] T aeff0fdef6b04a46975756455aba1a98 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.905103 21266 tablet_replica.cc:333] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270: stopping tablet replica
I20260709 12:13:24.906019 21266 raft_consensus.cc:2243] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:13:24.907406 21266 raft_consensus.cc:2272] T ea8ebc1d824844e688d0bd61c3fd2258 P 8701cd5186a949538d8efafb5f987270 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.910502 21266 tablet_replica.cc:333] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270: stopping tablet replica
I20260709 12:13:24.911329 21266 raft_consensus.cc:2243] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:13:24.912846 21266 raft_consensus.cc:2272] T 746b2a18bc684213bde228ac6cc37ef6 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.915815 21266 tablet_replica.cc:333] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270: stopping tablet replica
I20260709 12:13:24.916637 21266 raft_consensus.cc:2243] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.917464 21266 raft_consensus.cc:2272] T 1ba02be77861491da7dbcfee1161e46c P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.920444 21266 tablet_replica.cc:333] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270: stopping tablet replica
I20260709 12:13:24.921330 21266 raft_consensus.cc:2243] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:13:24.922956 21266 raft_consensus.cc:2272] T 9286627b6c59411d908ec035984616ac P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.925923 21266 tablet_replica.cc:333] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270: stopping tablet replica
I20260709 12:13:24.926664 21266 raft_consensus.cc:2243] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.927512 21266 raft_consensus.cc:2272] T 08a2fbce096642eb849b1a143f8e7bb9 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.930202 21266 tablet_replica.cc:333] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270: stopping tablet replica
I20260709 12:13:24.931093 21266 raft_consensus.cc:2243] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.932260 21266 raft_consensus.cc:2272] T 8efee6d07e5841fdb6b0d7ed673b49cb P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.934824 21266 tablet_replica.cc:333] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270: stopping tablet replica
I20260709 12:13:24.935694 21266 raft_consensus.cc:2243] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:13:24.937222 21266 raft_consensus.cc:2272] T 538826f1cb47443eb083fb9360e7b1fb P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.940248 21266 tablet_replica.cc:333] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270: stopping tablet replica
I20260709 12:13:24.941211 21266 raft_consensus.cc:2243] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:13:24.942766 21266 raft_consensus.cc:2272] T b41723f4983d46d0bf385fae671d9a04 P 8701cd5186a949538d8efafb5f987270 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.945737 21266 tablet_replica.cc:333] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270: stopping tablet replica
I20260709 12:13:24.946568 21266 raft_consensus.cc:2243] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.947193 21266 raft_consensus.cc:2272] T 8c3000c4a87f46b69b5da41dc1115486 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.950011 21266 tablet_replica.cc:333] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270: stopping tablet replica
I20260709 12:13:24.950806 21266 raft_consensus.cc:2243] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.951598 21266 raft_consensus.cc:2272] T 3aebfd8b04a4461ab6bc979eee23a2bc P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.954645 21266 tablet_replica.cc:333] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270: stopping tablet replica
I20260709 12:13:24.955466 21266 raft_consensus.cc:2243] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:13:24.956874 21266 raft_consensus.cc:2272] T 5b50f0bec71f4924aa1781b9818f1d73 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.959584 21266 tablet_replica.cc:333] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270: stopping tablet replica
I20260709 12:13:24.960487 21266 raft_consensus.cc:2243] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:13:24.961824 21266 raft_consensus.cc:2272] T b205f960deef48f8bc84127a8b47faf4 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.964520 21266 tablet_replica.cc:333] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270: stopping tablet replica
I20260709 12:13:24.965291 21266 raft_consensus.cc:2243] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.966013 21266 raft_consensus.cc:2272] T b36f3a080ce7465b8491197cc6189444 P 8701cd5186a949538d8efafb5f987270 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.968725 21266 tablet_replica.cc:333] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270: stopping tablet replica
I20260709 12:13:24.969465 21266 raft_consensus.cc:2243] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:13:24.970767 21266 raft_consensus.cc:2272] T cf7e3d0e753849fcb1514dc105ababfd P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.973481 21266 tablet_replica.cc:333] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270: stopping tablet replica
I20260709 12:13:24.974200 21266 raft_consensus.cc:2243] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:13:24.975907 21266 raft_consensus.cc:2272] T 40384260c96247e0ac31ade25baddaff P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.978633 21266 tablet_replica.cc:333] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270: stopping tablet replica
I20260709 12:13:24.979549 21266 raft_consensus.cc:2243] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.980400 21266 raft_consensus.cc:2272] T 10ed4486435d4f82978c5cb544504999 P 8701cd5186a949538d8efafb5f987270 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.983543 21266 tablet_replica.cc:333] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270: stopping tablet replica
I20260709 12:13:24.984566 21266 raft_consensus.cc:2243] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270 [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:13:24.986860 21266 raft_consensus.cc:2272] T 0da3e85670e74df8af94383289960785 P 8701cd5186a949538d8efafb5f987270 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.990367 21266 tablet_replica.cc:333] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270: stopping tablet replica
I20260709 12:13:24.991218 21266 raft_consensus.cc:2243] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.992478 21266 raft_consensus.cc:2272] T 9b31ce17d24644c19dbf9469c435d149 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.995270 21266 tablet_replica.cc:333] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270: stopping tablet replica
I20260709 12:13:24.996105 21266 raft_consensus.cc:2243] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:13:24.997666 21266 raft_consensus.cc:2272] T 897c484d3dec40a296e097e6b8d26d39 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:25.000542 21266 tablet_replica.cc:333] T 5cd56edb2a504be8a2de859108bea8e2 P 8701cd5186a949538d8efafb5f987270: stopping tablet replica
I20260709 12:13:25.001410 21266 raft_consensus.cc:2243] T 5cd56edb2a504be8a2de859108bea8e2 P 8701cd5186a949538d8efafb5f987270 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:25.002095 21266 raft_consensus.cc:2272] T 5cd56edb2a504be8a2de859108bea8e2 P 8701cd5186a949538d8efafb5f987270 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:25.005298 21266 tablet_replica.cc:333] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270: stopping tablet replica
I20260709 12:13:25.006201 21266 raft_consensus.cc:2243] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:25.007658 21266 raft_consensus.cc:2272] T 272afea078f74bf19baefd3c1300644d P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:25.010644 21266 tablet_replica.cc:333] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270: stopping tablet replica
I20260709 12:13:25.011709 21266 raft_consensus.cc:2243] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:25.012370 21266 raft_consensus.cc:2272] T d7a58204e5354d61a3b5db01e879dce9 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:25.040827 21266 tablet_replica.cc:333] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270: stopping tablet replica
I20260709 12:13:25.041886 21266 raft_consensus.cc:2243] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:25.043358 21266 raft_consensus.cc:2272] T 00284432759445f6a017e6ddb9ec1689 P 8701cd5186a949538d8efafb5f987270 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:25.046402 21266 tablet_replica.cc:333] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270: stopping tablet replica
I20260709 12:13:25.047127 21266 raft_consensus.cc:2243] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:13:25.049584 21266 raft_consensus.cc:2272] T 62319c9e82134e7daf8a46f78c124bff P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:25.052663 21266 tablet_replica.cc:333] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270: stopping tablet replica
I20260709 12:13:25.053699 21266 raft_consensus.cc:2243] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:13:25.055279 21266 raft_consensus.cc:2272] T 4e5929206e89419f978fa0283f6bb931 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:25.058648 21266 tablet_replica.cc:333] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270: stopping tablet replica
I20260709 12:13:25.059716 21266 raft_consensus.cc:2243] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:25.061036 21266 raft_consensus.cc:2272] T 174e3ddf6ee147d9b066ce86d1318882 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:25.118511 21266 tablet_replica.cc:333] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270: stopping tablet replica
I20260709 12:13:25.119812 21266 raft_consensus.cc:2243] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:13:25.121987 21266 raft_consensus.cc:2272] T 82e7db06c6ff4d96853c60f0f42c09a8 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:25.137741 21266 tablet_replica.cc:333] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270: stopping tablet replica
I20260709 12:13:25.166633 21266 raft_consensus.cc:2243] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:13:25.197429 21266 raft_consensus.cc:2272] T 263d51d0b43744d899e37466045af890 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:25.201198 21266 tablet_replica.cc:333] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270: stopping tablet replica
I20260709 12:13:25.210896 21266 raft_consensus.cc:2243] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:13:25.212229 21266 raft_consensus.cc:2272] T bf783936508640219af47375c444da09 P 8701cd5186a949538d8efafb5f987270 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:25.217526 21266 tablet_replica.cc:333] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270: stopping tablet replica
I20260709 12:13:25.218398 21266 raft_consensus.cc:2243] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:25.219204 21266 raft_consensus.cc:2272] T f007f8ed533640a9a25704c288c49f3c P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:25.222275 21266 tablet_replica.cc:333] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270: stopping tablet replica
I20260709 12:13:25.223213 21266 raft_consensus.cc:2243] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:25.223960 21266 raft_consensus.cc:2272] T 4c23033521664ca6a0c00a6f0f552308 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:25.226805 21266 tablet_replica.cc:333] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270: stopping tablet replica
I20260709 12:13:25.227595 21266 raft_consensus.cc:2243] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:25.228914 21266 raft_consensus.cc:2272] T cfdc6a19d6fc4ae7b122bc59c5d22aa0 P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:25.231597 21266 tablet_replica.cc:333] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270: stopping tablet replica
I20260709 12:13:25.232406 21266 raft_consensus.cc:2243] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:13:25.233816 21266 raft_consensus.cc:2272] T b196b03fbcb045da91c663d6595b2775 P 8701cd5186a949538d8efafb5f987270 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:25.236617 21266 tablet_replica.cc:333] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270: stopping tablet replica
I20260709 12:13:25.237387 21266 raft_consensus.cc:2243] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:25.238799 21266 raft_consensus.cc:2272] T ee3ba2f54b0343bea5e3a5364c372a89 P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:25.241554 21266 tablet_replica.cc:333] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270: stopping tablet replica
I20260709 12:13:25.242352 21266 raft_consensus.cc:2243] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:13:25.243525 21266 raft_consensus.cc:2272] T 6334366811764682b0a491c130c68eed P 8701cd5186a949538d8efafb5f987270 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:25.246332 21266 tablet_replica.cc:333] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270: stopping tablet replica
I20260709 12:13:25.247079 21266 raft_consensus.cc:2243] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:25.247805 21266 raft_consensus.cc:2272] T 13854b1cf45740e680c203d064295c78 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:25.250502 21266 tablet_replica.cc:333] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270: stopping tablet replica
I20260709 12:13:25.251281 21266 raft_consensus.cc:2243] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:25.251921 21266 raft_consensus.cc:2272] T 19773e9e6aec446eb719d3d53d49812b P 8701cd5186a949538d8efafb5f987270 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:25.254841 21266 tablet_replica.cc:333] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270: stopping tablet replica
I20260709 12:13:25.255621 21266 raft_consensus.cc:2243] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:13:25.256909 21266 raft_consensus.cc:2272] T 041a72bc20f246bdb6e7cc6423d67e62 P 8701cd5186a949538d8efafb5f987270 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:25.259395 21266 tablet_replica.cc:333] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270: stopping tablet replica
I20260709 12:13:25.260087 21266 raft_consensus.cc:2243] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:13:25.261325 21266 raft_consensus.cc:2272] T 6445cf83e0b646428e39f19d21ca6c44 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:25.263895 21266 tablet_replica.cc:333] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270: stopping tablet replica
I20260709 12:13:25.264555 21266 raft_consensus.cc:2243] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:25.265487 21266 raft_consensus.cc:2272] T 60b63fe1f8174bdab922fc97591f1860 P 8701cd5186a949538d8efafb5f987270 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:25.268263 21266 tablet_replica.cc:333] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270: stopping tablet replica
I20260709 12:13:25.268846 21266 raft_consensus.cc:2243] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:13:25.270355 21266 raft_consensus.cc:2272] T 05f9fdee21394d6e97e0554e30632be7 P 8701cd5186a949538d8efafb5f987270 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:26.240804 23146 debug-util.cc:398] Leaking SignalData structure 0x7b080013c020 after lost signal to thread 21269
W20260709 12:13:26.241935 23146 debug-util.cc:398] Leaking SignalData structure 0x7b0800193b20 after lost signal to thread 22389
W20260709 12:13:26.242503 23146 debug-util.cc:398] Leaking SignalData structure 0x7b0800353520 after lost signal to thread 23149
W20260709 12:13:26.358834 21266 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 23146)
I20260709 12:13:27.268208 21266 tablet_server.cc:196] TabletServer@127.20.196.132:0 shutdown complete.
I20260709 12:13:27.349310 21266 master.cc:562] Master@127.20.196.190:44877 shutting down...
W20260709 12:13:27.384516 22403 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:13:27.384809 22403 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:13:27.385030 22403 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:13:38.386426 22339 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111) [suppressed 345 similar messages]
W20260709 12:13:38.390412 22339 catalog_manager.cc:4755] TS c863116d91c14d1ca50d6e8a46a37a8f (127.20.196.129:42317): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 5cd56edb2a504be8a2de859108bea8e2: Network error: Client connection negotiation failed: client connection to 127.20.196.129:42317: connect: Connection refused (error 111)
I20260709 12:13:41.002794 21266 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 136fd3da76544029a815aef59e698e17 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:41.003998 21266 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 136fd3da76544029a815aef59e698e17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.004422 21266 tablet_replica.cc:333] T 00000000000000000000000000000000 P 136fd3da76544029a815aef59e698e17: stopping tablet replica
I20260709 12:13:41.160808 21266 master.cc:584] Master@127.20.196.190:44877 shutdown complete.
I20260709 12:13:41.216771 21266 test_util.cc:182] -----------------------------------------------
I20260709 12:13:41.216988 21266 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894355727-21266-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (265189 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:13:41.220623 21266 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.196.190:44745
I20260709 12:13:41.221808 21266 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:41.228080 30583 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:41.228463 30582 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:41.228989 30585 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:41.229453 21266 server_base.cc:1061] running on GCE node
I20260709 12:13:41.233780 21266 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:41.234112 21266 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:41.234277 21266 hybrid_clock.cc:648] HybridClock initialized: now 1783599221234262 us; error 0 us; skew 500 ppm
I20260709 12:13:41.235006 21266 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:41.237757 21266 webserver.cc:533] Webserver started at http://127.20.196.190:37879/ using document root <none> and password file <none>
I20260709 12:13:41.238216 21266 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:41.238369 21266 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:41.238584 21266 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:41.239893 21266 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894355727-21266-0/minicluster-data/master-0-root/instance:
uuid: "52770f65168a4e6a9c2fbf4335348a18"
format_stamp: "Formatted at 2026-07-09 12:13:41 on dist-test-slave-h6sg"
I20260709 12:13:41.244432 21266 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 12:13:41.247862 30590 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:41.248656 21266 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:13:41.248946 21266 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894355727-21266-0/minicluster-data/master-0-root
uuid: "52770f65168a4e6a9c2fbf4335348a18"
format_stamp: "Formatted at 2026-07-09 12:13:41 on dist-test-slave-h6sg"
I20260709 12:13:41.249253 21266 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894355727-21266-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894355727-21266-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894355727-21266-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:41.260658 21266 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:41.261900 21266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:41.302278 21266 rpc_server.cc:307] RPC server started. Bound to: 127.20.196.190:44745
I20260709 12:13:41.302392 30641 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.196.190:44745 every 8 connection(s)
I20260709 12:13:41.306509 30642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:41.318205 30642 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52770f65168a4e6a9c2fbf4335348a18: Bootstrap starting.
I20260709 12:13:41.323408 30642 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 52770f65168a4e6a9c2fbf4335348a18: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:41.327690 30642 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52770f65168a4e6a9c2fbf4335348a18: No bootstrap required, opened a new log
I20260709 12:13:41.330000 30642 raft_consensus.cc:359] T 00000000000000000000000000000000 P 52770f65168a4e6a9c2fbf4335348a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52770f65168a4e6a9c2fbf4335348a18" member_type: VOTER }
I20260709 12:13:41.330477 30642 raft_consensus.cc:385] T 00000000000000000000000000000000 P 52770f65168a4e6a9c2fbf4335348a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:41.330718 30642 raft_consensus.cc:740] T 00000000000000000000000000000000 P 52770f65168a4e6a9c2fbf4335348a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52770f65168a4e6a9c2fbf4335348a18, State: Initialized, Role: FOLLOWER
I20260709 12:13:41.331415 30642 consensus_queue.cc:260] T 00000000000000000000000000000000 P 52770f65168a4e6a9c2fbf4335348a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52770f65168a4e6a9c2fbf4335348a18" member_type: VOTER }
I20260709 12:13:41.331883 30642 raft_consensus.cc:399] T 00000000000000000000000000000000 P 52770f65168a4e6a9c2fbf4335348a18 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:13:41.332139 30642 raft_consensus.cc:493] T 00000000000000000000000000000000 P 52770f65168a4e6a9c2fbf4335348a18 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:13:41.332430 30642 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 52770f65168a4e6a9c2fbf4335348a18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:41.337514 30642 raft_consensus.cc:515] T 00000000000000000000000000000000 P 52770f65168a4e6a9c2fbf4335348a18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52770f65168a4e6a9c2fbf4335348a18" member_type: VOTER }
I20260709 12:13:41.338014 30642 leader_election.cc:304] T 00000000000000000000000000000000 P 52770f65168a4e6a9c2fbf4335348a18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 52770f65168a4e6a9c2fbf4335348a18; no voters: 
I20260709 12:13:41.339201 30642 leader_election.cc:290] T 00000000000000000000000000000000 P 52770f65168a4e6a9c2fbf4335348a18 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:13:41.339641 30645 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 52770f65168a4e6a9c2fbf4335348a18 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:41.341008 30645 raft_consensus.cc:697] T 00000000000000000000000000000000 P 52770f65168a4e6a9c2fbf4335348a18 [term 1 LEADER]: Becoming Leader. State: Replica: 52770f65168a4e6a9c2fbf4335348a18, State: Running, Role: LEADER
I20260709 12:13:41.341775 30645 consensus_queue.cc:237] T 00000000000000000000000000000000 P 52770f65168a4e6a9c2fbf4335348a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52770f65168a4e6a9c2fbf4335348a18" member_type: VOTER }
I20260709 12:13:41.342284 30642 sys_catalog.cc:565] T 00000000000000000000000000000000 P 52770f65168a4e6a9c2fbf4335348a18 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:13:41.349072 30647 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52770f65168a4e6a9c2fbf4335348a18 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 52770f65168a4e6a9c2fbf4335348a18. Latest consensus state: current_term: 1 leader_uuid: "52770f65168a4e6a9c2fbf4335348a18" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52770f65168a4e6a9c2fbf4335348a18" member_type: VOTER } }
I20260709 12:13:41.349236 30646 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52770f65168a4e6a9c2fbf4335348a18 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "52770f65168a4e6a9c2fbf4335348a18" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52770f65168a4e6a9c2fbf4335348a18" member_type: VOTER } }
I20260709 12:13:41.350128 30646 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52770f65168a4e6a9c2fbf4335348a18 [sys.catalog]: This master's current role is: LEADER
I20260709 12:13:41.349988 30647 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52770f65168a4e6a9c2fbf4335348a18 [sys.catalog]: This master's current role is: LEADER
I20260709 12:13:41.352371 30655 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:13:41.357259 30655 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:13:41.359043 21266 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:13:41.366009 30655 catalog_manager.cc:1383] Generated new cluster ID: 6b8ab0ce1123444caf0d41af05aa07bc
I20260709 12:13:41.366312 30655 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:13:41.393067 30655 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:13:41.394343 30655 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:13:41.408922 30655 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 52770f65168a4e6a9c2fbf4335348a18: Generated new TSK 0
I20260709 12:13:41.409564 30655 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:13:41.425562 21266 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:41.431980 30663 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:41.433065 30664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:41.435374 30666 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:41.435954 21266 server_base.cc:1061] running on GCE node
I20260709 12:13:41.438201 21266 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:41.438396 21266 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:41.438611 21266 hybrid_clock.cc:648] HybridClock initialized: now 1783599221438574 us; error 0 us; skew 500 ppm
I20260709 12:13:41.439256 21266 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:41.441594 21266 webserver.cc:533] Webserver started at http://127.20.196.129:42585/ using document root <none> and password file <none>
I20260709 12:13:41.442107 21266 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:41.442309 21266 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:41.442602 21266 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:41.443912 21266 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894355727-21266-0/minicluster-data/ts-0-root/instance:
uuid: "6c5665c17e904fc692bce76fc57b2460"
format_stamp: "Formatted at 2026-07-09 12:13:41 on dist-test-slave-h6sg"
I20260709 12:13:41.448846 21266 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:13:41.452386 30671 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:41.453233 21266 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:13:41.453724 21266 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894355727-21266-0/minicluster-data/ts-0-root
uuid: "6c5665c17e904fc692bce76fc57b2460"
format_stamp: "Formatted at 2026-07-09 12:13:41 on dist-test-slave-h6sg"
I20260709 12:13:41.454023 21266 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894355727-21266-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894355727-21266-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894355727-21266-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:41.467541 21266 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:41.468824 21266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:41.470456 21266 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:41.472942 21266 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:41.473179 21266 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:41.473428 21266 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:41.473611 21266 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:41.519966 21266 rpc_server.cc:307] RPC server started. Bound to: 127.20.196.129:40909
I20260709 12:13:41.520072 30733 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.196.129:40909 every 8 connection(s)
I20260709 12:13:41.525795 21266 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:41.534304 30738 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:41.534687 30739 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:41.537925 30741 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:41.538676 21266 server_base.cc:1061] running on GCE node
I20260709 12:13:41.541126 21266 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:41.541384 21266 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:41.541567 21266 hybrid_clock.cc:648] HybridClock initialized: now 1783599221541545 us; error 0 us; skew 500 ppm
I20260709 12:13:41.542328 21266 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:41.545764 30734 heartbeater.cc:344] Connected to a master server at 127.20.196.190:44745
I20260709 12:13:41.545926 21266 webserver.cc:533] Webserver started at http://127.20.196.130:41993/ using document root <none> and password file <none>
I20260709 12:13:41.546168 30734 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:41.546579 21266 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:41.546851 21266 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:41.547153 21266 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:41.547189 30734 heartbeater.cc:507] Master 127.20.196.190:44745 requested a full tablet report, sending...
I20260709 12:13:41.548743 21266 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894355727-21266-0/minicluster-data/ts-1-root/instance:
uuid: "84b98f9236604dd0b22ae23c5378a676"
format_stamp: "Formatted at 2026-07-09 12:13:41 on dist-test-slave-h6sg"
I20260709 12:13:41.549595 30607 ts_manager.cc:194] Registered new tserver with Master: 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:41.551770 30607 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57902
I20260709 12:13:41.553876 21266 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:13:41.557955 30746 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:41.558749 21266 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:13:41.559159 21266 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894355727-21266-0/minicluster-data/ts-1-root
uuid: "84b98f9236604dd0b22ae23c5378a676"
format_stamp: "Formatted at 2026-07-09 12:13:41 on dist-test-slave-h6sg"
I20260709 12:13:41.559412 21266 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894355727-21266-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894355727-21266-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894355727-21266-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:41.574579 21266 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:41.575922 21266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:41.577452 21266 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:41.579785 21266 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:41.580019 21266 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:41.580263 21266 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:41.580437 21266 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:41.623574 21266 rpc_server.cc:307] RPC server started. Bound to: 127.20.196.130:40083
I20260709 12:13:41.623678 30808 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.196.130:40083 every 8 connection(s)
I20260709 12:13:41.628741 21266 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:41.636930 30812 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:41.639881 30813 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:41.640434 30815 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:41.640880 21266 server_base.cc:1061] running on GCE node
I20260709 12:13:41.642338 21266 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:41.642570 21266 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:41.642786 21266 hybrid_clock.cc:648] HybridClock initialized: now 1783599221642767 us; error 0 us; skew 500 ppm
I20260709 12:13:41.643023 30809 heartbeater.cc:344] Connected to a master server at 127.20.196.190:44745
I20260709 12:13:41.643502 30809 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:41.643568 21266 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:41.644526 30809 heartbeater.cc:507] Master 127.20.196.190:44745 requested a full tablet report, sending...
I20260709 12:13:41.646181 21266 webserver.cc:533] Webserver started at http://127.20.196.131:41983/ using document root <none> and password file <none>
I20260709 12:13:41.646762 21266 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:41.646763 30607 ts_manager.cc:194] Registered new tserver with Master: 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:41.647100 21266 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:41.647500 21266 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:41.648445 30607 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57912
I20260709 12:13:41.648779 21266 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894355727-21266-0/minicluster-data/ts-2-root/instance:
uuid: "8130e18710c04a61a5d8bd019c6ffdad"
format_stamp: "Formatted at 2026-07-09 12:13:41 on dist-test-slave-h6sg"
I20260709 12:13:41.653653 21266 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:13:41.657392 30820 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:41.658233 21266 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:13:41.658546 21266 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894355727-21266-0/minicluster-data/ts-2-root
uuid: "8130e18710c04a61a5d8bd019c6ffdad"
format_stamp: "Formatted at 2026-07-09 12:13:41 on dist-test-slave-h6sg"
I20260709 12:13:41.658851 21266 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894355727-21266-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894355727-21266-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894355727-21266-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:41.703223 21266 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:41.704540 21266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:41.706099 21266 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:41.708400 21266 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:41.708633 21266 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:41.708879 21266 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:41.709054 21266 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:41.756848 21266 rpc_server.cc:307] RPC server started. Bound to: 127.20.196.131:42179
I20260709 12:13:41.756975 30882 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.196.131:42179 every 8 connection(s)
I20260709 12:13:41.762087 21266 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:41.772565 30886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:41.772710 30887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:41.775637 30889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:41.775873 21266 server_base.cc:1061] running on GCE node
I20260709 12:13:41.776371 30883 heartbeater.cc:344] Connected to a master server at 127.20.196.190:44745
I20260709 12:13:41.776791 30883 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:41.777004 21266 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:41.777276 21266 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:41.777462 21266 hybrid_clock.cc:648] HybridClock initialized: now 1783599221777449 us; error 0 us; skew 500 ppm
I20260709 12:13:41.777709 30883 heartbeater.cc:507] Master 127.20.196.190:44745 requested a full tablet report, sending...
I20260709 12:13:41.778160 21266 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:41.780160 30607 ts_manager.cc:194] Registered new tserver with Master: 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:41.781244 21266 webserver.cc:533] Webserver started at http://127.20.196.132:34191/ using document root <none> and password file <none>
I20260709 12:13:41.781919 21266 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:41.782168 21266 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:41.782126 30607 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57916
I20260709 12:13:41.782742 21266 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:41.784236 21266 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894355727-21266-0/minicluster-data/ts-3-root/instance:
uuid: "15ad0880a63541ef965cb6acca4513d7"
format_stamp: "Formatted at 2026-07-09 12:13:41 on dist-test-slave-h6sg"
I20260709 12:13:41.788846 21266 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:13:41.792419 30894 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:41.793295 21266 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 12:13:41.793608 21266 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894355727-21266-0/minicluster-data/ts-3-root
uuid: "15ad0880a63541ef965cb6acca4513d7"
format_stamp: "Formatted at 2026-07-09 12:13:41 on dist-test-slave-h6sg"
I20260709 12:13:41.793910 21266 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894355727-21266-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894355727-21266-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894355727-21266-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:41.807718 21266 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:41.808997 21266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:41.810581 21266 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:41.812950 21266 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:41.813131 21266 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:41.813422 21266 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:41.813598 21266 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:41.862646 21266 rpc_server.cc:307] RPC server started. Bound to: 127.20.196.132:43035
I20260709 12:13:41.862843 30956 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.196.132:43035 every 8 connection(s)
I20260709 12:13:41.877616 30957 heartbeater.cc:344] Connected to a master server at 127.20.196.190:44745
I20260709 12:13:41.878095 30957 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:41.878926 30957 heartbeater.cc:507] Master 127.20.196.190:44745 requested a full tablet report, sending...
I20260709 12:13:41.880856 30607 ts_manager.cc:194] Registered new tserver with Master: 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:41.881742 21266 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.015695254s
I20260709 12:13:41.882225 30607 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57920
I20260709 12:13:41.910890 30607 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57930:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:13:42.178428 30922 tablet_service.cc:1511] Processing CreateTablet for tablet 76d4dde0196948ef92f68df770af02b0 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:13:42.178812 30921 tablet_service.cc:1511] Processing CreateTablet for tablet a6a5bd717fa048aabdd0879bcea0fd60 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:13:42.180068 30922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76d4dde0196948ef92f68df770af02b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.178812 30920 tablet_service.cc:1511] Processing CreateTablet for tablet da25c47d7366434089b73f8af7ce453b (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:13:42.181619 30920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da25c47d7366434089b73f8af7ce453b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.177418 30919 tablet_service.cc:1511] Processing CreateTablet for tablet 2ff9e0d905854cceb79f96f500a07339 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:13:42.183887 30919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ff9e0d905854cceb79f96f500a07339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.185423 30918 tablet_service.cc:1511] Processing CreateTablet for tablet fd65967534164e9c805fc3d5d05e0369 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:13:42.186951 30918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd65967534164e9c805fc3d5d05e0369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.191887 30917 tablet_service.cc:1511] Processing CreateTablet for tablet d5a270750666414887b6fae2f3793dc5 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:13:42.193459 30917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5a270750666414887b6fae2f3793dc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.196017 30699 tablet_service.cc:1511] Processing CreateTablet for tablet 76d4dde0196948ef92f68df770af02b0 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:13:42.197588 30699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76d4dde0196948ef92f68df770af02b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.198668 30916 tablet_service.cc:1511] Processing CreateTablet for tablet 5324c1d1d0cd4e6e96c28c96ebcbb03f (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:13:42.200487 30916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5324c1d1d0cd4e6e96c28c96ebcbb03f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.200274 30698 tablet_service.cc:1511] Processing CreateTablet for tablet eb58d3a8bd8540ff9871ea41021a5025 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:13:42.201678 30698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb58d3a8bd8540ff9871ea41021a5025. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.204289 30697 tablet_service.cc:1511] Processing CreateTablet for tablet a6a5bd717fa048aabdd0879bcea0fd60 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:13:42.204913 30915 tablet_service.cc:1511] Processing CreateTablet for tablet 8b66a7b6f8aa4803b482e392cc945db7 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:13:42.206326 30915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b66a7b6f8aa4803b482e392cc945db7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.206718 30696 tablet_service.cc:1511] Processing CreateTablet for tablet f0fbdcbe46b34107bbbf63f69c98e244 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:13:42.209088 30695 tablet_service.cc:1511] Processing CreateTablet for tablet 2ff9e0d905854cceb79f96f500a07339 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:13:42.211162 30914 tablet_service.cc:1511] Processing CreateTablet for tablet b047acdc74424afc81c6380239209821 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:13:42.211477 30694 tablet_service.cc:1511] Processing CreateTablet for tablet fd65967534164e9c805fc3d5d05e0369 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:13:42.212654 30914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b047acdc74424afc81c6380239209821. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.213876 30693 tablet_service.cc:1511] Processing CreateTablet for tablet 615eb2fb16414287bc0956a27523b7f4 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:13:42.216004 30921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6a5bd717fa048aabdd0879bcea0fd60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.220450 30913 tablet_service.cc:1511] Processing CreateTablet for tablet a318673515aa415db1aa91d126a5b724 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:13:42.222047 30913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a318673515aa415db1aa91d126a5b724. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.224540 30692 tablet_service.cc:1511] Processing CreateTablet for tablet 5324c1d1d0cd4e6e96c28c96ebcbb03f (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:13:42.227684 30691 tablet_service.cc:1511] Processing CreateTablet for tablet 8b66a7b6f8aa4803b482e392cc945db7 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:13:42.229274 30691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b66a7b6f8aa4803b482e392cc945db7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.232592 30690 tablet_service.cc:1511] Processing CreateTablet for tablet a0bb1498511242ef95085be49c10c4d3 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:13:42.235270 30694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd65967534164e9c805fc3d5d05e0369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.237149 30696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0fbdcbe46b34107bbbf63f69c98e244. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.239877 30692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5324c1d1d0cd4e6e96c28c96ebcbb03f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.243436 30695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ff9e0d905854cceb79f96f500a07339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.247438 30697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6a5bd717fa048aabdd0879bcea0fd60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.251467 30693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 615eb2fb16414287bc0956a27523b7f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.263386 30690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0bb1498511242ef95085be49c10c4d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.341225 30848 tablet_service.cc:1511] Processing CreateTablet for tablet eb58d3a8bd8540ff9871ea41021a5025 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:13:42.342756 30848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb58d3a8bd8540ff9871ea41021a5025. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.344267 30847 tablet_service.cc:1511] Processing CreateTablet for tablet a6a5bd717fa048aabdd0879bcea0fd60 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:13:42.346755 30846 tablet_service.cc:1511] Processing CreateTablet for tablet da25c47d7366434089b73f8af7ce453b (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:13:42.349182 30845 tablet_service.cc:1511] Processing CreateTablet for tablet f0fbdcbe46b34107bbbf63f69c98e244 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:13:42.351353 30774 tablet_service.cc:1511] Processing CreateTablet for tablet 76d4dde0196948ef92f68df770af02b0 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:13:42.351588 30844 tablet_service.cc:1511] Processing CreateTablet for tablet fd65967534164e9c805fc3d5d05e0369 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:13:42.352857 30774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76d4dde0196948ef92f68df770af02b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.353856 30843 tablet_service.cc:1511] Processing CreateTablet for tablet d5a270750666414887b6fae2f3793dc5 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
W20260709 12:13:42.354573 30654 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:42.354761 30771 tablet_service.cc:1511] Processing CreateTablet for tablet f0fbdcbe46b34107bbbf63f69c98e244 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:13:42.352864 30772 tablet_service.cc:1511] Processing CreateTablet for tablet da25c47d7366434089b73f8af7ce453b (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:13:42.356290 30771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0fbdcbe46b34107bbbf63f69c98e244. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.356215 30842 tablet_service.cc:1511] Processing CreateTablet for tablet 615eb2fb16414287bc0956a27523b7f4 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:13:42.358729 30841 tablet_service.cc:1511] Processing CreateTablet for tablet 8b66a7b6f8aa4803b482e392cc945db7 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:13:42.361636 30772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da25c47d7366434089b73f8af7ce453b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.361407 30840 tablet_service.cc:1511] Processing CreateTablet for tablet b047acdc74424afc81c6380239209821 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:13:42.363832 30839 tablet_service.cc:1511] Processing CreateTablet for tablet a0bb1498511242ef95085be49c10c4d3 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:13:42.366878 30839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0bb1498511242ef95085be49c10c4d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.371354 30845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0fbdcbe46b34107bbbf63f69c98e244. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.371986 30844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd65967534164e9c805fc3d5d05e0369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.374599 30842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 615eb2fb16414287bc0956a27523b7f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.375293 30846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da25c47d7366434089b73f8af7ce453b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.375943 30841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b66a7b6f8aa4803b482e392cc945db7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.376549 30847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6a5bd717fa048aabdd0879bcea0fd60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.354820 30773 tablet_service.cc:1511] Processing CreateTablet for tablet eb58d3a8bd8540ff9871ea41021a5025 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:13:42.379618 30773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb58d3a8bd8540ff9871ea41021a5025. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.385226 30770 tablet_service.cc:1511] Processing CreateTablet for tablet 2ff9e0d905854cceb79f96f500a07339 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:13:42.388302 30769 tablet_service.cc:1511] Processing CreateTablet for tablet d5a270750666414887b6fae2f3793dc5 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:13:42.390784 30768 tablet_service.cc:1511] Processing CreateTablet for tablet 615eb2fb16414287bc0956a27523b7f4 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:13:42.393321 30767 tablet_service.cc:1511] Processing CreateTablet for tablet 5324c1d1d0cd4e6e96c28c96ebcbb03f (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:13:42.396725 30765 tablet_service.cc:1511] Processing CreateTablet for tablet a0bb1498511242ef95085be49c10c4d3 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:13:42.386816 30770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ff9e0d905854cceb79f96f500a07339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.407717 30843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5a270750666414887b6fae2f3793dc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.416034 30766 tablet_service.cc:1511] Processing CreateTablet for tablet b047acdc74424afc81c6380239209821 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:13:42.431284 30769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5a270750666414887b6fae2f3793dc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.385555 30913 tablet_service.cc:1511] Processing CreateTablet for tablet 21c0ba9bb1d64ab398c606450f72e966 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:13:42.436558 30768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 615eb2fb16414287bc0956a27523b7f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.437286 30765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0bb1498511242ef95085be49c10c4d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.437392 30913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21c0ba9bb1d64ab398c606450f72e966. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.438011 30766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b047acdc74424afc81c6380239209821. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.437289 30978 tablet_bootstrap.cc:492] T eb58d3a8bd8540ff9871ea41021a5025 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:42.440413 30767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5324c1d1d0cd4e6e96c28c96ebcbb03f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.451292 30920 tablet_service.cc:1511] Processing CreateTablet for tablet 5b500ac0d6a6419b8bc041e830d2dcf7 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:13:42.457257 30913 tablet_service.cc:1511] Processing CreateTablet for tablet 0b3eb62be46741aa9c0364ddea2ca5c9 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:13:42.459298 30914 tablet_service.cc:1511] Processing CreateTablet for tablet ac15e10cad8e4cbc9763eacc349d9549 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:13:42.462069 30915 tablet_service.cc:1511] Processing CreateTablet for tablet b9cc9d529de24234b98ed5e152fd4b24 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:13:42.462566 30978 tablet_bootstrap.cc:654] T eb58d3a8bd8540ff9871ea41021a5025 P 6c5665c17e904fc692bce76fc57b2460: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:42.471869 30918 tablet_service.cc:1511] Processing CreateTablet for tablet 671d30cec67d47a89e8ec6fab0c53c48 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:13:42.473513 30697 tablet_service.cc:1511] Processing CreateTablet for tablet a318673515aa415db1aa91d126a5b724 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:13:42.474900 30697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a318673515aa415db1aa91d126a5b724. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.459312 30913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b3eb62be46741aa9c0364ddea2ca5c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.475512 30916 tablet_service.cc:1511] Processing CreateTablet for tablet 491ae2039a6347a896b3a5aeacaa71b2 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:13:42.476151 30691 tablet_service.cc:1511] Processing CreateTablet for tablet 21c0ba9bb1d64ab398c606450f72e966 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:13:42.481839 30693 tablet_service.cc:1511] Processing CreateTablet for tablet 2bd90e4c16c54e13ae2b1c1e08d6238c (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:13:42.511201 30773 tablet_service.cc:1511] Processing CreateTablet for tablet a318673515aa415db1aa91d126a5b724 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:13:42.512764 30773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a318673515aa415db1aa91d126a5b724. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.515829 30691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21c0ba9bb1d64ab398c606450f72e966. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.523475 30693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bd90e4c16c54e13ae2b1c1e08d6238c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.529495 30770 tablet_service.cc:1511] Processing CreateTablet for tablet 5b500ac0d6a6419b8bc041e830d2dcf7 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:13:42.531010 30770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b500ac0d6a6419b8bc041e830d2dcf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.484879 30922 tablet_service.cc:1511] Processing CreateTablet for tablet 5d636204e40644318b4758f37c7b0474 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:13:42.539985 30922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d636204e40644318b4758f37c7b0474. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.498595 30919 tablet_service.cc:1511] Processing CreateTablet for tablet 99164e2d6f664ceab4d5921867d62c31 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:13:42.540391 30839 tablet_service.cc:1511] Processing CreateTablet for tablet 21c0ba9bb1d64ab398c606450f72e966 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:13:42.487614 30698 tablet_service.cc:1511] Processing CreateTablet for tablet 0b3eb62be46741aa9c0364ddea2ca5c9 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:13:42.545152 30698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b3eb62be46741aa9c0364ddea2ca5c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.544920 30917 tablet_service.cc:1511] Processing CreateTablet for tablet b6f09adc18e2485cbafdb86cfe535721 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:13:42.548882 30847 tablet_service.cc:1511] Processing CreateTablet for tablet 5b500ac0d6a6419b8bc041e830d2dcf7 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:13:42.505789 30981 tablet_bootstrap.cc:492] T eb58d3a8bd8540ff9871ea41021a5025 P 84b98f9236604dd0b22ae23c5378a676: Bootstrap starting.
I20260709 12:13:42.532969 30699 tablet_service.cc:1511] Processing CreateTablet for tablet b9cc9d529de24234b98ed5e152fd4b24 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:13:42.535130 30690 tablet_service.cc:1511] Processing CreateTablet for tablet 8c580512b11742d4977ff026ff8fc795 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:13:42.493363 30696 tablet_service.cc:1511] Processing CreateTablet for tablet 0203e5cc33ca470eb9c1f366291c344d (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:13:42.548887 30773 tablet_service.cc:1511] Processing CreateTablet for tablet 671d30cec67d47a89e8ec6fab0c53c48 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:13:42.555142 30734 heartbeater.cc:499] Master 127.20.196.190:44745 was elected leader, sending a full tablet report...
I20260709 12:13:42.584218 30980 tablet_bootstrap.cc:492] T 615eb2fb16414287bc0956a27523b7f4 P 8130e18710c04a61a5d8bd019c6ffdad: Bootstrap starting.
I20260709 12:13:42.546846 30917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6f09adc18e2485cbafdb86cfe535721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.587385 30919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99164e2d6f664ceab4d5921867d62c31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.588034 30914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac15e10cad8e4cbc9763eacc349d9549. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.591887 30694 tablet_service.cc:1511] Processing CreateTablet for tablet 671d30cec67d47a89e8ec6fab0c53c48 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:13:42.593027 30916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 491ae2039a6347a896b3a5aeacaa71b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.571904 30977 tablet_bootstrap.cc:492] T 76d4dde0196948ef92f68df770af02b0 P 15ad0880a63541ef965cb6acca4513d7: Bootstrap starting.
I20260709 12:13:42.483851 30840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b047acdc74424afc81c6380239209821. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.575645 30843 tablet_service.cc:1511] Processing CreateTablet for tablet 0203e5cc33ca470eb9c1f366291c344d (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:13:42.561311 30771 tablet_service.cc:1511] Processing CreateTablet for tablet 0203e5cc33ca470eb9c1f366291c344d (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:13:42.603223 30839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21c0ba9bb1d64ab398c606450f72e966. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.611354 30915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9cc9d529de24234b98ed5e152fd4b24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.612934 30920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b500ac0d6a6419b8bc041e830d2dcf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.613569 30845 tablet_service.cc:1511] Processing CreateTablet for tablet 0b3eb62be46741aa9c0364ddea2ca5c9 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:13:42.616029 30918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 671d30cec67d47a89e8ec6fab0c53c48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.619980 30773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 671d30cec67d47a89e8ec6fab0c53c48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.620651 30768 tablet_service.cc:1511] Processing CreateTablet for tablet 2bd90e4c16c54e13ae2b1c1e08d6238c (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:13:42.621954 30768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bd90e4c16c54e13ae2b1c1e08d6238c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.622464 30981 tablet_bootstrap.cc:654] T eb58d3a8bd8540ff9871ea41021a5025 P 84b98f9236604dd0b22ae23c5378a676: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:42.623168 30921 tablet_service.cc:1511] Processing CreateTablet for tablet 8c580512b11742d4977ff026ff8fc795 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:13:42.627806 30695 tablet_service.cc:1511] Processing CreateTablet for tablet cdf560ffbc0c4b8b80beb6494a13d9cd (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:13:42.629035 30696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0203e5cc33ca470eb9c1f366291c344d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.632534 30845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b3eb62be46741aa9c0364ddea2ca5c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.570809 30766 tablet_service.cc:1511] Processing CreateTablet for tablet ac15e10cad8e4cbc9763eacc349d9549 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:13:42.640111 30699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9cc9d529de24234b98ed5e152fd4b24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.642275 30771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0203e5cc33ca470eb9c1f366291c344d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.646643 30978 tablet_bootstrap.cc:492] T eb58d3a8bd8540ff9871ea41021a5025 P 6c5665c17e904fc692bce76fc57b2460: No bootstrap required, opened a new log
I20260709 12:13:42.647307 30978 ts_tablet_manager.cc:1403] T eb58d3a8bd8540ff9871ea41021a5025 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.210s	user 0.045s	sys 0.051s
I20260709 12:13:42.648818 30692 tablet_service.cc:1511] Processing CreateTablet for tablet 5d636204e40644318b4758f37c7b0474 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:13:42.647320 30766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac15e10cad8e4cbc9763eacc349d9549. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.651269 30809 heartbeater.cc:499] Master 127.20.196.190:44745 was elected leader, sending a full tablet report...
I20260709 12:13:42.659323 30690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c580512b11742d4977ff026ff8fc795. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.671514 30921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c580512b11742d4977ff026ff8fc795. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.618722 30844 tablet_service.cc:1511] Processing CreateTablet for tablet ac15e10cad8e4cbc9763eacc349d9549 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:13:42.671535 30977 tablet_bootstrap.cc:654] T 76d4dde0196948ef92f68df770af02b0 P 15ad0880a63541ef965cb6acca4513d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:42.686524 30694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 671d30cec67d47a89e8ec6fab0c53c48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.691200 30843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0203e5cc33ca470eb9c1f366291c344d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.694469 30919 tablet_service.cc:1511] Processing CreateTablet for tablet c5afc0720ca546d8b13026e7c7a30c1e (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:13:42.696082 30919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5afc0720ca546d8b13026e7c7a30c1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.701558 30767 tablet_service.cc:1511] Processing CreateTablet for tablet cdf560ffbc0c4b8b80beb6494a13d9cd (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:13:42.705318 30765 tablet_service.cc:1511] Processing CreateTablet for tablet 491ae2039a6347a896b3a5aeacaa71b2 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:13:42.705530 30846 tablet_service.cc:1511] Processing CreateTablet for tablet cdf560ffbc0c4b8b80beb6494a13d9cd (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:13:42.711515 30692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d636204e40644318b4758f37c7b0474. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.711953 30769 tablet_service.cc:1511] Processing CreateTablet for tablet b9cc9d529de24234b98ed5e152fd4b24 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:13:42.712443 30841 tablet_service.cc:1511] Processing CreateTablet for tablet 491ae2039a6347a896b3a5aeacaa71b2 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:13:42.713559 30848 tablet_service.cc:1511] Processing CreateTablet for tablet 8c580512b11742d4977ff026ff8fc795 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:13:42.714699 30842 tablet_service.cc:1511] Processing CreateTablet for tablet 2bd90e4c16c54e13ae2b1c1e08d6238c (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:13:42.717522 30922 tablet_service.cc:1511] Processing CreateTablet for tablet dcddf9f7713c4d04abedc36356c1888f (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:13:42.718851 30922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcddf9f7713c4d04abedc36356c1888f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.720115 30978 raft_consensus.cc:359] T eb58d3a8bd8540ff9871ea41021a5025 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:42.722087 30980 tablet_bootstrap.cc:654] T 615eb2fb16414287bc0956a27523b7f4 P 8130e18710c04a61a5d8bd019c6ffdad: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:42.706841 30846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdf560ffbc0c4b8b80beb6494a13d9cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.735659 30695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdf560ffbc0c4b8b80beb6494a13d9cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.734660 30767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdf560ffbc0c4b8b80beb6494a13d9cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.733881 30978 raft_consensus.cc:385] T eb58d3a8bd8540ff9871ea41021a5025 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:42.763532 30848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c580512b11742d4977ff026ff8fc795. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:13:42.760464 30593 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.20.196.132:43035, user_credentials={real_user=slave}} blocked reactor thread for 54439.3us
I20260709 12:13:42.767324 30847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b500ac0d6a6419b8bc041e830d2dcf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.767997 30841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 491ae2039a6347a896b3a5aeacaa71b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.755178 30978 raft_consensus.cc:740] T eb58d3a8bd8540ff9871ea41021a5025 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:42.771843 30978 consensus_queue.cc:260] T eb58d3a8bd8540ff9871ea41021a5025 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:42.778834 30981 tablet_bootstrap.cc:492] T eb58d3a8bd8540ff9871ea41021a5025 P 84b98f9236604dd0b22ae23c5378a676: No bootstrap required, opened a new log
I20260709 12:13:42.732196 30919 tablet_service.cc:1511] Processing CreateTablet for tablet baedd172e30a4ef4a6641302fdebd9c5 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:13:42.766445 30772 tablet_service.cc:1511] Processing CreateTablet for tablet c449839430794851b61ffba23f946c4f (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:13:42.785503 30883 heartbeater.cc:499] Master 127.20.196.190:44745 was elected leader, sending a full tablet report...
I20260709 12:13:42.788414 30691 tablet_service.cc:1511] Processing CreateTablet for tablet c449839430794851b61ffba23f946c4f (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:13:42.789749 30691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c449839430794851b61ffba23f946c4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.795804 30774 tablet_service.cc:1511] Processing CreateTablet for tablet 5d636204e40644318b4758f37c7b0474 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:13:42.797950 30765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 491ae2039a6347a896b3a5aeacaa71b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.798221 30844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac15e10cad8e4cbc9763eacc349d9549. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.798602 30839 tablet_service.cc:1511] Processing CreateTablet for tablet 99164e2d6f664ceab4d5921867d62c31 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:13:42.799896 30839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99164e2d6f664ceab4d5921867d62c31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.801195 30772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c449839430794851b61ffba23f946c4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.803387 30913 tablet_service.cc:1511] Processing CreateTablet for tablet 1eb80935abae44bf8dde4d54961c5fdb (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:13:42.781692 30981 ts_tablet_manager.cc:1403] T eb58d3a8bd8540ff9871ea41021a5025 P 84b98f9236604dd0b22ae23c5378a676: Time spent bootstrapping tablet: real 0.276s	user 0.012s	sys 0.024s
I20260709 12:13:42.816298 30840 tablet_service.cc:1511] Processing CreateTablet for tablet b6f09adc18e2485cbafdb86cfe535721 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:13:42.817826 30840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6f09adc18e2485cbafdb86cfe535721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.825126 30693 tablet_service.cc:1511] Processing CreateTablet for tablet c5afc0720ca546d8b13026e7c7a30c1e (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
W20260709 12:13:42.838574 30594 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.20.196.129:40909, user_credentials={real_user=slave}} blocked reactor thread for 51176.9us
I20260709 12:13:42.841784 30977 tablet_bootstrap.cc:492] T 76d4dde0196948ef92f68df770af02b0 P 15ad0880a63541ef965cb6acca4513d7: No bootstrap required, opened a new log
I20260709 12:13:42.842331 30977 ts_tablet_manager.cc:1403] T 76d4dde0196948ef92f68df770af02b0 P 15ad0880a63541ef965cb6acca4513d7: Time spent bootstrapping tablet: real 0.271s	user 0.016s	sys 0.013s
I20260709 12:13:42.832160 30769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9cc9d529de24234b98ed5e152fd4b24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.847692 30774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d636204e40644318b4758f37c7b0474. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.848565 30698 tablet_service.cc:1511] Processing CreateTablet for tablet 1eb80935abae44bf8dde4d54961c5fdb (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:13:42.849928 30698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1eb80935abae44bf8dde4d54961c5fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.857353 30913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1eb80935abae44bf8dde4d54961c5fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.865069 30921 tablet_service.cc:1511] Processing CreateTablet for tablet bb358c4df82f4168bc1debdfc4e7aa9c (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:13:42.865218 30915 tablet_service.cc:1511] Processing CreateTablet for tablet 5323645d8e844a489d166a94c77c2af1 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:13:42.867161 30842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bd90e4c16c54e13ae2b1c1e08d6238c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.872129 30977 raft_consensus.cc:359] T 76d4dde0196948ef92f68df770af02b0 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:42.872915 30977 raft_consensus.cc:385] T 76d4dde0196948ef92f68df770af02b0 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:42.873227 30977 raft_consensus.cc:740] T 76d4dde0196948ef92f68df770af02b0 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Initialized, Role: FOLLOWER
I20260709 12:13:42.874109 30977 consensus_queue.cc:260] T 76d4dde0196948ef92f68df770af02b0 P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:42.875792 30697 tablet_service.cc:1511] Processing CreateTablet for tablet 99164e2d6f664ceab4d5921867d62c31 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:13:42.876513 30919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baedd172e30a4ef4a6641302fdebd9c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.879321 30915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5323645d8e844a489d166a94c77c2af1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.893276 30847 tablet_service.cc:1511] Processing CreateTablet for tablet 1eb80935abae44bf8dde4d54961c5fdb (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:13:42.893675 30957 heartbeater.cc:499] Master 127.20.196.190:44745 was elected leader, sending a full tablet report...
I20260709 12:13:42.894449 30921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb358c4df82f4168bc1debdfc4e7aa9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.893889 30770 tablet_service.cc:1511] Processing CreateTablet for tablet b6f09adc18e2485cbafdb86cfe535721 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:13:42.895551 30770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6f09adc18e2485cbafdb86cfe535721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.899958 30692 tablet_service.cc:1511] Processing CreateTablet for tablet baedd172e30a4ef4a6641302fdebd9c5 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:13:42.907296 30693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5afc0720ca546d8b13026e7c7a30c1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.924530 30847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1eb80935abae44bf8dde4d54961c5fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.911778 30981 raft_consensus.cc:359] T eb58d3a8bd8540ff9871ea41021a5025 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:42.913426 30978 ts_tablet_manager.cc:1434] T eb58d3a8bd8540ff9871ea41021a5025 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.266s	user 0.015s	sys 0.037s
I20260709 12:13:42.927178 30981 raft_consensus.cc:385] T eb58d3a8bd8540ff9871ea41021a5025 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:42.927523 30981 raft_consensus.cc:740] T eb58d3a8bd8540ff9871ea41021a5025 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Initialized, Role: FOLLOWER
I20260709 12:13:42.928176 30914 tablet_service.cc:1511] Processing CreateTablet for tablet c52d3c5b6b15499e9c834cf33954609a (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:13:42.928409 30981 consensus_queue.cc:260] T eb58d3a8bd8540ff9871ea41021a5025 P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:42.929509 30914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c52d3c5b6b15499e9c834cf33954609a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.858775 30843 tablet_service.cc:1511] Processing CreateTablet for tablet c449839430794851b61ffba23f946c4f (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:13:42.938092 30773 tablet_service.cc:1511] Processing CreateTablet for tablet c5afc0720ca546d8b13026e7c7a30c1e (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:13:42.941531 30843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c449839430794851b61ffba23f946c4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.944934 30699 tablet_service.cc:1511] Processing CreateTablet for tablet a3ffdffa995943d28fc038fce9198caf (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:13:42.946693 30916 tablet_service.cc:1511] Processing CreateTablet for tablet 2971ad17262c4b5e8665700af97ec254 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:13:42.948019 30916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2971ad17262c4b5e8665700af97ec254. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.955675 30697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99164e2d6f664ceab4d5921867d62c31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.960121 30980 tablet_bootstrap.cc:492] T 615eb2fb16414287bc0956a27523b7f4 P 8130e18710c04a61a5d8bd019c6ffdad: No bootstrap required, opened a new log
I20260709 12:13:42.960691 30980 ts_tablet_manager.cc:1403] T 615eb2fb16414287bc0956a27523b7f4 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent bootstrapping tablet: real 0.377s	user 0.016s	sys 0.011s
I20260709 12:13:42.963975 30980 raft_consensus.cc:359] T 615eb2fb16414287bc0956a27523b7f4 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:42.975536 30773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5afc0720ca546d8b13026e7c7a30c1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.956988 30845 tablet_service.cc:1511] Processing CreateTablet for tablet dcddf9f7713c4d04abedc36356c1888f (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:13:42.978641 30766 tablet_service.cc:1511] Processing CreateTablet for tablet dcddf9f7713c4d04abedc36356c1888f (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:13:43.003883 30845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcddf9f7713c4d04abedc36356c1888f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.007085 30980 raft_consensus.cc:385] T 615eb2fb16414287bc0956a27523b7f4 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.007481 30980 raft_consensus.cc:740] T 615eb2fb16414287bc0956a27523b7f4 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Initialized, Role: FOLLOWER
I20260709 12:13:43.008286 30981 ts_tablet_manager.cc:1434] T eb58d3a8bd8540ff9871ea41021a5025 P 84b98f9236604dd0b22ae23c5378a676: Time spent starting tablet: real 0.201s	user 0.011s	sys 0.007s
I20260709 12:13:42.987974 30772 tablet_service.cc:1511] Processing CreateTablet for tablet a3ffdffa995943d28fc038fce9198caf (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:13:42.993734 30769 tablet_service.cc:1511] Processing CreateTablet for tablet baedd172e30a4ef4a6641302fdebd9c5 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:13:42.995677 30977 ts_tablet_manager.cc:1434] T 76d4dde0196948ef92f68df770af02b0 P 15ad0880a63541ef965cb6acca4513d7: Time spent starting tablet: real 0.153s	user 0.011s	sys 0.005s
I20260709 12:13:43.014191 30977 tablet_bootstrap.cc:492] T da25c47d7366434089b73f8af7ce453b P 15ad0880a63541ef965cb6acca4513d7: Bootstrap starting.
I20260709 12:13:43.019580 30981 tablet_bootstrap.cc:492] T 2ff9e0d905854cceb79f96f500a07339 P 84b98f9236604dd0b22ae23c5378a676: Bootstrap starting.
I20260709 12:13:43.021826 30920 tablet_service.cc:1511] Processing CreateTablet for tablet 2137918dbdc34ac29180015bd93261de (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:13:43.025246 30690 tablet_service.cc:1511] Processing CreateTablet for tablet bb358c4df82f4168bc1debdfc4e7aa9c (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:13:43.026520 30690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb358c4df82f4168bc1debdfc4e7aa9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.028422 30694 tablet_service.cc:1511] Processing CreateTablet for tablet e57ee667f8a246eb98ab6b169eb779b9 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
W20260709 12:13:43.029155 30735 tablet.cc:2406] T eb58d3a8bd8540ff9871ea41021a5025 P 6c5665c17e904fc692bce76fc57b2460: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:13:43.029749 30694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e57ee667f8a246eb98ab6b169eb779b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.004097 30766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcddf9f7713c4d04abedc36356c1888f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.032343 30695 tablet_service.cc:1511] Processing CreateTablet for tablet c52d3c5b6b15499e9c834cf33954609a (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:13:43.033612 30695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c52d3c5b6b15499e9c834cf33954609a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.034317 30691 tablet_service.cc:1511] Processing CreateTablet for tablet 2971ad17262c4b5e8665700af97ec254 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:13:43.036413 30692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baedd172e30a4ef4a6641302fdebd9c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.036365 30696 tablet_service.cc:1511] Processing CreateTablet for tablet 0317908edb88497b82c4e59ef1bac414 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:13:43.037755 30696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0317908edb88497b82c4e59ef1bac414. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.038694 30771 tablet_service.cc:1511] Processing CreateTablet for tablet 5323645d8e844a489d166a94c77c2af1 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:13:43.039234 30978 tablet_bootstrap.cc:492] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:43.040061 30771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5323645d8e844a489d166a94c77c2af1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.040598 30774 tablet_service.cc:1511] Processing CreateTablet for tablet e57ee667f8a246eb98ab6b169eb779b9 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:13:43.041806 30774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e57ee667f8a246eb98ab6b169eb779b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.043752 30699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3ffdffa995943d28fc038fce9198caf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.008333 30980 consensus_queue.cc:260] T 615eb2fb16414287bc0956a27523b7f4 P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:43.048379 30987 raft_consensus.cc:493] T eb58d3a8bd8540ff9871ea41021a5025 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.048882 30987 raft_consensus.cc:515] T eb58d3a8bd8540ff9871ea41021a5025 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:43.051957 30765 tablet_service.cc:1511] Processing CreateTablet for tablet c52d3c5b6b15499e9c834cf33954609a (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:13:43.067734 30847 tablet_service.cc:1511] Processing CreateTablet for tablet e57ee667f8a246eb98ab6b169eb779b9 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:13:43.054589 30848 tablet_service.cc:1511] Processing CreateTablet for tablet 5323645d8e844a489d166a94c77c2af1 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:13:43.055971 30691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2971ad17262c4b5e8665700af97ec254. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.062358 30919 tablet_service.cc:1511] Processing CreateTablet for tablet f351526ad9564be4be05825c266794c7 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:13:43.063158 30920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2137918dbdc34ac29180015bd93261de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.063697 30772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3ffdffa995943d28fc038fce9198caf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.064095 30767 tablet_service.cc:1511] Processing CreateTablet for tablet 2137918dbdc34ac29180015bd93261de (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:13:43.064837 30693 tablet_service.cc:1511] Processing CreateTablet for tablet f351526ad9564be4be05825c266794c7 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:13:43.068727 30981 tablet_bootstrap.cc:654] T 2ff9e0d905854cceb79f96f500a07339 P 84b98f9236604dd0b22ae23c5378a676: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.053925 30978 tablet_bootstrap.cc:654] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.083156 30977 tablet_bootstrap.cc:654] T da25c47d7366434089b73f8af7ce453b P 15ad0880a63541ef965cb6acca4513d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.100458 30842 tablet_service.cc:1511] Processing CreateTablet for tablet 2971ad17262c4b5e8665700af97ec254 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:13:43.105013 30842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2971ad17262c4b5e8665700af97ec254. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.990769 30839 tablet_service.cc:1511] Processing CreateTablet for tablet a3ffdffa995943d28fc038fce9198caf (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:13:43.079440 30987 leader_election.cc:290] T eb58d3a8bd8540ff9871ea41021a5025 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:43.136336 30765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c52d3c5b6b15499e9c834cf33954609a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.146498 30989 raft_consensus.cc:493] T 615eb2fb16414287bc0956a27523b7f4 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.150168 30840 tablet_service.cc:1511] Processing CreateTablet for tablet bb358c4df82f4168bc1debdfc4e7aa9c (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:13:43.150525 30841 tablet_service.cc:1511] Processing CreateTablet for tablet 2137918dbdc34ac29180015bd93261de (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:13:43.141819 30847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e57ee667f8a246eb98ab6b169eb779b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.143633 30919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f351526ad9564be4be05825c266794c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.144963 30693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f351526ad9564be4be05825c266794c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.180389 30913 tablet_service.cc:1511] Processing CreateTablet for tablet 7b23395f850d4699b8d289f501c96f60 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:13:43.181915 30913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b23395f850d4699b8d289f501c96f60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.194283 30848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5323645d8e844a489d166a94c77c2af1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.196547 30839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3ffdffa995943d28fc038fce9198caf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.204164 30770 tablet_service.cc:1511] Processing CreateTablet for tablet 0317908edb88497b82c4e59ef1bac414 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:13:43.204957 30697 tablet_service.cc:1511] Processing CreateTablet for tablet 7b23395f850d4699b8d289f501c96f60 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:13:43.167070 30989 raft_consensus.cc:515] T 615eb2fb16414287bc0956a27523b7f4 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:43.206292 30697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b23395f850d4699b8d289f501c96f60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.204957 30843 tablet_service.cc:1511] Processing CreateTablet for tablet 0317908edb88497b82c4e59ef1bac414 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:13:43.207952 30989 leader_election.cc:290] T 615eb2fb16414287bc0956a27523b7f4 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:43.209578 30843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0317908edb88497b82c4e59ef1bac414. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.227223 30984 raft_consensus.cc:493] T eb58d3a8bd8540ff9871ea41021a5025 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.227558 30840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb358c4df82f4168bc1debdfc4e7aa9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.227846 30984 raft_consensus.cc:515] T eb58d3a8bd8540ff9871ea41021a5025 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:43.211720 30980 ts_tablet_manager.cc:1434] T 615eb2fb16414287bc0956a27523b7f4 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent starting tablet: real 0.251s	user 0.010s	sys 0.023s
I20260709 12:13:43.223222 30769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baedd172e30a4ef4a6641302fdebd9c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.237200 30916 tablet_service.cc:1511] Processing CreateTablet for tablet 1bbb677d9c544ed5a31297773b1508d6 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:13:43.238500 30916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bbb677d9c544ed5a31297773b1508d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.247838 30980 tablet_bootstrap.cc:492] T a0bb1498511242ef95085be49c10c4d3 P 8130e18710c04a61a5d8bd019c6ffdad: Bootstrap starting.
I20260709 12:13:43.230897 30984 leader_election.cc:290] T eb58d3a8bd8540ff9871ea41021a5025 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:43.259197 30841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2137918dbdc34ac29180015bd93261de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.259523 30696 tablet_service.cc:1511] Processing CreateTablet for tablet 745e2cea61c44c3a80bdc49add504a75 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:13:43.275652 30696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 745e2cea61c44c3a80bdc49add504a75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.284358 30844 tablet_service.cc:1511] Processing CreateTablet for tablet 7b23395f850d4699b8d289f501c96f60 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:13:43.292321 30768 tablet_service.cc:1511] Processing CreateTablet for tablet f351526ad9564be4be05825c266794c7 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:13:43.294189 30986 raft_consensus.cc:493] T 76d4dde0196948ef92f68df770af02b0 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.294881 30986 raft_consensus.cc:515] T 76d4dde0196948ef92f68df770af02b0 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:43.297410 30981 tablet_bootstrap.cc:492] T 2ff9e0d905854cceb79f96f500a07339 P 84b98f9236604dd0b22ae23c5378a676: No bootstrap required, opened a new log
I20260709 12:13:43.297930 30981 ts_tablet_manager.cc:1403] T 2ff9e0d905854cceb79f96f500a07339 P 84b98f9236604dd0b22ae23c5378a676: Time spent bootstrapping tablet: real 0.279s	user 0.014s	sys 0.008s
I20260709 12:13:43.298615 30986 leader_election.cc:290] T 76d4dde0196948ef92f68df770af02b0 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:43.299621 30767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2137918dbdc34ac29180015bd93261de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.335140 30768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f351526ad9564be4be05825c266794c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.340260 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb58d3a8bd8540ff9871ea41021a5025" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
W20260709 12:13:43.343722 30748 leader_election.cc:343] T eb58d3a8bd8540ff9871ea41021a5025 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:43.346102 30977 tablet_bootstrap.cc:492] T da25c47d7366434089b73f8af7ce453b P 15ad0880a63541ef965cb6acca4513d7: No bootstrap required, opened a new log
I20260709 12:13:43.346706 30977 ts_tablet_manager.cc:1403] T da25c47d7366434089b73f8af7ce453b P 15ad0880a63541ef965cb6acca4513d7: Time spent bootstrapping tablet: real 0.333s	user 0.012s	sys 0.024s
I20260709 12:13:43.349826 30977 raft_consensus.cc:359] T da25c47d7366434089b73f8af7ce453b P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:43.350549 30977 raft_consensus.cc:385] T da25c47d7366434089b73f8af7ce453b P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.350939 30977 raft_consensus.cc:740] T da25c47d7366434089b73f8af7ce453b P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Initialized, Role: FOLLOWER
I20260709 12:13:43.352015 30771 tablet_service.cc:1511] Processing CreateTablet for tablet 745e2cea61c44c3a80bdc49add504a75 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:13:43.351984 30977 consensus_queue.cc:260] T da25c47d7366434089b73f8af7ce453b P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:43.353454 30771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 745e2cea61c44c3a80bdc49add504a75. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:13:43.357302 30654 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:43.357540 30981 raft_consensus.cc:359] T 2ff9e0d905854cceb79f96f500a07339 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:43.358398 30981 raft_consensus.cc:385] T 2ff9e0d905854cceb79f96f500a07339 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.323647 30844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b23395f850d4699b8d289f501c96f60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.375824 30978 tablet_bootstrap.cc:492] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460: No bootstrap required, opened a new log
I20260709 12:13:43.376626 30978 ts_tablet_manager.cc:1403] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.341s	user 0.008s	sys 0.008s
I20260709 12:13:43.380976 30978 raft_consensus.cc:359] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:43.381996 30978 raft_consensus.cc:385] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.358764 30981 raft_consensus.cc:740] T 2ff9e0d905854cceb79f96f500a07339 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Initialized, Role: FOLLOWER
I20260709 12:13:43.382368 30978 raft_consensus.cc:740] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:43.388028 30770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0317908edb88497b82c4e59ef1bac414. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.412470 30915 tablet_service.cc:1511] Processing CreateTablet for tablet ec7d33fd7f3245f68966bd7749ee53c3 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:13:43.413862 30915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec7d33fd7f3245f68966bd7749ee53c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.415112 30981 consensus_queue.cc:260] T 2ff9e0d905854cceb79f96f500a07339 P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:43.417487 30981 ts_tablet_manager.cc:1434] T 2ff9e0d905854cceb79f96f500a07339 P 84b98f9236604dd0b22ae23c5378a676: Time spent starting tablet: real 0.119s	user 0.007s	sys 0.000s
I20260709 12:13:43.419056 30766 tablet_service.cc:1511] Processing CreateTablet for tablet 1bbb677d9c544ed5a31297773b1508d6 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:13:43.420002 30921 tablet_service.cc:1511] Processing CreateTablet for tablet 34e3009dd96f4545b2abe325ac95e960 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:13:43.428530 30978 consensus_queue.cc:260] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:43.429661 30766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bbb677d9c544ed5a31297773b1508d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.439563 30978 ts_tablet_manager.cc:1434] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.063s	user 0.004s	sys 0.007s
I20260709 12:13:43.439850 30977 ts_tablet_manager.cc:1434] T da25c47d7366434089b73f8af7ce453b P 15ad0880a63541ef965cb6acca4513d7: Time spent starting tablet: real 0.093s	user 0.002s	sys 0.005s
I20260709 12:13:43.440874 30977 tablet_bootstrap.cc:492] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7: Bootstrap starting.
I20260709 12:13:43.420459 30980 tablet_bootstrap.cc:654] T a0bb1498511242ef95085be49c10c4d3 P 8130e18710c04a61a5d8bd019c6ffdad: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.447898 30695 tablet_service.cc:1511] Processing CreateTablet for tablet ec7d33fd7f3245f68966bd7749ee53c3 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:13:43.448233 30697 tablet_service.cc:1511] Processing CreateTablet for tablet 34e3009dd96f4545b2abe325ac95e960 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:13:43.449330 30695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec7d33fd7f3245f68966bd7749ee53c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.446164 30978 tablet_bootstrap.cc:492] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:43.449664 30981 tablet_bootstrap.cc:492] T a318673515aa415db1aa91d126a5b724 P 84b98f9236604dd0b22ae23c5378a676: Bootstrap starting.
I20260709 12:13:43.428576 30921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34e3009dd96f4545b2abe325ac95e960. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.452656 30774 tablet_service.cc:1511] Processing CreateTablet for tablet ec7d33fd7f3245f68966bd7749ee53c3 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:13:43.453972 30774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec7d33fd7f3245f68966bd7749ee53c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.450673 30697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34e3009dd96f4545b2abe325ac95e960. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.457346 30845 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35876 (request call id 23) took 1032 ms. Trace:
I20260709 12:13:43.460263 30845 rpcz_store.cc:276] 0709 12:13:42.425529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.906175 (+480646us) service_pool.cc:224] Handling call
0709 12:13:43.003331 (+ 97156us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:43.003494 (+   163us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:43.142462 (+138968us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:43.456837 (+314375us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:43.457284 (+   447us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:43.465709 30772 tablet_service.cc:1511] Processing CreateTablet for tablet 4031508121204ef4a2f5f2f0e9508cab (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:13:43.467159 30772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4031508121204ef4a2f5f2f0e9508cab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.472724 30709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d4dde0196948ef92f68df770af02b0" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
W20260709 12:13:43.474504 30898 leader_election.cc:343] T 76d4dde0196948ef92f68df770af02b0 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:43.475466 30919 tablet_service.cc:1511] Processing CreateTablet for tablet 4031508121204ef4a2f5f2f0e9508cab (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:13:43.476823 30919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4031508121204ef4a2f5f2f0e9508cab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.500981 30696 tablet_service.cc:1511] Processing CreateTablet for tablet 554acf71459c4e59b886396df52b3004 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:13:43.508810 30981 tablet_bootstrap.cc:654] T a318673515aa415db1aa91d126a5b724 P 84b98f9236604dd0b22ae23c5378a676: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.482959 30977 tablet_bootstrap.cc:654] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.520560 30842 tablet_service.cc:1511] Processing CreateTablet for tablet 745e2cea61c44c3a80bdc49add504a75 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:13:43.521082 30847 tablet_service.cc:1511] Processing CreateTablet for tablet 4031508121204ef4a2f5f2f0e9508cab (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:13:43.522112 30846 tablet_service.cc:1511] Processing CreateTablet for tablet 554acf71459c4e59b886396df52b3004 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:13:43.522800 30842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 745e2cea61c44c3a80bdc49add504a75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.522768 30841 tablet_service.cc:1511] Processing CreateTablet for tablet 1bbb677d9c544ed5a31297773b1508d6 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:13:43.523243 30709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "615eb2fb16414287bc0956a27523b7f4" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:43.524070 30846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 554acf71459c4e59b886396df52b3004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.526764 30841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bbb677d9c544ed5a31297773b1508d6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:13:43.527154 30824 leader_election.cc:343] T 615eb2fb16414287bc0956a27523b7f4 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:43.528026 30847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4031508121204ef4a2f5f2f0e9508cab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.520977 30845 tablet_service.cc:1511] Processing CreateTablet for tablet 34e3009dd96f4545b2abe325ac95e960 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:13:43.529058 30845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34e3009dd96f4545b2abe325ac95e960. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.501477 30769 tablet_service.cc:1511] Processing CreateTablet for tablet 554acf71459c4e59b886396df52b3004 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:13:43.534425 30769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 554acf71459c4e59b886396df52b3004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.539355 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb58d3a8bd8540ff9871ea41021a5025" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
W20260709 12:13:43.541105 30673 leader_election.cc:343] T eb58d3a8bd8540ff9871ea41021a5025 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:43.547688 30980 tablet_bootstrap.cc:492] T a0bb1498511242ef95085be49c10c4d3 P 8130e18710c04a61a5d8bd019c6ffdad: No bootstrap required, opened a new log
I20260709 12:13:43.548234 30980 ts_tablet_manager.cc:1403] T a0bb1498511242ef95085be49c10c4d3 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent bootstrapping tablet: real 0.301s	user 0.013s	sys 0.010s
I20260709 12:13:43.543965 30916 tablet_service.cc:1511] Processing CreateTablet for tablet 3e0e49105b2d44f09c55f7cc603f9b91 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:13:43.580195 30696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 554acf71459c4e59b886396df52b3004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.581141 30693 tablet_service.cc:1511] Processing CreateTablet for tablet 3e0e49105b2d44f09c55f7cc603f9b91 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:13:43.582479 30693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e0e49105b2d44f09c55f7cc603f9b91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.584069 30916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e0e49105b2d44f09c55f7cc603f9b91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.587875 30978 tablet_bootstrap.cc:700] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460: Time spent opening tablet: real 0.130s	user 0.001s	sys 0.000s
I20260709 12:13:43.588579 30978 tablet_bootstrap.cc:654] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.589005 30768 tablet_service.cc:1511] Processing CreateTablet for tablet 3e0e49105b2d44f09c55f7cc603f9b91 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:13:43.590518 30768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e0e49105b2d44f09c55f7cc603f9b91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.601215 30986 raft_consensus.cc:493] T da25c47d7366434089b73f8af7ce453b P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.601884 30986 raft_consensus.cc:515] T da25c47d7366434089b73f8af7ce453b P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:43.615546 30986 leader_election.cc:290] T da25c47d7366434089b73f8af7ce453b P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:43.626510 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da25c47d7366434089b73f8af7ce453b" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
W20260709 12:13:43.628101 30896 leader_election.cc:343] T da25c47d7366434089b73f8af7ce453b P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:43.645869 30709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb58d3a8bd8540ff9871ea41021a5025" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:43.646590 30709 raft_consensus.cc:2468] T eb58d3a8bd8540ff9871ea41021a5025 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 0.
I20260709 12:13:43.646381 30980 raft_consensus.cc:359] T a0bb1498511242ef95085be49c10c4d3 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:43.651062 30919 tablet_service.cc:1511] Processing CreateTablet for tablet ca92b4f3c36b42fb9aa2f575c06344fe (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:13:43.651561 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "615eb2fb16414287bc0956a27523b7f4" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:43.652467 30919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca92b4f3c36b42fb9aa2f575c06344fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.652220 30977 tablet_bootstrap.cc:492] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7: No bootstrap required, opened a new log
W20260709 12:13:43.653390 30822 leader_election.cc:343] T 615eb2fb16414287bc0956a27523b7f4 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:43.653605 30750 leader_election.cc:304] T eb58d3a8bd8540ff9871ea41021a5025 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460, 84b98f9236604dd0b22ae23c5378a676; no voters: 8130e18710c04a61a5d8bd019c6ffdad
I20260709 12:13:43.654102 30822 leader_election.cc:304] T 615eb2fb16414287bc0956a27523b7f4 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad; no voters: 6c5665c17e904fc692bce76fc57b2460, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:43.655375 30989 raft_consensus.cc:2749] T 615eb2fb16414287bc0956a27523b7f4 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:43.655890 30987 raft_consensus.cc:2804] T eb58d3a8bd8540ff9871ea41021a5025 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:43.656311 30987 raft_consensus.cc:493] T eb58d3a8bd8540ff9871ea41021a5025 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.656644 30987 raft_consensus.cc:3060] T eb58d3a8bd8540ff9871ea41021a5025 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:43.658676 30848 tablet_service.cc:1511] Processing CreateTablet for tablet ca92b4f3c36b42fb9aa2f575c06344fe (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:13:43.661181 30848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca92b4f3c36b42fb9aa2f575c06344fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.664757 30771 tablet_service.cc:1511] Processing CreateTablet for tablet 472c5cafdab84ead8ce9b93950070d13 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:13:43.668588 30771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 472c5cafdab84ead8ce9b93950070d13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.668816 30845 tablet_service.cc:1511] Processing CreateTablet for tablet 472c5cafdab84ead8ce9b93950070d13 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:13:43.675731 30845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 472c5cafdab84ead8ce9b93950070d13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.658941 30980 raft_consensus.cc:385] T a0bb1498511242ef95085be49c10c4d3 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.671909 30921 tablet_service.cc:1511] Processing CreateTablet for tablet 472c5cafdab84ead8ce9b93950070d13 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:13:43.680409 30699 tablet_service.cc:1511] Processing CreateTablet for tablet 56a566949cf345d08d43f13ccff4be37 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:13:43.681695 30699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56a566949cf345d08d43f13ccff4be37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.654104 30977 ts_tablet_manager.cc:1403] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7: Time spent bootstrapping tablet: real 0.213s	user 0.014s	sys 0.010s
I20260709 12:13:43.688225 30984 raft_consensus.cc:493] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.688735 30984 raft_consensus.cc:515] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:43.686506 30987 raft_consensus.cc:515] T eb58d3a8bd8540ff9871ea41021a5025 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:43.690101 30977 raft_consensus.cc:359] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:43.691604 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb58d3a8bd8540ff9871ea41021a5025" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:13:43.691898 30695 tablet_service.cc:1511] Processing CreateTablet for tablet ca92b4f3c36b42fb9aa2f575c06344fe (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:13:43.692404 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b66a7b6f8aa4803b482e392cc945db7" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:43.693166 30695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca92b4f3c36b42fb9aa2f575c06344fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.687736 30921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 472c5cafdab84ead8ce9b93950070d13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.690825 30977 raft_consensus.cc:385] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.700624 30987 leader_election.cc:290] T eb58d3a8bd8540ff9871ea41021a5025 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 election: Requested vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:43.702497 30916 tablet_service.cc:1511] Processing CreateTablet for tablet a4b7489c1b104bf2bb461bcdca7e6f42 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:13:43.679167 30980 raft_consensus.cc:740] T a0bb1498511242ef95085be49c10c4d3 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Initialized, Role: FOLLOWER
I20260709 12:13:43.690970 30984 leader_election.cc:290] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:43.711393 30697 tablet_service.cc:1511] Processing CreateTablet for tablet a4b7489c1b104bf2bb461bcdca7e6f42 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:13:43.712738 30697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4b7489c1b104bf2bb461bcdca7e6f42. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:13:43.703174 30748 leader_election.cc:343] T eb58d3a8bd8540ff9871ea41021a5025 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:43.717316 30841 tablet_service.cc:1511] Processing CreateTablet for tablet 56a566949cf345d08d43f13ccff4be37 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:13:43.718616 30841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56a566949cf345d08d43f13ccff4be37. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:13:43.720902 30673 leader_election.cc:343] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:43.722908 30978 tablet_bootstrap.cc:492] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460: No bootstrap required, opened a new log
I20260709 12:13:43.723464 30978 ts_tablet_manager.cc:1403] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.278s	user 0.014s	sys 0.006s
I20260709 12:13:43.723796 30770 tablet_service.cc:1511] Processing CreateTablet for tablet 56a566949cf345d08d43f13ccff4be37 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:13:43.725116 30770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56a566949cf345d08d43f13ccff4be37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.726541 30978 raft_consensus.cc:359] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:43.727424 30978 raft_consensus.cc:385] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.727120 30980 consensus_queue.cc:260] T a0bb1498511242ef95085be49c10c4d3 P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:43.727725 30978 raft_consensus.cc:740] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:43.727793 30916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4b7489c1b104bf2bb461bcdca7e6f42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.697716 30977 raft_consensus.cc:740] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Initialized, Role: FOLLOWER
I20260709 12:13:43.737982 30977 consensus_queue.cc:260] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:43.740391 30977 ts_tablet_manager.cc:1434] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7: Time spent starting tablet: real 0.053s	user 0.004s	sys 0.003s
I20260709 12:13:43.743896 30977 tablet_bootstrap.cc:492] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7: Bootstrap starting.
I20260709 12:13:43.747851 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d4dde0196948ef92f68df770af02b0" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:43.728747 30978 consensus_queue.cc:260] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:43.731684 30980 ts_tablet_manager.cc:1434] T a0bb1498511242ef95085be49c10c4d3 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent starting tablet: real 0.183s	user 0.008s	sys 0.001s
I20260709 12:13:43.749986 30980 tablet_bootstrap.cc:492] T a6a5bd717fa048aabdd0879bcea0fd60 P 8130e18710c04a61a5d8bd019c6ffdad: Bootstrap starting.
I20260709 12:13:43.750619 30978 ts_tablet_manager.cc:1434] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 12:13:43.751721 30978 tablet_bootstrap.cc:492] T a6a5bd717fa048aabdd0879bcea0fd60 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:43.729101 30981 tablet_bootstrap.cc:492] T a318673515aa415db1aa91d126a5b724 P 84b98f9236604dd0b22ae23c5378a676: No bootstrap required, opened a new log
I20260709 12:13:43.745291 30709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb58d3a8bd8540ff9871ea41021a5025" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
I20260709 12:13:43.746598 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb58d3a8bd8540ff9871ea41021a5025" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:43.747109 30987 raft_consensus.cc:493] T 2ff9e0d905854cceb79f96f500a07339 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.755522 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da25c47d7366434089b73f8af7ce453b" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:43.759456 30784 raft_consensus.cc:2393] T eb58d3a8bd8540ff9871ea41021a5025 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c5665c17e904fc692bce76fc57b2460 in current term 1: Already voted for candidate 84b98f9236604dd0b22ae23c5378a676 in this term.
I20260709 12:13:43.758348 30709 raft_consensus.cc:3060] T eb58d3a8bd8540ff9871ea41021a5025 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:43.762687 30915 tablet_service.cc:1511] Processing CreateTablet for tablet 32c211a79de247c8b5cef16a2d0a4dcb (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:13:43.763073 30768 tablet_service.cc:1511] Processing CreateTablet for tablet a4b7489c1b104bf2bb461bcdca7e6f42 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:13:43.764036 30915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32c211a79de247c8b5cef16a2d0a4dcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.764384 30768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4b7489c1b104bf2bb461bcdca7e6f42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.767097 30987 raft_consensus.cc:515] T 2ff9e0d905854cceb79f96f500a07339 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:43.768044 30848 tablet_service.cc:1511] Processing CreateTablet for tablet 32c211a79de247c8b5cef16a2d0a4dcb (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:13:43.769340 30848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32c211a79de247c8b5cef16a2d0a4dcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.769528 30987 leader_election.cc:290] T 2ff9e0d905854cceb79f96f500a07339 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:43.779961 30673 leader_election.cc:304] T eb58d3a8bd8540ff9871ea41021a5025 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460; no voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:43.758785 30981 ts_tablet_manager.cc:1403] T a318673515aa415db1aa91d126a5b724 P 84b98f9236604dd0b22ae23c5378a676: Time spent bootstrapping tablet: real 0.309s	user 0.020s	sys 0.000s
I20260709 12:13:43.784946 30708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9e0d905854cceb79f96f500a07339" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:43.787091 30697 tablet_service.cc:1511] Processing CreateTablet for tablet 32c211a79de247c8b5cef16a2d0a4dcb (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:13:43.795346 30697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32c211a79de247c8b5cef16a2d0a4dcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.799564 30771 tablet_service.cc:1511] Processing CreateTablet for tablet 71c3fcab3f8f41238feeb802a6d2dbc9 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:13:43.777159 30709 raft_consensus.cc:2468] T eb58d3a8bd8540ff9871ea41021a5025 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 1.
W20260709 12:13:43.787153 30750 leader_election.cc:343] T 2ff9e0d905854cceb79f96f500a07339 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:43.801352 30984 raft_consensus.cc:2749] T eb58d3a8bd8540ff9871ea41021a5025 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:43.789893 30981 raft_consensus.cc:359] T a318673515aa415db1aa91d126a5b724 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:43.802277 30981 raft_consensus.cc:385] T a318673515aa415db1aa91d126a5b724 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.802172 30750 leader_election.cc:304] T eb58d3a8bd8540ff9871ea41021a5025 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460, 84b98f9236604dd0b22ae23c5378a676; no voters: 8130e18710c04a61a5d8bd019c6ffdad
I20260709 12:13:43.802780 30981 raft_consensus.cc:740] T a318673515aa415db1aa91d126a5b724 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Initialized, Role: FOLLOWER
W20260709 12:13:43.777833 30896 leader_election.cc:343] T 76d4dde0196948ef92f68df770af02b0 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:43.805325 31013 raft_consensus.cc:2804] T eb58d3a8bd8540ff9871ea41021a5025 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:43.805523 30896 leader_election.cc:304] T 76d4dde0196948ef92f68df770af02b0 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7; no voters: 6c5665c17e904fc692bce76fc57b2460, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:43.805892 31013 raft_consensus.cc:697] T eb58d3a8bd8540ff9871ea41021a5025 P 84b98f9236604dd0b22ae23c5378a676 [term 1 LEADER]: Becoming Leader. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Running, Role: LEADER
I20260709 12:13:43.806766 31013 consensus_queue.cc:237] T eb58d3a8bd8540ff9871ea41021a5025 P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:43.807171 30986 raft_consensus.cc:2749] T 76d4dde0196948ef92f68df770af02b0 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:43.807247 30847 tablet_service.cc:1511] Processing CreateTablet for tablet 71c3fcab3f8f41238feeb802a6d2dbc9 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:13:43.808925 30847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71c3fcab3f8f41238feeb802a6d2dbc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.811563 30771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71c3fcab3f8f41238feeb802a6d2dbc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.811158 30981 consensus_queue.cc:260] T a318673515aa415db1aa91d126a5b724 P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:43.816279 30981 ts_tablet_manager.cc:1434] T a318673515aa415db1aa91d126a5b724 P 84b98f9236604dd0b22ae23c5378a676: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 12:13:43.816452 30913 tablet_service.cc:1511] Processing CreateTablet for tablet 71c3fcab3f8f41238feeb802a6d2dbc9 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:13:43.817323 30986 raft_consensus.cc:493] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.817759 30981 tablet_bootstrap.cc:492] T f0fbdcbe46b34107bbbf63f69c98e244 P 84b98f9236604dd0b22ae23c5378a676: Bootstrap starting.
I20260709 12:13:43.817788 30913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71c3fcab3f8f41238feeb802a6d2dbc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.817806 30986 raft_consensus.cc:515] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:43.823375 30986 leader_election.cc:290] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:43.828732 30980 tablet_bootstrap.cc:654] T a6a5bd717fa048aabdd0879bcea0fd60 P 8130e18710c04a61a5d8bd019c6ffdad: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.828366 30709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a318673515aa415db1aa91d126a5b724" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
W20260709 12:13:43.832933 30896 leader_election.cc:343] T da25c47d7366434089b73f8af7ce453b P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:43.833570 30898 leader_election.cc:343] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:43.833564 30896 leader_election.cc:304] T da25c47d7366434089b73f8af7ce453b P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7; no voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:43.836014 30986 raft_consensus.cc:2749] T da25c47d7366434089b73f8af7ce453b P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:43.836153 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a318673515aa415db1aa91d126a5b724" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:43.836879 30784 raft_consensus.cc:2468] T a318673515aa415db1aa91d126a5b724 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 0.
I20260709 12:13:43.838930 30896 leader_election.cc:304] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676; no voters: 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:43.840149 30978 tablet_bootstrap.cc:654] T a6a5bd717fa048aabdd0879bcea0fd60 P 6c5665c17e904fc692bce76fc57b2460: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.840108 30986 raft_consensus.cc:2804] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:43.843567 30986 raft_consensus.cc:493] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.845439 30986 raft_consensus.cc:3060] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:43.847075 30977 tablet_bootstrap.cc:654] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.854002 30981 tablet_bootstrap.cc:654] T f0fbdcbe46b34107bbbf63f69c98e244 P 84b98f9236604dd0b22ae23c5378a676: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.858002 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b66a7b6f8aa4803b482e392cc945db7" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:43.868391 30986 raft_consensus.cc:515] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:43.873025 30980 tablet_bootstrap.cc:492] T a6a5bd717fa048aabdd0879bcea0fd60 P 8130e18710c04a61a5d8bd019c6ffdad: No bootstrap required, opened a new log
I20260709 12:13:43.873695 30980 ts_tablet_manager.cc:1403] T a6a5bd717fa048aabdd0879bcea0fd60 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent bootstrapping tablet: real 0.124s	user 0.013s	sys 0.001s
I20260709 12:13:43.855139 30695 tablet_service.cc:1511] Processing CreateTablet for tablet 2cf56cf233cc48a5a720300bc769fa6a (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:13:43.857923 30770 tablet_service.cc:1511] Processing CreateTablet for tablet 2cf56cf233cc48a5a720300bc769fa6a (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:13:43.877385 30709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a318673515aa415db1aa91d126a5b724" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
I20260709 12:13:43.879078 30770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cf56cf233cc48a5a720300bc769fa6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.874838 30989 raft_consensus.cc:493] T a0bb1498511242ef95085be49c10c4d3 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.879622 30989 raft_consensus.cc:515] T a0bb1498511242ef95085be49c10c4d3 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:43.880035 30980 raft_consensus.cc:359] T a6a5bd717fa048aabdd0879bcea0fd60 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:43.880985 30980 raft_consensus.cc:385] T a6a5bd717fa048aabdd0879bcea0fd60 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.881330 30980 raft_consensus.cc:740] T a6a5bd717fa048aabdd0879bcea0fd60 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Initialized, Role: FOLLOWER
I20260709 12:13:43.881695 30989 leader_election.cc:290] T a0bb1498511242ef95085be49c10c4d3 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
W20260709 12:13:43.882428 30674 leader_election.cc:343] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:43.882130 30980 consensus_queue.cc:260] T a6a5bd717fa048aabdd0879bcea0fd60 P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:43.882880 30674 leader_election.cc:304] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460; no voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad
I20260709 12:13:43.884611 30848 tablet_service.cc:1511] Processing CreateTablet for tablet 2cf56cf233cc48a5a720300bc769fa6a (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
W20260709 12:13:43.885149 30898 leader_election.cc:343] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:43.885977 30709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0bb1498511242ef95085be49c10c4d3" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:43.885236 30915 tablet_service.cc:1511] Processing CreateTablet for tablet 660d2eb6dd3f4e96aab252cfd980be89 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:13:43.887156 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0bb1498511242ef95085be49c10c4d3" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:43.891098 30695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cf56cf233cc48a5a720300bc769fa6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.895897 30848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cf56cf233cc48a5a720300bc769fa6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.896721 30915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 660d2eb6dd3f4e96aab252cfd980be89. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:13:43.900658 30822 leader_election.cc:343] T a0bb1498511242ef95085be49c10c4d3 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:43.900686 30984 raft_consensus.cc:2749] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:43.897728 30699 tablet_service.cc:1511] Processing CreateTablet for tablet 660d2eb6dd3f4e96aab252cfd980be89 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
W20260709 12:13:43.902648 30824 leader_election.cc:343] T a0bb1498511242ef95085be49c10c4d3 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:43.903080 30824 leader_election.cc:304] T a0bb1498511242ef95085be49c10c4d3 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad; no voters: 6c5665c17e904fc692bce76fc57b2460, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:43.905452 30989 raft_consensus.cc:2749] T a0bb1498511242ef95085be49c10c4d3 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:43.905788 30980 ts_tablet_manager.cc:1434] T a6a5bd717fa048aabdd0879bcea0fd60 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent starting tablet: real 0.032s	user 0.010s	sys 0.000s
I20260709 12:13:43.906437 30699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 660d2eb6dd3f4e96aab252cfd980be89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.909415 30980 tablet_bootstrap.cc:492] T d5a270750666414887b6fae2f3793dc5 P 8130e18710c04a61a5d8bd019c6ffdad: Bootstrap starting.
I20260709 12:13:43.909366 30771 tablet_service.cc:1511] Processing CreateTablet for tablet 660d2eb6dd3f4e96aab252cfd980be89 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:13:43.910774 30771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 660d2eb6dd3f4e96aab252cfd980be89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.912362 30913 tablet_service.cc:1511] Processing CreateTablet for tablet fa9f00939aba452180334d67a6d33010 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:13:43.913587 30913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa9f00939aba452180334d67a6d33010. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.917400 30980 tablet_bootstrap.cc:654] T d5a270750666414887b6fae2f3793dc5 P 8130e18710c04a61a5d8bd019c6ffdad: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.919629 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9e0d905854cceb79f96f500a07339" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:43.919335 30605 catalog_manager.cc:5697] T eb58d3a8bd8540ff9871ea41021a5025 P 84b98f9236604dd0b22ae23c5378a676 reported cstate change: term changed from 0 to 1, leader changed from <none> to 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "84b98f9236604dd0b22ae23c5378a676" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:43.921046 30986 leader_election.cc:290] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Requested vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
W20260709 12:13:43.921182 30749 leader_election.cc:343] T 2ff9e0d905854cceb79f96f500a07339 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:43.933081 30749 leader_election.cc:304] T 2ff9e0d905854cceb79f96f500a07339 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 84b98f9236604dd0b22ae23c5378a676; no voters: 15ad0880a63541ef965cb6acca4513d7, 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:43.921882 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a318673515aa415db1aa91d126a5b724" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:13:43.934597 30784 raft_consensus.cc:3060] T a318673515aa415db1aa91d126a5b724 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:43.924817 30845 tablet_service.cc:1511] Processing CreateTablet for tablet fa9f00939aba452180334d67a6d33010 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:13:43.934118 31013 raft_consensus.cc:2749] T 2ff9e0d905854cceb79f96f500a07339 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:43.939805 30845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa9f00939aba452180334d67a6d33010. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.945784 30697 tablet_service.cc:1511] Processing CreateTablet for tablet fa9f00939aba452180334d67a6d33010 (DEFAULT_TABLE table=test-workload [id=408adc4ace4b4a41af622d58f8ea1ef6]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:13:43.946446 30784 raft_consensus.cc:2468] T a318673515aa415db1aa91d126a5b724 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 1.
I20260709 12:13:43.950377 30896 leader_election.cc:304] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676; no voters: 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:43.951476 30986 raft_consensus.cc:2804] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:43.951504 30981 tablet_bootstrap.cc:492] T f0fbdcbe46b34107bbbf63f69c98e244 P 84b98f9236604dd0b22ae23c5378a676: No bootstrap required, opened a new log
I20260709 12:13:43.953594 30981 ts_tablet_manager.cc:1403] T f0fbdcbe46b34107bbbf63f69c98e244 P 84b98f9236604dd0b22ae23c5378a676: Time spent bootstrapping tablet: real 0.136s	user 0.014s	sys 0.011s
I20260709 12:13:43.955778 30977 tablet_bootstrap.cc:492] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7: No bootstrap required, opened a new log
I20260709 12:13:43.956300 30977 ts_tablet_manager.cc:1403] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7: Time spent bootstrapping tablet: real 0.213s	user 0.013s	sys 0.012s
I20260709 12:13:43.957062 30981 raft_consensus.cc:359] T f0fbdcbe46b34107bbbf63f69c98e244 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:43.957773 30981 raft_consensus.cc:385] T f0fbdcbe46b34107bbbf63f69c98e244 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.958042 30981 raft_consensus.cc:740] T f0fbdcbe46b34107bbbf63f69c98e244 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Initialized, Role: FOLLOWER
I20260709 12:13:43.958902 30981 consensus_queue.cc:260] T f0fbdcbe46b34107bbbf63f69c98e244 P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:43.962970 30978 tablet_bootstrap.cc:492] T a6a5bd717fa048aabdd0879bcea0fd60 P 6c5665c17e904fc692bce76fc57b2460: No bootstrap required, opened a new log
I20260709 12:13:43.961287 30981 ts_tablet_manager.cc:1434] T f0fbdcbe46b34107bbbf63f69c98e244 P 84b98f9236604dd0b22ae23c5378a676: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:13:43.968019 30978 ts_tablet_manager.cc:1403] T a6a5bd717fa048aabdd0879bcea0fd60 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.216s	user 0.009s	sys 0.013s
I20260709 12:13:43.971148 30981 tablet_bootstrap.cc:492] T b047acdc74424afc81c6380239209821 P 84b98f9236604dd0b22ae23c5378a676: Bootstrap starting.
I20260709 12:13:43.972328 30986 raft_consensus.cc:697] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7 [term 1 LEADER]: Becoming Leader. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Running, Role: LEADER
I20260709 12:13:43.972149 30697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa9f00939aba452180334d67a6d33010. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.976169 30986 consensus_queue.cc:237] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:43.975740 30977 raft_consensus.cc:359] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:43.985140 30980 tablet_bootstrap.cc:492] T d5a270750666414887b6fae2f3793dc5 P 8130e18710c04a61a5d8bd019c6ffdad: No bootstrap required, opened a new log
I20260709 12:13:43.995194 30980 ts_tablet_manager.cc:1403] T d5a270750666414887b6fae2f3793dc5 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent bootstrapping tablet: real 0.086s	user 0.022s	sys 0.018s
I20260709 12:13:43.998332 30980 raft_consensus.cc:359] T d5a270750666414887b6fae2f3793dc5 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:43.998910 30980 raft_consensus.cc:385] T d5a270750666414887b6fae2f3793dc5 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.999218 30980 raft_consensus.cc:740] T d5a270750666414887b6fae2f3793dc5 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.000044 30980 consensus_queue.cc:260] T d5a270750666414887b6fae2f3793dc5 P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:43.985651 30977 raft_consensus.cc:385] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.004508 30977 raft_consensus.cc:740] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.005578 30978 raft_consensus.cc:359] T a6a5bd717fa048aabdd0879bcea0fd60 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:44.006510 30978 raft_consensus.cc:385] T a6a5bd717fa048aabdd0879bcea0fd60 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.006114 30977 consensus_queue.cc:260] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:44.005335 30980 ts_tablet_manager.cc:1434] T d5a270750666414887b6fae2f3793dc5 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:13:44.007236 30978 raft_consensus.cc:740] T a6a5bd717fa048aabdd0879bcea0fd60 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.009897 30980 tablet_bootstrap.cc:492] T f0fbdcbe46b34107bbbf63f69c98e244 P 8130e18710c04a61a5d8bd019c6ffdad: Bootstrap starting.
I20260709 12:13:44.010242 30977 ts_tablet_manager.cc:1434] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.001s
I20260709 12:13:44.010061 30978 consensus_queue.cc:260] T a6a5bd717fa048aabdd0879bcea0fd60 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:44.011343 30977 tablet_bootstrap.cc:492] T b047acdc74424afc81c6380239209821 P 15ad0880a63541ef965cb6acca4513d7: Bootstrap starting.
I20260709 12:13:44.013746 30978 ts_tablet_manager.cc:1434] T a6a5bd717fa048aabdd0879bcea0fd60 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 12:13:44.016289 30978 tablet_bootstrap.cc:492] T 615eb2fb16414287bc0956a27523b7f4 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:44.017660 30977 tablet_bootstrap.cc:654] T b047acdc74424afc81c6380239209821 P 15ad0880a63541ef965cb6acca4513d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.038071 30978 tablet_bootstrap.cc:654] T 615eb2fb16414287bc0956a27523b7f4 P 6c5665c17e904fc692bce76fc57b2460: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.038131 30607 catalog_manager.cc:5697] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132). New cstate: current_term: 1 leader_uuid: "15ad0880a63541ef965cb6acca4513d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:44.041911 30980 tablet_bootstrap.cc:654] T f0fbdcbe46b34107bbbf63f69c98e244 P 8130e18710c04a61a5d8bd019c6ffdad: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.045805 30981 tablet_bootstrap.cc:654] T b047acdc74424afc81c6380239209821 P 84b98f9236604dd0b22ae23c5378a676: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.050019 30977 tablet_bootstrap.cc:492] T b047acdc74424afc81c6380239209821 P 15ad0880a63541ef965cb6acca4513d7: No bootstrap required, opened a new log
I20260709 12:13:44.052201 30977 ts_tablet_manager.cc:1403] T b047acdc74424afc81c6380239209821 P 15ad0880a63541ef965cb6acca4513d7: Time spent bootstrapping tablet: real 0.041s	user 0.018s	sys 0.003s
I20260709 12:13:44.054252 30978 tablet_bootstrap.cc:492] T 615eb2fb16414287bc0956a27523b7f4 P 6c5665c17e904fc692bce76fc57b2460: No bootstrap required, opened a new log
I20260709 12:13:44.054430 30981 tablet_bootstrap.cc:492] T b047acdc74424afc81c6380239209821 P 84b98f9236604dd0b22ae23c5378a676: No bootstrap required, opened a new log
I20260709 12:13:44.054819 30978 ts_tablet_manager.cc:1403] T 615eb2fb16414287bc0956a27523b7f4 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.000s
I20260709 12:13:44.055037 30980 tablet_bootstrap.cc:492] T f0fbdcbe46b34107bbbf63f69c98e244 P 8130e18710c04a61a5d8bd019c6ffdad: No bootstrap required, opened a new log
I20260709 12:13:44.055261 30981 ts_tablet_manager.cc:1403] T b047acdc74424afc81c6380239209821 P 84b98f9236604dd0b22ae23c5378a676: Time spent bootstrapping tablet: real 0.086s	user 0.007s	sys 0.007s
I20260709 12:13:44.055696 30980 ts_tablet_manager.cc:1403] T f0fbdcbe46b34107bbbf63f69c98e244 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent bootstrapping tablet: real 0.047s	user 0.009s	sys 0.010s
I20260709 12:13:44.055644 30977 raft_consensus.cc:359] T b047acdc74424afc81c6380239209821 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:44.056668 30977 raft_consensus.cc:385] T b047acdc74424afc81c6380239209821 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.057000 30977 raft_consensus.cc:740] T b047acdc74424afc81c6380239209821 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.057837 30977 consensus_queue.cc:260] T b047acdc74424afc81c6380239209821 P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:44.058099 30978 raft_consensus.cc:359] T 615eb2fb16414287bc0956a27523b7f4 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:44.058801 30978 raft_consensus.cc:385] T 615eb2fb16414287bc0956a27523b7f4 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.059180 30978 raft_consensus.cc:740] T 615eb2fb16414287bc0956a27523b7f4 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.059384 30980 raft_consensus.cc:359] T f0fbdcbe46b34107bbbf63f69c98e244 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:44.060190 30980 raft_consensus.cc:385] T f0fbdcbe46b34107bbbf63f69c98e244 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.060634 30977 ts_tablet_manager.cc:1434] T b047acdc74424afc81c6380239209821 P 15ad0880a63541ef965cb6acca4513d7: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:13:44.060194 30978 consensus_queue.cc:260] T 615eb2fb16414287bc0956a27523b7f4 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:44.060902 30980 raft_consensus.cc:740] T f0fbdcbe46b34107bbbf63f69c98e244 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.062162 30977 tablet_bootstrap.cc:492] T 21c0ba9bb1d64ab398c606450f72e966 P 15ad0880a63541ef965cb6acca4513d7: Bootstrap starting.
I20260709 12:13:44.061861 30980 consensus_queue.cc:260] T f0fbdcbe46b34107bbbf63f69c98e244 P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:44.061542 30981 raft_consensus.cc:359] T b047acdc74424afc81c6380239209821 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:44.064913 30981 raft_consensus.cc:385] T b047acdc74424afc81c6380239209821 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.065223 30981 raft_consensus.cc:740] T b047acdc74424afc81c6380239209821 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.065882 30980 ts_tablet_manager.cc:1434] T f0fbdcbe46b34107bbbf63f69c98e244 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:13:44.067324 30980 tablet_bootstrap.cc:492] T fd65967534164e9c805fc3d5d05e0369 P 8130e18710c04a61a5d8bd019c6ffdad: Bootstrap starting.
I20260709 12:13:44.067070 30981 consensus_queue.cc:260] T b047acdc74424afc81c6380239209821 P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:44.062882 30978 ts_tablet_manager.cc:1434] T 615eb2fb16414287bc0956a27523b7f4 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 12:13:44.070016 30978 tablet_bootstrap.cc:492] T f0fbdcbe46b34107bbbf63f69c98e244 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:44.072144 30977 tablet_bootstrap.cc:654] T 21c0ba9bb1d64ab398c606450f72e966 P 15ad0880a63541ef965cb6acca4513d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.072854 30981 ts_tablet_manager.cc:1434] T b047acdc74424afc81c6380239209821 P 84b98f9236604dd0b22ae23c5378a676: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 12:13:44.074014 30980 tablet_bootstrap.cc:654] T fd65967534164e9c805fc3d5d05e0369 P 8130e18710c04a61a5d8bd019c6ffdad: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.077798 30978 tablet_bootstrap.cc:654] T f0fbdcbe46b34107bbbf63f69c98e244 P 6c5665c17e904fc692bce76fc57b2460: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.074016 30981 tablet_bootstrap.cc:492] T 615eb2fb16414287bc0956a27523b7f4 P 84b98f9236604dd0b22ae23c5378a676: Bootstrap starting.
I20260709 12:13:44.098632 30980 tablet_bootstrap.cc:492] T fd65967534164e9c805fc3d5d05e0369 P 8130e18710c04a61a5d8bd019c6ffdad: No bootstrap required, opened a new log
I20260709 12:13:44.099288 30980 ts_tablet_manager.cc:1403] T fd65967534164e9c805fc3d5d05e0369 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent bootstrapping tablet: real 0.032s	user 0.009s	sys 0.009s
I20260709 12:13:44.102533 30980 raft_consensus.cc:359] T fd65967534164e9c805fc3d5d05e0369 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:44.103394 30980 raft_consensus.cc:385] T fd65967534164e9c805fc3d5d05e0369 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.103693 30980 raft_consensus.cc:740] T fd65967534164e9c805fc3d5d05e0369 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.104050 30981 tablet_bootstrap.cc:654] T 615eb2fb16414287bc0956a27523b7f4 P 84b98f9236604dd0b22ae23c5378a676: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.104564 30980 consensus_queue.cc:260] T fd65967534164e9c805fc3d5d05e0369 P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:44.107097 30980 ts_tablet_manager.cc:1434] T fd65967534164e9c805fc3d5d05e0369 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:13:44.108353 30980 tablet_bootstrap.cc:492] T eb58d3a8bd8540ff9871ea41021a5025 P 8130e18710c04a61a5d8bd019c6ffdad: Bootstrap starting.
I20260709 12:13:44.108454 30977 tablet_bootstrap.cc:492] T 21c0ba9bb1d64ab398c606450f72e966 P 15ad0880a63541ef965cb6acca4513d7: No bootstrap required, opened a new log
I20260709 12:13:44.110599 30977 ts_tablet_manager.cc:1403] T 21c0ba9bb1d64ab398c606450f72e966 P 15ad0880a63541ef965cb6acca4513d7: Time spent bootstrapping tablet: real 0.049s	user 0.026s	sys 0.013s
I20260709 12:13:44.114333 30977 raft_consensus.cc:359] T 21c0ba9bb1d64ab398c606450f72e966 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:44.116118 30978 tablet_bootstrap.cc:492] T f0fbdcbe46b34107bbbf63f69c98e244 P 6c5665c17e904fc692bce76fc57b2460: No bootstrap required, opened a new log
I20260709 12:13:44.119089 30978 ts_tablet_manager.cc:1403] T f0fbdcbe46b34107bbbf63f69c98e244 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.049s	user 0.010s	sys 0.010s
I20260709 12:13:44.122400 30980 tablet_bootstrap.cc:654] T eb58d3a8bd8540ff9871ea41021a5025 P 8130e18710c04a61a5d8bd019c6ffdad: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.122095 30978 raft_consensus.cc:359] T f0fbdcbe46b34107bbbf63f69c98e244 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:44.122916 30977 raft_consensus.cc:385] T 21c0ba9bb1d64ab398c606450f72e966 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.122964 30978 raft_consensus.cc:385] T f0fbdcbe46b34107bbbf63f69c98e244 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.123992 30978 raft_consensus.cc:740] T f0fbdcbe46b34107bbbf63f69c98e244 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.124953 30984 raft_consensus.cc:493] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.125083 30978 consensus_queue.cc:260] T f0fbdcbe46b34107bbbf63f69c98e244 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:44.125460 30984 raft_consensus.cc:515] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:44.132755 30977 raft_consensus.cc:740] T 21c0ba9bb1d64ab398c606450f72e966 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.133765 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd65967534164e9c805fc3d5d05e0369" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:44.134239 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd65967534164e9c805fc3d5d05e0369" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:44.134578 30932 raft_consensus.cc:2468] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 0.
I20260709 12:13:44.135128 30984 leader_election.cc:290] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:44.136165 30857 raft_consensus.cc:2468] T fd65967534164e9c805fc3d5d05e0369 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 0.
I20260709 12:13:44.134649 30977 consensus_queue.cc:260] T 21c0ba9bb1d64ab398c606450f72e966 P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:44.139278 30674 leader_election.cc:304] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 6c5665c17e904fc692bce76fc57b2460; no voters: 
I20260709 12:13:44.142160 30986 raft_consensus.cc:493] T b047acdc74424afc81c6380239209821 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.142696 30986 raft_consensus.cc:515] T b047acdc74424afc81c6380239209821 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:44.144834 30986 leader_election.cc:290] T b047acdc74424afc81c6380239209821 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:44.145615 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b047acdc74424afc81c6380239209821" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:44.145527 30984 raft_consensus.cc:2804] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:44.146474 30977 ts_tablet_manager.cc:1434] T 21c0ba9bb1d64ab398c606450f72e966 P 15ad0880a63541ef965cb6acca4513d7: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 12:13:44.146775 30984 raft_consensus.cc:493] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.147372 30984 raft_consensus.cc:3060] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.148214 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b047acdc74424afc81c6380239209821" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
W20260709 12:13:44.150130 30896 leader_election.cc:343] T b047acdc74424afc81c6380239209821 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:44.146510 30784 raft_consensus.cc:2468] T b047acdc74424afc81c6380239209821 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 0.
I20260709 12:13:44.152993 30977 tablet_bootstrap.cc:492] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7: Bootstrap starting.
I20260709 12:13:44.153167 30896 leader_election.cc:304] T b047acdc74424afc81c6380239209821 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676; no voters: 8130e18710c04a61a5d8bd019c6ffdad
I20260709 12:13:44.154222 30986 raft_consensus.cc:2804] T b047acdc74424afc81c6380239209821 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:44.154611 30986 raft_consensus.cc:493] T b047acdc74424afc81c6380239209821 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.154950 30986 raft_consensus.cc:3060] T b047acdc74424afc81c6380239209821 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.155334 30980 tablet_bootstrap.cc:492] T eb58d3a8bd8540ff9871ea41021a5025 P 8130e18710c04a61a5d8bd019c6ffdad: No bootstrap required, opened a new log
I20260709 12:13:44.158691 30989 raft_consensus.cc:493] T a6a5bd717fa048aabdd0879bcea0fd60 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.160593 30980 ts_tablet_manager.cc:1403] T eb58d3a8bd8540ff9871ea41021a5025 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent bootstrapping tablet: real 0.053s	user 0.015s	sys 0.009s
I20260709 12:13:44.160586 30989 raft_consensus.cc:515] T a6a5bd717fa048aabdd0879bcea0fd60 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:44.158209 31013 raft_consensus.cc:493] T f0fbdcbe46b34107bbbf63f69c98e244 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.164016 31013 raft_consensus.cc:515] T f0fbdcbe46b34107bbbf63f69c98e244 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:44.165791 30980 raft_consensus.cc:359] T eb58d3a8bd8540ff9871ea41021a5025 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:44.166698 30980 raft_consensus.cc:385] T eb58d3a8bd8540ff9871ea41021a5025 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.167018 30980 raft_consensus.cc:740] T eb58d3a8bd8540ff9871ea41021a5025 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.170516 30709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a5bd717fa048aabdd0879bcea0fd60" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:44.171175 30709 raft_consensus.cc:2468] T a6a5bd717fa048aabdd0879bcea0fd60 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 0.
I20260709 12:13:44.171255 30980 consensus_queue.cc:260] T eb58d3a8bd8540ff9871ea41021a5025 P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:44.171823 30977 tablet_bootstrap.cc:654] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.170337 30984 raft_consensus.cc:515] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:44.172204 30708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fbdcbe46b34107bbbf63f69c98e244" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:44.172868 30708 raft_consensus.cc:2468] T f0fbdcbe46b34107bbbf63f69c98e244 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 0.
I20260709 12:13:44.173508 30824 leader_election.cc:304] T a6a5bd717fa048aabdd0879bcea0fd60 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 
I20260709 12:13:44.174347 30750 leader_election.cc:304] T f0fbdcbe46b34107bbbf63f69c98e244 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:13:44.175275 30984 leader_election.cc:290] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 election: Requested vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:44.175484 30987 raft_consensus.cc:2804] T f0fbdcbe46b34107bbbf63f69c98e244 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:44.176017 30987 raft_consensus.cc:493] T f0fbdcbe46b34107bbbf63f69c98e244 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.176447 30987 raft_consensus.cc:3060] T f0fbdcbe46b34107bbbf63f69c98e244 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.178740 31041 raft_consensus.cc:2804] T a6a5bd717fa048aabdd0879bcea0fd60 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:44.179273 31041 raft_consensus.cc:493] T a6a5bd717fa048aabdd0879bcea0fd60 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.179718 31041 raft_consensus.cc:3060] T a6a5bd717fa048aabdd0879bcea0fd60 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.180780 31013 leader_election.cc:290] T f0fbdcbe46b34107bbbf63f69c98e244 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:44.182241 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fbdcbe46b34107bbbf63f69c98e244" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:44.185418 30857 raft_consensus.cc:2468] T f0fbdcbe46b34107bbbf63f69c98e244 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 0.
I20260709 12:13:44.190443 30980 ts_tablet_manager.cc:1434] T eb58d3a8bd8540ff9871ea41021a5025 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.004s
I20260709 12:13:44.191177 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd65967534164e9c805fc3d5d05e0369" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
I20260709 12:13:44.191934 30932 raft_consensus.cc:3060] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.194584 30980 tablet_bootstrap.cc:492] T 8b66a7b6f8aa4803b482e392cc945db7 P 8130e18710c04a61a5d8bd019c6ffdad: Bootstrap starting.
I20260709 12:13:44.188843 30989 leader_election.cc:290] T a6a5bd717fa048aabdd0879bcea0fd60 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:44.201996 30980 tablet_bootstrap.cc:654] T 8b66a7b6f8aa4803b482e392cc945db7 P 8130e18710c04a61a5d8bd019c6ffdad: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.212730 31041 raft_consensus.cc:515] T a6a5bd717fa048aabdd0879bcea0fd60 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:44.216209 31041 leader_election.cc:290] T a6a5bd717fa048aabdd0879bcea0fd60 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 election: Requested vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:44.216888 30987 raft_consensus.cc:515] T f0fbdcbe46b34107bbbf63f69c98e244 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:44.223230 30932 raft_consensus.cc:2468] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 1.
W20260709 12:13:44.218729 30824 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:40909, user_credentials={real_user=slave}} blocked reactor thread for 45313.3us
I20260709 12:13:44.226300 30980 tablet_bootstrap.cc:492] T 8b66a7b6f8aa4803b482e392cc945db7 P 8130e18710c04a61a5d8bd019c6ffdad: No bootstrap required, opened a new log
I20260709 12:13:44.239689 30980 ts_tablet_manager.cc:1403] T 8b66a7b6f8aa4803b482e392cc945db7 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.002s
I20260709 12:13:44.227943 30986 raft_consensus.cc:515] T b047acdc74424afc81c6380239209821 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:44.241127 30987 leader_election.cc:290] T f0fbdcbe46b34107bbbf63f69c98e244 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 election: Requested vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:44.241328 31042 raft_consensus.cc:493] T d5a270750666414887b6fae2f3793dc5 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.241227 30977 tablet_bootstrap.cc:492] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7: No bootstrap required, opened a new log
I20260709 12:13:44.242205 30986 leader_election.cc:290] T b047acdc74424afc81c6380239209821 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Requested vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:44.241958 31042 raft_consensus.cc:515] T d5a270750666414887b6fae2f3793dc5 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:44.242318 30977 ts_tablet_manager.cc:1403] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7: Time spent bootstrapping tablet: real 0.090s	user 0.018s	sys 0.001s
I20260709 12:13:44.245438 30980 raft_consensus.cc:359] T 8b66a7b6f8aa4803b482e392cc945db7 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:44.246181 30980 raft_consensus.cc:385] T 8b66a7b6f8aa4803b482e392cc945db7 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.246714 30980 raft_consensus.cc:740] T 8b66a7b6f8aa4803b482e392cc945db7 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.247437 30674 leader_election.cc:304] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 6c5665c17e904fc692bce76fc57b2460; no voters: 
I20260709 12:13:44.247519 30980 consensus_queue.cc:260] T 8b66a7b6f8aa4803b482e392cc945db7 P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:44.249027 30708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a5bd717fa048aabdd0879bcea0fd60" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
I20260709 12:13:44.249596 30980 ts_tablet_manager.cc:1434] T 8b66a7b6f8aa4803b482e392cc945db7 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:13:44.236892 30978 ts_tablet_manager.cc:1434] T f0fbdcbe46b34107bbbf63f69c98e244 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.117s	user 0.005s	sys 0.034s
I20260709 12:13:44.250795 30978 tablet_bootstrap.cc:492] T 76d4dde0196948ef92f68df770af02b0 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:44.253736 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b047acdc74424afc81c6380239209821" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:13:44.248437 30977 raft_consensus.cc:359] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:44.254885 30977 raft_consensus.cc:385] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.255666 30977 raft_consensus.cc:740] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.249616 30708 raft_consensus.cc:3060] T a6a5bd717fa048aabdd0879bcea0fd60 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.256927 30977 consensus_queue.cc:260] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:44.259218 30980 tablet_bootstrap.cc:492] T da25c47d7366434089b73f8af7ce453b P 8130e18710c04a61a5d8bd019c6ffdad: Bootstrap starting.
I20260709 12:13:44.260442 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b047acdc74424afc81c6380239209821" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:13:44.261513 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd65967534164e9c805fc3d5d05e0369" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:13:44.262086 30857 raft_consensus.cc:3060] T fd65967534164e9c805fc3d5d05e0369 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.262934 30977 ts_tablet_manager.cc:1434] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.002s
I20260709 12:13:44.264379 30977 tablet_bootstrap.cc:492] T a6a5bd717fa048aabdd0879bcea0fd60 P 15ad0880a63541ef965cb6acca4513d7: Bootstrap starting.
I20260709 12:13:44.265710 30980 tablet_bootstrap.cc:654] T da25c47d7366434089b73f8af7ce453b P 8130e18710c04a61a5d8bd019c6ffdad: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.267207 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fbdcbe46b34107bbbf63f69c98e244" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:13:44.267839 30858 raft_consensus.cc:3060] T f0fbdcbe46b34107bbbf63f69c98e244 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.268625 30978 tablet_bootstrap.cc:654] T 76d4dde0196948ef92f68df770af02b0 P 6c5665c17e904fc692bce76fc57b2460: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:44.272433 30896 leader_election.cc:343] T b047acdc74424afc81c6380239209821 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:44.273124 30977 tablet_bootstrap.cc:654] T a6a5bd717fa048aabdd0879bcea0fd60 P 15ad0880a63541ef965cb6acca4513d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.274272 30709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fbdcbe46b34107bbbf63f69c98e244" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
I20260709 12:13:44.244132 31042 leader_election.cc:290] T d5a270750666414887b6fae2f3793dc5 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:44.276463 30709 raft_consensus.cc:3060] T f0fbdcbe46b34107bbbf63f69c98e244 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.254752 30784 raft_consensus.cc:3060] T b047acdc74424afc81c6380239209821 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.282724 30986 raft_consensus.cc:493] T 21c0ba9bb1d64ab398c606450f72e966 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.255736 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a270750666414887b6fae2f3793dc5" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:44.283349 30986 raft_consensus.cc:515] T 21c0ba9bb1d64ab398c606450f72e966 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:44.285704 30986 leader_election.cc:290] T 21c0ba9bb1d64ab398c606450f72e966 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:44.287894 30707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c0ba9bb1d64ab398c606450f72e966" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
W20260709 12:13:44.289248 30822 leader_election.cc:343] T d5a270750666414887b6fae2f3793dc5 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:44.289249 30898 leader_election.cc:343] T 21c0ba9bb1d64ab398c606450f72e966 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:44.291712 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c0ba9bb1d64ab398c606450f72e966" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:44.294049 30978 tablet_bootstrap.cc:492] T 76d4dde0196948ef92f68df770af02b0 P 6c5665c17e904fc692bce76fc57b2460: No bootstrap required, opened a new log
I20260709 12:13:44.294624 30978 ts_tablet_manager.cc:1403] T 76d4dde0196948ef92f68df770af02b0 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.010s
W20260709 12:13:44.294929 30896 leader_election.cc:343] T 21c0ba9bb1d64ab398c606450f72e966 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:44.295547 30896 leader_election.cc:304] T 21c0ba9bb1d64ab398c606450f72e966 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7; no voters: 6c5665c17e904fc692bce76fc57b2460, 8130e18710c04a61a5d8bd019c6ffdad
I20260709 12:13:44.296981 30980 tablet_bootstrap.cc:492] T da25c47d7366434089b73f8af7ce453b P 8130e18710c04a61a5d8bd019c6ffdad: No bootstrap required, opened a new log
I20260709 12:13:44.297452 30980 ts_tablet_manager.cc:1403] T da25c47d7366434089b73f8af7ce453b P 8130e18710c04a61a5d8bd019c6ffdad: Time spent bootstrapping tablet: real 0.038s	user 0.005s	sys 0.009s
I20260709 12:13:44.299336 30987 consensus_queue.cc:1048] T eb58d3a8bd8540ff9871ea41021a5025 P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:44.300364 30980 raft_consensus.cc:359] T da25c47d7366434089b73f8af7ce453b P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:44.299342 30986 raft_consensus.cc:2749] T 21c0ba9bb1d64ab398c606450f72e966 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:44.301473 30980 raft_consensus.cc:385] T da25c47d7366434089b73f8af7ce453b P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.301779 30980 raft_consensus.cc:740] T da25c47d7366434089b73f8af7ce453b P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.302568 30980 consensus_queue.cc:260] T da25c47d7366434089b73f8af7ce453b P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:44.302772 30984 raft_consensus.cc:2804] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:44.305554 30980 ts_tablet_manager.cc:1434] T da25c47d7366434089b73f8af7ce453b P 8130e18710c04a61a5d8bd019c6ffdad: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:13:44.315665 30980 tablet_bootstrap.cc:492] T 21c0ba9bb1d64ab398c606450f72e966 P 8130e18710c04a61a5d8bd019c6ffdad: Bootstrap starting.
I20260709 12:13:44.310899 30784 raft_consensus.cc:2468] T b047acdc74424afc81c6380239209821 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 1.
I20260709 12:13:44.320904 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a5bd717fa048aabdd0879bcea0fd60" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
W20260709 12:13:44.323760 30823 leader_election.cc:343] T a6a5bd717fa048aabdd0879bcea0fd60 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:44.325033 30857 raft_consensus.cc:2468] T fd65967534164e9c805fc3d5d05e0369 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 1.
I20260709 12:13:44.324450 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a270750666414887b6fae2f3793dc5" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:44.326175 30980 tablet_bootstrap.cc:654] T 21c0ba9bb1d64ab398c606450f72e966 P 8130e18710c04a61a5d8bd019c6ffdad: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.325919 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a5bd717fa048aabdd0879bcea0fd60" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
W20260709 12:13:44.326671 30823 leader_election.cc:343] T d5a270750666414887b6fae2f3793dc5 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:44.327169 30823 leader_election.cc:304] T d5a270750666414887b6fae2f3793dc5 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad; no voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:44.326772 30984 raft_consensus.cc:697] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460 [term 1 LEADER]: Becoming Leader. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Running, Role: LEADER
I20260709 12:13:44.329917 31042 raft_consensus.cc:2749] T d5a270750666414887b6fae2f3793dc5 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:13:44.330430 30823 leader_election.cc:343] T a6a5bd717fa048aabdd0879bcea0fd60 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:44.322842 30708 raft_consensus.cc:2468] T a6a5bd717fa048aabdd0879bcea0fd60 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 1.
I20260709 12:13:44.326666 30896 leader_election.cc:304] T b047acdc74424afc81c6380239209821 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676; no voters: 8130e18710c04a61a5d8bd019c6ffdad
I20260709 12:13:44.332408 30986 raft_consensus.cc:2804] T b047acdc74424afc81c6380239209821 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:44.333014 30858 raft_consensus.cc:2468] T f0fbdcbe46b34107bbbf63f69c98e244 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 1.
I20260709 12:13:44.333074 30986 raft_consensus.cc:697] T b047acdc74424afc81c6380239209821 P 15ad0880a63541ef965cb6acca4513d7 [term 1 LEADER]: Becoming Leader. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Running, Role: LEADER
I20260709 12:13:44.330327 30984 consensus_queue.cc:237] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:44.335438 30748 leader_election.cc:304] T f0fbdcbe46b34107bbbf63f69c98e244 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:13:44.336625 30987 raft_consensus.cc:2804] T f0fbdcbe46b34107bbbf63f69c98e244 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:44.335659 30986 consensus_queue.cc:237] T b047acdc74424afc81c6380239209821 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:44.336823 30981 tablet_bootstrap.cc:492] T 615eb2fb16414287bc0956a27523b7f4 P 84b98f9236604dd0b22ae23c5378a676: No bootstrap required, opened a new log
I20260709 12:13:44.337248 30987 raft_consensus.cc:697] T f0fbdcbe46b34107bbbf63f69c98e244 P 84b98f9236604dd0b22ae23c5378a676 [term 1 LEADER]: Becoming Leader. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Running, Role: LEADER
I20260709 12:13:44.337584 30981 ts_tablet_manager.cc:1403] T 615eb2fb16414287bc0956a27523b7f4 P 84b98f9236604dd0b22ae23c5378a676: Time spent bootstrapping tablet: real 0.264s	user 0.034s	sys 0.145s
I20260709 12:13:44.338181 30987 consensus_queue.cc:237] T f0fbdcbe46b34107bbbf63f69c98e244 P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:44.341511 30981 raft_consensus.cc:359] T 615eb2fb16414287bc0956a27523b7f4 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:44.342299 30981 raft_consensus.cc:385] T 615eb2fb16414287bc0956a27523b7f4 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.342618 30981 raft_consensus.cc:740] T 615eb2fb16414287bc0956a27523b7f4 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.313261 30978 raft_consensus.cc:359] T 76d4dde0196948ef92f68df770af02b0 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:44.344909 30978 raft_consensus.cc:385] T 76d4dde0196948ef92f68df770af02b0 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.346858 30978 raft_consensus.cc:740] T 76d4dde0196948ef92f68df770af02b0 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.344010 30981 consensus_queue.cc:260] T 615eb2fb16414287bc0956a27523b7f4 P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:44.388020 30977 tablet_bootstrap.cc:492] T a6a5bd717fa048aabdd0879bcea0fd60 P 15ad0880a63541ef965cb6acca4513d7: No bootstrap required, opened a new log
I20260709 12:13:44.389439 30977 ts_tablet_manager.cc:1403] T a6a5bd717fa048aabdd0879bcea0fd60 P 15ad0880a63541ef965cb6acca4513d7: Time spent bootstrapping tablet: real 0.125s	user 0.034s	sys 0.034s
I20260709 12:13:44.347879 30978 consensus_queue.cc:260] T 76d4dde0196948ef92f68df770af02b0 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:44.393242 30824 leader_election.cc:304] T a6a5bd717fa048aabdd0879bcea0fd60 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 15ad0880a63541ef965cb6acca4513d7
I20260709 12:13:44.396889 30978 ts_tablet_manager.cc:1434] T 76d4dde0196948ef92f68df770af02b0 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.102s	user 0.013s	sys 0.000s
I20260709 12:13:44.396481 30977 raft_consensus.cc:359] T a6a5bd717fa048aabdd0879bcea0fd60 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:44.397509 30977 raft_consensus.cc:385] T a6a5bd717fa048aabdd0879bcea0fd60 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.397878 30977 raft_consensus.cc:740] T a6a5bd717fa048aabdd0879bcea0fd60 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.399303 30978 tablet_bootstrap.cc:492] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:44.399009 30977 consensus_queue.cc:260] T a6a5bd717fa048aabdd0879bcea0fd60 P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:44.403271 30977 ts_tablet_manager.cc:1434] T a6a5bd717fa048aabdd0879bcea0fd60 P 15ad0880a63541ef965cb6acca4513d7: Time spent starting tablet: real 0.013s	user 0.012s	sys 0.003s
I20260709 12:13:44.405151 30977 tablet_bootstrap.cc:492] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 15ad0880a63541ef965cb6acca4513d7: Bootstrap starting.
I20260709 12:13:44.419847 31023 raft_consensus.cc:493] T a6a5bd717fa048aabdd0879bcea0fd60 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.420740 31023 raft_consensus.cc:515] T a6a5bd717fa048aabdd0879bcea0fd60 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
W20260709 12:13:44.422008 30654 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:44.443367 30986 raft_consensus.cc:493] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.444392 30986 raft_consensus.cc:515] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:44.450110 30980 tablet_bootstrap.cc:492] T 21c0ba9bb1d64ab398c606450f72e966 P 8130e18710c04a61a5d8bd019c6ffdad: No bootstrap required, opened a new log
I20260709 12:13:44.449880 31041 raft_consensus.cc:493] T da25c47d7366434089b73f8af7ce453b P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.450896 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b66a7b6f8aa4803b482e392cc945db7" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:44.451169 31041 raft_consensus.cc:515] T da25c47d7366434089b73f8af7ce453b P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:44.451200 30980 ts_tablet_manager.cc:1403] T 21c0ba9bb1d64ab398c606450f72e966 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent bootstrapping tablet: real 0.145s	user 0.007s	sys 0.019s
I20260709 12:13:44.452107 30858 raft_consensus.cc:2468] T 8b66a7b6f8aa4803b482e392cc945db7 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 0.
I20260709 12:13:44.453441 31042 raft_consensus.cc:2804] T a6a5bd717fa048aabdd0879bcea0fd60 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:44.454516 31042 raft_consensus.cc:697] T a6a5bd717fa048aabdd0879bcea0fd60 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 LEADER]: Becoming Leader. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Running, Role: LEADER
I20260709 12:13:44.456856 31042 consensus_queue.cc:237] T a6a5bd717fa048aabdd0879bcea0fd60 P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:44.457872 30707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b66a7b6f8aa4803b482e392cc945db7" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:44.458820 30707 raft_consensus.cc:2468] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 0.
W20260709 12:13:44.459568 30824 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:40909, user_credentials={real_user=slave}} blocked reactor thread for 66867.7us
I20260709 12:13:44.464138 30898 leader_election.cc:304] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 6c5665c17e904fc692bce76fc57b2460; no voters: 
I20260709 12:13:44.465385 30986 leader_election.cc:290] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:44.467025 31023 leader_election.cc:290] T a6a5bd717fa048aabdd0879bcea0fd60 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:44.470055 30980 raft_consensus.cc:359] T 21c0ba9bb1d64ab398c606450f72e966 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:44.473474 31041 leader_election.cc:290] T da25c47d7366434089b73f8af7ce453b P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:44.473906 30980 raft_consensus.cc:385] T 21c0ba9bb1d64ab398c606450f72e966 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.475167 30980 raft_consensus.cc:740] T 21c0ba9bb1d64ab398c606450f72e966 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.479177 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da25c47d7366434089b73f8af7ce453b" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:44.480118 30932 raft_consensus.cc:2468] T da25c47d7366434089b73f8af7ce453b P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 0.
I20260709 12:13:44.480134 30981 ts_tablet_manager.cc:1434] T 615eb2fb16414287bc0956a27523b7f4 P 84b98f9236604dd0b22ae23c5378a676: Time spent starting tablet: real 0.142s	user 0.010s	sys 0.000s
I20260709 12:13:44.480264 31041 raft_consensus.cc:493] T eb58d3a8bd8540ff9871ea41021a5025 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.484100 30981 tablet_bootstrap.cc:492] T d5a270750666414887b6fae2f3793dc5 P 84b98f9236604dd0b22ae23c5378a676: Bootstrap starting.
I20260709 12:13:44.483565 30987 raft_consensus.cc:493] T 615eb2fb16414287bc0956a27523b7f4 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.485742 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a5bd717fa048aabdd0879bcea0fd60" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:44.485903 30823 leader_election.cc:304] T da25c47d7366434089b73f8af7ce453b P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 
I20260709 12:13:44.488270 30989 raft_consensus.cc:2804] T da25c47d7366434089b73f8af7ce453b P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:44.488699 30989 raft_consensus.cc:493] T da25c47d7366434089b73f8af7ce453b P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.489063 30989 raft_consensus.cc:3060] T da25c47d7366434089b73f8af7ce453b P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.489630 31023 raft_consensus.cc:2804] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:44.505960 31023 raft_consensus.cc:493] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.506505 31023 raft_consensus.cc:3060] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.509595 30709 raft_consensus.cc:2468] T f0fbdcbe46b34107bbbf63f69c98e244 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 1.
I20260709 12:13:44.479715 30980 consensus_queue.cc:260] T 21c0ba9bb1d64ab398c606450f72e966 P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:44.497390 30607 catalog_manager.cc:5697] T f0fbdcbe46b34107bbbf63f69c98e244 P 84b98f9236604dd0b22ae23c5378a676 reported cstate change: term changed from 0 to 1, leader changed from <none> to 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "84b98f9236604dd0b22ae23c5378a676" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:44.527518 31041 raft_consensus.cc:515] T eb58d3a8bd8540ff9871ea41021a5025 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:44.532102 30978 tablet_bootstrap.cc:654] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.531967 30707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb58d3a8bd8540ff9871ea41021a5025" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:44.535511 31049 raft_consensus.cc:493] T 615eb2fb16414287bc0956a27523b7f4 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.536284 31049 raft_consensus.cc:515] T 615eb2fb16414287bc0956a27523b7f4 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:44.537856 30858 raft_consensus.cc:3060] T eb58d3a8bd8540ff9871ea41021a5025 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:44.522758 30898 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:40909, user_credentials={real_user=slave}} blocked reactor thread for 58925.7us
I20260709 12:13:44.550398 30977 tablet_bootstrap.cc:654] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 15ad0880a63541ef965cb6acca4513d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.476692 30605 catalog_manager.cc:5697] T b047acdc74424afc81c6380239209821 P 15ad0880a63541ef965cb6acca4513d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132). New cstate: current_term: 1 leader_uuid: "15ad0880a63541ef965cb6acca4513d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:44.551906 31049 leader_election.cc:290] T 615eb2fb16414287bc0956a27523b7f4 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:44.525394 30987 raft_consensus.cc:515] T 615eb2fb16414287bc0956a27523b7f4 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:44.561142 31049 raft_consensus.cc:493] T 76d4dde0196948ef92f68df770af02b0 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.561604 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "615eb2fb16414287bc0956a27523b7f4" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:44.561651 31049 raft_consensus.cc:515] T 76d4dde0196948ef92f68df770af02b0 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:44.562533 30857 raft_consensus.cc:2468] T 615eb2fb16414287bc0956a27523b7f4 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 0.
I20260709 12:13:44.564182 30673 leader_election.cc:304] T 615eb2fb16414287bc0956a27523b7f4 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 
I20260709 12:13:44.565619 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d4dde0196948ef92f68df770af02b0" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:44.566551 30932 raft_consensus.cc:2468] T 76d4dde0196948ef92f68df770af02b0 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 0.
I20260709 12:13:44.565779 31038 raft_consensus.cc:2804] T 615eb2fb16414287bc0956a27523b7f4 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:44.568101 30709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a5bd717fa048aabdd0879bcea0fd60" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:44.568413 31038 raft_consensus.cc:493] T 615eb2fb16414287bc0956a27523b7f4 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.568629 31041 leader_election.cc:290] T eb58d3a8bd8540ff9871ea41021a5025 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:44.568885 31038 raft_consensus.cc:3060] T 615eb2fb16414287bc0956a27523b7f4 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.569180 30709 raft_consensus.cc:2393] T a6a5bd717fa048aabdd0879bcea0fd60 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 15ad0880a63541ef965cb6acca4513d7 in current term 1: Already voted for candidate 8130e18710c04a61a5d8bd019c6ffdad in this term.
I20260709 12:13:44.569540 30987 leader_election.cc:290] T 615eb2fb16414287bc0956a27523b7f4 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:44.570417 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "615eb2fb16414287bc0956a27523b7f4" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:44.571038 30857 raft_consensus.cc:2468] T 615eb2fb16414287bc0956a27523b7f4 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 0.
I20260709 12:13:44.572656 30748 leader_election.cc:304] T 615eb2fb16414287bc0956a27523b7f4 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:13:44.573246 30674 leader_election.cc:304] T 76d4dde0196948ef92f68df770af02b0 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 6c5665c17e904fc692bce76fc57b2460; no voters: 
I20260709 12:13:44.574234 30987 raft_consensus.cc:2804] T 615eb2fb16414287bc0956a27523b7f4 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:44.574744 30987 raft_consensus.cc:493] T 615eb2fb16414287bc0956a27523b7f4 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.575186 30987 raft_consensus.cc:3060] T 615eb2fb16414287bc0956a27523b7f4 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.576116 30984 raft_consensus.cc:2804] T 76d4dde0196948ef92f68df770af02b0 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:44.576579 30984 raft_consensus.cc:493] T 76d4dde0196948ef92f68df770af02b0 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.576907 30984 raft_consensus.cc:3060] T 76d4dde0196948ef92f68df770af02b0 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.579138 31041 raft_consensus.cc:493] T 21c0ba9bb1d64ab398c606450f72e966 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.579885 30898 leader_election.cc:304] T a6a5bd717fa048aabdd0879bcea0fd60 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7; no voters: 6c5665c17e904fc692bce76fc57b2460, 8130e18710c04a61a5d8bd019c6ffdad
I20260709 12:13:44.580771 30986 raft_consensus.cc:3060] T a6a5bd717fa048aabdd0879bcea0fd60 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.581418 31049 leader_election.cc:290] T 76d4dde0196948ef92f68df770af02b0 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:44.579674 31041 raft_consensus.cc:515] T 21c0ba9bb1d64ab398c606450f72e966 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
W20260709 12:13:44.567924 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:40909, user_credentials={real_user=slave}} blocked reactor thread for 121002us
I20260709 12:13:44.592305 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c0ba9bb1d64ab398c606450f72e966" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:44.597743 30932 raft_consensus.cc:2468] T 21c0ba9bb1d64ab398c606450f72e966 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 0.
I20260709 12:13:44.599730 30823 leader_election.cc:304] T 21c0ba9bb1d64ab398c606450f72e966 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 
I20260709 12:13:44.600705 31042 raft_consensus.cc:2804] T 21c0ba9bb1d64ab398c606450f72e966 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:44.601233 31042 raft_consensus.cc:493] T 21c0ba9bb1d64ab398c606450f72e966 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.601632 31042 raft_consensus.cc:3060] T 21c0ba9bb1d64ab398c606450f72e966 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.610309 30986 raft_consensus.cc:2749] T a6a5bd717fa048aabdd0879bcea0fd60 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:44.613543 31023 raft_consensus.cc:515] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:44.616223 30981 tablet_bootstrap.cc:654] T d5a270750666414887b6fae2f3793dc5 P 84b98f9236604dd0b22ae23c5378a676: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:44.581446 30898 consensus_peers.cc:597] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:44.621774 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "615eb2fb16414287bc0956a27523b7f4" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:44.621887 30989 raft_consensus.cc:515] T da25c47d7366434089b73f8af7ce453b P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
W20260709 12:13:44.626242 30898 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:40909, user_credentials={real_user=slave}} blocked reactor thread for 45022.5us
I20260709 12:13:44.626325 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b66a7b6f8aa4803b482e392cc945db7" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
W20260709 12:13:44.620491 30674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:43035, user_credentials={real_user=slave}} blocked reactor thread for 47445.2us
I20260709 12:13:44.628360 30709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b66a7b6f8aa4803b482e392cc945db7" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
I20260709 12:13:44.629001 30709 raft_consensus.cc:3060] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.627846 30605 catalog_manager.cc:5697] T a6a5bd717fa048aabdd0879bcea0fd60 P 8130e18710c04a61a5d8bd019c6ffdad reported cstate change: term changed from 0 to 1, leader changed from <none> to 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131). New cstate: current_term: 1 leader_uuid: "8130e18710c04a61a5d8bd019c6ffdad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:44.630054 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da25c47d7366434089b73f8af7ce453b" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
I20260709 12:13:44.630640 30932 raft_consensus.cc:3060] T da25c47d7366434089b73f8af7ce453b P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.636536 31056 consensus_queue.cc:1048] T eb58d3a8bd8540ff9871ea41021a5025 P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:44.637522 31038 raft_consensus.cc:515] T 615eb2fb16414287bc0956a27523b7f4 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:44.637990 30709 raft_consensus.cc:2468] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 1.
I20260709 12:13:44.623540 31041 leader_election.cc:290] T 21c0ba9bb1d64ab398c606450f72e966 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:44.624564 30980 ts_tablet_manager.cc:1434] T 21c0ba9bb1d64ab398c606450f72e966 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent starting tablet: real 0.171s	user 0.014s	sys 0.008s
I20260709 12:13:44.624790 30707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c0ba9bb1d64ab398c606450f72e966" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:44.625674 31023 leader_election.cc:290] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Requested vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:44.627169 30857 raft_consensus.cc:3060] T 8b66a7b6f8aa4803b482e392cc945db7 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.640239 30989 leader_election.cc:290] T da25c47d7366434089b73f8af7ce453b P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 election: Requested vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:44.652923 30980 tablet_bootstrap.cc:492] T b047acdc74424afc81c6380239209821 P 8130e18710c04a61a5d8bd019c6ffdad: Bootstrap starting.
W20260709 12:13:44.653945 30824 leader_election.cc:343] T 21c0ba9bb1d64ab398c606450f72e966 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:44.654502 30977 tablet_bootstrap.cc:492] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 15ad0880a63541ef965cb6acca4513d7: No bootstrap required, opened a new log
I20260709 12:13:44.655032 30977 ts_tablet_manager.cc:1403] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 15ad0880a63541ef965cb6acca4513d7: Time spent bootstrapping tablet: real 0.250s	user 0.021s	sys 0.017s
I20260709 12:13:44.658161 30977 raft_consensus.cc:359] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:44.659641 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d4dde0196948ef92f68df770af02b0" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:44.660533 30987 raft_consensus.cc:515] T 615eb2fb16414287bc0956a27523b7f4 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:44.644544 30898 leader_election.cc:304] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 6c5665c17e904fc692bce76fc57b2460; no voters: 
I20260709 12:13:44.662025 31023 raft_consensus.cc:2804] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:44.662837 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da25c47d7366434089b73f8af7ce453b" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:44.663300 31023 raft_consensus.cc:697] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7 [term 1 LEADER]: Becoming Leader. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Running, Role: LEADER
I20260709 12:13:44.649317 30932 raft_consensus.cc:2468] T da25c47d7366434089b73f8af7ce453b P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 1.
I20260709 12:13:44.664449 31023 consensus_queue.cc:237] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:44.665696 30823 leader_election.cc:304] T da25c47d7366434089b73f8af7ce453b P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 
I20260709 12:13:44.665730 30784 raft_consensus.cc:2393] T 615eb2fb16414287bc0956a27523b7f4 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c5665c17e904fc692bce76fc57b2460 in current term 1: Already voted for candidate 84b98f9236604dd0b22ae23c5378a676 in this term.
I20260709 12:13:44.658795 30977 raft_consensus.cc:385] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.667766 30977 raft_consensus.cc:740] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.668486 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb58d3a8bd8540ff9871ea41021a5025" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:44.668603 30977 consensus_queue.cc:260] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:44.669457 30989 raft_consensus.cc:2804] T da25c47d7366434089b73f8af7ce453b P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:44.669679 30987 leader_election.cc:290] T 615eb2fb16414287bc0956a27523b7f4 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 election: Requested vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:44.670038 30989 raft_consensus.cc:697] T da25c47d7366434089b73f8af7ce453b P 8130e18710c04a61a5d8bd019c6ffdad [term 1 LEADER]: Becoming Leader. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Running, Role: LEADER
I20260709 12:13:44.670521 30980 tablet_bootstrap.cc:654] T b047acdc74424afc81c6380239209821 P 8130e18710c04a61a5d8bd019c6ffdad: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.648137 30607 catalog_manager.cc:5697] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129). New cstate: current_term: 1 leader_uuid: "6c5665c17e904fc692bce76fc57b2460" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:44.664352 30978 tablet_bootstrap.cc:492] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460: No bootstrap required, opened a new log
I20260709 12:13:44.671711 30978 ts_tablet_manager.cc:1403] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.273s	user 0.012s	sys 0.036s
I20260709 12:13:44.676683 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "615eb2fb16414287bc0956a27523b7f4" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:13:44.678510 30855 raft_consensus.cc:3060] T 615eb2fb16414287bc0956a27523b7f4 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.679317 30709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "615eb2fb16414287bc0956a27523b7f4" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:44.680253 30709 raft_consensus.cc:2393] T 615eb2fb16414287bc0956a27523b7f4 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 84b98f9236604dd0b22ae23c5378a676 in current term 1: Already voted for candidate 6c5665c17e904fc692bce76fc57b2460 in this term.
I20260709 12:13:44.677901 31038 leader_election.cc:290] T 615eb2fb16414287bc0956a27523b7f4 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 election: Requested vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
W20260709 12:13:44.694936 30673 leader_election.cc:343] T 76d4dde0196948ef92f68df770af02b0 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:44.695281 30822 leader_election.cc:343] T da25c47d7366434089b73f8af7ce453b P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:44.695075 30986 consensus_queue.cc:1048] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:44.696442 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da25c47d7366434089b73f8af7ce453b" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:13:44.696364 30989 consensus_queue.cc:237] T da25c47d7366434089b73f8af7ce453b P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:44.698164 30822 leader_election.cc:304] T eb58d3a8bd8540ff9871ea41021a5025 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad; no voters: 6c5665c17e904fc692bce76fc57b2460, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:44.698509 30857 raft_consensus.cc:2468] T 8b66a7b6f8aa4803b482e392cc945db7 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 1.
I20260709 12:13:44.699046 31041 raft_consensus.cc:2749] T eb58d3a8bd8540ff9871ea41021a5025 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:44.700305 30977 ts_tablet_manager.cc:1434] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 15ad0880a63541ef965cb6acca4513d7: Time spent starting tablet: real 0.045s	user 0.004s	sys 0.002s
I20260709 12:13:44.692718 31042 raft_consensus.cc:515] T 21c0ba9bb1d64ab398c606450f72e966 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:44.701526 30977 tablet_bootstrap.cc:492] T 2ff9e0d905854cceb79f96f500a07339 P 15ad0880a63541ef965cb6acca4513d7: Bootstrap starting.
I20260709 12:13:44.702112 30855 raft_consensus.cc:2468] T 615eb2fb16414287bc0956a27523b7f4 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 1.
I20260709 12:13:44.703284 31042 leader_election.cc:290] T 21c0ba9bb1d64ab398c606450f72e966 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 election: Requested vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:44.691391 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "615eb2fb16414287bc0956a27523b7f4" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:13:44.704396 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c0ba9bb1d64ab398c606450f72e966" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
I20260709 12:13:44.704931 30932 raft_consensus.cc:3060] T 21c0ba9bb1d64ab398c606450f72e966 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.705065 30858 raft_consensus.cc:2393] T 615eb2fb16414287bc0956a27523b7f4 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 84b98f9236604dd0b22ae23c5378a676 in current term 1: Already voted for candidate 6c5665c17e904fc692bce76fc57b2460 in this term.
W20260709 12:13:44.704035 30822 leader_election.cc:343] T da25c47d7366434089b73f8af7ce453b P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:44.706964 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "615eb2fb16414287bc0956a27523b7f4" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:13:44.709169 30707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c0ba9bb1d64ab398c606450f72e966" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
I20260709 12:13:44.709477 30783 raft_consensus.cc:2393] T 615eb2fb16414287bc0956a27523b7f4 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c5665c17e904fc692bce76fc57b2460 in current term 1: Already voted for candidate 84b98f9236604dd0b22ae23c5378a676 in this term.
I20260709 12:13:44.710225 30673 leader_election.cc:304] T 615eb2fb16414287bc0956a27523b7f4 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 
W20260709 12:13:44.710621 30824 leader_election.cc:343] T 21c0ba9bb1d64ab398c606450f72e966 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:44.713899 30709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "615eb2fb16414287bc0956a27523b7f4" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
I20260709 12:13:44.716295 30709 raft_consensus.cc:2393] T 615eb2fb16414287bc0956a27523b7f4 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 84b98f9236604dd0b22ae23c5378a676 in current term 1: Already voted for candidate 6c5665c17e904fc692bce76fc57b2460 in this term.
I20260709 12:13:44.716694 30981 tablet_bootstrap.cc:492] T d5a270750666414887b6fae2f3793dc5 P 84b98f9236604dd0b22ae23c5378a676: No bootstrap required, opened a new log
I20260709 12:13:44.717304 30981 ts_tablet_manager.cc:1403] T d5a270750666414887b6fae2f3793dc5 P 84b98f9236604dd0b22ae23c5378a676: Time spent bootstrapping tablet: real 0.234s	user 0.010s	sys 0.011s
I20260709 12:13:44.717432 31064 raft_consensus.cc:2804] T 615eb2fb16414287bc0956a27523b7f4 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:44.723590 30977 tablet_bootstrap.cc:654] T 2ff9e0d905854cceb79f96f500a07339 P 15ad0880a63541ef965cb6acca4513d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.724730 31064 raft_consensus.cc:697] T 615eb2fb16414287bc0956a27523b7f4 P 6c5665c17e904fc692bce76fc57b2460 [term 1 LEADER]: Becoming Leader. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Running, Role: LEADER
I20260709 12:13:44.725916 31064 consensus_queue.cc:237] T 615eb2fb16414287bc0956a27523b7f4 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:44.727684 30984 raft_consensus.cc:515] T 76d4dde0196948ef92f68df770af02b0 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:44.735700 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d4dde0196948ef92f68df770af02b0" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
I20260709 12:13:44.736018 30750 leader_election.cc:304] T 615eb2fb16414287bc0956a27523b7f4 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 84b98f9236604dd0b22ae23c5378a676; no voters: 6c5665c17e904fc692bce76fc57b2460, 8130e18710c04a61a5d8bd019c6ffdad
I20260709 12:13:44.736476 30931 raft_consensus.cc:3060] T 76d4dde0196948ef92f68df770af02b0 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.735620 30981 raft_consensus.cc:359] T d5a270750666414887b6fae2f3793dc5 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:44.737031 30981 raft_consensus.cc:385] T d5a270750666414887b6fae2f3793dc5 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.736902 30987 raft_consensus.cc:2749] T 615eb2fb16414287bc0956a27523b7f4 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:44.738068 30981 raft_consensus.cc:740] T d5a270750666414887b6fae2f3793dc5 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.739120 30981 consensus_queue.cc:260] T d5a270750666414887b6fae2f3793dc5 P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:44.738972 30932 raft_consensus.cc:2468] T 21c0ba9bb1d64ab398c606450f72e966 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 1.
I20260709 12:13:44.741951 30823 leader_election.cc:304] T 21c0ba9bb1d64ab398c606450f72e966 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:44.742933 30978 raft_consensus.cc:359] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:44.743918 30978 raft_consensus.cc:385] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.744241 30978 raft_consensus.cc:740] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.745666 30981 ts_tablet_manager.cc:1434] T d5a270750666414887b6fae2f3793dc5 P 84b98f9236604dd0b22ae23c5378a676: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.002s
I20260709 12:13:44.745213 30978 consensus_queue.cc:260] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:44.734493 30984 leader_election.cc:290] T 76d4dde0196948ef92f68df770af02b0 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 election: Requested vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:44.750277 31042 raft_consensus.cc:2804] T 21c0ba9bb1d64ab398c606450f72e966 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:44.758277 30978 ts_tablet_manager.cc:1434] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.085s	user 0.007s	sys 0.001s
I20260709 12:13:44.760263 30978 tablet_bootstrap.cc:492] T 2ff9e0d905854cceb79f96f500a07339 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:44.763156 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d4dde0196948ef92f68df770af02b0" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:13:44.768455 30981 tablet_bootstrap.cc:492] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 84b98f9236604dd0b22ae23c5378a676: Bootstrap starting.
I20260709 12:13:44.769050 30978 tablet_bootstrap.cc:654] T 2ff9e0d905854cceb79f96f500a07339 P 6c5665c17e904fc692bce76fc57b2460: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.771727 31042 raft_consensus.cc:697] T 21c0ba9bb1d64ab398c606450f72e966 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 LEADER]: Becoming Leader. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Running, Role: LEADER
I20260709 12:13:44.773003 30980 tablet_bootstrap.cc:492] T b047acdc74424afc81c6380239209821 P 8130e18710c04a61a5d8bd019c6ffdad: No bootstrap required, opened a new log
I20260709 12:13:44.772667 31042 consensus_queue.cc:237] T 21c0ba9bb1d64ab398c606450f72e966 P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:44.773489 30980 ts_tablet_manager.cc:1403] T b047acdc74424afc81c6380239209821 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent bootstrapping tablet: real 0.121s	user 0.018s	sys 0.003s
W20260709 12:13:44.776443 30673 leader_election.cc:343] T 76d4dde0196948ef92f68df770af02b0 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:44.778575 30931 raft_consensus.cc:2468] T 76d4dde0196948ef92f68df770af02b0 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 1.
I20260709 12:13:44.779844 31023 consensus_queue.cc:1048] T b047acdc74424afc81c6380239209821 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:44.781049 30606 catalog_manager.cc:5697] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132). New cstate: current_term: 1 leader_uuid: "15ad0880a63541ef965cb6acca4513d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:44.783363 30980 raft_consensus.cc:359] T b047acdc74424afc81c6380239209821 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:44.783638 30977 tablet_bootstrap.cc:492] T 2ff9e0d905854cceb79f96f500a07339 P 15ad0880a63541ef965cb6acca4513d7: No bootstrap required, opened a new log
I20260709 12:13:44.788652 30980 raft_consensus.cc:385] T b047acdc74424afc81c6380239209821 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.788985 30980 raft_consensus.cc:740] T b047acdc74424afc81c6380239209821 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.789039 30977 ts_tablet_manager.cc:1403] T 2ff9e0d905854cceb79f96f500a07339 P 15ad0880a63541ef965cb6acca4513d7: Time spent bootstrapping tablet: real 0.088s	user 0.013s	sys 0.002s
I20260709 12:13:44.789749 30980 consensus_queue.cc:260] T b047acdc74424afc81c6380239209821 P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:44.793279 30977 raft_consensus.cc:359] T 2ff9e0d905854cceb79f96f500a07339 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:44.794499 30977 raft_consensus.cc:385] T 2ff9e0d905854cceb79f96f500a07339 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.795308 30977 raft_consensus.cc:740] T 2ff9e0d905854cceb79f96f500a07339 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.796618 30977 consensus_queue.cc:260] T 2ff9e0d905854cceb79f96f500a07339 P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:44.796937 30674 leader_election.cc:304] T 76d4dde0196948ef92f68df770af02b0 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 6c5665c17e904fc692bce76fc57b2460; no voters: 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:44.799575 30984 raft_consensus.cc:2804] T 76d4dde0196948ef92f68df770af02b0 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:44.800022 30984 raft_consensus.cc:697] T 76d4dde0196948ef92f68df770af02b0 P 6c5665c17e904fc692bce76fc57b2460 [term 1 LEADER]: Becoming Leader. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Running, Role: LEADER
I20260709 12:13:44.800833 30984 consensus_queue.cc:237] T 76d4dde0196948ef92f68df770af02b0 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:44.807641 30980 ts_tablet_manager.cc:1434] T b047acdc74424afc81c6380239209821 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 12:13:44.808949 30980 tablet_bootstrap.cc:492] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 8130e18710c04a61a5d8bd019c6ffdad: Bootstrap starting.
I20260709 12:13:44.816087 30989 raft_consensus.cc:493] T b047acdc74424afc81c6380239209821 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.816588 30989 raft_consensus.cc:515] T b047acdc74424afc81c6380239209821 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:44.817418 30977 ts_tablet_manager.cc:1434] T 2ff9e0d905854cceb79f96f500a07339 P 15ad0880a63541ef965cb6acca4513d7: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 12:13:44.819967 30981 tablet_bootstrap.cc:654] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 84b98f9236604dd0b22ae23c5378a676: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.818746 30989 leader_election.cc:290] T b047acdc74424afc81c6380239209821 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:44.820807 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b047acdc74424afc81c6380239209821" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:44.836622 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b047acdc74424afc81c6380239209821" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:44.837471 30977 tablet_bootstrap.cc:492] T d5a270750666414887b6fae2f3793dc5 P 15ad0880a63541ef965cb6acca4513d7: Bootstrap starting.
I20260709 12:13:44.838485 30823 leader_election.cc:304] T b047acdc74424afc81c6380239209821 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad; no voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:44.838100 30605 catalog_manager.cc:5697] T 21c0ba9bb1d64ab398c606450f72e966 P 8130e18710c04a61a5d8bd019c6ffdad reported cstate change: term changed from 0 to 1, leader changed from <none> to 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131). New cstate: current_term: 1 leader_uuid: "8130e18710c04a61a5d8bd019c6ffdad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:44.840112 30605 catalog_manager.cc:5697] T da25c47d7366434089b73f8af7ce453b P 8130e18710c04a61a5d8bd019c6ffdad reported cstate change: term changed from 0 to 1, leader changed from <none> to 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131). New cstate: current_term: 1 leader_uuid: "8130e18710c04a61a5d8bd019c6ffdad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:44.843464 30980 tablet_bootstrap.cc:654] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 8130e18710c04a61a5d8bd019c6ffdad: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.843550 31042 raft_consensus.cc:2749] T b047acdc74424afc81c6380239209821 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:44.845649 30978 tablet_bootstrap.cc:492] T 2ff9e0d905854cceb79f96f500a07339 P 6c5665c17e904fc692bce76fc57b2460: No bootstrap required, opened a new log
I20260709 12:13:44.846143 30978 ts_tablet_manager.cc:1403] T 2ff9e0d905854cceb79f96f500a07339 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.087s	user 0.019s	sys 0.012s
I20260709 12:13:44.848127 30977 tablet_bootstrap.cc:654] T d5a270750666414887b6fae2f3793dc5 P 15ad0880a63541ef965cb6acca4513d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.849040 30978 raft_consensus.cc:359] T 2ff9e0d905854cceb79f96f500a07339 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:44.849809 30978 raft_consensus.cc:385] T 2ff9e0d905854cceb79f96f500a07339 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.850080 30978 raft_consensus.cc:740] T 2ff9e0d905854cceb79f96f500a07339 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.850777 30978 consensus_queue.cc:260] T 2ff9e0d905854cceb79f96f500a07339 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:44.851859 30858 raft_consensus.cc:3060] T b047acdc74424afc81c6380239209821 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.854627 30978 ts_tablet_manager.cc:1434] T 2ff9e0d905854cceb79f96f500a07339 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:13:44.856279 30978 tablet_bootstrap.cc:492] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:44.864223 31064 consensus_queue.cc:1048] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:44.878356 30981 tablet_bootstrap.cc:492] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 84b98f9236604dd0b22ae23c5378a676: No bootstrap required, opened a new log
I20260709 12:13:44.878996 30981 ts_tablet_manager.cc:1403] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 84b98f9236604dd0b22ae23c5378a676: Time spent bootstrapping tablet: real 0.111s	user 0.008s	sys 0.009s
I20260709 12:13:44.881909 30981 raft_consensus.cc:359] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:44.882629 30981 raft_consensus.cc:385] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.882953 30981 raft_consensus.cc:740] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.896222 30606 catalog_manager.cc:5697] T 615eb2fb16414287bc0956a27523b7f4 P 6c5665c17e904fc692bce76fc57b2460 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129). New cstate: current_term: 1 leader_uuid: "6c5665c17e904fc692bce76fc57b2460" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:44.896950 30981 consensus_queue.cc:260] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:44.902614 30981 ts_tablet_manager.cc:1434] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 84b98f9236604dd0b22ae23c5378a676: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.003s
I20260709 12:13:44.903824 30981 tablet_bootstrap.cc:492] T 76d4dde0196948ef92f68df770af02b0 P 84b98f9236604dd0b22ae23c5378a676: Bootstrap starting.
I20260709 12:13:44.910245 30978 tablet_bootstrap.cc:654] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 6c5665c17e904fc692bce76fc57b2460: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.918490 30980 tablet_bootstrap.cc:492] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 8130e18710c04a61a5d8bd019c6ffdad: No bootstrap required, opened a new log
I20260709 12:13:44.919016 30980 ts_tablet_manager.cc:1403] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent bootstrapping tablet: real 0.110s	user 0.007s	sys 0.002s
I20260709 12:13:44.922439 30980 raft_consensus.cc:359] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:44.924067 30980 raft_consensus.cc:385] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.923894 31059 consensus_queue.cc:1048] T b047acdc74424afc81c6380239209821 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:44.924358 30980 raft_consensus.cc:740] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.925081 30980 consensus_queue.cc:260] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:44.921953 31038 consensus_queue.cc:1048] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:13:44.930496 30987 consensus_queue.cc:1048] T f0fbdcbe46b34107bbbf63f69c98e244 P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:44.935125 30980 ts_tablet_manager.cc:1434] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:13:44.936631 30980 tablet_bootstrap.cc:492] T 0203e5cc33ca470eb9c1f366291c344d P 8130e18710c04a61a5d8bd019c6ffdad: Bootstrap starting.
I20260709 12:13:44.946131 30978 tablet_bootstrap.cc:492] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 6c5665c17e904fc692bce76fc57b2460: No bootstrap required, opened a new log
I20260709 12:13:44.946733 30978 ts_tablet_manager.cc:1403] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.091s	user 0.014s	sys 0.018s
I20260709 12:13:44.947566 30977 tablet_bootstrap.cc:492] T d5a270750666414887b6fae2f3793dc5 P 15ad0880a63541ef965cb6acca4513d7: No bootstrap required, opened a new log
I20260709 12:13:44.948258 30977 ts_tablet_manager.cc:1403] T d5a270750666414887b6fae2f3793dc5 P 15ad0880a63541ef965cb6acca4513d7: Time spent bootstrapping tablet: real 0.111s	user 0.047s	sys 0.030s
I20260709 12:13:44.948470 30981 tablet_bootstrap.cc:654] T 76d4dde0196948ef92f68df770af02b0 P 84b98f9236604dd0b22ae23c5378a676: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.949824 30978 raft_consensus.cc:359] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:44.950562 30978 raft_consensus.cc:385] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.950891 30978 raft_consensus.cc:740] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.951907 30978 consensus_queue.cc:260] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:44.951864 30977 raft_consensus.cc:359] T d5a270750666414887b6fae2f3793dc5 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:44.953313 31038 raft_consensus.cc:493] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.954002 31038 raft_consensus.cc:515] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:44.953228 30977 raft_consensus.cc:385] T d5a270750666414887b6fae2f3793dc5 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.957649 30977 raft_consensus.cc:740] T d5a270750666414887b6fae2f3793dc5 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.961565 31038 leader_election.cc:290] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:44.962029 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5324c1d1d0cd4e6e96c28c96ebcbb03f" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:44.962754 30932 raft_consensus.cc:2468] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 0.
I20260709 12:13:44.964308 30977 consensus_queue.cc:260] T d5a270750666414887b6fae2f3793dc5 P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:44.971194 30977 ts_tablet_manager.cc:1434] T d5a270750666414887b6fae2f3793dc5 P 15ad0880a63541ef965cb6acca4513d7: Time spent starting tablet: real 0.023s	user 0.010s	sys 0.001s
I20260709 12:13:44.972976 30987 consensus_queue.cc:1048] T f0fbdcbe46b34107bbbf63f69c98e244 P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:44.973271 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5324c1d1d0cd4e6e96c28c96ebcbb03f" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:44.973876 30782 raft_consensus.cc:2468] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 0.
I20260709 12:13:44.974901 30674 leader_election.cc:304] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 6c5665c17e904fc692bce76fc57b2460; no voters: 
I20260709 12:13:44.977788 31049 raft_consensus.cc:2804] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:44.978850 31049 raft_consensus.cc:493] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.979682 31049 raft_consensus.cc:3060] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.978842 30605 catalog_manager.cc:5697] T 76d4dde0196948ef92f68df770af02b0 P 6c5665c17e904fc692bce76fc57b2460 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129). New cstate: current_term: 1 leader_uuid: "6c5665c17e904fc692bce76fc57b2460" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:44.996863 30978 ts_tablet_manager.cc:1434] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.000s
I20260709 12:13:44.996636 31042 consensus_queue.cc:1048] T a6a5bd717fa048aabdd0879bcea0fd60 P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Connected to new peer: Peer: permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:44.998409 30978 tablet_bootstrap.cc:492] T a318673515aa415db1aa91d126a5b724 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:45.003072 31038 raft_consensus.cc:493] T 2ff9e0d905854cceb79f96f500a07339 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.003743 31038 raft_consensus.cc:515] T 2ff9e0d905854cceb79f96f500a07339 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:45.007974 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9e0d905854cceb79f96f500a07339" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:45.008898 30782 raft_consensus.cc:2468] T 2ff9e0d905854cceb79f96f500a07339 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 0.
I20260709 12:13:45.015302 30980 tablet_bootstrap.cc:654] T 0203e5cc33ca470eb9c1f366291c344d P 8130e18710c04a61a5d8bd019c6ffdad: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.016569 30673 leader_election.cc:304] T 2ff9e0d905854cceb79f96f500a07339 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:13:45.017033 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9e0d905854cceb79f96f500a07339" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:45.017679 30931 raft_consensus.cc:2468] T 2ff9e0d905854cceb79f96f500a07339 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 0.
I20260709 12:13:45.018021 30981 tablet_bootstrap.cc:492] T 76d4dde0196948ef92f68df770af02b0 P 84b98f9236604dd0b22ae23c5378a676: No bootstrap required, opened a new log
I20260709 12:13:45.018505 30981 ts_tablet_manager.cc:1403] T 76d4dde0196948ef92f68df770af02b0 P 84b98f9236604dd0b22ae23c5378a676: Time spent bootstrapping tablet: real 0.115s	user 0.010s	sys 0.007s
I20260709 12:13:45.010869 31038 leader_election.cc:290] T 2ff9e0d905854cceb79f96f500a07339 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:45.019109 31038 raft_consensus.cc:2804] T 2ff9e0d905854cceb79f96f500a07339 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:45.019454 31038 raft_consensus.cc:493] T 2ff9e0d905854cceb79f96f500a07339 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.019797 31038 raft_consensus.cc:3060] T 2ff9e0d905854cceb79f96f500a07339 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.021509 30977 tablet_bootstrap.cc:492] T 99164e2d6f664ceab4d5921867d62c31 P 15ad0880a63541ef965cb6acca4513d7: Bootstrap starting.
I20260709 12:13:45.031807 30981 raft_consensus.cc:359] T 76d4dde0196948ef92f68df770af02b0 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:45.034435 30981 raft_consensus.cc:385] T 76d4dde0196948ef92f68df770af02b0 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.034893 30981 raft_consensus.cc:740] T 76d4dde0196948ef92f68df770af02b0 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.037235 30981 consensus_queue.cc:260] T 76d4dde0196948ef92f68df770af02b0 P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:45.040691 30981 ts_tablet_manager.cc:1434] T 76d4dde0196948ef92f68df770af02b0 P 84b98f9236604dd0b22ae23c5378a676: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 12:13:45.042968 30981 tablet_bootstrap.cc:492] T a0bb1498511242ef95085be49c10c4d3 P 84b98f9236604dd0b22ae23c5378a676: Bootstrap starting.
I20260709 12:13:45.046191 30978 tablet_bootstrap.cc:654] T a318673515aa415db1aa91d126a5b724 P 6c5665c17e904fc692bce76fc57b2460: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.049369 31059 raft_consensus.cc:493] T d5a270750666414887b6fae2f3793dc5 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.049878 31059 raft_consensus.cc:515] T d5a270750666414887b6fae2f3793dc5 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:45.050649 30981 tablet_bootstrap.cc:654] T a0bb1498511242ef95085be49c10c4d3 P 84b98f9236604dd0b22ae23c5378a676: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.052175 31059 leader_election.cc:290] T d5a270750666414887b6fae2f3793dc5 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:45.054704 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a270750666414887b6fae2f3793dc5" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:45.055964 30782 raft_consensus.cc:2468] T d5a270750666414887b6fae2f3793dc5 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 0.
I20260709 12:13:45.056584 30977 tablet_bootstrap.cc:654] T 99164e2d6f664ceab4d5921867d62c31 P 15ad0880a63541ef965cb6acca4513d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.057730 30896 leader_election.cc:304] T d5a270750666414887b6fae2f3793dc5 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:13:45.058908 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a270750666414887b6fae2f3793dc5" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:45.059684 30857 raft_consensus.cc:2468] T d5a270750666414887b6fae2f3793dc5 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 0.
I20260709 12:13:45.061579 31059 raft_consensus.cc:2804] T d5a270750666414887b6fae2f3793dc5 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:45.061998 31059 raft_consensus.cc:493] T d5a270750666414887b6fae2f3793dc5 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.062345 31059 raft_consensus.cc:3060] T d5a270750666414887b6fae2f3793dc5 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.071653 31053 consensus_queue.cc:1048] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:13:45.084677 30989 consensus_queue.cc:1048] T a6a5bd717fa048aabdd0879bcea0fd60 P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:45.048565 31049 raft_consensus.cc:515] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:45.095017 31064 raft_consensus.cc:493] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.100518 31064 raft_consensus.cc:515] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:45.108970 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0bb1498511242ef95085be49c10c4d3" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:45.109661 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0bb1498511242ef95085be49c10c4d3" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:45.110356 30858 raft_consensus.cc:2468] T a0bb1498511242ef95085be49c10c4d3 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 0.
I20260709 12:13:45.111680 30673 leader_election.cc:304] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 
I20260709 12:13:45.112574 30984 raft_consensus.cc:2804] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:45.112958 30984 raft_consensus.cc:493] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.113283 30984 raft_consensus.cc:3060] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.114607 31053 consensus_queue.cc:1048] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.095309 31038 raft_consensus.cc:515] T 2ff9e0d905854cceb79f96f500a07339 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:45.109613 30980 tablet_bootstrap.cc:492] T 0203e5cc33ca470eb9c1f366291c344d P 8130e18710c04a61a5d8bd019c6ffdad: No bootstrap required, opened a new log
I20260709 12:13:45.119089 30980 ts_tablet_manager.cc:1403] T 0203e5cc33ca470eb9c1f366291c344d P 8130e18710c04a61a5d8bd019c6ffdad: Time spent bootstrapping tablet: real 0.183s	user 0.009s	sys 0.022s
I20260709 12:13:45.118623 31064 leader_election.cc:290] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
W20260709 12:13:45.124752 30673 leader_election.cc:343] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:45.136487 30981 tablet_bootstrap.cc:492] T a0bb1498511242ef95085be49c10c4d3 P 84b98f9236604dd0b22ae23c5378a676: No bootstrap required, opened a new log
I20260709 12:13:45.137116 30981 ts_tablet_manager.cc:1403] T a0bb1498511242ef95085be49c10c4d3 P 84b98f9236604dd0b22ae23c5378a676: Time spent bootstrapping tablet: real 0.094s	user 0.013s	sys 0.009s
I20260709 12:13:45.136590 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9e0d905854cceb79f96f500a07339" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
I20260709 12:13:45.136756 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9e0d905854cceb79f96f500a07339" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:13:45.137651 30932 raft_consensus.cc:3060] T 2ff9e0d905854cceb79f96f500a07339 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.137702 30782 raft_consensus.cc:3060] T 2ff9e0d905854cceb79f96f500a07339 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.136795 30984 raft_consensus.cc:515] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:45.141075 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5324c1d1d0cd4e6e96c28c96ebcbb03f" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
I20260709 12:13:45.142486 30981 raft_consensus.cc:359] T a0bb1498511242ef95085be49c10c4d3 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:45.149042 30931 raft_consensus.cc:3060] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.149085 30981 raft_consensus.cc:385] T a0bb1498511242ef95085be49c10c4d3 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.149680 30981 raft_consensus.cc:740] T a0bb1498511242ef95085be49c10c4d3 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.142694 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0bb1498511242ef95085be49c10c4d3" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:13:45.144023 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0bb1498511242ef95085be49c10c4d3" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:13:45.152757 30858 raft_consensus.cc:3060] T a0bb1498511242ef95085be49c10c4d3 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.153455 30932 raft_consensus.cc:2468] T 2ff9e0d905854cceb79f96f500a07339 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 1.
I20260709 12:13:45.139460 31049 leader_election.cc:290] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 election: Requested vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:45.154757 30674 leader_election.cc:304] T 2ff9e0d905854cceb79f96f500a07339 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 6c5665c17e904fc692bce76fc57b2460; no voters: 
I20260709 12:13:45.137440 31038 leader_election.cc:290] T 2ff9e0d905854cceb79f96f500a07339 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 election: Requested vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:45.139691 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5324c1d1d0cd4e6e96c28c96ebcbb03f" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:13:45.156903 31049 raft_consensus.cc:2804] T 2ff9e0d905854cceb79f96f500a07339 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:45.157188 30784 raft_consensus.cc:3060] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.150590 30981 consensus_queue.cc:260] T a0bb1498511242ef95085be49c10c4d3 P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:45.146720 30782 raft_consensus.cc:2468] T 2ff9e0d905854cceb79f96f500a07339 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 1.
I20260709 12:13:45.165968 30980 raft_consensus.cc:359] T 0203e5cc33ca470eb9c1f366291c344d P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:45.166671 30980 raft_consensus.cc:385] T 0203e5cc33ca470eb9c1f366291c344d P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.166947 31041 consensus_queue.cc:1048] T da25c47d7366434089b73f8af7ce453b P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Connected to new peer: Peer: permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.161893 30783 raft_consensus.cc:3060] T a0bb1498511242ef95085be49c10c4d3 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.172024 30978 tablet_bootstrap.cc:492] T a318673515aa415db1aa91d126a5b724 P 6c5665c17e904fc692bce76fc57b2460: No bootstrap required, opened a new log
I20260709 12:13:45.172547 30978 ts_tablet_manager.cc:1403] T a318673515aa415db1aa91d126a5b724 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.174s	user 0.016s	sys 0.015s
I20260709 12:13:45.139633 31059 raft_consensus.cc:515] T d5a270750666414887b6fae2f3793dc5 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:45.180048 31059 leader_election.cc:290] T d5a270750666414887b6fae2f3793dc5 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Requested vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:45.181388 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a270750666414887b6fae2f3793dc5" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:13:45.182070 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a270750666414887b6fae2f3793dc5" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:13:45.182758 30781 raft_consensus.cc:3060] T d5a270750666414887b6fae2f3793dc5 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.183378 30858 raft_consensus.cc:2468] T a0bb1498511242ef95085be49c10c4d3 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 1.
I20260709 12:13:45.184068 30783 raft_consensus.cc:2468] T a0bb1498511242ef95085be49c10c4d3 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 1.
W20260709 12:13:45.184258 30822 consensus_peers.cc:597] T da25c47d7366434089b73f8af7ce453b P 8130e18710c04a61a5d8bd019c6ffdad -> Peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Couldn't send request to peer 84b98f9236604dd0b22ae23c5378a676. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:45.166923 30980 raft_consensus.cc:740] T 0203e5cc33ca470eb9c1f366291c344d P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.142949 30984 leader_election.cc:290] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 election: Requested vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:45.187052 30673 leader_election.cc:304] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 
I20260709 12:13:45.182076 30855 raft_consensus.cc:3060] T d5a270750666414887b6fae2f3793dc5 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.188864 30931 raft_consensus.cc:2468] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 1.
I20260709 12:13:45.189352 30980 consensus_queue.cc:260] T 0203e5cc33ca470eb9c1f366291c344d P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:45.190488 30978 raft_consensus.cc:359] T a318673515aa415db1aa91d126a5b724 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:45.192358 30978 raft_consensus.cc:385] T a318673515aa415db1aa91d126a5b724 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.189900 31049 raft_consensus.cc:697] T 2ff9e0d905854cceb79f96f500a07339 P 6c5665c17e904fc692bce76fc57b2460 [term 1 LEADER]: Becoming Leader. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Running, Role: LEADER
I20260709 12:13:45.192659 30978 raft_consensus.cc:740] T a318673515aa415db1aa91d126a5b724 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.194022 30674 leader_election.cc:304] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 6c5665c17e904fc692bce76fc57b2460; no voters: 
I20260709 12:13:45.194343 30978 consensus_queue.cc:260] T a318673515aa415db1aa91d126a5b724 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:45.195030 30984 raft_consensus.cc:2804] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:45.194404 31049 consensus_queue.cc:237] T 2ff9e0d905854cceb79f96f500a07339 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:45.197376 30978 ts_tablet_manager.cc:1434] T a318673515aa415db1aa91d126a5b724 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 12:13:45.195737 30984 raft_consensus.cc:697] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 6c5665c17e904fc692bce76fc57b2460 [term 1 LEADER]: Becoming Leader. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Running, Role: LEADER
I20260709 12:13:45.199266 30984 consensus_queue.cc:237] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:45.192881 31038 raft_consensus.cc:2804] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:45.200246 31038 raft_consensus.cc:697] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460 [term 1 LEADER]: Becoming Leader. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Running, Role: LEADER
I20260709 12:13:45.201081 31038 consensus_queue.cc:237] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:45.204111 30978 tablet_bootstrap.cc:492] T 21c0ba9bb1d64ab398c606450f72e966 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:45.209049 30981 ts_tablet_manager.cc:1434] T a0bb1498511242ef95085be49c10c4d3 P 84b98f9236604dd0b22ae23c5378a676: Time spent starting tablet: real 0.072s	user 0.008s	sys 0.000s
I20260709 12:13:45.210397 30981 tablet_bootstrap.cc:492] T da25c47d7366434089b73f8af7ce453b P 84b98f9236604dd0b22ae23c5378a676: Bootstrap starting.
I20260709 12:13:45.211809 31041 consensus_queue.cc:1048] T 21c0ba9bb1d64ab398c606450f72e966 P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Connected to new peer: Peer: permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:45.216518 30980 ts_tablet_manager.cc:1434] T 0203e5cc33ca470eb9c1f366291c344d P 8130e18710c04a61a5d8bd019c6ffdad: Time spent starting tablet: real 0.097s	user 0.005s	sys 0.003s
I20260709 12:13:45.219484 30781 raft_consensus.cc:2468] T d5a270750666414887b6fae2f3793dc5 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 1.
I20260709 12:13:45.224577 30896 leader_election.cc:304] T d5a270750666414887b6fae2f3793dc5 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:13:45.225611 31059 raft_consensus.cc:2804] T d5a270750666414887b6fae2f3793dc5 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:45.226101 31059 raft_consensus.cc:697] T d5a270750666414887b6fae2f3793dc5 P 15ad0880a63541ef965cb6acca4513d7 [term 1 LEADER]: Becoming Leader. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Running, Role: LEADER
I20260709 12:13:45.226928 31059 consensus_queue.cc:237] T d5a270750666414887b6fae2f3793dc5 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:45.229803 30784 raft_consensus.cc:2468] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 1.
I20260709 12:13:45.232471 30855 raft_consensus.cc:2468] T d5a270750666414887b6fae2f3793dc5 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 1.
I20260709 12:13:45.243332 31056 raft_consensus.cc:493] T 76d4dde0196948ef92f68df770af02b0 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.243930 31056 raft_consensus.cc:515] T 76d4dde0196948ef92f68df770af02b0 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:45.245668 30981 tablet_bootstrap.cc:654] T da25c47d7366434089b73f8af7ce453b P 84b98f9236604dd0b22ae23c5378a676: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.246855 31056 leader_election.cc:290] T 76d4dde0196948ef92f68df770af02b0 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:45.248544 30977 tablet_bootstrap.cc:492] T 99164e2d6f664ceab4d5921867d62c31 P 15ad0880a63541ef965cb6acca4513d7: No bootstrap required, opened a new log
I20260709 12:13:45.259228 30977 ts_tablet_manager.cc:1403] T 99164e2d6f664ceab4d5921867d62c31 P 15ad0880a63541ef965cb6acca4513d7: Time spent bootstrapping tablet: real 0.249s	user 0.012s	sys 0.010s
I20260709 12:13:45.252516 30980 tablet_bootstrap.cc:492] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 8130e18710c04a61a5d8bd019c6ffdad: Bootstrap starting.
I20260709 12:13:45.260123 30984 consensus_queue.cc:1048] T 76d4dde0196948ef92f68df770af02b0 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.249974 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d4dde0196948ef92f68df770af02b0" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:45.249310 30709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d4dde0196948ef92f68df770af02b0" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
W20260709 12:13:45.251928 31096 log.cc:927] Time spent T 8b66a7b6f8aa4803b482e392cc945db7 P 8130e18710c04a61a5d8bd019c6ffdad: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:13:45.266171 30977 raft_consensus.cc:359] T 99164e2d6f664ceab4d5921867d62c31 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:45.267000 31098 consensus_queue.cc:1048] T 615eb2fb16414287bc0956a27523b7f4 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:45.270639 30978 tablet_bootstrap.cc:654] T 21c0ba9bb1d64ab398c606450f72e966 P 6c5665c17e904fc692bce76fc57b2460: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.273142 30977 raft_consensus.cc:385] T 99164e2d6f664ceab4d5921867d62c31 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.274222 30977 raft_consensus.cc:740] T 99164e2d6f664ceab4d5921867d62c31 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.276263 30932 raft_consensus.cc:2393] T 76d4dde0196948ef92f68df770af02b0 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 84b98f9236604dd0b22ae23c5378a676 in current term 1: Already voted for candidate 6c5665c17e904fc692bce76fc57b2460 in this term.
I20260709 12:13:45.277034 30977 consensus_queue.cc:260] T 99164e2d6f664ceab4d5921867d62c31 P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:45.281551 30977 ts_tablet_manager.cc:1434] T 99164e2d6f664ceab4d5921867d62c31 P 15ad0880a63541ef965cb6acca4513d7: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 12:13:45.284889 30750 leader_election.cc:304] T 76d4dde0196948ef92f68df770af02b0 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 84b98f9236604dd0b22ae23c5378a676; no voters: 15ad0880a63541ef965cb6acca4513d7, 6c5665c17e904fc692bce76fc57b2460
W20260709 12:13:45.286412 30824 consensus_peers.cc:597] T 21c0ba9bb1d64ab398c606450f72e966 P 8130e18710c04a61a5d8bd019c6ffdad -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:45.286372 31056 raft_consensus.cc:3060] T 76d4dde0196948ef92f68df770af02b0 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.286592 30605 catalog_manager.cc:5697] T 2ff9e0d905854cceb79f96f500a07339 P 6c5665c17e904fc692bce76fc57b2460 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129). New cstate: current_term: 1 leader_uuid: "6c5665c17e904fc692bce76fc57b2460" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:45.263965 31049 raft_consensus.cc:493] T a318673515aa415db1aa91d126a5b724 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.298687 31049 raft_consensus.cc:515] T a318673515aa415db1aa91d126a5b724 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:45.301136 31049 leader_election.cc:290] T a318673515aa415db1aa91d126a5b724 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:45.301858 31056 raft_consensus.cc:2749] T 76d4dde0196948ef92f68df770af02b0 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:45.302486 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a318673515aa415db1aa91d126a5b724" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:45.304201 31041 raft_consensus.cc:493] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.304665 30977 tablet_bootstrap.cc:492] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 15ad0880a63541ef965cb6acca4513d7: Bootstrap starting.
I20260709 12:13:45.306243 31041 raft_consensus.cc:515] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:45.309319 31041 leader_election.cc:290] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:45.315708 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b500ac0d6a6419b8bc041e830d2dcf7" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
W20260709 12:13:45.317849 30823 leader_election.cc:343] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:45.318576 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a318673515aa415db1aa91d126a5b724" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:45.320641 30674 leader_election.cc:304] T a318673515aa415db1aa91d126a5b724 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460; no voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:45.321110 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b500ac0d6a6419b8bc041e830d2dcf7" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:45.322012 31038 raft_consensus.cc:2749] T a318673515aa415db1aa91d126a5b724 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:13:45.323167 30822 leader_election.cc:343] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:45.323827 30822 leader_election.cc:304] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad; no voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:45.324823 31041 raft_consensus.cc:2749] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:45.326942 30606 catalog_manager.cc:5697] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 6c5665c17e904fc692bce76fc57b2460 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129). New cstate: current_term: 1 leader_uuid: "6c5665c17e904fc692bce76fc57b2460" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:45.329535 30606 catalog_manager.cc:5697] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129). New cstate: current_term: 1 leader_uuid: "6c5665c17e904fc692bce76fc57b2460" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:45.331233 30984 consensus_queue.cc:1048] T 615eb2fb16414287bc0956a27523b7f4 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.327286 30981 tablet_bootstrap.cc:492] T da25c47d7366434089b73f8af7ce453b P 84b98f9236604dd0b22ae23c5378a676: No bootstrap required, opened a new log
I20260709 12:13:45.333772 30981 ts_tablet_manager.cc:1403] T da25c47d7366434089b73f8af7ce453b P 84b98f9236604dd0b22ae23c5378a676: Time spent bootstrapping tablet: real 0.124s	user 0.012s	sys 0.001s
I20260709 12:13:45.339156 30980 tablet_bootstrap.cc:654] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 8130e18710c04a61a5d8bd019c6ffdad: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.341707 30978 tablet_bootstrap.cc:492] T 21c0ba9bb1d64ab398c606450f72e966 P 6c5665c17e904fc692bce76fc57b2460: No bootstrap required, opened a new log
I20260709 12:13:45.342244 30978 ts_tablet_manager.cc:1403] T 21c0ba9bb1d64ab398c606450f72e966 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.144s	user 0.018s	sys 0.020s
I20260709 12:13:45.345790 30978 raft_consensus.cc:359] T 21c0ba9bb1d64ab398c606450f72e966 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:45.347442 30978 raft_consensus.cc:385] T 21c0ba9bb1d64ab398c606450f72e966 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.347903 30978 raft_consensus.cc:740] T 21c0ba9bb1d64ab398c606450f72e966 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.349061 30978 consensus_queue.cc:260] T 21c0ba9bb1d64ab398c606450f72e966 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:45.346473 30977 tablet_bootstrap.cc:654] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 15ad0880a63541ef965cb6acca4513d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.351300 31038 consensus_queue.cc:1048] T 76d4dde0196948ef92f68df770af02b0 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.352602 30981 raft_consensus.cc:359] T da25c47d7366434089b73f8af7ce453b P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:45.353127 30978 ts_tablet_manager.cc:1434] T 21c0ba9bb1d64ab398c606450f72e966 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.005s
I20260709 12:13:45.353333 30981 raft_consensus.cc:385] T da25c47d7366434089b73f8af7ce453b P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.353803 30981 raft_consensus.cc:740] T da25c47d7366434089b73f8af7ce453b P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.353911 30605 catalog_manager.cc:5697] T d5a270750666414887b6fae2f3793dc5 P 15ad0880a63541ef965cb6acca4513d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132). New cstate: current_term: 1 leader_uuid: "15ad0880a63541ef965cb6acca4513d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:45.356832 30981 consensus_queue.cc:260] T da25c47d7366434089b73f8af7ce453b P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:45.360633 30978 tablet_bootstrap.cc:492] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:45.366207 31041 raft_consensus.cc:493] T 0203e5cc33ca470eb9c1f366291c344d P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.366895 31041 raft_consensus.cc:515] T 0203e5cc33ca470eb9c1f366291c344d P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:45.371434 30709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0203e5cc33ca470eb9c1f366291c344d" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:45.359094 30981 ts_tablet_manager.cc:1434] T da25c47d7366434089b73f8af7ce453b P 84b98f9236604dd0b22ae23c5378a676: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.002s
I20260709 12:13:45.373621 31056 raft_consensus.cc:493] T da25c47d7366434089b73f8af7ce453b P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.373906 30981 tablet_bootstrap.cc:492] T 671d30cec67d47a89e8ec6fab0c53c48 P 84b98f9236604dd0b22ae23c5378a676: Bootstrap starting.
W20260709 12:13:45.374893 30824 leader_election.cc:343] T 0203e5cc33ca470eb9c1f366291c344d P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:45.377380 31056 raft_consensus.cc:515] T da25c47d7366434089b73f8af7ce453b P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:45.373987 30978 tablet_bootstrap.cc:654] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 6c5665c17e904fc692bce76fc57b2460: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.380741 30981 tablet_bootstrap.cc:654] T 671d30cec67d47a89e8ec6fab0c53c48 P 84b98f9236604dd0b22ae23c5378a676: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.381273 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da25c47d7366434089b73f8af7ce453b" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:45.386279 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da25c47d7366434089b73f8af7ce453b" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:45.388571 30749 leader_election.cc:304] T da25c47d7366434089b73f8af7ce453b P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 84b98f9236604dd0b22ae23c5378a676; no voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad
I20260709 12:13:45.389744 31013 raft_consensus.cc:2749] T da25c47d7366434089b73f8af7ce453b P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:45.391331 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0203e5cc33ca470eb9c1f366291c344d" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
W20260709 12:13:45.393265 30822 leader_election.cc:343] T 0203e5cc33ca470eb9c1f366291c344d P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:45.393831 30822 leader_election.cc:304] T 0203e5cc33ca470eb9c1f366291c344d P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad; no voters: 6c5665c17e904fc692bce76fc57b2460, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:45.395196 30989 raft_consensus.cc:2749] T 0203e5cc33ca470eb9c1f366291c344d P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:45.389758 31056 leader_election.cc:290] T da25c47d7366434089b73f8af7ce453b P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:45.396736 31041 leader_election.cc:290] T 0203e5cc33ca470eb9c1f366291c344d P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:45.411675 30980 tablet_bootstrap.cc:492] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 8130e18710c04a61a5d8bd019c6ffdad: No bootstrap required, opened a new log
I20260709 12:13:45.412328 30980 ts_tablet_manager.cc:1403] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent bootstrapping tablet: real 0.160s	user 0.010s	sys 0.001s
I20260709 12:13:45.423313 30980 raft_consensus.cc:359] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:45.424261 30980 raft_consensus.cc:385] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.425071 30980 raft_consensus.cc:740] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.426270 30980 consensus_queue.cc:260] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:45.429072 30980 ts_tablet_manager.cc:1434] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:13:45.430570 30980 tablet_bootstrap.cc:492] T 99164e2d6f664ceab4d5921867d62c31 P 8130e18710c04a61a5d8bd019c6ffdad: Bootstrap starting.
I20260709 12:13:45.436688 30980 tablet_bootstrap.cc:654] T 99164e2d6f664ceab4d5921867d62c31 P 8130e18710c04a61a5d8bd019c6ffdad: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.451211 30709 raft_consensus.cc:3060] T a318673515aa415db1aa91d126a5b724 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.451495 30978 tablet_bootstrap.cc:492] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 6c5665c17e904fc692bce76fc57b2460: No bootstrap required, opened a new log
I20260709 12:13:45.452016 30978 ts_tablet_manager.cc:1403] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.098s	user 0.016s	sys 0.010s
I20260709 12:13:45.454787 30978 raft_consensus.cc:359] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:45.461427 30978 raft_consensus.cc:385] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.461800 30978 raft_consensus.cc:740] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
W20260709 12:13:45.462805 30654 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:45.462590 30978 consensus_queue.cc:260] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:45.465359 30978 ts_tablet_manager.cc:1434] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
I20260709 12:13:45.466692 30978 tablet_bootstrap.cc:492] T b9cc9d529de24234b98ed5e152fd4b24 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:45.467797 30981 tablet_bootstrap.cc:492] T 671d30cec67d47a89e8ec6fab0c53c48 P 84b98f9236604dd0b22ae23c5378a676: No bootstrap required, opened a new log
I20260709 12:13:45.468444 30981 ts_tablet_manager.cc:1403] T 671d30cec67d47a89e8ec6fab0c53c48 P 84b98f9236604dd0b22ae23c5378a676: Time spent bootstrapping tablet: real 0.095s	user 0.022s	sys 0.012s
I20260709 12:13:45.474704 30977 tablet_bootstrap.cc:492] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 15ad0880a63541ef965cb6acca4513d7: No bootstrap required, opened a new log
I20260709 12:13:45.475281 30977 ts_tablet_manager.cc:1403] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 15ad0880a63541ef965cb6acca4513d7: Time spent bootstrapping tablet: real 0.172s	user 0.025s	sys 0.011s
I20260709 12:13:45.474880 30981 raft_consensus.cc:359] T 671d30cec67d47a89e8ec6fab0c53c48 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:45.475663 30981 raft_consensus.cc:385] T 671d30cec67d47a89e8ec6fab0c53c48 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.475847 30980 tablet_bootstrap.cc:492] T 99164e2d6f664ceab4d5921867d62c31 P 8130e18710c04a61a5d8bd019c6ffdad: No bootstrap required, opened a new log
I20260709 12:13:45.475991 30981 raft_consensus.cc:740] T 671d30cec67d47a89e8ec6fab0c53c48 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.476470 30980 ts_tablet_manager.cc:1403] T 99164e2d6f664ceab4d5921867d62c31 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent bootstrapping tablet: real 0.046s	user 0.017s	sys 0.009s
I20260709 12:13:45.476830 30981 consensus_queue.cc:260] T 671d30cec67d47a89e8ec6fab0c53c48 P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:45.477845 30977 raft_consensus.cc:359] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:45.478503 30977 raft_consensus.cc:385] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.478739 30977 raft_consensus.cc:740] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.478945 30980 raft_consensus.cc:359] T 99164e2d6f664ceab4d5921867d62c31 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:45.479643 30980 raft_consensus.cc:385] T 99164e2d6f664ceab4d5921867d62c31 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.479501 30977 consensus_queue.cc:260] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:45.479970 30980 raft_consensus.cc:740] T 99164e2d6f664ceab4d5921867d62c31 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.480835 30980 consensus_queue.cc:260] T 99164e2d6f664ceab4d5921867d62c31 P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:45.484400 30978 tablet_bootstrap.cc:654] T b9cc9d529de24234b98ed5e152fd4b24 P 6c5665c17e904fc692bce76fc57b2460: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.485057 30977 ts_tablet_manager.cc:1434] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 15ad0880a63541ef965cb6acca4513d7: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:13:45.486374 30977 tablet_bootstrap.cc:492] T 5d636204e40644318b4758f37c7b0474 P 15ad0880a63541ef965cb6acca4513d7: Bootstrap starting.
I20260709 12:13:45.486416 30980 ts_tablet_manager.cc:1434] T 99164e2d6f664ceab4d5921867d62c31 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 12:13:45.487689 30980 tablet_bootstrap.cc:492] T b6f09adc18e2485cbafdb86cfe535721 P 8130e18710c04a61a5d8bd019c6ffdad: Bootstrap starting.
I20260709 12:13:45.487898 30981 ts_tablet_manager.cc:1434] T 671d30cec67d47a89e8ec6fab0c53c48 P 84b98f9236604dd0b22ae23c5378a676: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 12:13:45.488966 30981 tablet_bootstrap.cc:492] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 84b98f9236604dd0b22ae23c5378a676: Bootstrap starting.
I20260709 12:13:45.493538 30980 tablet_bootstrap.cc:654] T b6f09adc18e2485cbafdb86cfe535721 P 8130e18710c04a61a5d8bd019c6ffdad: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.494663 30981 tablet_bootstrap.cc:654] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 84b98f9236604dd0b22ae23c5378a676: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.497293 30977 tablet_bootstrap.cc:654] T 5d636204e40644318b4758f37c7b0474 P 15ad0880a63541ef965cb6acca4513d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.502918 30981 tablet_bootstrap.cc:492] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 84b98f9236604dd0b22ae23c5378a676: No bootstrap required, opened a new log
I20260709 12:13:45.503402 30981 ts_tablet_manager.cc:1403] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 84b98f9236604dd0b22ae23c5378a676: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 12:13:45.507884 31059 raft_consensus.cc:493] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.508567 31059 raft_consensus.cc:515] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:45.509812 30980 tablet_bootstrap.cc:492] T b6f09adc18e2485cbafdb86cfe535721 P 8130e18710c04a61a5d8bd019c6ffdad: No bootstrap required, opened a new log
I20260709 12:13:45.510275 30980 ts_tablet_manager.cc:1403] T b6f09adc18e2485cbafdb86cfe535721 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.007s
I20260709 12:13:45.511299 31059 leader_election.cc:290] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:45.513089 30981 raft_consensus.cc:359] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:45.513804 30981 raft_consensus.cc:385] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.513653 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b3eb62be46741aa9c0364ddea2ca5c9" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:45.514113 30981 raft_consensus.cc:740] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.514341 30857 raft_consensus.cc:2468] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 0.
I20260709 12:13:45.515817 30896 leader_election.cc:304] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 
I20260709 12:13:45.515748 30980 raft_consensus.cc:359] T b6f09adc18e2485cbafdb86cfe535721 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:45.516821 31059 raft_consensus.cc:2804] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:45.517480 30981 consensus_queue.cc:260] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:45.518112 31059 raft_consensus.cc:493] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.518603 31059 raft_consensus.cc:3060] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.519959 30981 ts_tablet_manager.cc:1434] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 84b98f9236604dd0b22ae23c5378a676: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:13:45.516558 30980 raft_consensus.cc:385] T b6f09adc18e2485cbafdb86cfe535721 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.517576 30709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b3eb62be46741aa9c0364ddea2ca5c9" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
W20260709 12:13:45.528721 30898 leader_election.cc:343] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:45.529772 30980 raft_consensus.cc:740] T b6f09adc18e2485cbafdb86cfe535721 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.530839 30980 consensus_queue.cc:260] T b6f09adc18e2485cbafdb86cfe535721 P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:45.531678 30981 tablet_bootstrap.cc:492] T ac15e10cad8e4cbc9763eacc349d9549 P 84b98f9236604dd0b22ae23c5378a676: Bootstrap starting.
I20260709 12:13:45.526755 31059 raft_consensus.cc:515] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:45.533883 30978 tablet_bootstrap.cc:492] T b9cc9d529de24234b98ed5e152fd4b24 P 6c5665c17e904fc692bce76fc57b2460: No bootstrap required, opened a new log
I20260709 12:13:45.534359 30978 ts_tablet_manager.cc:1403] T b9cc9d529de24234b98ed5e152fd4b24 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.068s	user 0.030s	sys 0.013s
I20260709 12:13:45.537413 30978 raft_consensus.cc:359] T b9cc9d529de24234b98ed5e152fd4b24 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:45.538116 30978 raft_consensus.cc:385] T b9cc9d529de24234b98ed5e152fd4b24 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.538363 30978 raft_consensus.cc:740] T b9cc9d529de24234b98ed5e152fd4b24 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.538580 30981 tablet_bootstrap.cc:654] T ac15e10cad8e4cbc9763eacc349d9549 P 84b98f9236604dd0b22ae23c5378a676: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.539122 30978 consensus_queue.cc:260] T b9cc9d529de24234b98ed5e152fd4b24 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:45.542661 30980 ts_tablet_manager.cc:1434] T b6f09adc18e2485cbafdb86cfe535721 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.003s
I20260709 12:13:45.544018 30980 tablet_bootstrap.cc:492] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 8130e18710c04a61a5d8bd019c6ffdad: Bootstrap starting.
I20260709 12:13:45.548519 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b3eb62be46741aa9c0364ddea2ca5c9" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:13:45.549202 30857 raft_consensus.cc:3060] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.561204 30978 ts_tablet_manager.cc:1434] T b9cc9d529de24234b98ed5e152fd4b24 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:13:45.561903 30977 tablet_bootstrap.cc:492] T 5d636204e40644318b4758f37c7b0474 P 15ad0880a63541ef965cb6acca4513d7: No bootstrap required, opened a new log
I20260709 12:13:45.562799 31059 leader_election.cc:290] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Requested vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:45.563313 30709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b3eb62be46741aa9c0364ddea2ca5c9" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
I20260709 12:13:45.565888 30980 tablet_bootstrap.cc:654] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 8130e18710c04a61a5d8bd019c6ffdad: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:45.566601 30898 leader_election.cc:343] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:45.564137 30857 raft_consensus.cc:2468] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 1.
I20260709 12:13:45.568135 30896 leader_election.cc:304] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:45.568611 30981 tablet_bootstrap.cc:492] T ac15e10cad8e4cbc9763eacc349d9549 P 84b98f9236604dd0b22ae23c5378a676: No bootstrap required, opened a new log
I20260709 12:13:45.569149 30981 ts_tablet_manager.cc:1403] T ac15e10cad8e4cbc9763eacc349d9549 P 84b98f9236604dd0b22ae23c5378a676: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.010s
I20260709 12:13:45.564538 30977 ts_tablet_manager.cc:1403] T 5d636204e40644318b4758f37c7b0474 P 15ad0880a63541ef965cb6acca4513d7: Time spent bootstrapping tablet: real 0.079s	user 0.010s	sys 0.009s
I20260709 12:13:45.569319 30978 tablet_bootstrap.cc:492] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:45.569259 31059 raft_consensus.cc:2804] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:45.570329 31059 raft_consensus.cc:697] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 15ad0880a63541ef965cb6acca4513d7 [term 1 LEADER]: Becoming Leader. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Running, Role: LEADER
I20260709 12:13:45.571199 31059 consensus_queue.cc:237] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:45.572815 30981 raft_consensus.cc:359] T ac15e10cad8e4cbc9763eacc349d9549 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:45.573307 30977 raft_consensus.cc:359] T 5d636204e40644318b4758f37c7b0474 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:45.574008 30977 raft_consensus.cc:385] T 5d636204e40644318b4758f37c7b0474 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.574290 30977 raft_consensus.cc:740] T 5d636204e40644318b4758f37c7b0474 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.575922 30978 tablet_bootstrap.cc:654] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 6c5665c17e904fc692bce76fc57b2460: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.579768 30981 raft_consensus.cc:385] T ac15e10cad8e4cbc9763eacc349d9549 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.580240 30981 raft_consensus.cc:740] T ac15e10cad8e4cbc9763eacc349d9549 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.581565 30981 consensus_queue.cc:260] T ac15e10cad8e4cbc9763eacc349d9549 P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:45.583549 30977 consensus_queue.cc:260] T 5d636204e40644318b4758f37c7b0474 P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:45.585321 30981 ts_tablet_manager.cc:1434] T ac15e10cad8e4cbc9763eacc349d9549 P 84b98f9236604dd0b22ae23c5378a676: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:13:45.587010 30981 tablet_bootstrap.cc:492] T c449839430794851b61ffba23f946c4f P 84b98f9236604dd0b22ae23c5378a676: Bootstrap starting.
I20260709 12:13:45.593688 30977 ts_tablet_manager.cc:1434] T 5d636204e40644318b4758f37c7b0474 P 15ad0880a63541ef965cb6acca4513d7: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 12:13:45.595360 30977 tablet_bootstrap.cc:492] T c5afc0720ca546d8b13026e7c7a30c1e P 15ad0880a63541ef965cb6acca4513d7: Bootstrap starting.
I20260709 12:13:45.596038 30981 tablet_bootstrap.cc:654] T c449839430794851b61ffba23f946c4f P 84b98f9236604dd0b22ae23c5378a676: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.606709 30977 tablet_bootstrap.cc:654] T c5afc0720ca546d8b13026e7c7a30c1e P 15ad0880a63541ef965cb6acca4513d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.608525 30781 raft_consensus.cc:3060] T da25c47d7366434089b73f8af7ce453b P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.611315 31038 consensus_queue.cc:1048] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.614518 30978 tablet_bootstrap.cc:492] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 6c5665c17e904fc692bce76fc57b2460: No bootstrap required, opened a new log
I20260709 12:13:45.615103 30978 ts_tablet_manager.cc:1403] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.046s	user 0.018s	sys 0.007s
I20260709 12:13:45.618345 30978 raft_consensus.cc:359] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:45.615144 30977 tablet_bootstrap.cc:492] T c5afc0720ca546d8b13026e7c7a30c1e P 15ad0880a63541ef965cb6acca4513d7: No bootstrap required, opened a new log
I20260709 12:13:45.621531 30980 tablet_bootstrap.cc:492] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 8130e18710c04a61a5d8bd019c6ffdad: No bootstrap required, opened a new log
I20260709 12:13:45.621939 30977 ts_tablet_manager.cc:1403] T c5afc0720ca546d8b13026e7c7a30c1e P 15ad0880a63541ef965cb6acca4513d7: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.000s
I20260709 12:13:45.618207 30605 catalog_manager.cc:5697] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 15ad0880a63541ef965cb6acca4513d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132). New cstate: current_term: 1 leader_uuid: "15ad0880a63541ef965cb6acca4513d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:45.619099 30978 raft_consensus.cc:385] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.621976 30980 ts_tablet_manager.cc:1403] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 8130e18710c04a61a5d8bd019c6ffdad: Time spent bootstrapping tablet: real 0.078s	user 0.017s	sys 0.006s
I20260709 12:13:45.625172 30978 raft_consensus.cc:740] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.639740 30978 consensus_queue.cc:260] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:45.627477 30980 raft_consensus.cc:359] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:45.638280 31049 consensus_queue.cc:1048] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:13:45.640848 30980 raft_consensus.cc:385] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.641172 30980 raft_consensus.cc:740] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.642254 30978 ts_tablet_manager.cc:1434] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.003s
I20260709 12:13:45.641958 30980 consensus_queue.cc:260] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:45.643442 30978 tablet_bootstrap.cc:492] T 5d636204e40644318b4758f37c7b0474 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:45.650128 30978 tablet_bootstrap.cc:654] T 5d636204e40644318b4758f37c7b0474 P 6c5665c17e904fc692bce76fc57b2460: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.650301 30980 ts_tablet_manager.cc:1434] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 8130e18710c04a61a5d8bd019c6ffdad: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.000s
I20260709 12:13:45.625094 30977 raft_consensus.cc:359] T c5afc0720ca546d8b13026e7c7a30c1e P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:45.651816 30980 tablet_bootstrap.cc:492] T 8c580512b11742d4977ff026ff8fc795 P 8130e18710c04a61a5d8bd019c6ffdad: Bootstrap starting.
I20260709 12:13:45.651763 30977 raft_consensus.cc:385] T c5afc0720ca546d8b13026e7c7a30c1e P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.652871 30977 raft_consensus.cc:740] T c5afc0720ca546d8b13026e7c7a30c1e P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.653465 31038 consensus_queue.cc:1048] T 2ff9e0d905854cceb79f96f500a07339 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.653712 30977 consensus_queue.cc:260] T c5afc0720ca546d8b13026e7c7a30c1e P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:45.655755 30981 tablet_bootstrap.cc:492] T c449839430794851b61ffba23f946c4f P 84b98f9236604dd0b22ae23c5378a676: No bootstrap required, opened a new log
I20260709 12:13:45.656229 30981 ts_tablet_manager.cc:1403] T c449839430794851b61ffba23f946c4f P 84b98f9236604dd0b22ae23c5378a676: Time spent bootstrapping tablet: real 0.070s	user 0.016s	sys 0.000s
I20260709 12:13:45.656323 30977 ts_tablet_manager.cc:1434] T c5afc0720ca546d8b13026e7c7a30c1e P 15ad0880a63541ef965cb6acca4513d7: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 12:13:45.657514 30977 tablet_bootstrap.cc:492] T 8c580512b11742d4977ff026ff8fc795 P 15ad0880a63541ef965cb6acca4513d7: Bootstrap starting.
I20260709 12:13:45.659436 30981 raft_consensus.cc:359] T c449839430794851b61ffba23f946c4f P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:45.660116 30981 raft_consensus.cc:385] T c449839430794851b61ffba23f946c4f P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.660382 30981 raft_consensus.cc:740] T c449839430794851b61ffba23f946c4f P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.661038 30981 consensus_queue.cc:260] T c449839430794851b61ffba23f946c4f P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:45.666227 30981 ts_tablet_manager.cc:1434] T c449839430794851b61ffba23f946c4f P 84b98f9236604dd0b22ae23c5378a676: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 12:13:45.667270 30977 tablet_bootstrap.cc:654] T 8c580512b11742d4977ff026ff8fc795 P 15ad0880a63541ef965cb6acca4513d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.675943 30981 tablet_bootstrap.cc:492] T b9cc9d529de24234b98ed5e152fd4b24 P 84b98f9236604dd0b22ae23c5378a676: Bootstrap starting.
I20260709 12:13:45.681533 30980 tablet_bootstrap.cc:654] T 8c580512b11742d4977ff026ff8fc795 P 8130e18710c04a61a5d8bd019c6ffdad: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.684449 30977 tablet_bootstrap.cc:492] T 8c580512b11742d4977ff026ff8fc795 P 15ad0880a63541ef965cb6acca4513d7: No bootstrap required, opened a new log
I20260709 12:13:45.684989 30977 ts_tablet_manager.cc:1403] T 8c580512b11742d4977ff026ff8fc795 P 15ad0880a63541ef965cb6acca4513d7: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.004s
I20260709 12:13:45.683065 30981 tablet_bootstrap.cc:654] T b9cc9d529de24234b98ed5e152fd4b24 P 84b98f9236604dd0b22ae23c5378a676: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.688220 30977 raft_consensus.cc:359] T 8c580512b11742d4977ff026ff8fc795 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:45.689459 30977 raft_consensus.cc:385] T 8c580512b11742d4977ff026ff8fc795 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.689755 30977 raft_consensus.cc:740] T 8c580512b11742d4977ff026ff8fc795 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.689791 31013 raft_consensus.cc:493] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.690424 31013 raft_consensus.cc:515] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:45.690646 30977 consensus_queue.cc:260] T 8c580512b11742d4977ff026ff8fc795 P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:45.692102 31038 consensus_queue.cc:1048] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.694916 31013 leader_election.cc:290] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:45.695313 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b500ac0d6a6419b8bc041e830d2dcf7" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:45.696246 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b500ac0d6a6419b8bc041e830d2dcf7" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:45.704457 30980 tablet_bootstrap.cc:492] T 8c580512b11742d4977ff026ff8fc795 P 8130e18710c04a61a5d8bd019c6ffdad: No bootstrap required, opened a new log
I20260709 12:13:45.705197 30980 ts_tablet_manager.cc:1403] T 8c580512b11742d4977ff026ff8fc795 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent bootstrapping tablet: real 0.054s	user 0.012s	sys 0.002s
I20260709 12:13:45.707156 30977 ts_tablet_manager.cc:1434] T 8c580512b11742d4977ff026ff8fc795 P 15ad0880a63541ef965cb6acca4513d7: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 12:13:45.702150 30857 raft_consensus.cc:2468] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 0.
I20260709 12:13:45.711279 30977 tablet_bootstrap.cc:492] T b9cc9d529de24234b98ed5e152fd4b24 P 15ad0880a63541ef965cb6acca4513d7: Bootstrap starting.
W20260709 12:13:45.701711 30749 leader_election.cc:343] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:45.715142 31013 raft_consensus.cc:493] T ac15e10cad8e4cbc9763eacc349d9549 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.715801 31013 raft_consensus.cc:515] T ac15e10cad8e4cbc9763eacc349d9549 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:45.718552 31013 leader_election.cc:290] T ac15e10cad8e4cbc9763eacc349d9549 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:45.720408 30980 raft_consensus.cc:359] T 8c580512b11742d4977ff026ff8fc795 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:45.721285 30980 raft_consensus.cc:385] T 8c580512b11742d4977ff026ff8fc795 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.721565 30980 raft_consensus.cc:740] T 8c580512b11742d4977ff026ff8fc795 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.722369 30980 consensus_queue.cc:260] T 8c580512b11742d4977ff026ff8fc795 P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:45.725180 31059 raft_consensus.cc:493] T 99164e2d6f664ceab4d5921867d62c31 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.725723 31059 raft_consensus.cc:515] T 99164e2d6f664ceab4d5921867d62c31 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:45.715175 30748 leader_election.cc:304] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676; no voters: 15ad0880a63541ef965cb6acca4513d7
I20260709 12:13:45.729619 30709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99164e2d6f664ceab4d5921867d62c31" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:45.730191 31056 raft_consensus.cc:2804] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:45.730612 31056 raft_consensus.cc:493] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.730949 31056 raft_consensus.cc:3060] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:45.731195 30898 leader_election.cc:343] T 99164e2d6f664ceab4d5921867d62c31 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:45.733088 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99164e2d6f664ceab4d5921867d62c31" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:45.733801 30857 raft_consensus.cc:2468] T 99164e2d6f664ceab4d5921867d62c31 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 0.
I20260709 12:13:45.734282 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac15e10cad8e4cbc9763eacc349d9549" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:45.735602 30896 leader_election.cc:304] T 99164e2d6f664ceab4d5921867d62c31 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:45.728081 31059 leader_election.cc:290] T 99164e2d6f664ceab4d5921867d62c31 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
W20260709 12:13:45.739253 30748 leader_election.cc:343] T ac15e10cad8e4cbc9763eacc349d9549 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:45.742970 30986 raft_consensus.cc:2804] T 99164e2d6f664ceab4d5921867d62c31 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:45.743428 30986 raft_consensus.cc:493] T 99164e2d6f664ceab4d5921867d62c31 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.743537 31013 raft_consensus.cc:493] T 671d30cec67d47a89e8ec6fab0c53c48 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.743858 30986 raft_consensus.cc:3060] T 99164e2d6f664ceab4d5921867d62c31 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.751024 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac15e10cad8e4cbc9763eacc349d9549" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:45.744340 31098 consensus_queue.cc:1048] T 2ff9e0d905854cceb79f96f500a07339 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.745375 31064 consensus_queue.cc:1048] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.742672 30980 ts_tablet_manager.cc:1434] T 8c580512b11742d4977ff026ff8fc795 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 12:13:45.748521 31056 raft_consensus.cc:515] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
W20260709 12:13:45.755048 30749 leader_election.cc:343] T ac15e10cad8e4cbc9763eacc349d9549 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:45.754010 31013 raft_consensus.cc:515] T 671d30cec67d47a89e8ec6fab0c53c48 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:45.756201 30749 leader_election.cc:304] T ac15e10cad8e4cbc9763eacc349d9549 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 84b98f9236604dd0b22ae23c5378a676; no voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad
I20260709 12:13:45.757105 30980 tablet_bootstrap.cc:492] T 1eb80935abae44bf8dde4d54961c5fdb P 8130e18710c04a61a5d8bd019c6ffdad: Bootstrap starting.
I20260709 12:13:45.760396 31056 leader_election.cc:290] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 election: Requested vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:45.761018 31056 raft_consensus.cc:2749] T ac15e10cad8e4cbc9763eacc349d9549 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:45.761581 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b500ac0d6a6419b8bc041e830d2dcf7" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:13:45.762261 30855 raft_consensus.cc:3060] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.763590 30980 tablet_bootstrap.cc:654] T 1eb80935abae44bf8dde4d54961c5fdb P 8130e18710c04a61a5d8bd019c6ffdad: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.767460 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b500ac0d6a6419b8bc041e830d2dcf7" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
I20260709 12:13:45.773609 30981 tablet_bootstrap.cc:492] T b9cc9d529de24234b98ed5e152fd4b24 P 84b98f9236604dd0b22ae23c5378a676: No bootstrap required, opened a new log
I20260709 12:13:45.774089 30981 ts_tablet_manager.cc:1403] T b9cc9d529de24234b98ed5e152fd4b24 P 84b98f9236604dd0b22ae23c5378a676: Time spent bootstrapping tablet: real 0.099s	user 0.013s	sys 0.028s
I20260709 12:13:45.776845 30981 raft_consensus.cc:359] T b9cc9d529de24234b98ed5e152fd4b24 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:45.777701 30981 raft_consensus.cc:385] T b9cc9d529de24234b98ed5e152fd4b24 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.777954 30981 raft_consensus.cc:740] T b9cc9d529de24234b98ed5e152fd4b24 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.778703 30981 consensus_queue.cc:260] T b9cc9d529de24234b98ed5e152fd4b24 P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:45.780383 30986 raft_consensus.cc:515] T 99164e2d6f664ceab4d5921867d62c31 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:45.781059 31013 leader_election.cc:290] T 671d30cec67d47a89e8ec6fab0c53c48 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:45.782110 30709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671d30cec67d47a89e8ec6fab0c53c48" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:45.782847 30981 ts_tablet_manager.cc:1434] T b9cc9d529de24234b98ed5e152fd4b24 P 84b98f9236604dd0b22ae23c5378a676: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
W20260709 12:13:45.784408 30750 leader_election.cc:343] T 671d30cec67d47a89e8ec6fab0c53c48 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:45.785566 30981 tablet_bootstrap.cc:492] T 0203e5cc33ca470eb9c1f366291c344d P 84b98f9236604dd0b22ae23c5378a676: Bootstrap starting.
I20260709 12:13:45.778206 31059 consensus_queue.cc:1048] T d5a270750666414887b6fae2f3793dc5 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:13:45.795236 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99164e2d6f664ceab4d5921867d62c31" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:13:45.799338 30981 tablet_bootstrap.cc:654] T 0203e5cc33ca470eb9c1f366291c344d P 84b98f9236604dd0b22ae23c5378a676: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.800784 30857 raft_consensus.cc:3060] T 99164e2d6f664ceab4d5921867d62c31 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.801209 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671d30cec67d47a89e8ec6fab0c53c48" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
W20260709 12:13:45.796538 30749 leader_election.cc:343] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:45.802937 31138 raft_consensus.cc:493] T b9cc9d529de24234b98ed5e152fd4b24 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.803462 31138 raft_consensus.cc:515] T b9cc9d529de24234b98ed5e152fd4b24 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:45.810087 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9cc9d529de24234b98ed5e152fd4b24" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:45.813565 31138 leader_election.cc:290] T b9cc9d529de24234b98ed5e152fd4b24 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:45.817224 30978 tablet_bootstrap.cc:492] T 5d636204e40644318b4758f37c7b0474 P 6c5665c17e904fc692bce76fc57b2460: No bootstrap required, opened a new log
I20260709 12:13:45.817878 30978 ts_tablet_manager.cc:1403] T 5d636204e40644318b4758f37c7b0474 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.175s	user 0.015s	sys 0.009s
I20260709 12:13:45.821537 30855 raft_consensus.cc:2468] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 1.
I20260709 12:13:45.822119 30980 tablet_bootstrap.cc:492] T 1eb80935abae44bf8dde4d54961c5fdb P 8130e18710c04a61a5d8bd019c6ffdad: No bootstrap required, opened a new log
I20260709 12:13:45.822642 30980 ts_tablet_manager.cc:1403] T 1eb80935abae44bf8dde4d54961c5fdb P 8130e18710c04a61a5d8bd019c6ffdad: Time spent bootstrapping tablet: real 0.066s	user 0.019s	sys 0.008s
I20260709 12:13:45.822450 30709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9cc9d529de24234b98ed5e152fd4b24" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:45.823213 30709 raft_consensus.cc:2468] T b9cc9d529de24234b98ed5e152fd4b24 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 0.
I20260709 12:13:45.824577 30750 leader_election.cc:304] T b9cc9d529de24234b98ed5e152fd4b24 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:13:45.825438 31138 raft_consensus.cc:2804] T b9cc9d529de24234b98ed5e152fd4b24 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:45.826172 31138 raft_consensus.cc:493] T b9cc9d529de24234b98ed5e152fd4b24 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.827247 31138 raft_consensus.cc:3060] T b9cc9d529de24234b98ed5e152fd4b24 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.825539 30709 raft_consensus.cc:3060] T 21c0ba9bb1d64ab398c606450f72e966 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.838644 30977 tablet_bootstrap.cc:654] T b9cc9d529de24234b98ed5e152fd4b24 P 15ad0880a63541ef965cb6acca4513d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.839089 30978 raft_consensus.cc:359] T 5d636204e40644318b4758f37c7b0474 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:45.839834 30978 raft_consensus.cc:385] T 5d636204e40644318b4758f37c7b0474 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.840214 30978 raft_consensus.cc:740] T 5d636204e40644318b4758f37c7b0474 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.844810 31042 raft_consensus.cc:493] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.845247 30986 leader_election.cc:290] T 99164e2d6f664ceab4d5921867d62c31 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Requested vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:45.845397 31042 raft_consensus.cc:515] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:45.847057 30708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99164e2d6f664ceab4d5921867d62c31" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
I20260709 12:13:45.847577 31042 leader_election.cc:290] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:45.847788 30748 leader_election.cc:304] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676; no voters: 15ad0880a63541ef965cb6acca4513d7
I20260709 12:13:45.848971 31013 raft_consensus.cc:2804] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:45.850340 30978 consensus_queue.cc:260] T 5d636204e40644318b4758f37c7b0474 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:45.854341 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd90e4c16c54e13ae2b1c1e08d6238c" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
W20260709 12:13:45.855232 30898 leader_election.cc:343] T 99164e2d6f664ceab4d5921867d62c31 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:45.849653 31013 raft_consensus.cc:697] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 84b98f9236604dd0b22ae23c5378a676 [term 1 LEADER]: Becoming Leader. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Running, Role: LEADER
W20260709 12:13:45.856073 30822 leader_election.cc:343] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:45.856495 31013 consensus_queue.cc:237] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:45.858496 30978 ts_tablet_manager.cc:1434] T 5d636204e40644318b4758f37c7b0474 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.001s
I20260709 12:13:45.859213 30708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd90e4c16c54e13ae2b1c1e08d6238c" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:45.860088 30708 raft_consensus.cc:2468] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 0.
I20260709 12:13:45.841045 30857 raft_consensus.cc:2468] T 99164e2d6f664ceab4d5921867d62c31 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 1.
I20260709 12:13:45.862341 30824 leader_election.cc:304] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:45.863193 30980 raft_consensus.cc:359] T 1eb80935abae44bf8dde4d54961c5fdb P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:45.863916 30980 raft_consensus.cc:385] T 1eb80935abae44bf8dde4d54961c5fdb P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.864197 30980 raft_consensus.cc:740] T 1eb80935abae44bf8dde4d54961c5fdb P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.864665 30981 tablet_bootstrap.cc:492] T 0203e5cc33ca470eb9c1f366291c344d P 84b98f9236604dd0b22ae23c5378a676: No bootstrap required, opened a new log
I20260709 12:13:45.864815 31042 raft_consensus.cc:2804] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:45.865141 30981 ts_tablet_manager.cc:1403] T 0203e5cc33ca470eb9c1f366291c344d P 84b98f9236604dd0b22ae23c5378a676: Time spent bootstrapping tablet: real 0.080s	user 0.014s	sys 0.002s
I20260709 12:13:45.864886 30980 consensus_queue.cc:260] T 1eb80935abae44bf8dde4d54961c5fdb P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:45.865415 31042 raft_consensus.cc:493] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.866204 31042 raft_consensus.cc:3060] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.867449 30980 ts_tablet_manager.cc:1434] T 1eb80935abae44bf8dde4d54961c5fdb P 8130e18710c04a61a5d8bd019c6ffdad: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 12:13:45.868685 30980 tablet_bootstrap.cc:492] T 491ae2039a6347a896b3a5aeacaa71b2 P 8130e18710c04a61a5d8bd019c6ffdad: Bootstrap starting.
I20260709 12:13:45.872690 30981 raft_consensus.cc:359] T 0203e5cc33ca470eb9c1f366291c344d P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:45.873386 30981 raft_consensus.cc:385] T 0203e5cc33ca470eb9c1f366291c344d P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.873663 30981 raft_consensus.cc:740] T 0203e5cc33ca470eb9c1f366291c344d P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.874315 30981 consensus_queue.cc:260] T 0203e5cc33ca470eb9c1f366291c344d P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:45.876173 30978 tablet_bootstrap.cc:492] T 8c580512b11742d4977ff026ff8fc795 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:45.876500 31138 raft_consensus.cc:515] T b9cc9d529de24234b98ed5e152fd4b24 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:45.880565 31042 raft_consensus.cc:515] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:45.886200 30708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9cc9d529de24234b98ed5e152fd4b24" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
I20260709 12:13:45.886967 30708 raft_consensus.cc:3060] T b9cc9d529de24234b98ed5e152fd4b24 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.887549 31042 leader_election.cc:290] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 election: Requested vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:45.888725 31138 leader_election.cc:290] T b9cc9d529de24234b98ed5e152fd4b24 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 election: Requested vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:45.880268 30980 tablet_bootstrap.cc:654] T 491ae2039a6347a896b3a5aeacaa71b2 P 8130e18710c04a61a5d8bd019c6ffdad: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.895533 30707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd90e4c16c54e13ae2b1c1e08d6238c" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
I20260709 12:13:45.895983 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd90e4c16c54e13ae2b1c1e08d6238c" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:13:45.896437 30707 raft_consensus.cc:3060] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:45.898025 30822 leader_election.cc:343] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:45.903716 30749 leader_election.cc:343] T 671d30cec67d47a89e8ec6fab0c53c48 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:45.904376 30749 leader_election.cc:304] T 671d30cec67d47a89e8ec6fab0c53c48 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 84b98f9236604dd0b22ae23c5378a676; no voters: 15ad0880a63541ef965cb6acca4513d7, 6c5665c17e904fc692bce76fc57b2460
W20260709 12:13:45.905820 30749 leader_election.cc:343] T b9cc9d529de24234b98ed5e152fd4b24 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:45.906855 31137 raft_consensus.cc:2749] T 671d30cec67d47a89e8ec6fab0c53c48 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:45.915349 31053 consensus_queue.cc:1048] T d5a270750666414887b6fae2f3793dc5 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.918200 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9cc9d529de24234b98ed5e152fd4b24" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
I20260709 12:13:45.919588 30896 leader_election.cc:304] T 99164e2d6f664ceab4d5921867d62c31 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:45.920753 30978 tablet_bootstrap.cc:654] T 8c580512b11742d4977ff026ff8fc795 P 6c5665c17e904fc692bce76fc57b2460: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.921808 31053 raft_consensus.cc:2804] T 99164e2d6f664ceab4d5921867d62c31 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:45.921329 30981 ts_tablet_manager.cc:1434] T 0203e5cc33ca470eb9c1f366291c344d P 84b98f9236604dd0b22ae23c5378a676: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.000s
I20260709 12:13:45.922483 31053 raft_consensus.cc:697] T 99164e2d6f664ceab4d5921867d62c31 P 15ad0880a63541ef965cb6acca4513d7 [term 1 LEADER]: Becoming Leader. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Running, Role: LEADER
I20260709 12:13:45.923707 30981 tablet_bootstrap.cc:492] T 5d636204e40644318b4758f37c7b0474 P 84b98f9236604dd0b22ae23c5378a676: Bootstrap starting.
I20260709 12:13:45.923976 31053 consensus_queue.cc:237] T 99164e2d6f664ceab4d5921867d62c31 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
W20260709 12:13:45.933686 30749 leader_election.cc:343] T b9cc9d529de24234b98ed5e152fd4b24 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:45.938081 30708 raft_consensus.cc:2468] T b9cc9d529de24234b98ed5e152fd4b24 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 1.
I20260709 12:13:45.943192 31038 raft_consensus.cc:493] T 21c0ba9bb1d64ab398c606450f72e966 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8130e18710c04a61a5d8bd019c6ffdad)
I20260709 12:13:45.944096 31038 raft_consensus.cc:515] T 21c0ba9bb1d64ab398c606450f72e966 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:45.944772 31064 raft_consensus.cc:493] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.945240 31064 raft_consensus.cc:515] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:45.948485 30977 tablet_bootstrap.cc:492] T b9cc9d529de24234b98ed5e152fd4b24 P 15ad0880a63541ef965cb6acca4513d7: No bootstrap required, opened a new log
I20260709 12:13:45.948973 30977 ts_tablet_manager.cc:1403] T b9cc9d529de24234b98ed5e152fd4b24 P 15ad0880a63541ef965cb6acca4513d7: Time spent bootstrapping tablet: real 0.238s	user 0.013s	sys 0.006s
I20260709 12:13:45.952127 30977 raft_consensus.cc:359] T b9cc9d529de24234b98ed5e152fd4b24 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:45.952791 30977 raft_consensus.cc:385] T b9cc9d529de24234b98ed5e152fd4b24 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.953032 30977 raft_consensus.cc:740] T b9cc9d529de24234b98ed5e152fd4b24 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.928305 30707 raft_consensus.cc:2468] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 1.
I20260709 12:13:45.957166 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b3eb62be46741aa9c0364ddea2ca5c9" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:45.954887 30977 consensus_queue.cc:260] T b9cc9d529de24234b98ed5e152fd4b24 P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:45.963863 30750 leader_election.cc:304] T b9cc9d529de24234b98ed5e152fd4b24 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460, 84b98f9236604dd0b22ae23c5378a676; no voters: 15ad0880a63541ef965cb6acca4513d7
I20260709 12:13:45.964758 31013 raft_consensus.cc:2804] T b9cc9d529de24234b98ed5e152fd4b24 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:45.965327 31013 raft_consensus.cc:697] T b9cc9d529de24234b98ed5e152fd4b24 P 84b98f9236604dd0b22ae23c5378a676 [term 1 LEADER]: Becoming Leader. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Running, Role: LEADER
I20260709 12:13:45.965842 31098 raft_consensus.cc:493] T 5d636204e40644318b4758f37c7b0474 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.966317 31098 raft_consensus.cc:515] T 5d636204e40644318b4758f37c7b0474 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:45.966293 31013 consensus_queue.cc:237] T b9cc9d529de24234b98ed5e152fd4b24 P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:45.968675 31098 leader_election.cc:290] T 5d636204e40644318b4758f37c7b0474 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:45.970737 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d636204e40644318b4758f37c7b0474" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:45.971643 30931 raft_consensus.cc:2468] T 5d636204e40644318b4758f37c7b0474 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 0.
I20260709 12:13:45.973647 30674 leader_election.cc:304] T 5d636204e40644318b4758f37c7b0474 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 6c5665c17e904fc692bce76fc57b2460; no voters: 
I20260709 12:13:45.974993 31098 raft_consensus.cc:2804] T 5d636204e40644318b4758f37c7b0474 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:45.975461 31098 raft_consensus.cc:493] T 5d636204e40644318b4758f37c7b0474 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.975914 31098 raft_consensus.cc:3060] T 5d636204e40644318b4758f37c7b0474 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.977728 30606 catalog_manager.cc:5697] T 99164e2d6f664ceab4d5921867d62c31 P 15ad0880a63541ef965cb6acca4513d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132). New cstate: current_term: 1 leader_uuid: "15ad0880a63541ef965cb6acca4513d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:45.983497 31038 leader_election.cc:290] T 21c0ba9bb1d64ab398c606450f72e966 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:45.984227 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b3eb62be46741aa9c0364ddea2ca5c9" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:45.984988 30857 raft_consensus.cc:2393] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c5665c17e904fc692bce76fc57b2460 in current term 1: Already voted for candidate 15ad0880a63541ef965cb6acca4513d7 in this term.
I20260709 12:13:45.988781 30977 ts_tablet_manager.cc:1434] T b9cc9d529de24234b98ed5e152fd4b24 P 15ad0880a63541ef965cb6acca4513d7: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.000s
I20260709 12:13:45.989817 30977 tablet_bootstrap.cc:492] T 671d30cec67d47a89e8ec6fab0c53c48 P 15ad0880a63541ef965cb6acca4513d7: Bootstrap starting.
I20260709 12:13:45.959926 31064 leader_election.cc:290] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:45.995905 30980 tablet_bootstrap.cc:492] T 491ae2039a6347a896b3a5aeacaa71b2 P 8130e18710c04a61a5d8bd019c6ffdad: No bootstrap required, opened a new log
I20260709 12:13:45.996380 30980 ts_tablet_manager.cc:1403] T 491ae2039a6347a896b3a5aeacaa71b2 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent bootstrapping tablet: real 0.128s	user 0.032s	sys 0.035s
I20260709 12:13:45.998710 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d636204e40644318b4758f37c7b0474" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:46.000178 30674 leader_election.cc:304] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460; no voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad
I20260709 12:13:46.001276 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c0ba9bb1d64ab398c606450f72e966" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:46.002266 30824 leader_election.cc:304] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:46.002655 31064 raft_consensus.cc:3060] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.996179 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c0ba9bb1d64ab398c606450f72e966" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:46.004974 30980 raft_consensus.cc:359] T 491ae2039a6347a896b3a5aeacaa71b2 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:46.006006 30980 raft_consensus.cc:385] T 491ae2039a6347a896b3a5aeacaa71b2 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.006376 30980 raft_consensus.cc:740] T 491ae2039a6347a896b3a5aeacaa71b2 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.011511 30981 tablet_bootstrap.cc:654] T 5d636204e40644318b4758f37c7b0474 P 84b98f9236604dd0b22ae23c5378a676: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.011220 30980 consensus_queue.cc:260] T 491ae2039a6347a896b3a5aeacaa71b2 P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:46.005720 31041 raft_consensus.cc:2804] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:46.018872 30989 raft_consensus.cc:493] T 491ae2039a6347a896b3a5aeacaa71b2 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.019415 30989 raft_consensus.cc:515] T 491ae2039a6347a896b3a5aeacaa71b2 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:46.021657 30989 leader_election.cc:290] T 491ae2039a6347a896b3a5aeacaa71b2 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
W20260709 12:13:46.013288 30673 leader_election.cc:343] T 5d636204e40644318b4758f37c7b0474 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:46.013833 31041 raft_consensus.cc:697] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 8130e18710c04a61a5d8bd019c6ffdad [term 1 LEADER]: Becoming Leader. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Running, Role: LEADER
I20260709 12:13:46.023444 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "491ae2039a6347a896b3a5aeacaa71b2" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:46.023761 30980 ts_tablet_manager.cc:1434] T 491ae2039a6347a896b3a5aeacaa71b2 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:13:46.023881 31041 consensus_queue.cc:237] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:46.024904 30980 tablet_bootstrap.cc:492] T c449839430794851b61ffba23f946c4f P 8130e18710c04a61a5d8bd019c6ffdad: Bootstrap starting.
W20260709 12:13:46.025297 30823 leader_election.cc:343] T 491ae2039a6347a896b3a5aeacaa71b2 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:46.015602 31053 raft_consensus.cc:493] T c5afc0720ca546d8b13026e7c7a30c1e P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.031981 30989 raft_consensus.cc:493] T b6f09adc18e2485cbafdb86cfe535721 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.038414 30674 leader_election.cc:304] T 21c0ba9bb1d64ab398c606450f72e966 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460; no voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad
I20260709 12:13:46.041530 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "491ae2039a6347a896b3a5aeacaa71b2" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:46.043301 31049 raft_consensus.cc:2749] T 21c0ba9bb1d64ab398c606450f72e966 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:46.047345 30822 leader_election.cc:343] T 491ae2039a6347a896b3a5aeacaa71b2 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:46.036834 31013 raft_consensus.cc:493] T 0203e5cc33ca470eb9c1f366291c344d P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.047840 30822 leader_election.cc:304] T 491ae2039a6347a896b3a5aeacaa71b2 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad; no voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:46.050415 31042 raft_consensus.cc:2749] T 491ae2039a6347a896b3a5aeacaa71b2 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:46.048573 31064 raft_consensus.cc:2749] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:46.051604 31098 raft_consensus.cc:515] T 5d636204e40644318b4758f37c7b0474 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:46.033954 30989 raft_consensus.cc:515] T b6f09adc18e2485cbafdb86cfe535721 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:46.055246 30989 leader_election.cc:290] T b6f09adc18e2485cbafdb86cfe535721 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:46.056711 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f09adc18e2485cbafdb86cfe535721" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:46.058565 30977 tablet_bootstrap.cc:654] T 671d30cec67d47a89e8ec6fab0c53c48 P 15ad0880a63541ef965cb6acca4513d7: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:46.058575 30823 leader_election.cc:343] T b6f09adc18e2485cbafdb86cfe535721 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:46.058741 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f09adc18e2485cbafdb86cfe535721" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:46.060364 31098 leader_election.cc:290] T 5d636204e40644318b4758f37c7b0474 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 election: Requested vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:46.032922 31053 raft_consensus.cc:515] T c5afc0720ca546d8b13026e7c7a30c1e P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
W20260709 12:13:46.064890 30822 leader_election.cc:343] T b6f09adc18e2485cbafdb86cfe535721 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:46.065582 30822 leader_election.cc:304] T b6f09adc18e2485cbafdb86cfe535721 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad; no voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:46.065840 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d636204e40644318b4758f37c7b0474" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
I20260709 12:13:46.067327 31042 raft_consensus.cc:2749] T b6f09adc18e2485cbafdb86cfe535721 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:46.069247 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d636204e40644318b4758f37c7b0474" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
W20260709 12:13:46.072445 30673 leader_election.cc:343] T 5d636204e40644318b4758f37c7b0474 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:46.068539 30930 raft_consensus.cc:3060] T 5d636204e40644318b4758f37c7b0474 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.083127 30978 tablet_bootstrap.cc:492] T 8c580512b11742d4977ff026ff8fc795 P 6c5665c17e904fc692bce76fc57b2460: No bootstrap required, opened a new log
I20260709 12:13:46.083869 30978 ts_tablet_manager.cc:1403] T 8c580512b11742d4977ff026ff8fc795 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.208s	user 0.037s	sys 0.020s
I20260709 12:13:46.053886 30604 catalog_manager.cc:5697] T b9cc9d529de24234b98ed5e152fd4b24 P 84b98f9236604dd0b22ae23c5378a676 reported cstate change: term changed from 0 to 1, leader changed from <none> to 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "84b98f9236604dd0b22ae23c5378a676" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:46.085693 31042 raft_consensus.cc:493] T 8c580512b11742d4977ff026ff8fc795 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.086408 31042 raft_consensus.cc:515] T 8c580512b11742d4977ff026ff8fc795 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:46.089164 30709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5afc0720ca546d8b13026e7c7a30c1e" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:46.089563 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c580512b11742d4977ff026ff8fc795" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:46.090214 30931 raft_consensus.cc:2468] T 8c580512b11742d4977ff026ff8fc795 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 0.
W20260709 12:13:46.090728 30898 leader_election.cc:343] T c5afc0720ca546d8b13026e7c7a30c1e P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:46.091511 30823 leader_election.cc:304] T 8c580512b11742d4977ff026ff8fc795 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 
I20260709 12:13:46.092001 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5afc0720ca546d8b13026e7c7a30c1e" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:46.092475 30989 raft_consensus.cc:2804] T 8c580512b11742d4977ff026ff8fc795 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:46.061244 31013 raft_consensus.cc:515] T 0203e5cc33ca470eb9c1f366291c344d P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:46.092882 30989 raft_consensus.cc:493] T 8c580512b11742d4977ff026ff8fc795 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:46.093277 30989 raft_consensus.cc:3060] T 8c580512b11742d4977ff026ff8fc795 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:46.093380 30896 leader_election.cc:343] T c5afc0720ca546d8b13026e7c7a30c1e P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:46.093899 30896 leader_election.cc:304] T c5afc0720ca546d8b13026e7c7a30c1e P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7; no voters: 6c5665c17e904fc692bce76fc57b2460, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:46.094882 30986 raft_consensus.cc:2749] T c5afc0720ca546d8b13026e7c7a30c1e P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:46.096589 30709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0203e5cc33ca470eb9c1f366291c344d" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:46.097352 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0203e5cc33ca470eb9c1f366291c344d" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
W20260709 12:13:46.098078 30750 leader_election.cc:343] T 0203e5cc33ca470eb9c1f366291c344d P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:46.098206 30855 raft_consensus.cc:2468] T 0203e5cc33ca470eb9c1f366291c344d P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 0.
I20260709 12:13:46.087759 30604 catalog_manager.cc:5697] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 84b98f9236604dd0b22ae23c5378a676 reported cstate change: term changed from 0 to 1, leader changed from <none> to 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "84b98f9236604dd0b22ae23c5378a676" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:46.099116 31053 leader_election.cc:290] T c5afc0720ca546d8b13026e7c7a30c1e P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:46.099465 31013 leader_election.cc:290] T 0203e5cc33ca470eb9c1f366291c344d P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:46.111209 30748 leader_election.cc:304] T 0203e5cc33ca470eb9c1f366291c344d P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676; no voters: 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:46.108275 31042 leader_election.cc:290] T 8c580512b11742d4977ff026ff8fc795 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:46.111479 30978 raft_consensus.cc:359] T 8c580512b11742d4977ff026ff8fc795 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:46.112035 30709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c580512b11742d4977ff026ff8fc795" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:46.116063 30978 raft_consensus.cc:385] T 8c580512b11742d4977ff026ff8fc795 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.116397 30978 raft_consensus.cc:740] T 8c580512b11742d4977ff026ff8fc795 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.117081 30978 consensus_queue.cc:260] T 8c580512b11742d4977ff026ff8fc795 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:46.119953 30709 raft_consensus.cc:2468] T 8c580512b11742d4977ff026ff8fc795 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 0.
I20260709 12:13:46.120049 30930 raft_consensus.cc:2468] T 5d636204e40644318b4758f37c7b0474 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 1.
I20260709 12:13:46.120615 31013 raft_consensus.cc:2804] T 0203e5cc33ca470eb9c1f366291c344d P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:46.120996 31013 raft_consensus.cc:493] T 0203e5cc33ca470eb9c1f366291c344d P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:46.121338 31013 raft_consensus.cc:3060] T 0203e5cc33ca470eb9c1f366291c344d P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.122517 30978 ts_tablet_manager.cc:1434] T 8c580512b11742d4977ff026ff8fc795 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 12:13:46.122869 30674 leader_election.cc:304] T 5d636204e40644318b4758f37c7b0474 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 6c5665c17e904fc692bce76fc57b2460; no voters: 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:46.123612 30978 tablet_bootstrap.cc:492] T 671d30cec67d47a89e8ec6fab0c53c48 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:46.124384 30981 tablet_bootstrap.cc:492] T 5d636204e40644318b4758f37c7b0474 P 84b98f9236604dd0b22ae23c5378a676: No bootstrap required, opened a new log
I20260709 12:13:46.124588 31038 raft_consensus.cc:2804] T 5d636204e40644318b4758f37c7b0474 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:46.124842 30981 ts_tablet_manager.cc:1403] T 5d636204e40644318b4758f37c7b0474 P 84b98f9236604dd0b22ae23c5378a676: Time spent bootstrapping tablet: real 0.201s	user 0.034s	sys 0.018s
I20260709 12:13:46.125171 31038 raft_consensus.cc:697] T 5d636204e40644318b4758f37c7b0474 P 6c5665c17e904fc692bce76fc57b2460 [term 1 LEADER]: Becoming Leader. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Running, Role: LEADER
I20260709 12:13:46.126154 31038 consensus_queue.cc:237] T 5d636204e40644318b4758f37c7b0474 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:46.127668 30981 raft_consensus.cc:359] T 5d636204e40644318b4758f37c7b0474 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:46.114841 30605 catalog_manager.cc:5697] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 8130e18710c04a61a5d8bd019c6ffdad reported cstate change: term changed from 0 to 1, leader changed from <none> to 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131). New cstate: current_term: 1 leader_uuid: "8130e18710c04a61a5d8bd019c6ffdad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:46.104496 31137 raft_consensus.cc:493] T c449839430794851b61ffba23f946c4f P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.128845 31137 raft_consensus.cc:515] T c449839430794851b61ffba23f946c4f P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:46.130194 30978 tablet_bootstrap.cc:654] T 671d30cec67d47a89e8ec6fab0c53c48 P 6c5665c17e904fc692bce76fc57b2460: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.133605 30989 raft_consensus.cc:515] T 8c580512b11742d4977ff026ff8fc795 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:46.134703 31013 raft_consensus.cc:515] T 0203e5cc33ca470eb9c1f366291c344d P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:46.135115 30709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c449839430794851b61ffba23f946c4f" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:46.137073 31137 leader_election.cc:290] T c449839430794851b61ffba23f946c4f P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
W20260709 12:13:46.137143 30750 leader_election.cc:343] T c449839430794851b61ffba23f946c4f P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:46.120250 30980 tablet_bootstrap.cc:654] T c449839430794851b61ffba23f946c4f P 8130e18710c04a61a5d8bd019c6ffdad: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.137637 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c580512b11742d4977ff026ff8fc795" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
I20260709 12:13:46.138031 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0203e5cc33ca470eb9c1f366291c344d" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:13:46.138366 30930 raft_consensus.cc:3060] T 8c580512b11742d4977ff026ff8fc795 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.138638 30857 raft_consensus.cc:3060] T 0203e5cc33ca470eb9c1f366291c344d P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.139456 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c449839430794851b61ffba23f946c4f" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
W20260709 12:13:46.140974 30748 leader_election.cc:343] T c449839430794851b61ffba23f946c4f P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:46.141635 30748 leader_election.cc:304] T c449839430794851b61ffba23f946c4f P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 84b98f9236604dd0b22ae23c5378a676; no voters: 6c5665c17e904fc692bce76fc57b2460, 8130e18710c04a61a5d8bd019c6ffdad
I20260709 12:13:46.141907 30707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c580512b11742d4977ff026ff8fc795" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
I20260709 12:13:46.142508 30707 raft_consensus.cc:3060] T 8c580512b11742d4977ff026ff8fc795 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.143069 31137 raft_consensus.cc:2749] T c449839430794851b61ffba23f946c4f P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:46.148159 30857 raft_consensus.cc:2468] T 0203e5cc33ca470eb9c1f366291c344d P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 1.
I20260709 12:13:46.149372 30748 leader_election.cc:304] T 0203e5cc33ca470eb9c1f366291c344d P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:13:46.150280 31137 raft_consensus.cc:2804] T 0203e5cc33ca470eb9c1f366291c344d P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:46.151000 31137 raft_consensus.cc:697] T 0203e5cc33ca470eb9c1f366291c344d P 84b98f9236604dd0b22ae23c5378a676 [term 1 LEADER]: Becoming Leader. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Running, Role: LEADER
I20260709 12:13:46.152233 30986 consensus_queue.cc:1048] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:46.152108 31137 consensus_queue.cc:237] T 0203e5cc33ca470eb9c1f366291c344d P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:46.128415 30981 raft_consensus.cc:385] T 5d636204e40644318b4758f37c7b0474 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.153596 30981 raft_consensus.cc:740] T 5d636204e40644318b4758f37c7b0474 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.138558 30709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0203e5cc33ca470eb9c1f366291c344d" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
I20260709 12:13:46.154524 31013 leader_election.cc:290] T 0203e5cc33ca470eb9c1f366291c344d P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 election: Requested vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
W20260709 12:13:46.155567 30750 leader_election.cc:343] T 0203e5cc33ca470eb9c1f366291c344d P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:46.163364 30977 tablet_bootstrap.cc:492] T 671d30cec67d47a89e8ec6fab0c53c48 P 15ad0880a63541ef965cb6acca4513d7: No bootstrap required, opened a new log
I20260709 12:13:46.163924 30977 ts_tablet_manager.cc:1403] T 671d30cec67d47a89e8ec6fab0c53c48 P 15ad0880a63541ef965cb6acca4513d7: Time spent bootstrapping tablet: real 0.174s	user 0.013s	sys 0.006s
I20260709 12:13:46.167169 30977 raft_consensus.cc:359] T 671d30cec67d47a89e8ec6fab0c53c48 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:46.167856 30977 raft_consensus.cc:385] T 671d30cec67d47a89e8ec6fab0c53c48 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.168112 30977 raft_consensus.cc:740] T 671d30cec67d47a89e8ec6fab0c53c48 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.169663 30989 leader_election.cc:290] T 8c580512b11742d4977ff026ff8fc795 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 election: Requested vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:46.171864 30981 consensus_queue.cc:260] T 5d636204e40644318b4758f37c7b0474 P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:46.174840 30977 consensus_queue.cc:260] T 671d30cec67d47a89e8ec6fab0c53c48 P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:46.170670 30980 tablet_bootstrap.cc:492] T c449839430794851b61ffba23f946c4f P 8130e18710c04a61a5d8bd019c6ffdad: No bootstrap required, opened a new log
I20260709 12:13:46.171512 30707 raft_consensus.cc:2468] T 8c580512b11742d4977ff026ff8fc795 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 1.
I20260709 12:13:46.176753 30980 ts_tablet_manager.cc:1403] T c449839430794851b61ffba23f946c4f P 8130e18710c04a61a5d8bd019c6ffdad: Time spent bootstrapping tablet: real 0.152s	user 0.014s	sys 0.003s
I20260709 12:13:46.177731 30824 leader_election.cc:304] T 8c580512b11742d4977ff026ff8fc795 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 
I20260709 12:13:46.179368 30989 raft_consensus.cc:2804] T 8c580512b11742d4977ff026ff8fc795 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:46.180150 30981 ts_tablet_manager.cc:1434] T 5d636204e40644318b4758f37c7b0474 P 84b98f9236604dd0b22ae23c5378a676: Time spent starting tablet: real 0.055s	user 0.004s	sys 0.004s
I20260709 12:13:46.180951 30989 raft_consensus.cc:697] T 8c580512b11742d4977ff026ff8fc795 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 LEADER]: Becoming Leader. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Running, Role: LEADER
I20260709 12:13:46.187304 30977 ts_tablet_manager.cc:1434] T 671d30cec67d47a89e8ec6fab0c53c48 P 15ad0880a63541ef965cb6acca4513d7: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.003s
I20260709 12:13:46.188486 30977 tablet_bootstrap.cc:492] T b6f09adc18e2485cbafdb86cfe535721 P 15ad0880a63541ef965cb6acca4513d7: Bootstrap starting.
I20260709 12:13:46.192585 30980 raft_consensus.cc:359] T c449839430794851b61ffba23f946c4f P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:46.193308 30980 raft_consensus.cc:385] T c449839430794851b61ffba23f946c4f P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.193578 30980 raft_consensus.cc:740] T c449839430794851b61ffba23f946c4f P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.181272 30981 tablet_bootstrap.cc:492] T 491ae2039a6347a896b3a5aeacaa71b2 P 84b98f9236604dd0b22ae23c5378a676: Bootstrap starting.
I20260709 12:13:46.200053 31059 consensus_queue.cc:1048] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:46.200771 30980 consensus_queue.cc:260] T c449839430794851b61ffba23f946c4f P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:46.203528 30930 raft_consensus.cc:2468] T 8c580512b11742d4977ff026ff8fc795 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 1.
I20260709 12:13:46.205435 31059 raft_consensus.cc:493] T 671d30cec67d47a89e8ec6fab0c53c48 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.205956 31059 raft_consensus.cc:515] T 671d30cec67d47a89e8ec6fab0c53c48 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:46.182296 30989 consensus_queue.cc:237] T 8c580512b11742d4977ff026ff8fc795 P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:46.207828 31042 raft_consensus.cc:493] T c449839430794851b61ffba23f946c4f P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.211406 31042 raft_consensus.cc:515] T c449839430794851b61ffba23f946c4f P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:46.212123 30980 ts_tablet_manager.cc:1434] T c449839430794851b61ffba23f946c4f P 8130e18710c04a61a5d8bd019c6ffdad: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.002s
I20260709 12:13:46.214658 31042 leader_election.cc:290] T c449839430794851b61ffba23f946c4f P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:46.210125 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671d30cec67d47a89e8ec6fab0c53c48" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:46.214679 30709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c449839430794851b61ffba23f946c4f" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:46.215427 30783 raft_consensus.cc:2468] T 671d30cec67d47a89e8ec6fab0c53c48 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 0.
I20260709 12:13:46.209926 31059 leader_election.cc:290] T 671d30cec67d47a89e8ec6fab0c53c48 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:46.217089 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c449839430794851b61ffba23f946c4f" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:46.217440 30977 tablet_bootstrap.cc:654] T b6f09adc18e2485cbafdb86cfe535721 P 15ad0880a63541ef965cb6acca4513d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.217805 30783 raft_consensus.cc:2468] T c449839430794851b61ffba23f946c4f P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 0.
I20260709 12:13:46.219178 30896 leader_election.cc:304] T 671d30cec67d47a89e8ec6fab0c53c48 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:13:46.219650 30604 catalog_manager.cc:5697] T 5d636204e40644318b4758f37c7b0474 P 6c5665c17e904fc692bce76fc57b2460 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129). New cstate: current_term: 1 leader_uuid: "6c5665c17e904fc692bce76fc57b2460" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:46.220237 30822 leader_election.cc:304] T c449839430794851b61ffba23f946c4f P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:13:46.214781 30980 tablet_bootstrap.cc:492] T cdf560ffbc0c4b8b80beb6494a13d9cd P 8130e18710c04a61a5d8bd019c6ffdad: Bootstrap starting.
W20260709 12:13:46.221663 30824 leader_election.cc:343] T c449839430794851b61ffba23f946c4f P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:46.221302 31042 raft_consensus.cc:2804] T c449839430794851b61ffba23f946c4f P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:46.223109 31042 raft_consensus.cc:493] T c449839430794851b61ffba23f946c4f P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:46.223551 31042 raft_consensus.cc:3060] T c449839430794851b61ffba23f946c4f P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.221772 31059 raft_consensus.cc:2804] T 671d30cec67d47a89e8ec6fab0c53c48 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:46.225638 31059 raft_consensus.cc:493] T 671d30cec67d47a89e8ec6fab0c53c48 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:46.220286 30981 tablet_bootstrap.cc:654] T 491ae2039a6347a896b3a5aeacaa71b2 P 84b98f9236604dd0b22ae23c5378a676: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.226049 31059 raft_consensus.cc:3060] T 671d30cec67d47a89e8ec6fab0c53c48 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.210870 30708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671d30cec67d47a89e8ec6fab0c53c48" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
W20260709 12:13:46.229734 30898 leader_election.cc:343] T 671d30cec67d47a89e8ec6fab0c53c48 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:46.232972 31059 raft_consensus.cc:515] T 671d30cec67d47a89e8ec6fab0c53c48 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:46.235908 30708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671d30cec67d47a89e8ec6fab0c53c48" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
I20260709 12:13:46.236763 30981 tablet_bootstrap.cc:492] T 491ae2039a6347a896b3a5aeacaa71b2 P 84b98f9236604dd0b22ae23c5378a676: No bootstrap required, opened a new log
I20260709 12:13:46.238606 30981 ts_tablet_manager.cc:1403] T 491ae2039a6347a896b3a5aeacaa71b2 P 84b98f9236604dd0b22ae23c5378a676: Time spent bootstrapping tablet: real 0.058s	user 0.002s	sys 0.010s
I20260709 12:13:46.239493 30607 catalog_manager.cc:5697] T 0203e5cc33ca470eb9c1f366291c344d P 84b98f9236604dd0b22ae23c5378a676 reported cstate change: term changed from 0 to 1, leader changed from <none> to 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "84b98f9236604dd0b22ae23c5378a676" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:46.241130 31042 raft_consensus.cc:515] T c449839430794851b61ffba23f946c4f P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:46.245891 31059 leader_election.cc:290] T 671d30cec67d47a89e8ec6fab0c53c48 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Requested vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:46.247332 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671d30cec67d47a89e8ec6fab0c53c48" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:13:46.247927 30783 raft_consensus.cc:3060] T 671d30cec67d47a89e8ec6fab0c53c48 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:46.249630 30898 leader_election.cc:343] T 671d30cec67d47a89e8ec6fab0c53c48 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:46.251045 30978 tablet_bootstrap.cc:492] T 671d30cec67d47a89e8ec6fab0c53c48 P 6c5665c17e904fc692bce76fc57b2460: No bootstrap required, opened a new log
I20260709 12:13:46.251787 30978 ts_tablet_manager.cc:1403] T 671d30cec67d47a89e8ec6fab0c53c48 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.128s	user 0.012s	sys 0.000s
I20260709 12:13:46.255913 30980 tablet_bootstrap.cc:654] T cdf560ffbc0c4b8b80beb6494a13d9cd P 8130e18710c04a61a5d8bd019c6ffdad: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.259914 30783 raft_consensus.cc:2468] T 671d30cec67d47a89e8ec6fab0c53c48 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 1.
I20260709 12:13:46.260576 30978 raft_consensus.cc:359] T 671d30cec67d47a89e8ec6fab0c53c48 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:46.261256 30978 raft_consensus.cc:385] T 671d30cec67d47a89e8ec6fab0c53c48 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.261471 30896 leader_election.cc:304] T 671d30cec67d47a89e8ec6fab0c53c48 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676; no voters: 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:46.263083 31059 raft_consensus.cc:2804] T 671d30cec67d47a89e8ec6fab0c53c48 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:46.263810 31059 raft_consensus.cc:697] T 671d30cec67d47a89e8ec6fab0c53c48 P 15ad0880a63541ef965cb6acca4513d7 [term 1 LEADER]: Becoming Leader. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Running, Role: LEADER
I20260709 12:13:46.264964 30977 tablet_bootstrap.cc:492] T b6f09adc18e2485cbafdb86cfe535721 P 15ad0880a63541ef965cb6acca4513d7: No bootstrap required, opened a new log
I20260709 12:13:46.264600 31059 consensus_queue.cc:237] T 671d30cec67d47a89e8ec6fab0c53c48 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:46.265460 30977 ts_tablet_manager.cc:1403] T b6f09adc18e2485cbafdb86cfe535721 P 15ad0880a63541ef965cb6acca4513d7: Time spent bootstrapping tablet: real 0.077s	user 0.010s	sys 0.000s
I20260709 12:13:46.268642 30981 raft_consensus.cc:359] T 491ae2039a6347a896b3a5aeacaa71b2 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:46.269829 31137 raft_consensus.cc:493] T 5d636204e40644318b4758f37c7b0474 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.270308 31137 raft_consensus.cc:515] T 5d636204e40644318b4758f37c7b0474 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:46.270864 31042 leader_election.cc:290] T c449839430794851b61ffba23f946c4f P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 election: Requested vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:46.272475 31137 leader_election.cc:290] T 5d636204e40644318b4758f37c7b0474 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:46.274214 30708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c449839430794851b61ffba23f946c4f" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
I20260709 12:13:46.274364 30707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d636204e40644318b4758f37c7b0474" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:46.277844 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d636204e40644318b4758f37c7b0474" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:46.274734 31042 raft_consensus.cc:493] T 1eb80935abae44bf8dde4d54961c5fdb P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.279060 31042 raft_consensus.cc:515] T 1eb80935abae44bf8dde4d54961c5fdb P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:46.280215 30930 raft_consensus.cc:2393] T 5d636204e40644318b4758f37c7b0474 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 84b98f9236604dd0b22ae23c5378a676 in current term 1: Already voted for candidate 6c5665c17e904fc692bce76fc57b2460 in this term.
I20260709 12:13:46.281661 30749 leader_election.cc:304] T 5d636204e40644318b4758f37c7b0474 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 84b98f9236604dd0b22ae23c5378a676; no voters: 15ad0880a63541ef965cb6acca4513d7, 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:46.282634 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb80935abae44bf8dde4d54961c5fdb" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:46.283133 31137 raft_consensus.cc:3060] T 5d636204e40644318b4758f37c7b0474 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.283419 30707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb80935abae44bf8dde4d54961c5fdb" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
W20260709 12:13:46.284080 30823 leader_election.cc:343] T 1eb80935abae44bf8dde4d54961c5fdb P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:46.285260 30824 leader_election.cc:343] T 1eb80935abae44bf8dde4d54961c5fdb P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:46.285847 30824 leader_election.cc:304] T 1eb80935abae44bf8dde4d54961c5fdb P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad; no voters: 15ad0880a63541ef965cb6acca4513d7, 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:46.286844 31042 leader_election.cc:290] T 1eb80935abae44bf8dde4d54961c5fdb P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:46.275403 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c449839430794851b61ffba23f946c4f" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:13:46.287750 31041 raft_consensus.cc:2749] T 1eb80935abae44bf8dde4d54961c5fdb P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:46.288084 30783 raft_consensus.cc:3060] T c449839430794851b61ffba23f946c4f P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.269383 30981 raft_consensus.cc:385] T 491ae2039a6347a896b3a5aeacaa71b2 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.291152 30981 raft_consensus.cc:740] T 491ae2039a6347a896b3a5aeacaa71b2 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.291906 30981 consensus_queue.cc:260] T 491ae2039a6347a896b3a5aeacaa71b2 P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:46.261503 30978 raft_consensus.cc:740] T 671d30cec67d47a89e8ec6fab0c53c48 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.292167 31137 raft_consensus.cc:2749] T 5d636204e40644318b4758f37c7b0474 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:46.293275 30978 consensus_queue.cc:260] T 671d30cec67d47a89e8ec6fab0c53c48 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:46.294915 30977 raft_consensus.cc:359] T b6f09adc18e2485cbafdb86cfe535721 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:46.298573 30977 raft_consensus.cc:385] T b6f09adc18e2485cbafdb86cfe535721 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.298905 30977 raft_consensus.cc:740] T b6f09adc18e2485cbafdb86cfe535721 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.299440 30978 ts_tablet_manager.cc:1434] T 671d30cec67d47a89e8ec6fab0c53c48 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.000s
I20260709 12:13:46.299695 30977 consensus_queue.cc:260] T b6f09adc18e2485cbafdb86cfe535721 P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:46.300690 30978 tablet_bootstrap.cc:492] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:46.301944 30977 ts_tablet_manager.cc:1434] T b6f09adc18e2485cbafdb86cfe535721 P 15ad0880a63541ef965cb6acca4513d7: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 12:13:46.302973 30977 tablet_bootstrap.cc:492] T 491ae2039a6347a896b3a5aeacaa71b2 P 15ad0880a63541ef965cb6acca4513d7: Bootstrap starting.
W20260709 12:13:46.304167 30824 leader_election.cc:343] T c449839430794851b61ffba23f946c4f P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:46.298250 30980 tablet_bootstrap.cc:492] T cdf560ffbc0c4b8b80beb6494a13d9cd P 8130e18710c04a61a5d8bd019c6ffdad: No bootstrap required, opened a new log
I20260709 12:13:46.315610 30980 ts_tablet_manager.cc:1403] T cdf560ffbc0c4b8b80beb6494a13d9cd P 8130e18710c04a61a5d8bd019c6ffdad: Time spent bootstrapping tablet: real 0.101s	user 0.029s	sys 0.008s
I20260709 12:13:46.316919 31137 raft_consensus.cc:493] T 491ae2039a6347a896b3a5aeacaa71b2 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.317634 30783 raft_consensus.cc:2468] T c449839430794851b61ffba23f946c4f P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 1.
I20260709 12:13:46.317492 31137 raft_consensus.cc:515] T 491ae2039a6347a896b3a5aeacaa71b2 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:46.318387 30980 raft_consensus.cc:359] T cdf560ffbc0c4b8b80beb6494a13d9cd P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:46.319049 30980 raft_consensus.cc:385] T cdf560ffbc0c4b8b80beb6494a13d9cd P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.318967 30822 leader_election.cc:304] T c449839430794851b61ffba23f946c4f P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676; no voters: 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:46.319572 30980 raft_consensus.cc:740] T cdf560ffbc0c4b8b80beb6494a13d9cd P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.320429 30989 raft_consensus.cc:2804] T c449839430794851b61ffba23f946c4f P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:46.320567 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "491ae2039a6347a896b3a5aeacaa71b2" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:46.321156 30989 raft_consensus.cc:697] T c449839430794851b61ffba23f946c4f P 8130e18710c04a61a5d8bd019c6ffdad [term 1 LEADER]: Becoming Leader. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Running, Role: LEADER
I20260709 12:13:46.321286 30857 raft_consensus.cc:2468] T 491ae2039a6347a896b3a5aeacaa71b2 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 0.
I20260709 12:13:46.322024 30989 consensus_queue.cc:237] T c449839430794851b61ffba23f946c4f P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:46.322465 30977 tablet_bootstrap.cc:654] T 491ae2039a6347a896b3a5aeacaa71b2 P 15ad0880a63541ef965cb6acca4513d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.322511 31137 leader_election.cc:290] T 491ae2039a6347a896b3a5aeacaa71b2 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:46.322554 30748 leader_election.cc:304] T 491ae2039a6347a896b3a5aeacaa71b2 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:13:46.306185 30981 ts_tablet_manager.cc:1434] T 491ae2039a6347a896b3a5aeacaa71b2 P 84b98f9236604dd0b22ae23c5378a676: Time spent starting tablet: real 0.067s	user 0.006s	sys 0.000s
I20260709 12:13:46.320376 30980 consensus_queue.cc:260] T cdf560ffbc0c4b8b80beb6494a13d9cd P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:46.324374 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "491ae2039a6347a896b3a5aeacaa71b2" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:46.324657 30981 tablet_bootstrap.cc:492] T cdf560ffbc0c4b8b80beb6494a13d9cd P 84b98f9236604dd0b22ae23c5378a676: Bootstrap starting.
I20260709 12:13:46.304582 30604 catalog_manager.cc:5697] T 8c580512b11742d4977ff026ff8fc795 P 8130e18710c04a61a5d8bd019c6ffdad reported cstate change: term changed from 0 to 1, leader changed from <none> to 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131). New cstate: current_term: 1 leader_uuid: "8130e18710c04a61a5d8bd019c6ffdad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:46.325371 30980 ts_tablet_manager.cc:1434] T cdf560ffbc0c4b8b80beb6494a13d9cd P 8130e18710c04a61a5d8bd019c6ffdad: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:13:46.326377 30980 tablet_bootstrap.cc:492] T ac15e10cad8e4cbc9763eacc349d9549 P 8130e18710c04a61a5d8bd019c6ffdad: Bootstrap starting.
W20260709 12:13:46.327109 30749 leader_election.cc:343] T 491ae2039a6347a896b3a5aeacaa71b2 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:46.328222 30606 catalog_manager.cc:5697] T 671d30cec67d47a89e8ec6fab0c53c48 P 15ad0880a63541ef965cb6acca4513d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132). New cstate: current_term: 1 leader_uuid: "15ad0880a63541ef965cb6acca4513d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:46.330694 31137 raft_consensus.cc:2804] T 491ae2039a6347a896b3a5aeacaa71b2 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:46.331691 30981 tablet_bootstrap.cc:654] T cdf560ffbc0c4b8b80beb6494a13d9cd P 84b98f9236604dd0b22ae23c5378a676: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.333220 30980 tablet_bootstrap.cc:654] T ac15e10cad8e4cbc9763eacc349d9549 P 8130e18710c04a61a5d8bd019c6ffdad: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.312568 30978 tablet_bootstrap.cc:654] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.344596 30977 tablet_bootstrap.cc:492] T 491ae2039a6347a896b3a5aeacaa71b2 P 15ad0880a63541ef965cb6acca4513d7: No bootstrap required, opened a new log
I20260709 12:13:46.345074 30977 ts_tablet_manager.cc:1403] T 491ae2039a6347a896b3a5aeacaa71b2 P 15ad0880a63541ef965cb6acca4513d7: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.000s
I20260709 12:13:46.347752 30977 raft_consensus.cc:359] T 491ae2039a6347a896b3a5aeacaa71b2 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:46.348402 30977 raft_consensus.cc:385] T 491ae2039a6347a896b3a5aeacaa71b2 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.357044 30977 raft_consensus.cc:740] T 491ae2039a6347a896b3a5aeacaa71b2 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.357762 30977 consensus_queue.cc:260] T 491ae2039a6347a896b3a5aeacaa71b2 P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:46.364567 30977 ts_tablet_manager.cc:1434] T 491ae2039a6347a896b3a5aeacaa71b2 P 15ad0880a63541ef965cb6acca4513d7: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 12:13:46.365684 30977 tablet_bootstrap.cc:492] T ac15e10cad8e4cbc9763eacc349d9549 P 15ad0880a63541ef965cb6acca4513d7: Bootstrap starting.
I20260709 12:13:46.372205 30980 tablet_bootstrap.cc:492] T ac15e10cad8e4cbc9763eacc349d9549 P 8130e18710c04a61a5d8bd019c6ffdad: No bootstrap required, opened a new log
I20260709 12:13:46.372967 30980 ts_tablet_manager.cc:1403] T ac15e10cad8e4cbc9763eacc349d9549 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.009s
I20260709 12:13:46.376435 30977 tablet_bootstrap.cc:654] T ac15e10cad8e4cbc9763eacc349d9549 P 15ad0880a63541ef965cb6acca4513d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.377117 30980 raft_consensus.cc:359] T ac15e10cad8e4cbc9763eacc349d9549 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:46.378111 30980 raft_consensus.cc:385] T ac15e10cad8e4cbc9763eacc349d9549 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.378494 30980 raft_consensus.cc:740] T ac15e10cad8e4cbc9763eacc349d9549 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.387122 30980 consensus_queue.cc:260] T ac15e10cad8e4cbc9763eacc349d9549 P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:46.391937 30977 tablet_bootstrap.cc:492] T ac15e10cad8e4cbc9763eacc349d9549 P 15ad0880a63541ef965cb6acca4513d7: No bootstrap required, opened a new log
I20260709 12:13:46.392414 30977 ts_tablet_manager.cc:1403] T ac15e10cad8e4cbc9763eacc349d9549 P 15ad0880a63541ef965cb6acca4513d7: Time spent bootstrapping tablet: real 0.027s	user 0.007s	sys 0.003s
I20260709 12:13:46.395747 30977 raft_consensus.cc:359] T ac15e10cad8e4cbc9763eacc349d9549 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:46.389901 31137 raft_consensus.cc:493] T 491ae2039a6347a896b3a5aeacaa71b2 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:46.396855 31137 raft_consensus.cc:3060] T 491ae2039a6347a896b3a5aeacaa71b2 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.396464 30977 raft_consensus.cc:385] T ac15e10cad8e4cbc9763eacc349d9549 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.404398 30980 ts_tablet_manager.cc:1434] T ac15e10cad8e4cbc9763eacc349d9549 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent starting tablet: real 0.031s	user 0.010s	sys 0.000s
I20260709 12:13:46.405999 30977 raft_consensus.cc:740] T ac15e10cad8e4cbc9763eacc349d9549 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.407166 31059 raft_consensus.cc:493] T b9cc9d529de24234b98ed5e152fd4b24 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.407670 31059 raft_consensus.cc:515] T b9cc9d529de24234b98ed5e152fd4b24 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:46.408658 30980 tablet_bootstrap.cc:492] T e57ee667f8a246eb98ab6b169eb779b9 P 8130e18710c04a61a5d8bd019c6ffdad: Bootstrap starting.
I20260709 12:13:46.410030 31059 leader_election.cc:290] T b9cc9d529de24234b98ed5e152fd4b24 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:46.411723 30708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9cc9d529de24234b98ed5e152fd4b24" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:46.412545 30708 raft_consensus.cc:2393] T b9cc9d529de24234b98ed5e152fd4b24 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 15ad0880a63541ef965cb6acca4513d7 in current term 1: Already voted for candidate 84b98f9236604dd0b22ae23c5378a676 in this term.
I20260709 12:13:46.419678 30980 tablet_bootstrap.cc:654] T e57ee667f8a246eb98ab6b169eb779b9 P 8130e18710c04a61a5d8bd019c6ffdad: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:46.421216 30749 consensus_peers.cc:597] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 84b98f9236604dd0b22ae23c5378a676 -> Peer 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035): Couldn't send request to peer 15ad0880a63541ef965cb6acca4513d7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:46.421000 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9cc9d529de24234b98ed5e152fd4b24" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:46.423427 30896 leader_election.cc:304] T b9cc9d529de24234b98ed5e152fd4b24 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7; no voters: 6c5665c17e904fc692bce76fc57b2460, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:46.423579 30606 catalog_manager.cc:5697] T c449839430794851b61ffba23f946c4f P 8130e18710c04a61a5d8bd019c6ffdad reported cstate change: term changed from 0 to 1, leader changed from <none> to 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131). New cstate: current_term: 1 leader_uuid: "8130e18710c04a61a5d8bd019c6ffdad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:46.424846 31059 raft_consensus.cc:493] T 491ae2039a6347a896b3a5aeacaa71b2 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.425171 31053 raft_consensus.cc:3060] T b9cc9d529de24234b98ed5e152fd4b24 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.425285 31059 raft_consensus.cc:515] T 491ae2039a6347a896b3a5aeacaa71b2 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:46.427506 31059 leader_election.cc:290] T 491ae2039a6347a896b3a5aeacaa71b2 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:46.430352 31059 raft_consensus.cc:493] T b6f09adc18e2485cbafdb86cfe535721 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.430786 31059 raft_consensus.cc:515] T b6f09adc18e2485cbafdb86cfe535721 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:46.432924 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "491ae2039a6347a896b3a5aeacaa71b2" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:46.433679 30857 raft_consensus.cc:2468] T 491ae2039a6347a896b3a5aeacaa71b2 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 0.
I20260709 12:13:46.436242 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "491ae2039a6347a896b3a5aeacaa71b2" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:46.437672 31013 consensus_queue.cc:1048] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:46.438740 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f09adc18e2485cbafdb86cfe535721" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:46.440948 30896 leader_election.cc:304] T 491ae2039a6347a896b3a5aeacaa71b2 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 
I20260709 12:13:46.443677 30977 consensus_queue.cc:260] T ac15e10cad8e4cbc9763eacc349d9549 P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:46.450943 30977 ts_tablet_manager.cc:1434] T ac15e10cad8e4cbc9763eacc349d9549 P 15ad0880a63541ef965cb6acca4513d7: Time spent starting tablet: real 0.058s	user 0.009s	sys 0.000s
I20260709 12:13:46.451725 30981 tablet_bootstrap.cc:492] T cdf560ffbc0c4b8b80beb6494a13d9cd P 84b98f9236604dd0b22ae23c5378a676: No bootstrap required, opened a new log
I20260709 12:13:46.452471 30981 ts_tablet_manager.cc:1403] T cdf560ffbc0c4b8b80beb6494a13d9cd P 84b98f9236604dd0b22ae23c5378a676: Time spent bootstrapping tablet: real 0.128s	user 0.022s	sys 0.016s
I20260709 12:13:46.454744 30977 tablet_bootstrap.cc:492] T dcddf9f7713c4d04abedc36356c1888f P 15ad0880a63541ef965cb6acca4513d7: Bootstrap starting.
I20260709 12:13:46.445341 30986 raft_consensus.cc:2804] T 491ae2039a6347a896b3a5aeacaa71b2 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:46.455317 30986 raft_consensus.cc:493] T 491ae2039a6347a896b3a5aeacaa71b2 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:46.455726 30986 raft_consensus.cc:3060] T 491ae2039a6347a896b3a5aeacaa71b2 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.456323 30981 raft_consensus.cc:359] T cdf560ffbc0c4b8b80beb6494a13d9cd P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:46.457056 30981 raft_consensus.cc:385] T cdf560ffbc0c4b8b80beb6494a13d9cd P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.457554 30981 raft_consensus.cc:740] T cdf560ffbc0c4b8b80beb6494a13d9cd P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.458516 30981 consensus_queue.cc:260] T cdf560ffbc0c4b8b80beb6494a13d9cd P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
W20260709 12:13:46.459086 30896 leader_election.cc:343] T b6f09adc18e2485cbafdb86cfe535721 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:46.461330 30981 ts_tablet_manager.cc:1434] T cdf560ffbc0c4b8b80beb6494a13d9cd P 84b98f9236604dd0b22ae23c5378a676: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:13:46.462042 30977 tablet_bootstrap.cc:654] T dcddf9f7713c4d04abedc36356c1888f P 15ad0880a63541ef965cb6acca4513d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.462620 30981 tablet_bootstrap.cc:492] T b6f09adc18e2485cbafdb86cfe535721 P 84b98f9236604dd0b22ae23c5378a676: Bootstrap starting.
I20260709 12:13:46.472988 31053 raft_consensus.cc:2749] T b9cc9d529de24234b98ed5e152fd4b24 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:46.475143 31059 leader_election.cc:290] T b6f09adc18e2485cbafdb86cfe535721 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:46.485684 30978 tablet_bootstrap.cc:492] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460: No bootstrap required, opened a new log
I20260709 12:13:46.485569 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f09adc18e2485cbafdb86cfe535721" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:46.486354 30978 ts_tablet_manager.cc:1403] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.186s	user 0.033s	sys 0.047s
I20260709 12:13:46.485632 31013 consensus_queue.cc:1048] T b9cc9d529de24234b98ed5e152fd4b24 P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:13:46.487326 30855 raft_consensus.cc:2468] T b6f09adc18e2485cbafdb86cfe535721 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 0.
I20260709 12:13:46.488831 30896 leader_election.cc:304] T b6f09adc18e2485cbafdb86cfe535721 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:46.489876 30978 raft_consensus.cc:359] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:46.490638 30978 raft_consensus.cc:385] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.490922 30978 raft_consensus.cc:740] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.491752 30978 consensus_queue.cc:260] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:46.492920 30989 raft_consensus.cc:493] T ac15e10cad8e4cbc9763eacc349d9549 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.493443 30989 raft_consensus.cc:515] T ac15e10cad8e4cbc9763eacc349d9549 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:46.446801 31137 raft_consensus.cc:515] T 491ae2039a6347a896b3a5aeacaa71b2 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:46.491603 31053 raft_consensus.cc:2804] T b6f09adc18e2485cbafdb86cfe535721 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:46.491727 30981 tablet_bootstrap.cc:654] T b6f09adc18e2485cbafdb86cfe535721 P 84b98f9236604dd0b22ae23c5378a676: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.504271 30978 ts_tablet_manager.cc:1434] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:13:46.505354 30978 tablet_bootstrap.cc:492] T c449839430794851b61ffba23f946c4f P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:46.507179 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac15e10cad8e4cbc9763eacc349d9549" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:46.507658 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac15e10cad8e4cbc9763eacc349d9549" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:46.507910 30781 raft_consensus.cc:2468] T ac15e10cad8e4cbc9763eacc349d9549 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 0.
I20260709 12:13:46.508299 30930 raft_consensus.cc:2468] T ac15e10cad8e4cbc9763eacc349d9549 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 0.
I20260709 12:13:46.509542 30823 leader_election.cc:304] T ac15e10cad8e4cbc9763eacc349d9549 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 
I20260709 12:13:46.510422 31042 raft_consensus.cc:2804] T ac15e10cad8e4cbc9763eacc349d9549 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:46.510780 31042 raft_consensus.cc:493] T ac15e10cad8e4cbc9763eacc349d9549 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:46.511286 30989 leader_election.cc:290] T ac15e10cad8e4cbc9763eacc349d9549 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:46.511027 31176 consensus_queue.cc:1048] T 99164e2d6f664ceab4d5921867d62c31 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:46.494700 30986 raft_consensus.cc:515] T 491ae2039a6347a896b3a5aeacaa71b2 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:46.511135 31042 raft_consensus.cc:3060] T ac15e10cad8e4cbc9763eacc349d9549 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.513851 30783 raft_consensus.cc:2393] T 491ae2039a6347a896b3a5aeacaa71b2 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 15ad0880a63541ef965cb6acca4513d7 in current term 1: Already voted for candidate 84b98f9236604dd0b22ae23c5378a676 in this term.
I20260709 12:13:46.498651 31053 raft_consensus.cc:493] T b6f09adc18e2485cbafdb86cfe535721 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:46.518429 31053 raft_consensus.cc:3060] T b6f09adc18e2485cbafdb86cfe535721 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:46.524375 30898 consensus_peers.cc:597] T 99164e2d6f664ceab4d5921867d62c31 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:46.530668 30980 tablet_bootstrap.cc:492] T e57ee667f8a246eb98ab6b169eb779b9 P 8130e18710c04a61a5d8bd019c6ffdad: No bootstrap required, opened a new log
I20260709 12:13:46.531239 30980 ts_tablet_manager.cc:1403] T e57ee667f8a246eb98ab6b169eb779b9 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent bootstrapping tablet: real 0.124s	user 0.017s	sys 0.010s
I20260709 12:13:46.541394 31137 leader_election.cc:290] T 491ae2039a6347a896b3a5aeacaa71b2 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 election: Requested vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:46.541895 30978 tablet_bootstrap.cc:654] T c449839430794851b61ffba23f946c4f P 6c5665c17e904fc692bce76fc57b2460: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.543197 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "491ae2039a6347a896b3a5aeacaa71b2" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:13:46.561605 30977 tablet_bootstrap.cc:492] T dcddf9f7713c4d04abedc36356c1888f P 15ad0880a63541ef965cb6acca4513d7: No bootstrap required, opened a new log
I20260709 12:13:46.551568 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "491ae2039a6347a896b3a5aeacaa71b2" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:13:46.578065 30783 raft_consensus.cc:2393] T 491ae2039a6347a896b3a5aeacaa71b2 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 15ad0880a63541ef965cb6acca4513d7 in current term 1: Already voted for candidate 84b98f9236604dd0b22ae23c5378a676 in this term.
I20260709 12:13:46.551589 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "491ae2039a6347a896b3a5aeacaa71b2" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
I20260709 12:13:46.541543 30980 raft_consensus.cc:359] T e57ee667f8a246eb98ab6b169eb779b9 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:46.569720 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "491ae2039a6347a896b3a5aeacaa71b2" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:13:46.578794 30981 tablet_bootstrap.cc:492] T b6f09adc18e2485cbafdb86cfe535721 P 84b98f9236604dd0b22ae23c5378a676: No bootstrap required, opened a new log
I20260709 12:13:46.562650 31038 consensus_queue.cc:1048] T 5d636204e40644318b4758f37c7b0474 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 12:13:46.588703 30980 raft_consensus.cc:385] T e57ee667f8a246eb98ab6b169eb779b9 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.607336 30980 raft_consensus.cc:740] T e57ee667f8a246eb98ab6b169eb779b9 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.607749 30981 ts_tablet_manager.cc:1403] T b6f09adc18e2485cbafdb86cfe535721 P 84b98f9236604dd0b22ae23c5378a676: Time spent bootstrapping tablet: real 0.146s	user 0.015s	sys 0.008s
I20260709 12:13:46.608166 30980 consensus_queue.cc:260] T e57ee667f8a246eb98ab6b169eb779b9 P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:46.609108 31098 consensus_queue.cc:1048] T 5d636204e40644318b4758f37c7b0474 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:46.610850 30981 raft_consensus.cc:359] T b6f09adc18e2485cbafdb86cfe535721 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:46.611634 30981 raft_consensus.cc:385] T b6f09adc18e2485cbafdb86cfe535721 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.611924 30981 raft_consensus.cc:740] T b6f09adc18e2485cbafdb86cfe535721 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.546785 30857 raft_consensus.cc:3060] T 491ae2039a6347a896b3a5aeacaa71b2 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.617319 30980 ts_tablet_manager.cc:1434] T e57ee667f8a246eb98ab6b169eb779b9 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent starting tablet: real 0.086s	user 0.006s	sys 0.002s
I20260709 12:13:46.618536 30980 tablet_bootstrap.cc:492] T dcddf9f7713c4d04abedc36356c1888f P 8130e18710c04a61a5d8bd019c6ffdad: Bootstrap starting.
I20260709 12:13:46.621901 30857 raft_consensus.cc:2468] T 491ae2039a6347a896b3a5aeacaa71b2 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 1.
I20260709 12:13:46.622295 31173 consensus_queue.cc:1048] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:46.623001 30981 consensus_queue.cc:260] T b6f09adc18e2485cbafdb86cfe535721 P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:46.623663 30748 leader_election.cc:304] T 491ae2039a6347a896b3a5aeacaa71b2 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:13:46.624609 31137 raft_consensus.cc:2804] T 491ae2039a6347a896b3a5aeacaa71b2 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:46.625172 30980 tablet_bootstrap.cc:654] T dcddf9f7713c4d04abedc36356c1888f P 8130e18710c04a61a5d8bd019c6ffdad: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.550437 30986 leader_election.cc:290] T 491ae2039a6347a896b3a5aeacaa71b2 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Requested vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:46.554414 31053 raft_consensus.cc:515] T b6f09adc18e2485cbafdb86cfe535721 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:46.630765 31053 leader_election.cc:290] T b6f09adc18e2485cbafdb86cfe535721 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Requested vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:46.577016 30977 ts_tablet_manager.cc:1403] T dcddf9f7713c4d04abedc36356c1888f P 15ad0880a63541ef965cb6acca4513d7: Time spent bootstrapping tablet: real 0.123s	user 0.014s	sys 0.019s
I20260709 12:13:46.596459 31138 consensus_queue.cc:1048] T b9cc9d529de24234b98ed5e152fd4b24 P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:46.635591 31038 raft_consensus.cc:493] T 671d30cec67d47a89e8ec6fab0c53c48 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.637645 31038 raft_consensus.cc:515] T 671d30cec67d47a89e8ec6fab0c53c48 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:46.644222 31038 leader_election.cc:290] T 671d30cec67d47a89e8ec6fab0c53c48 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:46.601249 30930 raft_consensus.cc:2393] T 491ae2039a6347a896b3a5aeacaa71b2 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 84b98f9236604dd0b22ae23c5378a676 in current term 1: Already voted for candidate 15ad0880a63541ef965cb6acca4513d7 in this term.
W20260709 12:13:46.571228 30750 consensus_peers.cc:597] T 0203e5cc33ca470eb9c1f366291c344d P 84b98f9236604dd0b22ae23c5378a676 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:46.625102 31137 raft_consensus.cc:697] T 491ae2039a6347a896b3a5aeacaa71b2 P 84b98f9236604dd0b22ae23c5378a676 [term 1 LEADER]: Becoming Leader. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Running, Role: LEADER
W20260709 12:13:46.599920 30654 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:13:46.655686 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:40909, user_credentials={real_user=slave}} blocked reactor thread for 84584.1us
I20260709 12:13:46.659693 31137 consensus_queue.cc:237] T 491ae2039a6347a896b3a5aeacaa71b2 P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:46.664390 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671d30cec67d47a89e8ec6fab0c53c48" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:46.665858 30781 raft_consensus.cc:2393] T 671d30cec67d47a89e8ec6fab0c53c48 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c5665c17e904fc692bce76fc57b2460 in current term 1: Already voted for candidate 15ad0880a63541ef965cb6acca4513d7 in this term.
I20260709 12:13:46.666047 30896 leader_election.cc:304] T 491ae2039a6347a896b3a5aeacaa71b2 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7; no voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:46.667796 31053 raft_consensus.cc:2749] T 491ae2039a6347a896b3a5aeacaa71b2 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:46.546499 31042 raft_consensus.cc:515] T ac15e10cad8e4cbc9763eacc349d9549 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:46.647588 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671d30cec67d47a89e8ec6fab0c53c48" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:46.634207 30977 raft_consensus.cc:359] T dcddf9f7713c4d04abedc36356c1888f P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:46.669503 30977 raft_consensus.cc:385] T dcddf9f7713c4d04abedc36356c1888f P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.669832 30977 raft_consensus.cc:740] T dcddf9f7713c4d04abedc36356c1888f P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.600184 30978 tablet_bootstrap.cc:492] T c449839430794851b61ffba23f946c4f P 6c5665c17e904fc692bce76fc57b2460: No bootstrap required, opened a new log
I20260709 12:13:46.670619 30978 ts_tablet_manager.cc:1403] T c449839430794851b61ffba23f946c4f P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.165s	user 0.010s	sys 0.012s
W20260709 12:13:46.675141 30822 consensus_peers.cc:597] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 8130e18710c04a61a5d8bd019c6ffdad -> Peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Couldn't send request to peer 84b98f9236604dd0b22ae23c5378a676. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:46.675580 30978 raft_consensus.cc:359] T c449839430794851b61ffba23f946c4f P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:46.676332 30978 raft_consensus.cc:385] T c449839430794851b61ffba23f946c4f P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.676611 30978 raft_consensus.cc:740] T c449839430794851b61ffba23f946c4f P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.679473 30977 consensus_queue.cc:260] T dcddf9f7713c4d04abedc36356c1888f P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:46.690090 30978 consensus_queue.cc:260] T c449839430794851b61ffba23f946c4f P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:46.698283 30674 leader_election.cc:304] T 671d30cec67d47a89e8ec6fab0c53c48 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460; no voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:46.700856 30981 ts_tablet_manager.cc:1434] T b6f09adc18e2485cbafdb86cfe535721 P 84b98f9236604dd0b22ae23c5378a676: Time spent starting tablet: real 0.093s	user 0.008s	sys 0.000s
I20260709 12:13:46.704531 30977 ts_tablet_manager.cc:1434] T dcddf9f7713c4d04abedc36356c1888f P 15ad0880a63541ef965cb6acca4513d7: Time spent starting tablet: real 0.073s	user 0.005s	sys 0.002s
I20260709 12:13:46.708266 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f09adc18e2485cbafdb86cfe535721" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:13:46.709108 30781 raft_consensus.cc:3060] T b6f09adc18e2485cbafdb86cfe535721 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.711767 31098 raft_consensus.cc:493] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.712491 31098 raft_consensus.cc:515] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:46.716238 30978 ts_tablet_manager.cc:1434] T c449839430794851b61ffba23f946c4f P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260709 12:13:46.739004 30981 tablet_bootstrap.cc:492] T c5afc0720ca546d8b13026e7c7a30c1e P 84b98f9236604dd0b22ae23c5378a676: Bootstrap starting.
I20260709 12:13:46.706007 31064 raft_consensus.cc:3060] T 671d30cec67d47a89e8ec6fab0c53c48 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.747157 30978 tablet_bootstrap.cc:492] T 0203e5cc33ca470eb9c1f366291c344d P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:46.752111 30977 tablet_bootstrap.cc:492] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 15ad0880a63541ef965cb6acca4513d7: Bootstrap starting.
I20260709 12:13:46.736397 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f09adc18e2485cbafdb86cfe535721" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:13:46.740370 31042 leader_election.cc:290] T ac15e10cad8e4cbc9763eacc349d9549 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 election: Requested vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:46.759406 31098 leader_election.cc:290] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:46.753720 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac15e10cad8e4cbc9763eacc349d9549" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:13:46.755548 30857 raft_consensus.cc:3060] T b6f09adc18e2485cbafdb86cfe535721 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.769882 30784 raft_consensus.cc:3060] T ac15e10cad8e4cbc9763eacc349d9549 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.773633 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf560ffbc0c4b8b80beb6494a13d9cd" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:46.774576 31159 raft_consensus.cc:493] T dcddf9f7713c4d04abedc36356c1888f P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.775130 30782 raft_consensus.cc:2468] T cdf560ffbc0c4b8b80beb6494a13d9cd P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 0.
I20260709 12:13:46.775161 31159 raft_consensus.cc:515] T dcddf9f7713c4d04abedc36356c1888f P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:46.776681 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac15e10cad8e4cbc9763eacc349d9549" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
I20260709 12:13:46.777235 30930 raft_consensus.cc:3060] T ac15e10cad8e4cbc9763eacc349d9549 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.777617 31159 leader_election.cc:290] T dcddf9f7713c4d04abedc36356c1888f P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:46.779805 30989 consensus_queue.cc:1048] T 8c580512b11742d4977ff026ff8fc795 P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:46.780748 31064 raft_consensus.cc:2749] T 671d30cec67d47a89e8ec6fab0c53c48 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:46.782063 30784 raft_consensus.cc:2468] T ac15e10cad8e4cbc9763eacc349d9549 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 1.
I20260709 12:13:46.785806 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf560ffbc0c4b8b80beb6494a13d9cd" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:46.786499 30855 raft_consensus.cc:2468] T cdf560ffbc0c4b8b80beb6494a13d9cd P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 0.
I20260709 12:13:46.787153 30989 raft_consensus.cc:493] T cdf560ffbc0c4b8b80beb6494a13d9cd P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.787590 30989 raft_consensus.cc:515] T cdf560ffbc0c4b8b80beb6494a13d9cd P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:46.789558 30989 leader_election.cc:290] T cdf560ffbc0c4b8b80beb6494a13d9cd P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:46.789950 30978 tablet_bootstrap.cc:654] T 0203e5cc33ca470eb9c1f366291c344d P 6c5665c17e904fc692bce76fc57b2460: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.794227 30857 raft_consensus.cc:2468] T b6f09adc18e2485cbafdb86cfe535721 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 1.
I20260709 12:13:46.796653 30980 tablet_bootstrap.cc:492] T dcddf9f7713c4d04abedc36356c1888f P 8130e18710c04a61a5d8bd019c6ffdad: No bootstrap required, opened a new log
I20260709 12:13:46.797580 30980 ts_tablet_manager.cc:1403] T dcddf9f7713c4d04abedc36356c1888f P 8130e18710c04a61a5d8bd019c6ffdad: Time spent bootstrapping tablet: real 0.179s	user 0.043s	sys 0.072s
I20260709 12:13:46.803591 30896 leader_election.cc:304] T b6f09adc18e2485cbafdb86cfe535721 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 
I20260709 12:13:46.805464 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf560ffbc0c4b8b80beb6494a13d9cd" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:46.806110 30782 raft_consensus.cc:2468] T cdf560ffbc0c4b8b80beb6494a13d9cd P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 0.
I20260709 12:13:46.806851 30706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf560ffbc0c4b8b80beb6494a13d9cd" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:46.807519 30706 raft_consensus.cc:2468] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 0.
I20260709 12:13:46.808670 30673 leader_election.cc:304] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:13:46.809624 31190 raft_consensus.cc:2804] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:46.810053 31190 raft_consensus.cc:493] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:46.810415 31190 raft_consensus.cc:3060] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.813382 30822 leader_election.cc:304] T ac15e10cad8e4cbc9763eacc349d9549 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:13:46.813748 30781 raft_consensus.cc:2468] T b6f09adc18e2485cbafdb86cfe535721 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 1.
I20260709 12:13:46.815464 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcddf9f7713c4d04abedc36356c1888f" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:46.816332 31042 raft_consensus.cc:2804] T ac15e10cad8e4cbc9763eacc349d9549 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:46.816903 31042 raft_consensus.cc:697] T ac15e10cad8e4cbc9763eacc349d9549 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 LEADER]: Becoming Leader. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Running, Role: LEADER
I20260709 12:13:46.803858 30977 tablet_bootstrap.cc:654] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 15ad0880a63541ef965cb6acca4513d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.820493 31190 raft_consensus.cc:515] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:46.820999 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcddf9f7713c4d04abedc36356c1888f" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:46.821313 30824 leader_election.cc:304] T cdf560ffbc0c4b8b80beb6494a13d9cd P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 
I20260709 12:13:46.823766 30930 raft_consensus.cc:2468] T ac15e10cad8e4cbc9763eacc349d9549 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 1.
I20260709 12:13:46.825793 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf560ffbc0c4b8b80beb6494a13d9cd" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:13:46.826542 30782 raft_consensus.cc:3060] T cdf560ffbc0c4b8b80beb6494a13d9cd P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.829558 30986 raft_consensus.cc:2804] T b6f09adc18e2485cbafdb86cfe535721 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:46.830135 30986 raft_consensus.cc:697] T b6f09adc18e2485cbafdb86cfe535721 P 15ad0880a63541ef965cb6acca4513d7 [term 1 LEADER]: Becoming Leader. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Running, Role: LEADER
I20260709 12:13:46.831377 30986 consensus_queue.cc:237] T b6f09adc18e2485cbafdb86cfe535721 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:46.833827 31137 consensus_queue.cc:1048] T 0203e5cc33ca470eb9c1f366291c344d P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:46.834334 30981 tablet_bootstrap.cc:654] T c5afc0720ca546d8b13026e7c7a30c1e P 84b98f9236604dd0b22ae23c5378a676: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.838222 31183 consensus_queue.cc:1048] T 671d30cec67d47a89e8ec6fab0c53c48 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:46.817837 31042 consensus_queue.cc:237] T ac15e10cad8e4cbc9763eacc349d9549 P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:46.850525 30978 tablet_bootstrap.cc:492] T 0203e5cc33ca470eb9c1f366291c344d P 6c5665c17e904fc692bce76fc57b2460: No bootstrap required, opened a new log
I20260709 12:13:46.850492 31174 raft_consensus.cc:2804] T cdf560ffbc0c4b8b80beb6494a13d9cd P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:46.851150 31174 raft_consensus.cc:493] T cdf560ffbc0c4b8b80beb6494a13d9cd P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:46.851270 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf560ffbc0c4b8b80beb6494a13d9cd" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:13:46.851521 31174 raft_consensus.cc:3060] T cdf560ffbc0c4b8b80beb6494a13d9cd P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.822877 31190 leader_election.cc:290] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 election: Requested vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:46.854126 30978 ts_tablet_manager.cc:1403] T 0203e5cc33ca470eb9c1f366291c344d P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.124s	user 0.029s	sys 0.019s
I20260709 12:13:46.863078 30980 raft_consensus.cc:359] T dcddf9f7713c4d04abedc36356c1888f P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
W20260709 12:13:46.847218 30896 leader_election.cc:343] T dcddf9f7713c4d04abedc36356c1888f P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:46.867709 30782 raft_consensus.cc:2468] T cdf560ffbc0c4b8b80beb6494a13d9cd P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 1.
I20260709 12:13:46.864369 30980 raft_consensus.cc:385] T dcddf9f7713c4d04abedc36356c1888f P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.872594 30980 raft_consensus.cc:740] T dcddf9f7713c4d04abedc36356c1888f P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.863116 31173 consensus_queue.cc:1048] T 8c580512b11742d4977ff026ff8fc795 P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Connected to new peer: Peer: permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
W20260709 12:13:46.883527 30896 leader_election.cc:343] T dcddf9f7713c4d04abedc36356c1888f P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:46.884020 30896 leader_election.cc:304] T dcddf9f7713c4d04abedc36356c1888f P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7; no voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:46.885982 30977 tablet_bootstrap.cc:492] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 15ad0880a63541ef965cb6acca4513d7: No bootstrap required, opened a new log
I20260709 12:13:46.886344 31159 raft_consensus.cc:2749] T dcddf9f7713c4d04abedc36356c1888f P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:46.887033 30977 ts_tablet_manager.cc:1403] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 15ad0880a63541ef965cb6acca4513d7: Time spent bootstrapping tablet: real 0.150s	user 0.014s	sys 0.011s
I20260709 12:13:46.887311 31159 consensus_queue.cc:1048] T 671d30cec67d47a89e8ec6fab0c53c48 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:46.881289 30980 consensus_queue.cc:260] T dcddf9f7713c4d04abedc36356c1888f P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:46.888352 30605 catalog_manager.cc:5697] T 491ae2039a6347a896b3a5aeacaa71b2 P 84b98f9236604dd0b22ae23c5378a676 reported cstate change: term changed from 0 to 1, leader changed from <none> to 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "84b98f9236604dd0b22ae23c5378a676" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:46.893343 30977 raft_consensus.cc:359] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:46.894465 30977 raft_consensus.cc:385] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.894807 30977 raft_consensus.cc:740] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.902205 31174 raft_consensus.cc:515] T cdf560ffbc0c4b8b80beb6494a13d9cd P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:46.902498 30673 leader_election.cc:304] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:13:46.895716 30977 consensus_queue.cc:260] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:46.910416 31192 raft_consensus.cc:493] T c449839430794851b61ffba23f946c4f P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.910895 31192 raft_consensus.cc:515] T c449839430794851b61ffba23f946c4f P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:46.912339 30980 ts_tablet_manager.cc:1434] T dcddf9f7713c4d04abedc36356c1888f P 8130e18710c04a61a5d8bd019c6ffdad: Time spent starting tablet: real 0.114s	user 0.005s	sys 0.002s
I20260709 12:13:46.913365 30980 tablet_bootstrap.cc:492] T 2971ad17262c4b5e8665700af97ec254 P 8130e18710c04a61a5d8bd019c6ffdad: Bootstrap starting.
I20260709 12:13:46.913611 30978 raft_consensus.cc:359] T 0203e5cc33ca470eb9c1f366291c344d P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:46.914076 31192 leader_election.cc:290] T c449839430794851b61ffba23f946c4f P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:46.914319 30978 raft_consensus.cc:385] T 0203e5cc33ca470eb9c1f366291c344d P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.914608 30978 raft_consensus.cc:740] T 0203e5cc33ca470eb9c1f366291c344d P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.917330 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c449839430794851b61ffba23f946c4f" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:46.920192 31098 raft_consensus.cc:2804] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:46.921708 31098 raft_consensus.cc:697] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460 [term 1 LEADER]: Becoming Leader. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Running, Role: LEADER
I20260709 12:13:46.922694 30855 raft_consensus.cc:2393] T cdf560ffbc0c4b8b80beb6494a13d9cd P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c5665c17e904fc692bce76fc57b2460 in current term 1: Already voted for candidate 8130e18710c04a61a5d8bd019c6ffdad in this term.
I20260709 12:13:46.923143 30980 tablet_bootstrap.cc:654] T 2971ad17262c4b5e8665700af97ec254 P 8130e18710c04a61a5d8bd019c6ffdad: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.922602 31098 consensus_queue.cc:237] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:46.925763 30978 consensus_queue.cc:260] T 0203e5cc33ca470eb9c1f366291c344d P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:46.931454 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c449839430794851b61ffba23f946c4f" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:46.935544 30981 tablet_bootstrap.cc:492] T c5afc0720ca546d8b13026e7c7a30c1e P 84b98f9236604dd0b22ae23c5378a676: No bootstrap required, opened a new log
I20260709 12:13:46.936192 30981 ts_tablet_manager.cc:1403] T c5afc0720ca546d8b13026e7c7a30c1e P 84b98f9236604dd0b22ae23c5378a676: Time spent bootstrapping tablet: real 0.207s	user 0.010s	sys 0.018s
I20260709 12:13:46.937071 30977 ts_tablet_manager.cc:1434] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 15ad0880a63541ef965cb6acca4513d7: Time spent starting tablet: real 0.050s	user 0.004s	sys 0.003s
I20260709 12:13:46.938104 30977 tablet_bootstrap.cc:492] T 2971ad17262c4b5e8665700af97ec254 P 15ad0880a63541ef965cb6acca4513d7: Bootstrap starting.
I20260709 12:13:46.943284 30981 raft_consensus.cc:359] T c5afc0720ca546d8b13026e7c7a30c1e P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:46.944176 30981 raft_consensus.cc:385] T c5afc0720ca546d8b13026e7c7a30c1e P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.944449 30981 raft_consensus.cc:740] T c5afc0720ca546d8b13026e7c7a30c1e P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.956609 30709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf560ffbc0c4b8b80beb6494a13d9cd" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
I20260709 12:13:46.948814 31174 leader_election.cc:290] T cdf560ffbc0c4b8b80beb6494a13d9cd P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 election: Requested vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:46.957944 31174 consensus_queue.cc:1048] T c449839430794851b61ffba23f946c4f P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Connected to new peer: Peer: permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:46.960335 30707 raft_consensus.cc:3060] T c449839430794851b61ffba23f946c4f P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.962635 30978 ts_tablet_manager.cc:1434] T 0203e5cc33ca470eb9c1f366291c344d P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.108s	user 0.007s	sys 0.000s
I20260709 12:13:46.963726 30978 tablet_bootstrap.cc:492] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:46.969316 30673 leader_election.cc:304] T c449839430794851b61ffba23f946c4f P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460; no voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:46.974319 31064 raft_consensus.cc:2749] T c449839430794851b61ffba23f946c4f P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:46.976270 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf560ffbc0c4b8b80beb6494a13d9cd" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:13:46.977025 30782 raft_consensus.cc:2393] T cdf560ffbc0c4b8b80beb6494a13d9cd P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8130e18710c04a61a5d8bd019c6ffdad in current term 1: Already voted for candidate 6c5665c17e904fc692bce76fc57b2460 in this term.
I20260709 12:13:46.981462 30930 raft_consensus.cc:3060] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.979314 31174 consensus_queue.cc:1048] T c449839430794851b61ffba23f946c4f P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:13:46.986490 30978 tablet_bootstrap.cc:654] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.986292 30822 leader_election.cc:304] T cdf560ffbc0c4b8b80beb6494a13d9cd P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad; no voters: 6c5665c17e904fc692bce76fc57b2460, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:46.965296 30981 consensus_queue.cc:260] T c5afc0720ca546d8b13026e7c7a30c1e P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:47.005975 30981 ts_tablet_manager.cc:1434] T c5afc0720ca546d8b13026e7c7a30c1e P 84b98f9236604dd0b22ae23c5378a676: Time spent starting tablet: real 0.069s	user 0.007s	sys 0.000s
I20260709 12:13:47.020757 31196 raft_consensus.cc:2749] T cdf560ffbc0c4b8b80beb6494a13d9cd P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:47.021996 31196 raft_consensus.cc:493] T e57ee667f8a246eb98ab6b169eb779b9 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.023686 31196 raft_consensus.cc:515] T e57ee667f8a246eb98ab6b169eb779b9 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:47.031895 30980 tablet_bootstrap.cc:492] T 2971ad17262c4b5e8665700af97ec254 P 8130e18710c04a61a5d8bd019c6ffdad: No bootstrap required, opened a new log
I20260709 12:13:47.032462 30980 ts_tablet_manager.cc:1403] T 2971ad17262c4b5e8665700af97ec254 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent bootstrapping tablet: real 0.119s	user 0.012s	sys 0.000s
I20260709 12:13:47.034710 30708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57ee667f8a246eb98ab6b169eb779b9" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
W20260709 12:13:47.036242 30824 leader_election.cc:343] T e57ee667f8a246eb98ab6b169eb779b9 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:47.037238 30980 raft_consensus.cc:359] T 2971ad17262c4b5e8665700af97ec254 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:47.037927 30980 raft_consensus.cc:385] T 2971ad17262c4b5e8665700af97ec254 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.038199 30980 raft_consensus.cc:740] T 2971ad17262c4b5e8665700af97ec254 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.040016 31196 leader_election.cc:290] T e57ee667f8a246eb98ab6b169eb779b9 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:47.040580 30708 raft_consensus.cc:3060] T 0203e5cc33ca470eb9c1f366291c344d P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.049083 30977 tablet_bootstrap.cc:654] T 2971ad17262c4b5e8665700af97ec254 P 15ad0880a63541ef965cb6acca4513d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.052565 30981 tablet_bootstrap.cc:492] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 84b98f9236604dd0b22ae23c5378a676: Bootstrap starting.
I20260709 12:13:47.053439 30980 consensus_queue.cc:260] T 2971ad17262c4b5e8665700af97ec254 P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:47.061559 30607 catalog_manager.cc:5697] T ac15e10cad8e4cbc9763eacc349d9549 P 8130e18710c04a61a5d8bd019c6ffdad reported cstate change: term changed from 0 to 1, leader changed from <none> to 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131). New cstate: current_term: 1 leader_uuid: "8130e18710c04a61a5d8bd019c6ffdad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:47.065726 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57ee667f8a246eb98ab6b169eb779b9" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
W20260709 12:13:47.067508 30822 leader_election.cc:343] T e57ee667f8a246eb98ab6b169eb779b9 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:47.068009 30822 leader_election.cc:304] T e57ee667f8a246eb98ab6b169eb779b9 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad; no voters: 6c5665c17e904fc692bce76fc57b2460, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:47.068799 31173 raft_consensus.cc:2749] T e57ee667f8a246eb98ab6b169eb779b9 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:47.070081 30980 ts_tablet_manager.cc:1434] T 2971ad17262c4b5e8665700af97ec254 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 12:13:47.070766 30978 tablet_bootstrap.cc:492] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460: No bootstrap required, opened a new log
I20260709 12:13:47.071295 30978 ts_tablet_manager.cc:1403] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.108s	user 0.020s	sys 0.021s
I20260709 12:13:47.072986 30980 tablet_bootstrap.cc:492] T 2137918dbdc34ac29180015bd93261de P 8130e18710c04a61a5d8bd019c6ffdad: Bootstrap starting.
I20260709 12:13:47.096721 30981 tablet_bootstrap.cc:654] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 84b98f9236604dd0b22ae23c5378a676: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.089264 30978 raft_consensus.cc:359] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:47.099406 30978 raft_consensus.cc:385] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.099565 30980 tablet_bootstrap.cc:654] T 2137918dbdc34ac29180015bd93261de P 8130e18710c04a61a5d8bd019c6ffdad: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.099774 30978 raft_consensus.cc:740] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.100719 30978 consensus_queue.cc:260] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:47.104858 30978 ts_tablet_manager.cc:1434] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.002s
I20260709 12:13:47.109103 30978 tablet_bootstrap.cc:492] T c5afc0720ca546d8b13026e7c7a30c1e P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:47.128708 30978 tablet_bootstrap.cc:654] T c5afc0720ca546d8b13026e7c7a30c1e P 6c5665c17e904fc692bce76fc57b2460: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.142181 30978 tablet_bootstrap.cc:492] T c5afc0720ca546d8b13026e7c7a30c1e P 6c5665c17e904fc692bce76fc57b2460: No bootstrap required, opened a new log
I20260709 12:13:47.142763 30978 ts_tablet_manager.cc:1403] T c5afc0720ca546d8b13026e7c7a30c1e P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.005s
I20260709 12:13:47.146497 30978 raft_consensus.cc:359] T c5afc0720ca546d8b13026e7c7a30c1e P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:47.147506 30978 raft_consensus.cc:385] T c5afc0720ca546d8b13026e7c7a30c1e P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.147843 30978 raft_consensus.cc:740] T c5afc0720ca546d8b13026e7c7a30c1e P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.148741 30978 consensus_queue.cc:260] T c5afc0720ca546d8b13026e7c7a30c1e P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:47.150859 30978 ts_tablet_manager.cc:1434] T c5afc0720ca546d8b13026e7c7a30c1e P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 12:13:47.151926 30978 tablet_bootstrap.cc:492] T 99164e2d6f664ceab4d5921867d62c31 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:47.159004 30978 tablet_bootstrap.cc:654] T 99164e2d6f664ceab4d5921867d62c31 P 6c5665c17e904fc692bce76fc57b2460: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.183513 30977 tablet_bootstrap.cc:492] T 2971ad17262c4b5e8665700af97ec254 P 15ad0880a63541ef965cb6acca4513d7: No bootstrap required, opened a new log
I20260709 12:13:47.184041 30977 ts_tablet_manager.cc:1403] T 2971ad17262c4b5e8665700af97ec254 P 15ad0880a63541ef965cb6acca4513d7: Time spent bootstrapping tablet: real 0.246s	user 0.017s	sys 0.011s
I20260709 12:13:47.187126 30977 raft_consensus.cc:359] T 2971ad17262c4b5e8665700af97ec254 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:47.187832 30977 raft_consensus.cc:385] T 2971ad17262c4b5e8665700af97ec254 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.188114 30977 raft_consensus.cc:740] T 2971ad17262c4b5e8665700af97ec254 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.188748 30977 consensus_queue.cc:260] T 2971ad17262c4b5e8665700af97ec254 P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:47.193231 30977 ts_tablet_manager.cc:1434] T 2971ad17262c4b5e8665700af97ec254 P 15ad0880a63541ef965cb6acca4513d7: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:13:47.193594 30981 tablet_bootstrap.cc:492] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 84b98f9236604dd0b22ae23c5378a676: No bootstrap required, opened a new log
I20260709 12:13:47.193992 30980 tablet_bootstrap.cc:492] T 2137918dbdc34ac29180015bd93261de P 8130e18710c04a61a5d8bd019c6ffdad: No bootstrap required, opened a new log
I20260709 12:13:47.194173 30981 ts_tablet_manager.cc:1403] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 84b98f9236604dd0b22ae23c5378a676: Time spent bootstrapping tablet: real 0.164s	user 0.015s	sys 0.011s
I20260709 12:13:47.194352 30977 tablet_bootstrap.cc:492] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7: Bootstrap starting.
I20260709 12:13:47.194644 30980 ts_tablet_manager.cc:1403] T 2137918dbdc34ac29180015bd93261de P 8130e18710c04a61a5d8bd019c6ffdad: Time spent bootstrapping tablet: real 0.124s	user 0.010s	sys 0.004s
I20260709 12:13:47.197392 30980 raft_consensus.cc:359] T 2137918dbdc34ac29180015bd93261de P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:47.197688 30981 raft_consensus.cc:359] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:47.198402 30981 raft_consensus.cc:385] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.198688 30981 raft_consensus.cc:740] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.199628 30981 consensus_queue.cc:260] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:47.201292 30978 tablet_bootstrap.cc:492] T 99164e2d6f664ceab4d5921867d62c31 P 6c5665c17e904fc692bce76fc57b2460: No bootstrap required, opened a new log
I20260709 12:13:47.201314 30977 tablet_bootstrap.cc:654] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.201946 30978 ts_tablet_manager.cc:1403] T 99164e2d6f664ceab4d5921867d62c31 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.002s
I20260709 12:13:47.202160 30981 ts_tablet_manager.cc:1434] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 84b98f9236604dd0b22ae23c5378a676: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:13:47.203287 30981 tablet_bootstrap.cc:492] T e57ee667f8a246eb98ab6b169eb779b9 P 84b98f9236604dd0b22ae23c5378a676: Bootstrap starting.
I20260709 12:13:47.205391 30978 raft_consensus.cc:359] T 99164e2d6f664ceab4d5921867d62c31 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:47.206278 30978 raft_consensus.cc:385] T 99164e2d6f664ceab4d5921867d62c31 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.206604 30978 raft_consensus.cc:740] T 99164e2d6f664ceab4d5921867d62c31 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.207394 30978 consensus_queue.cc:260] T 99164e2d6f664ceab4d5921867d62c31 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:47.209197 30981 tablet_bootstrap.cc:654] T e57ee667f8a246eb98ab6b169eb779b9 P 84b98f9236604dd0b22ae23c5378a676: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.210533 30978 ts_tablet_manager.cc:1434] T 99164e2d6f664ceab4d5921867d62c31 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:13:47.211987 30978 tablet_bootstrap.cc:492] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:47.198138 30980 raft_consensus.cc:385] T 2137918dbdc34ac29180015bd93261de P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.219868 30980 raft_consensus.cc:740] T 2137918dbdc34ac29180015bd93261de P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.220695 30980 consensus_queue.cc:260] T 2137918dbdc34ac29180015bd93261de P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:47.222595 30978 tablet_bootstrap.cc:654] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.222675 30981 tablet_bootstrap.cc:492] T e57ee667f8a246eb98ab6b169eb779b9 P 84b98f9236604dd0b22ae23c5378a676: No bootstrap required, opened a new log
I20260709 12:13:47.223374 30981 ts_tablet_manager.cc:1403] T e57ee667f8a246eb98ab6b169eb779b9 P 84b98f9236604dd0b22ae23c5378a676: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.005s
I20260709 12:13:47.223958 30980 ts_tablet_manager.cc:1434] T 2137918dbdc34ac29180015bd93261de P 8130e18710c04a61a5d8bd019c6ffdad: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.001s
I20260709 12:13:47.225056 30980 tablet_bootstrap.cc:492] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad: Bootstrap starting.
I20260709 12:13:47.226850 30977 tablet_bootstrap.cc:492] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7: No bootstrap required, opened a new log
I20260709 12:13:47.226640 30981 raft_consensus.cc:359] T e57ee667f8a246eb98ab6b169eb779b9 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:47.227346 30977 ts_tablet_manager.cc:1403] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.013s
I20260709 12:13:47.227373 30981 raft_consensus.cc:385] T e57ee667f8a246eb98ab6b169eb779b9 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.227881 30981 raft_consensus.cc:740] T e57ee667f8a246eb98ab6b169eb779b9 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.228600 30981 consensus_queue.cc:260] T e57ee667f8a246eb98ab6b169eb779b9 P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:47.230161 30977 raft_consensus.cc:359] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:47.230810 30981 ts_tablet_manager.cc:1434] T e57ee667f8a246eb98ab6b169eb779b9 P 84b98f9236604dd0b22ae23c5378a676: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:13:47.231003 30977 raft_consensus.cc:385] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.231369 30977 raft_consensus.cc:740] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.232061 30977 consensus_queue.cc:260] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:47.233357 30980 tablet_bootstrap.cc:654] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.233636 30977 ts_tablet_manager.cc:1434] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:13:47.234026 30981 tablet_bootstrap.cc:492] T 5323645d8e844a489d166a94c77c2af1 P 84b98f9236604dd0b22ae23c5378a676: Bootstrap starting.
I20260709 12:13:47.234774 30977 tablet_bootstrap.cc:492] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7: Bootstrap starting.
I20260709 12:13:47.241649 30977 tablet_bootstrap.cc:654] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.242672 30981 tablet_bootstrap.cc:654] T 5323645d8e844a489d166a94c77c2af1 P 84b98f9236604dd0b22ae23c5378a676: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.314374 31013 consensus_queue.cc:1048] T 491ae2039a6347a896b3a5aeacaa71b2 P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:47.316089 31013 raft_consensus.cc:493] T e57ee667f8a246eb98ab6b169eb779b9 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.317078 31013 raft_consensus.cc:515] T e57ee667f8a246eb98ab6b169eb779b9 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:47.319857 31013 leader_election.cc:290] T e57ee667f8a246eb98ab6b169eb779b9 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:47.320163 30708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57ee667f8a246eb98ab6b169eb779b9" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
W20260709 12:13:47.321960 30750 leader_election.cc:343] T e57ee667f8a246eb98ab6b169eb779b9 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:47.398279 31221 raft_consensus.cc:493] T 99164e2d6f664ceab4d5921867d62c31 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.398762 31221 raft_consensus.cc:515] T 99164e2d6f664ceab4d5921867d62c31 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:47.401593 31221 leader_election.cc:290] T 99164e2d6f664ceab4d5921867d62c31 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:47.402720 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99164e2d6f664ceab4d5921867d62c31" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:47.405936 30977 tablet_bootstrap.cc:492] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7: No bootstrap required, opened a new log
I20260709 12:13:47.406476 30977 ts_tablet_manager.cc:1403] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7: Time spent bootstrapping tablet: real 0.172s	user 0.023s	sys 0.011s
I20260709 12:13:47.413229 30977 raft_consensus.cc:359] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:47.413950 30977 raft_consensus.cc:385] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.414213 30977 raft_consensus.cc:740] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.414916 30977 consensus_queue.cc:260] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:47.424937 30977 ts_tablet_manager.cc:1434] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.001s
I20260709 12:13:47.425385 31173 raft_consensus.cc:493] T dcddf9f7713c4d04abedc36356c1888f P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.425959 30977 tablet_bootstrap.cc:492] T 1eb80935abae44bf8dde4d54961c5fdb P 15ad0880a63541ef965cb6acca4513d7: Bootstrap starting.
I20260709 12:13:47.425897 31173 raft_consensus.cc:515] T dcddf9f7713c4d04abedc36356c1888f P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:47.428200 30980 tablet_bootstrap.cc:492] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad: No bootstrap required, opened a new log
I20260709 12:13:47.428823 30980 ts_tablet_manager.cc:1403] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent bootstrapping tablet: real 0.204s	user 0.020s	sys 0.023s
I20260709 12:13:47.423655 31013 raft_consensus.cc:493] T c5afc0720ca546d8b13026e7c7a30c1e P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.429759 31013 raft_consensus.cc:515] T c5afc0720ca546d8b13026e7c7a30c1e P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:47.428128 31173 leader_election.cc:290] T dcddf9f7713c4d04abedc36356c1888f P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:47.431947 31013 leader_election.cc:290] T c5afc0720ca546d8b13026e7c7a30c1e P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:47.434478 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcddf9f7713c4d04abedc36356c1888f" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:47.436316 30708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5afc0720ca546d8b13026e7c7a30c1e" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:47.437018 30708 raft_consensus.cc:2468] T c5afc0720ca546d8b13026e7c7a30c1e P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 0.
I20260709 12:13:47.437152 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57ee667f8a246eb98ab6b169eb779b9" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:47.437772 30858 raft_consensus.cc:2468] T e57ee667f8a246eb98ab6b169eb779b9 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 0.
I20260709 12:13:47.438076 30977 tablet_bootstrap.cc:654] T 1eb80935abae44bf8dde4d54961c5fdb P 15ad0880a63541ef965cb6acca4513d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.443212 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5afc0720ca546d8b13026e7c7a30c1e" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:47.443652 31174 raft_consensus.cc:493] T 2137918dbdc34ac29180015bd93261de P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.443868 30930 raft_consensus.cc:2468] T c5afc0720ca546d8b13026e7c7a30c1e P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 0.
W20260709 12:13:47.443710 30822 leader_election.cc:343] T dcddf9f7713c4d04abedc36356c1888f P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:47.444239 31174 raft_consensus.cc:515] T 2137918dbdc34ac29180015bd93261de P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:47.445079 30781 raft_consensus.cc:3060] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.449386 31174 leader_election.cc:290] T 2137918dbdc34ac29180015bd93261de P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:47.450448 30750 leader_election.cc:304] T c5afc0720ca546d8b13026e7c7a30c1e P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:13:47.450773 30748 leader_election.cc:304] T e57ee667f8a246eb98ab6b169eb779b9 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676; no voters: 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:47.452348 30980 raft_consensus.cc:359] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:47.458787 30980 raft_consensus.cc:385] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.459103 30980 raft_consensus.cc:740] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.475134 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcddf9f7713c4d04abedc36356c1888f" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:47.475812 30930 raft_consensus.cc:2468] T dcddf9f7713c4d04abedc36356c1888f P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 0.
I20260709 12:13:47.474893 31222 consensus_queue.cc:1048] T b6f09adc18e2485cbafdb86cfe535721 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:13:47.478641 31223 raft_consensus.cc:493] T 2971ad17262c4b5e8665700af97ec254 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.479689 30978 tablet_bootstrap.cc:492] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460: No bootstrap required, opened a new log
I20260709 12:13:47.479199 31223 raft_consensus.cc:515] T 2971ad17262c4b5e8665700af97ec254 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:47.480244 30978 ts_tablet_manager.cc:1403] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.269s	user 0.018s	sys 0.009s
I20260709 12:13:47.490146 31226 raft_consensus.cc:2804] T c5afc0720ca546d8b13026e7c7a30c1e P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:47.490623 31226 raft_consensus.cc:493] T c5afc0720ca546d8b13026e7c7a30c1e P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:47.491050 31226 raft_consensus.cc:3060] T c5afc0720ca546d8b13026e7c7a30c1e P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.490756 31013 raft_consensus.cc:2804] T e57ee667f8a246eb98ab6b169eb779b9 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:47.491541 31013 raft_consensus.cc:493] T e57ee667f8a246eb98ab6b169eb779b9 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:47.512161 31064 consensus_queue.cc:1048] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:47.494472 30980 consensus_queue.cc:260] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:47.501920 30709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2971ad17262c4b5e8665700af97ec254" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:47.515816 30981 tablet_bootstrap.cc:492] T 5323645d8e844a489d166a94c77c2af1 P 84b98f9236604dd0b22ae23c5378a676: No bootstrap required, opened a new log
I20260709 12:13:47.494138 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2137918dbdc34ac29180015bd93261de" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:47.506358 30604 catalog_manager.cc:5697] T b6f09adc18e2485cbafdb86cfe535721 P 15ad0880a63541ef965cb6acca4513d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132). New cstate: current_term: 1 leader_uuid: "15ad0880a63541ef965cb6acca4513d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:47.534840 31013 raft_consensus.cc:3060] T e57ee667f8a246eb98ab6b169eb779b9 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.496099 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99164e2d6f664ceab4d5921867d62c31" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:47.555466 30707 raft_consensus.cc:3060] T 99164e2d6f664ceab4d5921867d62c31 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.539932 30977 tablet_bootstrap.cc:492] T 1eb80935abae44bf8dde4d54961c5fdb P 15ad0880a63541ef965cb6acca4513d7: No bootstrap required, opened a new log
I20260709 12:13:47.544286 30981 ts_tablet_manager.cc:1403] T 5323645d8e844a489d166a94c77c2af1 P 84b98f9236604dd0b22ae23c5378a676: Time spent bootstrapping tablet: real 0.311s	user 0.026s	sys 0.022s
I20260709 12:13:47.490412 30978 raft_consensus.cc:359] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:47.557610 30977 ts_tablet_manager.cc:1403] T 1eb80935abae44bf8dde4d54961c5fdb P 15ad0880a63541ef965cb6acca4513d7: Time spent bootstrapping tablet: real 0.132s	user 0.013s	sys 0.000s
I20260709 12:13:47.557714 30978 raft_consensus.cc:385] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:13:47.541472 30748 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:42179, user_credentials={real_user=slave}} blocked reactor thread for 90800us
I20260709 12:13:47.549685 30980 ts_tablet_manager.cc:1434] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent starting tablet: real 0.120s	user 0.018s	sys 0.001s
I20260709 12:13:47.550351 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2971ad17262c4b5e8665700af97ec254" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:47.544912 31190 raft_consensus.cc:493] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.558053 30978 raft_consensus.cc:740] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.568455 31190 raft_consensus.cc:515] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:47.571805 30673 leader_election.cc:304] T 99164e2d6f664ceab4d5921867d62c31 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460; no voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad
I20260709 12:13:47.574306 30930 raft_consensus.cc:2468] T 2971ad17262c4b5e8665700af97ec254 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 0.
W20260709 12:13:47.576135 30824 leader_election.cc:343] T 2971ad17262c4b5e8665700af97ec254 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:47.547691 31226 raft_consensus.cc:515] T c5afc0720ca546d8b13026e7c7a30c1e P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:47.578876 30606 catalog_manager.cc:5697] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129). New cstate: current_term: 1 leader_uuid: "6c5665c17e904fc692bce76fc57b2460" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:47.580430 31138 consensus_queue.cc:1048] T 491ae2039a6347a896b3a5aeacaa71b2 P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:47.581255 30978 consensus_queue.cc:260] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:47.584175 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb80935abae44bf8dde4d54961c5fdb" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:47.586107 31190 leader_election.cc:290] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:47.588271 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb80935abae44bf8dde4d54961c5fdb" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:47.588938 30855 raft_consensus.cc:2468] T 1eb80935abae44bf8dde4d54961c5fdb P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 0.
I20260709 12:13:47.590225 30673 leader_election.cc:304] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 
I20260709 12:13:47.591275 31190 raft_consensus.cc:2804] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:47.591652 31190 raft_consensus.cc:493] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:47.591989 31190 raft_consensus.cc:3060] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.596333 30978 ts_tablet_manager.cc:1434] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.116s	user 0.006s	sys 0.003s
I20260709 12:13:47.560228 31223 leader_election.cc:290] T 2971ad17262c4b5e8665700af97ec254 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:47.602550 30980 tablet_bootstrap.cc:492] T a3ffdffa995943d28fc038fce9198caf P 8130e18710c04a61a5d8bd019c6ffdad: Bootstrap starting.
I20260709 12:13:47.620229 30823 leader_election.cc:304] T dcddf9f7713c4d04abedc36356c1888f P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:47.623946 31226 leader_election.cc:290] T c5afc0720ca546d8b13026e7c7a30c1e P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 election: Requested vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
W20260709 12:13:47.625453 30674 leader_election.cc:343] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:47.624140 31183 consensus_queue.cc:1048] T b6f09adc18e2485cbafdb86cfe535721 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:13:47.633263 30978 tablet_bootstrap.cc:492] T bb358c4df82f4168bc1debdfc4e7aa9c P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:47.632898 31173 raft_consensus.cc:2804] T dcddf9f7713c4d04abedc36356c1888f P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:47.637568 31173 raft_consensus.cc:493] T dcddf9f7713c4d04abedc36356c1888f P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:47.637981 31173 raft_consensus.cc:3060] T dcddf9f7713c4d04abedc36356c1888f P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.641387 30981 raft_consensus.cc:359] T 5323645d8e844a489d166a94c77c2af1 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:47.642155 30981 raft_consensus.cc:385] T 5323645d8e844a489d166a94c77c2af1 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.642436 30981 raft_consensus.cc:740] T 5323645d8e844a489d166a94c77c2af1 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.643555 31196 consensus_queue.cc:1048] T ac15e10cad8e4cbc9763eacc349d9549 P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Connected to new peer: Peer: permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
W20260709 12:13:47.632999 30823 leader_election.cc:343] T 2137918dbdc34ac29180015bd93261de P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:47.647013 30823 leader_election.cc:304] T 2971ad17262c4b5e8665700af97ec254 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:47.648381 31174 raft_consensus.cc:2804] T 2971ad17262c4b5e8665700af97ec254 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:47.648869 31174 raft_consensus.cc:493] T 2971ad17262c4b5e8665700af97ec254 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:47.649300 31174 raft_consensus.cc:3060] T 2971ad17262c4b5e8665700af97ec254 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.651882 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5afc0720ca546d8b13026e7c7a30c1e" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
I20260709 12:13:47.652513 30930 raft_consensus.cc:3060] T c5afc0720ca546d8b13026e7c7a30c1e P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.643100 30981 consensus_queue.cc:260] T 5323645d8e844a489d166a94c77c2af1 P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:47.656535 31183 raft_consensus.cc:493] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.666522 30977 raft_consensus.cc:359] T 1eb80935abae44bf8dde4d54961c5fdb P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:47.667325 30977 raft_consensus.cc:385] T 1eb80935abae44bf8dde4d54961c5fdb P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.667721 30977 raft_consensus.cc:740] T 1eb80935abae44bf8dde4d54961c5fdb P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.668610 30977 consensus_queue.cc:260] T 1eb80935abae44bf8dde4d54961c5fdb P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:47.632408 31013 raft_consensus.cc:515] T e57ee667f8a246eb98ab6b169eb779b9 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:47.682391 31064 raft_consensus.cc:493] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.683274 30980 tablet_bootstrap.cc:654] T a3ffdffa995943d28fc038fce9198caf P 8130e18710c04a61a5d8bd019c6ffdad: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.687523 30981 ts_tablet_manager.cc:1434] T 5323645d8e844a489d166a94c77c2af1 P 84b98f9236604dd0b22ae23c5378a676: Time spent starting tablet: real 0.130s	user 0.007s	sys 0.001s
I20260709 12:13:47.692524 30977 ts_tablet_manager.cc:1434] T 1eb80935abae44bf8dde4d54961c5fdb P 15ad0880a63541ef965cb6acca4513d7: Time spent starting tablet: real 0.135s	user 0.008s	sys 0.000s
I20260709 12:13:47.660478 31183 raft_consensus.cc:515] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:47.702711 30981 tablet_bootstrap.cc:492] T dcddf9f7713c4d04abedc36356c1888f P 84b98f9236604dd0b22ae23c5378a676: Bootstrap starting.
I20260709 12:13:47.711033 30977 tablet_bootstrap.cc:492] T bb358c4df82f4168bc1debdfc4e7aa9c P 15ad0880a63541ef965cb6acca4513d7: Bootstrap starting.
I20260709 12:13:47.686811 31190 raft_consensus.cc:515] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:47.697623 31064 raft_consensus.cc:515] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:47.721875 31064 leader_election.cc:290] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:47.749428 31174 raft_consensus.cc:515] T 2971ad17262c4b5e8665700af97ec254 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:47.750394 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2137918dbdc34ac29180015bd93261de" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:47.752480 31173 raft_consensus.cc:515] T dcddf9f7713c4d04abedc36356c1888f P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:47.754714 31183 leader_election.cc:290] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:47.755962 31190 leader_election.cc:290] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 election: Requested vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:47.756007 31013 leader_election.cc:290] T e57ee667f8a246eb98ab6b169eb779b9 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 election: Requested vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:47.757083 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb80935abae44bf8dde4d54961c5fdb" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
I20260709 12:13:47.757730 30929 raft_consensus.cc:3060] T 1eb80935abae44bf8dde4d54961c5fdb P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.759438 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcddf9f7713c4d04abedc36356c1888f" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:13:47.765372 30929 raft_consensus.cc:2468] T 1eb80935abae44bf8dde4d54961c5fdb P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 1.
I20260709 12:13:47.766448 30978 tablet_bootstrap.cc:654] T bb358c4df82f4168bc1debdfc4e7aa9c P 6c5665c17e904fc692bce76fc57b2460: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.766685 30674 leader_election.cc:304] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 6c5665c17e904fc692bce76fc57b2460; no voters: 
I20260709 12:13:47.767871 31221 raft_consensus.cc:2804] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:47.768224 30708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5afc0720ca546d8b13026e7c7a30c1e" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
I20260709 12:13:47.768515 31221 raft_consensus.cc:697] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460 [term 1 LEADER]: Becoming Leader. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Running, Role: LEADER
I20260709 12:13:47.768966 30708 raft_consensus.cc:3060] T c5afc0720ca546d8b13026e7c7a30c1e P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.769802 31221 consensus_queue.cc:237] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:47.776376 30708 raft_consensus.cc:2468] T c5afc0720ca546d8b13026e7c7a30c1e P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 1.
I20260709 12:13:47.780555 30977 tablet_bootstrap.cc:654] T bb358c4df82f4168bc1debdfc4e7aa9c P 15ad0880a63541ef965cb6acca4513d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.783991 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb80935abae44bf8dde4d54961c5fdb" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:13:47.784657 30853 raft_consensus.cc:3060] T 1eb80935abae44bf8dde4d54961c5fdb P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.788118 30981 tablet_bootstrap.cc:654] T dcddf9f7713c4d04abedc36356c1888f P 84b98f9236604dd0b22ae23c5378a676: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.790831 30709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c52d3c5b6b15499e9c834cf33954609a" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:47.792764 30709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57ee667f8a246eb98ab6b169eb779b9" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
I20260709 12:13:47.794308 31042 consensus_queue.cc:1048] T ac15e10cad8e4cbc9763eacc349d9549 P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Connected to new peer: Peer: permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:13:47.795285 30822 leader_election.cc:343] T 2137918dbdc34ac29180015bd93261de P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:47.795775 30822 leader_election.cc:304] T 2137918dbdc34ac29180015bd93261de P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad; no voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:47.796468 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57ee667f8a246eb98ab6b169eb779b9" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:13:47.796756 31042 raft_consensus.cc:2749] T 2137918dbdc34ac29180015bd93261de P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:47.797078 30857 raft_consensus.cc:3060] T e57ee667f8a246eb98ab6b169eb779b9 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:47.800664 30822 leader_election.cc:343] T dcddf9f7713c4d04abedc36356c1888f P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:47.776911 31038 consensus_queue.cc:1048] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:47.827466 31042 raft_consensus.cc:493] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.839892 31042 raft_consensus.cc:515] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:47.835491 31173 leader_election.cc:290] T dcddf9f7713c4d04abedc36356c1888f P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 election: Requested vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:47.842286 31042 leader_election.cc:290] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:47.843052 30930 raft_consensus.cc:2468] T c5afc0720ca546d8b13026e7c7a30c1e P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 1.
W20260709 12:13:47.829716 30898 leader_election.cc:343] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:47.845023 31174 leader_election.cc:290] T 2971ad17262c4b5e8665700af97ec254 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 election: Requested vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:47.824719 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0317908edb88497b82c4e59ef1bac414" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:47.854704 31183 raft_consensus.cc:493] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.855468 31183 raft_consensus.cc:515] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:47.857995 31183 leader_election.cc:290] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:47.859122 30749 leader_election.cc:304] T c5afc0720ca546d8b13026e7c7a30c1e P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:13:47.859889 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c52d3c5b6b15499e9c834cf33954609a" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
W20260709 12:13:47.860356 30750 leader_election.cc:343] T e57ee667f8a246eb98ab6b169eb779b9 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:47.861044 31098 raft_consensus.cc:2749] T 99164e2d6f664ceab4d5921867d62c31 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:47.861368 30709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baedd172e30a4ef4a6641302fdebd9c5" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:47.863194 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0317908edb88497b82c4e59ef1bac414" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:47.863499 31232 raft_consensus.cc:2804] T c5afc0720ca546d8b13026e7c7a30c1e P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:47.864030 31232 raft_consensus.cc:697] T c5afc0720ca546d8b13026e7c7a30c1e P 84b98f9236604dd0b22ae23c5378a676 [term 1 LEADER]: Becoming Leader. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Running, Role: LEADER
W20260709 12:13:47.864621 30822 leader_election.cc:343] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:47.864693 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0317908edb88497b82c4e59ef1bac414" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:47.829258 30853 raft_consensus.cc:2468] T 1eb80935abae44bf8dde4d54961c5fdb P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 1.
W20260709 12:13:47.871356 30898 leader_election.cc:343] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:47.875916 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2971ad17262c4b5e8665700af97ec254" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
I20260709 12:13:47.876674 30929 raft_consensus.cc:3060] T 2971ad17262c4b5e8665700af97ec254 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.882687 30706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2971ad17262c4b5e8665700af97ec254" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
I20260709 12:13:47.895104 30855 raft_consensus.cc:2468] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 0.
I20260709 12:13:47.896713 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baedd172e30a4ef4a6641302fdebd9c5" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
W20260709 12:13:47.898269 30824 leader_election.cc:343] T 2971ad17262c4b5e8665700af97ec254 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:47.900216 30709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0317908edb88497b82c4e59ef1bac414" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:47.901211 30709 raft_consensus.cc:2468] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 0.
I20260709 12:13:47.904258 30824 leader_election.cc:304] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:47.906811 31173 raft_consensus.cc:2804] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:47.907312 31173 raft_consensus.cc:493] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:47.907716 31173 raft_consensus.cc:3060] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.864880 31232 consensus_queue.cc:237] T c5afc0720ca546d8b13026e7c7a30c1e P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:47.958951 30980 tablet_bootstrap.cc:492] T a3ffdffa995943d28fc038fce9198caf P 8130e18710c04a61a5d8bd019c6ffdad: No bootstrap required, opened a new log
I20260709 12:13:47.959504 30980 ts_tablet_manager.cc:1403] T a3ffdffa995943d28fc038fce9198caf P 8130e18710c04a61a5d8bd019c6ffdad: Time spent bootstrapping tablet: real 0.366s	user 0.012s	sys 0.024s
W20260709 12:13:47.947719 30673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:42179, user_credentials={real_user=slave}} blocked reactor thread for 61996.9us
W20260709 12:13:47.964002 30896 leader_election.cc:343] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:47.954200 30824 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:40909, user_credentials={real_user=slave}} blocked reactor thread for 50091.1us
I20260709 12:13:47.974123 30896 leader_election.cc:304] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7; no voters: 6c5665c17e904fc692bce76fc57b2460, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:47.976847 31138 raft_consensus.cc:493] T 5323645d8e844a489d166a94c77c2af1 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:47.981282 30673 leader_election.cc:343] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:47.981395 30896 leader_election.cc:343] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:47.981762 30977 tablet_bootstrap.cc:492] T bb358c4df82f4168bc1debdfc4e7aa9c P 15ad0880a63541ef965cb6acca4513d7: No bootstrap required, opened a new log
I20260709 12:13:47.982025 30896 leader_election.cc:304] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7; no voters: 6c5665c17e904fc692bce76fc57b2460, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:47.982280 30977 ts_tablet_manager.cc:1403] T bb358c4df82f4168bc1debdfc4e7aa9c P 15ad0880a63541ef965cb6acca4513d7: Time spent bootstrapping tablet: real 0.281s	user 0.013s	sys 0.036s
I20260709 12:13:47.969981 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcddf9f7713c4d04abedc36356c1888f" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
I20260709 12:13:47.986035 30986 raft_consensus.cc:2749] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:47.986388 31222 raft_consensus.cc:2749] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:47.995648 30978 tablet_bootstrap.cc:492] T bb358c4df82f4168bc1debdfc4e7aa9c P 6c5665c17e904fc692bce76fc57b2460: No bootstrap required, opened a new log
I20260709 12:13:47.996183 30978 ts_tablet_manager.cc:1403] T bb358c4df82f4168bc1debdfc4e7aa9c P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.388s	user 0.048s	sys 0.100s
I20260709 12:13:48.001011 30981 tablet_bootstrap.cc:492] T dcddf9f7713c4d04abedc36356c1888f P 84b98f9236604dd0b22ae23c5378a676: No bootstrap required, opened a new log
I20260709 12:13:48.001560 30981 ts_tablet_manager.cc:1403] T dcddf9f7713c4d04abedc36356c1888f P 84b98f9236604dd0b22ae23c5378a676: Time spent bootstrapping tablet: real 0.299s	user 0.022s	sys 0.026s
I20260709 12:13:47.981560 31138 raft_consensus.cc:515] T 5323645d8e844a489d166a94c77c2af1 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:48.003305 30980 raft_consensus.cc:359] T a3ffdffa995943d28fc038fce9198caf P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:48.004043 30980 raft_consensus.cc:385] T a3ffdffa995943d28fc038fce9198caf P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.004379 30981 raft_consensus.cc:359] T dcddf9f7713c4d04abedc36356c1888f P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:48.005055 30981 raft_consensus.cc:385] T dcddf9f7713c4d04abedc36356c1888f P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.005354 30981 raft_consensus.cc:740] T dcddf9f7713c4d04abedc36356c1888f P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.007081 30930 raft_consensus.cc:3060] T dcddf9f7713c4d04abedc36356c1888f P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:48.008014 30981 consensus_queue.cc:260] T dcddf9f7713c4d04abedc36356c1888f P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:48.004309 30980 raft_consensus.cc:740] T a3ffdffa995943d28fc038fce9198caf P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.010317 30980 consensus_queue.cc:260] T a3ffdffa995943d28fc038fce9198caf P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:48.011816 30981 ts_tablet_manager.cc:1434] T dcddf9f7713c4d04abedc36356c1888f P 84b98f9236604dd0b22ae23c5378a676: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:13:48.016350 30981 tablet_bootstrap.cc:492] T a3ffdffa995943d28fc038fce9198caf P 84b98f9236604dd0b22ae23c5378a676: Bootstrap starting.
I20260709 12:13:48.016222 30977 raft_consensus.cc:359] T bb358c4df82f4168bc1debdfc4e7aa9c P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:48.016950 30977 raft_consensus.cc:385] T bb358c4df82f4168bc1debdfc4e7aa9c P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.017223 30977 raft_consensus.cc:740] T bb358c4df82f4168bc1debdfc4e7aa9c P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.017860 30977 consensus_queue.cc:260] T bb358c4df82f4168bc1debdfc4e7aa9c P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:48.019632 30980 ts_tablet_manager.cc:1434] T a3ffdffa995943d28fc038fce9198caf P 8130e18710c04a61a5d8bd019c6ffdad: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.000s
I20260709 12:13:48.019889 30673 leader_election.cc:304] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:48.020793 30980 tablet_bootstrap.cc:492] T bb358c4df82f4168bc1debdfc4e7aa9c P 8130e18710c04a61a5d8bd019c6ffdad: Bootstrap starting.
I20260709 12:13:48.021727 31042 raft_consensus.cc:493] T a3ffdffa995943d28fc038fce9198caf P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.022336 30978 raft_consensus.cc:359] T bb358c4df82f4168bc1debdfc4e7aa9c P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:48.022214 31042 raft_consensus.cc:515] T a3ffdffa995943d28fc038fce9198caf P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:48.023123 30978 raft_consensus.cc:385] T bb358c4df82f4168bc1debdfc4e7aa9c P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.023463 30978 raft_consensus.cc:740] T bb358c4df82f4168bc1debdfc4e7aa9c P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.024214 30978 consensus_queue.cc:260] T bb358c4df82f4168bc1debdfc4e7aa9c P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:48.025084 31042 leader_election.cc:290] T a3ffdffa995943d28fc038fce9198caf P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:48.026430 30978 ts_tablet_manager.cc:1434] T bb358c4df82f4168bc1debdfc4e7aa9c P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.002s
I20260709 12:13:48.022214 31190 raft_consensus.cc:2804] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:48.027460 31190 raft_consensus.cc:493] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.027850 31190 raft_consensus.cc:3060] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:48.030067 30981 tablet_bootstrap.cc:654] T a3ffdffa995943d28fc038fce9198caf P 84b98f9236604dd0b22ae23c5378a676: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:48.035295 31190 raft_consensus.cc:515] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:48.037410 31190 leader_election.cc:290] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 election: Requested vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:48.027428 31173 raft_consensus.cc:515] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:48.040966 31173 leader_election.cc:290] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 election: Requested vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:48.042456 30929 raft_consensus.cc:2468] T 2971ad17262c4b5e8665700af97ec254 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 1.
I20260709 12:13:48.044548 30706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0317908edb88497b82c4e59ef1bac414" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
I20260709 12:13:48.045348 30706 raft_consensus.cc:2393] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8130e18710c04a61a5d8bd019c6ffdad in current term 1: Already voted for candidate 6c5665c17e904fc692bce76fc57b2460 in this term.
I20260709 12:13:48.045763 30980 tablet_bootstrap.cc:654] T bb358c4df82f4168bc1debdfc4e7aa9c P 8130e18710c04a61a5d8bd019c6ffdad: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:48.048897 30708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3ffdffa995943d28fc038fce9198caf" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:48.050645 31221 raft_consensus.cc:493] T bb358c4df82f4168bc1debdfc4e7aa9c P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:48.050596 30824 leader_election.cc:343] T a3ffdffa995943d28fc038fce9198caf P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:48.051249 31221 raft_consensus.cc:515] T bb358c4df82f4168bc1debdfc4e7aa9c P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:48.053881 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb358c4df82f4168bc1debdfc4e7aa9c" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
W20260709 12:13:48.055328 30673 leader_election.cc:343] T bb358c4df82f4168bc1debdfc4e7aa9c P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:48.053889 31221 leader_election.cc:290] T bb358c4df82f4168bc1debdfc4e7aa9c P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:48.055816 30823 leader_election.cc:304] T 2971ad17262c4b5e8665700af97ec254 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:48.057610 31173 raft_consensus.cc:2804] T 2971ad17262c4b5e8665700af97ec254 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:48.058086 31173 raft_consensus.cc:697] T 2971ad17262c4b5e8665700af97ec254 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 LEADER]: Becoming Leader. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Running, Role: LEADER
I20260709 12:13:48.058893 31173 consensus_queue.cc:237] T 2971ad17262c4b5e8665700af97ec254 P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:48.063845 30857 raft_consensus.cc:2468] T e57ee667f8a246eb98ab6b169eb779b9 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 1.
I20260709 12:13:48.066035 30748 leader_election.cc:304] T e57ee667f8a246eb98ab6b169eb779b9 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676; no voters: 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:48.066747 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3ffdffa995943d28fc038fce9198caf" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:48.068409 30977 ts_tablet_manager.cc:1434] T bb358c4df82f4168bc1debdfc4e7aa9c P 15ad0880a63541ef965cb6acca4513d7: Time spent starting tablet: real 0.086s	user 0.005s	sys 0.002s
I20260709 12:13:48.069550 31137 raft_consensus.cc:2804] T e57ee667f8a246eb98ab6b169eb779b9 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:13:48.071141 30822 leader_election.cc:343] T a3ffdffa995943d28fc038fce9198caf P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:48.071797 30822 leader_election.cc:304] T a3ffdffa995943d28fc038fce9198caf P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad; no voters: 6c5665c17e904fc692bce76fc57b2460, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:48.070313 31137 raft_consensus.cc:697] T e57ee667f8a246eb98ab6b169eb779b9 P 84b98f9236604dd0b22ae23c5378a676 [term 1 LEADER]: Becoming Leader. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Running, Role: LEADER
I20260709 12:13:48.073196 30989 raft_consensus.cc:2749] T a3ffdffa995943d28fc038fce9198caf P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:48.073964 31137 consensus_queue.cc:237] T e57ee667f8a246eb98ab6b169eb779b9 P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:48.077606 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0317908edb88497b82c4e59ef1bac414" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:13:48.069571 30977 tablet_bootstrap.cc:492] T 5323645d8e844a489d166a94c77c2af1 P 15ad0880a63541ef965cb6acca4513d7: Bootstrap starting.
I20260709 12:13:48.005075 31138 leader_election.cc:290] T 5323645d8e844a489d166a94c77c2af1 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:48.090850 30605 catalog_manager.cc:5697] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129). New cstate: current_term: 1 leader_uuid: "6c5665c17e904fc692bce76fc57b2460" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:48.096546 30978 tablet_bootstrap.cc:492] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:48.070327 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0317908edb88497b82c4e59ef1bac414" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
W20260709 12:13:48.121609 30822 leader_election.cc:343] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:48.122117 30822 leader_election.cc:304] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad; no voters: 6c5665c17e904fc692bce76fc57b2460, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:48.114516 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5323645d8e844a489d166a94c77c2af1" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
W20260709 12:13:48.116031 30673 leader_election.cc:343] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:48.117087 30930 raft_consensus.cc:2468] T dcddf9f7713c4d04abedc36356c1888f P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 1.
I20260709 12:13:48.124830 31223 raft_consensus.cc:2749] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:48.149259 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb358c4df82f4168bc1debdfc4e7aa9c" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:48.150135 30930 raft_consensus.cc:2468] T bb358c4df82f4168bc1debdfc4e7aa9c P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 0.
W20260709 12:13:48.150866 30748 leader_election.cc:343] T 5323645d8e844a489d166a94c77c2af1 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:48.157253 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0317908edb88497b82c4e59ef1bac414" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:13:48.158905 30856 raft_consensus.cc:2393] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c5665c17e904fc692bce76fc57b2460 in current term 1: Already voted for candidate 8130e18710c04a61a5d8bd019c6ffdad in this term.
I20260709 12:13:48.144654 30823 leader_election.cc:304] T dcddf9f7713c4d04abedc36356c1888f P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:48.160979 31223 raft_consensus.cc:2804] T dcddf9f7713c4d04abedc36356c1888f P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:48.162307 31223 raft_consensus.cc:697] T dcddf9f7713c4d04abedc36356c1888f P 8130e18710c04a61a5d8bd019c6ffdad [term 1 LEADER]: Becoming Leader. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Running, Role: LEADER
I20260709 12:13:48.165889 30977 tablet_bootstrap.cc:654] T 5323645d8e844a489d166a94c77c2af1 P 15ad0880a63541ef965cb6acca4513d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:48.167433 30673 leader_election.cc:304] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460; no voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:48.168592 31038 raft_consensus.cc:2749] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:48.173803 30978 tablet_bootstrap.cc:654] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:48.180267 30981 tablet_bootstrap.cc:492] T a3ffdffa995943d28fc038fce9198caf P 84b98f9236604dd0b22ae23c5378a676: No bootstrap required, opened a new log
I20260709 12:13:48.165388 31223 consensus_queue.cc:237] T dcddf9f7713c4d04abedc36356c1888f P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:48.181277 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5323645d8e844a489d166a94c77c2af1" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:48.183658 30674 leader_election.cc:304] T bb358c4df82f4168bc1debdfc4e7aa9c P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 6c5665c17e904fc692bce76fc57b2460; no voters: 8130e18710c04a61a5d8bd019c6ffdad
I20260709 12:13:48.195259 31098 raft_consensus.cc:2804] T bb358c4df82f4168bc1debdfc4e7aa9c P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:48.195727 31098 raft_consensus.cc:493] T bb358c4df82f4168bc1debdfc4e7aa9c P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:48.195784 30749 leader_election.cc:343] T 5323645d8e844a489d166a94c77c2af1 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:48.196154 31098 raft_consensus.cc:3060] T bb358c4df82f4168bc1debdfc4e7aa9c P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:48.196316 30749 leader_election.cc:304] T 5323645d8e844a489d166a94c77c2af1 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 84b98f9236604dd0b22ae23c5378a676; no voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad
W20260709 12:13:48.196923 31244 log.cc:927] Time spent T b6f09adc18e2485cbafdb86cfe535721 P 84b98f9236604dd0b22ae23c5378a676: Append to log took a long time: real 0.098s	user 0.002s	sys 0.003s
I20260709 12:13:48.197609 31232 raft_consensus.cc:2749] T 5323645d8e844a489d166a94c77c2af1 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:48.201958 30981 ts_tablet_manager.cc:1403] T a3ffdffa995943d28fc038fce9198caf P 84b98f9236604dd0b22ae23c5378a676: Time spent bootstrapping tablet: real 0.186s	user 0.013s	sys 0.013s
I20260709 12:13:48.205955 31098 raft_consensus.cc:515] T bb358c4df82f4168bc1debdfc4e7aa9c P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:48.210389 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb358c4df82f4168bc1debdfc4e7aa9c" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:13:48.211570 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb358c4df82f4168bc1debdfc4e7aa9c" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
W20260709 12:13:48.211901 30673 leader_election.cc:343] T bb358c4df82f4168bc1debdfc4e7aa9c P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:48.212240 30930 raft_consensus.cc:3060] T bb358c4df82f4168bc1debdfc4e7aa9c P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:48.226312 30981 raft_consensus.cc:359] T a3ffdffa995943d28fc038fce9198caf P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:48.227120 30981 raft_consensus.cc:385] T a3ffdffa995943d28fc038fce9198caf P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.227396 30981 raft_consensus.cc:740] T a3ffdffa995943d28fc038fce9198caf P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.228101 30981 consensus_queue.cc:260] T a3ffdffa995943d28fc038fce9198caf P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:48.233415 30930 raft_consensus.cc:2468] T bb358c4df82f4168bc1debdfc4e7aa9c P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 1.
W20260709 12:13:48.167696 30654 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:48.234874 31098 leader_election.cc:290] T bb358c4df82f4168bc1debdfc4e7aa9c P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 election: Requested vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:48.236107 30978 tablet_bootstrap.cc:492] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460: No bootstrap required, opened a new log
I20260709 12:13:48.236609 30978 ts_tablet_manager.cc:1403] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.147s	user 0.011s	sys 0.001s
I20260709 12:13:48.237097 30674 leader_election.cc:304] T bb358c4df82f4168bc1debdfc4e7aa9c P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 6c5665c17e904fc692bce76fc57b2460; no voters: 8130e18710c04a61a5d8bd019c6ffdad
I20260709 12:13:48.238955 31038 raft_consensus.cc:2804] T bb358c4df82f4168bc1debdfc4e7aa9c P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:48.239464 31038 raft_consensus.cc:697] T bb358c4df82f4168bc1debdfc4e7aa9c P 6c5665c17e904fc692bce76fc57b2460 [term 1 LEADER]: Becoming Leader. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Running, Role: LEADER
I20260709 12:13:48.240046 30978 raft_consensus.cc:359] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:48.240304 31038 consensus_queue.cc:237] T bb358c4df82f4168bc1debdfc4e7aa9c P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:48.245992 30980 tablet_bootstrap.cc:492] T bb358c4df82f4168bc1debdfc4e7aa9c P 8130e18710c04a61a5d8bd019c6ffdad: No bootstrap required, opened a new log
I20260709 12:13:48.246670 30980 ts_tablet_manager.cc:1403] T bb358c4df82f4168bc1debdfc4e7aa9c P 8130e18710c04a61a5d8bd019c6ffdad: Time spent bootstrapping tablet: real 0.226s	user 0.015s	sys 0.009s
I20260709 12:13:48.249917 30980 raft_consensus.cc:359] T bb358c4df82f4168bc1debdfc4e7aa9c P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:48.250500 30980 raft_consensus.cc:385] T bb358c4df82f4168bc1debdfc4e7aa9c P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.250736 30980 raft_consensus.cc:740] T bb358c4df82f4168bc1debdfc4e7aa9c P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.251466 30980 consensus_queue.cc:260] T bb358c4df82f4168bc1debdfc4e7aa9c P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:48.254004 30981 ts_tablet_manager.cc:1434] T a3ffdffa995943d28fc038fce9198caf P 84b98f9236604dd0b22ae23c5378a676: Time spent starting tablet: real 0.052s	user 0.004s	sys 0.003s
I20260709 12:13:48.254938 30980 ts_tablet_manager.cc:1434] T bb358c4df82f4168bc1debdfc4e7aa9c P 8130e18710c04a61a5d8bd019c6ffdad: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:13:48.258011 30981 tablet_bootstrap.cc:492] T baedd172e30a4ef4a6641302fdebd9c5 P 84b98f9236604dd0b22ae23c5378a676: Bootstrap starting.
I20260709 12:13:48.240765 30978 raft_consensus.cc:385] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.261834 30978 raft_consensus.cc:740] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.262120 30980 tablet_bootstrap.cc:492] T 745e2cea61c44c3a80bdc49add504a75 P 8130e18710c04a61a5d8bd019c6ffdad: Bootstrap starting.
I20260709 12:13:48.262698 30978 consensus_queue.cc:260] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:48.262784 30607 catalog_manager.cc:5697] T 2971ad17262c4b5e8665700af97ec254 P 8130e18710c04a61a5d8bd019c6ffdad reported cstate change: term changed from 0 to 1, leader changed from <none> to 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131). New cstate: current_term: 1 leader_uuid: "8130e18710c04a61a5d8bd019c6ffdad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:48.265291 30978 ts_tablet_manager.cc:1434] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 12:13:48.273674 30978 tablet_bootstrap.cc:492] T e57ee667f8a246eb98ab6b169eb779b9 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:48.258247 30606 catalog_manager.cc:5697] T c5afc0720ca546d8b13026e7c7a30c1e P 84b98f9236604dd0b22ae23c5378a676 reported cstate change: term changed from 0 to 1, leader changed from <none> to 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "84b98f9236604dd0b22ae23c5378a676" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:48.269752 31221 raft_consensus.cc:493] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.278422 31221 raft_consensus.cc:515] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:48.272125 31192 consensus_queue.cc:1048] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:48.284350 30981 tablet_bootstrap.cc:654] T baedd172e30a4ef4a6641302fdebd9c5 P 84b98f9236604dd0b22ae23c5378a676: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:48.284834 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baedd172e30a4ef4a6641302fdebd9c5" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:48.285953 31221 leader_election.cc:290] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
W20260709 12:13:48.286312 30673 leader_election.cc:343] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:48.287635 30978 tablet_bootstrap.cc:654] T e57ee667f8a246eb98ab6b169eb779b9 P 6c5665c17e904fc692bce76fc57b2460: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:48.289149 30980 tablet_bootstrap.cc:654] T 745e2cea61c44c3a80bdc49add504a75 P 8130e18710c04a61a5d8bd019c6ffdad: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:48.292169 30953 debug-util.cc:398] Leaking SignalData structure 0x7b080011c900 after lost signal to thread 21269
W20260709 12:13:48.293294 30953 debug-util.cc:398] Leaking SignalData structure 0x7b0800114d00 after lost signal to thread 30641
I20260709 12:13:48.293452 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baedd172e30a4ef4a6641302fdebd9c5" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:48.294377 30930 raft_consensus.cc:2468] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 0.
W20260709 12:13:48.294646 30953 debug-util.cc:398] Leaking SignalData structure 0x7b080011e7c0 after lost signal to thread 30733
I20260709 12:13:48.296420 30674 leader_election.cc:304] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 6c5665c17e904fc692bce76fc57b2460; no voters: 84b98f9236604dd0b22ae23c5378a676
W20260709 12:13:48.296926 30953 debug-util.cc:398] Leaking SignalData structure 0x7b08000e54a0 after lost signal to thread 30808
I20260709 12:13:48.297953 31221 raft_consensus.cc:2804] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:48.298413 31221 raft_consensus.cc:493] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.298754 31221 raft_consensus.cc:3060] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:48.298100 30953 debug-util.cc:398] Leaking SignalData structure 0x7b08001454a0 after lost signal to thread 30882
W20260709 12:13:48.302516 30953 debug-util.cc:398] Leaking SignalData structure 0x7b08001ce560 after lost signal to thread 30956
I20260709 12:13:48.310101 30605 catalog_manager.cc:5697] T bb358c4df82f4168bc1debdfc4e7aa9c P 6c5665c17e904fc692bce76fc57b2460 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129). New cstate: current_term: 1 leader_uuid: "6c5665c17e904fc692bce76fc57b2460" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:48.293397 30977 tablet_bootstrap.cc:492] T 5323645d8e844a489d166a94c77c2af1 P 15ad0880a63541ef965cb6acca4513d7: No bootstrap required, opened a new log
I20260709 12:13:48.317615 30977 ts_tablet_manager.cc:1403] T 5323645d8e844a489d166a94c77c2af1 P 15ad0880a63541ef965cb6acca4513d7: Time spent bootstrapping tablet: real 0.248s	user 0.014s	sys 0.001s
I20260709 12:13:48.319049 31038 consensus_queue.cc:1048] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:48.325673 30977 raft_consensus.cc:359] T 5323645d8e844a489d166a94c77c2af1 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:48.326364 30977 raft_consensus.cc:385] T 5323645d8e844a489d166a94c77c2af1 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.326634 30977 raft_consensus.cc:740] T 5323645d8e844a489d166a94c77c2af1 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.332814 30977 consensus_queue.cc:260] T 5323645d8e844a489d166a94c77c2af1 P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:48.336956 30977 ts_tablet_manager.cc:1434] T 5323645d8e844a489d166a94c77c2af1 P 15ad0880a63541ef965cb6acca4513d7: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 12:13:48.337996 30977 tablet_bootstrap.cc:492] T f351526ad9564be4be05825c266794c7 P 15ad0880a63541ef965cb6acca4513d7: Bootstrap starting.
I20260709 12:13:48.339619 31221 raft_consensus.cc:515] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:48.342756 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baedd172e30a4ef4a6641302fdebd9c5" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
I20260709 12:13:48.343475 30930 raft_consensus.cc:3060] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:48.346338 31221 leader_election.cc:290] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 election: Requested vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:48.346484 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baedd172e30a4ef4a6641302fdebd9c5" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
W20260709 12:13:48.348292 30673 leader_election.cc:343] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:48.353204 30977 tablet_bootstrap.cc:654] T f351526ad9564be4be05825c266794c7 P 15ad0880a63541ef965cb6acca4513d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:48.356660 30930 raft_consensus.cc:2468] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 1.
I20260709 12:13:48.357883 30674 leader_election.cc:304] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 6c5665c17e904fc692bce76fc57b2460; no voters: 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:48.359316 31221 raft_consensus.cc:2804] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:48.359848 31221 raft_consensus.cc:697] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460 [term 1 LEADER]: Becoming Leader. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Running, Role: LEADER
I20260709 12:13:48.360703 31221 consensus_queue.cc:237] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:48.360572 30607 catalog_manager.cc:5697] T dcddf9f7713c4d04abedc36356c1888f P 8130e18710c04a61a5d8bd019c6ffdad reported cstate change: term changed from 0 to 1, leader changed from <none> to 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131). New cstate: current_term: 1 leader_uuid: "8130e18710c04a61a5d8bd019c6ffdad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:48.361487 31173 raft_consensus.cc:493] T bb358c4df82f4168bc1debdfc4e7aa9c P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.362011 31173 raft_consensus.cc:515] T bb358c4df82f4168bc1debdfc4e7aa9c P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:48.364277 31137 raft_consensus.cc:493] T dcddf9f7713c4d04abedc36356c1888f P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.364775 31137 raft_consensus.cc:515] T dcddf9f7713c4d04abedc36356c1888f P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:48.366845 31137 leader_election.cc:290] T dcddf9f7713c4d04abedc36356c1888f P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:48.368122 31173 leader_election.cc:290] T bb358c4df82f4168bc1debdfc4e7aa9c P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:48.368330 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcddf9f7713c4d04abedc36356c1888f" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:48.369164 30707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb358c4df82f4168bc1debdfc4e7aa9c" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:48.369940 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcddf9f7713c4d04abedc36356c1888f" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:48.369184 30931 raft_consensus.cc:2393] T dcddf9f7713c4d04abedc36356c1888f P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 84b98f9236604dd0b22ae23c5378a676 in current term 1: Already voted for candidate 8130e18710c04a61a5d8bd019c6ffdad in this term.
I20260709 12:13:48.375640 30749 leader_election.cc:304] T dcddf9f7713c4d04abedc36356c1888f P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 84b98f9236604dd0b22ae23c5378a676; no voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad
I20260709 12:13:48.376935 31137 raft_consensus.cc:3060] T dcddf9f7713c4d04abedc36356c1888f P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:48.384323 31232 consensus_queue.cc:1048] T c5afc0720ca546d8b13026e7c7a30c1e P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:48.410014 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb358c4df82f4168bc1debdfc4e7aa9c" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:48.410857 31137 raft_consensus.cc:2749] T dcddf9f7713c4d04abedc36356c1888f P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:48.411129 30930 raft_consensus.cc:2393] T bb358c4df82f4168bc1debdfc4e7aa9c P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8130e18710c04a61a5d8bd019c6ffdad in current term 1: Already voted for candidate 6c5665c17e904fc692bce76fc57b2460 in this term.
I20260709 12:13:48.412400 30823 leader_election.cc:304] T bb358c4df82f4168bc1debdfc4e7aa9c P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad; no voters: 15ad0880a63541ef965cb6acca4513d7, 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:48.413842 31173 raft_consensus.cc:3060] T bb358c4df82f4168bc1debdfc4e7aa9c P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:48.402765 30603 catalog_manager.cc:5697] T e57ee667f8a246eb98ab6b169eb779b9 P 84b98f9236604dd0b22ae23c5378a676 reported cstate change: term changed from 0 to 1, leader changed from <none> to 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "84b98f9236604dd0b22ae23c5378a676" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:48.421026 31137 consensus_queue.cc:1048] T c5afc0720ca546d8b13026e7c7a30c1e P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:13:48.428563 30981 tablet_bootstrap.cc:492] T baedd172e30a4ef4a6641302fdebd9c5 P 84b98f9236604dd0b22ae23c5378a676: No bootstrap required, opened a new log
I20260709 12:13:48.429122 30981 ts_tablet_manager.cc:1403] T baedd172e30a4ef4a6641302fdebd9c5 P 84b98f9236604dd0b22ae23c5378a676: Time spent bootstrapping tablet: real 0.171s	user 0.027s	sys 0.035s
I20260709 12:13:48.432451 31173 raft_consensus.cc:2749] T bb358c4df82f4168bc1debdfc4e7aa9c P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:48.432466 30980 tablet_bootstrap.cc:492] T 745e2cea61c44c3a80bdc49add504a75 P 8130e18710c04a61a5d8bd019c6ffdad: No bootstrap required, opened a new log
I20260709 12:13:48.433751 30980 ts_tablet_manager.cc:1403] T 745e2cea61c44c3a80bdc49add504a75 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent bootstrapping tablet: real 0.172s	user 0.029s	sys 0.034s
I20260709 12:13:48.436635 30607 catalog_manager.cc:5697] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129). New cstate: current_term: 1 leader_uuid: "6c5665c17e904fc692bce76fc57b2460" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:48.449723 30981 raft_consensus.cc:359] T baedd172e30a4ef4a6641302fdebd9c5 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:48.450484 30981 raft_consensus.cc:385] T baedd172e30a4ef4a6641302fdebd9c5 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.450752 30981 raft_consensus.cc:740] T baedd172e30a4ef4a6641302fdebd9c5 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.451455 30981 consensus_queue.cc:260] T baedd172e30a4ef4a6641302fdebd9c5 P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:48.453510 30981 ts_tablet_manager.cc:1434] T baedd172e30a4ef4a6641302fdebd9c5 P 84b98f9236604dd0b22ae23c5378a676: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 12:13:48.454425 30981 tablet_bootstrap.cc:492] T 4031508121204ef4a2f5f2f0e9508cab P 84b98f9236604dd0b22ae23c5378a676: Bootstrap starting.
I20260709 12:13:48.437048 30977 tablet_bootstrap.cc:492] T f351526ad9564be4be05825c266794c7 P 15ad0880a63541ef965cb6acca4513d7: No bootstrap required, opened a new log
I20260709 12:13:48.455812 30977 ts_tablet_manager.cc:1403] T f351526ad9564be4be05825c266794c7 P 15ad0880a63541ef965cb6acca4513d7: Time spent bootstrapping tablet: real 0.118s	user 0.015s	sys 0.001s
I20260709 12:13:48.458624 30977 raft_consensus.cc:359] T f351526ad9564be4be05825c266794c7 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:48.459256 30977 raft_consensus.cc:385] T f351526ad9564be4be05825c266794c7 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.459493 30977 raft_consensus.cc:740] T f351526ad9564be4be05825c266794c7 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.460037 30980 raft_consensus.cc:359] T 745e2cea61c44c3a80bdc49add504a75 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:48.460722 30980 raft_consensus.cc:385] T 745e2cea61c44c3a80bdc49add504a75 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.460978 30980 raft_consensus.cc:740] T 745e2cea61c44c3a80bdc49add504a75 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.464586 30978 tablet_bootstrap.cc:492] T e57ee667f8a246eb98ab6b169eb779b9 P 6c5665c17e904fc692bce76fc57b2460: No bootstrap required, opened a new log
I20260709 12:13:48.465073 30978 ts_tablet_manager.cc:1403] T e57ee667f8a246eb98ab6b169eb779b9 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.192s	user 0.024s	sys 0.044s
I20260709 12:13:48.465170 31227 consensus_queue.cc:1048] T e57ee667f8a246eb98ab6b169eb779b9 P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:48.482947 30981 tablet_bootstrap.cc:654] T 4031508121204ef4a2f5f2f0e9508cab P 84b98f9236604dd0b22ae23c5378a676: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:48.483946 30977 consensus_queue.cc:260] T f351526ad9564be4be05825c266794c7 P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:48.463472 30980 consensus_queue.cc:260] T 745e2cea61c44c3a80bdc49add504a75 P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:48.488974 30978 raft_consensus.cc:359] T e57ee667f8a246eb98ab6b169eb779b9 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:48.489705 30978 raft_consensus.cc:385] T e57ee667f8a246eb98ab6b169eb779b9 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.489955 30978 raft_consensus.cc:740] T e57ee667f8a246eb98ab6b169eb779b9 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.490618 30978 consensus_queue.cc:260] T e57ee667f8a246eb98ab6b169eb779b9 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:48.491401 30980 ts_tablet_manager.cc:1434] T 745e2cea61c44c3a80bdc49add504a75 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.000s
I20260709 12:13:48.492370 30980 tablet_bootstrap.cc:492] T 34e3009dd96f4545b2abe325ac95e960 P 8130e18710c04a61a5d8bd019c6ffdad: Bootstrap starting.
I20260709 12:13:48.495942 30978 ts_tablet_manager.cc:1434] T e57ee667f8a246eb98ab6b169eb779b9 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.002s
I20260709 12:13:48.501226 30977 ts_tablet_manager.cc:1434] T f351526ad9564be4be05825c266794c7 P 15ad0880a63541ef965cb6acca4513d7: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.001s
I20260709 12:13:48.502447 30977 tablet_bootstrap.cc:492] T 2137918dbdc34ac29180015bd93261de P 15ad0880a63541ef965cb6acca4513d7: Bootstrap starting.
I20260709 12:13:48.504670 30978 tablet_bootstrap.cc:492] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:48.520542 30977 tablet_bootstrap.cc:654] T 2137918dbdc34ac29180015bd93261de P 15ad0880a63541ef965cb6acca4513d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:48.526364 30978 tablet_bootstrap.cc:654] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:48.531852 30707 raft_consensus.cc:3060] T e57ee667f8a246eb98ab6b169eb779b9 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:48.545826 31138 consensus_queue.cc:1048] T e57ee667f8a246eb98ab6b169eb779b9 P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:48.555604 31174 consensus_queue.cc:1048] T 2971ad17262c4b5e8665700af97ec254 P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Connected to new peer: Peer: permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:48.561412 30978 tablet_bootstrap.cc:492] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460: No bootstrap required, opened a new log
I20260709 12:13:48.561967 30978 ts_tablet_manager.cc:1403] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.058s	user 0.011s	sys 0.014s
I20260709 12:13:48.562637 30980 tablet_bootstrap.cc:654] T 34e3009dd96f4545b2abe325ac95e960 P 8130e18710c04a61a5d8bd019c6ffdad: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:48.563721 30981 tablet_bootstrap.cc:492] T 4031508121204ef4a2f5f2f0e9508cab P 84b98f9236604dd0b22ae23c5378a676: No bootstrap required, opened a new log
I20260709 12:13:48.564234 30981 ts_tablet_manager.cc:1403] T 4031508121204ef4a2f5f2f0e9508cab P 84b98f9236604dd0b22ae23c5378a676: Time spent bootstrapping tablet: real 0.110s	user 0.017s	sys 0.000s
I20260709 12:13:48.564790 30978 raft_consensus.cc:359] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:48.565466 30978 raft_consensus.cc:385] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.565721 30978 raft_consensus.cc:740] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.568843 30981 raft_consensus.cc:359] T 4031508121204ef4a2f5f2f0e9508cab P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:48.570823 30981 raft_consensus.cc:385] T 4031508121204ef4a2f5f2f0e9508cab P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.571192 30981 raft_consensus.cc:740] T 4031508121204ef4a2f5f2f0e9508cab P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.573004 30978 consensus_queue.cc:260] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:48.575299 30978 ts_tablet_manager.cc:1434] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 12:13:48.576238 30978 tablet_bootstrap.cc:492] T 2971ad17262c4b5e8665700af97ec254 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
W20260709 12:13:48.592744 30824 consensus_peers.cc:597] T 2971ad17262c4b5e8665700af97ec254 P 8130e18710c04a61a5d8bd019c6ffdad -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:48.595108 30981 consensus_queue.cc:260] T 4031508121204ef4a2f5f2f0e9508cab P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:48.609094 30981 ts_tablet_manager.cc:1434] T 4031508121204ef4a2f5f2f0e9508cab P 84b98f9236604dd0b22ae23c5378a676: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.001s
I20260709 12:13:48.630645 30978 tablet_bootstrap.cc:654] T 2971ad17262c4b5e8665700af97ec254 P 6c5665c17e904fc692bce76fc57b2460: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:48.631143 31222 raft_consensus.cc:493] T 5323645d8e844a489d166a94c77c2af1 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.632124 31222 raft_consensus.cc:515] T 5323645d8e844a489d166a94c77c2af1 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:48.634377 31222 leader_election.cc:290] T 5323645d8e844a489d166a94c77c2af1 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:48.635028 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5323645d8e844a489d166a94c77c2af1" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:48.635733 30783 raft_consensus.cc:2468] T 5323645d8e844a489d166a94c77c2af1 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 0.
I20260709 12:13:48.635891 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5323645d8e844a489d166a94c77c2af1" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:48.637645 30977 tablet_bootstrap.cc:492] T 2137918dbdc34ac29180015bd93261de P 15ad0880a63541ef965cb6acca4513d7: No bootstrap required, opened a new log
W20260709 12:13:48.637876 30896 leader_election.cc:343] T 5323645d8e844a489d166a94c77c2af1 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:48.640667 30896 leader_election.cc:304] T 5323645d8e844a489d166a94c77c2af1 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676; no voters: 8130e18710c04a61a5d8bd019c6ffdad
I20260709 12:13:48.643509 31222 raft_consensus.cc:2804] T 5323645d8e844a489d166a94c77c2af1 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:48.643884 31222 raft_consensus.cc:493] T 5323645d8e844a489d166a94c77c2af1 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.644200 31222 raft_consensus.cc:3060] T 5323645d8e844a489d166a94c77c2af1 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:48.638594 30981 tablet_bootstrap.cc:492] T ec7d33fd7f3245f68966bd7749ee53c3 P 84b98f9236604dd0b22ae23c5378a676: Bootstrap starting.
I20260709 12:13:48.647749 31221 consensus_queue.cc:1048] T bb358c4df82f4168bc1debdfc4e7aa9c P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:48.649817 30977 ts_tablet_manager.cc:1403] T 2137918dbdc34ac29180015bd93261de P 15ad0880a63541ef965cb6acca4513d7: Time spent bootstrapping tablet: real 0.148s	user 0.019s	sys 0.026s
I20260709 12:13:48.657626 30980 tablet_bootstrap.cc:492] T 34e3009dd96f4545b2abe325ac95e960 P 8130e18710c04a61a5d8bd019c6ffdad: No bootstrap required, opened a new log
I20260709 12:13:48.654718 30977 raft_consensus.cc:359] T 2137918dbdc34ac29180015bd93261de P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:48.661382 30980 ts_tablet_manager.cc:1403] T 34e3009dd96f4545b2abe325ac95e960 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent bootstrapping tablet: real 0.169s	user 0.024s	sys 0.013s
I20260709 12:13:48.661409 30977 raft_consensus.cc:385] T 2137918dbdc34ac29180015bd93261de P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.661901 30977 raft_consensus.cc:740] T 2137918dbdc34ac29180015bd93261de P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.662511 30977 consensus_queue.cc:260] T 2137918dbdc34ac29180015bd93261de P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:48.669226 30980 raft_consensus.cc:359] T 34e3009dd96f4545b2abe325ac95e960 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:48.672405 31232 raft_consensus.cc:493] T a3ffdffa995943d28fc038fce9198caf P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.674681 31232 raft_consensus.cc:515] T a3ffdffa995943d28fc038fce9198caf P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:48.677313 31232 leader_election.cc:290] T a3ffdffa995943d28fc038fce9198caf P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:48.677805 30707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3ffdffa995943d28fc038fce9198caf" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:48.678421 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3ffdffa995943d28fc038fce9198caf" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:48.656332 31222 raft_consensus.cc:515] T 5323645d8e844a489d166a94c77c2af1 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:48.679169 30855 raft_consensus.cc:2468] T a3ffdffa995943d28fc038fce9198caf P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 0.
I20260709 12:13:48.680821 31222 leader_election.cc:290] T 5323645d8e844a489d166a94c77c2af1 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Requested vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:48.681643 30748 leader_election.cc:304] T a3ffdffa995943d28fc038fce9198caf P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:13:48.682216 30980 raft_consensus.cc:385] T 34e3009dd96f4545b2abe325ac95e960 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.683084 31174 consensus_queue.cc:1048] T dcddf9f7713c4d04abedc36356c1888f P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Connected to new peer: Peer: permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:13:48.685658 30750 leader_election.cc:343] T a3ffdffa995943d28fc038fce9198caf P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:48.685902 30980 raft_consensus.cc:740] T 34e3009dd96f4545b2abe325ac95e960 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.682714 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5323645d8e844a489d166a94c77c2af1" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:13:48.678579 31053 raft_consensus.cc:493] T f351526ad9564be4be05825c266794c7 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.684221 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5323645d8e844a489d166a94c77c2af1" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:13:48.687151 30980 consensus_queue.cc:260] T 34e3009dd96f4545b2abe325ac95e960 P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:48.688742 30981 tablet_bootstrap.cc:654] T ec7d33fd7f3245f68966bd7749ee53c3 P 84b98f9236604dd0b22ae23c5378a676: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:48.688047 31232 raft_consensus.cc:2804] T a3ffdffa995943d28fc038fce9198caf P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:48.694768 31232 raft_consensus.cc:493] T a3ffdffa995943d28fc038fce9198caf P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:48.695228 30896 leader_election.cc:343] T 5323645d8e844a489d166a94c77c2af1 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:48.695309 31232 raft_consensus.cc:3060] T a3ffdffa995943d28fc038fce9198caf P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:48.688764 31053 raft_consensus.cc:515] T f351526ad9564be4be05825c266794c7 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:48.701943 30707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f351526ad9564be4be05825c266794c7" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:48.688601 30783 raft_consensus.cc:3060] T 5323645d8e844a489d166a94c77c2af1 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:48.703514 30898 leader_election.cc:343] T f351526ad9564be4be05825c266794c7 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:48.705559 31053 leader_election.cc:290] T f351526ad9564be4be05825c266794c7 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:48.705763 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f351526ad9564be4be05825c266794c7" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:48.707209 30980 ts_tablet_manager.cc:1434] T 34e3009dd96f4545b2abe325ac95e960 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.005s
I20260709 12:13:48.708365 30980 tablet_bootstrap.cc:492] T 5323645d8e844a489d166a94c77c2af1 P 8130e18710c04a61a5d8bd019c6ffdad: Bootstrap starting.
W20260709 12:13:48.708568 30896 leader_election.cc:343] T f351526ad9564be4be05825c266794c7 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:48.708985 30896 leader_election.cc:304] T f351526ad9564be4be05825c266794c7 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7; no voters: 6c5665c17e904fc692bce76fc57b2460, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:48.710558 31222 raft_consensus.cc:2749] T f351526ad9564be4be05825c266794c7 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:48.712352 30977 ts_tablet_manager.cc:1434] T 2137918dbdc34ac29180015bd93261de P 15ad0880a63541ef965cb6acca4513d7: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.000s
I20260709 12:13:48.716019 31174 raft_consensus.cc:493] T 745e2cea61c44c3a80bdc49add504a75 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.716501 31174 raft_consensus.cc:515] T 745e2cea61c44c3a80bdc49add504a75 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:48.718107 30783 raft_consensus.cc:2468] T 5323645d8e844a489d166a94c77c2af1 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 1.
I20260709 12:13:48.718549 31174 leader_election.cc:290] T 745e2cea61c44c3a80bdc49add504a75 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:48.722540 30707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "745e2cea61c44c3a80bdc49add504a75" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:48.723421 30896 leader_election.cc:304] T 5323645d8e844a489d166a94c77c2af1 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676; no voters: 8130e18710c04a61a5d8bd019c6ffdad
I20260709 12:13:48.723989 30980 tablet_bootstrap.cc:654] T 5323645d8e844a489d166a94c77c2af1 P 8130e18710c04a61a5d8bd019c6ffdad: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:48.729373 31053 raft_consensus.cc:2804] T 5323645d8e844a489d166a94c77c2af1 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:48.722798 31232 raft_consensus.cc:515] T a3ffdffa995943d28fc038fce9198caf P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:48.729918 31053 raft_consensus.cc:697] T 5323645d8e844a489d166a94c77c2af1 P 15ad0880a63541ef965cb6acca4513d7 [term 1 LEADER]: Becoming Leader. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Running, Role: LEADER
I20260709 12:13:48.730824 31053 consensus_queue.cc:237] T 5323645d8e844a489d166a94c77c2af1 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:48.732013 31098 raft_consensus.cc:493] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.732822 31232 leader_election.cc:290] T a3ffdffa995943d28fc038fce9198caf P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 election: Requested vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:48.732617 31098 raft_consensus.cc:515] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:48.734055 30977 tablet_bootstrap.cc:492] T 7b23395f850d4699b8d289f501c96f60 P 15ad0880a63541ef965cb6acca4513d7: Bootstrap starting.
I20260709 12:13:48.741371 30978 tablet_bootstrap.cc:492] T 2971ad17262c4b5e8665700af97ec254 P 6c5665c17e904fc692bce76fc57b2460: No bootstrap required, opened a new log
I20260709 12:13:48.741868 30978 ts_tablet_manager.cc:1403] T 2971ad17262c4b5e8665700af97ec254 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.166s	user 0.014s	sys 0.012s
I20260709 12:13:48.746685 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "745e2cea61c44c3a80bdc49add504a75" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:48.765472 30978 raft_consensus.cc:359] T 2971ad17262c4b5e8665700af97ec254 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:48.766058 30978 raft_consensus.cc:385] T 2971ad17262c4b5e8665700af97ec254 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.766291 30978 raft_consensus.cc:740] T 2971ad17262c4b5e8665700af97ec254 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.765187 31232 raft_consensus.cc:493] T baedd172e30a4ef4a6641302fdebd9c5 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.755618 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3ffdffa995943d28fc038fce9198caf" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:13:48.767663 31232 raft_consensus.cc:515] T baedd172e30a4ef4a6641302fdebd9c5 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:48.768129 30856 raft_consensus.cc:3060] T a3ffdffa995943d28fc038fce9198caf P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:48.768599 30978 consensus_queue.cc:260] T 2971ad17262c4b5e8665700af97ec254 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:48.769909 31232 leader_election.cc:290] T baedd172e30a4ef4a6641302fdebd9c5 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:48.770759 30978 ts_tablet_manager.cc:1434] T 2971ad17262c4b5e8665700af97ec254 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.002s
I20260709 12:13:48.771533 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baedd172e30a4ef4a6641302fdebd9c5" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:48.772727 30929 raft_consensus.cc:2393] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 84b98f9236604dd0b22ae23c5378a676 in current term 1: Already voted for candidate 6c5665c17e904fc692bce76fc57b2460 in this term.
I20260709 12:13:48.773784 30980 tablet_bootstrap.cc:492] T 5323645d8e844a489d166a94c77c2af1 P 8130e18710c04a61a5d8bd019c6ffdad: No bootstrap required, opened a new log
I20260709 12:13:48.774184 30978 tablet_bootstrap.cc:492] T 7b23395f850d4699b8d289f501c96f60 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:48.774284 30980 ts_tablet_manager.cc:1403] T 5323645d8e844a489d166a94c77c2af1 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent bootstrapping tablet: real 0.066s	user 0.011s	sys 0.011s
I20260709 12:13:48.777002 30980 raft_consensus.cc:359] T 5323645d8e844a489d166a94c77c2af1 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:48.777493 30980 raft_consensus.cc:385] T 5323645d8e844a489d166a94c77c2af1 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.777747 30980 raft_consensus.cc:740] T 5323645d8e844a489d166a94c77c2af1 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.778502 30709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3ffdffa995943d28fc038fce9198caf" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
I20260709 12:13:48.779778 30708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baedd172e30a4ef4a6641302fdebd9c5" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:48.778393 30980 consensus_queue.cc:260] T 5323645d8e844a489d166a94c77c2af1 P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
W20260709 12:13:48.758278 30824 leader_election.cc:343] T 745e2cea61c44c3a80bdc49add504a75 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:48.783916 31098 leader_election.cc:290] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:48.789440 31098 consensus_queue.cc:1048] T bb358c4df82f4168bc1debdfc4e7aa9c P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:13:48.787714 30750 leader_election.cc:343] T a3ffdffa995943d28fc038fce9198caf P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:48.791472 30750 leader_election.cc:304] T baedd172e30a4ef4a6641302fdebd9c5 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 84b98f9236604dd0b22ae23c5378a676; no voters: 15ad0880a63541ef965cb6acca4513d7, 6c5665c17e904fc692bce76fc57b2460
W20260709 12:13:48.785948 30822 leader_election.cc:343] T 745e2cea61c44c3a80bdc49add504a75 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:48.793670 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c52d3c5b6b15499e9c834cf33954609a" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:48.799505 30856 raft_consensus.cc:2468] T a3ffdffa995943d28fc038fce9198caf P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 1.
I20260709 12:13:48.802852 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c52d3c5b6b15499e9c834cf33954609a" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:48.806680 30930 raft_consensus.cc:2468] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 0.
I20260709 12:13:48.793970 31232 raft_consensus.cc:3060] T baedd172e30a4ef4a6641302fdebd9c5 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:48.812587 30822 leader_election.cc:304] T 745e2cea61c44c3a80bdc49add504a75 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad; no voters: 6c5665c17e904fc692bce76fc57b2460, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:48.812336 30607 catalog_manager.cc:5697] T 5323645d8e844a489d166a94c77c2af1 P 15ad0880a63541ef965cb6acca4513d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132). New cstate: current_term: 1 leader_uuid: "15ad0880a63541ef965cb6acca4513d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: HEALTHY } } }
W20260709 12:13:48.813591 30822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:40083, user_credentials={real_user=slave}} blocked reactor thread for 45393.3us
I20260709 12:13:48.813860 31174 raft_consensus.cc:2749] T 745e2cea61c44c3a80bdc49add504a75 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:13:48.820541 30673 leader_election.cc:343] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:48.825282 30978 tablet_bootstrap.cc:654] T 7b23395f850d4699b8d289f501c96f60 P 6c5665c17e904fc692bce76fc57b2460: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:48.829135 30980 ts_tablet_manager.cc:1434] T 5323645d8e844a489d166a94c77c2af1 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.002s
I20260709 12:13:48.833069 31174 consensus_queue.cc:1048] T dcddf9f7713c4d04abedc36356c1888f P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Connected to new peer: Peer: permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:48.840688 31138 raft_consensus.cc:493] T 4031508121204ef4a2f5f2f0e9508cab P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.841264 31138 raft_consensus.cc:515] T 4031508121204ef4a2f5f2f0e9508cab P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:48.843725 31138 leader_election.cc:290] T 4031508121204ef4a2f5f2f0e9508cab P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:48.847365 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4031508121204ef4a2f5f2f0e9508cab" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
W20260709 12:13:48.848726 31283 log.cc:927] Time spent T 5323645d8e844a489d166a94c77c2af1 P 15ad0880a63541ef965cb6acca4513d7: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:13:48.851392 30748 leader_election.cc:304] T a3ffdffa995943d28fc038fce9198caf P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676; no voters: 6c5665c17e904fc692bce76fc57b2460
W20260709 12:13:48.853262 30749 leader_election.cc:343] T 4031508121204ef4a2f5f2f0e9508cab P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:48.856289 30981 tablet_bootstrap.cc:492] T ec7d33fd7f3245f68966bd7749ee53c3 P 84b98f9236604dd0b22ae23c5378a676: No bootstrap required, opened a new log
I20260709 12:13:48.856912 30981 ts_tablet_manager.cc:1403] T ec7d33fd7f3245f68966bd7749ee53c3 P 84b98f9236604dd0b22ae23c5378a676: Time spent bootstrapping tablet: real 0.219s	user 0.013s	sys 0.029s
I20260709 12:13:48.853787 31232 raft_consensus.cc:2749] T baedd172e30a4ef4a6641302fdebd9c5 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:48.859102 31138 raft_consensus.cc:2804] T a3ffdffa995943d28fc038fce9198caf P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:48.860215 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4031508121204ef4a2f5f2f0e9508cab" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:48.861572 30981 raft_consensus.cc:359] T ec7d33fd7f3245f68966bd7749ee53c3 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:48.862914 30977 tablet_bootstrap.cc:654] T 7b23395f850d4699b8d289f501c96f60 P 15ad0880a63541ef965cb6acca4513d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:48.854375 30674 leader_election.cc:304] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 6c5665c17e904fc692bce76fc57b2460; no voters: 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:48.878911 30981 raft_consensus.cc:385] T ec7d33fd7f3245f68966bd7749ee53c3 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.880474 30980 tablet_bootstrap.cc:492] T 7b23395f850d4699b8d289f501c96f60 P 8130e18710c04a61a5d8bd019c6ffdad: Bootstrap starting.
I20260709 12:13:48.880353 30981 raft_consensus.cc:740] T ec7d33fd7f3245f68966bd7749ee53c3 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.881281 30981 consensus_queue.cc:260] T ec7d33fd7f3245f68966bd7749ee53c3 P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:48.881481 31138 raft_consensus.cc:697] T a3ffdffa995943d28fc038fce9198caf P 84b98f9236604dd0b22ae23c5378a676 [term 1 LEADER]: Becoming Leader. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Running, Role: LEADER
I20260709 12:13:48.884452 31138 consensus_queue.cc:237] T a3ffdffa995943d28fc038fce9198caf P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:48.886212 30981 ts_tablet_manager.cc:1434] T ec7d33fd7f3245f68966bd7749ee53c3 P 84b98f9236604dd0b22ae23c5378a676: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.003s
W20260709 12:13:48.889873 30748 leader_election.cc:343] T 4031508121204ef4a2f5f2f0e9508cab P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:48.890388 30748 leader_election.cc:304] T 4031508121204ef4a2f5f2f0e9508cab P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 84b98f9236604dd0b22ae23c5378a676; no voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad
I20260709 12:13:48.891031 31190 raft_consensus.cc:2804] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:48.891199 31137 raft_consensus.cc:2749] T 4031508121204ef4a2f5f2f0e9508cab P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:48.891459 31190 raft_consensus.cc:493] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.891899 31190 raft_consensus.cc:3060] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:48.896230 31064 consensus_queue.cc:1048] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:48.899338 31098 consensus_queue.cc:1048] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:48.902431 30981 tablet_bootstrap.cc:492] T 2137918dbdc34ac29180015bd93261de P 84b98f9236604dd0b22ae23c5378a676: Bootstrap starting.
I20260709 12:13:48.909838 30980 tablet_bootstrap.cc:654] T 7b23395f850d4699b8d289f501c96f60 P 8130e18710c04a61a5d8bd019c6ffdad: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:48.911743 30981 tablet_bootstrap.cc:654] T 2137918dbdc34ac29180015bd93261de P 84b98f9236604dd0b22ae23c5378a676: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:48.923120 31173 raft_consensus.cc:493] T 5323645d8e844a489d166a94c77c2af1 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.925300 31173 raft_consensus.cc:515] T 5323645d8e844a489d166a94c77c2af1 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:48.929309 30978 tablet_bootstrap.cc:492] T 7b23395f850d4699b8d289f501c96f60 P 6c5665c17e904fc692bce76fc57b2460: No bootstrap required, opened a new log
I20260709 12:13:48.929785 30978 ts_tablet_manager.cc:1403] T 7b23395f850d4699b8d289f501c96f60 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.156s	user 0.014s	sys 0.024s
I20260709 12:13:48.936537 31190 raft_consensus.cc:515] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:48.943953 31173 leader_election.cc:290] T 5323645d8e844a489d166a94c77c2af1 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:48.947005 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5323645d8e844a489d166a94c77c2af1" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:48.948231 30780 raft_consensus.cc:2393] T 5323645d8e844a489d166a94c77c2af1 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8130e18710c04a61a5d8bd019c6ffdad in current term 1: Already voted for candidate 15ad0880a63541ef965cb6acca4513d7 in this term.
I20260709 12:13:48.953424 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5323645d8e844a489d166a94c77c2af1" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:48.955081 31222 raft_consensus.cc:493] T 2137918dbdc34ac29180015bd93261de P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.955627 31222 raft_consensus.cc:515] T 2137918dbdc34ac29180015bd93261de P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:48.957713 31222 leader_election.cc:290] T 2137918dbdc34ac29180015bd93261de P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:48.959724 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2137918dbdc34ac29180015bd93261de" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:48.960604 30823 leader_election.cc:304] T 5323645d8e844a489d166a94c77c2af1 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad; no voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:48.961462 31173 raft_consensus.cc:3060] T 5323645d8e844a489d166a94c77c2af1 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:48.963277 30896 leader_election.cc:343] T 2137918dbdc34ac29180015bd93261de P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:48.971490 30978 raft_consensus.cc:359] T 7b23395f850d4699b8d289f501c96f60 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:48.972236 30978 raft_consensus.cc:385] T 7b23395f850d4699b8d289f501c96f60 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.972507 30978 raft_consensus.cc:740] T 7b23395f850d4699b8d289f501c96f60 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.973845 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c52d3c5b6b15499e9c834cf33954609a" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
I20260709 12:13:48.982069 30932 raft_consensus.cc:3060] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:48.989414 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c52d3c5b6b15499e9c834cf33954609a" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:13:48.973204 31190 leader_election.cc:290] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 election: Requested vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:48.997536 30978 consensus_queue.cc:260] T 7b23395f850d4699b8d289f501c96f60 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:48.998072 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2137918dbdc34ac29180015bd93261de" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:48.998404 31192 raft_consensus.cc:493] T 2971ad17262c4b5e8665700af97ec254 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.998771 30855 raft_consensus.cc:2468] T 2137918dbdc34ac29180015bd93261de P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 0.
I20260709 12:13:48.998934 31192 raft_consensus.cc:515] T 2971ad17262c4b5e8665700af97ec254 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:48.999775 30978 ts_tablet_manager.cc:1434] T 7b23395f850d4699b8d289f501c96f60 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.070s	user 0.009s	sys 0.000s
I20260709 12:13:49.000459 30896 leader_election.cc:304] T 2137918dbdc34ac29180015bd93261de P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:49.000828 30978 tablet_bootstrap.cc:492] T 745e2cea61c44c3a80bdc49add504a75 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:48.977349 31173 raft_consensus.cc:2749] T 5323645d8e844a489d166a94c77c2af1 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:49.004522 31192 leader_election.cc:290] T 2971ad17262c4b5e8665700af97ec254 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:49.005090 31053 raft_consensus.cc:2804] T 2137918dbdc34ac29180015bd93261de P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:49.005489 31053 raft_consensus.cc:493] T 2137918dbdc34ac29180015bd93261de P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.005815 31053 raft_consensus.cc:3060] T 2137918dbdc34ac29180015bd93261de P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:49.000845 30673 leader_election.cc:343] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:49.016448 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2971ad17262c4b5e8665700af97ec254" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:49.014891 30603 catalog_manager.cc:5697] T a3ffdffa995943d28fc038fce9198caf P 84b98f9236604dd0b22ae23c5378a676 reported cstate change: term changed from 0 to 1, leader changed from <none> to 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "84b98f9236604dd0b22ae23c5378a676" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:49.019709 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2971ad17262c4b5e8665700af97ec254" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:49.022598 30673 leader_election.cc:304] T 2971ad17262c4b5e8665700af97ec254 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460; no voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad
I20260709 12:13:49.023404 31190 raft_consensus.cc:2749] T 2971ad17262c4b5e8665700af97ec254 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:49.025620 30977 tablet_bootstrap.cc:492] T 7b23395f850d4699b8d289f501c96f60 P 15ad0880a63541ef965cb6acca4513d7: No bootstrap required, opened a new log
I20260709 12:13:49.026155 30977 ts_tablet_manager.cc:1403] T 7b23395f850d4699b8d289f501c96f60 P 15ad0880a63541ef965cb6acca4513d7: Time spent bootstrapping tablet: real 0.311s	user 0.016s	sys 0.016s
I20260709 12:13:49.026209 30932 raft_consensus.cc:2468] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 1.
I20260709 12:13:49.032364 30978 tablet_bootstrap.cc:654] T 745e2cea61c44c3a80bdc49add504a75 P 6c5665c17e904fc692bce76fc57b2460: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.039289 31053 raft_consensus.cc:515] T 2137918dbdc34ac29180015bd93261de P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:49.041549 31053 leader_election.cc:290] T 2137918dbdc34ac29180015bd93261de P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Requested vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:49.042225 30674 leader_election.cc:304] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 6c5665c17e904fc692bce76fc57b2460; no voters: 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:49.042860 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2137918dbdc34ac29180015bd93261de" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:13:49.043581 30855 raft_consensus.cc:3060] T 2137918dbdc34ac29180015bd93261de P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.044057 31221 raft_consensus.cc:2804] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:49.044620 31221 raft_consensus.cc:697] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 [term 1 LEADER]: Becoming Leader. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Running, Role: LEADER
I20260709 12:13:49.044493 30977 raft_consensus.cc:359] T 7b23395f850d4699b8d289f501c96f60 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:49.045271 30977 raft_consensus.cc:385] T 7b23395f850d4699b8d289f501c96f60 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.045545 31221 consensus_queue.cc:237] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:49.045583 30977 raft_consensus.cc:740] T 7b23395f850d4699b8d289f501c96f60 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.050048 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2137918dbdc34ac29180015bd93261de" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:13:49.052811 30977 consensus_queue.cc:260] T 7b23395f850d4699b8d289f501c96f60 P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
W20260709 12:13:49.057680 30896 leader_election.cc:343] T 2137918dbdc34ac29180015bd93261de P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:49.062238 31174 raft_consensus.cc:493] T 34e3009dd96f4545b2abe325ac95e960 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.063974 30981 tablet_bootstrap.cc:492] T 2137918dbdc34ac29180015bd93261de P 84b98f9236604dd0b22ae23c5378a676: No bootstrap required, opened a new log
I20260709 12:13:49.064395 30981 ts_tablet_manager.cc:1403] T 2137918dbdc34ac29180015bd93261de P 84b98f9236604dd0b22ae23c5378a676: Time spent bootstrapping tablet: real 0.162s	user 0.021s	sys 0.012s
I20260709 12:13:49.062866 31174 raft_consensus.cc:515] T 34e3009dd96f4545b2abe325ac95e960 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:49.067199 30977 ts_tablet_manager.cc:1434] T 7b23395f850d4699b8d289f501c96f60 P 15ad0880a63541ef965cb6acca4513d7: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.001s
I20260709 12:13:49.068518 31174 leader_election.cc:290] T 34e3009dd96f4545b2abe325ac95e960 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:49.068919 30981 raft_consensus.cc:359] T 2137918dbdc34ac29180015bd93261de P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:49.069669 30981 raft_consensus.cc:385] T 2137918dbdc34ac29180015bd93261de P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.069913 30981 raft_consensus.cc:740] T 2137918dbdc34ac29180015bd93261de P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.070571 30708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e3009dd96f4545b2abe325ac95e960" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
W20260709 12:13:49.072219 30824 leader_election.cc:343] T 34e3009dd96f4545b2abe325ac95e960 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:49.076476 30980 tablet_bootstrap.cc:492] T 7b23395f850d4699b8d289f501c96f60 P 8130e18710c04a61a5d8bd019c6ffdad: No bootstrap required, opened a new log
I20260709 12:13:49.076985 30980 ts_tablet_manager.cc:1403] T 7b23395f850d4699b8d289f501c96f60 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent bootstrapping tablet: real 0.219s	user 0.016s	sys 0.013s
I20260709 12:13:49.090281 30980 raft_consensus.cc:359] T 7b23395f850d4699b8d289f501c96f60 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:49.090759 30977 tablet_bootstrap.cc:492] T 1bbb677d9c544ed5a31297773b1508d6 P 15ad0880a63541ef965cb6acca4513d7: Bootstrap starting.
I20260709 12:13:49.091024 30980 raft_consensus.cc:385] T 7b23395f850d4699b8d289f501c96f60 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.091526 30980 raft_consensus.cc:740] T 7b23395f850d4699b8d289f501c96f60 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.092450 30980 consensus_queue.cc:260] T 7b23395f850d4699b8d289f501c96f60 P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:49.095057 30981 consensus_queue.cc:260] T 2137918dbdc34ac29180015bd93261de P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:49.096464 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e3009dd96f4545b2abe325ac95e960" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
W20260709 12:13:49.105846 30823 leader_election.cc:343] T 34e3009dd96f4545b2abe325ac95e960 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:49.106375 30823 leader_election.cc:304] T 34e3009dd96f4545b2abe325ac95e960 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad; no voters: 15ad0880a63541ef965cb6acca4513d7, 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:49.109045 31173 raft_consensus.cc:2749] T 34e3009dd96f4545b2abe325ac95e960 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:49.111922 30977 tablet_bootstrap.cc:654] T 1bbb677d9c544ed5a31297773b1508d6 P 15ad0880a63541ef965cb6acca4513d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.115060 31173 raft_consensus.cc:493] T 7b23395f850d4699b8d289f501c96f60 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.115736 31173 raft_consensus.cc:515] T 7b23395f850d4699b8d289f501c96f60 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:49.119854 30708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b23395f850d4699b8d289f501c96f60" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:49.120493 30708 raft_consensus.cc:2468] T 7b23395f850d4699b8d289f501c96f60 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 0.
I20260709 12:13:49.121850 30824 leader_election.cc:304] T 7b23395f850d4699b8d289f501c96f60 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 
I20260709 12:13:49.120802 31173 leader_election.cc:290] T 7b23395f850d4699b8d289f501c96f60 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:49.122936 31174 raft_consensus.cc:2804] T 7b23395f850d4699b8d289f501c96f60 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:49.123433 31174 raft_consensus.cc:493] T 7b23395f850d4699b8d289f501c96f60 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.123776 31174 raft_consensus.cc:3060] T 7b23395f850d4699b8d289f501c96f60 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.123732 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b23395f850d4699b8d289f501c96f60" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:49.124883 30932 raft_consensus.cc:2468] T 7b23395f850d4699b8d289f501c96f60 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 0.
I20260709 12:13:49.121665 30605 catalog_manager.cc:5697] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129). New cstate: current_term: 1 leader_uuid: "6c5665c17e904fc692bce76fc57b2460" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:49.128860 30978 tablet_bootstrap.cc:492] T 745e2cea61c44c3a80bdc49add504a75 P 6c5665c17e904fc692bce76fc57b2460: No bootstrap required, opened a new log
I20260709 12:13:49.129550 30978 ts_tablet_manager.cc:1403] T 745e2cea61c44c3a80bdc49add504a75 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.129s	user 0.011s	sys 0.005s
I20260709 12:13:49.131966 31174 raft_consensus.cc:515] T 7b23395f850d4699b8d289f501c96f60 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:49.134779 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b23395f850d4699b8d289f501c96f60" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
I20260709 12:13:49.135373 30932 raft_consensus.cc:3060] T 7b23395f850d4699b8d289f501c96f60 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.141255 30980 ts_tablet_manager.cc:1434] T 7b23395f850d4699b8d289f501c96f60 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.002s
I20260709 12:13:49.146689 30981 ts_tablet_manager.cc:1434] T 2137918dbdc34ac29180015bd93261de P 84b98f9236604dd0b22ae23c5378a676: Time spent starting tablet: real 0.082s	user 0.006s	sys 0.001s
I20260709 12:13:49.149837 30981 tablet_bootstrap.cc:492] T f351526ad9564be4be05825c266794c7 P 84b98f9236604dd0b22ae23c5378a676: Bootstrap starting.
I20260709 12:13:49.157155 30978 raft_consensus.cc:359] T 745e2cea61c44c3a80bdc49add504a75 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:49.158413 30978 raft_consensus.cc:385] T 745e2cea61c44c3a80bdc49add504a75 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.158769 30978 raft_consensus.cc:740] T 745e2cea61c44c3a80bdc49add504a75 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.160563 30708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b23395f850d4699b8d289f501c96f60" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
I20260709 12:13:49.144508 30855 raft_consensus.cc:2468] T 2137918dbdc34ac29180015bd93261de P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 1.
I20260709 12:13:49.161201 30708 raft_consensus.cc:3060] T 7b23395f850d4699b8d289f501c96f60 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.160748 30980 tablet_bootstrap.cc:492] T 554acf71459c4e59b886396df52b3004 P 8130e18710c04a61a5d8bd019c6ffdad: Bootstrap starting.
I20260709 12:13:49.161586 30981 tablet_bootstrap.cc:654] T f351526ad9564be4be05825c266794c7 P 84b98f9236604dd0b22ae23c5378a676: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.164120 30896 leader_election.cc:304] T 2137918dbdc34ac29180015bd93261de P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:49.164821 30977 tablet_bootstrap.cc:492] T 1bbb677d9c544ed5a31297773b1508d6 P 15ad0880a63541ef965cb6acca4513d7: No bootstrap required, opened a new log
I20260709 12:13:49.164899 31053 raft_consensus.cc:2804] T 2137918dbdc34ac29180015bd93261de P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:49.165474 30977 ts_tablet_manager.cc:1403] T 1bbb677d9c544ed5a31297773b1508d6 P 15ad0880a63541ef965cb6acca4513d7: Time spent bootstrapping tablet: real 0.083s	user 0.025s	sys 0.031s
I20260709 12:13:49.162027 30978 consensus_queue.cc:260] T 745e2cea61c44c3a80bdc49add504a75 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:49.165593 31053 raft_consensus.cc:697] T 2137918dbdc34ac29180015bd93261de P 15ad0880a63541ef965cb6acca4513d7 [term 1 LEADER]: Becoming Leader. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Running, Role: LEADER
I20260709 12:13:49.167570 31053 consensus_queue.cc:237] T 2137918dbdc34ac29180015bd93261de P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:49.169150 30709 raft_consensus.cc:3060] T 2971ad17262c4b5e8665700af97ec254 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.175048 30980 tablet_bootstrap.cc:654] T 554acf71459c4e59b886396df52b3004 P 8130e18710c04a61a5d8bd019c6ffdad: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.177057 30977 raft_consensus.cc:359] T 1bbb677d9c544ed5a31297773b1508d6 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:49.177772 30977 raft_consensus.cc:385] T 1bbb677d9c544ed5a31297773b1508d6 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.178030 30977 raft_consensus.cc:740] T 1bbb677d9c544ed5a31297773b1508d6 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.178822 30977 consensus_queue.cc:260] T 1bbb677d9c544ed5a31297773b1508d6 P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:49.178938 30708 raft_consensus.cc:2468] T 7b23395f850d4699b8d289f501c96f60 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 1.
I20260709 12:13:49.185735 30824 leader_election.cc:304] T 7b23395f850d4699b8d289f501c96f60 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 
I20260709 12:13:49.182569 30977 ts_tablet_manager.cc:1434] T 1bbb677d9c544ed5a31297773b1508d6 P 15ad0880a63541ef965cb6acca4513d7: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:13:49.187199 31223 raft_consensus.cc:2804] T 7b23395f850d4699b8d289f501c96f60 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:49.187978 31223 raft_consensus.cc:697] T 7b23395f850d4699b8d289f501c96f60 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 LEADER]: Becoming Leader. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Running, Role: LEADER
I20260709 12:13:49.189338 30977 tablet_bootstrap.cc:492] T ec7d33fd7f3245f68966bd7749ee53c3 P 15ad0880a63541ef965cb6acca4513d7: Bootstrap starting.
I20260709 12:13:49.189134 31223 consensus_queue.cc:237] T 7b23395f850d4699b8d289f501c96f60 P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:49.193012 30978 ts_tablet_manager.cc:1434] T 745e2cea61c44c3a80bdc49add504a75 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.063s	user 0.010s	sys 0.000s
I20260709 12:13:49.196110 30977 tablet_bootstrap.cc:654] T ec7d33fd7f3245f68966bd7749ee53c3 P 15ad0880a63541ef965cb6acca4513d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.183024 31174 leader_election.cc:290] T 7b23395f850d4699b8d289f501c96f60 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 election: Requested vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:49.198805 30978 tablet_bootstrap.cc:492] T a3ffdffa995943d28fc038fce9198caf P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:49.210875 30977 tablet_bootstrap.cc:492] T ec7d33fd7f3245f68966bd7749ee53c3 P 15ad0880a63541ef965cb6acca4513d7: No bootstrap required, opened a new log
I20260709 12:13:49.211544 30977 ts_tablet_manager.cc:1403] T ec7d33fd7f3245f68966bd7749ee53c3 P 15ad0880a63541ef965cb6acca4513d7: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.004s
I20260709 12:13:49.213352 30981 tablet_bootstrap.cc:492] T f351526ad9564be4be05825c266794c7 P 84b98f9236604dd0b22ae23c5378a676: No bootstrap required, opened a new log
I20260709 12:13:49.213828 30981 ts_tablet_manager.cc:1403] T f351526ad9564be4be05825c266794c7 P 84b98f9236604dd0b22ae23c5378a676: Time spent bootstrapping tablet: real 0.064s	user 0.008s	sys 0.005s
I20260709 12:13:49.215691 30607 catalog_manager.cc:5697] T 7b23395f850d4699b8d289f501c96f60 P 8130e18710c04a61a5d8bd019c6ffdad reported cstate change: term changed from 0 to 1, leader changed from <none> to 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131). New cstate: current_term: 1 leader_uuid: "8130e18710c04a61a5d8bd019c6ffdad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:49.216630 30981 raft_consensus.cc:359] T f351526ad9564be4be05825c266794c7 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:49.217314 30981 raft_consensus.cc:385] T f351526ad9564be4be05825c266794c7 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.217584 30981 raft_consensus.cc:740] T f351526ad9564be4be05825c266794c7 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.217893 31183 consensus_queue.cc:1048] T 5323645d8e844a489d166a94c77c2af1 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:49.219276 30981 consensus_queue.cc:260] T f351526ad9564be4be05825c266794c7 P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:49.220374 30978 tablet_bootstrap.cc:654] T a3ffdffa995943d28fc038fce9198caf P 6c5665c17e904fc692bce76fc57b2460: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.226003 30977 raft_consensus.cc:359] T ec7d33fd7f3245f68966bd7749ee53c3 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:49.226701 30977 raft_consensus.cc:385] T ec7d33fd7f3245f68966bd7749ee53c3 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.226960 30977 raft_consensus.cc:740] T ec7d33fd7f3245f68966bd7749ee53c3 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.228360 30605 catalog_manager.cc:5697] T 2137918dbdc34ac29180015bd93261de P 15ad0880a63541ef965cb6acca4513d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132). New cstate: current_term: 1 leader_uuid: "15ad0880a63541ef965cb6acca4513d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:49.231958 30977 consensus_queue.cc:260] T ec7d33fd7f3245f68966bd7749ee53c3 P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:49.233685 30932 raft_consensus.cc:2468] T 7b23395f850d4699b8d289f501c96f60 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 1.
I20260709 12:13:49.234094 30977 ts_tablet_manager.cc:1434] T ec7d33fd7f3245f68966bd7749ee53c3 P 15ad0880a63541ef965cb6acca4513d7: Time spent starting tablet: real 0.022s	user 0.001s	sys 0.004s
I20260709 12:13:49.243780 30981 ts_tablet_manager.cc:1434] T f351526ad9564be4be05825c266794c7 P 84b98f9236604dd0b22ae23c5378a676: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.001s
I20260709 12:13:49.251045 31190 raft_consensus.cc:493] T 745e2cea61c44c3a80bdc49add504a75 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.251689 31190 raft_consensus.cc:515] T 745e2cea61c44c3a80bdc49add504a75 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:49.252749 30981 tablet_bootstrap.cc:492] T 1bbb677d9c544ed5a31297773b1508d6 P 84b98f9236604dd0b22ae23c5378a676: Bootstrap starting.
I20260709 12:13:49.253600 30980 tablet_bootstrap.cc:492] T 554acf71459c4e59b886396df52b3004 P 8130e18710c04a61a5d8bd019c6ffdad: No bootstrap required, opened a new log
I20260709 12:13:49.254092 31190 leader_election.cc:290] T 745e2cea61c44c3a80bdc49add504a75 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:49.256901 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "745e2cea61c44c3a80bdc49add504a75" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:49.257198 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "745e2cea61c44c3a80bdc49add504a75" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:49.257921 30856 raft_consensus.cc:2468] T 745e2cea61c44c3a80bdc49add504a75 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 0.
I20260709 12:13:49.259325 30673 leader_election.cc:304] T 745e2cea61c44c3a80bdc49add504a75 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 
I20260709 12:13:49.260437 31192 raft_consensus.cc:2804] T 745e2cea61c44c3a80bdc49add504a75 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:49.260877 31192 raft_consensus.cc:493] T 745e2cea61c44c3a80bdc49add504a75 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.261227 31192 raft_consensus.cc:3060] T 745e2cea61c44c3a80bdc49add504a75 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:49.271582 30673 leader_election.cc:343] T 745e2cea61c44c3a80bdc49add504a75 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:49.235205 30977 tablet_bootstrap.cc:492] T 34e3009dd96f4545b2abe325ac95e960 P 15ad0880a63541ef965cb6acca4513d7: Bootstrap starting.
I20260709 12:13:49.285498 30981 tablet_bootstrap.cc:654] T 1bbb677d9c544ed5a31297773b1508d6 P 84b98f9236604dd0b22ae23c5378a676: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.254117 30980 ts_tablet_manager.cc:1403] T 554acf71459c4e59b886396df52b3004 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent bootstrapping tablet: real 0.094s	user 0.022s	sys 0.004s
I20260709 12:13:49.294430 30977 tablet_bootstrap.cc:654] T 34e3009dd96f4545b2abe325ac95e960 P 15ad0880a63541ef965cb6acca4513d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.294821 30980 raft_consensus.cc:359] T 554acf71459c4e59b886396df52b3004 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:49.295567 30980 raft_consensus.cc:385] T 554acf71459c4e59b886396df52b3004 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.295820 30980 raft_consensus.cc:740] T 554acf71459c4e59b886396df52b3004 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.296497 30980 consensus_queue.cc:260] T 554acf71459c4e59b886396df52b3004 P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:49.298054 30980 ts_tablet_manager.cc:1434] T 554acf71459c4e59b886396df52b3004 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:13:49.298702 30978 tablet_bootstrap.cc:492] T a3ffdffa995943d28fc038fce9198caf P 6c5665c17e904fc692bce76fc57b2460: No bootstrap required, opened a new log
I20260709 12:13:49.299234 30978 ts_tablet_manager.cc:1403] T a3ffdffa995943d28fc038fce9198caf P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.101s	user 0.019s	sys 0.000s
I20260709 12:13:49.301982 30978 raft_consensus.cc:359] T a3ffdffa995943d28fc038fce9198caf P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:49.302636 30978 raft_consensus.cc:385] T a3ffdffa995943d28fc038fce9198caf P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.294469 31192 raft_consensus.cc:515] T 745e2cea61c44c3a80bdc49add504a75 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:49.311632 31222 consensus_queue.cc:1048] T 5323645d8e844a489d166a94c77c2af1 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:49.302887 30978 raft_consensus.cc:740] T a3ffdffa995943d28fc038fce9198caf P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.314524 31192 leader_election.cc:290] T 745e2cea61c44c3a80bdc49add504a75 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 election: Requested vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:49.315289 30978 consensus_queue.cc:260] T a3ffdffa995943d28fc038fce9198caf P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:49.316322 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "745e2cea61c44c3a80bdc49add504a75" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:13:49.317767 30980 tablet_bootstrap.cc:492] T 4031508121204ef4a2f5f2f0e9508cab P 8130e18710c04a61a5d8bd019c6ffdad: Bootstrap starting.
W20260709 12:13:49.318632 30673 leader_election.cc:343] T 745e2cea61c44c3a80bdc49add504a75 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:49.319522 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "745e2cea61c44c3a80bdc49add504a75" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:13:49.320168 30856 raft_consensus.cc:3060] T 745e2cea61c44c3a80bdc49add504a75 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.332417 30981 tablet_bootstrap.cc:492] T 1bbb677d9c544ed5a31297773b1508d6 P 84b98f9236604dd0b22ae23c5378a676: No bootstrap required, opened a new log
I20260709 12:13:49.332926 30981 ts_tablet_manager.cc:1403] T 1bbb677d9c544ed5a31297773b1508d6 P 84b98f9236604dd0b22ae23c5378a676: Time spent bootstrapping tablet: real 0.080s	user 0.013s	sys 0.000s
I20260709 12:13:49.322835 30978 ts_tablet_manager.cc:1434] T a3ffdffa995943d28fc038fce9198caf P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:13:49.327584 31173 raft_consensus.cc:493] T 554acf71459c4e59b886396df52b3004 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.340560 31173 raft_consensus.cc:515] T 554acf71459c4e59b886396df52b3004 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:49.343174 30980 tablet_bootstrap.cc:654] T 4031508121204ef4a2f5f2f0e9508cab P 8130e18710c04a61a5d8bd019c6ffdad: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.344754 30709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554acf71459c4e59b886396df52b3004" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:49.345286 31137 raft_consensus.cc:493] T ec7d33fd7f3245f68966bd7749ee53c3 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.345795 31137 raft_consensus.cc:515] T ec7d33fd7f3245f68966bd7749ee53c3 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
W20260709 12:13:49.347190 30824 leader_election.cc:343] T 554acf71459c4e59b886396df52b3004 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:49.347798 31137 leader_election.cc:290] T ec7d33fd7f3245f68966bd7749ee53c3 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
W20260709 12:13:49.347894 30654 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:49.349800 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554acf71459c4e59b886396df52b3004" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:49.350029 30709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec7d33fd7f3245f68966bd7749ee53c3" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
W20260709 12:13:49.351653 30750 leader_election.cc:343] T ec7d33fd7f3245f68966bd7749ee53c3 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:49.352553 30822 leader_election.cc:343] T 554acf71459c4e59b886396df52b3004 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:49.353184 30822 leader_election.cc:304] T 554acf71459c4e59b886396df52b3004 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad; no voters: 6c5665c17e904fc692bce76fc57b2460, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:49.354220 31173 leader_election.cc:290] T 554acf71459c4e59b886396df52b3004 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:49.355376 31173 raft_consensus.cc:2749] T 554acf71459c4e59b886396df52b3004 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:49.357769 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec7d33fd7f3245f68966bd7749ee53c3" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:49.358405 30932 raft_consensus.cc:2468] T ec7d33fd7f3245f68966bd7749ee53c3 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 0.
I20260709 12:13:49.359735 30749 leader_election.cc:304] T ec7d33fd7f3245f68966bd7749ee53c3 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676; no voters: 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:49.360869 31137 raft_consensus.cc:2804] T ec7d33fd7f3245f68966bd7749ee53c3 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:49.361088 30980 tablet_bootstrap.cc:492] T 4031508121204ef4a2f5f2f0e9508cab P 8130e18710c04a61a5d8bd019c6ffdad: No bootstrap required, opened a new log
I20260709 12:13:49.361665 30980 ts_tablet_manager.cc:1403] T 4031508121204ef4a2f5f2f0e9508cab P 8130e18710c04a61a5d8bd019c6ffdad: Time spent bootstrapping tablet: real 0.044s	user 0.008s	sys 0.004s
I20260709 12:13:49.361338 31137 raft_consensus.cc:493] T ec7d33fd7f3245f68966bd7749ee53c3 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.366823 31137 raft_consensus.cc:3060] T ec7d33fd7f3245f68966bd7749ee53c3 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.369313 30980 raft_consensus.cc:359] T 4031508121204ef4a2f5f2f0e9508cab P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:49.370206 30980 raft_consensus.cc:385] T 4031508121204ef4a2f5f2f0e9508cab P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.370304 30856 raft_consensus.cc:2468] T 745e2cea61c44c3a80bdc49add504a75 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 1.
I20260709 12:13:49.372778 30673 leader_election.cc:304] T 745e2cea61c44c3a80bdc49add504a75 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:49.374619 31190 raft_consensus.cc:2804] T 745e2cea61c44c3a80bdc49add504a75 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:49.375183 31190 raft_consensus.cc:697] T 745e2cea61c44c3a80bdc49add504a75 P 6c5665c17e904fc692bce76fc57b2460 [term 1 LEADER]: Becoming Leader. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Running, Role: LEADER
I20260709 12:13:49.375633 30978 tablet_bootstrap.cc:492] T f351526ad9564be4be05825c266794c7 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:49.375983 31190 consensus_queue.cc:237] T 745e2cea61c44c3a80bdc49add504a75 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:49.378468 30981 raft_consensus.cc:359] T 1bbb677d9c544ed5a31297773b1508d6 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:49.379185 30981 raft_consensus.cc:385] T 1bbb677d9c544ed5a31297773b1508d6 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.379451 30981 raft_consensus.cc:740] T 1bbb677d9c544ed5a31297773b1508d6 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.380261 31138 raft_consensus.cc:493] T f351526ad9564be4be05825c266794c7 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.380740 31138 raft_consensus.cc:515] T f351526ad9564be4be05825c266794c7 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:49.381455 31232 consensus_queue.cc:1048] T a3ffdffa995943d28fc038fce9198caf P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:49.370509 30980 raft_consensus.cc:740] T 4031508121204ef4a2f5f2f0e9508cab P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.382814 31138 leader_election.cc:290] T f351526ad9564be4be05825c266794c7 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:49.383778 30980 consensus_queue.cc:260] T 4031508121204ef4a2f5f2f0e9508cab P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:49.384507 30709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f351526ad9564be4be05825c266794c7" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:49.387023 30980 ts_tablet_manager.cc:1434] T 4031508121204ef4a2f5f2f0e9508cab P 8130e18710c04a61a5d8bd019c6ffdad: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 12:13:49.387444 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f351526ad9564be4be05825c266794c7" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:49.388125 30930 raft_consensus.cc:2468] T f351526ad9564be4be05825c266794c7 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 0.
I20260709 12:13:49.389463 30980 tablet_bootstrap.cc:492] T 1bbb677d9c544ed5a31297773b1508d6 P 8130e18710c04a61a5d8bd019c6ffdad: Bootstrap starting.
I20260709 12:13:49.389424 30749 leader_election.cc:304] T f351526ad9564be4be05825c266794c7 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:13:49.392493 31226 raft_consensus.cc:2804] T f351526ad9564be4be05825c266794c7 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:49.392885 31226 raft_consensus.cc:493] T f351526ad9564be4be05825c266794c7 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.393226 31226 raft_consensus.cc:3060] T f351526ad9564be4be05825c266794c7 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:49.396713 30750 leader_election.cc:343] T f351526ad9564be4be05825c266794c7 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:49.402427 30980 tablet_bootstrap.cc:654] T 1bbb677d9c544ed5a31297773b1508d6 P 8130e18710c04a61a5d8bd019c6ffdad: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.402916 30981 consensus_queue.cc:260] T 1bbb677d9c544ed5a31297773b1508d6 P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:49.406700 30981 ts_tablet_manager.cc:1434] T 1bbb677d9c544ed5a31297773b1508d6 P 84b98f9236604dd0b22ae23c5378a676: Time spent starting tablet: real 0.074s	user 0.006s	sys 0.000s
I20260709 12:13:49.406970 30607 catalog_manager.cc:5697] T 745e2cea61c44c3a80bdc49add504a75 P 6c5665c17e904fc692bce76fc57b2460 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129). New cstate: current_term: 1 leader_uuid: "6c5665c17e904fc692bce76fc57b2460" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:49.410454 30981 tablet_bootstrap.cc:492] T c52d3c5b6b15499e9c834cf33954609a P 84b98f9236604dd0b22ae23c5378a676: Bootstrap starting.
I20260709 12:13:49.414256 31226 raft_consensus.cc:515] T f351526ad9564be4be05825c266794c7 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:49.418773 31173 raft_consensus.cc:493] T 4031508121204ef4a2f5f2f0e9508cab P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.423684 31226 leader_election.cc:290] T f351526ad9564be4be05825c266794c7 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 election: Requested vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:49.399580 31137 raft_consensus.cc:515] T ec7d33fd7f3245f68966bd7749ee53c3 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:49.423180 31173 raft_consensus.cc:515] T 4031508121204ef4a2f5f2f0e9508cab P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:49.425024 30709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f351526ad9564be4be05825c266794c7" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
I20260709 12:13:49.427770 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4031508121204ef4a2f5f2f0e9508cab" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:49.428982 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec7d33fd7f3245f68966bd7749ee53c3" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
I20260709 12:13:49.429572 30929 raft_consensus.cc:3060] T ec7d33fd7f3245f68966bd7749ee53c3 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:49.429458 30750 leader_election.cc:343] T f351526ad9564be4be05825c266794c7 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:49.421933 30977 tablet_bootstrap.cc:492] T 34e3009dd96f4545b2abe325ac95e960 P 15ad0880a63541ef965cb6acca4513d7: No bootstrap required, opened a new log
I20260709 12:13:49.430800 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4031508121204ef4a2f5f2f0e9508cab" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:49.432390 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f351526ad9564be4be05825c266794c7" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
W20260709 12:13:49.432730 30823 leader_election.cc:343] T 4031508121204ef4a2f5f2f0e9508cab P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:49.432999 30932 raft_consensus.cc:3060] T f351526ad9564be4be05825c266794c7 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.433051 30780 raft_consensus.cc:2468] T 4031508121204ef4a2f5f2f0e9508cab P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 0.
I20260709 12:13:49.440809 30978 tablet_bootstrap.cc:654] T f351526ad9564be4be05825c266794c7 P 6c5665c17e904fc692bce76fc57b2460: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.434607 30977 ts_tablet_manager.cc:1403] T 34e3009dd96f4545b2abe325ac95e960 P 15ad0880a63541ef965cb6acca4513d7: Time spent bootstrapping tablet: real 0.200s	user 0.021s	sys 0.012s
I20260709 12:13:49.431970 31173 leader_election.cc:290] T 4031508121204ef4a2f5f2f0e9508cab P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:49.438526 30709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec7d33fd7f3245f68966bd7749ee53c3" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
I20260709 12:13:49.436928 31137 leader_election.cc:290] T ec7d33fd7f3245f68966bd7749ee53c3 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 election: Requested vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:49.457875 31232 raft_consensus.cc:493] T 2137918dbdc34ac29180015bd93261de P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.484563 31232 raft_consensus.cc:515] T 2137918dbdc34ac29180015bd93261de P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:49.486877 31232 leader_election.cc:290] T 2137918dbdc34ac29180015bd93261de P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:49.487926 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2137918dbdc34ac29180015bd93261de" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:49.488502 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2137918dbdc34ac29180015bd93261de" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:49.459240 30977 raft_consensus.cc:359] T 34e3009dd96f4545b2abe325ac95e960 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:49.489225 30977 raft_consensus.cc:385] T 34e3009dd96f4545b2abe325ac95e960 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.489362 30709 raft_consensus.cc:3060] T a3ffdffa995943d28fc038fce9198caf P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.489537 30977 raft_consensus.cc:740] T 34e3009dd96f4545b2abe325ac95e960 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.458407 30981 tablet_bootstrap.cc:654] T c52d3c5b6b15499e9c834cf33954609a P 84b98f9236604dd0b22ae23c5378a676: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.490290 30977 consensus_queue.cc:260] T 34e3009dd96f4545b2abe325ac95e960 P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:49.492509 30977 ts_tablet_manager.cc:1434] T 34e3009dd96f4545b2abe325ac95e960 P 15ad0880a63541ef965cb6acca4513d7: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 12:13:49.493499 30977 tablet_bootstrap.cc:492] T 4031508121204ef4a2f5f2f0e9508cab P 15ad0880a63541ef965cb6acca4513d7: Bootstrap starting.
I20260709 12:13:49.434746 30822 leader_election.cc:304] T 4031508121204ef4a2f5f2f0e9508cab P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676; no voters: 15ad0880a63541ef965cb6acca4513d7
W20260709 12:13:49.495042 30822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:40083, user_credentials={real_user=slave}} blocked reactor thread for 60725.9us
I20260709 12:13:49.442576 30929 raft_consensus.cc:2468] T ec7d33fd7f3245f68966bd7749ee53c3 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 1.
I20260709 12:13:49.496510 30749 leader_election.cc:304] T ec7d33fd7f3245f68966bd7749ee53c3 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:13:49.497607 31138 raft_consensus.cc:2804] T ec7d33fd7f3245f68966bd7749ee53c3 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:49.482108 30978 tablet_bootstrap.cc:492] T f351526ad9564be4be05825c266794c7 P 6c5665c17e904fc692bce76fc57b2460: No bootstrap required, opened a new log
I20260709 12:13:49.488760 30855 raft_consensus.cc:2393] T 2137918dbdc34ac29180015bd93261de P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 84b98f9236604dd0b22ae23c5378a676 in current term 1: Already voted for candidate 15ad0880a63541ef965cb6acca4513d7 in this term.
I20260709 12:13:49.498230 31138 raft_consensus.cc:697] T ec7d33fd7f3245f68966bd7749ee53c3 P 84b98f9236604dd0b22ae23c5378a676 [term 1 LEADER]: Becoming Leader. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Running, Role: LEADER
I20260709 12:13:49.498642 30978 ts_tablet_manager.cc:1403] T f351526ad9564be4be05825c266794c7 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.123s	user 0.014s	sys 0.001s
I20260709 12:13:49.499475 30748 leader_election.cc:304] T 2137918dbdc34ac29180015bd93261de P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 84b98f9236604dd0b22ae23c5378a676; no voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad
I20260709 12:13:49.499177 31138 consensus_queue.cc:237] T ec7d33fd7f3245f68966bd7749ee53c3 P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:49.500968 31232 raft_consensus.cc:3060] T 2137918dbdc34ac29180015bd93261de P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.501917 30978 raft_consensus.cc:359] T f351526ad9564be4be05825c266794c7 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:49.502619 30978 raft_consensus.cc:385] T f351526ad9564be4be05825c266794c7 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.502883 30978 raft_consensus.cc:740] T f351526ad9564be4be05825c266794c7 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.503603 31173 raft_consensus.cc:2804] T 4031508121204ef4a2f5f2f0e9508cab P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:49.503993 31173 raft_consensus.cc:493] T 4031508121204ef4a2f5f2f0e9508cab P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.504323 31173 raft_consensus.cc:3060] T 4031508121204ef4a2f5f2f0e9508cab P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.469489 30932 raft_consensus.cc:2468] T f351526ad9564be4be05825c266794c7 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 1.
I20260709 12:13:49.506286 30749 leader_election.cc:304] T f351526ad9564be4be05825c266794c7 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676; no voters: 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:49.471279 30980 tablet_bootstrap.cc:492] T 1bbb677d9c544ed5a31297773b1508d6 P 8130e18710c04a61a5d8bd019c6ffdad: No bootstrap required, opened a new log
I20260709 12:13:49.507429 31137 raft_consensus.cc:2804] T f351526ad9564be4be05825c266794c7 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:49.507654 30980 ts_tablet_manager.cc:1403] T 1bbb677d9c544ed5a31297773b1508d6 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent bootstrapping tablet: real 0.118s	user 0.029s	sys 0.014s
I20260709 12:13:49.507925 31137 raft_consensus.cc:697] T f351526ad9564be4be05825c266794c7 P 84b98f9236604dd0b22ae23c5378a676 [term 1 LEADER]: Becoming Leader. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Running, Role: LEADER
I20260709 12:13:49.508762 31137 consensus_queue.cc:237] T f351526ad9564be4be05825c266794c7 P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
W20260709 12:13:49.516403 30750 leader_election.cc:343] T ec7d33fd7f3245f68966bd7749ee53c3 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:49.517028 30980 raft_consensus.cc:359] T 1bbb677d9c544ed5a31297773b1508d6 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:49.517894 30980 raft_consensus.cc:385] T 1bbb677d9c544ed5a31297773b1508d6 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.518172 30980 raft_consensus.cc:740] T 1bbb677d9c544ed5a31297773b1508d6 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.518374 31226 consensus_queue.cc:1048] T a3ffdffa995943d28fc038fce9198caf P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:49.519045 30980 consensus_queue.cc:260] T 1bbb677d9c544ed5a31297773b1508d6 P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:49.518852 30978 consensus_queue.cc:260] T f351526ad9564be4be05825c266794c7 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:49.520558 30977 tablet_bootstrap.cc:654] T 4031508121204ef4a2f5f2f0e9508cab P 15ad0880a63541ef965cb6acca4513d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.516320 31232 raft_consensus.cc:2749] T 2137918dbdc34ac29180015bd93261de P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:49.531808 31173 raft_consensus.cc:515] T 4031508121204ef4a2f5f2f0e9508cab P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:49.534584 31173 leader_election.cc:290] T 4031508121204ef4a2f5f2f0e9508cab P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 election: Requested vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:49.539980 30978 ts_tablet_manager.cc:1434] T f351526ad9564be4be05825c266794c7 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 12:13:49.545969 30980 ts_tablet_manager.cc:1434] T 1bbb677d9c544ed5a31297773b1508d6 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 12:13:49.547334 30978 tablet_bootstrap.cc:492] T ec7d33fd7f3245f68966bd7749ee53c3 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:49.563668 30980 tablet_bootstrap.cc:492] T ca92b4f3c36b42fb9aa2f575c06344fe P 8130e18710c04a61a5d8bd019c6ffdad: Bootstrap starting.
I20260709 12:13:49.563520 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4031508121204ef4a2f5f2f0e9508cab" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:13:49.564378 30780 raft_consensus.cc:3060] T 4031508121204ef4a2f5f2f0e9508cab P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.556440 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4031508121204ef4a2f5f2f0e9508cab" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
I20260709 12:13:49.570495 30607 catalog_manager.cc:5697] T ec7d33fd7f3245f68966bd7749ee53c3 P 84b98f9236604dd0b22ae23c5378a676 reported cstate change: term changed from 0 to 1, leader changed from <none> to 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "84b98f9236604dd0b22ae23c5378a676" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:49.575490 30607 catalog_manager.cc:5697] T f351526ad9564be4be05825c266794c7 P 84b98f9236604dd0b22ae23c5378a676 reported cstate change: term changed from 0 to 1, leader changed from <none> to 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "84b98f9236604dd0b22ae23c5378a676" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: HEALTHY } } }
W20260709 12:13:49.583630 30823 leader_election.cc:343] T 4031508121204ef4a2f5f2f0e9508cab P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:49.590904 30978 tablet_bootstrap.cc:654] T ec7d33fd7f3245f68966bd7749ee53c3 P 6c5665c17e904fc692bce76fc57b2460: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.583724 31222 raft_consensus.cc:493] T 34e3009dd96f4545b2abe325ac95e960 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.591461 31222 raft_consensus.cc:515] T 34e3009dd96f4545b2abe325ac95e960 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:49.591914 31053 raft_consensus.cc:493] T 1bbb677d9c544ed5a31297773b1508d6 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.592619 31053 raft_consensus.cc:515] T 1bbb677d9c544ed5a31297773b1508d6 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:49.593338 31222 leader_election.cc:290] T 34e3009dd96f4545b2abe325ac95e960 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:49.593992 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e3009dd96f4545b2abe325ac95e960" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:49.594739 30855 raft_consensus.cc:2468] T 34e3009dd96f4545b2abe325ac95e960 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 0.
I20260709 12:13:49.594938 30780 raft_consensus.cc:2468] T 4031508121204ef4a2f5f2f0e9508cab P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 1.
I20260709 12:13:49.596189 30896 leader_election.cc:304] T 34e3009dd96f4545b2abe325ac95e960 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 
I20260709 12:13:49.594862 30707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e3009dd96f4545b2abe325ac95e960" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:49.597800 31053 leader_election.cc:290] T 1bbb677d9c544ed5a31297773b1508d6 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:49.596601 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bbb677d9c544ed5a31297773b1508d6" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:49.596515 30822 leader_election.cc:304] T 4031508121204ef4a2f5f2f0e9508cab P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676; no voters: 15ad0880a63541ef965cb6acca4513d7
I20260709 12:13:49.596971 31222 raft_consensus.cc:2804] T 34e3009dd96f4545b2abe325ac95e960 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:49.607923 31222 raft_consensus.cc:493] T 34e3009dd96f4545b2abe325ac95e960 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.608266 31222 raft_consensus.cc:3060] T 34e3009dd96f4545b2abe325ac95e960 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.609491 31174 raft_consensus.cc:2804] T 4031508121204ef4a2f5f2f0e9508cab P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:49.610219 31174 raft_consensus.cc:697] T 4031508121204ef4a2f5f2f0e9508cab P 8130e18710c04a61a5d8bd019c6ffdad [term 1 LEADER]: Becoming Leader. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Running, Role: LEADER
I20260709 12:13:49.611383 31174 consensus_queue.cc:237] T 4031508121204ef4a2f5f2f0e9508cab P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:49.596769 31221 consensus_queue.cc:1048] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:13:49.616390 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bbb677d9c544ed5a31297773b1508d6" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:49.617110 30855 raft_consensus.cc:2468] T 1bbb677d9c544ed5a31297773b1508d6 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 0.
I20260709 12:13:49.618247 30896 leader_election.cc:304] T 1bbb677d9c544ed5a31297773b1508d6 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 
W20260709 12:13:49.620682 30898 leader_election.cc:343] T 34e3009dd96f4545b2abe325ac95e960 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:49.622107 31183 raft_consensus.cc:2804] T 1bbb677d9c544ed5a31297773b1508d6 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:49.622529 31183 raft_consensus.cc:493] T 1bbb677d9c544ed5a31297773b1508d6 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.622849 31183 raft_consensus.cc:3060] T 1bbb677d9c544ed5a31297773b1508d6 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.623364 30780 raft_consensus.cc:2468] T 1bbb677d9c544ed5a31297773b1508d6 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 0.
I20260709 12:13:49.635373 30981 tablet_bootstrap.cc:492] T c52d3c5b6b15499e9c834cf33954609a P 84b98f9236604dd0b22ae23c5378a676: No bootstrap required, opened a new log
I20260709 12:13:49.635915 30981 ts_tablet_manager.cc:1403] T c52d3c5b6b15499e9c834cf33954609a P 84b98f9236604dd0b22ae23c5378a676: Time spent bootstrapping tablet: real 0.226s	user 0.014s	sys 0.000s
I20260709 12:13:49.636741 30980 tablet_bootstrap.cc:654] T ca92b4f3c36b42fb9aa2f575c06344fe P 8130e18710c04a61a5d8bd019c6ffdad: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.638911 30981 raft_consensus.cc:359] T c52d3c5b6b15499e9c834cf33954609a P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:49.671039 30981 raft_consensus.cc:385] T c52d3c5b6b15499e9c834cf33954609a P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.674672 30981 raft_consensus.cc:740] T c52d3c5b6b15499e9c834cf33954609a P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.644300 31222 raft_consensus.cc:515] T 34e3009dd96f4545b2abe325ac95e960 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:49.675390 31173 consensus_queue.cc:1048] T 7b23395f850d4699b8d289f501c96f60 P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:49.676966 30981 consensus_queue.cc:260] T c52d3c5b6b15499e9c834cf33954609a P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:49.678943 30709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e3009dd96f4545b2abe325ac95e960" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
I20260709 12:13:49.679458 31222 leader_election.cc:290] T 34e3009dd96f4545b2abe325ac95e960 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Requested vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
W20260709 12:13:49.700595 30673 consensus_peers.cc:597] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 -> Peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Couldn't send request to peer 84b98f9236604dd0b22ae23c5378a676. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:49.701715 30898 leader_election.cc:343] T 34e3009dd96f4545b2abe325ac95e960 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:49.683485 31183 raft_consensus.cc:515] T 1bbb677d9c544ed5a31297773b1508d6 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:49.691103 30978 tablet_bootstrap.cc:492] T ec7d33fd7f3245f68966bd7749ee53c3 P 6c5665c17e904fc692bce76fc57b2460: No bootstrap required, opened a new log
I20260709 12:13:49.702728 30978 ts_tablet_manager.cc:1403] T ec7d33fd7f3245f68966bd7749ee53c3 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.158s	user 0.011s	sys 0.013s
I20260709 12:13:49.643323 30977 tablet_bootstrap.cc:492] T 4031508121204ef4a2f5f2f0e9508cab P 15ad0880a63541ef965cb6acca4513d7: No bootstrap required, opened a new log
I20260709 12:13:49.697152 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e3009dd96f4545b2abe325ac95e960" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:13:49.703752 30855 raft_consensus.cc:3060] T 34e3009dd96f4545b2abe325ac95e960 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.703894 31183 leader_election.cc:290] T 1bbb677d9c544ed5a31297773b1508d6 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Requested vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:49.710783 30978 raft_consensus.cc:359] T ec7d33fd7f3245f68966bd7749ee53c3 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:49.711572 30978 raft_consensus.cc:385] T ec7d33fd7f3245f68966bd7749ee53c3 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.711256 30977 ts_tablet_manager.cc:1403] T 4031508121204ef4a2f5f2f0e9508cab P 15ad0880a63541ef965cb6acca4513d7: Time spent bootstrapping tablet: real 0.218s	user 0.013s	sys 0.016s
I20260709 12:13:49.711850 30978 raft_consensus.cc:740] T ec7d33fd7f3245f68966bd7749ee53c3 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.714138 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bbb677d9c544ed5a31297773b1508d6" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:13:49.715049 30856 raft_consensus.cc:3060] T 1bbb677d9c544ed5a31297773b1508d6 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.715740 30978 consensus_queue.cc:260] T ec7d33fd7f3245f68966bd7749ee53c3 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:49.720211 30978 ts_tablet_manager.cc:1434] T ec7d33fd7f3245f68966bd7749ee53c3 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:13:49.721205 30978 tablet_bootstrap.cc:492] T 34e3009dd96f4545b2abe325ac95e960 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:49.724050 30856 raft_consensus.cc:2468] T 1bbb677d9c544ed5a31297773b1508d6 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 1.
I20260709 12:13:49.733429 30977 raft_consensus.cc:359] T 4031508121204ef4a2f5f2f0e9508cab P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:49.764223 30977 raft_consensus.cc:385] T 4031508121204ef4a2f5f2f0e9508cab P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.764673 30977 raft_consensus.cc:740] T 4031508121204ef4a2f5f2f0e9508cab P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.765596 30977 consensus_queue.cc:260] T 4031508121204ef4a2f5f2f0e9508cab P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:49.734732 30855 raft_consensus.cc:2468] T 34e3009dd96f4545b2abe325ac95e960 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 1.
I20260709 12:13:49.740814 31192 raft_consensus.cc:493] T ec7d33fd7f3245f68966bd7749ee53c3 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.767405 31192 raft_consensus.cc:515] T ec7d33fd7f3245f68966bd7749ee53c3 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:49.768286 30977 ts_tablet_manager.cc:1434] T 4031508121204ef4a2f5f2f0e9508cab P 15ad0880a63541ef965cb6acca4513d7: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.001s
I20260709 12:13:49.769472 30977 tablet_bootstrap.cc:492] T 3e0e49105b2d44f09c55f7cc603f9b91 P 15ad0880a63541ef965cb6acca4513d7: Bootstrap starting.
I20260709 12:13:49.769649 31192 leader_election.cc:290] T ec7d33fd7f3245f68966bd7749ee53c3 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:49.747351 30978 tablet_bootstrap.cc:654] T 34e3009dd96f4545b2abe325ac95e960 P 6c5665c17e904fc692bce76fc57b2460: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.748027 31325 consensus_queue.cc:1048] T 7b23395f850d4699b8d289f501c96f60 P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Connected to new peer: Peer: permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:49.795011 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec7d33fd7f3245f68966bd7749ee53c3" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:49.760550 30981 ts_tablet_manager.cc:1434] T c52d3c5b6b15499e9c834cf33954609a P 84b98f9236604dd0b22ae23c5378a676: Time spent starting tablet: real 0.124s	user 0.007s	sys 0.000s
I20260709 12:13:49.796689 30929 raft_consensus.cc:2393] T ec7d33fd7f3245f68966bd7749ee53c3 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c5665c17e904fc692bce76fc57b2460 in current term 1: Already voted for candidate 84b98f9236604dd0b22ae23c5378a676 in this term.
I20260709 12:13:49.798830 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bbb677d9c544ed5a31297773b1508d6" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:13:49.799748 30779 raft_consensus.cc:3060] T 1bbb677d9c544ed5a31297773b1508d6 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.802412 30981 tablet_bootstrap.cc:492] T 554acf71459c4e59b886396df52b3004 P 84b98f9236604dd0b22ae23c5378a676: Bootstrap starting.
I20260709 12:13:49.817263 30981 tablet_bootstrap.cc:654] T 554acf71459c4e59b886396df52b3004 P 84b98f9236604dd0b22ae23c5378a676: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.817747 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec7d33fd7f3245f68966bd7749ee53c3" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:49.828594 30896 leader_election.cc:304] T 34e3009dd96f4545b2abe325ac95e960 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:49.832697 31318 raft_consensus.cc:2804] T 34e3009dd96f4545b2abe325ac95e960 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:49.833240 31318 raft_consensus.cc:697] T 34e3009dd96f4545b2abe325ac95e960 P 15ad0880a63541ef965cb6acca4513d7 [term 1 LEADER]: Becoming Leader. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Running, Role: LEADER
I20260709 12:13:49.834053 31318 consensus_queue.cc:237] T 34e3009dd96f4545b2abe325ac95e960 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:49.829483 31321 consensus_queue.cc:1048] T 2137918dbdc34ac29180015bd93261de P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:49.845489 30607 catalog_manager.cc:5697] T 4031508121204ef4a2f5f2f0e9508cab P 8130e18710c04a61a5d8bd019c6ffdad reported cstate change: term changed from 0 to 1, leader changed from <none> to 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131). New cstate: current_term: 1 leader_uuid: "8130e18710c04a61a5d8bd019c6ffdad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:49.848579 30673 consensus_peers.cc:597] T 745e2cea61c44c3a80bdc49add504a75 P 6c5665c17e904fc692bce76fc57b2460 -> Peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Couldn't send request to peer 84b98f9236604dd0b22ae23c5378a676. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:49.810515 30779 raft_consensus.cc:2468] T 1bbb677d9c544ed5a31297773b1508d6 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 1.
I20260709 12:13:49.850885 30896 leader_election.cc:304] T 1bbb677d9c544ed5a31297773b1508d6 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 
I20260709 12:13:49.852753 31323 raft_consensus.cc:2804] T 1bbb677d9c544ed5a31297773b1508d6 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:49.853447 31323 raft_consensus.cc:697] T 1bbb677d9c544ed5a31297773b1508d6 P 15ad0880a63541ef965cb6acca4513d7 [term 1 LEADER]: Becoming Leader. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Running, Role: LEADER
I20260709 12:13:49.854578 31323 consensus_queue.cc:237] T 1bbb677d9c544ed5a31297773b1508d6 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:49.857236 30981 tablet_bootstrap.cc:492] T 554acf71459c4e59b886396df52b3004 P 84b98f9236604dd0b22ae23c5378a676: No bootstrap required, opened a new log
I20260709 12:13:49.857743 30981 ts_tablet_manager.cc:1403] T 554acf71459c4e59b886396df52b3004 P 84b98f9236604dd0b22ae23c5378a676: Time spent bootstrapping tablet: real 0.056s	user 0.013s	sys 0.000s
I20260709 12:13:49.827490 30978 tablet_bootstrap.cc:492] T 34e3009dd96f4545b2abe325ac95e960 P 6c5665c17e904fc692bce76fc57b2460: No bootstrap required, opened a new log
I20260709 12:13:49.858662 30978 ts_tablet_manager.cc:1403] T 34e3009dd96f4545b2abe325ac95e960 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.138s	user 0.012s	sys 0.000s
I20260709 12:13:49.859754 31192 raft_consensus.cc:493] T f351526ad9564be4be05825c266794c7 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.860284 31192 raft_consensus.cc:515] T f351526ad9564be4be05825c266794c7 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:49.861459 30978 raft_consensus.cc:359] T 34e3009dd96f4545b2abe325ac95e960 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:49.862401 31192 leader_election.cc:290] T f351526ad9564be4be05825c266794c7 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:49.866850 30978 raft_consensus.cc:385] T 34e3009dd96f4545b2abe325ac95e960 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.867239 30978 raft_consensus.cc:740] T 34e3009dd96f4545b2abe325ac95e960 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.867842 30978 consensus_queue.cc:260] T 34e3009dd96f4545b2abe325ac95e960 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:49.869451 30977 tablet_bootstrap.cc:654] T 3e0e49105b2d44f09c55f7cc603f9b91 P 15ad0880a63541ef965cb6acca4513d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.871110 30978 ts_tablet_manager.cc:1434] T 34e3009dd96f4545b2abe325ac95e960 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:13:49.872063 30978 tablet_bootstrap.cc:492] T a4b7489c1b104bf2bb461bcdca7e6f42 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:49.878371 31137 raft_consensus.cc:493] T c52d3c5b6b15499e9c834cf33954609a P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.877965 31321 consensus_queue.cc:1048] T 2137918dbdc34ac29180015bd93261de P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:13:49.880770 31137 raft_consensus.cc:515] T c52d3c5b6b15499e9c834cf33954609a P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:49.883813 30674 leader_election.cc:304] T ec7d33fd7f3245f68966bd7749ee53c3 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460; no voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:49.888540 31192 raft_consensus.cc:3060] T ec7d33fd7f3245f68966bd7749ee53c3 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.886125 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f351526ad9564be4be05825c266794c7" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:49.903602 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f351526ad9564be4be05825c266794c7" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:49.904013 31192 raft_consensus.cc:2749] T ec7d33fd7f3245f68966bd7749ee53c3 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:49.904536 30932 raft_consensus.cc:2393] T f351526ad9564be4be05825c266794c7 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c5665c17e904fc692bce76fc57b2460 in current term 1: Already voted for candidate 84b98f9236604dd0b22ae23c5378a676 in this term.
I20260709 12:13:49.907315 31137 leader_election.cc:290] T c52d3c5b6b15499e9c834cf33954609a P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:49.913918 30706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c52d3c5b6b15499e9c834cf33954609a" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:49.914629 31221 consensus_queue.cc:1048] T 745e2cea61c44c3a80bdc49add504a75 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:49.915220 30981 raft_consensus.cc:359] T 554acf71459c4e59b886396df52b3004 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:49.915947 30981 raft_consensus.cc:385] T 554acf71459c4e59b886396df52b3004 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.916250 30981 raft_consensus.cc:740] T 554acf71459c4e59b886396df52b3004 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.917109 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c52d3c5b6b15499e9c834cf33954609a" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:49.919895 30981 consensus_queue.cc:260] T 554acf71459c4e59b886396df52b3004 P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:49.927861 30604 catalog_manager.cc:5697] T 34e3009dd96f4545b2abe325ac95e960 P 15ad0880a63541ef965cb6acca4513d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132). New cstate: current_term: 1 leader_uuid: "15ad0880a63541ef965cb6acca4513d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:49.929447 30604 catalog_manager.cc:5697] T 1bbb677d9c544ed5a31297773b1508d6 P 15ad0880a63541ef965cb6acca4513d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132). New cstate: current_term: 1 leader_uuid: "15ad0880a63541ef965cb6acca4513d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:49.933563 30978 tablet_bootstrap.cc:654] T a4b7489c1b104bf2bb461bcdca7e6f42 P 6c5665c17e904fc692bce76fc57b2460: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.936287 30980 tablet_bootstrap.cc:492] T ca92b4f3c36b42fb9aa2f575c06344fe P 8130e18710c04a61a5d8bd019c6ffdad: No bootstrap required, opened a new log
I20260709 12:13:49.936766 30980 ts_tablet_manager.cc:1403] T ca92b4f3c36b42fb9aa2f575c06344fe P 8130e18710c04a61a5d8bd019c6ffdad: Time spent bootstrapping tablet: real 0.373s	user 0.028s	sys 0.043s
I20260709 12:13:49.941643 30980 raft_consensus.cc:359] T ca92b4f3c36b42fb9aa2f575c06344fe P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:49.942408 30980 raft_consensus.cc:385] T ca92b4f3c36b42fb9aa2f575c06344fe P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.942755 30980 raft_consensus.cc:740] T ca92b4f3c36b42fb9aa2f575c06344fe P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.943516 30980 consensus_queue.cc:260] T ca92b4f3c36b42fb9aa2f575c06344fe P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:49.948300 30981 ts_tablet_manager.cc:1434] T 554acf71459c4e59b886396df52b3004 P 84b98f9236604dd0b22ae23c5378a676: Time spent starting tablet: real 0.090s	user 0.009s	sys 0.000s
I20260709 12:13:49.957106 30981 tablet_bootstrap.cc:492] T 745e2cea61c44c3a80bdc49add504a75 P 84b98f9236604dd0b22ae23c5378a676: Bootstrap starting.
I20260709 12:13:49.958685 30977 tablet_bootstrap.cc:492] T 3e0e49105b2d44f09c55f7cc603f9b91 P 15ad0880a63541ef965cb6acca4513d7: No bootstrap required, opened a new log
I20260709 12:13:49.959241 30977 ts_tablet_manager.cc:1403] T 3e0e49105b2d44f09c55f7cc603f9b91 P 15ad0880a63541ef965cb6acca4513d7: Time spent bootstrapping tablet: real 0.190s	user 0.013s	sys 0.017s
I20260709 12:13:49.962255 30977 raft_consensus.cc:359] T 3e0e49105b2d44f09c55f7cc603f9b91 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:49.962920 30977 raft_consensus.cc:385] T 3e0e49105b2d44f09c55f7cc603f9b91 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.963209 30977 raft_consensus.cc:740] T 3e0e49105b2d44f09c55f7cc603f9b91 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.963973 30977 consensus_queue.cc:260] T 3e0e49105b2d44f09c55f7cc603f9b91 P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:49.968282 30981 tablet_bootstrap.cc:654] T 745e2cea61c44c3a80bdc49add504a75 P 84b98f9236604dd0b22ae23c5378a676: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.968381 30980 ts_tablet_manager.cc:1434] T ca92b4f3c36b42fb9aa2f575c06344fe P 8130e18710c04a61a5d8bd019c6ffdad: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
W20260709 12:13:49.953738 30674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:43035, user_credentials={real_user=slave}} blocked reactor thread for 43963.3us
I20260709 12:13:49.978667 30977 ts_tablet_manager.cc:1434] T 3e0e49105b2d44f09c55f7cc603f9b91 P 15ad0880a63541ef965cb6acca4513d7: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:13:49.986518 30750 leader_election.cc:304] T c52d3c5b6b15499e9c834cf33954609a P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 84b98f9236604dd0b22ae23c5378a676; no voters: 15ad0880a63541ef965cb6acca4513d7, 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:49.987654 30674 leader_election.cc:304] T f351526ad9564be4be05825c266794c7 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460; no voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:49.989223 30706 raft_consensus.cc:3060] T f351526ad9564be4be05825c266794c7 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.002784 31311 raft_consensus.cc:2749] T c52d3c5b6b15499e9c834cf33954609a P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:50.009438 31190 raft_consensus.cc:493] T 34e3009dd96f4545b2abe325ac95e960 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.009999 31190 raft_consensus.cc:515] T 34e3009dd96f4545b2abe325ac95e960 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:50.012095 31190 leader_election.cc:290] T 34e3009dd96f4545b2abe325ac95e960 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:50.020991 30980 tablet_bootstrap.cc:492] T 32c211a79de247c8b5cef16a2d0a4dcb P 8130e18710c04a61a5d8bd019c6ffdad: Bootstrap starting.
I20260709 12:13:50.019375 31221 raft_consensus.cc:493] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.022382 31221 raft_consensus.cc:515] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:50.024416 31221 leader_election.cc:290] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:50.025969 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e3009dd96f4545b2abe325ac95e960" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:50.026796 30853 raft_consensus.cc:2393] T 34e3009dd96f4545b2abe325ac95e960 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c5665c17e904fc692bce76fc57b2460 in current term 1: Already voted for candidate 15ad0880a63541ef965cb6acca4513d7 in this term.
I20260709 12:13:50.028097 30980 tablet_bootstrap.cc:654] T 32c211a79de247c8b5cef16a2d0a4dcb P 8130e18710c04a61a5d8bd019c6ffdad: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:50.031328 30674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.132:43035, user_credentials={real_user=slave}} blocked reactor thread for 43817.1us
I20260709 12:13:50.034307 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e3009dd96f4545b2abe325ac95e960" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:50.036635 30977 tablet_bootstrap.cc:492] T ca92b4f3c36b42fb9aa2f575c06344fe P 15ad0880a63541ef965cb6acca4513d7: Bootstrap starting.
I20260709 12:13:50.038501 31318 raft_consensus.cc:493] T 4031508121204ef4a2f5f2f0e9508cab P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.039116 31318 raft_consensus.cc:515] T 4031508121204ef4a2f5f2f0e9508cab P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:50.041301 31318 leader_election.cc:290] T 4031508121204ef4a2f5f2f0e9508cab P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:50.043155 30978 tablet_bootstrap.cc:492] T a4b7489c1b104bf2bb461bcdca7e6f42 P 6c5665c17e904fc692bce76fc57b2460: No bootstrap required, opened a new log
I20260709 12:13:50.046227 30978 ts_tablet_manager.cc:1403] T a4b7489c1b104bf2bb461bcdca7e6f42 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.174s	user 0.041s	sys 0.030s
I20260709 12:13:50.046752 30977 tablet_bootstrap.cc:654] T ca92b4f3c36b42fb9aa2f575c06344fe P 15ad0880a63541ef965cb6acca4513d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.044912 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4031508121204ef4a2f5f2f0e9508cab" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:50.047487 30780 raft_consensus.cc:2393] T 4031508121204ef4a2f5f2f0e9508cab P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 15ad0880a63541ef965cb6acca4513d7 in current term 1: Already voted for candidate 8130e18710c04a61a5d8bd019c6ffdad in this term.
I20260709 12:13:50.042937 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4031508121204ef4a2f5f2f0e9508cab" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:50.052083 30896 leader_election.cc:304] T 4031508121204ef4a2f5f2f0e9508cab P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7; no voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:50.053406 31318 raft_consensus.cc:3060] T 4031508121204ef4a2f5f2f0e9508cab P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.061197 31334 raft_consensus.cc:2749] T f351526ad9564be4be05825c266794c7 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:50.061412 30978 raft_consensus.cc:359] T a4b7489c1b104bf2bb461bcdca7e6f42 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:50.062757 30978 raft_consensus.cc:385] T a4b7489c1b104bf2bb461bcdca7e6f42 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.063125 30978 raft_consensus.cc:740] T a4b7489c1b104bf2bb461bcdca7e6f42 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
W20260709 12:13:50.067605 30673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:40083, user_credentials={real_user=slave}} blocked reactor thread for 53444.8us
I20260709 12:13:50.064029 30978 consensus_queue.cc:260] T a4b7489c1b104bf2bb461bcdca7e6f42 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:50.078655 30978 ts_tablet_manager.cc:1434] T a4b7489c1b104bf2bb461bcdca7e6f42 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.032s	user 0.002s	sys 0.004s
I20260709 12:13:50.083190 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0317908edb88497b82c4e59ef1bac414" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:50.084009 31137 consensus_queue.cc:1048] T ec7d33fd7f3245f68966bd7749ee53c3 P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:50.085381 30673 leader_election.cc:304] T 34e3009dd96f4545b2abe325ac95e960 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460; no voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad
I20260709 12:13:50.087535 31334 raft_consensus.cc:3060] T 34e3009dd96f4545b2abe325ac95e960 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.088096 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0317908edb88497b82c4e59ef1bac414" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:50.089069 30853 raft_consensus.cc:2468] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 1.
I20260709 12:13:50.083081 31232 consensus_queue.cc:1048] T f351526ad9564be4be05825c266794c7 P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:50.097270 31311 consensus_queue.cc:1048] T f351526ad9564be4be05825c266794c7 P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:50.119221 30782 raft_consensus.cc:3060] T c52d3c5b6b15499e9c834cf33954609a P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:50.110991 30673 leader_election.cc:343] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:50.123908 30673 leader_election.cc:304] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:50.137221 30978 tablet_bootstrap.cc:492] T 554acf71459c4e59b886396df52b3004 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:50.135428 31221 raft_consensus.cc:2804] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:50.148386 30981 tablet_bootstrap.cc:492] T 745e2cea61c44c3a80bdc49add504a75 P 84b98f9236604dd0b22ae23c5378a676: No bootstrap required, opened a new log
I20260709 12:13:50.149134 30981 ts_tablet_manager.cc:1403] T 745e2cea61c44c3a80bdc49add504a75 P 84b98f9236604dd0b22ae23c5378a676: Time spent bootstrapping tablet: real 0.192s	user 0.024s	sys 0.029s
I20260709 12:13:50.145578 31318 raft_consensus.cc:2749] T 4031508121204ef4a2f5f2f0e9508cab P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:50.153370 30980 tablet_bootstrap.cc:492] T 32c211a79de247c8b5cef16a2d0a4dcb P 8130e18710c04a61a5d8bd019c6ffdad: No bootstrap required, opened a new log
I20260709 12:13:50.143397 31311 consensus_queue.cc:1048] T ec7d33fd7f3245f68966bd7749ee53c3 P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:13:50.153879 30980 ts_tablet_manager.cc:1403] T 32c211a79de247c8b5cef16a2d0a4dcb P 8130e18710c04a61a5d8bd019c6ffdad: Time spent bootstrapping tablet: real 0.139s	user 0.021s	sys 0.033s
I20260709 12:13:50.149243 31221 raft_consensus.cc:493] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:50.156102 31221 raft_consensus.cc:3060] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:50.160988 30981 raft_consensus.cc:359] T 745e2cea61c44c3a80bdc49add504a75 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:50.162195 30981 raft_consensus.cc:385] T 745e2cea61c44c3a80bdc49add504a75 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.162475 30981 raft_consensus.cc:740] T 745e2cea61c44c3a80bdc49add504a75 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.163096 30981 consensus_queue.cc:260] T 745e2cea61c44c3a80bdc49add504a75 P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:50.165832 30977 tablet_bootstrap.cc:492] T ca92b4f3c36b42fb9aa2f575c06344fe P 15ad0880a63541ef965cb6acca4513d7: No bootstrap required, opened a new log
I20260709 12:13:50.166458 30977 ts_tablet_manager.cc:1403] T ca92b4f3c36b42fb9aa2f575c06344fe P 15ad0880a63541ef965cb6acca4513d7: Time spent bootstrapping tablet: real 0.130s	user 0.014s	sys 0.003s
I20260709 12:13:50.178056 31042 consensus_queue.cc:1048] T 4031508121204ef4a2f5f2f0e9508cab P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Connected to new peer: Peer: permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:50.180500 31325 raft_consensus.cc:493] T ca92b4f3c36b42fb9aa2f575c06344fe P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.181041 31325 raft_consensus.cc:515] T ca92b4f3c36b42fb9aa2f575c06344fe P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:50.184835 30980 raft_consensus.cc:359] T 32c211a79de247c8b5cef16a2d0a4dcb P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:50.185559 30980 raft_consensus.cc:385] T 32c211a79de247c8b5cef16a2d0a4dcb P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.185861 30980 raft_consensus.cc:740] T 32c211a79de247c8b5cef16a2d0a4dcb P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.185689 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca92b4f3c36b42fb9aa2f575c06344fe" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:50.190488 31325 leader_election.cc:290] T ca92b4f3c36b42fb9aa2f575c06344fe P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:50.186512 30980 consensus_queue.cc:260] T 32c211a79de247c8b5cef16a2d0a4dcb P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:50.193084 30980 ts_tablet_manager.cc:1434] T 32c211a79de247c8b5cef16a2d0a4dcb P 8130e18710c04a61a5d8bd019c6ffdad: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 12:13:50.193552 30977 raft_consensus.cc:359] T ca92b4f3c36b42fb9aa2f575c06344fe P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:50.194064 30980 tablet_bootstrap.cc:492] T 56a566949cf345d08d43f13ccff4be37 P 8130e18710c04a61a5d8bd019c6ffdad: Bootstrap starting.
I20260709 12:13:50.194301 30977 raft_consensus.cc:385] T ca92b4f3c36b42fb9aa2f575c06344fe P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.194646 30977 raft_consensus.cc:740] T ca92b4f3c36b42fb9aa2f575c06344fe P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.196357 31334 raft_consensus.cc:2749] T 34e3009dd96f4545b2abe325ac95e960 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:50.193809 30707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca92b4f3c36b42fb9aa2f575c06344fe" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:50.198617 30981 ts_tablet_manager.cc:1434] T 745e2cea61c44c3a80bdc49add504a75 P 84b98f9236604dd0b22ae23c5378a676: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.000s
I20260709 12:13:50.199618 30977 consensus_queue.cc:260] T ca92b4f3c36b42fb9aa2f575c06344fe P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:50.211429 30977 ts_tablet_manager.cc:1434] T ca92b4f3c36b42fb9aa2f575c06344fe P 15ad0880a63541ef965cb6acca4513d7: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.003s
W20260709 12:13:50.204638 30749 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:43035, user_credentials={real_user=slave}} blocked reactor thread for 121244us
I20260709 12:13:50.209620 30929 raft_consensus.cc:2468] T ca92b4f3c36b42fb9aa2f575c06344fe P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 0.
I20260709 12:13:50.227151 30823 leader_election.cc:304] T ca92b4f3c36b42fb9aa2f575c06344fe P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 
W20260709 12:13:50.228549 30824 leader_election.cc:343] T ca92b4f3c36b42fb9aa2f575c06344fe P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:50.229367 30779 raft_consensus.cc:3060] T 745e2cea61c44c3a80bdc49add504a75 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.235199 30981 tablet_bootstrap.cc:492] T 0317908edb88497b82c4e59ef1bac414 P 84b98f9236604dd0b22ae23c5378a676: Bootstrap starting.
I20260709 12:13:50.234475 31173 raft_consensus.cc:2804] T ca92b4f3c36b42fb9aa2f575c06344fe P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:50.236810 31173 raft_consensus.cc:493] T ca92b4f3c36b42fb9aa2f575c06344fe P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:50.237154 31173 raft_consensus.cc:3060] T ca92b4f3c36b42fb9aa2f575c06344fe P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.256034 30977 tablet_bootstrap.cc:492] T 472c5cafdab84ead8ce9b93950070d13 P 15ad0880a63541ef965cb6acca4513d7: Bootstrap starting.
I20260709 12:13:50.251066 31222 raft_consensus.cc:493] T 3e0e49105b2d44f09c55f7cc603f9b91 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.259055 31222 raft_consensus.cc:515] T 3e0e49105b2d44f09c55f7cc603f9b91 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:50.241559 31325 consensus_queue.cc:1048] T 4031508121204ef4a2f5f2f0e9508cab P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Connected to new peer: Peer: permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260709 12:13:50.269940 30978 tablet_bootstrap.cc:654] T 554acf71459c4e59b886396df52b3004 P 6c5665c17e904fc692bce76fc57b2460: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.271332 30977 tablet_bootstrap.cc:654] T 472c5cafdab84ead8ce9b93950070d13 P 15ad0880a63541ef965cb6acca4513d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.273260 30981 tablet_bootstrap.cc:654] T 0317908edb88497b82c4e59ef1bac414 P 84b98f9236604dd0b22ae23c5378a676: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.280889 30707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e0e49105b2d44f09c55f7cc603f9b91" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
W20260709 12:13:50.286892 30898 leader_election.cc:343] T 3e0e49105b2d44f09c55f7cc603f9b91 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:50.289565 31222 leader_election.cc:290] T 3e0e49105b2d44f09c55f7cc603f9b91 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:50.292272 31221 raft_consensus.cc:515] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:50.292711 31173 raft_consensus.cc:515] T ca92b4f3c36b42fb9aa2f575c06344fe P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:50.300436 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca92b4f3c36b42fb9aa2f575c06344fe" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
I20260709 12:13:50.301105 30928 raft_consensus.cc:3060] T ca92b4f3c36b42fb9aa2f575c06344fe P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.301383 30980 tablet_bootstrap.cc:654] T 56a566949cf345d08d43f13ccff4be37 P 8130e18710c04a61a5d8bd019c6ffdad: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.311703 30705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca92b4f3c36b42fb9aa2f575c06344fe" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
I20260709 12:13:50.312532 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0317908edb88497b82c4e59ef1bac414" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:13:50.312775 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0317908edb88497b82c4e59ef1bac414" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:13:50.313634 30853 raft_consensus.cc:3060] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:50.314010 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e0e49105b2d44f09c55f7cc603f9b91" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:50.315063 31174 raft_consensus.cc:493] T 32c211a79de247c8b5cef16a2d0a4dcb P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.315475 31318 consensus_queue.cc:1048] T 34e3009dd96f4545b2abe325ac95e960 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:50.315539 31174 raft_consensus.cc:515] T 32c211a79de247c8b5cef16a2d0a4dcb P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
W20260709 12:13:50.320223 30673 leader_election.cc:343] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:50.323482 30824 leader_election.cc:343] T ca92b4f3c36b42fb9aa2f575c06344fe P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:50.328068 31174 leader_election.cc:290] T 32c211a79de247c8b5cef16a2d0a4dcb P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:50.329911 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c211a79de247c8b5cef16a2d0a4dcb" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
W20260709 12:13:50.331192 30823 leader_election.cc:343] T 32c211a79de247c8b5cef16a2d0a4dcb P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:50.302392 31173 leader_election.cc:290] T ca92b4f3c36b42fb9aa2f575c06344fe P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 election: Requested vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
W20260709 12:13:50.334810 30896 leader_election.cc:343] T 3e0e49105b2d44f09c55f7cc603f9b91 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:50.338088 30896 leader_election.cc:304] T 3e0e49105b2d44f09c55f7cc603f9b91 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7; no voters: 6c5665c17e904fc692bce76fc57b2460, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:50.340703 31183 raft_consensus.cc:2749] T 3e0e49105b2d44f09c55f7cc603f9b91 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:50.337474 31221 leader_election.cc:290] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 2 election: Requested vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:50.381711 30928 raft_consensus.cc:2468] T ca92b4f3c36b42fb9aa2f575c06344fe P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 1.
W20260709 12:13:50.434022 30654 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:50.437338 30853 raft_consensus.cc:2468] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 2.
I20260709 12:13:50.419057 31311 raft_consensus.cc:493] T 554acf71459c4e59b886396df52b3004 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.440342 31311 raft_consensus.cc:515] T 554acf71459c4e59b886396df52b3004 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:50.442490 31311 leader_election.cc:290] T 554acf71459c4e59b886396df52b3004 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:50.444316 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554acf71459c4e59b886396df52b3004" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:50.444707 30823 leader_election.cc:304] T ca92b4f3c36b42fb9aa2f575c06344fe P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:50.444976 30855 raft_consensus.cc:2468] T 554acf71459c4e59b886396df52b3004 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 0.
I20260709 12:13:50.428079 31334 raft_consensus.cc:493] T a4b7489c1b104bf2bb461bcdca7e6f42 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.445689 31334 raft_consensus.cc:515] T a4b7489c1b104bf2bb461bcdca7e6f42 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:50.446606 31042 raft_consensus.cc:2804] T ca92b4f3c36b42fb9aa2f575c06344fe P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:50.447127 31042 raft_consensus.cc:697] T ca92b4f3c36b42fb9aa2f575c06344fe P 8130e18710c04a61a5d8bd019c6ffdad [term 1 LEADER]: Becoming Leader. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Running, Role: LEADER
I20260709 12:13:50.447889 30978 tablet_bootstrap.cc:492] T 554acf71459c4e59b886396df52b3004 P 6c5665c17e904fc692bce76fc57b2460: No bootstrap required, opened a new log
I20260709 12:13:50.448378 30978 ts_tablet_manager.cc:1403] T 554acf71459c4e59b886396df52b3004 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.323s	user 0.034s	sys 0.007s
I20260709 12:13:50.450187 30748 leader_election.cc:304] T 554acf71459c4e59b886396df52b3004 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:13:50.450513 30705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554acf71459c4e59b886396df52b3004" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:50.451110 31344 raft_consensus.cc:2804] T 554acf71459c4e59b886396df52b3004 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:50.451480 31344 raft_consensus.cc:493] T 554acf71459c4e59b886396df52b3004 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:50.451896 31344 raft_consensus.cc:3060] T 554acf71459c4e59b886396df52b3004 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.460609 30673 leader_election.cc:304] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:50.447923 31042 consensus_queue.cc:237] T ca92b4f3c36b42fb9aa2f575c06344fe P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:50.482931 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b7489c1b104bf2bb461bcdca7e6f42" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:50.483366 30977 tablet_bootstrap.cc:492] T 472c5cafdab84ead8ce9b93950070d13 P 15ad0880a63541ef965cb6acca4513d7: No bootstrap required, opened a new log
I20260709 12:13:50.483841 30977 ts_tablet_manager.cc:1403] T 472c5cafdab84ead8ce9b93950070d13 P 15ad0880a63541ef965cb6acca4513d7: Time spent bootstrapping tablet: real 0.237s	user 0.008s	sys 0.011s
I20260709 12:13:50.447914 31334 leader_election.cc:290] T a4b7489c1b104bf2bb461bcdca7e6f42 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:50.471239 31192 raft_consensus.cc:2804] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:13:50.488286 30750 leader_election.cc:343] T 554acf71459c4e59b886396df52b3004 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:50.484443 30673 leader_election.cc:343] T a4b7489c1b104bf2bb461bcdca7e6f42 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:50.492794 30980 tablet_bootstrap.cc:492] T 56a566949cf345d08d43f13ccff4be37 P 8130e18710c04a61a5d8bd019c6ffdad: No bootstrap required, opened a new log
I20260709 12:13:50.493301 30980 ts_tablet_manager.cc:1403] T 56a566949cf345d08d43f13ccff4be37 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent bootstrapping tablet: real 0.299s	user 0.018s	sys 0.000s
I20260709 12:13:50.493012 30978 raft_consensus.cc:359] T 554acf71459c4e59b886396df52b3004 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:50.493748 30978 raft_consensus.cc:385] T 554acf71459c4e59b886396df52b3004 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.494051 30978 raft_consensus.cc:740] T 554acf71459c4e59b886396df52b3004 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
W20260709 12:13:50.496951 30896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:42179, user_credentials={real_user=slave}} blocked reactor thread for 130022us
I20260709 12:13:50.500017 30978 consensus_queue.cc:260] T 554acf71459c4e59b886396df52b3004 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:50.494954 31192 raft_consensus.cc:697] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [term 2 LEADER]: Becoming Leader. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Running, Role: LEADER
I20260709 12:13:50.529086 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b7489c1b104bf2bb461bcdca7e6f42" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:50.530069 30980 raft_consensus.cc:359] T 56a566949cf345d08d43f13ccff4be37 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:50.531311 30980 raft_consensus.cc:385] T 56a566949cf345d08d43f13ccff4be37 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.532189 30977 raft_consensus.cc:359] T 472c5cafdab84ead8ce9b93950070d13 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:50.533401 30977 raft_consensus.cc:385] T 472c5cafdab84ead8ce9b93950070d13 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.533753 30977 raft_consensus.cc:740] T 472c5cafdab84ead8ce9b93950070d13 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.531692 30980 raft_consensus.cc:740] T 56a566949cf345d08d43f13ccff4be37 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.539093 30981 tablet_bootstrap.cc:492] T 0317908edb88497b82c4e59ef1bac414 P 84b98f9236604dd0b22ae23c5378a676: No bootstrap required, opened a new log
I20260709 12:13:50.539047 30977 consensus_queue.cc:260] T 472c5cafdab84ead8ce9b93950070d13 P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:50.539772 30981 ts_tablet_manager.cc:1403] T 0317908edb88497b82c4e59ef1bac414 P 84b98f9236604dd0b22ae23c5378a676: Time spent bootstrapping tablet: real 0.305s	user 0.023s	sys 0.009s
I20260709 12:13:50.535562 30980 consensus_queue.cc:260] T 56a566949cf345d08d43f13ccff4be37 P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:50.548511 30978 ts_tablet_manager.cc:1434] T 554acf71459c4e59b886396df52b3004 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.100s	user 0.005s	sys 0.002s
I20260709 12:13:50.552304 30977 ts_tablet_manager.cc:1434] T 472c5cafdab84ead8ce9b93950070d13 P 15ad0880a63541ef965cb6acca4513d7: Time spent starting tablet: real 0.068s	user 0.014s	sys 0.004s
I20260709 12:13:50.553184 30981 raft_consensus.cc:359] T 0317908edb88497b82c4e59ef1bac414 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:50.553900 30981 raft_consensus.cc:385] T 0317908edb88497b82c4e59ef1bac414 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.554165 30981 raft_consensus.cc:740] T 0317908edb88497b82c4e59ef1bac414 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.554589 31192 consensus_queue.cc:237] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:50.554847 30981 consensus_queue.cc:260] T 0317908edb88497b82c4e59ef1bac414 P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:50.557204 30981 ts_tablet_manager.cc:1434] T 0317908edb88497b82c4e59ef1bac414 P 84b98f9236604dd0b22ae23c5378a676: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:13:50.550078 30705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c211a79de247c8b5cef16a2d0a4dcb" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:50.558149 30981 tablet_bootstrap.cc:492] T 3e0e49105b2d44f09c55f7cc603f9b91 P 84b98f9236604dd0b22ae23c5378a676: Bootstrap starting.
I20260709 12:13:50.558529 30980 ts_tablet_manager.cc:1434] T 56a566949cf345d08d43f13ccff4be37 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent starting tablet: real 0.065s	user 0.008s	sys 0.000s
I20260709 12:13:50.559628 30980 tablet_bootstrap.cc:492] T 472c5cafdab84ead8ce9b93950070d13 P 8130e18710c04a61a5d8bd019c6ffdad: Bootstrap starting.
W20260709 12:13:50.566334 30824 leader_election.cc:343] T 32c211a79de247c8b5cef16a2d0a4dcb P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:50.566825 30824 leader_election.cc:304] T 32c211a79de247c8b5cef16a2d0a4dcb P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad; no voters: 15ad0880a63541ef965cb6acca4513d7, 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:50.568313 31173 raft_consensus.cc:2749] T 32c211a79de247c8b5cef16a2d0a4dcb P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:50.569965 30977 tablet_bootstrap.cc:492] T 32c211a79de247c8b5cef16a2d0a4dcb P 15ad0880a63541ef965cb6acca4513d7: Bootstrap starting.
I20260709 12:13:50.570261 31321 consensus_queue.cc:1048] T 34e3009dd96f4545b2abe325ac95e960 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:50.573378 30981 tablet_bootstrap.cc:654] T 3e0e49105b2d44f09c55f7cc603f9b91 P 84b98f9236604dd0b22ae23c5378a676: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.578167 30980 tablet_bootstrap.cc:654] T 472c5cafdab84ead8ce9b93950070d13 P 8130e18710c04a61a5d8bd019c6ffdad: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.586721 31344 raft_consensus.cc:515] T 554acf71459c4e59b886396df52b3004 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:50.589092 30978 tablet_bootstrap.cc:492] T 3e0e49105b2d44f09c55f7cc603f9b91 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:50.608754 30604 catalog_manager.cc:5697] T ca92b4f3c36b42fb9aa2f575c06344fe P 8130e18710c04a61a5d8bd019c6ffdad reported cstate change: term changed from 0 to 1, leader changed from <none> to 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131). New cstate: current_term: 1 leader_uuid: "8130e18710c04a61a5d8bd019c6ffdad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:50.612187 30674 leader_election.cc:343] T a4b7489c1b104bf2bb461bcdca7e6f42 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:50.612670 30674 leader_election.cc:304] T a4b7489c1b104bf2bb461bcdca7e6f42 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460; no voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:50.612828 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554acf71459c4e59b886396df52b3004" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:13:50.613456 30856 raft_consensus.cc:3060] T 554acf71459c4e59b886396df52b3004 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.613759 31192 raft_consensus.cc:2749] T a4b7489c1b104bf2bb461bcdca7e6f42 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:50.620510 30978 tablet_bootstrap.cc:654] T 3e0e49105b2d44f09c55f7cc603f9b91 P 6c5665c17e904fc692bce76fc57b2460: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.623020 30705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554acf71459c4e59b886396df52b3004" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
I20260709 12:13:50.623867 30705 raft_consensus.cc:3060] T 554acf71459c4e59b886396df52b3004 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.634236 30977 tablet_bootstrap.cc:654] T 32c211a79de247c8b5cef16a2d0a4dcb P 15ad0880a63541ef965cb6acca4513d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.640527 31222 consensus_queue.cc:1048] T 1bbb677d9c544ed5a31297773b1508d6 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:50.641906 31222 consensus_queue.cc:1048] T 1bbb677d9c544ed5a31297773b1508d6 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:50.599663 31344 leader_election.cc:290] T 554acf71459c4e59b886396df52b3004 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 election: Requested vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:50.664590 31223 raft_consensus.cc:493] T 56a566949cf345d08d43f13ccff4be37 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.670639 31223 raft_consensus.cc:515] T 56a566949cf345d08d43f13ccff4be37 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:50.678436 31223 leader_election.cc:290] T 56a566949cf345d08d43f13ccff4be37 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:50.704731 30706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a566949cf345d08d43f13ccff4be37" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
W20260709 12:13:50.711426 30824 leader_election.cc:343] T 56a566949cf345d08d43f13ccff4be37 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:50.698232 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a566949cf345d08d43f13ccff4be37" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
W20260709 12:13:50.713968 30822 leader_election.cc:343] T 56a566949cf345d08d43f13ccff4be37 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:50.714488 30822 leader_election.cc:304] T 56a566949cf345d08d43f13ccff4be37 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad; no voters: 6c5665c17e904fc692bce76fc57b2460, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:50.716341 31173 raft_consensus.cc:2749] T 56a566949cf345d08d43f13ccff4be37 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:50.718377 30705 raft_consensus.cc:2468] T 554acf71459c4e59b886396df52b3004 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 1.
I20260709 12:13:50.724941 30980 tablet_bootstrap.cc:492] T 472c5cafdab84ead8ce9b93950070d13 P 8130e18710c04a61a5d8bd019c6ffdad: No bootstrap required, opened a new log
I20260709 12:13:50.725662 30980 ts_tablet_manager.cc:1403] T 472c5cafdab84ead8ce9b93950070d13 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent bootstrapping tablet: real 0.166s	user 0.016s	sys 0.024s
I20260709 12:13:50.726673 30856 raft_consensus.cc:2468] T 554acf71459c4e59b886396df52b3004 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 1.
I20260709 12:13:50.727803 30748 leader_election.cc:304] T 554acf71459c4e59b886396df52b3004 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:13:50.728703 31344 raft_consensus.cc:2804] T 554acf71459c4e59b886396df52b3004 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:50.728785 30980 raft_consensus.cc:359] T 472c5cafdab84ead8ce9b93950070d13 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:50.729478 30980 raft_consensus.cc:385] T 472c5cafdab84ead8ce9b93950070d13 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.729530 31344 raft_consensus.cc:697] T 554acf71459c4e59b886396df52b3004 P 84b98f9236604dd0b22ae23c5378a676 [term 1 LEADER]: Becoming Leader. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Running, Role: LEADER
I20260709 12:13:50.729844 30980 raft_consensus.cc:740] T 472c5cafdab84ead8ce9b93950070d13 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.730644 31344 consensus_queue.cc:237] T 554acf71459c4e59b886396df52b3004 P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:50.742192 30980 consensus_queue.cc:260] T 472c5cafdab84ead8ce9b93950070d13 P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:50.744545 30981 tablet_bootstrap.cc:492] T 3e0e49105b2d44f09c55f7cc603f9b91 P 84b98f9236604dd0b22ae23c5378a676: No bootstrap required, opened a new log
I20260709 12:13:50.745060 30981 ts_tablet_manager.cc:1403] T 3e0e49105b2d44f09c55f7cc603f9b91 P 84b98f9236604dd0b22ae23c5378a676: Time spent bootstrapping tablet: real 0.187s	user 0.012s	sys 0.007s
I20260709 12:13:50.746536 30980 ts_tablet_manager.cc:1434] T 472c5cafdab84ead8ce9b93950070d13 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 12:13:50.749127 30980 tablet_bootstrap.cc:492] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 8130e18710c04a61a5d8bd019c6ffdad: Bootstrap starting.
I20260709 12:13:50.751533 30981 raft_consensus.cc:359] T 3e0e49105b2d44f09c55f7cc603f9b91 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:50.752177 30981 raft_consensus.cc:385] T 3e0e49105b2d44f09c55f7cc603f9b91 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.752454 30981 raft_consensus.cc:740] T 3e0e49105b2d44f09c55f7cc603f9b91 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.753171 30981 consensus_queue.cc:260] T 3e0e49105b2d44f09c55f7cc603f9b91 P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:50.754889 30980 tablet_bootstrap.cc:654] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 8130e18710c04a61a5d8bd019c6ffdad: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.755540 30981 ts_tablet_manager.cc:1434] T 3e0e49105b2d44f09c55f7cc603f9b91 P 84b98f9236604dd0b22ae23c5378a676: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:13:50.756585 30981 tablet_bootstrap.cc:492] T 472c5cafdab84ead8ce9b93950070d13 P 84b98f9236604dd0b22ae23c5378a676: Bootstrap starting.
I20260709 12:13:50.766897 30981 tablet_bootstrap.cc:654] T 472c5cafdab84ead8ce9b93950070d13 P 84b98f9236604dd0b22ae23c5378a676: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.774479 30977 tablet_bootstrap.cc:492] T 32c211a79de247c8b5cef16a2d0a4dcb P 15ad0880a63541ef965cb6acca4513d7: No bootstrap required, opened a new log
I20260709 12:13:50.775046 30977 ts_tablet_manager.cc:1403] T 32c211a79de247c8b5cef16a2d0a4dcb P 15ad0880a63541ef965cb6acca4513d7: Time spent bootstrapping tablet: real 0.205s	user 0.015s	sys 0.013s
I20260709 12:13:50.793375 30977 raft_consensus.cc:359] T 32c211a79de247c8b5cef16a2d0a4dcb P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:50.794062 30977 raft_consensus.cc:385] T 32c211a79de247c8b5cef16a2d0a4dcb P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.794346 30977 raft_consensus.cc:740] T 32c211a79de247c8b5cef16a2d0a4dcb P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.795063 30977 consensus_queue.cc:260] T 32c211a79de247c8b5cef16a2d0a4dcb P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:50.796758 30977 ts_tablet_manager.cc:1434] T 32c211a79de247c8b5cef16a2d0a4dcb P 15ad0880a63541ef965cb6acca4513d7: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:13:50.797770 30977 tablet_bootstrap.cc:492] T a4b7489c1b104bf2bb461bcdca7e6f42 P 15ad0880a63541ef965cb6acca4513d7: Bootstrap starting.
I20260709 12:13:50.780920 30981 tablet_bootstrap.cc:492] T 472c5cafdab84ead8ce9b93950070d13 P 84b98f9236604dd0b22ae23c5378a676: No bootstrap required, opened a new log
I20260709 12:13:50.799556 30981 ts_tablet_manager.cc:1403] T 472c5cafdab84ead8ce9b93950070d13 P 84b98f9236604dd0b22ae23c5378a676: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.000s
I20260709 12:13:50.802354 30981 raft_consensus.cc:359] T 472c5cafdab84ead8ce9b93950070d13 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:50.774660 30978 tablet_bootstrap.cc:492] T 3e0e49105b2d44f09c55f7cc603f9b91 P 6c5665c17e904fc692bce76fc57b2460: No bootstrap required, opened a new log
I20260709 12:13:50.803539 30978 ts_tablet_manager.cc:1403] T 3e0e49105b2d44f09c55f7cc603f9b91 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.215s	user 0.012s	sys 0.003s
I20260709 12:13:50.811836 30981 raft_consensus.cc:385] T 472c5cafdab84ead8ce9b93950070d13 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.812626 30981 raft_consensus.cc:740] T 472c5cafdab84ead8ce9b93950070d13 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.816766 30981 consensus_queue.cc:260] T 472c5cafdab84ead8ce9b93950070d13 P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:50.819789 30981 ts_tablet_manager.cc:1434] T 472c5cafdab84ead8ce9b93950070d13 P 84b98f9236604dd0b22ae23c5378a676: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 12:13:50.820988 30977 tablet_bootstrap.cc:654] T a4b7489c1b104bf2bb461bcdca7e6f42 P 15ad0880a63541ef965cb6acca4513d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.825353 30981 tablet_bootstrap.cc:492] T a4b7489c1b104bf2bb461bcdca7e6f42 P 84b98f9236604dd0b22ae23c5378a676: Bootstrap starting.
I20260709 12:13:50.832458 30978 raft_consensus.cc:359] T 3e0e49105b2d44f09c55f7cc603f9b91 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:50.833199 30978 raft_consensus.cc:385] T 3e0e49105b2d44f09c55f7cc603f9b91 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.833474 30978 raft_consensus.cc:740] T 3e0e49105b2d44f09c55f7cc603f9b91 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.835383 30978 consensus_queue.cc:260] T 3e0e49105b2d44f09c55f7cc603f9b91 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:50.837949 30978 ts_tablet_manager.cc:1434] T 3e0e49105b2d44f09c55f7cc603f9b91 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.034s	user 0.004s	sys 0.003s
I20260709 12:13:50.838770 30978 tablet_bootstrap.cc:492] T 56a566949cf345d08d43f13ccff4be37 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:50.841926 30605 catalog_manager.cc:5697] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 reported cstate change: term changed from 0 to 2, leader changed from <none> to 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129). New cstate: current_term: 2 leader_uuid: "6c5665c17e904fc692bce76fc57b2460" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:50.843238 30980 tablet_bootstrap.cc:492] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 8130e18710c04a61a5d8bd019c6ffdad: No bootstrap required, opened a new log
I20260709 12:13:50.843354 30977 tablet_bootstrap.cc:492] T a4b7489c1b104bf2bb461bcdca7e6f42 P 15ad0880a63541ef965cb6acca4513d7: No bootstrap required, opened a new log
I20260709 12:13:50.843807 30980 ts_tablet_manager.cc:1403] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent bootstrapping tablet: real 0.096s	user 0.043s	sys 0.041s
I20260709 12:13:50.843942 30977 ts_tablet_manager.cc:1403] T a4b7489c1b104bf2bb461bcdca7e6f42 P 15ad0880a63541ef965cb6acca4513d7: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.000s
I20260709 12:13:50.846647 30980 raft_consensus.cc:359] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:50.847402 30980 raft_consensus.cc:385] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.847671 30980 raft_consensus.cc:740] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.848384 30980 consensus_queue.cc:260] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:50.849346 30981 tablet_bootstrap.cc:654] T a4b7489c1b104bf2bb461bcdca7e6f42 P 84b98f9236604dd0b22ae23c5378a676: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.850580 30980 ts_tablet_manager.cc:1434] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:13:50.849226 31344 raft_consensus.cc:493] T 472c5cafdab84ead8ce9b93950070d13 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.851655 31344 raft_consensus.cc:515] T 472c5cafdab84ead8ce9b93950070d13 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:50.854382 30978 tablet_bootstrap.cc:654] T 56a566949cf345d08d43f13ccff4be37 P 6c5665c17e904fc692bce76fc57b2460: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.855923 31344 leader_election.cc:290] T 472c5cafdab84ead8ce9b93950070d13 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:50.858188 30977 raft_consensus.cc:359] T a4b7489c1b104bf2bb461bcdca7e6f42 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:50.858863 30977 raft_consensus.cc:385] T a4b7489c1b104bf2bb461bcdca7e6f42 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.859153 30977 raft_consensus.cc:740] T a4b7489c1b104bf2bb461bcdca7e6f42 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.859386 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "472c5cafdab84ead8ce9b93950070d13" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:50.860028 30931 raft_consensus.cc:2468] T 472c5cafdab84ead8ce9b93950070d13 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 0.
I20260709 12:13:50.859890 30977 consensus_queue.cc:260] T a4b7489c1b104bf2bb461bcdca7e6f42 P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:50.851677 30980 tablet_bootstrap.cc:492] T fa9f00939aba452180334d67a6d33010 P 8130e18710c04a61a5d8bd019c6ffdad: Bootstrap starting.
I20260709 12:13:50.864605 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "472c5cafdab84ead8ce9b93950070d13" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:50.865823 30853 raft_consensus.cc:2468] T 472c5cafdab84ead8ce9b93950070d13 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 0.
I20260709 12:13:50.867945 30749 leader_election.cc:304] T 472c5cafdab84ead8ce9b93950070d13 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:13:50.869714 31137 raft_consensus.cc:2804] T 472c5cafdab84ead8ce9b93950070d13 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:50.870136 31137 raft_consensus.cc:493] T 472c5cafdab84ead8ce9b93950070d13 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:50.870483 31137 raft_consensus.cc:3060] T 472c5cafdab84ead8ce9b93950070d13 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.871888 30980 tablet_bootstrap.cc:654] T fa9f00939aba452180334d67a6d33010 P 8130e18710c04a61a5d8bd019c6ffdad: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.884100 30977 ts_tablet_manager.cc:1434] T a4b7489c1b104bf2bb461bcdca7e6f42 P 15ad0880a63541ef965cb6acca4513d7: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.000s
I20260709 12:13:50.885015 31137 raft_consensus.cc:515] T 472c5cafdab84ead8ce9b93950070d13 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:50.894557 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "472c5cafdab84ead8ce9b93950070d13" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:13:50.894706 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "472c5cafdab84ead8ce9b93950070d13" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
I20260709 12:13:50.895219 30853 raft_consensus.cc:3060] T 472c5cafdab84ead8ce9b93950070d13 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.895756 30929 raft_consensus.cc:3060] T 472c5cafdab84ead8ce9b93950070d13 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.915869 31137 leader_election.cc:290] T 472c5cafdab84ead8ce9b93950070d13 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 election: Requested vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:50.917553 30977 tablet_bootstrap.cc:492] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 15ad0880a63541ef965cb6acca4513d7: Bootstrap starting.
I20260709 12:13:50.924816 30607 catalog_manager.cc:5697] T 554acf71459c4e59b886396df52b3004 P 84b98f9236604dd0b22ae23c5378a676 reported cstate change: term changed from 0 to 1, leader changed from <none> to 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "84b98f9236604dd0b22ae23c5378a676" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:50.935218 30977 tablet_bootstrap.cc:654] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 15ad0880a63541ef965cb6acca4513d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.935578 30978 tablet_bootstrap.cc:492] T 56a566949cf345d08d43f13ccff4be37 P 6c5665c17e904fc692bce76fc57b2460: No bootstrap required, opened a new log
I20260709 12:13:50.940574 30978 ts_tablet_manager.cc:1403] T 56a566949cf345d08d43f13ccff4be37 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.102s	user 0.012s	sys 0.003s
I20260709 12:13:50.937572 30981 tablet_bootstrap.cc:492] T a4b7489c1b104bf2bb461bcdca7e6f42 P 84b98f9236604dd0b22ae23c5378a676: No bootstrap required, opened a new log
I20260709 12:13:50.941327 30981 ts_tablet_manager.cc:1403] T a4b7489c1b104bf2bb461bcdca7e6f42 P 84b98f9236604dd0b22ae23c5378a676: Time spent bootstrapping tablet: real 0.116s	user 0.009s	sys 0.007s
I20260709 12:13:50.945534 30981 raft_consensus.cc:359] T a4b7489c1b104bf2bb461bcdca7e6f42 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:50.946189 30981 raft_consensus.cc:385] T a4b7489c1b104bf2bb461bcdca7e6f42 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.946441 30981 raft_consensus.cc:740] T a4b7489c1b104bf2bb461bcdca7e6f42 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Initialized, Role: FOLLOWER
W20260709 12:13:50.957464 30824 consensus_peers.cc:597] T ca92b4f3c36b42fb9aa2f575c06344fe P 8130e18710c04a61a5d8bd019c6ffdad -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:50.964497 30981 consensus_queue.cc:260] T a4b7489c1b104bf2bb461bcdca7e6f42 P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:50.967238 30981 ts_tablet_manager.cc:1434] T a4b7489c1b104bf2bb461bcdca7e6f42 P 84b98f9236604dd0b22ae23c5378a676: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.002s
I20260709 12:13:50.968436 30981 tablet_bootstrap.cc:492] T 56a566949cf345d08d43f13ccff4be37 P 84b98f9236604dd0b22ae23c5378a676: Bootstrap starting.
I20260709 12:13:50.974877 30981 tablet_bootstrap.cc:654] T 56a566949cf345d08d43f13ccff4be37 P 84b98f9236604dd0b22ae23c5378a676: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.963762 30978 raft_consensus.cc:359] T 56a566949cf345d08d43f13ccff4be37 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:50.986095 30978 raft_consensus.cc:385] T 56a566949cf345d08d43f13ccff4be37 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.986527 30978 raft_consensus.cc:740] T 56a566949cf345d08d43f13ccff4be37 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.998028 30853 raft_consensus.cc:2468] T 472c5cafdab84ead8ce9b93950070d13 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 1.
I20260709 12:13:51.000851 30856 raft_consensus.cc:1275] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Refusing update from remote peer 6c5665c17e904fc692bce76fc57b2460: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:13:51.001258 30748 leader_election.cc:304] T 472c5cafdab84ead8ce9b93950070d13 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:13:51.002514 31137 raft_consensus.cc:2804] T 472c5cafdab84ead8ce9b93950070d13 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:51.003099 31334 consensus_queue.cc:1048] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:51.003115 31137 raft_consensus.cc:697] T 472c5cafdab84ead8ce9b93950070d13 P 84b98f9236604dd0b22ae23c5378a676 [term 1 LEADER]: Becoming Leader. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Running, Role: LEADER
I20260709 12:13:51.010236 30981 tablet_bootstrap.cc:492] T 56a566949cf345d08d43f13ccff4be37 P 84b98f9236604dd0b22ae23c5378a676: No bootstrap required, opened a new log
I20260709 12:13:51.010767 30981 ts_tablet_manager.cc:1403] T 56a566949cf345d08d43f13ccff4be37 P 84b98f9236604dd0b22ae23c5378a676: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.028s
I20260709 12:13:51.010494 31137 consensus_queue.cc:237] T 472c5cafdab84ead8ce9b93950070d13 P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:51.007750 30978 consensus_queue.cc:260] T 56a566949cf345d08d43f13ccff4be37 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:51.000969 30929 raft_consensus.cc:2468] T 472c5cafdab84ead8ce9b93950070d13 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 1.
I20260709 12:13:51.013922 30981 raft_consensus.cc:359] T 56a566949cf345d08d43f13ccff4be37 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:51.015264 30981 raft_consensus.cc:385] T 56a566949cf345d08d43f13ccff4be37 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:51.015544 30981 raft_consensus.cc:740] T 56a566949cf345d08d43f13ccff4be37 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Initialized, Role: FOLLOWER
I20260709 12:13:51.016232 30981 consensus_queue.cc:260] T 56a566949cf345d08d43f13ccff4be37 P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:51.018153 30980 tablet_bootstrap.cc:492] T fa9f00939aba452180334d67a6d33010 P 8130e18710c04a61a5d8bd019c6ffdad: No bootstrap required, opened a new log
I20260709 12:13:51.018581 30981 ts_tablet_manager.cc:1434] T 56a566949cf345d08d43f13ccff4be37 P 84b98f9236604dd0b22ae23c5378a676: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 12:13:51.018631 30980 ts_tablet_manager.cc:1403] T fa9f00939aba452180334d67a6d33010 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent bootstrapping tablet: real 0.167s	user 0.028s	sys 0.037s
I20260709 12:13:51.019413 31183 raft_consensus.cc:493] T a4b7489c1b104bf2bb461bcdca7e6f42 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.019836 30981 tablet_bootstrap.cc:492] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 84b98f9236604dd0b22ae23c5378a676: Bootstrap starting.
I20260709 12:13:51.020334 31183 raft_consensus.cc:515] T a4b7489c1b104bf2bb461bcdca7e6f42 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:51.021517 30980 raft_consensus.cc:359] T fa9f00939aba452180334d67a6d33010 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:51.022171 30980 raft_consensus.cc:385] T fa9f00939aba452180334d67a6d33010 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:51.022415 30980 raft_consensus.cc:740] T fa9f00939aba452180334d67a6d33010 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Initialized, Role: FOLLOWER
I20260709 12:13:51.027902 30981 tablet_bootstrap.cc:654] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 84b98f9236604dd0b22ae23c5378a676: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:51.022701 31183 leader_election.cc:290] T a4b7489c1b104bf2bb461bcdca7e6f42 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:51.031324 30706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b7489c1b104bf2bb461bcdca7e6f42" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:51.031487 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b7489c1b104bf2bb461bcdca7e6f42" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:51.031992 30706 raft_consensus.cc:2468] T a4b7489c1b104bf2bb461bcdca7e6f42 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 0.
I20260709 12:13:51.032245 30779 raft_consensus.cc:2468] T a4b7489c1b104bf2bb461bcdca7e6f42 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 0.
I20260709 12:13:51.023077 30980 consensus_queue.cc:260] T fa9f00939aba452180334d67a6d33010 P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:51.033254 30898 leader_election.cc:304] T a4b7489c1b104bf2bb461bcdca7e6f42 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 6c5665c17e904fc692bce76fc57b2460; no voters: 
I20260709 12:13:51.034258 31183 raft_consensus.cc:2804] T a4b7489c1b104bf2bb461bcdca7e6f42 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:51.034626 31183 raft_consensus.cc:493] T a4b7489c1b104bf2bb461bcdca7e6f42 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:51.035049 31183 raft_consensus.cc:3060] T a4b7489c1b104bf2bb461bcdca7e6f42 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:51.035614 30980 ts_tablet_manager.cc:1434] T fa9f00939aba452180334d67a6d33010 P 8130e18710c04a61a5d8bd019c6ffdad: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.002s
I20260709 12:13:51.036067 30977 tablet_bootstrap.cc:492] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 15ad0880a63541ef965cb6acca4513d7: No bootstrap required, opened a new log
I20260709 12:13:51.036573 30977 ts_tablet_manager.cc:1403] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 15ad0880a63541ef965cb6acca4513d7: Time spent bootstrapping tablet: real 0.119s	user 0.025s	sys 0.026s
I20260709 12:13:51.039371 31344 raft_consensus.cc:493] T 56a566949cf345d08d43f13ccff4be37 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.037521 30980 tablet_bootstrap.cc:492] T 2cf56cf233cc48a5a720300bc769fa6a P 8130e18710c04a61a5d8bd019c6ffdad: Bootstrap starting.
I20260709 12:13:51.039884 31344 raft_consensus.cc:515] T 56a566949cf345d08d43f13ccff4be37 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:51.041448 30981 tablet_bootstrap.cc:492] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 84b98f9236604dd0b22ae23c5378a676: No bootstrap required, opened a new log
I20260709 12:13:51.041958 30981 ts_tablet_manager.cc:1403] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 84b98f9236604dd0b22ae23c5378a676: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.006s
I20260709 12:13:51.044543 30978 ts_tablet_manager.cc:1434] T 56a566949cf345d08d43f13ccff4be37 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.103s	user 0.009s	sys 0.001s
I20260709 12:13:51.044668 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a566949cf345d08d43f13ccff4be37" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:51.047993 30706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a566949cf345d08d43f13ccff4be37" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:51.048687 30706 raft_consensus.cc:2468] T 56a566949cf345d08d43f13ccff4be37 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 0.
I20260709 12:13:51.048797 31343 raft_consensus.cc:493] T 0317908edb88497b82c4e59ef1bac414 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.049321 31343 raft_consensus.cc:515] T 0317908edb88497b82c4e59ef1bac414 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:51.046694 30856 raft_consensus.cc:2468] T 56a566949cf345d08d43f13ccff4be37 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 0.
I20260709 12:13:51.052562 30748 leader_election.cc:304] T 56a566949cf345d08d43f13ccff4be37 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:13:51.053341 31311 raft_consensus.cc:2804] T 56a566949cf345d08d43f13ccff4be37 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:51.053704 31311 raft_consensus.cc:493] T 56a566949cf345d08d43f13ccff4be37 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:51.054054 31311 raft_consensus.cc:3060] T 56a566949cf345d08d43f13ccff4be37 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:51.054394 31343 leader_election.cc:290] T 0317908edb88497b82c4e59ef1bac414 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:51.056439 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0317908edb88497b82c4e59ef1bac414" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:51.060607 31173 consensus_queue.cc:1048] T ca92b4f3c36b42fb9aa2f575c06344fe P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Connected to new peer: Peer: permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:51.061630 31311 raft_consensus.cc:515] T 56a566949cf345d08d43f13ccff4be37 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:51.062568 30980 tablet_bootstrap.cc:654] T 2cf56cf233cc48a5a720300bc769fa6a P 8130e18710c04a61a5d8bd019c6ffdad: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:51.064002 31311 leader_election.cc:290] T 56a566949cf345d08d43f13ccff4be37 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 election: Requested vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:51.067152 30706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0317908edb88497b82c4e59ef1bac414" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:51.042042 31344 leader_election.cc:290] T 56a566949cf345d08d43f13ccff4be37 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:51.070377 30750 leader_election.cc:304] T 0317908edb88497b82c4e59ef1bac414 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 84b98f9236604dd0b22ae23c5378a676; no voters: 6c5665c17e904fc692bce76fc57b2460, 8130e18710c04a61a5d8bd019c6ffdad
I20260709 12:13:51.071372 30705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a566949cf345d08d43f13ccff4be37" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
I20260709 12:13:51.072084 30705 raft_consensus.cc:3060] T 56a566949cf345d08d43f13ccff4be37 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:51.044790 30981 raft_consensus.cc:359] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:51.075177 30981 raft_consensus.cc:385] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:51.068462 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a566949cf345d08d43f13ccff4be37" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:13:51.075523 30981 raft_consensus.cc:740] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Initialized, Role: FOLLOWER
I20260709 12:13:51.075820 30856 raft_consensus.cc:3060] T 56a566949cf345d08d43f13ccff4be37 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:51.076372 30981 consensus_queue.cc:260] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:51.075529 31344 raft_consensus.cc:2749] T 0317908edb88497b82c4e59ef1bac414 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:51.080298 30977 raft_consensus.cc:359] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:51.081048 30977 raft_consensus.cc:385] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:51.081346 30977 raft_consensus.cc:740] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Initialized, Role: FOLLOWER
I20260709 12:13:51.082103 30977 consensus_queue.cc:260] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:51.078220 30981 ts_tablet_manager.cc:1434] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 84b98f9236604dd0b22ae23c5378a676: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.000s
I20260709 12:13:51.089236 30981 tablet_bootstrap.cc:492] T 2cf56cf233cc48a5a720300bc769fa6a P 84b98f9236604dd0b22ae23c5378a676: Bootstrap starting.
I20260709 12:13:51.093564 30705 raft_consensus.cc:2468] T 56a566949cf345d08d43f13ccff4be37 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 1.
I20260709 12:13:51.042549 31183 raft_consensus.cc:515] T a4b7489c1b104bf2bb461bcdca7e6f42 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:51.096323 30977 ts_tablet_manager.cc:1434] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 15ad0880a63541ef965cb6acca4513d7: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.000s
I20260709 12:13:51.102865 30977 tablet_bootstrap.cc:492] T 660d2eb6dd3f4e96aab252cfd980be89 P 15ad0880a63541ef965cb6acca4513d7: Bootstrap starting.
I20260709 12:13:51.103915 30750 leader_election.cc:304] T 56a566949cf345d08d43f13ccff4be37 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:13:51.104696 31311 raft_consensus.cc:2804] T 56a566949cf345d08d43f13ccff4be37 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:51.105216 31311 raft_consensus.cc:697] T 56a566949cf345d08d43f13ccff4be37 P 84b98f9236604dd0b22ae23c5378a676 [term 1 LEADER]: Becoming Leader. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Running, Role: LEADER
I20260709 12:13:51.106505 30981 tablet_bootstrap.cc:654] T 2cf56cf233cc48a5a720300bc769fa6a P 84b98f9236604dd0b22ae23c5378a676: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:51.106038 31311 consensus_queue.cc:237] T 56a566949cf345d08d43f13ccff4be37 P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:51.112391 30705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b7489c1b104bf2bb461bcdca7e6f42" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
I20260709 12:13:51.113041 30705 raft_consensus.cc:3060] T a4b7489c1b104bf2bb461bcdca7e6f42 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:51.119649 31344 raft_consensus.cc:493] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.121354 31344 raft_consensus.cc:515] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:51.219805 31173 raft_consensus.cc:493] T fa9f00939aba452180334d67a6d33010 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.220343 31173 raft_consensus.cc:515] T fa9f00939aba452180334d67a6d33010 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:51.235989 30977 tablet_bootstrap.cc:700] T 660d2eb6dd3f4e96aab252cfd980be89 P 15ad0880a63541ef965cb6acca4513d7: Time spent opening tablet: real 0.124s	user 0.002s	sys 0.000s
I20260709 12:13:51.243045 30977 tablet_bootstrap.cc:654] T 660d2eb6dd3f4e96aab252cfd980be89 P 15ad0880a63541ef965cb6acca4513d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:51.243758 31173 leader_election.cc:290] T fa9f00939aba452180334d67a6d33010 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:51.234922 31042 raft_consensus.cc:493] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.255167 31137 raft_consensus.cc:493] T 3e0e49105b2d44f09c55f7cc603f9b91 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.255839 31137 raft_consensus.cc:515] T 3e0e49105b2d44f09c55f7cc603f9b91 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:51.258462 31042 raft_consensus.cc:515] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:51.264357 30978 tablet_bootstrap.cc:492] T ca92b4f3c36b42fb9aa2f575c06344fe P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:51.263744 31362 raft_consensus.cc:493] T 32c211a79de247c8b5cef16a2d0a4dcb P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.264091 31183 leader_election.cc:290] T a4b7489c1b104bf2bb461bcdca7e6f42 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Requested vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:51.259410 30856 raft_consensus.cc:2468] T 56a566949cf345d08d43f13ccff4be37 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 1.
I20260709 12:13:51.325112 31137 leader_election.cc:290] T 3e0e49105b2d44f09c55f7cc603f9b91 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:51.310532 31344 leader_election.cc:290] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:51.320605 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b7489c1b104bf2bb461bcdca7e6f42" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:13:51.327445 31358 raft_consensus.cc:493] T 3e0e49105b2d44f09c55f7cc603f9b91 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.354085 30980 tablet_bootstrap.cc:492] T 2cf56cf233cc48a5a720300bc769fa6a P 8130e18710c04a61a5d8bd019c6ffdad: No bootstrap required, opened a new log
I20260709 12:13:51.354848 30980 ts_tablet_manager.cc:1403] T 2cf56cf233cc48a5a720300bc769fa6a P 8130e18710c04a61a5d8bd019c6ffdad: Time spent bootstrapping tablet: real 0.318s	user 0.013s	sys 0.006s
I20260709 12:13:51.306056 31362 raft_consensus.cc:515] T 32c211a79de247c8b5cef16a2d0a4dcb P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:51.378196 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c3fcab3f8f41238feeb802a6d2dbc9" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:51.379128 30783 raft_consensus.cc:2468] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 0.
W20260709 12:13:51.380707 31388 log.cc:927] Time spent T 56a566949cf345d08d43f13ccff4be37 P 84b98f9236604dd0b22ae23c5378a676: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:13:51.370471 30607 catalog_manager.cc:5697] T 472c5cafdab84ead8ce9b93950070d13 P 84b98f9236604dd0b22ae23c5378a676 reported cstate change: term changed from 0 to 1, leader changed from <none> to 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "84b98f9236604dd0b22ae23c5378a676" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:51.358029 30779 raft_consensus.cc:3060] T a4b7489c1b104bf2bb461bcdca7e6f42 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:51.368453 31358 raft_consensus.cc:515] T 3e0e49105b2d44f09c55f7cc603f9b91 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:51.417465 31183 raft_consensus.cc:493] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.418246 31042 leader_election.cc:290] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:51.416093 30705 raft_consensus.cc:2468] T a4b7489c1b104bf2bb461bcdca7e6f42 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 1.
I20260709 12:13:51.429674 31183 raft_consensus.cc:515] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:51.450086 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e0e49105b2d44f09c55f7cc603f9b91" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:51.450420 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c3fcab3f8f41238feeb802a6d2dbc9" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:51.451067 30931 raft_consensus.cc:2468] T 3e0e49105b2d44f09c55f7cc603f9b91 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 0.
I20260709 12:13:51.451097 30932 raft_consensus.cc:2468] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 0.
I20260709 12:13:51.453511 30981 tablet_bootstrap.cc:492] T 2cf56cf233cc48a5a720300bc769fa6a P 84b98f9236604dd0b22ae23c5378a676: No bootstrap required, opened a new log
I20260709 12:13:51.453965 30981 ts_tablet_manager.cc:1403] T 2cf56cf233cc48a5a720300bc769fa6a P 84b98f9236604dd0b22ae23c5378a676: Time spent bootstrapping tablet: real 0.365s	user 0.016s	sys 0.033s
I20260709 12:13:51.489312 30980 raft_consensus.cc:359] T 2cf56cf233cc48a5a720300bc769fa6a P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:51.490119 30980 raft_consensus.cc:385] T 2cf56cf233cc48a5a720300bc769fa6a P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:51.490437 30980 raft_consensus.cc:740] T 2cf56cf233cc48a5a720300bc769fa6a P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Initialized, Role: FOLLOWER
I20260709 12:13:51.489568 30709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e0e49105b2d44f09c55f7cc603f9b91" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:51.491641 30709 raft_consensus.cc:2468] T 3e0e49105b2d44f09c55f7cc603f9b91 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 0.
I20260709 12:13:51.495601 31362 leader_election.cc:290] T 32c211a79de247c8b5cef16a2d0a4dcb P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:51.496639 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c211a79de247c8b5cef16a2d0a4dcb" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:51.497270 30855 raft_consensus.cc:2468] T 32c211a79de247c8b5cef16a2d0a4dcb P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 0.
W20260709 12:13:51.498886 30654 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:51.499163 30981 raft_consensus.cc:359] T 2cf56cf233cc48a5a720300bc769fa6a P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:51.500042 30981 raft_consensus.cc:385] T 2cf56cf233cc48a5a720300bc769fa6a P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:51.500283 31183 leader_election.cc:290] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:51.500363 30981 raft_consensus.cc:740] T 2cf56cf233cc48a5a720300bc769fa6a P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Initialized, Role: FOLLOWER
I20260709 12:13:51.501559 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c3fcab3f8f41238feeb802a6d2dbc9" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:51.501405 30981 consensus_queue.cc:260] T 2cf56cf233cc48a5a720300bc769fa6a P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:51.502192 30856 raft_consensus.cc:2468] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 0.
I20260709 12:13:51.503494 31358 leader_election.cc:290] T 3e0e49105b2d44f09c55f7cc603f9b91 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:51.504151 30981 ts_tablet_manager.cc:1434] T 2cf56cf233cc48a5a720300bc769fa6a P 84b98f9236604dd0b22ae23c5378a676: Time spent starting tablet: real 0.050s	user 0.003s	sys 0.005s
I20260709 12:13:51.504685 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c3fcab3f8f41238feeb802a6d2dbc9" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:51.505347 30782 raft_consensus.cc:2468] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 0.
I20260709 12:13:51.508433 30981 tablet_bootstrap.cc:492] T 660d2eb6dd3f4e96aab252cfd980be89 P 84b98f9236604dd0b22ae23c5378a676: Bootstrap starting.
I20260709 12:13:51.509737 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9f00939aba452180334d67a6d33010" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:51.518307 30980 consensus_queue.cc:260] T 2cf56cf233cc48a5a720300bc769fa6a P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
W20260709 12:13:51.516299 31383 log.cc:927] Time spent T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 12:13:51.526180 30980 ts_tablet_manager.cc:1434] T 2cf56cf233cc48a5a720300bc769fa6a P 8130e18710c04a61a5d8bd019c6ffdad: Time spent starting tablet: real 0.171s	user 0.005s	sys 0.002s
I20260709 12:13:51.525777 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c3fcab3f8f41238feeb802a6d2dbc9" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:51.550625 30978 tablet_bootstrap.cc:654] T ca92b4f3c36b42fb9aa2f575c06344fe P 6c5665c17e904fc692bce76fc57b2460: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:51.559876 30674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:43035, user_credentials={real_user=slave}} blocked reactor thread for 71120.7us
I20260709 12:13:51.561340 30750 leader_election.cc:304] T 3e0e49105b2d44f09c55f7cc603f9b91 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:13:51.564814 31137 raft_consensus.cc:2804] T 3e0e49105b2d44f09c55f7cc603f9b91 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:51.565335 31137 raft_consensus.cc:493] T 3e0e49105b2d44f09c55f7cc603f9b91 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:51.565722 31137 raft_consensus.cc:3060] T 3e0e49105b2d44f09c55f7cc603f9b91 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:51.546815 30931 raft_consensus.cc:2468] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 0.
I20260709 12:13:51.601112 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e0e49105b2d44f09c55f7cc603f9b91" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:51.601933 30930 raft_consensus.cc:2468] T 3e0e49105b2d44f09c55f7cc603f9b91 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 0.
I20260709 12:13:51.603576 30674 leader_election.cc:304] T 3e0e49105b2d44f09c55f7cc603f9b91 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 6c5665c17e904fc692bce76fc57b2460; no voters: 
I20260709 12:13:51.604205 30822 leader_election.cc:304] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:13:51.612836 31311 raft_consensus.cc:493] T 2cf56cf233cc48a5a720300bc769fa6a P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.613409 31311 raft_consensus.cc:515] T 2cf56cf233cc48a5a720300bc769fa6a P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:51.615126 31406 raft_consensus.cc:2804] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:51.617542 31406 raft_consensus.cc:493] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:51.617941 31406 raft_consensus.cc:3060] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:51.619284 31405 raft_consensus.cc:2804] T 3e0e49105b2d44f09c55f7cc603f9b91 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:51.619738 31405 raft_consensus.cc:493] T 3e0e49105b2d44f09c55f7cc603f9b91 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:51.620078 31405 raft_consensus.cc:3060] T 3e0e49105b2d44f09c55f7cc603f9b91 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:51.623744 30977 tablet_bootstrap.cc:492] T 660d2eb6dd3f4e96aab252cfd980be89 P 15ad0880a63541ef965cb6acca4513d7: No bootstrap required, opened a new log
I20260709 12:13:51.624455 30977 ts_tablet_manager.cc:1403] T 660d2eb6dd3f4e96aab252cfd980be89 P 15ad0880a63541ef965cb6acca4513d7: Time spent bootstrapping tablet: real 0.522s	user 0.011s	sys 0.019s
I20260709 12:13:51.622730 31137 raft_consensus.cc:515] T 3e0e49105b2d44f09c55f7cc603f9b91 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:51.631330 31137 leader_election.cc:290] T 3e0e49105b2d44f09c55f7cc603f9b91 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 election: Requested vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:51.634936 30896 leader_election.cc:304] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:13:51.655557 31390 consensus_queue.cc:1048] T 554acf71459c4e59b886396df52b3004 P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:13:51.659628 31311 leader_election.cc:290] T 2cf56cf233cc48a5a720300bc769fa6a P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:51.660854 30749 leader_election.cc:304] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:13:51.661757 31399 raft_consensus.cc:2804] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:51.662220 31399 raft_consensus.cc:493] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:51.662572 31399 raft_consensus.cc:3060] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:51.664551 31401 raft_consensus.cc:2804] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:51.665108 31401 raft_consensus.cc:493] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:51.665536 31401 raft_consensus.cc:3060] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:51.666335 30709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9f00939aba452180334d67a6d33010" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:51.666888 30707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e0e49105b2d44f09c55f7cc603f9b91" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
I20260709 12:13:51.674015 30896 leader_election.cc:304] T 32c211a79de247c8b5cef16a2d0a4dcb P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 
I20260709 12:13:51.675347 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e0e49105b2d44f09c55f7cc603f9b91" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
I20260709 12:13:51.676056 30929 raft_consensus.cc:3060] T 3e0e49105b2d44f09c55f7cc603f9b91 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:51.676322 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c3fcab3f8f41238feeb802a6d2dbc9" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:51.681536 31402 raft_consensus.cc:2804] T 32c211a79de247c8b5cef16a2d0a4dcb P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:51.681968 31402 raft_consensus.cc:493] T 32c211a79de247c8b5cef16a2d0a4dcb P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:51.682334 31402 raft_consensus.cc:3060] T 32c211a79de247c8b5cef16a2d0a4dcb P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:51.682616 30779 raft_consensus.cc:2468] T a4b7489c1b104bf2bb461bcdca7e6f42 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 1.
I20260709 12:13:51.689990 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf56cf233cc48a5a720300bc769fa6a" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:51.691607 30857 raft_consensus.cc:2468] T 2cf56cf233cc48a5a720300bc769fa6a P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 0.
W20260709 12:13:51.700101 30824 leader_election.cc:343] T fa9f00939aba452180334d67a6d33010 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:51.704310 30977 raft_consensus.cc:359] T 660d2eb6dd3f4e96aab252cfd980be89 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:51.705035 30977 raft_consensus.cc:385] T 660d2eb6dd3f4e96aab252cfd980be89 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:51.705315 30977 raft_consensus.cc:740] T 660d2eb6dd3f4e96aab252cfd980be89 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Initialized, Role: FOLLOWER
I20260709 12:13:51.705961 30977 consensus_queue.cc:260] T 660d2eb6dd3f4e96aab252cfd980be89 P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:51.707708 30929 raft_consensus.cc:2468] T 3e0e49105b2d44f09c55f7cc603f9b91 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 1.
I20260709 12:13:51.707718 30898 leader_election.cc:304] T a4b7489c1b104bf2bb461bcdca7e6f42 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 6c5665c17e904fc692bce76fc57b2460; no voters: 
I20260709 12:13:51.708909 31318 raft_consensus.cc:2804] T a4b7489c1b104bf2bb461bcdca7e6f42 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:51.709563 31318 raft_consensus.cc:697] T a4b7489c1b104bf2bb461bcdca7e6f42 P 15ad0880a63541ef965cb6acca4513d7 [term 1 LEADER]: Becoming Leader. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Running, Role: LEADER
I20260709 12:13:51.710693 31318 consensus_queue.cc:237] T a4b7489c1b104bf2bb461bcdca7e6f42 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:51.713517 31402 raft_consensus.cc:515] T 32c211a79de247c8b5cef16a2d0a4dcb P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:51.721330 31405 raft_consensus.cc:515] T 3e0e49105b2d44f09c55f7cc603f9b91 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:51.722538 30707 raft_consensus.cc:2393] T 3e0e49105b2d44f09c55f7cc603f9b91 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 84b98f9236604dd0b22ae23c5378a676 in current term 1: Already voted for candidate 6c5665c17e904fc692bce76fc57b2460 in this term.
W20260709 12:13:51.728351 30823 leader_election.cc:343] T fa9f00939aba452180334d67a6d33010 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:51.728857 30823 leader_election.cc:304] T fa9f00939aba452180334d67a6d33010 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad; no voters: 15ad0880a63541ef965cb6acca4513d7, 6c5665c17e904fc692bce76fc57b2460
W20260709 12:13:51.729183 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:40909, user_credentials={real_user=slave}} blocked reactor thread for 73089.2us
I20260709 12:13:51.729650 31173 raft_consensus.cc:2749] T fa9f00939aba452180334d67a6d33010 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:51.731700 31405 leader_election.cc:290] T 3e0e49105b2d44f09c55f7cc603f9b91 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 election: Requested vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:51.734314 30981 tablet_bootstrap.cc:654] T 660d2eb6dd3f4e96aab252cfd980be89 P 84b98f9236604dd0b22ae23c5378a676: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:51.735489 30748 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:42179, user_credentials={real_user=slave}} blocked reactor thread for 45986.1us
I20260709 12:13:51.737003 31311 consensus_queue.cc:1048] T 554acf71459c4e59b886396df52b3004 P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:13:51.743940 30673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:42179, user_credentials={real_user=slave}} blocked reactor thread for 126932us
I20260709 12:13:51.726413 31399 raft_consensus.cc:515] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:51.755028 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e0e49105b2d44f09c55f7cc603f9b91" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:51.755919 30783 raft_consensus.cc:2393] T 3e0e49105b2d44f09c55f7cc603f9b91 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c5665c17e904fc692bce76fc57b2460 in current term 1: Already voted for candidate 84b98f9236604dd0b22ae23c5378a676 in this term.
I20260709 12:13:51.759076 30977 ts_tablet_manager.cc:1434] T 660d2eb6dd3f4e96aab252cfd980be89 P 15ad0880a63541ef965cb6acca4513d7: Time spent starting tablet: real 0.134s	user 0.004s	sys 0.004s
I20260709 12:13:51.763477 30709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c211a79de247c8b5cef16a2d0a4dcb" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:51.779397 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e0e49105b2d44f09c55f7cc603f9b91" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
I20260709 12:13:51.781800 30932 raft_consensus.cc:2393] T 3e0e49105b2d44f09c55f7cc603f9b91 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c5665c17e904fc692bce76fc57b2460 in current term 1: Already voted for candidate 84b98f9236604dd0b22ae23c5378a676 in this term.
I20260709 12:13:51.799208 30977 tablet_bootstrap.cc:492] T fa9f00939aba452180334d67a6d33010 P 15ad0880a63541ef965cb6acca4513d7: Bootstrap starting.
I20260709 12:13:51.793399 30779 raft_consensus.cc:3060] T 0317908edb88497b82c4e59ef1bac414 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Advancing to term 2
W20260709 12:13:51.780290 30823 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:43035, user_credentials={real_user=slave}} blocked reactor thread for 49286.9us
I20260709 12:13:51.813437 31402 leader_election.cc:290] T 32c211a79de247c8b5cef16a2d0a4dcb P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Requested vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:51.810250 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c211a79de247c8b5cef16a2d0a4dcb" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:13:51.814502 30858 raft_consensus.cc:3060] T 32c211a79de247c8b5cef16a2d0a4dcb P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:51.799530 30707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf56cf233cc48a5a720300bc769fa6a" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
W20260709 12:13:51.816257 30673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:42179, user_credentials={real_user=slave}} blocked reactor thread for 53503.2us
I20260709 12:13:51.817689 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c3fcab3f8f41238feeb802a6d2dbc9" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:13:51.818213 31344 consensus_queue.cc:1048] T 472c5cafdab84ead8ce9b93950070d13 P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:51.797140 31406 raft_consensus.cc:515] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:51.813475 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e0e49105b2d44f09c55f7cc603f9b91" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:13:51.823243 30781 raft_consensus.cc:2393] T 3e0e49105b2d44f09c55f7cc603f9b91 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c5665c17e904fc692bce76fc57b2460 in current term 1: Already voted for candidate 84b98f9236604dd0b22ae23c5378a676 in this term.
I20260709 12:13:51.822561 31406 leader_election.cc:290] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 election: Requested vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
W20260709 12:13:51.828976 30750 leader_election.cc:343] T 2cf56cf233cc48a5a720300bc769fa6a P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:51.824800 30858 raft_consensus.cc:2468] T 32c211a79de247c8b5cef16a2d0a4dcb P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 1.
I20260709 12:13:51.841706 30748 leader_election.cc:304] T 2cf56cf233cc48a5a720300bc769fa6a P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676; no voters: 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:51.843251 30896 leader_election.cc:304] T 32c211a79de247c8b5cef16a2d0a4dcb P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 
I20260709 12:13:51.843073 30978 tablet_bootstrap.cc:492] T ca92b4f3c36b42fb9aa2f575c06344fe P 6c5665c17e904fc692bce76fc57b2460: No bootstrap required, opened a new log
I20260709 12:13:51.826208 31399 leader_election.cc:290] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Requested vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:51.845206 30978 ts_tablet_manager.cc:1403] T ca92b4f3c36b42fb9aa2f575c06344fe P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.586s	user 0.018s	sys 0.007s
I20260709 12:13:51.845628 31404 raft_consensus.cc:2804] T 32c211a79de247c8b5cef16a2d0a4dcb P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:51.846203 31404 raft_consensus.cc:697] T 32c211a79de247c8b5cef16a2d0a4dcb P 15ad0880a63541ef965cb6acca4513d7 [term 1 LEADER]: Becoming Leader. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Running, Role: LEADER
I20260709 12:13:51.849980 30749 leader_election.cc:304] T 3e0e49105b2d44f09c55f7cc603f9b91 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676; no voters: 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:51.856518 30673 leader_election.cc:304] T 3e0e49105b2d44f09c55f7cc603f9b91 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460; no voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:51.857488 31411 raft_consensus.cc:2749] T 3e0e49105b2d44f09c55f7cc603f9b91 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:51.857919 31409 raft_consensus.cc:2804] T 3e0e49105b2d44f09c55f7cc603f9b91 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:51.858513 31409 raft_consensus.cc:697] T 3e0e49105b2d44f09c55f7cc603f9b91 P 84b98f9236604dd0b22ae23c5378a676 [term 1 LEADER]: Becoming Leader. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Running, Role: LEADER
I20260709 12:13:51.858754 31395 consensus_queue.cc:1048] T 472c5cafdab84ead8ce9b93950070d13 P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:51.859411 31409 consensus_queue.cc:237] T 3e0e49105b2d44f09c55f7cc603f9b91 P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:51.843447 31390 consensus_queue.cc:1048] T 56a566949cf345d08d43f13ccff4be37 P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 12:13:51.851451 30853 raft_consensus.cc:2393] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 84b98f9236604dd0b22ae23c5378a676 in current term 1: Already voted for candidate 8130e18710c04a61a5d8bd019c6ffdad in this term.
I20260709 12:13:51.872118 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c3fcab3f8f41238feeb802a6d2dbc9" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
W20260709 12:13:51.852061 30898 leader_election.cc:343] T 32c211a79de247c8b5cef16a2d0a4dcb P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:51.876520 30977 tablet_bootstrap.cc:654] T fa9f00939aba452180334d67a6d33010 P 15ad0880a63541ef965cb6acca4513d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:51.877504 31404 consensus_queue.cc:237] T 32c211a79de247c8b5cef16a2d0a4dcb P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:51.851457 31137 raft_consensus.cc:2804] T 2cf56cf233cc48a5a720300bc769fa6a P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:51.881892 30978 raft_consensus.cc:359] T ca92b4f3c36b42fb9aa2f575c06344fe P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:51.884032 31401 raft_consensus.cc:515] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:51.887106 30778 raft_consensus.cc:2393] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 15ad0880a63541ef965cb6acca4513d7 in current term 1: Already voted for candidate 84b98f9236604dd0b22ae23c5378a676 in this term.
I20260709 12:13:51.888103 30779 raft_consensus.cc:1275] T 0317908edb88497b82c4e59ef1bac414 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Refusing update from remote peer 6c5665c17e904fc692bce76fc57b2460: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:13:51.884852 30978 raft_consensus.cc:385] T ca92b4f3c36b42fb9aa2f575c06344fe P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:51.883931 30707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c211a79de247c8b5cef16a2d0a4dcb" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
I20260709 12:13:51.885829 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c3fcab3f8f41238feeb802a6d2dbc9" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
I20260709 12:13:51.890544 30931 raft_consensus.cc:2393] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8130e18710c04a61a5d8bd019c6ffdad in current term 1: Already voted for candidate 15ad0880a63541ef965cb6acca4513d7 in this term.
I20260709 12:13:51.892352 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c3fcab3f8f41238feeb802a6d2dbc9" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
I20260709 12:13:51.893108 30929 raft_consensus.cc:2393] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 84b98f9236604dd0b22ae23c5378a676 in current term 1: Already voted for candidate 15ad0880a63541ef965cb6acca4513d7 in this term.
I20260709 12:13:51.881930 31137 raft_consensus.cc:493] T 2cf56cf233cc48a5a720300bc769fa6a P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:51.895193 31137 raft_consensus.cc:3060] T 2cf56cf233cc48a5a720300bc769fa6a P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:51.899173 30898 leader_election.cc:343] T 32c211a79de247c8b5cef16a2d0a4dcb P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:51.895314 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c3fcab3f8f41238feeb802a6d2dbc9" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:13:51.902504 30784 raft_consensus.cc:2393] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8130e18710c04a61a5d8bd019c6ffdad in current term 1: Already voted for candidate 84b98f9236604dd0b22ae23c5378a676 in this term.
I20260709 12:13:51.905019 31137 raft_consensus.cc:515] T 2cf56cf233cc48a5a720300bc769fa6a P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:51.907557 31137 leader_election.cc:290] T 2cf56cf233cc48a5a720300bc769fa6a P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 election: Requested vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:51.899114 31401 leader_election.cc:290] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 election: Requested vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:51.919596 30822 leader_election.cc:304] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad; no voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:51.889613 30978 raft_consensus.cc:740] T ca92b4f3c36b42fb9aa2f575c06344fe P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:51.917608 30896 leader_election.cc:304] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7; no voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:51.937170 31398 raft_consensus.cc:2749] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:51.937476 30978 consensus_queue.cc:260] T ca92b4f3c36b42fb9aa2f575c06344fe P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:51.941197 30978 ts_tablet_manager.cc:1434] T ca92b4f3c36b42fb9aa2f575c06344fe P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.096s	user 0.005s	sys 0.002s
I20260709 12:13:51.955180 30707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf56cf233cc48a5a720300bc769fa6a" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
I20260709 12:13:51.956275 31408 raft_consensus.cc:2749] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:51.960304 31401 consensus_queue.cc:1048] T 56a566949cf345d08d43f13ccff4be37 P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:51.955204 31410 consensus_queue.cc:1048] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 12:13:51.961318 30978 tablet_bootstrap.cc:492] T 32c211a79de247c8b5cef16a2d0a4dcb P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
W20260709 12:13:51.967319 30750 leader_election.cc:343] T 2cf56cf233cc48a5a720300bc769fa6a P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:51.979017 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf56cf233cc48a5a720300bc769fa6a" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:13:51.979727 30858 raft_consensus.cc:3060] T 2cf56cf233cc48a5a720300bc769fa6a P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:51.982033 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c3fcab3f8f41238feeb802a6d2dbc9" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:13:51.982846 30853 raft_consensus.cc:2393] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 84b98f9236604dd0b22ae23c5378a676 in current term 1: Already voted for candidate 8130e18710c04a61a5d8bd019c6ffdad in this term.
I20260709 12:13:51.992551 30748 leader_election.cc:304] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 84b98f9236604dd0b22ae23c5378a676; no voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad
I20260709 12:13:51.994814 31343 raft_consensus.cc:2749] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:52.002123 30704 raft_consensus.cc:3060] T ca92b4f3c36b42fb9aa2f575c06344fe P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:52.010711 31222 raft_consensus.cc:493] T 660d2eb6dd3f4e96aab252cfd980be89 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.011451 31222 raft_consensus.cc:515] T 660d2eb6dd3f4e96aab252cfd980be89 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:52.012852 30977 tablet_bootstrap.cc:492] T fa9f00939aba452180334d67a6d33010 P 15ad0880a63541ef965cb6acca4513d7: No bootstrap required, opened a new log
I20260709 12:13:52.024507 30978 tablet_bootstrap.cc:654] T 32c211a79de247c8b5cef16a2d0a4dcb P 6c5665c17e904fc692bce76fc57b2460: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:52.029091 30977 ts_tablet_manager.cc:1403] T fa9f00939aba452180334d67a6d33010 P 15ad0880a63541ef965cb6acca4513d7: Time spent bootstrapping tablet: real 0.237s	user 0.017s	sys 0.012s
I20260709 12:13:52.033955 30981 tablet_bootstrap.cc:492] T 660d2eb6dd3f4e96aab252cfd980be89 P 84b98f9236604dd0b22ae23c5378a676: No bootstrap required, opened a new log
I20260709 12:13:52.034508 30981 ts_tablet_manager.cc:1403] T 660d2eb6dd3f4e96aab252cfd980be89 P 84b98f9236604dd0b22ae23c5378a676: Time spent bootstrapping tablet: real 0.529s	user 0.013s	sys 0.000s
I20260709 12:13:52.035548 30705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660d2eb6dd3f4e96aab252cfd980be89" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
I20260709 12:13:52.037051 31222 leader_election.cc:290] T 660d2eb6dd3f4e96aab252cfd980be89 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
W20260709 12:13:52.037165 30898 leader_election.cc:343] T 660d2eb6dd3f4e96aab252cfd980be89 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:52.058481 30981 raft_consensus.cc:359] T 660d2eb6dd3f4e96aab252cfd980be89 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:52.059841 30981 raft_consensus.cc:385] T 660d2eb6dd3f4e96aab252cfd980be89 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:52.060231 30981 raft_consensus.cc:740] T 660d2eb6dd3f4e96aab252cfd980be89 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Initialized, Role: FOLLOWER
I20260709 12:13:52.062790 30977 raft_consensus.cc:359] T fa9f00939aba452180334d67a6d33010 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:52.063508 30977 raft_consensus.cc:385] T fa9f00939aba452180334d67a6d33010 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:52.069965 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660d2eb6dd3f4e96aab252cfd980be89" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:52.049832 30858 raft_consensus.cc:2468] T 2cf56cf233cc48a5a720300bc769fa6a P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 1.
W20260709 12:13:52.115208 30748 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:42179, user_credentials={real_user=slave}} blocked reactor thread for 44543.8us
I20260709 12:13:52.063766 30977 raft_consensus.cc:740] T fa9f00939aba452180334d67a6d33010 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Initialized, Role: FOLLOWER
W20260709 12:13:52.127085 31425 log.cc:927] Time spent T 56a566949cf345d08d43f13ccff4be37 P 6c5665c17e904fc692bce76fc57b2460: Append to log took a long time: real 0.077s	user 0.002s	sys 0.003s
I20260709 12:13:52.122516 30977 consensus_queue.cc:260] T fa9f00939aba452180334d67a6d33010 P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
W20260709 12:13:52.128679 30898 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:40909, user_credentials={real_user=slave}} blocked reactor thread for 63374us
I20260709 12:13:52.130102 30977 ts_tablet_manager.cc:1434] T fa9f00939aba452180334d67a6d33010 P 15ad0880a63541ef965cb6acca4513d7: Time spent starting tablet: real 0.099s	user 0.003s	sys 0.004s
I20260709 12:13:52.142913 30603 catalog_manager.cc:5697] T 56a566949cf345d08d43f13ccff4be37 P 84b98f9236604dd0b22ae23c5378a676 reported cstate change: term changed from 0 to 1, leader changed from <none> to 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "84b98f9236604dd0b22ae23c5378a676" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:52.146284 30603 catalog_manager.cc:5697] T 3e0e49105b2d44f09c55f7cc603f9b91 P 84b98f9236604dd0b22ae23c5378a676 reported cstate change: term changed from 0 to 1, leader changed from <none> to 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "84b98f9236604dd0b22ae23c5378a676" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:52.155828 30981 consensus_queue.cc:260] T 660d2eb6dd3f4e96aab252cfd980be89 P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:52.165004 30781 raft_consensus.cc:2468] T 660d2eb6dd3f4e96aab252cfd980be89 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 0.
I20260709 12:13:52.184767 30896 leader_election.cc:304] T 660d2eb6dd3f4e96aab252cfd980be89 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676; no voters: 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:52.192397 31362 raft_consensus.cc:2804] T 660d2eb6dd3f4e96aab252cfd980be89 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:52.192965 31362 raft_consensus.cc:493] T 660d2eb6dd3f4e96aab252cfd980be89 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:52.193361 31362 raft_consensus.cc:3060] T 660d2eb6dd3f4e96aab252cfd980be89 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:52.150909 30748 leader_election.cc:304] T 2cf56cf233cc48a5a720300bc769fa6a P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676; no voters: 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:52.195989 31409 raft_consensus.cc:2804] T 2cf56cf233cc48a5a720300bc769fa6a P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:52.196554 31409 raft_consensus.cc:697] T 2cf56cf233cc48a5a720300bc769fa6a P 84b98f9236604dd0b22ae23c5378a676 [term 1 LEADER]: Becoming Leader. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Running, Role: LEADER
I20260709 12:13:52.197392 31409 consensus_queue.cc:237] T 2cf56cf233cc48a5a720300bc769fa6a P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
W20260709 12:13:52.194918 30748 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:42179, user_credentials={real_user=slave}} blocked reactor thread for 44111.1us
I20260709 12:13:52.223453 31183 consensus_queue.cc:1048] T a4b7489c1b104bf2bb461bcdca7e6f42 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:52.245899 30978 tablet_bootstrap.cc:492] T 32c211a79de247c8b5cef16a2d0a4dcb P 6c5665c17e904fc692bce76fc57b2460: No bootstrap required, opened a new log
I20260709 12:13:52.246506 30978 ts_tablet_manager.cc:1403] T 32c211a79de247c8b5cef16a2d0a4dcb P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.292s	user 0.023s	sys 0.022s
I20260709 12:13:52.259968 30981 ts_tablet_manager.cc:1434] T 660d2eb6dd3f4e96aab252cfd980be89 P 84b98f9236604dd0b22ae23c5378a676: Time spent starting tablet: real 0.225s	user 0.014s	sys 0.002s
I20260709 12:13:52.289985 31362 raft_consensus.cc:515] T 660d2eb6dd3f4e96aab252cfd980be89 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:52.295135 30978 raft_consensus.cc:359] T 32c211a79de247c8b5cef16a2d0a4dcb P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:52.296172 30978 raft_consensus.cc:385] T 32c211a79de247c8b5cef16a2d0a4dcb P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:52.296468 30978 raft_consensus.cc:740] T 32c211a79de247c8b5cef16a2d0a4dcb P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:52.298780 30978 consensus_queue.cc:260] T 32c211a79de247c8b5cef16a2d0a4dcb P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:52.309008 30978 ts_tablet_manager.cc:1434] T 32c211a79de247c8b5cef16a2d0a4dcb P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.000s
I20260709 12:13:52.313421 30978 tablet_bootstrap.cc:492] T 2cf56cf233cc48a5a720300bc769fa6a P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:52.328693 31402 consensus_queue.cc:1048] T 32c211a79de247c8b5cef16a2d0a4dcb P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:52.330780 30978 tablet_bootstrap.cc:654] T 2cf56cf233cc48a5a720300bc769fa6a P 6c5665c17e904fc692bce76fc57b2460: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:52.344311 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660d2eb6dd3f4e96aab252cfd980be89" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:13:52.351308 31362 leader_election.cc:290] T 660d2eb6dd3f4e96aab252cfd980be89 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Requested vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:52.363724 30781 raft_consensus.cc:3060] T 660d2eb6dd3f4e96aab252cfd980be89 P 84b98f9236604dd0b22ae23c5378a676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:52.368978 30704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660d2eb6dd3f4e96aab252cfd980be89" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
I20260709 12:13:52.369901 31402 consensus_queue.cc:1048] T a4b7489c1b104bf2bb461bcdca7e6f42 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:52.378551 30978 tablet_bootstrap.cc:492] T 2cf56cf233cc48a5a720300bc769fa6a P 6c5665c17e904fc692bce76fc57b2460: No bootstrap required, opened a new log
I20260709 12:13:52.379983 30978 ts_tablet_manager.cc:1403] T 2cf56cf233cc48a5a720300bc769fa6a P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.067s	user 0.027s	sys 0.001s
I20260709 12:13:52.382728 30978 raft_consensus.cc:359] T 2cf56cf233cc48a5a720300bc769fa6a P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:52.383401 30978 raft_consensus.cc:385] T 2cf56cf233cc48a5a720300bc769fa6a P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:52.383677 30978 raft_consensus.cc:740] T 2cf56cf233cc48a5a720300bc769fa6a P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
W20260709 12:13:52.378973 30898 leader_election.cc:343] T 660d2eb6dd3f4e96aab252cfd980be89 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:52.385797 30706 raft_consensus.cc:3060] T 32c211a79de247c8b5cef16a2d0a4dcb P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:52.387878 30781 raft_consensus.cc:2468] T 660d2eb6dd3f4e96aab252cfd980be89 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 1.
I20260709 12:13:52.390866 30978 consensus_queue.cc:260] T 2cf56cf233cc48a5a720300bc769fa6a P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:52.394902 30896 leader_election.cc:304] T 660d2eb6dd3f4e96aab252cfd980be89 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676; no voters: 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:52.397401 31402 raft_consensus.cc:2804] T 660d2eb6dd3f4e96aab252cfd980be89 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:52.398025 31402 raft_consensus.cc:697] T 660d2eb6dd3f4e96aab252cfd980be89 P 15ad0880a63541ef965cb6acca4513d7 [term 1 LEADER]: Becoming Leader. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Running, Role: LEADER
I20260709 12:13:52.399115 31402 consensus_queue.cc:237] T 660d2eb6dd3f4e96aab252cfd980be89 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:52.395731 31362 consensus_queue.cc:1048] T 32c211a79de247c8b5cef16a2d0a4dcb P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.032s
I20260709 12:13:52.432037 31344 consensus_queue.cc:1048] T 3e0e49105b2d44f09c55f7cc603f9b91 P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:52.420547 30978 ts_tablet_manager.cc:1434] T 2cf56cf233cc48a5a720300bc769fa6a P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.000s
I20260709 12:13:52.439721 30978 tablet_bootstrap.cc:492] T 660d2eb6dd3f4e96aab252cfd980be89 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:52.447439 31409 consensus_queue.cc:1048] T 3e0e49105b2d44f09c55f7cc603f9b91 P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:52.447616 30607 catalog_manager.cc:5697] T a4b7489c1b104bf2bb461bcdca7e6f42 P 15ad0880a63541ef965cb6acca4513d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132). New cstate: current_term: 1 leader_uuid: "15ad0880a63541ef965cb6acca4513d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:52.449316 30607 catalog_manager.cc:5697] T 32c211a79de247c8b5cef16a2d0a4dcb P 15ad0880a63541ef965cb6acca4513d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132). New cstate: current_term: 1 leader_uuid: "15ad0880a63541ef965cb6acca4513d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:52.454807 30978 tablet_bootstrap.cc:654] T 660d2eb6dd3f4e96aab252cfd980be89 P 6c5665c17e904fc692bce76fc57b2460: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:52.464200 30978 tablet_bootstrap.cc:492] T 660d2eb6dd3f4e96aab252cfd980be89 P 6c5665c17e904fc692bce76fc57b2460: No bootstrap required, opened a new log
I20260709 12:13:52.464762 30978 ts_tablet_manager.cc:1403] T 660d2eb6dd3f4e96aab252cfd980be89 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.000s
I20260709 12:13:52.467612 30978 raft_consensus.cc:359] T 660d2eb6dd3f4e96aab252cfd980be89 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:52.468372 30978 raft_consensus.cc:385] T 660d2eb6dd3f4e96aab252cfd980be89 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:52.468932 30978 raft_consensus.cc:740] T 660d2eb6dd3f4e96aab252cfd980be89 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:52.469678 30978 consensus_queue.cc:260] T 660d2eb6dd3f4e96aab252cfd980be89 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:52.472010 30978 ts_tablet_manager.cc:1434] T 660d2eb6dd3f4e96aab252cfd980be89 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:13:52.477445 30978 tablet_bootstrap.cc:492] T fa9f00939aba452180334d67a6d33010 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:52.484308 30978 tablet_bootstrap.cc:654] T fa9f00939aba452180334d67a6d33010 P 6c5665c17e904fc692bce76fc57b2460: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:52.486227 31318 raft_consensus.cc:493] T fa9f00939aba452180334d67a6d33010 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.486758 31318 raft_consensus.cc:515] T fa9f00939aba452180334d67a6d33010 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:52.489492 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9f00939aba452180334d67a6d33010" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:52.490157 30854 raft_consensus.cc:2468] T fa9f00939aba452180334d67a6d33010 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 0.
I20260709 12:13:52.491746 30896 leader_election.cc:304] T fa9f00939aba452180334d67a6d33010 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 
I20260709 12:13:52.492821 31402 raft_consensus.cc:2804] T fa9f00939aba452180334d67a6d33010 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:52.493373 31402 raft_consensus.cc:493] T fa9f00939aba452180334d67a6d33010 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:52.493841 31402 raft_consensus.cc:3060] T fa9f00939aba452180334d67a6d33010 P 15ad0880a63541ef965cb6acca4513d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:52.493955 31318 leader_election.cc:290] T fa9f00939aba452180334d67a6d33010 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:52.495010 30704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9f00939aba452180334d67a6d33010" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
W20260709 12:13:52.496465 30898 leader_election.cc:343] T fa9f00939aba452180334d67a6d33010 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:52.507965 30603 catalog_manager.cc:5697] T 2cf56cf233cc48a5a720300bc769fa6a P 84b98f9236604dd0b22ae23c5378a676 reported cstate change: term changed from 0 to 1, leader changed from <none> to 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "84b98f9236604dd0b22ae23c5378a676" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:52.537338 31402 raft_consensus.cc:515] T fa9f00939aba452180334d67a6d33010 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:52.552938 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9f00939aba452180334d67a6d33010" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:13:52.553593 30856 raft_consensus.cc:3060] T fa9f00939aba452180334d67a6d33010 P 8130e18710c04a61a5d8bd019c6ffdad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:52.553838 31402 leader_election.cc:290] T fa9f00939aba452180334d67a6d33010 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Requested vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:52.555325 30706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9f00939aba452180334d67a6d33010" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
I20260709 12:13:52.557257 30978 tablet_bootstrap.cc:492] T fa9f00939aba452180334d67a6d33010 P 6c5665c17e904fc692bce76fc57b2460: No bootstrap required, opened a new log
I20260709 12:13:52.557844 30978 ts_tablet_manager.cc:1403] T fa9f00939aba452180334d67a6d33010 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.081s	user 0.029s	sys 0.037s
W20260709 12:13:52.560562 30898 leader_election.cc:343] T fa9f00939aba452180334d67a6d33010 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:52.560886 30978 raft_consensus.cc:359] T fa9f00939aba452180334d67a6d33010 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:52.561735 30978 raft_consensus.cc:385] T fa9f00939aba452180334d67a6d33010 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:52.562450 30978 raft_consensus.cc:740] T fa9f00939aba452180334d67a6d33010 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:52.563155 30978 consensus_queue.cc:260] T fa9f00939aba452180334d67a6d33010 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:52.564949 30978 ts_tablet_manager.cc:1434] T fa9f00939aba452180334d67a6d33010 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:13:52.600620 31192 raft_consensus.cc:493] T 660d2eb6dd3f4e96aab252cfd980be89 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.600168 30604 catalog_manager.cc:5697] T 660d2eb6dd3f4e96aab252cfd980be89 P 15ad0880a63541ef965cb6acca4513d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132). New cstate: current_term: 1 leader_uuid: "15ad0880a63541ef965cb6acca4513d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:52.601182 31192 raft_consensus.cc:515] T 660d2eb6dd3f4e96aab252cfd980be89 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:52.602917 31400 raft_consensus.cc:493] T 2cf56cf233cc48a5a720300bc769fa6a P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.603295 31192 leader_election.cc:290] T 660d2eb6dd3f4e96aab252cfd980be89 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:52.603431 31400 raft_consensus.cc:515] T 2cf56cf233cc48a5a720300bc769fa6a P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:52.605468 31400 leader_election.cc:290] T 2cf56cf233cc48a5a720300bc769fa6a P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:52.607524 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660d2eb6dd3f4e96aab252cfd980be89" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:52.616618 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660d2eb6dd3f4e96aab252cfd980be89" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:52.617436 30782 raft_consensus.cc:2393] T 660d2eb6dd3f4e96aab252cfd980be89 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c5665c17e904fc692bce76fc57b2460 in current term 1: Already voted for candidate 15ad0880a63541ef965cb6acca4513d7 in this term.
I20260709 12:13:52.621610 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf56cf233cc48a5a720300bc769fa6a" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:52.622591 30673 leader_election.cc:304] T 660d2eb6dd3f4e96aab252cfd980be89 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460; no voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:52.624267 31339 raft_consensus.cc:3060] T 660d2eb6dd3f4e96aab252cfd980be89 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:52.627545 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf56cf233cc48a5a720300bc769fa6a" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:52.628387 30854 raft_consensus.cc:2393] T 2cf56cf233cc48a5a720300bc769fa6a P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c5665c17e904fc692bce76fc57b2460 in current term 1: Already voted for candidate 84b98f9236604dd0b22ae23c5378a676 in this term.
W20260709 12:13:52.628453 30654 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:52.633661 30856 raft_consensus.cc:2468] T fa9f00939aba452180334d67a6d33010 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 1.
I20260709 12:13:52.635800 30896 leader_election.cc:304] T fa9f00939aba452180334d67a6d33010 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:52.636880 31318 raft_consensus.cc:2804] T fa9f00939aba452180334d67a6d33010 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:52.637348 31318 raft_consensus.cc:697] T fa9f00939aba452180334d67a6d33010 P 15ad0880a63541ef965cb6acca4513d7 [term 1 LEADER]: Becoming Leader. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Running, Role: LEADER
I20260709 12:13:52.638154 31318 consensus_queue.cc:237] T fa9f00939aba452180334d67a6d33010 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:52.639910 30673 leader_election.cc:304] T 2cf56cf233cc48a5a720300bc769fa6a P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460; no voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:52.641171 31400 raft_consensus.cc:3060] T 2cf56cf233cc48a5a720300bc769fa6a P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:52.649494 31339 raft_consensus.cc:2749] T 660d2eb6dd3f4e96aab252cfd980be89 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:52.659838 30605 catalog_manager.cc:5697] T fa9f00939aba452180334d67a6d33010 P 15ad0880a63541ef965cb6acca4513d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132). New cstate: current_term: 1 leader_uuid: "15ad0880a63541ef965cb6acca4513d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:52.672997 31400 raft_consensus.cc:2749] T 2cf56cf233cc48a5a720300bc769fa6a P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:52.709738 31409 consensus_queue.cc:1048] T 2cf56cf233cc48a5a720300bc769fa6a P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:52.716773 31400 raft_consensus.cc:493] T fa9f00939aba452180334d67a6d33010 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.717310 31400 raft_consensus.cc:515] T fa9f00939aba452180334d67a6d33010 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:52.732678 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9f00939aba452180334d67a6d33010" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:52.732918 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9f00939aba452180334d67a6d33010" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:52.734042 30858 raft_consensus.cc:2393] T fa9f00939aba452180334d67a6d33010 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c5665c17e904fc692bce76fc57b2460 in current term 1: Already voted for candidate 15ad0880a63541ef965cb6acca4513d7 in this term.
I20260709 12:13:52.736742 31137 consensus_queue.cc:1048] T 2cf56cf233cc48a5a720300bc769fa6a P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:52.742710 30673 leader_election.cc:304] T fa9f00939aba452180334d67a6d33010 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460; no voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad
I20260709 12:13:52.743388 31192 raft_consensus.cc:3060] T fa9f00939aba452180334d67a6d33010 P 6c5665c17e904fc692bce76fc57b2460 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:52.743549 31400 leader_election.cc:290] T fa9f00939aba452180334d67a6d33010 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:52.752307 31192 raft_consensus.cc:2749] T fa9f00939aba452180334d67a6d33010 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:53.006675 31435 consensus_queue.cc:1048] T 660d2eb6dd3f4e96aab252cfd980be89 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:53.007634 31183 consensus_queue.cc:1048] T 660d2eb6dd3f4e96aab252cfd980be89 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:53.105624 31318 consensus_queue.cc:1048] T fa9f00939aba452180334d67a6d33010 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:53.152822 31318 consensus_queue.cc:1048] T fa9f00939aba452180334d67a6d33010 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:53.544968 31394 raft_consensus.cc:493] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.545534 31394 raft_consensus.cc:515] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:53.555405 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c3fcab3f8f41238feeb802a6d2dbc9" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:53.556089 30781 raft_consensus.cc:2468] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 1.
I20260709 12:13:53.558337 30822 leader_election.cc:304] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:13:53.559211 31463 raft_consensus.cc:2804] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:53.556864 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c3fcab3f8f41238feeb802a6d2dbc9" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:53.559640 31463 raft_consensus.cc:493] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:53.560089 31463 raft_consensus.cc:3060] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:53.560039 30932 raft_consensus.cc:2468] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 1.
I20260709 12:13:53.562330 31394 leader_election.cc:290] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:53.566665 31463 raft_consensus.cc:515] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:53.569291 31463 leader_election.cc:290] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 2 election: Requested vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:53.570966 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c3fcab3f8f41238feeb802a6d2dbc9" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
I20260709 12:13:53.571611 30931 raft_consensus.cc:3060] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:53.574918 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c3fcab3f8f41238feeb802a6d2dbc9" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:13:53.578284 30781 raft_consensus.cc:3060] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:53.583786 30931 raft_consensus.cc:2468] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 2.
I20260709 12:13:53.585626 30823 leader_election.cc:304] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 
I20260709 12:13:53.586269 31463 raft_consensus.cc:2804] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:53.586522 30781 raft_consensus.cc:2468] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 2.
I20260709 12:13:53.586727 31463 raft_consensus.cc:697] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 LEADER]: Becoming Leader. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Running, Role: LEADER
I20260709 12:13:53.587990 31463 consensus_queue.cc:237] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:53.600036 30604 catalog_manager.cc:5697] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 8130e18710c04a61a5d8bd019c6ffdad reported cstate change: term changed from 0 to 2, leader changed from <none> to 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131). New cstate: current_term: 2 leader_uuid: "8130e18710c04a61a5d8bd019c6ffdad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:54.023032 30782 raft_consensus.cc:1275] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Refusing update from remote peer 8130e18710c04a61a5d8bd019c6ffdad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:13:54.024871 31394 consensus_queue.cc:1048] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Connected to new peer: Peer: permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:54.070739 30929 raft_consensus.cc:1275] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Refusing update from remote peer 8130e18710c04a61a5d8bd019c6ffdad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:13:54.073586 31408 consensus_queue.cc:1048] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Connected to new peer: Peer: permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:54.558286 21266 tablet_server.cc:179] TabletServer@127.20.196.129:0 shutting down...
W20260709 12:13:54.596657 30898 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:54.631990 30674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:43035, user_credentials={real_user=slave}} blocked reactor thread for 55315.7us
W20260709 12:13:54.695022 30898 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:40909, user_credentials={real_user=slave}} blocked reactor thread for 98521.8us
W20260709 12:13:54.697698 30824 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:40909, user_credentials={real_user=slave}} blocked reactor thread for 44650.9us
W20260709 12:13:54.777376 30898 consensus_peers.cc:597] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:54.785383 30824 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:40909, user_credentials={real_user=slave}} blocked reactor thread for 68561us
W20260709 12:13:54.804818 30896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:42179, user_credentials={real_user=slave}} blocked reactor thread for 121415us
W20260709 12:13:54.816326 30898 consensus_peers.cc:597] T 99164e2d6f664ceab4d5921867d62c31 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:54.804144 30824 consensus_peers.cc:597] T 7b23395f850d4699b8d289f501c96f60 P 8130e18710c04a61a5d8bd019c6ffdad -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:54.841320 30898 consensus_peers.cc:597] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:54.845600 30824 consensus_peers.cc:597] T 8c580512b11742d4977ff026ff8fc795 P 8130e18710c04a61a5d8bd019c6ffdad -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:54.852986 30898 consensus_peers.cc:597] T 660d2eb6dd3f4e96aab252cfd980be89 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:54.853611 30824 consensus_peers.cc:597] T c449839430794851b61ffba23f946c4f P 8130e18710c04a61a5d8bd019c6ffdad -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:54.855304 30824 consensus_peers.cc:597] T ca92b4f3c36b42fb9aa2f575c06344fe P 8130e18710c04a61a5d8bd019c6ffdad -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:54.864864 30824 consensus_peers.cc:597] T 21c0ba9bb1d64ab398c606450f72e966 P 8130e18710c04a61a5d8bd019c6ffdad -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:54.867843 30824 consensus_peers.cc:597] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 8130e18710c04a61a5d8bd019c6ffdad -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:54.875650 30898 consensus_peers.cc:597] T fa9f00939aba452180334d67a6d33010 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:54.876977 30898 consensus_peers.cc:597] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:54.878221 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:40909, user_credentials={real_user=slave}} blocked reactor thread for 84088.2us
W20260709 12:13:54.895536 30898 consensus_peers.cc:597] T 32c211a79de247c8b5cef16a2d0a4dcb P 15ad0880a63541ef965cb6acca4513d7 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:54.899784 30898 consensus_peers.cc:597] T 34e3009dd96f4545b2abe325ac95e960 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:54.901048 30673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:40083, user_credentials={real_user=slave}} blocked reactor thread for 88677.4us
W20260709 12:13:54.908576 30898 consensus_peers.cc:597] T 671d30cec67d47a89e8ec6fab0c53c48 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:54.991401 30673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:42179, user_credentials={real_user=slave}} blocked reactor thread for 60430.5us
W20260709 12:13:55.004251 30674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:43035, user_credentials={real_user=slave}} blocked reactor thread for 79267.6us
W20260709 12:13:55.034505 30824 consensus_peers.cc:597] T a6a5bd717fa048aabdd0879bcea0fd60 P 8130e18710c04a61a5d8bd019c6ffdad -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:55.033044 30898 consensus_peers.cc:597] T a4b7489c1b104bf2bb461bcdca7e6f42 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:55.036432 30824 consensus_peers.cc:597] T 2971ad17262c4b5e8665700af97ec254 P 8130e18710c04a61a5d8bd019c6ffdad -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:55.039920 30750 consensus_peers.cc:597] T 554acf71459c4e59b886396df52b3004 P 84b98f9236604dd0b22ae23c5378a676 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:55.040954 30750 consensus_peers.cc:597] T 56a566949cf345d08d43f13ccff4be37 P 84b98f9236604dd0b22ae23c5378a676 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:55.050824 30750 consensus_peers.cc:597] T eb58d3a8bd8540ff9871ea41021a5025 P 84b98f9236604dd0b22ae23c5378a676 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:55.051857 30750 consensus_peers.cc:597] T 0203e5cc33ca470eb9c1f366291c344d P 84b98f9236604dd0b22ae23c5378a676 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:55.052485 30750 consensus_peers.cc:597] T e57ee667f8a246eb98ab6b169eb779b9 P 84b98f9236604dd0b22ae23c5378a676 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:55.053071 30750 consensus_peers.cc:597] T 3e0e49105b2d44f09c55f7cc603f9b91 P 84b98f9236604dd0b22ae23c5378a676 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:55.053633 30750 consensus_peers.cc:597] T c5afc0720ca546d8b13026e7c7a30c1e P 84b98f9236604dd0b22ae23c5378a676 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:55.061128 30750 consensus_peers.cc:597] T f0fbdcbe46b34107bbbf63f69c98e244 P 84b98f9236604dd0b22ae23c5378a676 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:55.067612 30750 consensus_peers.cc:597] T ec7d33fd7f3245f68966bd7749ee53c3 P 84b98f9236604dd0b22ae23c5378a676 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:55.071300 30750 consensus_peers.cc:597] T b9cc9d529de24234b98ed5e152fd4b24 P 84b98f9236604dd0b22ae23c5378a676 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:55.074443 30750 consensus_peers.cc:597] T 2cf56cf233cc48a5a720300bc769fa6a P 84b98f9236604dd0b22ae23c5378a676 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:55.079042 30750 consensus_peers.cc:597] T a3ffdffa995943d28fc038fce9198caf P 84b98f9236604dd0b22ae23c5378a676 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:55.079710 30750 consensus_peers.cc:597] T f351526ad9564be4be05825c266794c7 P 84b98f9236604dd0b22ae23c5378a676 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:55.094094 21266 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:55.095484 21266 tablet_replica.cc:333] T fa9f00939aba452180334d67a6d33010 P 6c5665c17e904fc692bce76fc57b2460: stopping tablet replica
I20260709 12:13:55.096832 21266 raft_consensus.cc:2243] T fa9f00939aba452180334d67a6d33010 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.098712 21266 raft_consensus.cc:2272] T fa9f00939aba452180334d67a6d33010 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.102025 21266 tablet_replica.cc:333] T 2cf56cf233cc48a5a720300bc769fa6a P 6c5665c17e904fc692bce76fc57b2460: stopping tablet replica
I20260709 12:13:55.103039 21266 raft_consensus.cc:2243] T 2cf56cf233cc48a5a720300bc769fa6a P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.103672 21266 raft_consensus.cc:2272] T 2cf56cf233cc48a5a720300bc769fa6a P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.112573 21266 tablet_replica.cc:333] T 32c211a79de247c8b5cef16a2d0a4dcb P 6c5665c17e904fc692bce76fc57b2460: stopping tablet replica
I20260709 12:13:55.113211 21266 raft_consensus.cc:2243] T 32c211a79de247c8b5cef16a2d0a4dcb P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.114071 21266 raft_consensus.cc:2272] T 32c211a79de247c8b5cef16a2d0a4dcb P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.131908 21266 tablet_replica.cc:333] T ca92b4f3c36b42fb9aa2f575c06344fe P 6c5665c17e904fc692bce76fc57b2460: stopping tablet replica
I20260709 12:13:55.132869 21266 raft_consensus.cc:2243] T ca92b4f3c36b42fb9aa2f575c06344fe P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.133565 21266 raft_consensus.cc:2272] T ca92b4f3c36b42fb9aa2f575c06344fe P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.137008 21266 tablet_replica.cc:333] T 3e0e49105b2d44f09c55f7cc603f9b91 P 6c5665c17e904fc692bce76fc57b2460: stopping tablet replica
I20260709 12:13:55.137984 21266 raft_consensus.cc:2243] T 3e0e49105b2d44f09c55f7cc603f9b91 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.138741 21266 raft_consensus.cc:2272] T 3e0e49105b2d44f09c55f7cc603f9b91 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.142388 21266 tablet_replica.cc:333] T f351526ad9564be4be05825c266794c7 P 6c5665c17e904fc692bce76fc57b2460: stopping tablet replica
I20260709 12:13:55.147164 21266 raft_consensus.cc:2243] T f351526ad9564be4be05825c266794c7 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.147830 21266 raft_consensus.cc:2272] T f351526ad9564be4be05825c266794c7 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.155131 21266 tablet_replica.cc:333] T a3ffdffa995943d28fc038fce9198caf P 6c5665c17e904fc692bce76fc57b2460: stopping tablet replica
I20260709 12:13:55.157395 21266 raft_consensus.cc:2243] T a3ffdffa995943d28fc038fce9198caf P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.158213 21266 raft_consensus.cc:2272] T a3ffdffa995943d28fc038fce9198caf P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.163930 21266 tablet_replica.cc:333] T 2971ad17262c4b5e8665700af97ec254 P 6c5665c17e904fc692bce76fc57b2460: stopping tablet replica
I20260709 12:13:55.164765 21266 raft_consensus.cc:2243] T 2971ad17262c4b5e8665700af97ec254 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.165800 21266 raft_consensus.cc:2272] T 2971ad17262c4b5e8665700af97ec254 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.169103 21266 tablet_replica.cc:333] T 7b23395f850d4699b8d289f501c96f60 P 6c5665c17e904fc692bce76fc57b2460: stopping tablet replica
I20260709 12:13:55.172870 21266 raft_consensus.cc:2243] T 7b23395f850d4699b8d289f501c96f60 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.173703 21266 raft_consensus.cc:2272] T 7b23395f850d4699b8d289f501c96f60 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.176906 21266 tablet_replica.cc:333] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460: stopping tablet replica
I20260709 12:13:55.177826 21266 raft_consensus.cc:2243] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:55.179106 21266 raft_consensus.cc:2272] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.191291 21266 tablet_replica.cc:333] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460: stopping tablet replica
I20260709 12:13:55.192085 21266 raft_consensus.cc:2243] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:55.193267 21266 raft_consensus.cc:2272] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.196403 21266 tablet_replica.cc:333] T bb358c4df82f4168bc1debdfc4e7aa9c P 6c5665c17e904fc692bce76fc57b2460: stopping tablet replica
I20260709 12:13:55.197043 21266 raft_consensus.cc:2243] T bb358c4df82f4168bc1debdfc4e7aa9c P 6c5665c17e904fc692bce76fc57b2460 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:55.198120 21266 raft_consensus.cc:2272] T bb358c4df82f4168bc1debdfc4e7aa9c P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.200439 21266 tablet_replica.cc:333] T 99164e2d6f664ceab4d5921867d62c31 P 6c5665c17e904fc692bce76fc57b2460: stopping tablet replica
I20260709 12:13:55.201105 21266 raft_consensus.cc:2243] T 99164e2d6f664ceab4d5921867d62c31 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.201704 21266 raft_consensus.cc:2272] T 99164e2d6f664ceab4d5921867d62c31 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.203853 21266 tablet_replica.cc:333] T 0203e5cc33ca470eb9c1f366291c344d P 6c5665c17e904fc692bce76fc57b2460: stopping tablet replica
I20260709 12:13:55.204442 21266 raft_consensus.cc:2243] T 0203e5cc33ca470eb9c1f366291c344d P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.204975 21266 raft_consensus.cc:2272] T 0203e5cc33ca470eb9c1f366291c344d P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.207481 21266 tablet_replica.cc:333] T b9cc9d529de24234b98ed5e152fd4b24 P 6c5665c17e904fc692bce76fc57b2460: stopping tablet replica
I20260709 12:13:55.208040 21266 raft_consensus.cc:2243] T b9cc9d529de24234b98ed5e152fd4b24 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.208612 21266 raft_consensus.cc:2272] T b9cc9d529de24234b98ed5e152fd4b24 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.211530 21266 tablet_replica.cc:333] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460: stopping tablet replica
I20260709 12:13:55.212253 21266 raft_consensus.cc:2243] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:55.214015 21266 raft_consensus.cc:2272] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.218647 21266 tablet_replica.cc:333] T 554acf71459c4e59b886396df52b3004 P 6c5665c17e904fc692bce76fc57b2460: stopping tablet replica
I20260709 12:13:55.219679 21266 raft_consensus.cc:2243] T 554acf71459c4e59b886396df52b3004 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.220331 21266 raft_consensus.cc:2272] T 554acf71459c4e59b886396df52b3004 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.223425 21266 tablet_replica.cc:333] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460: stopping tablet replica
I20260709 12:13:55.224279 21266 raft_consensus.cc:2243] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:55.225791 21266 raft_consensus.cc:2272] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.228789 21266 tablet_replica.cc:333] T 8c580512b11742d4977ff026ff8fc795 P 6c5665c17e904fc692bce76fc57b2460: stopping tablet replica
I20260709 12:13:55.229542 21266 raft_consensus.cc:2243] T 8c580512b11742d4977ff026ff8fc795 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.230379 21266 raft_consensus.cc:2272] T 8c580512b11742d4977ff026ff8fc795 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.233701 21266 tablet_replica.cc:333] T 660d2eb6dd3f4e96aab252cfd980be89 P 6c5665c17e904fc692bce76fc57b2460: stopping tablet replica
I20260709 12:13:55.234586 21266 raft_consensus.cc:2243] T 660d2eb6dd3f4e96aab252cfd980be89 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.235385 21266 raft_consensus.cc:2272] T 660d2eb6dd3f4e96aab252cfd980be89 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.238585 21266 tablet_replica.cc:333] T c449839430794851b61ffba23f946c4f P 6c5665c17e904fc692bce76fc57b2460: stopping tablet replica
I20260709 12:13:55.239367 21266 raft_consensus.cc:2243] T c449839430794851b61ffba23f946c4f P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.239974 21266 raft_consensus.cc:2272] T c449839430794851b61ffba23f946c4f P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.242702 21266 tablet_replica.cc:333] T 5d636204e40644318b4758f37c7b0474 P 6c5665c17e904fc692bce76fc57b2460: stopping tablet replica
I20260709 12:13:55.243515 21266 raft_consensus.cc:2243] T 5d636204e40644318b4758f37c7b0474 P 6c5665c17e904fc692bce76fc57b2460 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:55.244683 21266 raft_consensus.cc:2272] T 5d636204e40644318b4758f37c7b0474 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.247713 21266 tablet_replica.cc:333] T 21c0ba9bb1d64ab398c606450f72e966 P 6c5665c17e904fc692bce76fc57b2460: stopping tablet replica
I20260709 12:13:55.248487 21266 raft_consensus.cc:2243] T 21c0ba9bb1d64ab398c606450f72e966 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.249116 21266 raft_consensus.cc:2272] T 21c0ba9bb1d64ab398c606450f72e966 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.252257 21266 tablet_replica.cc:333] T e57ee667f8a246eb98ab6b169eb779b9 P 6c5665c17e904fc692bce76fc57b2460: stopping tablet replica
I20260709 12:13:55.253021 21266 raft_consensus.cc:2243] T e57ee667f8a246eb98ab6b169eb779b9 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.253582 21266 raft_consensus.cc:2272] T e57ee667f8a246eb98ab6b169eb779b9 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.256546 21266 tablet_replica.cc:333] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460: stopping tablet replica
I20260709 12:13:55.257331 21266 raft_consensus.cc:2243] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:55.262801 21266 raft_consensus.cc:2272] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.265991 21266 tablet_replica.cc:333] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 6c5665c17e904fc692bce76fc57b2460: stopping tablet replica
I20260709 12:13:55.266800 21266 raft_consensus.cc:2243] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 6c5665c17e904fc692bce76fc57b2460 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:55.268137 21266 raft_consensus.cc:2272] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.271282 21266 tablet_replica.cc:333] T a4b7489c1b104bf2bb461bcdca7e6f42 P 6c5665c17e904fc692bce76fc57b2460: stopping tablet replica
I20260709 12:13:55.272058 21266 raft_consensus.cc:2243] T a4b7489c1b104bf2bb461bcdca7e6f42 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.272687 21266 raft_consensus.cc:2272] T a4b7489c1b104bf2bb461bcdca7e6f42 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.275487 21266 tablet_replica.cc:333] T 745e2cea61c44c3a80bdc49add504a75 P 6c5665c17e904fc692bce76fc57b2460: stopping tablet replica
I20260709 12:13:55.276237 21266 raft_consensus.cc:2243] T 745e2cea61c44c3a80bdc49add504a75 P 6c5665c17e904fc692bce76fc57b2460 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:55.277364 21266 raft_consensus.cc:2272] T 745e2cea61c44c3a80bdc49add504a75 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.280530 21266 tablet_replica.cc:333] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460: stopping tablet replica
I20260709 12:13:55.281258 21266 raft_consensus.cc:2243] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:55.282366 21266 raft_consensus.cc:2272] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.288003 21266 tablet_replica.cc:333] T f0fbdcbe46b34107bbbf63f69c98e244 P 6c5665c17e904fc692bce76fc57b2460: stopping tablet replica
I20260709 12:13:55.288800 21266 raft_consensus.cc:2243] T f0fbdcbe46b34107bbbf63f69c98e244 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.289454 21266 raft_consensus.cc:2272] T f0fbdcbe46b34107bbbf63f69c98e244 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.292670 21266 tablet_replica.cc:333] T a318673515aa415db1aa91d126a5b724 P 6c5665c17e904fc692bce76fc57b2460: stopping tablet replica
I20260709 12:13:55.293390 21266 raft_consensus.cc:2243] T a318673515aa415db1aa91d126a5b724 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.294004 21266 raft_consensus.cc:2272] T a318673515aa415db1aa91d126a5b724 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.298384 21266 tablet_replica.cc:333] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460: stopping tablet replica
I20260709 12:13:55.299135 21266 raft_consensus.cc:2243] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.299793 21266 raft_consensus.cc:2272] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.303177 21266 tablet_replica.cc:333] T 56a566949cf345d08d43f13ccff4be37 P 6c5665c17e904fc692bce76fc57b2460: stopping tablet replica
I20260709 12:13:55.303938 21266 raft_consensus.cc:2243] T 56a566949cf345d08d43f13ccff4be37 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.304471 21266 raft_consensus.cc:2272] T 56a566949cf345d08d43f13ccff4be37 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.307590 21266 tablet_replica.cc:333] T 671d30cec67d47a89e8ec6fab0c53c48 P 6c5665c17e904fc692bce76fc57b2460: stopping tablet replica
I20260709 12:13:55.308383 21266 raft_consensus.cc:2243] T 671d30cec67d47a89e8ec6fab0c53c48 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.308979 21266 raft_consensus.cc:2272] T 671d30cec67d47a89e8ec6fab0c53c48 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.311914 21266 tablet_replica.cc:333] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 6c5665c17e904fc692bce76fc57b2460: stopping tablet replica
I20260709 12:13:55.312681 21266 raft_consensus.cc:2243] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.313333 21266 raft_consensus.cc:2272] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.316224 21266 tablet_replica.cc:333] T 34e3009dd96f4545b2abe325ac95e960 P 6c5665c17e904fc692bce76fc57b2460: stopping tablet replica
I20260709 12:13:55.316955 21266 raft_consensus.cc:2243] T 34e3009dd96f4545b2abe325ac95e960 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.317639 21266 raft_consensus.cc:2272] T 34e3009dd96f4545b2abe325ac95e960 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.321914 21266 tablet_replica.cc:333] T 2ff9e0d905854cceb79f96f500a07339 P 6c5665c17e904fc692bce76fc57b2460: stopping tablet replica
I20260709 12:13:55.322680 21266 raft_consensus.cc:2243] T 2ff9e0d905854cceb79f96f500a07339 P 6c5665c17e904fc692bce76fc57b2460 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:55.323945 21266 raft_consensus.cc:2272] T 2ff9e0d905854cceb79f96f500a07339 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.326893 21266 tablet_replica.cc:333] T c5afc0720ca546d8b13026e7c7a30c1e P 6c5665c17e904fc692bce76fc57b2460: stopping tablet replica
I20260709 12:13:55.327659 21266 raft_consensus.cc:2243] T c5afc0720ca546d8b13026e7c7a30c1e P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.328234 21266 raft_consensus.cc:2272] T c5afc0720ca546d8b13026e7c7a30c1e P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.331164 21266 tablet_replica.cc:333] T ec7d33fd7f3245f68966bd7749ee53c3 P 6c5665c17e904fc692bce76fc57b2460: stopping tablet replica
I20260709 12:13:55.331888 21266 raft_consensus.cc:2243] T ec7d33fd7f3245f68966bd7749ee53c3 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.332505 21266 raft_consensus.cc:2272] T ec7d33fd7f3245f68966bd7749ee53c3 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.336732 21266 tablet_replica.cc:333] T 615eb2fb16414287bc0956a27523b7f4 P 6c5665c17e904fc692bce76fc57b2460: stopping tablet replica
I20260709 12:13:55.337442 21266 raft_consensus.cc:2243] T 615eb2fb16414287bc0956a27523b7f4 P 6c5665c17e904fc692bce76fc57b2460 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:55.338649 21266 raft_consensus.cc:2272] T 615eb2fb16414287bc0956a27523b7f4 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.341594 21266 tablet_replica.cc:333] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 6c5665c17e904fc692bce76fc57b2460: stopping tablet replica
I20260709 12:13:55.342303 21266 raft_consensus.cc:2243] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.342839 21266 raft_consensus.cc:2272] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.345806 21266 tablet_replica.cc:333] T 76d4dde0196948ef92f68df770af02b0 P 6c5665c17e904fc692bce76fc57b2460: stopping tablet replica
I20260709 12:13:55.346472 21266 raft_consensus.cc:2243] T 76d4dde0196948ef92f68df770af02b0 P 6c5665c17e904fc692bce76fc57b2460 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:55.348631 21266 raft_consensus.cc:2272] T 76d4dde0196948ef92f68df770af02b0 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.351747 21266 tablet_replica.cc:333] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460: stopping tablet replica
I20260709 12:13:55.352427 21266 raft_consensus.cc:2243] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:55.353631 21266 raft_consensus.cc:2272] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.357465 21266 tablet_replica.cc:333] T a6a5bd717fa048aabdd0879bcea0fd60 P 6c5665c17e904fc692bce76fc57b2460: stopping tablet replica
I20260709 12:13:55.358094 21266 raft_consensus.cc:2243] T a6a5bd717fa048aabdd0879bcea0fd60 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.358737 21266 raft_consensus.cc:2272] T a6a5bd717fa048aabdd0879bcea0fd60 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.361756 21266 tablet_replica.cc:333] T eb58d3a8bd8540ff9871ea41021a5025 P 6c5665c17e904fc692bce76fc57b2460: stopping tablet replica
I20260709 12:13:55.362450 21266 raft_consensus.cc:2243] T eb58d3a8bd8540ff9871ea41021a5025 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.363049 21266 raft_consensus.cc:2272] T eb58d3a8bd8540ff9871ea41021a5025 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.480954 21266 tablet_server.cc:196] TabletServer@127.20.196.129:0 shutdown complete.
I20260709 12:13:55.619451 21266 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:55.628499 31505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:55.629142 31506 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:55.638736 31508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:55.640304 21266 server_base.cc:1061] running on GCE node
I20260709 12:13:55.643042 21266 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:55.643316 21266 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:55.643532 21266 hybrid_clock.cc:648] HybridClock initialized: now 1783599235643507 us; error 0 us; skew 500 ppm
I20260709 12:13:55.644089 21266 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:55.647564 21266 webserver.cc:533] Webserver started at http://127.20.196.129:42585/ using document root <none> and password file <none>
I20260709 12:13:55.648258 21266 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:55.648495 21266 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:13:55.659482 21266 fs_manager.cc:714] Time spent opening directory manager: real 0.010s	user 0.002s	sys 0.008s
I20260709 12:13:55.668002 31513 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:55.669072 21266 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.001s
I20260709 12:13:55.669425 21266 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894355727-21266-0/minicluster-data/ts-0-root
uuid: "6c5665c17e904fc692bce76fc57b2460"
format_stamp: "Formatted at 2026-07-09 12:13:41 on dist-test-slave-h6sg"
I20260709 12:13:55.670009 21266 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894355727-21266-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894355727-21266-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894355727-21266-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:55.696786 21266 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:55.698460 21266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:55.700201 21266 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:55.705452 31520 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 12:13:55.995227 21266 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:13:55.995617 21266 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.291s	user 0.009s	sys 0.000s
I20260709 12:13:55.995939 21266 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:13:56.001425 31520 tablet_bootstrap.cc:492] T a3ffdffa995943d28fc038fce9198caf P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:56.018527 31520 tablet_bootstrap.cc:492] T a3ffdffa995943d28fc038fce9198caf P 6c5665c17e904fc692bce76fc57b2460: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:56.019629 31520 tablet_bootstrap.cc:492] T a3ffdffa995943d28fc038fce9198caf P 6c5665c17e904fc692bce76fc57b2460: Bootstrap complete.
I20260709 12:13:56.021039 31520 ts_tablet_manager.cc:1403] T a3ffdffa995943d28fc038fce9198caf P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.012s
I20260709 12:13:56.024212 31520 raft_consensus.cc:359] T a3ffdffa995943d28fc038fce9198caf P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:56.025184 31520 raft_consensus.cc:740] T a3ffdffa995943d28fc038fce9198caf P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:56.025976 31520 consensus_queue.cc:260] T a3ffdffa995943d28fc038fce9198caf P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:56.028839 31520 ts_tablet_manager.cc:1434] T a3ffdffa995943d28fc038fce9198caf P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 12:13:56.030146 31520 tablet_bootstrap.cc:492] T a6a5bd717fa048aabdd0879bcea0fd60 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:56.046478 31520 tablet_bootstrap.cc:492] T a6a5bd717fa048aabdd0879bcea0fd60 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:56.047472 31520 tablet_bootstrap.cc:492] T a6a5bd717fa048aabdd0879bcea0fd60 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap complete.
I20260709 12:13:56.048189 31520 ts_tablet_manager.cc:1403] T a6a5bd717fa048aabdd0879bcea0fd60 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.005s
I20260709 12:13:56.051587 31520 raft_consensus.cc:359] T a6a5bd717fa048aabdd0879bcea0fd60 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:56.052300 31520 raft_consensus.cc:740] T a6a5bd717fa048aabdd0879bcea0fd60 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:56.053040 31520 consensus_queue.cc:260] T a6a5bd717fa048aabdd0879bcea0fd60 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:56.055264 31520 ts_tablet_manager.cc:1434] T a6a5bd717fa048aabdd0879bcea0fd60 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:13:56.056088 31520 tablet_bootstrap.cc:492] T 3e0e49105b2d44f09c55f7cc603f9b91 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:56.072132 31520 tablet_bootstrap.cc:492] T 3e0e49105b2d44f09c55f7cc603f9b91 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:56.073172 31520 tablet_bootstrap.cc:492] T 3e0e49105b2d44f09c55f7cc603f9b91 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap complete.
I20260709 12:13:56.073827 31520 ts_tablet_manager.cc:1403] T 3e0e49105b2d44f09c55f7cc603f9b91 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 12:13:56.076517 31520 raft_consensus.cc:359] T 3e0e49105b2d44f09c55f7cc603f9b91 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:56.077267 31520 raft_consensus.cc:740] T 3e0e49105b2d44f09c55f7cc603f9b91 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:56.077986 31520 consensus_queue.cc:260] T 3e0e49105b2d44f09c55f7cc603f9b91 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:56.080191 31520 ts_tablet_manager.cc:1434] T 3e0e49105b2d44f09c55f7cc603f9b91 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:13:56.081072 31520 tablet_bootstrap.cc:492] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:56.110597 31520 tablet_bootstrap.cc:492] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:56.111835 31520 tablet_bootstrap.cc:492] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap complete.
I20260709 12:13:56.112571 31520 ts_tablet_manager.cc:1403] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.007s
I20260709 12:13:56.136242 31520 raft_consensus.cc:359] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:56.137034 31520 raft_consensus.cc:740] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:56.137881 31520 consensus_queue.cc:260] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:56.139717 31520 ts_tablet_manager.cc:1434] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 12:13:56.140468 31520 tablet_bootstrap.cc:492] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:56.164258 31520 tablet_bootstrap.cc:492] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:56.165043 31520 tablet_bootstrap.cc:492] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460: Bootstrap complete.
I20260709 12:13:56.165666 31520 ts_tablet_manager.cc:1403] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.000s
I20260709 12:13:56.179466 31520 raft_consensus.cc:359] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:56.180143 31520 raft_consensus.cc:740] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:56.180968 31520 consensus_queue.cc:260] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:56.182858 31520 ts_tablet_manager.cc:1434] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.000s
I20260709 12:13:56.187193 31520 tablet_bootstrap.cc:492] T c449839430794851b61ffba23f946c4f P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:56.238775 31344 raft_consensus.cc:493] T 5d636204e40644318b4758f37c7b0474 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c5665c17e904fc692bce76fc57b2460)
I20260709 12:13:56.239382 31344 raft_consensus.cc:515] T 5d636204e40644318b4758f37c7b0474 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:56.244318 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d636204e40644318b4758f37c7b0474" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
W20260709 12:13:56.255355 30750 leader_election.cc:336] T 5d636204e40644318b4758f37c7b0474 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111)
I20260709 12:13:56.255851 30750 leader_election.cc:304] T 5d636204e40644318b4758f37c7b0474 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 84b98f9236604dd0b22ae23c5378a676; no voters: 15ad0880a63541ef965cb6acca4513d7, 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:56.241398 31344 leader_election.cc:290] T 5d636204e40644318b4758f37c7b0474 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:56.257737 21266 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:13:56.258132 21266 ts_tablet_manager.cc:595] Time spent register tablets: real 0.262s	user 0.237s	sys 0.004s
I20260709 12:13:56.258052 31491 raft_consensus.cc:2749] T 5d636204e40644318b4758f37c7b0474 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:56.286798 31520 tablet_bootstrap.cc:492] T c449839430794851b61ffba23f946c4f P 6c5665c17e904fc692bce76fc57b2460: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:56.287909 31520 tablet_bootstrap.cc:492] T c449839430794851b61ffba23f946c4f P 6c5665c17e904fc692bce76fc57b2460: Bootstrap complete.
I20260709 12:13:56.294111 31520 ts_tablet_manager.cc:1403] T c449839430794851b61ffba23f946c4f P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.111s	user 0.018s	sys 0.007s
I20260709 12:13:56.300089 31520 raft_consensus.cc:359] T c449839430794851b61ffba23f946c4f P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:56.305233 31520 raft_consensus.cc:740] T c449839430794851b61ffba23f946c4f P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:56.308563 31520 consensus_queue.cc:260] T c449839430794851b61ffba23f946c4f P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:56.315203 31520 ts_tablet_manager.cc:1434] T c449839430794851b61ffba23f946c4f P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:13:56.316084 31520 tablet_bootstrap.cc:492] T 554acf71459c4e59b886396df52b3004 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:56.321334 31488 raft_consensus.cc:493] T 1eb80935abae44bf8dde4d54961c5fdb P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c5665c17e904fc692bce76fc57b2460)
I20260709 12:13:56.322273 31488 raft_consensus.cc:515] T 1eb80935abae44bf8dde4d54961c5fdb P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
W20260709 12:13:56.340951 30824 leader_election.cc:336] T 1eb80935abae44bf8dde4d54961c5fdb P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111)
I20260709 12:13:56.342658 31493 raft_consensus.cc:493] T bb358c4df82f4168bc1debdfc4e7aa9c P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c5665c17e904fc692bce76fc57b2460)
I20260709 12:13:56.343449 31493 raft_consensus.cc:515] T bb358c4df82f4168bc1debdfc4e7aa9c P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:56.346275 31493 leader_election.cc:290] T bb358c4df82f4168bc1debdfc4e7aa9c P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:56.349611 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb358c4df82f4168bc1debdfc4e7aa9c" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:56.352646 31491 raft_consensus.cc:493] T cdf560ffbc0c4b8b80beb6494a13d9cd P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c5665c17e904fc692bce76fc57b2460)
I20260709 12:13:56.353446 31491 raft_consensus.cc:515] T cdf560ffbc0c4b8b80beb6494a13d9cd P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:56.346891 31493 raft_consensus.cc:493] T 1eb80935abae44bf8dde4d54961c5fdb P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c5665c17e904fc692bce76fc57b2460)
I20260709 12:13:56.365269 31493 raft_consensus.cc:515] T 1eb80935abae44bf8dde4d54961c5fdb P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:56.379374 31488 leader_election.cc:290] T 1eb80935abae44bf8dde4d54961c5fdb P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:56.383349 31491 leader_election.cc:290] T cdf560ffbc0c4b8b80beb6494a13d9cd P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:56.387665 31493 leader_election.cc:290] T 1eb80935abae44bf8dde4d54961c5fdb P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
W20260709 12:13:56.389149 30898 leader_election.cc:336] T bb358c4df82f4168bc1debdfc4e7aa9c P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111)
I20260709 12:13:56.389897 30898 leader_election.cc:304] T bb358c4df82f4168bc1debdfc4e7aa9c P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7; no voters: 6c5665c17e904fc692bce76fc57b2460, 8130e18710c04a61a5d8bd019c6ffdad
I20260709 12:13:56.392649 31493 raft_consensus.cc:2749] T bb358c4df82f4168bc1debdfc4e7aa9c P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:56.406317 30898 leader_election.cc:336] T 1eb80935abae44bf8dde4d54961c5fdb P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111)
I20260709 12:13:56.417398 31520 tablet_bootstrap.cc:492] T 554acf71459c4e59b886396df52b3004 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:56.455660 31520 tablet_bootstrap.cc:492] T 554acf71459c4e59b886396df52b3004 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap complete.
I20260709 12:13:56.456377 31520 ts_tablet_manager.cc:1403] T 554acf71459c4e59b886396df52b3004 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.141s	user 0.017s	sys 0.003s
I20260709 12:13:56.460660 31520 raft_consensus.cc:359] T 554acf71459c4e59b886396df52b3004 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:56.461374 31520 raft_consensus.cc:740] T 554acf71459c4e59b886396df52b3004 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:56.462098 31520 consensus_queue.cc:260] T 554acf71459c4e59b886396df52b3004 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
W20260709 12:13:56.447182 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:40909, user_credentials={real_user=slave}} blocked reactor thread for 191845us
I20260709 12:13:56.450766 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb80935abae44bf8dde4d54961c5fdb" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:56.463744 30854 raft_consensus.cc:2468] T 1eb80935abae44bf8dde4d54961c5fdb P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 1.
I20260709 12:13:56.467320 31520 ts_tablet_manager.cc:1434] T 554acf71459c4e59b886396df52b3004 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.003s
I20260709 12:13:56.468247 31520 tablet_bootstrap.cc:492] T eb58d3a8bd8540ff9871ea41021a5025 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
W20260709 12:13:56.462858 30823 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:43035, user_credentials={real_user=slave}} blocked reactor thread for 143348us
I20260709 12:13:56.477609 31529 raft_consensus.cc:493] T baedd172e30a4ef4a6641302fdebd9c5 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c5665c17e904fc692bce76fc57b2460)
I20260709 12:13:56.478149 31529 raft_consensus.cc:515] T baedd172e30a4ef4a6641302fdebd9c5 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:56.480962 31529 leader_election.cc:290] T baedd172e30a4ef4a6641302fdebd9c5 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
W20260709 12:13:56.481527 30898 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:40909, user_credentials={real_user=slave}} blocked reactor thread for 75244.2us
I20260709 12:13:56.483304 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baedd172e30a4ef4a6641302fdebd9c5" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
W20260709 12:13:56.453076 30748 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:42179, user_credentials={real_user=slave}} blocked reactor thread for 196588us
I20260709 12:13:56.494207 31527 raft_consensus.cc:493] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c5665c17e904fc692bce76fc57b2460)
I20260709 12:13:56.494835 31527 raft_consensus.cc:515] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:56.500270 31534 raft_consensus.cc:493] T fd65967534164e9c805fc3d5d05e0369 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c5665c17e904fc692bce76fc57b2460)
I20260709 12:13:56.501140 31534 raft_consensus.cc:515] T fd65967534164e9c805fc3d5d05e0369 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:56.503558 31534 leader_election.cc:290] T fd65967534164e9c805fc3d5d05e0369 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:56.524677 31530 raft_consensus.cc:493] T c52d3c5b6b15499e9c834cf33954609a P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c5665c17e904fc692bce76fc57b2460)
I20260709 12:13:56.525264 30896 leader_election.cc:304] T 1eb80935abae44bf8dde4d54961c5fdb P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:56.525424 31530 raft_consensus.cc:515] T c52d3c5b6b15499e9c834cf33954609a P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:56.527076 31478 raft_consensus.cc:2804] T 1eb80935abae44bf8dde4d54961c5fdb P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:56.527444 31478 raft_consensus.cc:493] T 1eb80935abae44bf8dde4d54961c5fdb P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6c5665c17e904fc692bce76fc57b2460)
I20260709 12:13:56.527803 31478 raft_consensus.cc:3060] T 1eb80935abae44bf8dde4d54961c5fdb P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:56.529340 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd65967534164e9c805fc3d5d05e0369" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:56.505353 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf560ffbc0c4b8b80beb6494a13d9cd" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:56.518996 31491 raft_consensus.cc:493] T 745e2cea61c44c3a80bdc49add504a75 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c5665c17e904fc692bce76fc57b2460)
I20260709 12:13:56.540395 30854 raft_consensus.cc:2468] T cdf560ffbc0c4b8b80beb6494a13d9cd P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 1.
I20260709 12:13:56.541461 31491 raft_consensus.cc:515] T 745e2cea61c44c3a80bdc49add504a75 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:56.542001 31344 raft_consensus.cc:493] T a0bb1498511242ef95085be49c10c4d3 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c5665c17e904fc692bce76fc57b2460)
I20260709 12:13:56.540452 31536 raft_consensus.cc:493] T 745e2cea61c44c3a80bdc49add504a75 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c5665c17e904fc692bce76fc57b2460)
I20260709 12:13:56.542667 31344 raft_consensus.cc:515] T a0bb1498511242ef95085be49c10c4d3 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:56.518502 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb80935abae44bf8dde4d54961c5fdb" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:56.541738 31530 leader_election.cc:290] T c52d3c5b6b15499e9c834cf33954609a P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:56.518620 31529 raft_consensus.cc:493] T 615eb2fb16414287bc0956a27523b7f4 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c5665c17e904fc692bce76fc57b2460)
I20260709 12:13:56.551318 31491 leader_election.cc:290] T 745e2cea61c44c3a80bdc49add504a75 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:56.551116 31529 raft_consensus.cc:515] T 615eb2fb16414287bc0956a27523b7f4 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:56.545405 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c52d3c5b6b15499e9c834cf33954609a" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:56.547714 31486 raft_consensus.cc:493] T bb358c4df82f4168bc1debdfc4e7aa9c P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c5665c17e904fc692bce76fc57b2460)
I20260709 12:13:56.542784 31536 raft_consensus.cc:515] T 745e2cea61c44c3a80bdc49add504a75 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:56.552835 31486 raft_consensus.cc:515] T bb358c4df82f4168bc1debdfc4e7aa9c P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:56.553509 31529 leader_election.cc:290] T 615eb2fb16414287bc0956a27523b7f4 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:56.554627 31536 leader_election.cc:290] T 745e2cea61c44c3a80bdc49add504a75 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:56.555008 31486 leader_election.cc:290] T bb358c4df82f4168bc1debdfc4e7aa9c P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:56.556206 31344 leader_election.cc:290] T a0bb1498511242ef95085be49c10c4d3 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
W20260709 12:13:56.557628 30898 leader_election.cc:336] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111)
I20260709 12:13:56.557961 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb358c4df82f4168bc1debdfc4e7aa9c" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:56.558588 30929 raft_consensus.cc:2468] T bb358c4df82f4168bc1debdfc4e7aa9c P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 1.
I20260709 12:13:56.561910 31344 raft_consensus.cc:493] T 2ff9e0d905854cceb79f96f500a07339 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c5665c17e904fc692bce76fc57b2460)
I20260709 12:13:56.549201 31478 raft_consensus.cc:515] T 1eb80935abae44bf8dde4d54961c5fdb P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:56.500377 31527 leader_election.cc:290] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:56.562781 31344 raft_consensus.cc:515] T 2ff9e0d905854cceb79f96f500a07339 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:56.564740 31478 leader_election.cc:290] T 1eb80935abae44bf8dde4d54961c5fdb P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 election: Requested vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:56.565992 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9e0d905854cceb79f96f500a07339" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:56.566331 30823 leader_election.cc:304] T bb358c4df82f4168bc1debdfc4e7aa9c P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 
I20260709 12:13:56.567363 31536 raft_consensus.cc:2804] T bb358c4df82f4168bc1debdfc4e7aa9c P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:56.567832 31536 raft_consensus.cc:493] T bb358c4df82f4168bc1debdfc4e7aa9c P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6c5665c17e904fc692bce76fc57b2460)
I20260709 12:13:56.568233 31536 raft_consensus.cc:3060] T bb358c4df82f4168bc1debdfc4e7aa9c P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:56.570962 30898 leader_election.cc:336] T 1eb80935abae44bf8dde4d54961c5fdb P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111)
I20260709 12:13:56.568197 31344 leader_election.cc:290] T 2ff9e0d905854cceb79f96f500a07339 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:56.571197 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb80935abae44bf8dde4d54961c5fdb" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:13:56.573056 30854 raft_consensus.cc:3060] T 1eb80935abae44bf8dde4d54961c5fdb P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:56.573575 30748 leader_election.cc:304] T cdf560ffbc0c4b8b80beb6494a13d9cd P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:13:56.571861 30930 raft_consensus.cc:2393] T 1eb80935abae44bf8dde4d54961c5fdb P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8130e18710c04a61a5d8bd019c6ffdad in current term 2: Already voted for candidate 15ad0880a63541ef965cb6acca4513d7 in this term.
W20260709 12:13:56.575695 30824 leader_election.cc:336] T fd65967534164e9c805fc3d5d05e0369 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111)
I20260709 12:13:56.571933 31486 raft_consensus.cc:493] T a0bb1498511242ef95085be49c10c4d3 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c5665c17e904fc692bce76fc57b2460)
I20260709 12:13:56.576179 30824 leader_election.cc:304] T fd65967534164e9c805fc3d5d05e0369 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad; no voters: 15ad0880a63541ef965cb6acca4513d7, 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:56.576493 31486 raft_consensus.cc:515] T a0bb1498511242ef95085be49c10c4d3 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:56.576990 31491 raft_consensus.cc:2804] T cdf560ffbc0c4b8b80beb6494a13d9cd P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:56.577468 31491 raft_consensus.cc:493] T cdf560ffbc0c4b8b80beb6494a13d9cd P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6c5665c17e904fc692bce76fc57b2460)
I20260709 12:13:56.577870 31491 raft_consensus.cc:3060] T cdf560ffbc0c4b8b80beb6494a13d9cd P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:56.578706 31486 leader_election.cc:290] T a0bb1498511242ef95085be49c10c4d3 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:56.581790 30823 leader_election.cc:304] T 1eb80935abae44bf8dde4d54961c5fdb P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad; no voters: 15ad0880a63541ef965cb6acca4513d7, 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:56.585667 30854 raft_consensus.cc:2468] T 1eb80935abae44bf8dde4d54961c5fdb P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 2.
I20260709 12:13:56.586050 31491 raft_consensus.cc:515] T cdf560ffbc0c4b8b80beb6494a13d9cd P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:56.586952 30896 leader_election.cc:304] T 1eb80935abae44bf8dde4d54961c5fdb P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:56.587932 31478 raft_consensus.cc:2804] T 1eb80935abae44bf8dde4d54961c5fdb P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:56.588408 31478 raft_consensus.cc:697] T 1eb80935abae44bf8dde4d54961c5fdb P 15ad0880a63541ef965cb6acca4513d7 [term 2 LEADER]: Becoming Leader. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Running, Role: LEADER
I20260709 12:13:56.588584 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "745e2cea61c44c3a80bdc49add504a75" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:56.589237 30856 raft_consensus.cc:2468] T 745e2cea61c44c3a80bdc49add504a75 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 1.
I20260709 12:13:56.589342 31478 consensus_queue.cc:237] T 1eb80935abae44bf8dde4d54961c5fdb P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:56.588613 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "615eb2fb16414287bc0956a27523b7f4" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:56.591858 31520 tablet_bootstrap.cc:492] T eb58d3a8bd8540ff9871ea41021a5025 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:56.593032 31520 tablet_bootstrap.cc:492] T eb58d3a8bd8540ff9871ea41021a5025 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap complete.
I20260709 12:13:56.593797 31520 ts_tablet_manager.cc:1403] T eb58d3a8bd8540ff9871ea41021a5025 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.126s	user 0.016s	sys 0.004s
I20260709 12:13:56.595913 31527 raft_consensus.cc:493] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c5665c17e904fc692bce76fc57b2460)
I20260709 12:13:56.596294 30748 leader_election.cc:304] T 745e2cea61c44c3a80bdc49add504a75 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:13:56.596465 31527 raft_consensus.cc:515] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:56.625342 31520 raft_consensus.cc:359] T eb58d3a8bd8540ff9871ea41021a5025 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:56.630133 31520 raft_consensus.cc:740] T eb58d3a8bd8540ff9871ea41021a5025 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:56.630177 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0bb1498511242ef95085be49c10c4d3" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
W20260709 12:13:56.627780 30750 leader_election.cc:336] T cdf560ffbc0c4b8b80beb6494a13d9cd P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111)
I20260709 12:13:56.597900 31534 raft_consensus.cc:2749] T fd65967534164e9c805fc3d5d05e0369 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:56.596911 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5324c1d1d0cd4e6e96c28c96ebcbb03f" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:56.633167 31520 consensus_queue.cc:260] T eb58d3a8bd8540ff9871ea41021a5025 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:56.634009 31534 raft_consensus.cc:493] T 615eb2fb16414287bc0956a27523b7f4 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c5665c17e904fc692bce76fc57b2460)
I20260709 12:13:56.634645 31534 raft_consensus.cc:515] T 615eb2fb16414287bc0956a27523b7f4 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:56.635463 31529 raft_consensus.cc:493] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c5665c17e904fc692bce76fc57b2460)
I20260709 12:13:56.636755 31479 raft_consensus.cc:493] T 5d636204e40644318b4758f37c7b0474 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c5665c17e904fc692bce76fc57b2460)
W20260709 12:13:56.636976 30898 leader_election.cc:336] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111)
I20260709 12:13:56.637334 31479 raft_consensus.cc:515] T 5d636204e40644318b4758f37c7b0474 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:56.637774 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf560ffbc0c4b8b80beb6494a13d9cd" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:13:56.638371 30857 raft_consensus.cc:3060] T cdf560ffbc0c4b8b80beb6494a13d9cd P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:56.639734 31479 leader_election.cc:290] T 5d636204e40644318b4758f37c7b0474 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:56.635978 31529 raft_consensus.cc:515] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:56.643741 31529 leader_election.cc:290] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
W20260709 12:13:56.626816 30824 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:40909, user_credentials={real_user=slave}} blocked reactor thread for 51152.3us
I20260709 12:13:56.646282 30857 raft_consensus.cc:2468] T cdf560ffbc0c4b8b80beb6494a13d9cd P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 2.
I20260709 12:13:56.647169 31527 leader_election.cc:290] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:56.598541 31486 raft_consensus.cc:2749] T 1eb80935abae44bf8dde4d54961c5fdb P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:56.643685 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5324c1d1d0cd4e6e96c28c96ebcbb03f" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:56.628791 31538 raft_consensus.cc:2804] T 745e2cea61c44c3a80bdc49add504a75 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:13:56.645720 30898 leader_election.cc:336] T 5d636204e40644318b4758f37c7b0474 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111)
I20260709 12:13:56.648583 30930 raft_consensus.cc:2468] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 1.
I20260709 12:13:56.649760 30748 leader_election.cc:304] T cdf560ffbc0c4b8b80beb6494a13d9cd P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:13:56.632308 31491 leader_election.cc:290] T cdf560ffbc0c4b8b80beb6494a13d9cd P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 2 election: Requested vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:56.651515 31344 raft_consensus.cc:2804] T cdf560ffbc0c4b8b80beb6494a13d9cd P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:56.653193 30749 leader_election.cc:304] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:13:56.654906 31530 raft_consensus.cc:2804] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:56.648753 31538 raft_consensus.cc:493] T 745e2cea61c44c3a80bdc49add504a75 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6c5665c17e904fc692bce76fc57b2460)
I20260709 12:13:56.655287 31530 raft_consensus.cc:493] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6c5665c17e904fc692bce76fc57b2460)
I20260709 12:13:56.655432 31538 raft_consensus.cc:3060] T 745e2cea61c44c3a80bdc49add504a75 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:56.655745 31530 raft_consensus.cc:3060] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:56.604560 31493 raft_consensus.cc:493] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c5665c17e904fc692bce76fc57b2460)
I20260709 12:13:56.656957 31493 raft_consensus.cc:515] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:56.653419 31344 raft_consensus.cc:697] T cdf560ffbc0c4b8b80beb6494a13d9cd P 84b98f9236604dd0b22ae23c5378a676 [term 2 LEADER]: Becoming Leader. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Running, Role: LEADER
I20260709 12:13:56.634971 30854 raft_consensus.cc:2468] T a0bb1498511242ef95085be49c10c4d3 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 1.
W20260709 12:13:56.666915 30824 leader_election.cc:336] T 745e2cea61c44c3a80bdc49add504a75 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111)
I20260709 12:13:56.667212 30748 leader_election.cc:304] T a0bb1498511242ef95085be49c10c4d3 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:13:56.664512 31344 consensus_queue.cc:237] T cdf560ffbc0c4b8b80beb6494a13d9cd P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
W20260709 12:13:56.667538 30824 leader_election.cc:336] T bb358c4df82f4168bc1debdfc4e7aa9c P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111)
I20260709 12:13:56.636752 31534 leader_election.cc:290] T 615eb2fb16414287bc0956a27523b7f4 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:56.669426 31520 ts_tablet_manager.cc:1434] T eb58d3a8bd8540ff9871ea41021a5025 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.075s	user 0.009s	sys 0.001s
I20260709 12:13:56.671551 31520 tablet_bootstrap.cc:492] T 2971ad17262c4b5e8665700af97ec254 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:56.660204 31527 raft_consensus.cc:493] T 76d4dde0196948ef92f68df770af02b0 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c5665c17e904fc692bce76fc57b2460)
I20260709 12:13:56.677397 31536 raft_consensus.cc:515] T bb358c4df82f4168bc1debdfc4e7aa9c P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:56.687318 31479 raft_consensus.cc:493] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c5665c17e904fc692bce76fc57b2460)
I20260709 12:13:56.699329 31536 leader_election.cc:290] T bb358c4df82f4168bc1debdfc4e7aa9c P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 2 election: Requested vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:56.699488 31479 raft_consensus.cc:515] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:56.701957 31479 leader_election.cc:290] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:56.687291 31534 raft_consensus.cc:493] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c5665c17e904fc692bce76fc57b2460)
I20260709 12:13:56.703599 31534 raft_consensus.cc:515] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:56.706218 31534 leader_election.cc:290] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
W20260709 12:13:56.708778 30824 leader_election.cc:336] T a0bb1498511242ef95085be49c10c4d3 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111)
W20260709 12:13:56.709300 30824 leader_election.cc:336] T 615eb2fb16414287bc0956a27523b7f4 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111)
W20260709 12:13:56.730441 30896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:42179, user_credentials={real_user=slave}} blocked reactor thread for 56569.6us
I20260709 12:13:56.684779 31527 raft_consensus.cc:515] T 76d4dde0196948ef92f68df770af02b0 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:56.737015 31529 raft_consensus.cc:2804] T a0bb1498511242ef95085be49c10c4d3 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:56.744292 31479 raft_consensus.cc:493] T 2ff9e0d905854cceb79f96f500a07339 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c5665c17e904fc692bce76fc57b2460)
I20260709 12:13:56.750463 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd65967534164e9c805fc3d5d05e0369" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:56.753419 31491 raft_consensus.cc:493] T 0317908edb88497b82c4e59ef1bac414 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c5665c17e904fc692bce76fc57b2460)
I20260709 12:13:56.753958 30857 raft_consensus.cc:2468] T fd65967534164e9c805fc3d5d05e0369 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 1.
I20260709 12:13:56.751029 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb358c4df82f4168bc1debdfc4e7aa9c" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
W20260709 12:13:56.752466 30824 leader_election.cc:336] T bb358c4df82f4168bc1debdfc4e7aa9c P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111)
W20260709 12:13:56.772035 30824 leader_election.cc:336] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111)
I20260709 12:13:56.753996 31491 raft_consensus.cc:515] T 0317908edb88497b82c4e59ef1bac414 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:56.777410 31491 leader_election.cc:290] T 0317908edb88497b82c4e59ef1bac414 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:56.777987 31491 raft_consensus.cc:493] T 76d4dde0196948ef92f68df770af02b0 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c5665c17e904fc692bce76fc57b2460)
I20260709 12:13:56.783124 30929 raft_consensus.cc:3060] T bb358c4df82f4168bc1debdfc4e7aa9c P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:56.789512 31538 raft_consensus.cc:515] T 745e2cea61c44c3a80bdc49add504a75 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:56.789430 30896 leader_election.cc:304] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 
I20260709 12:13:56.749203 31529 raft_consensus.cc:493] T a0bb1498511242ef95085be49c10c4d3 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6c5665c17e904fc692bce76fc57b2460)
I20260709 12:13:56.778541 31491 raft_consensus.cc:515] T 76d4dde0196948ef92f68df770af02b0 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
W20260709 12:13:56.808864 30749 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:43035, user_credentials={real_user=slave}} blocked reactor thread for 67252.2us
I20260709 12:13:56.817826 30929 raft_consensus.cc:2468] T bb358c4df82f4168bc1debdfc4e7aa9c P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 2.
I20260709 12:13:56.806659 31529 raft_consensus.cc:3060] T a0bb1498511242ef95085be49c10c4d3 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:56.753854 31479 raft_consensus.cc:515] T 2ff9e0d905854cceb79f96f500a07339 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:56.823792 31493 leader_election.cc:290] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:56.832621 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0317908edb88497b82c4e59ef1bac414" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:56.833508 30823 leader_election.cc:304] T bb358c4df82f4168bc1debdfc4e7aa9c P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:56.833287 30856 raft_consensus.cc:2468] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 2.
I20260709 12:13:56.840453 31544 raft_consensus.cc:2804] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:56.840969 31544 raft_consensus.cc:493] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6c5665c17e904fc692bce76fc57b2460)
I20260709 12:13:56.841349 31544 raft_consensus.cc:3060] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:56.843994 31534 raft_consensus.cc:2804] T bb358c4df82f4168bc1debdfc4e7aa9c P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:56.844525 31534 raft_consensus.cc:697] T bb358c4df82f4168bc1debdfc4e7aa9c P 8130e18710c04a61a5d8bd019c6ffdad [term 2 LEADER]: Becoming Leader. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Running, Role: LEADER
I20260709 12:13:56.845454 31534 consensus_queue.cc:237] T bb358c4df82f4168bc1debdfc4e7aa9c P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:56.848534 30607 catalog_manager.cc:5697] T cdf560ffbc0c4b8b80beb6494a13d9cd P 84b98f9236604dd0b22ae23c5378a676 reported cstate change: term changed from 1 to 2, leader changed from 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129) to 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130). New cstate: current_term: 2 leader_uuid: "84b98f9236604dd0b22ae23c5378a676" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:56.850328 30604 catalog_manager.cc:5697] T 1eb80935abae44bf8dde4d54961c5fdb P 15ad0880a63541ef965cb6acca4513d7 reported cstate change: term changed from 1 to 2, leader changed from 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129) to 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132). New cstate: current_term: 2 leader_uuid: "15ad0880a63541ef965cb6acca4513d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:56.852380 31527 leader_election.cc:290] T 76d4dde0196948ef92f68df770af02b0 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:56.874380 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0bb1498511242ef95085be49c10c4d3" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:56.857229 31479 leader_election.cc:290] T 2ff9e0d905854cceb79f96f500a07339 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:56.903514 30748 leader_election.cc:304] T 0317908edb88497b82c4e59ef1bac414 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:13:56.906117 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "615eb2fb16414287bc0956a27523b7f4" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:56.906771 31529 raft_consensus.cc:515] T a0bb1498511242ef95085be49c10c4d3 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:56.909005 31529 leader_election.cc:290] T a0bb1498511242ef95085be49c10c4d3 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 2 election: Requested vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:56.909693 30781 raft_consensus.cc:2393] T a0bb1498511242ef95085be49c10c4d3 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8130e18710c04a61a5d8bd019c6ffdad in current term 2: Already voted for candidate 84b98f9236604dd0b22ae23c5378a676 in this term.
I20260709 12:13:56.906818 30784 raft_consensus.cc:2468] T 615eb2fb16414287bc0956a27523b7f4 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 1.
I20260709 12:13:56.906147 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0317908edb88497b82c4e59ef1bac414" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:56.926352 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c52d3c5b6b15499e9c834cf33954609a" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:56.922895 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d636204e40644318b4758f37c7b0474" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:56.927248 30781 raft_consensus.cc:2468] T 5d636204e40644318b4758f37c7b0474 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 1.
I20260709 12:13:56.937325 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baedd172e30a4ef4a6641302fdebd9c5" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:56.937994 30781 raft_consensus.cc:2468] T baedd172e30a4ef4a6641302fdebd9c5 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 1.
I20260709 12:13:56.932452 30784 raft_consensus.cc:2468] T c52d3c5b6b15499e9c834cf33954609a P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 1.
I20260709 12:13:56.921742 30779 raft_consensus.cc:2468] T 0317908edb88497b82c4e59ef1bac414 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 2.
I20260709 12:13:56.942037 31548 raft_consensus.cc:2804] T 0317908edb88497b82c4e59ef1bac414 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:56.943771 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "745e2cea61c44c3a80bdc49add504a75" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:56.944943 30777 raft_consensus.cc:2393] T 745e2cea61c44c3a80bdc49add504a75 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8130e18710c04a61a5d8bd019c6ffdad in current term 2: Already voted for candidate 84b98f9236604dd0b22ae23c5378a676 in this term.
I20260709 12:13:56.945870 31530 raft_consensus.cc:515] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:56.947041 31548 raft_consensus.cc:493] T 0317908edb88497b82c4e59ef1bac414 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6c5665c17e904fc692bce76fc57b2460)
I20260709 12:13:56.947597 31548 raft_consensus.cc:3060] T 0317908edb88497b82c4e59ef1bac414 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:56.947991 31530 leader_election.cc:290] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 2 election: Requested vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:56.951965 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5324c1d1d0cd4e6e96c28c96ebcbb03f" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
I20260709 12:13:56.952636 30928 raft_consensus.cc:3060] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:56.952126 31491 leader_election.cc:290] T 76d4dde0196948ef92f68df770af02b0 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:56.953855 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d4dde0196948ef92f68df770af02b0" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:56.954487 30929 raft_consensus.cc:2468] T 76d4dde0196948ef92f68df770af02b0 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 1.
I20260709 12:13:56.956014 30749 leader_election.cc:304] T 76d4dde0196948ef92f68df770af02b0 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:13:56.959143 31491 raft_consensus.cc:2804] T 76d4dde0196948ef92f68df770af02b0 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:56.959509 31491 raft_consensus.cc:493] T 76d4dde0196948ef92f68df770af02b0 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6c5665c17e904fc692bce76fc57b2460)
I20260709 12:13:56.959875 31491 raft_consensus.cc:3060] T 76d4dde0196948ef92f68df770af02b0 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:56.961041 31544 raft_consensus.cc:515] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
W20260709 12:13:56.961968 30824 consensus_peers.cc:597] T c449839430794851b61ffba23f946c4f P 8130e18710c04a61a5d8bd019c6ffdad -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:56.962608 30928 raft_consensus.cc:2468] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 2.
W20260709 12:13:56.939623 30898 leader_election.cc:336] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111)
I20260709 12:13:56.937954 31538 leader_election.cc:290] T 745e2cea61c44c3a80bdc49add504a75 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 2 election: Requested vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:56.995914 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9e0d905854cceb79f96f500a07339" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:56.968513 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0bb1498511242ef95085be49c10c4d3" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:13:56.996706 30781 raft_consensus.cc:2468] T 2ff9e0d905854cceb79f96f500a07339 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 1.
I20260709 12:13:56.996542 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d4dde0196948ef92f68df770af02b0" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:56.999603 30854 raft_consensus.cc:3060] T a0bb1498511242ef95085be49c10c4d3 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:57.002734 30898 leader_election.cc:336] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111)
I20260709 12:13:57.019183 30605 catalog_manager.cc:5697] T bb358c4df82f4168bc1debdfc4e7aa9c P 8130e18710c04a61a5d8bd019c6ffdad reported cstate change: term changed from 1 to 2, leader changed from 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129) to 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131). New cstate: current_term: 2 leader_uuid: "8130e18710c04a61a5d8bd019c6ffdad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:57.020661 31544 leader_election.cc:290] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 election: Requested vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:57.022501 30749 leader_election.cc:304] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:13:57.023754 31549 raft_consensus.cc:2804] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:57.024260 31549 raft_consensus.cc:697] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 84b98f9236604dd0b22ae23c5378a676 [term 2 LEADER]: Becoming Leader. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Running, Role: LEADER
I20260709 12:13:57.025218 31549 consensus_queue.cc:237] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:57.028615 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd65967534164e9c805fc3d5d05e0369" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:13:57.029299 30855 raft_consensus.cc:3060] T fd65967534164e9c805fc3d5d05e0369 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:57.030967 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "745e2cea61c44c3a80bdc49add504a75" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:13:57.032178 30856 raft_consensus.cc:3060] T 745e2cea61c44c3a80bdc49add504a75 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:57.032994 30854 raft_consensus.cc:2468] T a0bb1498511242ef95085be49c10c4d3 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 2.
I20260709 12:13:56.974434 31548 raft_consensus.cc:515] T 0317908edb88497b82c4e59ef1bac414 P 84b98f9236604dd0b22ae23c5378a676 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:57.040633 30896 leader_election.cc:304] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7; no voters: 6c5665c17e904fc692bce76fc57b2460, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:57.050184 31544 raft_consensus.cc:2749] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:57.055629 30856 raft_consensus.cc:2468] T 745e2cea61c44c3a80bdc49add504a75 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 2.
I20260709 12:13:57.056953 30748 leader_election.cc:304] T 745e2cea61c44c3a80bdc49add504a75 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:13:57.057580 30896 leader_election.cc:304] T 5d636204e40644318b4758f37c7b0474 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676; no voters: 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:57.051035 30855 raft_consensus.cc:2468] T fd65967534164e9c805fc3d5d05e0369 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 2.
I20260709 12:13:57.061139 31548 leader_election.cc:290] T 0317908edb88497b82c4e59ef1bac414 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 3 election: Requested vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:57.066612 31491 raft_consensus.cc:515] T 76d4dde0196948ef92f68df770af02b0 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:57.068475 31548 raft_consensus.cc:2804] T 745e2cea61c44c3a80bdc49add504a75 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:57.069037 31548 raft_consensus.cc:697] T 745e2cea61c44c3a80bdc49add504a75 P 84b98f9236604dd0b22ae23c5378a676 [term 2 LEADER]: Becoming Leader. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Running, Role: LEADER
I20260709 12:13:57.068881 30748 leader_election.cc:304] T a0bb1498511242ef95085be49c10c4d3 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:13:57.070045 31548 consensus_queue.cc:237] T 745e2cea61c44c3a80bdc49add504a75 P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:57.071636 31493 raft_consensus.cc:2804] T 5d636204e40644318b4758f37c7b0474 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:57.072160 31550 raft_consensus.cc:2804] T a0bb1498511242ef95085be49c10c4d3 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:57.072955 31550 raft_consensus.cc:697] T a0bb1498511242ef95085be49c10c4d3 P 84b98f9236604dd0b22ae23c5378a676 [term 2 LEADER]: Becoming Leader. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Running, Role: LEADER
I20260709 12:13:57.073942 30822 leader_election.cc:304] T 615eb2fb16414287bc0956a27523b7f4 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676; no voters: 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:57.073884 31550 consensus_queue.cc:237] T a0bb1498511242ef95085be49c10c4d3 P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:57.074690 31520 tablet_bootstrap.cc:492] T 2971ad17262c4b5e8665700af97ec254 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:57.075680 31520 tablet_bootstrap.cc:492] T 2971ad17262c4b5e8665700af97ec254 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap complete.
I20260709 12:13:57.076510 31520 ts_tablet_manager.cc:1403] T 2971ad17262c4b5e8665700af97ec254 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.405s	user 0.029s	sys 0.035s
I20260709 12:13:57.076965 31532 raft_consensus.cc:2804] T 615eb2fb16414287bc0956a27523b7f4 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:57.077407 31532 raft_consensus.cc:493] T 615eb2fb16414287bc0956a27523b7f4 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6c5665c17e904fc692bce76fc57b2460)
I20260709 12:13:57.077872 31532 raft_consensus.cc:3060] T 615eb2fb16414287bc0956a27523b7f4 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:57.072124 31493 raft_consensus.cc:493] T 5d636204e40644318b4758f37c7b0474 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6c5665c17e904fc692bce76fc57b2460)
I20260709 12:13:57.069043 31491 leader_election.cc:290] T 76d4dde0196948ef92f68df770af02b0 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 2 election: Requested vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:57.079773 31493 raft_consensus.cc:3060] T 5d636204e40644318b4758f37c7b0474 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:57.069950 30777 raft_consensus.cc:2393] T 76d4dde0196948ef92f68df770af02b0 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 15ad0880a63541ef965cb6acca4513d7 in current term 2: Already voted for candidate 84b98f9236604dd0b22ae23c5378a676 in this term.
I20260709 12:13:57.085706 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d4dde0196948ef92f68df770af02b0" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
I20260709 12:13:57.086336 30929 raft_consensus.cc:3060] T 76d4dde0196948ef92f68df770af02b0 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:57.087967 30824 consensus_peers.cc:597] T 7b23395f850d4699b8d289f501c96f60 P 8130e18710c04a61a5d8bd019c6ffdad -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:57.075605 30822 leader_election.cc:304] T a0bb1498511242ef95085be49c10c4d3 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad; no voters: 6c5665c17e904fc692bce76fc57b2460, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:57.093122 30896 leader_election.cc:304] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676; no voters: 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:57.093384 30929 raft_consensus.cc:2468] T 76d4dde0196948ef92f68df770af02b0 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84b98f9236604dd0b22ae23c5378a676 in term 2.
I20260709 12:13:57.095023 30749 leader_election.cc:304] T 76d4dde0196948ef92f68df770af02b0 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:13:57.099537 30896 leader_election.cc:304] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 
I20260709 12:13:57.100317 31538 raft_consensus.cc:2804] T 76d4dde0196948ef92f68df770af02b0 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:57.106769 30822 leader_election.cc:304] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676; no voters: 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:57.100069 31520 raft_consensus.cc:359] T 2971ad17262c4b5e8665700af97ec254 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:57.107710 31536 raft_consensus.cc:2804] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:57.098968 31534 raft_consensus.cc:2749] T a0bb1498511242ef95085be49c10c4d3 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:57.113981 31554 raft_consensus.cc:2804] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:57.114542 31554 raft_consensus.cc:697] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7 [term 2 LEADER]: Becoming Leader. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Running, Role: LEADER
I20260709 12:13:57.113235 31538 raft_consensus.cc:697] T 76d4dde0196948ef92f68df770af02b0 P 84b98f9236604dd0b22ae23c5378a676 [term 2 LEADER]: Becoming Leader. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Running, Role: LEADER
I20260709 12:13:57.115688 31538 consensus_queue.cc:237] T 76d4dde0196948ef92f68df770af02b0 P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:57.116143 31554 consensus_queue.cc:237] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:57.113248 31536 raft_consensus.cc:493] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6c5665c17e904fc692bce76fc57b2460)
I20260709 12:13:57.117406 31536 raft_consensus.cc:3060] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:57.107745 31520 raft_consensus.cc:740] T 2971ad17262c4b5e8665700af97ec254 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:57.108922 30896 leader_election.cc:304] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676; no voters: 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:57.132030 31527 raft_consensus.cc:2804] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:57.132493 31527 raft_consensus.cc:493] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6c5665c17e904fc692bce76fc57b2460)
I20260709 12:13:57.132948 31527 raft_consensus.cc:3060] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:57.133517 30896 leader_election.cc:304] T 2ff9e0d905854cceb79f96f500a07339 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:13:57.109534 30822 leader_election.cc:304] T 745e2cea61c44c3a80bdc49add504a75 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad; no voters: 6c5665c17e904fc692bce76fc57b2460, 84b98f9236604dd0b22ae23c5378a676
W20260709 12:13:57.102829 30898 leader_election.cc:336] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111)
I20260709 12:13:57.135139 31535 raft_consensus.cc:2749] T 745e2cea61c44c3a80bdc49add504a75 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:57.135833 30898 leader_election.cc:336] T 76d4dde0196948ef92f68df770af02b0 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111)
W20260709 12:13:57.136390 30898 leader_election.cc:336] T 2ff9e0d905854cceb79f96f500a07339 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111)
I20260709 12:13:57.111378 31532 raft_consensus.cc:515] T 615eb2fb16414287bc0956a27523b7f4 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:57.104183 30853 raft_consensus.cc:1275] T cdf560ffbc0c4b8b80beb6494a13d9cd P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Refusing update from remote peer 84b98f9236604dd0b22ae23c5378a676: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:57.103411 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0317908edb88497b82c4e59ef1bac414" candidate_uuid: "84b98f9236604dd0b22ae23c5378a676" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:13:57.100092 31544 raft_consensus.cc:2804] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:13:57.131124 30824 consensus_peers.cc:597] T ca92b4f3c36b42fb9aa2f575c06344fe P 8130e18710c04a61a5d8bd019c6ffdad -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:57.153523 31555 raft_consensus.cc:2804] T 2ff9e0d905854cceb79f96f500a07339 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:57.154006 31555 raft_consensus.cc:493] T 2ff9e0d905854cceb79f96f500a07339 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6c5665c17e904fc692bce76fc57b2460)
I20260709 12:13:57.154362 31555 raft_consensus.cc:3060] T 2ff9e0d905854cceb79f96f500a07339 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:57.155206 30898 consensus_peers.cc:597] T 1eb80935abae44bf8dde4d54961c5fdb P 15ad0880a63541ef965cb6acca4513d7 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:57.155030 31493 raft_consensus.cc:515] T 5d636204e40644318b4758f37c7b0474 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
W20260709 12:13:57.155682 30898 consensus_peers.cc:597] T 99164e2d6f664ceab4d5921867d62c31 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:57.141139 31520 consensus_queue.cc:260] T 2971ad17262c4b5e8665700af97ec254 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
W20260709 12:13:57.147423 30750 leader_election.cc:336] T c52d3c5b6b15499e9c834cf33954609a P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111)
I20260709 12:13:57.147347 31532 leader_election.cc:290] T 615eb2fb16414287bc0956a27523b7f4 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 2 election: Requested vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:57.157354 30750 leader_election.cc:304] T c52d3c5b6b15499e9c834cf33954609a P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 84b98f9236604dd0b22ae23c5378a676; no voters: 15ad0880a63541ef965cb6acca4513d7, 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:57.162707 31344 raft_consensus.cc:2749] T c52d3c5b6b15499e9c834cf33954609a P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:57.162671 30750 leader_election.cc:336] T 745e2cea61c44c3a80bdc49add504a75 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111)
I20260709 12:13:57.156689 31544 raft_consensus.cc:493] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6c5665c17e904fc692bce76fc57b2460)
I20260709 12:13:57.166759 31544 raft_consensus.cc:3060] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:57.171797 30750 leader_election.cc:336] T 615eb2fb16414287bc0956a27523b7f4 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111)
I20260709 12:13:57.172318 30750 leader_election.cc:304] T 615eb2fb16414287bc0956a27523b7f4 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 84b98f9236604dd0b22ae23c5378a676; no voters: 6c5665c17e904fc692bce76fc57b2460, 8130e18710c04a61a5d8bd019c6ffdad
I20260709 12:13:57.173092 31344 raft_consensus.cc:2749] T 615eb2fb16414287bc0956a27523b7f4 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:57.173326 30750 leader_election.cc:336] T a0bb1498511242ef95085be49c10c4d3 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111)
W20260709 12:13:57.173992 30750 leader_election.cc:336] T 2ff9e0d905854cceb79f96f500a07339 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111)
I20260709 12:13:57.174304 30750 leader_election.cc:304] T 2ff9e0d905854cceb79f96f500a07339 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 84b98f9236604dd0b22ae23c5378a676; no voters: 15ad0880a63541ef965cb6acca4513d7, 6c5665c17e904fc692bce76fc57b2460
W20260709 12:13:57.177101 30898 consensus_peers.cc:597] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:57.179178 31530 raft_consensus.cc:2749] T 2ff9e0d905854cceb79f96f500a07339 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:57.180831 31544 raft_consensus.cc:515] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:57.183301 31544 leader_election.cc:290] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 election: Requested vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:57.161070 31538 consensus_queue.cc:1048] T cdf560ffbc0c4b8b80beb6494a13d9cd P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:13:57.185989 31527 raft_consensus.cc:515] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
W20260709 12:13:57.188755 30824 leader_election.cc:336] T 615eb2fb16414287bc0956a27523b7f4 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111)
I20260709 12:13:57.190492 31493 leader_election.cc:290] T 5d636204e40644318b4758f37c7b0474 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 election: Requested vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:57.192386 31536 raft_consensus.cc:515] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:57.193629 30856 raft_consensus.cc:2393] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 84b98f9236604dd0b22ae23c5378a676 in current term 3: Already voted for candidate 8130e18710c04a61a5d8bd019c6ffdad in this term.
I20260709 12:13:57.194733 31536 leader_election.cc:290] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 3 election: Requested vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:57.196341 31527 leader_election.cc:290] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 election: Requested vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
W20260709 12:13:57.198553 30750 leader_election.cc:336] T cdf560ffbc0c4b8b80beb6494a13d9cd P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111)
W20260709 12:13:57.199290 30898 leader_election.cc:336] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111)
W20260709 12:13:57.200274 30750 leader_election.cc:336] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111)
W20260709 12:13:57.209358 30898 leader_election.cc:336] T 5d636204e40644318b4758f37c7b0474 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111)
W20260709 12:13:57.210114 30898 leader_election.cc:336] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111)
I20260709 12:13:57.215018 31520 ts_tablet_manager.cc:1434] T 2971ad17262c4b5e8665700af97ec254 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.138s	user 0.019s	sys 0.000s
I20260709 12:13:57.216028 31520 tablet_bootstrap.cc:492] T 2ff9e0d905854cceb79f96f500a07339 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:57.229100 31555 raft_consensus.cc:515] T 2ff9e0d905854cceb79f96f500a07339 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
W20260709 12:13:57.212531 30750 leader_election.cc:336] T baedd172e30a4ef4a6641302fdebd9c5 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111)
I20260709 12:13:57.236214 30750 leader_election.cc:304] T baedd172e30a4ef4a6641302fdebd9c5 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 84b98f9236604dd0b22ae23c5378a676; no voters: 15ad0880a63541ef965cb6acca4513d7, 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:57.247695 31538 raft_consensus.cc:2749] T baedd172e30a4ef4a6641302fdebd9c5 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:57.248814 31572 raft_consensus.cc:493] T 3e0e49105b2d44f09c55f7cc603f9b91 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.249842 31555 leader_election.cc:290] T 2ff9e0d905854cceb79f96f500a07339 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 election: Requested vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:57.249521 31572 raft_consensus.cc:515] T 3e0e49105b2d44f09c55f7cc603f9b91 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:57.246183 30896 leader_election.cc:304] T 76d4dde0196948ef92f68df770af02b0 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7; no voters: 6c5665c17e904fc692bce76fc57b2460, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:57.266619 31555 raft_consensus.cc:2749] T 76d4dde0196948ef92f68df770af02b0 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:57.270606 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c52d3c5b6b15499e9c834cf33954609a" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:13:57.271294 30784 raft_consensus.cc:3060] T c52d3c5b6b15499e9c834cf33954609a P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:57.287777 30856 raft_consensus.cc:1275] T 1eb80935abae44bf8dde4d54961c5fdb P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Refusing update from remote peer 15ad0880a63541ef965cb6acca4513d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:13:57.311918 30750 leader_election.cc:336] T 0317908edb88497b82c4e59ef1bac414 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111)
W20260709 12:13:57.313079 30750 leader_election.cc:336] T 745e2cea61c44c3a80bdc49add504a75 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111)
W20260709 12:13:57.313783 30750 leader_election.cc:336] T a0bb1498511242ef95085be49c10c4d3 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111)
W20260709 12:13:57.314651 30750 leader_election.cc:336] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111)
I20260709 12:13:57.315177 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9e0d905854cceb79f96f500a07339" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
W20260709 12:13:57.315570 30824 leader_election.cc:336] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111)
I20260709 12:13:57.315941 30778 raft_consensus.cc:3060] T 2ff9e0d905854cceb79f96f500a07339 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:57.308707 31554 consensus_queue.cc:1048] T 1eb80935abae44bf8dde4d54961c5fdb P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:13:57.319448 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baedd172e30a4ef4a6641302fdebd9c5" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:13:57.320086 30783 raft_consensus.cc:3060] T baedd172e30a4ef4a6641302fdebd9c5 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:57.323092 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d636204e40644318b4758f37c7b0474" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:13:57.323695 30782 raft_consensus.cc:3060] T 5d636204e40644318b4758f37c7b0474 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:57.324035 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0317908edb88497b82c4e59ef1bac414" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:13:57.324862 30780 raft_consensus.cc:2393] T 0317908edb88497b82c4e59ef1bac414 P 84b98f9236604dd0b22ae23c5378a676 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8130e18710c04a61a5d8bd019c6ffdad in current term 3: Already voted for candidate 84b98f9236604dd0b22ae23c5378a676 in this term.
I20260709 12:13:57.328209 31572 leader_election.cc:290] T 3e0e49105b2d44f09c55f7cc603f9b91 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
W20260709 12:13:57.331053 30750 leader_election.cc:336] T 76d4dde0196948ef92f68df770af02b0 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111)
I20260709 12:13:57.335155 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "615eb2fb16414287bc0956a27523b7f4" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
W20260709 12:13:57.337741 30750 consensus_peers.cc:597] T 554acf71459c4e59b886396df52b3004 P 84b98f9236604dd0b22ae23c5378a676 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:57.339666 30750 leader_election.cc:336] T 0317908edb88497b82c4e59ef1bac414 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111)
I20260709 12:13:57.347095 30750 leader_election.cc:304] T 0317908edb88497b82c4e59ef1bac414 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 84b98f9236604dd0b22ae23c5378a676; no voters: 6c5665c17e904fc692bce76fc57b2460, 8130e18710c04a61a5d8bd019c6ffdad
I20260709 12:13:57.350849 30822 leader_election.cc:304] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad; no voters: 6c5665c17e904fc692bce76fc57b2460, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:57.339883 30779 raft_consensus.cc:3060] T 615eb2fb16414287bc0956a27523b7f4 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:57.348065 30604 catalog_manager.cc:5697] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 84b98f9236604dd0b22ae23c5378a676 reported cstate change: term changed from 1 to 2, leader changed from 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129) to 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130). New cstate: current_term: 2 leader_uuid: "84b98f9236604dd0b22ae23c5378a676" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:57.361080 31520 tablet_bootstrap.cc:492] T 2ff9e0d905854cceb79f96f500a07339 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:57.354713 30604 catalog_manager.cc:5697] T a0bb1498511242ef95085be49c10c4d3 P 84b98f9236604dd0b22ae23c5378a676 reported cstate change: term changed from 1 to 2, leader changed from 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129) to 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130). New cstate: current_term: 2 leader_uuid: "84b98f9236604dd0b22ae23c5378a676" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:57.362455 30604 catalog_manager.cc:5697] T 745e2cea61c44c3a80bdc49add504a75 P 84b98f9236604dd0b22ae23c5378a676 reported cstate change: term changed from 1 to 2, leader changed from 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129) to 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130). New cstate: current_term: 2 leader_uuid: "84b98f9236604dd0b22ae23c5378a676" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:57.364173 31520 tablet_bootstrap.cc:492] T 2ff9e0d905854cceb79f96f500a07339 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap complete.
I20260709 12:13:57.367209 31520 ts_tablet_manager.cc:1403] T 2ff9e0d905854cceb79f96f500a07339 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.151s	user 0.018s	sys 0.022s
I20260709 12:13:57.363269 30782 raft_consensus.cc:2468] T 5d636204e40644318b4758f37c7b0474 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 2.
I20260709 12:13:57.373152 30896 leader_election.cc:304] T 5d636204e40644318b4758f37c7b0474 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676; no voters: 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:57.376945 31554 raft_consensus.cc:2804] T 5d636204e40644318b4758f37c7b0474 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:57.377436 31554 raft_consensus.cc:697] T 5d636204e40644318b4758f37c7b0474 P 15ad0880a63541ef965cb6acca4513d7 [term 2 LEADER]: Becoming Leader. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Running, Role: LEADER
I20260709 12:13:57.377918 31520 raft_consensus.cc:359] T 2ff9e0d905854cceb79f96f500a07339 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:57.378226 30778 raft_consensus.cc:2468] T 2ff9e0d905854cceb79f96f500a07339 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 2.
I20260709 12:13:57.378647 31520 raft_consensus.cc:740] T 2ff9e0d905854cceb79f96f500a07339 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:57.354926 31550 raft_consensus.cc:2749] T 0317908edb88497b82c4e59ef1bac414 P 84b98f9236604dd0b22ae23c5378a676 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:57.381707 30896 leader_election.cc:304] T 2ff9e0d905854cceb79f96f500a07339 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676; no voters: 
W20260709 12:13:57.383028 30750 consensus_peers.cc:597] T cdf560ffbc0c4b8b80beb6494a13d9cd P 84b98f9236604dd0b22ae23c5378a676 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:57.366432 31535 raft_consensus.cc:2749] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:57.385246 31520 consensus_queue.cc:260] T 2ff9e0d905854cceb79f96f500a07339 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
W20260709 12:13:57.386163 30898 consensus_peers.cc:597] T 671d30cec67d47a89e8ec6fab0c53c48 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:57.388425 30898 leader_election.cc:336] T 2ff9e0d905854cceb79f96f500a07339 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111)
W20260709 12:13:57.392258 30750 leader_election.cc:336] T 76d4dde0196948ef92f68df770af02b0 P 84b98f9236604dd0b22ae23c5378a676 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111)
I20260709 12:13:57.393604 30604 catalog_manager.cc:5697] T 76d4dde0196948ef92f68df770af02b0 P 84b98f9236604dd0b22ae23c5378a676 reported cstate change: term changed from 1 to 2, leader changed from 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129) to 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130). New cstate: current_term: 2 leader_uuid: "84b98f9236604dd0b22ae23c5378a676" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:57.395637 31520 ts_tablet_manager.cc:1434] T 2ff9e0d905854cceb79f96f500a07339 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
W20260709 12:13:57.397994 30750 consensus_peers.cc:597] T c5afc0720ca546d8b13026e7c7a30c1e P 84b98f9236604dd0b22ae23c5378a676 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:57.398959 30898 consensus_peers.cc:597] T 34e3009dd96f4545b2abe325ac95e960 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:57.399471 30898 consensus_peers.cc:597] T 660d2eb6dd3f4e96aab252cfd980be89 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:57.384122 31479 raft_consensus.cc:2804] T 2ff9e0d905854cceb79f96f500a07339 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:57.404912 31479 raft_consensus.cc:697] T 2ff9e0d905854cceb79f96f500a07339 P 15ad0880a63541ef965cb6acca4513d7 [term 2 LEADER]: Becoming Leader. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Running, Role: LEADER
I20260709 12:13:57.405781 31479 consensus_queue.cc:237] T 2ff9e0d905854cceb79f96f500a07339 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:57.378278 31554 consensus_queue.cc:237] T 5d636204e40644318b4758f37c7b0474 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:57.404541 30605 catalog_manager.cc:5697] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7 reported cstate change: term changed from 1 to 2, leader changed from 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129) to 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132). New cstate: current_term: 2 leader_uuid: "15ad0880a63541ef965cb6acca4513d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:57.424185 31576 raft_consensus.cc:493] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.424847 31576 raft_consensus.cc:515] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
W20260709 12:13:57.428629 30750 consensus_peers.cc:597] T 0203e5cc33ca470eb9c1f366291c344d P 84b98f9236604dd0b22ae23c5378a676 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:57.429281 30784 raft_consensus.cc:2468] T c52d3c5b6b15499e9c834cf33954609a P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 2.
I20260709 12:13:57.404567 30783 raft_consensus.cc:2468] T baedd172e30a4ef4a6641302fdebd9c5 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 2.
I20260709 12:13:57.440369 30896 leader_election.cc:304] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676; no voters: 6c5665c17e904fc692bce76fc57b2460
W20260709 12:13:57.440727 30824 consensus_peers.cc:597] T 8c580512b11742d4977ff026ff8fc795 P 8130e18710c04a61a5d8bd019c6ffdad -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:57.441251 30824 consensus_peers.cc:597] T bb358c4df82f4168bc1debdfc4e7aa9c P 8130e18710c04a61a5d8bd019c6ffdad -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:57.446817 30896 leader_election.cc:304] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676; no voters: 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:57.454073 30929 raft_consensus.cc:1275] T bb358c4df82f4168bc1debdfc4e7aa9c P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Refusing update from remote peer 8130e18710c04a61a5d8bd019c6ffdad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:57.444418 31493 raft_consensus.cc:2804] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:57.453608 31544 raft_consensus.cc:2804] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:57.461926 31493 raft_consensus.cc:697] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7 [term 2 LEADER]: Becoming Leader. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Running, Role: LEADER
I20260709 12:13:57.460058 31576 leader_election.cc:290] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:57.474571 31493 consensus_queue.cc:237] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:57.482177 30779 raft_consensus.cc:2468] T 615eb2fb16414287bc0956a27523b7f4 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 2.
I20260709 12:13:57.483906 30822 leader_election.cc:304] T 615eb2fb16414287bc0956a27523b7f4 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676; no voters: 6c5665c17e904fc692bce76fc57b2460
W20260709 12:13:57.485551 30898 consensus_peers.cc:597] T fa9f00939aba452180334d67a6d33010 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:57.486205 31520 tablet_bootstrap.cc:492] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
W20260709 12:13:57.489821 30824 consensus_peers.cc:597] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 8130e18710c04a61a5d8bd019c6ffdad -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:57.460634 31532 consensus_queue.cc:1048] T bb358c4df82f4168bc1debdfc4e7aa9c P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Connected to new peer: Peer: permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:13:57.475200 31544 raft_consensus.cc:697] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7 [term 2 LEADER]: Becoming Leader. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Running, Role: LEADER
I20260709 12:13:57.494825 31544 consensus_queue.cc:237] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:57.504503 31576 raft_consensus.cc:493] T a3ffdffa995943d28fc038fce9198caf P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.505322 30929 raft_consensus.cc:1275] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Refusing update from remote peer 84b98f9236604dd0b22ae23c5378a676: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:57.505151 31576 raft_consensus.cc:515] T a3ffdffa995943d28fc038fce9198caf P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:57.513582 31576 leader_election.cc:290] T a3ffdffa995943d28fc038fce9198caf P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
W20260709 12:13:57.514688 30898 consensus_peers.cc:597] T 32c211a79de247c8b5cef16a2d0a4dcb P 15ad0880a63541ef965cb6acca4513d7 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:57.515290 30898 consensus_peers.cc:597] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:57.490633 31536 raft_consensus.cc:2804] T 615eb2fb16414287bc0956a27523b7f4 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:57.519205 31536 raft_consensus.cc:697] T 615eb2fb16414287bc0956a27523b7f4 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 LEADER]: Becoming Leader. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Running, Role: LEADER
I20260709 12:13:57.520198 31536 consensus_queue.cc:237] T 615eb2fb16414287bc0956a27523b7f4 P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:57.555305 30857 raft_consensus.cc:1275] T fd65967534164e9c805fc3d5d05e0369 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Refusing update from remote peer 15ad0880a63541ef965cb6acca4513d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:57.526746 31491 consensus_queue.cc:1048] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
W20260709 12:13:57.557397 30750 consensus_peers.cc:597] T 3e0e49105b2d44f09c55f7cc603f9b91 P 84b98f9236604dd0b22ae23c5378a676 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:57.557920 30750 consensus_peers.cc:597] T e57ee667f8a246eb98ab6b169eb779b9 P 84b98f9236604dd0b22ae23c5378a676 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:57.558292 30750 consensus_peers.cc:597] T a3ffdffa995943d28fc038fce9198caf P 84b98f9236604dd0b22ae23c5378a676 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:57.558854 30824 consensus_peers.cc:597] T 2971ad17262c4b5e8665700af97ec254 P 8130e18710c04a61a5d8bd019c6ffdad -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:57.559373 30824 consensus_peers.cc:597] T 21c0ba9bb1d64ab398c606450f72e966 P 8130e18710c04a61a5d8bd019c6ffdad -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:57.579222 30856 raft_consensus.cc:1275] T 745e2cea61c44c3a80bdc49add504a75 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Refusing update from remote peer 84b98f9236604dd0b22ae23c5378a676: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:57.575153 31576 raft_consensus.cc:493] T a6a5bd717fa048aabdd0879bcea0fd60 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:57.608546 30823 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:43035, user_credentials={real_user=slave}} blocked reactor thread for 47119.3us
I20260709 12:13:57.606277 31344 consensus_queue.cc:1048] T 745e2cea61c44c3a80bdc49add504a75 P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:57.625025 31556 consensus_queue.cc:1048] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:57.613221 31576 raft_consensus.cc:515] T a6a5bd717fa048aabdd0879bcea0fd60 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:57.638633 31576 leader_election.cc:290] T a6a5bd717fa048aabdd0879bcea0fd60 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:57.650205 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b66a7b6f8aa4803b482e392cc945db7" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
W20260709 12:13:57.651995 30898 consensus_peers.cc:597] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:57.653486 30924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a5bd717fa048aabdd0879bcea0fd60" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:57.654223 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e0e49105b2d44f09c55f7cc603f9b91" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:57.662310 31520 tablet_bootstrap.cc:492] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:57.655385 30930 raft_consensus.cc:1275] T 76d4dde0196948ef92f68df770af02b0 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Refusing update from remote peer 84b98f9236604dd0b22ae23c5378a676: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:57.655263 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a5bd717fa048aabdd0879bcea0fd60" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
W20260709 12:13:57.658804 30750 consensus_peers.cc:597] T 76d4dde0196948ef92f68df770af02b0 P 84b98f9236604dd0b22ae23c5378a676 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:57.655061 30925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b66a7b6f8aa4803b482e392cc945db7" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
W20260709 12:13:57.663352 30750 consensus_peers.cc:597] T 745e2cea61c44c3a80bdc49add504a75 P 84b98f9236604dd0b22ae23c5378a676 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:57.667672 30748 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:42179, user_credentials={real_user=slave}} blocked reactor thread for 61788.2us
I20260709 12:13:57.656080 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3ffdffa995943d28fc038fce9198caf" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:57.684532 31520 tablet_bootstrap.cc:492] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460: Bootstrap complete.
I20260709 12:13:57.685619 31520 ts_tablet_manager.cc:1403] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.210s	user 0.026s	sys 0.011s
I20260709 12:13:57.662694 31576 raft_consensus.cc:493] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.699628 30855 raft_consensus.cc:1275] T a0bb1498511242ef95085be49c10c4d3 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Refusing update from remote peer 84b98f9236604dd0b22ae23c5378a676: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:13:57.709563 30824 consensus_peers.cc:597] T a6a5bd717fa048aabdd0879bcea0fd60 P 8130e18710c04a61a5d8bd019c6ffdad -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:57.718312 31344 consensus_queue.cc:1048] T 76d4dde0196948ef92f68df770af02b0 P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:57.711046 30607 catalog_manager.cc:5697] T 615eb2fb16414287bc0956a27523b7f4 P 8130e18710c04a61a5d8bd019c6ffdad reported cstate change: term changed from 1 to 2, leader changed from 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129) to 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131). New cstate: current_term: 2 leader_uuid: "8130e18710c04a61a5d8bd019c6ffdad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:57.709142 31516 leader_election.cc:304] T a6a5bd717fa048aabdd0879bcea0fd60 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460; no voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad
I20260709 12:13:57.737623 31516 leader_election.cc:304] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460; no voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad
I20260709 12:13:57.739599 31520 raft_consensus.cc:359] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:57.741642 31520 raft_consensus.cc:740] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:57.745223 31520 consensus_queue.cc:260] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:57.709738 31576 raft_consensus.cc:515] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:57.745463 31572 raft_consensus.cc:2749] T a6a5bd717fa048aabdd0879bcea0fd60 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:57.824869 30823 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:43035, user_credentials={real_user=slave}} blocked reactor thread for 211443us
W20260709 12:13:57.828306 30750 consensus_peers.cc:597] T a0bb1498511242ef95085be49c10c4d3 P 84b98f9236604dd0b22ae23c5378a676 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:57.833168 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.129:40909, user_credentials={real_user=slave}} blocked reactor thread for 62761.1us
W20260709 12:13:57.833904 30750 consensus_peers.cc:597] T b9cc9d529de24234b98ed5e152fd4b24 P 84b98f9236604dd0b22ae23c5378a676 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:57.839191 30896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:42179, user_credentials={real_user=slave}} blocked reactor thread for 84015.9us
I20260709 12:13:57.845520 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3ffdffa995943d28fc038fce9198caf" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:57.846012 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e0e49105b2d44f09c55f7cc603f9b91" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:57.853418 31610 raft_consensus.cc:2749] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:57.875981 31520 ts_tablet_manager.cc:1434] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.190s	user 0.011s	sys 0.011s
I20260709 12:13:57.884339 31520 tablet_bootstrap.cc:492] T 2cf56cf233cc48a5a720300bc769fa6a P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
W20260709 12:13:57.894629 30823 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.132:43035, user_credentials={real_user=slave}} blocked reactor thread for 46177.8us
W20260709 12:13:57.903352 31607 log.cc:927] Time spent T 745e2cea61c44c3a80bdc49add504a75 P 8130e18710c04a61a5d8bd019c6ffdad: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:13:57.904420 31550 consensus_queue.cc:1048] T a0bb1498511242ef95085be49c10c4d3 P 84b98f9236604dd0b22ae23c5378a676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:57.907236 31576 leader_election.cc:290] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
W20260709 12:13:57.910534 30898 consensus_peers.cc:597] T a4b7489c1b104bf2bb461bcdca7e6f42 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:57.911067 30898 consensus_peers.cc:597] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:57.944034 30750 consensus_peers.cc:597] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 84b98f9236604dd0b22ae23c5378a676 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:57.952972 31515 leader_election.cc:304] T a3ffdffa995943d28fc038fce9198caf P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460; no voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676
W20260709 12:13:57.954183 31515 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:40083, user_credentials={real_user=slave}} blocked reactor thread for 70296.7us
I20260709 12:13:57.955029 31515 leader_election.cc:304] T 3e0e49105b2d44f09c55f7cc603f9b91 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460; no voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:57.956632 31576 raft_consensus.cc:2749] T a3ffdffa995943d28fc038fce9198caf P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:57.957487 30896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:40083, user_credentials={real_user=slave}} blocked reactor thread for 45017.3us
I20260709 12:13:57.965991 31612 raft_consensus.cc:2749] T 3e0e49105b2d44f09c55f7cc603f9b91 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:57.967353 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c52d3c5b6b15499e9c834cf33954609a" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:57.968194 30780 raft_consensus.cc:2393] T c52d3c5b6b15499e9c834cf33954609a P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c5665c17e904fc692bce76fc57b2460 in current term 2: Already voted for candidate 15ad0880a63541ef965cb6acca4513d7 in this term.
W20260709 12:13:57.974896 30750 consensus_peers.cc:597] T eb58d3a8bd8540ff9871ea41021a5025 P 84b98f9236604dd0b22ae23c5378a676 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:58.014009 30898 consensus_peers.cc:597] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:58.014668 30898 consensus_peers.cc:597] T 2ff9e0d905854cceb79f96f500a07339 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:58.016585 30824 consensus_peers.cc:597] T 615eb2fb16414287bc0956a27523b7f4 P 8130e18710c04a61a5d8bd019c6ffdad -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:58.036983 30784 raft_consensus.cc:1275] T 615eb2fb16414287bc0956a27523b7f4 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Refusing update from remote peer 8130e18710c04a61a5d8bd019c6ffdad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:58.065061 30605 catalog_manager.cc:5697] T 5d636204e40644318b4758f37c7b0474 P 15ad0880a63541ef965cb6acca4513d7 reported cstate change: term changed from 1 to 2, leader changed from 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129) to 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132). New cstate: current_term: 2 leader_uuid: "15ad0880a63541ef965cb6acca4513d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:58.067833 30605 catalog_manager.cc:5697] T 2ff9e0d905854cceb79f96f500a07339 P 15ad0880a63541ef965cb6acca4513d7 reported cstate change: term changed from 1 to 2, leader changed from 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129) to 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132). New cstate: current_term: 2 leader_uuid: "15ad0880a63541ef965cb6acca4513d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:58.033273 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c52d3c5b6b15499e9c834cf33954609a" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:58.071138 30784 raft_consensus.cc:1275] T 2ff9e0d905854cceb79f96f500a07339 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Refusing update from remote peer 15ad0880a63541ef965cb6acca4513d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:58.071508 30780 raft_consensus.cc:1275] T 5d636204e40644318b4758f37c7b0474 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Refusing update from remote peer 15ad0880a63541ef965cb6acca4513d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:58.068936 30605 catalog_manager.cc:5697] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7 reported cstate change: term changed from 1 to 2, leader changed from 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129) to 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132). New cstate: current_term: 2 leader_uuid: "15ad0880a63541ef965cb6acca4513d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:58.073791 30605 catalog_manager.cc:5697] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7 reported cstate change: term changed from 1 to 2, leader changed from 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129) to 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132). New cstate: current_term: 2 leader_uuid: "15ad0880a63541ef965cb6acca4513d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:58.060106 31612 raft_consensus.cc:493] T c449839430794851b61ffba23f946c4f P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.092563 30780 raft_consensus.cc:1275] T c52d3c5b6b15499e9c834cf33954609a P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Refusing update from remote peer 15ad0880a63541ef965cb6acca4513d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:58.101677 31576 raft_consensus.cc:493] T eb58d3a8bd8540ff9871ea41021a5025 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.102996 31576 raft_consensus.cc:515] T eb58d3a8bd8540ff9871ea41021a5025 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:58.105302 31576 leader_election.cc:290] T eb58d3a8bd8540ff9871ea41021a5025 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:58.105336 31606 consensus_queue.cc:1048] T 615eb2fb16414287bc0956a27523b7f4 P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Connected to new peer: Peer: permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:58.089785 31612 raft_consensus.cc:515] T c449839430794851b61ffba23f946c4f P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:58.109062 31612 leader_election.cc:290] T c449839430794851b61ffba23f946c4f P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:58.116079 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c449839430794851b61ffba23f946c4f" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:58.119321 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb58d3a8bd8540ff9871ea41021a5025" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
W20260709 12:13:58.124626 30750 consensus_peers.cc:597] T f351526ad9564be4be05825c266794c7 P 84b98f9236604dd0b22ae23c5378a676 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:58.125686 31545 consensus_queue.cc:1048] T 5d636204e40644318b4758f37c7b0474 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:58.126070 31544 consensus_queue.cc:1048] T 2ff9e0d905854cceb79f96f500a07339 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:13:58.129402 30898 consensus_peers.cc:597] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:58.130827 30898 consensus_peers.cc:597] T 5d636204e40644318b4758f37c7b0474 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:58.125734 31516 leader_election.cc:304] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460; no voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:58.129217 31554 consensus_queue.cc:1048] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:13:58.144287 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb58d3a8bd8540ff9871ea41021a5025" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:58.144685 31612 raft_consensus.cc:3060] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:58.149060 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c449839430794851b61ffba23f946c4f" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:58.170550 30777 raft_consensus.cc:1275] T baedd172e30a4ef4a6641302fdebd9c5 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Refusing update from remote peer 15ad0880a63541ef965cb6acca4513d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:58.177971 31576 raft_consensus.cc:493] T 554acf71459c4e59b886396df52b3004 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.178515 31576 raft_consensus.cc:515] T 554acf71459c4e59b886396df52b3004 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:58.180593 31576 leader_election.cc:290] T 554acf71459c4e59b886396df52b3004 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:13:58.185545 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554acf71459c4e59b886396df52b3004" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:58.197484 31612 raft_consensus.cc:2749] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:58.199172 31515 leader_election.cc:304] T eb58d3a8bd8540ff9871ea41021a5025 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460; no voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:58.200520 31576 raft_consensus.cc:2749] T eb58d3a8bd8540ff9871ea41021a5025 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:58.214571 31515 leader_election.cc:304] T c449839430794851b61ffba23f946c4f P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460; no voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:58.226696 31612 raft_consensus.cc:2749] T c449839430794851b61ffba23f946c4f P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:58.231626 31554 consensus_queue.cc:1048] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:58.250636 31520 tablet_bootstrap.cc:492] T 2cf56cf233cc48a5a720300bc769fa6a P 6c5665c17e904fc692bce76fc57b2460: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:58.251760 31520 tablet_bootstrap.cc:492] T 2cf56cf233cc48a5a720300bc769fa6a P 6c5665c17e904fc692bce76fc57b2460: Bootstrap complete.
I20260709 12:13:58.252664 31520 ts_tablet_manager.cc:1403] T 2cf56cf233cc48a5a720300bc769fa6a P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.376s	user 0.027s	sys 0.009s
W20260709 12:13:58.255648 30750 consensus_peers.cc:597] T 2cf56cf233cc48a5a720300bc769fa6a P 84b98f9236604dd0b22ae23c5378a676 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:58.256155 30750 consensus_peers.cc:597] T f0fbdcbe46b34107bbbf63f69c98e244 P 84b98f9236604dd0b22ae23c5378a676 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:58.256701 30750 consensus_peers.cc:597] T 56a566949cf345d08d43f13ccff4be37 P 84b98f9236604dd0b22ae23c5378a676 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:58.257535 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554acf71459c4e59b886396df52b3004" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:58.259708 31520 raft_consensus.cc:359] T 2cf56cf233cc48a5a720300bc769fa6a P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:58.263412 31515 leader_election.cc:304] T 554acf71459c4e59b886396df52b3004 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460; no voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:58.263777 31520 raft_consensus.cc:740] T 2cf56cf233cc48a5a720300bc769fa6a P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:58.264842 31520 consensus_queue.cc:260] T 2cf56cf233cc48a5a720300bc769fa6a P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:58.267582 31612 raft_consensus.cc:2749] T 554acf71459c4e59b886396df52b3004 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:58.293095 31520 ts_tablet_manager.cc:1434] T 2cf56cf233cc48a5a720300bc769fa6a P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
W20260709 12:13:58.294803 30750 consensus_peers.cc:597] T ec7d33fd7f3245f68966bd7749ee53c3 P 84b98f9236604dd0b22ae23c5378a676 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:58.295894 31520 tablet_bootstrap.cc:492] T 99164e2d6f664ceab4d5921867d62c31 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:58.368124 31520 tablet_bootstrap.cc:492] T 99164e2d6f664ceab4d5921867d62c31 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:58.369083 31520 tablet_bootstrap.cc:492] T 99164e2d6f664ceab4d5921867d62c31 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap complete.
I20260709 12:13:58.369704 31520 ts_tablet_manager.cc:1403] T 99164e2d6f664ceab4d5921867d62c31 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.074s	user 0.032s	sys 0.025s
I20260709 12:13:58.376669 31520 raft_consensus.cc:359] T 99164e2d6f664ceab4d5921867d62c31 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:58.377183 31520 raft_consensus.cc:740] T 99164e2d6f664ceab4d5921867d62c31 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:58.377802 31520 consensus_queue.cc:260] T 99164e2d6f664ceab4d5921867d62c31 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:58.379748 31520 ts_tablet_manager.cc:1434] T 99164e2d6f664ceab4d5921867d62c31 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:13:58.380389 31520 tablet_bootstrap.cc:492] T fa9f00939aba452180334d67a6d33010 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:58.394822 31520 tablet_bootstrap.cc:492] T fa9f00939aba452180334d67a6d33010 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:58.396256 31520 tablet_bootstrap.cc:492] T fa9f00939aba452180334d67a6d33010 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap complete.
I20260709 12:13:58.397222 31520 ts_tablet_manager.cc:1403] T fa9f00939aba452180334d67a6d33010 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.005s
I20260709 12:13:58.398926 31612 raft_consensus.cc:493] T 2971ad17262c4b5e8665700af97ec254 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.399505 31612 raft_consensus.cc:515] T 2971ad17262c4b5e8665700af97ec254 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:58.401691 31612 leader_election.cc:290] T 2971ad17262c4b5e8665700af97ec254 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:13:58.403062 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2971ad17262c4b5e8665700af97ec254" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:58.404135 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2971ad17262c4b5e8665700af97ec254" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad" is_pre_election: true
I20260709 12:13:58.404848 31520 raft_consensus.cc:359] T fa9f00939aba452180334d67a6d33010 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:58.405644 31515 leader_election.cc:304] T 2971ad17262c4b5e8665700af97ec254 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460; no voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad
I20260709 12:13:58.405895 31520 raft_consensus.cc:740] T fa9f00939aba452180334d67a6d33010 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:58.406937 31612 raft_consensus.cc:2749] T 2971ad17262c4b5e8665700af97ec254 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:58.406847 31520 consensus_queue.cc:260] T fa9f00939aba452180334d67a6d33010 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:58.409200 31520 ts_tablet_manager.cc:1434] T fa9f00939aba452180334d67a6d33010 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:13:58.410094 31520 tablet_bootstrap.cc:492] T ec7d33fd7f3245f68966bd7749ee53c3 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:58.469045 31520 tablet_bootstrap.cc:492] T ec7d33fd7f3245f68966bd7749ee53c3 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:58.469986 31520 tablet_bootstrap.cc:492] T ec7d33fd7f3245f68966bd7749ee53c3 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap complete.
I20260709 12:13:58.470611 31520 ts_tablet_manager.cc:1403] T ec7d33fd7f3245f68966bd7749ee53c3 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.061s	user 0.022s	sys 0.019s
I20260709 12:13:58.473080 31520 raft_consensus.cc:359] T ec7d33fd7f3245f68966bd7749ee53c3 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:58.473748 31520 raft_consensus.cc:740] T ec7d33fd7f3245f68966bd7749ee53c3 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:58.474408 31520 consensus_queue.cc:260] T ec7d33fd7f3245f68966bd7749ee53c3 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:58.476321 31520 ts_tablet_manager.cc:1434] T ec7d33fd7f3245f68966bd7749ee53c3 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:13:58.476951 31520 tablet_bootstrap.cc:492] T 32c211a79de247c8b5cef16a2d0a4dcb P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:58.532615 31520 tablet_bootstrap.cc:492] T 32c211a79de247c8b5cef16a2d0a4dcb P 6c5665c17e904fc692bce76fc57b2460: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:58.533623 31520 tablet_bootstrap.cc:492] T 32c211a79de247c8b5cef16a2d0a4dcb P 6c5665c17e904fc692bce76fc57b2460: Bootstrap complete.
I20260709 12:13:58.534494 31520 ts_tablet_manager.cc:1403] T 32c211a79de247c8b5cef16a2d0a4dcb P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.058s	user 0.015s	sys 0.000s
I20260709 12:13:58.543748 31520 raft_consensus.cc:359] T 32c211a79de247c8b5cef16a2d0a4dcb P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:58.544521 31520 raft_consensus.cc:740] T 32c211a79de247c8b5cef16a2d0a4dcb P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:58.545379 31520 consensus_queue.cc:260] T 32c211a79de247c8b5cef16a2d0a4dcb P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:58.555507 31520 ts_tablet_manager.cc:1434] T 32c211a79de247c8b5cef16a2d0a4dcb P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.003s
I20260709 12:13:58.559291 31520 tablet_bootstrap.cc:492] T a4b7489c1b104bf2bb461bcdca7e6f42 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:58.589730 31520 tablet_bootstrap.cc:492] T a4b7489c1b104bf2bb461bcdca7e6f42 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:58.590715 31520 tablet_bootstrap.cc:492] T a4b7489c1b104bf2bb461bcdca7e6f42 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap complete.
I20260709 12:13:58.591415 31520 ts_tablet_manager.cc:1403] T a4b7489c1b104bf2bb461bcdca7e6f42 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.006s
I20260709 12:13:58.607232 31520 raft_consensus.cc:359] T a4b7489c1b104bf2bb461bcdca7e6f42 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:58.607939 31520 raft_consensus.cc:740] T a4b7489c1b104bf2bb461bcdca7e6f42 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:58.609201 31520 consensus_queue.cc:260] T a4b7489c1b104bf2bb461bcdca7e6f42 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:58.611537 31520 ts_tablet_manager.cc:1434] T a4b7489c1b104bf2bb461bcdca7e6f42 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:13:58.612294 31520 tablet_bootstrap.cc:492] T 0203e5cc33ca470eb9c1f366291c344d P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:58.621876 31612 raft_consensus.cc:493] T 2ff9e0d905854cceb79f96f500a07339 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.622555 31612 raft_consensus.cc:515] T 2ff9e0d905854cceb79f96f500a07339 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:58.625142 31612 leader_election.cc:290] T 2ff9e0d905854cceb79f96f500a07339 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:58.626204 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9e0d905854cceb79f96f500a07339" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "15ad0880a63541ef965cb6acca4513d7" is_pre_election: true
I20260709 12:13:58.631768 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9e0d905854cceb79f96f500a07339" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:58.636036 31515 leader_election.cc:304] T 2ff9e0d905854cceb79f96f500a07339 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460; no voters: 15ad0880a63541ef965cb6acca4513d7, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:13:58.637477 31612 raft_consensus.cc:2749] T 2ff9e0d905854cceb79f96f500a07339 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:58.685002 31520 tablet_bootstrap.cc:492] T 0203e5cc33ca470eb9c1f366291c344d P 6c5665c17e904fc692bce76fc57b2460: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:58.687181 31520 tablet_bootstrap.cc:492] T 0203e5cc33ca470eb9c1f366291c344d P 6c5665c17e904fc692bce76fc57b2460: Bootstrap complete.
I20260709 12:13:58.688020 31520 ts_tablet_manager.cc:1403] T 0203e5cc33ca470eb9c1f366291c344d P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.076s	user 0.012s	sys 0.010s
I20260709 12:13:58.690936 31520 raft_consensus.cc:359] T 0203e5cc33ca470eb9c1f366291c344d P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:58.691689 31520 raft_consensus.cc:740] T 0203e5cc33ca470eb9c1f366291c344d P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:58.692521 31520 consensus_queue.cc:260] T 0203e5cc33ca470eb9c1f366291c344d P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:58.694852 31520 ts_tablet_manager.cc:1434] T 0203e5cc33ca470eb9c1f366291c344d P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:13:58.695706 31520 tablet_bootstrap.cc:492] T f351526ad9564be4be05825c266794c7 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:58.712749 31520 tablet_bootstrap.cc:492] T f351526ad9564be4be05825c266794c7 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:58.713742 31520 tablet_bootstrap.cc:492] T f351526ad9564be4be05825c266794c7 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap complete.
I20260709 12:13:58.714404 31520 ts_tablet_manager.cc:1403] T f351526ad9564be4be05825c266794c7 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.000s
I20260709 12:13:58.717001 31520 raft_consensus.cc:359] T f351526ad9564be4be05825c266794c7 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:58.717724 31520 raft_consensus.cc:740] T f351526ad9564be4be05825c266794c7 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:58.718616 31520 consensus_queue.cc:260] T f351526ad9564be4be05825c266794c7 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:58.720911 31520 ts_tablet_manager.cc:1434] T f351526ad9564be4be05825c266794c7 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 12:13:58.721733 31520 tablet_bootstrap.cc:492] T 8c580512b11742d4977ff026ff8fc795 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:58.770493 31520 tablet_bootstrap.cc:492] T 8c580512b11742d4977ff026ff8fc795 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:58.771802 31520 tablet_bootstrap.cc:492] T 8c580512b11742d4977ff026ff8fc795 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap complete.
I20260709 12:13:58.772413 31520 ts_tablet_manager.cc:1403] T 8c580512b11742d4977ff026ff8fc795 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.051s	user 0.028s	sys 0.016s
I20260709 12:13:58.774816 31520 raft_consensus.cc:359] T 8c580512b11742d4977ff026ff8fc795 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:58.775493 31520 raft_consensus.cc:740] T 8c580512b11742d4977ff026ff8fc795 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:58.776273 31520 consensus_queue.cc:260] T 8c580512b11742d4977ff026ff8fc795 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:58.778302 31520 ts_tablet_manager.cc:1434] T 8c580512b11742d4977ff026ff8fc795 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:13:58.778448 21266 rpc_server.cc:307] RPC server started. Bound to: 127.20.196.129:40909
I20260709 12:13:58.778694 31679 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.196.129:40909 every 8 connection(s)
I20260709 12:13:58.779196 31520 tablet_bootstrap.cc:492] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:58.822710 31520 tablet_bootstrap.cc:492] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:58.824051 31520 tablet_bootstrap.cc:492] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap complete.
I20260709 12:13:58.824767 31520 ts_tablet_manager.cc:1403] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.046s	user 0.029s	sys 0.008s
I20260709 12:13:58.829062 31520 raft_consensus.cc:359] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:58.829731 31520 raft_consensus.cc:740] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:58.830384 31520 consensus_queue.cc:260] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:58.832124 31520 ts_tablet_manager.cc:1434] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:13:58.832914 31520 tablet_bootstrap.cc:492] T bb358c4df82f4168bc1debdfc4e7aa9c P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:58.908639 31520 tablet_bootstrap.cc:492] T bb358c4df82f4168bc1debdfc4e7aa9c P 6c5665c17e904fc692bce76fc57b2460: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:58.909677 31520 tablet_bootstrap.cc:492] T bb358c4df82f4168bc1debdfc4e7aa9c P 6c5665c17e904fc692bce76fc57b2460: Bootstrap complete.
I20260709 12:13:58.911520 31520 ts_tablet_manager.cc:1403] T bb358c4df82f4168bc1debdfc4e7aa9c P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.079s	user 0.033s	sys 0.009s
I20260709 12:13:58.914342 31520 raft_consensus.cc:359] T bb358c4df82f4168bc1debdfc4e7aa9c P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:58.915145 31520 raft_consensus.cc:740] T bb358c4df82f4168bc1debdfc4e7aa9c P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:58.916085 31520 consensus_queue.cc:260] T bb358c4df82f4168bc1debdfc4e7aa9c P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:58.918812 31520 ts_tablet_manager.cc:1434] T bb358c4df82f4168bc1debdfc4e7aa9c P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:13:58.919912 31520 tablet_bootstrap.cc:492] T 76d4dde0196948ef92f68df770af02b0 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:58.926137 31649 raft_consensus.cc:3060] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:58.927887 31532 raft_consensus.cc:493] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.928449 31532 raft_consensus.cc:515] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:58.931749 31647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0317908edb88497b82c4e59ef1bac414" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460" is_pre_election: true
W20260709 12:13:58.933323 30824 leader_election.cc:343] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 4 pre-election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:58.936736 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0317908edb88497b82c4e59ef1bac414" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676" is_pre_election: true
I20260709 12:13:58.937389 30778 raft_consensus.cc:2468] T 0317908edb88497b82c4e59ef1bac414 P 84b98f9236604dd0b22ae23c5378a676 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 3.
I20260709 12:13:58.938585 30822 leader_election.cc:304] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676; no voters: 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:58.939404 31691 raft_consensus.cc:2804] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:58.939577 31647 raft_consensus.cc:3060] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:58.939837 31691 raft_consensus.cc:493] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:58.940243 31691 raft_consensus.cc:3060] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:58.947433 31691 raft_consensus.cc:515] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:58.936981 31532 leader_election.cc:290] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:58.950232 31645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0317908edb88497b82c4e59ef1bac414" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
W20260709 12:13:58.951716 30824 leader_election.cc:343] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 4 election: Tablet error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:58.953925 31691 leader_election.cc:290] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 4 election: Requested vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:13:58.955061 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0317908edb88497b82c4e59ef1bac414" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:13:58.955787 30778 raft_consensus.cc:3060] T 0317908edb88497b82c4e59ef1bac414 P 84b98f9236604dd0b22ae23c5378a676 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:58.959070 31645 raft_consensus.cc:3060] T 2ff9e0d905854cceb79f96f500a07339 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:58.966804 31680 heartbeater.cc:344] Connected to a master server at 127.20.196.190:44745
I20260709 12:13:58.967473 31680 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:58.968457 31680 heartbeater.cc:507] Master 127.20.196.190:44745 requested a full tablet report, sending...
I20260709 12:13:58.984714 30778 raft_consensus.cc:2468] T 0317908edb88497b82c4e59ef1bac414 P 84b98f9236604dd0b22ae23c5378a676 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 4.
I20260709 12:13:58.986227 30822 leader_election.cc:304] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676; no voters: 6c5665c17e904fc692bce76fc57b2460
I20260709 12:13:58.987473 31691 raft_consensus.cc:2804] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:58.990262 31691 raft_consensus.cc:697] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [term 4 LEADER]: Becoming Leader. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Running, Role: LEADER
I20260709 12:13:58.994316 31691 consensus_queue.cc:237] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:59.006405 31520 tablet_bootstrap.cc:492] T 76d4dde0196948ef92f68df770af02b0 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:59.010421 31520 tablet_bootstrap.cc:492] T 76d4dde0196948ef92f68df770af02b0 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap complete.
I20260709 12:13:59.011093 31520 ts_tablet_manager.cc:1403] T 76d4dde0196948ef92f68df770af02b0 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.092s	user 0.019s	sys 0.004s
I20260709 12:13:59.013980 31520 raft_consensus.cc:359] T 76d4dde0196948ef92f68df770af02b0 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:59.014659 31520 raft_consensus.cc:740] T 76d4dde0196948ef92f68df770af02b0 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:59.019263 31520 consensus_queue.cc:260] T 76d4dde0196948ef92f68df770af02b0 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:13:59.023447 31520 ts_tablet_manager.cc:1434] T 76d4dde0196948ef92f68df770af02b0 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:13:59.024191 31520 tablet_bootstrap.cc:492] T f0fbdcbe46b34107bbbf63f69c98e244 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:59.031517 30604 ts_manager.cc:194] Re-registered known tserver with Master: 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:13:59.044689 31520 tablet_bootstrap.cc:492] T f0fbdcbe46b34107bbbf63f69c98e244 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:59.045863 31520 tablet_bootstrap.cc:492] T f0fbdcbe46b34107bbbf63f69c98e244 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap complete.
I20260709 12:13:59.046670 31520 ts_tablet_manager.cc:1403] T f0fbdcbe46b34107bbbf63f69c98e244 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.006s
I20260709 12:13:59.049454 31520 raft_consensus.cc:359] T f0fbdcbe46b34107bbbf63f69c98e244 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:59.050103 31520 raft_consensus.cc:740] T f0fbdcbe46b34107bbbf63f69c98e244 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:59.046401 30607 catalog_manager.cc:5697] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad reported cstate change: term changed from 2 to 4, leader changed from 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129) to 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131). New cstate: current_term: 4 leader_uuid: "8130e18710c04a61a5d8bd019c6ffdad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:59.051023 31520 consensus_queue.cc:260] T f0fbdcbe46b34107bbbf63f69c98e244 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:59.054136 31520 ts_tablet_manager.cc:1434] T f0fbdcbe46b34107bbbf63f69c98e244 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.002s
I20260709 12:13:59.055006 31520 tablet_bootstrap.cc:492] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:59.086071 31645 raft_consensus.cc:3060] T bb358c4df82f4168bc1debdfc4e7aa9c P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:59.185648 30824 consensus_peers.cc:597] T 7b23395f850d4699b8d289f501c96f60 P 8130e18710c04a61a5d8bd019c6ffdad -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:59.198429 31520 tablet_bootstrap.cc:492] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 6c5665c17e904fc692bce76fc57b2460: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:59.199512 31520 tablet_bootstrap.cc:492] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 6c5665c17e904fc692bce76fc57b2460: Bootstrap complete.
I20260709 12:13:59.200181 31520 ts_tablet_manager.cc:1403] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.145s	user 0.015s	sys 0.022s
I20260709 12:13:59.202896 31520 raft_consensus.cc:359] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:59.203678 31520 raft_consensus.cc:740] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:59.204461 31520 consensus_queue.cc:260] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:59.206651 31520 ts_tablet_manager.cc:1434] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:13:59.207399 31520 tablet_bootstrap.cc:492] T 660d2eb6dd3f4e96aab252cfd980be89 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:59.237900 31520 tablet_bootstrap.cc:492] T 660d2eb6dd3f4e96aab252cfd980be89 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:59.239223 31520 tablet_bootstrap.cc:492] T 660d2eb6dd3f4e96aab252cfd980be89 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap complete.
I20260709 12:13:59.239843 31520 ts_tablet_manager.cc:1403] T 660d2eb6dd3f4e96aab252cfd980be89 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.012s
I20260709 12:13:59.242628 31520 raft_consensus.cc:359] T 660d2eb6dd3f4e96aab252cfd980be89 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:59.243306 31520 raft_consensus.cc:740] T 660d2eb6dd3f4e96aab252cfd980be89 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:59.244092 31520 consensus_queue.cc:260] T 660d2eb6dd3f4e96aab252cfd980be89 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:59.246214 31520 ts_tablet_manager.cc:1434] T 660d2eb6dd3f4e96aab252cfd980be89 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:13:59.246999 31520 tablet_bootstrap.cc:492] T b9cc9d529de24234b98ed5e152fd4b24 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:59.275018 30604 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48060
I20260709 12:13:59.281013 31680 heartbeater.cc:499] Master 127.20.196.190:44745 was elected leader, sending a full tablet report...
I20260709 12:13:59.302865 31520 tablet_bootstrap.cc:492] T b9cc9d529de24234b98ed5e152fd4b24 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:59.306375 31520 tablet_bootstrap.cc:492] T b9cc9d529de24234b98ed5e152fd4b24 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap complete.
I20260709 12:13:59.307873 31520 ts_tablet_manager.cc:1403] T b9cc9d529de24234b98ed5e152fd4b24 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.061s	user 0.022s	sys 0.020s
I20260709 12:13:59.309063 31645 raft_consensus.cc:3060] T 76d4dde0196948ef92f68df770af02b0 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:59.310333 31520 raft_consensus.cc:359] T b9cc9d529de24234b98ed5e152fd4b24 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:59.310910 31520 raft_consensus.cc:740] T b9cc9d529de24234b98ed5e152fd4b24 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:59.311765 31520 consensus_queue.cc:260] T b9cc9d529de24234b98ed5e152fd4b24 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:59.347247 31520 ts_tablet_manager.cc:1434] T b9cc9d529de24234b98ed5e152fd4b24 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.002s
I20260709 12:13:59.348237 31520 tablet_bootstrap.cc:492] T 745e2cea61c44c3a80bdc49add504a75 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:59.388515 31520 tablet_bootstrap.cc:492] T 745e2cea61c44c3a80bdc49add504a75 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:59.393177 31520 tablet_bootstrap.cc:492] T 745e2cea61c44c3a80bdc49add504a75 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap complete.
I20260709 12:13:59.393906 31520 ts_tablet_manager.cc:1403] T 745e2cea61c44c3a80bdc49add504a75 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.002s
I20260709 12:13:59.396788 31520 raft_consensus.cc:359] T 745e2cea61c44c3a80bdc49add504a75 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:59.397552 31520 raft_consensus.cc:740] T 745e2cea61c44c3a80bdc49add504a75 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:59.398355 31520 consensus_queue.cc:260] T 745e2cea61c44c3a80bdc49add504a75 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:59.400657 31520 ts_tablet_manager.cc:1434] T 745e2cea61c44c3a80bdc49add504a75 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:13:59.401448 31520 tablet_bootstrap.cc:492] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:59.426240 31520 tablet_bootstrap.cc:492] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:59.427322 31520 tablet_bootstrap.cc:492] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap complete.
I20260709 12:13:59.428113 31520 ts_tablet_manager.cc:1403] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.008s
I20260709 12:13:59.435828 31520 raft_consensus.cc:359] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:59.436379 31520 raft_consensus.cc:740] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:59.436970 31520 consensus_queue.cc:260] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:59.438906 31520 ts_tablet_manager.cc:1434] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.001s
I20260709 12:13:59.440161 31520 tablet_bootstrap.cc:492] T 615eb2fb16414287bc0956a27523b7f4 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:59.460959 30780 raft_consensus.cc:1275] T 0317908edb88497b82c4e59ef1bac414 P 84b98f9236604dd0b22ae23c5378a676 [term 4 FOLLOWER]: Refusing update from remote peer 8130e18710c04a61a5d8bd019c6ffdad: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:13:59.462447 31536 consensus_queue.cc:1048] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Connected to new peer: Peer: permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:59.468987 31644 raft_consensus.cc:3060] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:59.498798 31645 raft_consensus.cc:3060] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:13:59.499686 31520 tablet_bootstrap.cc:492] T 615eb2fb16414287bc0956a27523b7f4 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:59.501351 31520 tablet_bootstrap.cc:492] T 615eb2fb16414287bc0956a27523b7f4 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap complete.
I20260709 12:13:59.501973 31520 ts_tablet_manager.cc:1403] T 615eb2fb16414287bc0956a27523b7f4 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.062s	user 0.017s	sys 0.002s
I20260709 12:13:59.509963 31520 raft_consensus.cc:359] T 615eb2fb16414287bc0956a27523b7f4 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:59.512059 31520 raft_consensus.cc:740] T 615eb2fb16414287bc0956a27523b7f4 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:59.512806 31520 consensus_queue.cc:260] T 615eb2fb16414287bc0956a27523b7f4 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:59.523633 31645 raft_consensus.cc:1275] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [term 4 FOLLOWER]: Refusing update from remote peer 8130e18710c04a61a5d8bd019c6ffdad: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:13:59.527082 31532 consensus_queue.cc:1048] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:59.532037 31520 ts_tablet_manager.cc:1434] T 615eb2fb16414287bc0956a27523b7f4 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.001s
I20260709 12:13:59.533106 31520 tablet_bootstrap.cc:492] T 5d636204e40644318b4758f37c7b0474 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:59.569051 31520 tablet_bootstrap.cc:492] T 5d636204e40644318b4758f37c7b0474 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:59.570098 31520 tablet_bootstrap.cc:492] T 5d636204e40644318b4758f37c7b0474 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap complete.
I20260709 12:13:59.570838 31520 ts_tablet_manager.cc:1403] T 5d636204e40644318b4758f37c7b0474 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.004s
I20260709 12:13:59.582580 31520 raft_consensus.cc:359] T 5d636204e40644318b4758f37c7b0474 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:59.583369 31520 raft_consensus.cc:740] T 5d636204e40644318b4758f37c7b0474 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:59.587673 31520 consensus_queue.cc:260] T 5d636204e40644318b4758f37c7b0474 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:59.590003 31520 ts_tablet_manager.cc:1434] T 5d636204e40644318b4758f37c7b0474 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.002s
I20260709 12:13:59.590869 31520 tablet_bootstrap.cc:492] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:59.606195 31520 tablet_bootstrap.cc:492] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:59.607167 31520 tablet_bootstrap.cc:492] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460: Bootstrap complete.
I20260709 12:13:59.607800 31520 ts_tablet_manager.cc:1403] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.017s	user 0.016s	sys 0.000s
I20260709 12:13:59.609877 31520 raft_consensus.cc:359] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:59.610360 31520 raft_consensus.cc:740] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:59.610864 31520 consensus_queue.cc:260] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:59.612763 31520 ts_tablet_manager.cc:1434] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:13:59.613493 31520 tablet_bootstrap.cc:492] T 671d30cec67d47a89e8ec6fab0c53c48 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:59.650168 31520 tablet_bootstrap.cc:492] T 671d30cec67d47a89e8ec6fab0c53c48 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:59.650962 31520 tablet_bootstrap.cc:492] T 671d30cec67d47a89e8ec6fab0c53c48 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap complete.
I20260709 12:13:59.651562 31520 ts_tablet_manager.cc:1403] T 671d30cec67d47a89e8ec6fab0c53c48 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.008s
I20260709 12:13:59.653759 31520 raft_consensus.cc:359] T 671d30cec67d47a89e8ec6fab0c53c48 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:59.654424 31520 raft_consensus.cc:740] T 671d30cec67d47a89e8ec6fab0c53c48 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:59.655090 31520 consensus_queue.cc:260] T 671d30cec67d47a89e8ec6fab0c53c48 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:13:59.657866 31520 ts_tablet_manager.cc:1434] T 671d30cec67d47a89e8ec6fab0c53c48 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:13:59.659607 31520 tablet_bootstrap.cc:492] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:59.687464 31520 tablet_bootstrap.cc:492] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:59.688437 31520 tablet_bootstrap.cc:492] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap complete.
I20260709 12:13:59.689177 31520 ts_tablet_manager.cc:1403] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.009s
I20260709 12:13:59.692008 31520 raft_consensus.cc:359] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:59.692806 31520 raft_consensus.cc:740] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:59.693579 31520 consensus_queue.cc:260] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:59.695822 31520 ts_tablet_manager.cc:1434] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:13:59.696666 31520 tablet_bootstrap.cc:492] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:59.701519 31645 raft_consensus.cc:3060] T 5d636204e40644318b4758f37c7b0474 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:59.709851 30824 consensus_peers.cc:597] T ca92b4f3c36b42fb9aa2f575c06344fe P 8130e18710c04a61a5d8bd019c6ffdad -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:59.736606 31520 tablet_bootstrap.cc:492] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:59.737438 31520 tablet_bootstrap.cc:492] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap complete.
I20260709 12:13:59.738160 31520 ts_tablet_manager.cc:1403] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.042s	user 0.022s	sys 0.016s
I20260709 12:13:59.745653 31520 raft_consensus.cc:359] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:59.746335 31520 raft_consensus.cc:740] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:59.747187 31520 consensus_queue.cc:260] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:59.749172 31520 ts_tablet_manager.cc:1434] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:13:59.749949 31520 tablet_bootstrap.cc:492] T 56a566949cf345d08d43f13ccff4be37 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:59.784835 31645 raft_consensus.cc:3060] T 745e2cea61c44c3a80bdc49add504a75 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:59.796731 30898 consensus_peers.cc:597] T 34e3009dd96f4545b2abe325ac95e960 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:59.809345 31647 raft_consensus.cc:3060] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:59.826624 31520 tablet_bootstrap.cc:492] T 56a566949cf345d08d43f13ccff4be37 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:59.827592 31520 tablet_bootstrap.cc:492] T 56a566949cf345d08d43f13ccff4be37 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap complete.
I20260709 12:13:59.828418 31520 ts_tablet_manager.cc:1403] T 56a566949cf345d08d43f13ccff4be37 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.079s	user 0.022s	sys 0.047s
I20260709 12:13:59.832062 31520 raft_consensus.cc:359] T 56a566949cf345d08d43f13ccff4be37 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:13:59.832732 31520 raft_consensus.cc:740] T 56a566949cf345d08d43f13ccff4be37 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:59.833498 31520 consensus_queue.cc:260] T 56a566949cf345d08d43f13ccff4be37 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
W20260709 12:13:59.835084 30898 consensus_peers.cc:597] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:59.835628 31520 ts_tablet_manager.cc:1434] T 56a566949cf345d08d43f13ccff4be37 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:13:59.836427 31520 tablet_bootstrap.cc:492] T ca92b4f3c36b42fb9aa2f575c06344fe P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:59.874755 31520 tablet_bootstrap.cc:492] T ca92b4f3c36b42fb9aa2f575c06344fe P 6c5665c17e904fc692bce76fc57b2460: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:59.876686 31520 tablet_bootstrap.cc:492] T ca92b4f3c36b42fb9aa2f575c06344fe P 6c5665c17e904fc692bce76fc57b2460: Bootstrap complete.
I20260709 12:13:59.877311 31520 ts_tablet_manager.cc:1403] T ca92b4f3c36b42fb9aa2f575c06344fe P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.014s
I20260709 12:13:59.879844 31520 raft_consensus.cc:359] T ca92b4f3c36b42fb9aa2f575c06344fe P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:59.880511 31520 raft_consensus.cc:740] T ca92b4f3c36b42fb9aa2f575c06344fe P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:13:59.881170 31520 consensus_queue.cc:260] T ca92b4f3c36b42fb9aa2f575c06344fe P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:13:59.883416 31520 ts_tablet_manager.cc:1434] T ca92b4f3c36b42fb9aa2f575c06344fe P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:13:59.884153 31520 tablet_bootstrap.cc:492] T a318673515aa415db1aa91d126a5b724 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:13:59.905184 31648 raft_consensus.cc:3060] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:59.920351 30750 consensus_peers.cc:597] T c5afc0720ca546d8b13026e7c7a30c1e P 84b98f9236604dd0b22ae23c5378a676 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:59.930806 31644 raft_consensus.cc:3060] T 615eb2fb16414287bc0956a27523b7f4 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:00.038563 30824 consensus_peers.cc:597] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 8130e18710c04a61a5d8bd019c6ffdad -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:00.098694 31520 tablet_bootstrap.cc:492] T a318673515aa415db1aa91d126a5b724 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:00.099757 31520 tablet_bootstrap.cc:492] T a318673515aa415db1aa91d126a5b724 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap complete.
I20260709 12:14:00.100456 31520 ts_tablet_manager.cc:1403] T a318673515aa415db1aa91d126a5b724 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.216s	user 0.048s	sys 0.077s
I20260709 12:14:00.106644 31520 raft_consensus.cc:359] T a318673515aa415db1aa91d126a5b724 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:14:00.107457 31520 raft_consensus.cc:740] T a318673515aa415db1aa91d126a5b724 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:14:00.108181 31520 consensus_queue.cc:260] T a318673515aa415db1aa91d126a5b724 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:14:00.109781 31520 ts_tablet_manager.cc:1434] T a318673515aa415db1aa91d126a5b724 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 12:14:00.110664 31520 tablet_bootstrap.cc:492] T 34e3009dd96f4545b2abe325ac95e960 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:14:00.140161 31520 tablet_bootstrap.cc:492] T 34e3009dd96f4545b2abe325ac95e960 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:00.141204 31520 tablet_bootstrap.cc:492] T 34e3009dd96f4545b2abe325ac95e960 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap complete.
I20260709 12:14:00.141866 31520 ts_tablet_manager.cc:1403] T 34e3009dd96f4545b2abe325ac95e960 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.008s
I20260709 12:14:00.144506 31520 raft_consensus.cc:359] T 34e3009dd96f4545b2abe325ac95e960 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:14:00.145186 31520 raft_consensus.cc:740] T 34e3009dd96f4545b2abe325ac95e960 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:14:00.145867 31520 consensus_queue.cc:260] T 34e3009dd96f4545b2abe325ac95e960 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:14:00.148509 31520 ts_tablet_manager.cc:1434] T 34e3009dd96f4545b2abe325ac95e960 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 12:14:00.150035 31520 tablet_bootstrap.cc:492] T e57ee667f8a246eb98ab6b169eb779b9 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:14:00.167310 31520 tablet_bootstrap.cc:492] T e57ee667f8a246eb98ab6b169eb779b9 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:00.168329 31520 tablet_bootstrap.cc:492] T e57ee667f8a246eb98ab6b169eb779b9 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap complete.
I20260709 12:14:00.169093 31520 ts_tablet_manager.cc:1403] T e57ee667f8a246eb98ab6b169eb779b9 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 12:14:00.171618 31520 raft_consensus.cc:359] T e57ee667f8a246eb98ab6b169eb779b9 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:14:00.172133 31520 raft_consensus.cc:740] T e57ee667f8a246eb98ab6b169eb779b9 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:14:00.172678 31520 consensus_queue.cc:260] T e57ee667f8a246eb98ab6b169eb779b9 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:14:00.174503 31520 ts_tablet_manager.cc:1434] T e57ee667f8a246eb98ab6b169eb779b9 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 12:14:00.175561 31520 tablet_bootstrap.cc:492] T c5afc0720ca546d8b13026e7c7a30c1e P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:14:00.190589 31520 tablet_bootstrap.cc:492] T c5afc0720ca546d8b13026e7c7a30c1e P 6c5665c17e904fc692bce76fc57b2460: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:00.191392 31520 tablet_bootstrap.cc:492] T c5afc0720ca546d8b13026e7c7a30c1e P 6c5665c17e904fc692bce76fc57b2460: Bootstrap complete.
I20260709 12:14:00.192085 31520 ts_tablet_manager.cc:1403] T c5afc0720ca546d8b13026e7c7a30c1e P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 12:14:00.194054 31520 raft_consensus.cc:359] T c5afc0720ca546d8b13026e7c7a30c1e P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:14:00.194561 31520 raft_consensus.cc:740] T c5afc0720ca546d8b13026e7c7a30c1e P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:14:00.195158 31520 consensus_queue.cc:260] T c5afc0720ca546d8b13026e7c7a30c1e P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:14:00.197005 31520 ts_tablet_manager.cc:1434] T c5afc0720ca546d8b13026e7c7a30c1e P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:14:00.197714 31520 tablet_bootstrap.cc:492] T 7b23395f850d4699b8d289f501c96f60 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:14:00.214852 31520 tablet_bootstrap.cc:492] T 7b23395f850d4699b8d289f501c96f60 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:00.215647 31520 tablet_bootstrap.cc:492] T 7b23395f850d4699b8d289f501c96f60 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap complete.
I20260709 12:14:00.216285 31520 ts_tablet_manager.cc:1403] T 7b23395f850d4699b8d289f501c96f60 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.001s
I20260709 12:14:00.218427 31520 raft_consensus.cc:359] T 7b23395f850d4699b8d289f501c96f60 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:14:00.219080 31520 raft_consensus.cc:740] T 7b23395f850d4699b8d289f501c96f60 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:14:00.221693 31520 consensus_queue.cc:260] T 7b23395f850d4699b8d289f501c96f60 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:14:00.223960 31520 ts_tablet_manager.cc:1434] T 7b23395f850d4699b8d289f501c96f60 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:14:00.224784 31520 tablet_bootstrap.cc:492] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:14:00.243803 31520 tablet_bootstrap.cc:492] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:00.244724 31520 tablet_bootstrap.cc:492] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap complete.
I20260709 12:14:00.245357 31520 ts_tablet_manager.cc:1403] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.007s
I20260709 12:14:00.249341 31520 raft_consensus.cc:359] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:14:00.250022 31520 raft_consensus.cc:740] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:14:00.250695 31520 consensus_queue.cc:260] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:14:00.258340 31520 ts_tablet_manager.cc:1434] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:14:00.259245 31520 tablet_bootstrap.cc:492] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
I20260709 12:14:00.263566 31644 raft_consensus.cc:3060] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:00.279251 31520 tablet_bootstrap.cc:492] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 6c5665c17e904fc692bce76fc57b2460: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:00.280229 31520 tablet_bootstrap.cc:492] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 6c5665c17e904fc692bce76fc57b2460: Bootstrap complete.
I20260709 12:14:00.280889 31520 ts_tablet_manager.cc:1403] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.022s	user 0.005s	sys 0.010s
I20260709 12:14:00.283463 31520 raft_consensus.cc:359] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:14:00.284121 31520 raft_consensus.cc:740] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:14:00.284981 31520 consensus_queue.cc:260] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:14:00.287036 31520 ts_tablet_manager.cc:1434] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:14:00.288166 31520 tablet_bootstrap.cc:492] T 21c0ba9bb1d64ab398c606450f72e966 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap starting.
W20260709 12:14:00.302485 30824 consensus_peers.cc:597] T 21c0ba9bb1d64ab398c606450f72e966 P 8130e18710c04a61a5d8bd019c6ffdad -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:00.330552 31520 tablet_bootstrap.cc:492] T 21c0ba9bb1d64ab398c606450f72e966 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:00.331629 31520 tablet_bootstrap.cc:492] T 21c0ba9bb1d64ab398c606450f72e966 P 6c5665c17e904fc692bce76fc57b2460: Bootstrap complete.
I20260709 12:14:00.332329 31520 ts_tablet_manager.cc:1403] T 21c0ba9bb1d64ab398c606450f72e966 P 6c5665c17e904fc692bce76fc57b2460: Time spent bootstrapping tablet: real 0.044s	user 0.021s	sys 0.011s
I20260709 12:14:00.334792 31520 raft_consensus.cc:359] T 21c0ba9bb1d64ab398c606450f72e966 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:14:00.335484 31520 raft_consensus.cc:740] T 21c0ba9bb1d64ab398c606450f72e966 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Initialized, Role: FOLLOWER
I20260709 12:14:00.336154 31520 consensus_queue.cc:260] T 21c0ba9bb1d64ab398c606450f72e966 P 6c5665c17e904fc692bce76fc57b2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:14:00.343902 31520 ts_tablet_manager.cc:1434] T 21c0ba9bb1d64ab398c606450f72e966 P 6c5665c17e904fc692bce76fc57b2460: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
W20260709 12:14:01.953311 30953 debug-util.cc:398] Leaking SignalData structure 0x7b08000af680 after lost signal to thread 21269
W20260709 12:14:01.954371 30953 debug-util.cc:398] Leaking SignalData structure 0x7b0800206320 after lost signal to thread 30641
W20260709 12:14:01.955569 30953 debug-util.cc:398] Leaking SignalData structure 0x7b080011c620 after lost signal to thread 30808
W20260709 12:14:01.956538 30953 debug-util.cc:398] Leaking SignalData structure 0x7b0800180160 after lost signal to thread 30882
W20260709 12:14:01.957633 30953 debug-util.cc:398] Leaking SignalData structure 0x7b08000cd6c0 after lost signal to thread 30956
W20260709 12:14:01.959510 30953 debug-util.cc:398] Leaking SignalData structure 0x7b0800248360 after lost signal to thread 31679
I20260709 12:14:08.983774 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:09.035200 30854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0317908edb88497b82c4e59ef1bac414"
dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
mode: GRACEFUL
new_leader_uuid: "6c5665c17e904fc692bce76fc57b2460"
 from {username='slave'} at 127.0.0.1:49054
I20260709 12:14:09.035912 30854 raft_consensus.cc:606] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [term 4 LEADER]: Received request to transfer leadership to TS 6c5665c17e904fc692bce76fc57b2460
I20260709 12:14:09.047254 30928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bbb677d9c544ed5a31297773b1508d6"
dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
mode: GRACEFUL
new_leader_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
 from {username='slave'} at 127.0.0.1:40644
I20260709 12:14:09.047773 30928 raft_consensus.cc:606] T 1bbb677d9c544ed5a31297773b1508d6 P 15ad0880a63541ef965cb6acca4513d7 [term 1 LEADER]: Received request to transfer leadership to TS 8130e18710c04a61a5d8bd019c6ffdad
I20260709 12:14:09.050249 30928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b66a7b6f8aa4803b482e392cc945db7"
dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
mode: GRACEFUL
new_leader_uuid: "6c5665c17e904fc692bce76fc57b2460"
 from {username='slave'} at 127.0.0.1:40644
I20260709 12:14:09.050733 30928 raft_consensus.cc:606] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7 [term 1 LEADER]: Received request to transfer leadership to TS 6c5665c17e904fc692bce76fc57b2460
I20260709 12:14:09.053146 30928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "baedd172e30a4ef4a6641302fdebd9c5"
dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
mode: GRACEFUL
new_leader_uuid: "6c5665c17e904fc692bce76fc57b2460"
 from {username='slave'} at 127.0.0.1:40644
I20260709 12:14:09.053659 30928 raft_consensus.cc:606] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7 [term 2 LEADER]: Received request to transfer leadership to TS 6c5665c17e904fc692bce76fc57b2460
I20260709 12:14:09.056392 30928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5a270750666414887b6fae2f3793dc5"
dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
mode: GRACEFUL
new_leader_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
 from {username='slave'} at 127.0.0.1:40644
I20260709 12:14:09.056802 30928 raft_consensus.cc:606] T d5a270750666414887b6fae2f3793dc5 P 15ad0880a63541ef965cb6acca4513d7 [term 1 LEADER]: Received request to transfer leadership to TS 8130e18710c04a61a5d8bd019c6ffdad
I20260709 12:14:09.064252 31744 raft_consensus.cc:993] T 1bbb677d9c544ed5a31297773b1508d6 P 15ad0880a63541ef965cb6acca4513d7: : Instructing follower 8130e18710c04a61a5d8bd019c6ffdad to start an election
I20260709 12:14:09.064852 31766 raft_consensus.cc:1081] T 1bbb677d9c544ed5a31297773b1508d6 P 15ad0880a63541ef965cb6acca4513d7 [term 1 LEADER]: Signalling peer 8130e18710c04a61a5d8bd019c6ffdad to start an election
I20260709 12:14:09.066726 30854 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1bbb677d9c544ed5a31297773b1508d6"
dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
 from {username='slave'} at 127.0.0.1:35910
I20260709 12:14:09.067538 30854 raft_consensus.cc:493] T 1bbb677d9c544ed5a31297773b1508d6 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:09.067958 30854 raft_consensus.cc:3060] T 1bbb677d9c544ed5a31297773b1508d6 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:09.073933 30780 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec7d33fd7f3245f68966bd7749ee53c3"
dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
mode: GRACEFUL
new_leader_uuid: "6c5665c17e904fc692bce76fc57b2460"
 from {username='slave'} at 127.0.0.1:46850
I20260709 12:14:09.074546 30780 raft_consensus.cc:606] T ec7d33fd7f3245f68966bd7749ee53c3 P 84b98f9236604dd0b22ae23c5378a676 [term 1 LEADER]: Received request to transfer leadership to TS 6c5665c17e904fc692bce76fc57b2460
I20260709 12:14:09.076972 30854 raft_consensus.cc:515] T 1bbb677d9c544ed5a31297773b1508d6 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:14:09.077741 30928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd65967534164e9c805fc3d5d05e0369"
dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
mode: GRACEFUL
new_leader_uuid: "6c5665c17e904fc692bce76fc57b2460"
 from {username='slave'} at 127.0.0.1:40644
I20260709 12:14:09.078439 30928 raft_consensus.cc:606] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7 [term 2 LEADER]: Received request to transfer leadership to TS 6c5665c17e904fc692bce76fc57b2460
I20260709 12:14:09.079699 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 12:14:09.081310 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bbb677d9c544ed5a31297773b1508d6" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:14:09.081465 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bbb677d9c544ed5a31297773b1508d6" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
I20260709 12:14:09.091374 30928 raft_consensus.cc:3055] T 1bbb677d9c544ed5a31297773b1508d6 P 15ad0880a63541ef965cb6acca4513d7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:09.091727 30928 raft_consensus.cc:740] T 1bbb677d9c544ed5a31297773b1508d6 P 15ad0880a63541ef965cb6acca4513d7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Running, Role: LEADER
I20260709 12:14:09.092622 30928 consensus_queue.cc:260] T 1bbb677d9c544ed5a31297773b1508d6 P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:14:09.093890 30928 raft_consensus.cc:3060] T 1bbb677d9c544ed5a31297773b1508d6 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:09.079974 30854 leader_election.cc:290] T 1bbb677d9c544ed5a31297773b1508d6 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 2 election: Requested vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:14:09.101327 31744 raft_consensus.cc:993] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7: : Instructing follower 6c5665c17e904fc692bce76fc57b2460 to start an election
I20260709 12:14:09.102232 31744 raft_consensus.cc:1081] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7 [term 2 LEADER]: Signalling peer 6c5665c17e904fc692bce76fc57b2460 to start an election
I20260709 12:14:09.102607 30780 raft_consensus.cc:3060] T 1bbb677d9c544ed5a31297773b1508d6 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:09.105401 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:09.106552 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:09.110694 30928 raft_consensus.cc:2468] T 1bbb677d9c544ed5a31297773b1508d6 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 2.
I20260709 12:14:09.112612 31769 raft_consensus.cc:993] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7: : Instructing follower 6c5665c17e904fc692bce76fc57b2460 to start an election
I20260709 12:14:09.113152 31769 raft_consensus.cc:1081] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7 [term 2 LEADER]: Signalling peer 6c5665c17e904fc692bce76fc57b2460 to start an election
I20260709 12:14:09.113457 30823 leader_election.cc:304] T 1bbb677d9c544ed5a31297773b1508d6 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 
I20260709 12:14:09.115140 31763 raft_consensus.cc:2804] T 1bbb677d9c544ed5a31297773b1508d6 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:09.115181 31647 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "baedd172e30a4ef4a6641302fdebd9c5"
dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
 from {username='slave'} at 127.0.0.1:54514
I20260709 12:14:09.115809 31647 raft_consensus.cc:493] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:09.116180 31647 raft_consensus.cc:3060] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:09.116622 31763 raft_consensus.cc:697] T 1bbb677d9c544ed5a31297773b1508d6 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 LEADER]: Becoming Leader. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Running, Role: LEADER
I20260709 12:14:09.118420 30780 raft_consensus.cc:2468] T 1bbb677d9c544ed5a31297773b1508d6 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 2.
I20260709 12:14:09.118160 31763 consensus_queue.cc:237] T 1bbb677d9c544ed5a31297773b1508d6 P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:14:09.121496 31645 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd65967534164e9c805fc3d5d05e0369"
dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
 from {username='slave'} at 127.0.0.1:54514
I20260709 12:14:09.122117 31645 raft_consensus.cc:493] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:09.122570 31645 raft_consensus.cc:3060] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:09.140614 30896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:40083, user_credentials={real_user=slave}} blocked reactor thread for 43989.6us
I20260709 12:14:09.149008 31647 raft_consensus.cc:515] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:14:09.150040 31645 raft_consensus.cc:515] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:14:09.152025 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baedd172e30a4ef4a6641302fdebd9c5" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
I20260709 12:14:09.155668 30928 raft_consensus.cc:3055] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:09.155992 30928 raft_consensus.cc:740] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Running, Role: LEADER
I20260709 12:14:09.156862 30928 consensus_queue.cc:260] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:14:09.158056 30928 raft_consensus.cc:3060] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:09.164291 31647 leader_election.cc:290] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 3 election: Requested vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:14:09.166777 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baedd172e30a4ef4a6641302fdebd9c5" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:14:09.167667 30780 raft_consensus.cc:3060] T baedd172e30a4ef4a6641302fdebd9c5 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:09.171360 31645 leader_election.cc:290] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 3 election: Requested vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:14:09.172549 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd65967534164e9c805fc3d5d05e0369" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
I20260709 12:14:09.173008 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd65967534164e9c805fc3d5d05e0369" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:14:09.173235 30932 raft_consensus.cc:3055] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:09.173651 30932 raft_consensus.cc:740] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Running, Role: LEADER
I20260709 12:14:09.173684 30851 raft_consensus.cc:3060] T fd65967534164e9c805fc3d5d05e0369 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:09.174467 30932 consensus_queue.cc:260] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:14:09.175705 30932 raft_consensus.cc:3060] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:09.182966 30932 raft_consensus.cc:2468] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 3.
I20260709 12:14:09.183308 30928 raft_consensus.cc:2468] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 3.
I20260709 12:14:09.184139 31516 leader_election.cc:304] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 6c5665c17e904fc692bce76fc57b2460; no voters: 
I20260709 12:14:09.184441 30780 raft_consensus.cc:2468] T baedd172e30a4ef4a6641302fdebd9c5 P 84b98f9236604dd0b22ae23c5378a676 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 3.
I20260709 12:14:09.185645 31515 leader_election.cc:304] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:14:09.187525 31764 raft_consensus.cc:993] T ec7d33fd7f3245f68966bd7749ee53c3 P 84b98f9236604dd0b22ae23c5378a676: : Instructing follower 6c5665c17e904fc692bce76fc57b2460 to start an election
I20260709 12:14:09.187973 31764 raft_consensus.cc:1081] T ec7d33fd7f3245f68966bd7749ee53c3 P 84b98f9236604dd0b22ae23c5378a676 [term 1 LEADER]: Signalling peer 6c5665c17e904fc692bce76fc57b2460 to start an election
I20260709 12:14:09.197307 30605 catalog_manager.cc:5697] T 1bbb677d9c544ed5a31297773b1508d6 P 8130e18710c04a61a5d8bd019c6ffdad reported cstate change: term changed from 1 to 2, leader changed from 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132) to 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131). New cstate: current_term: 2 leader_uuid: "8130e18710c04a61a5d8bd019c6ffdad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:09.202116 30851 raft_consensus.cc:2468] T fd65967534164e9c805fc3d5d05e0369 P 8130e18710c04a61a5d8bd019c6ffdad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 3.
I20260709 12:14:09.202749 31779 raft_consensus.cc:2804] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:09.206358 31778 raft_consensus.cc:2804] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:09.207049 31645 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec7d33fd7f3245f68966bd7749ee53c3"
dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
 from {username='slave'} at 127.0.0.1:54516
I20260709 12:14:09.207608 31645 raft_consensus.cc:493] T ec7d33fd7f3245f68966bd7749ee53c3 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:09.207964 31645 raft_consensus.cc:3060] T ec7d33fd7f3245f68966bd7749ee53c3 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:09.210398 31779 raft_consensus.cc:697] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460 [term 3 LEADER]: Becoming Leader. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Running, Role: LEADER
I20260709 12:14:09.211680 31779 consensus_queue.cc:237] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:14:09.220780 31645 raft_consensus.cc:515] T ec7d33fd7f3245f68966bd7749ee53c3 P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:14:09.222895 31645 leader_election.cc:290] T ec7d33fd7f3245f68966bd7749ee53c3 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 2 election: Requested vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:14:09.223686 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec7d33fd7f3245f68966bd7749ee53c3" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
I20260709 12:14:09.224323 30932 raft_consensus.cc:3060] T ec7d33fd7f3245f68966bd7749ee53c3 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:09.224325 31778 raft_consensus.cc:697] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460 [term 3 LEADER]: Becoming Leader. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Running, Role: LEADER
I20260709 12:14:09.232255 31778 consensus_queue.cc:237] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:14:09.235498 30932 raft_consensus.cc:2468] T ec7d33fd7f3245f68966bd7749ee53c3 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 2.
I20260709 12:14:09.236771 31516 leader_election.cc:304] T ec7d33fd7f3245f68966bd7749ee53c3 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 6c5665c17e904fc692bce76fc57b2460; no voters: 
I20260709 12:14:09.237746 31779 raft_consensus.cc:2804] T ec7d33fd7f3245f68966bd7749ee53c3 P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:09.238222 31779 raft_consensus.cc:697] T ec7d33fd7f3245f68966bd7749ee53c3 P 6c5665c17e904fc692bce76fc57b2460 [term 2 LEADER]: Becoming Leader. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Running, Role: LEADER
I20260709 12:14:09.234434 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec7d33fd7f3245f68966bd7749ee53c3" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:14:09.239265 30780 raft_consensus.cc:3055] T ec7d33fd7f3245f68966bd7749ee53c3 P 84b98f9236604dd0b22ae23c5378a676 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:09.239781 30780 raft_consensus.cc:740] T ec7d33fd7f3245f68966bd7749ee53c3 P 84b98f9236604dd0b22ae23c5378a676 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Running, Role: LEADER
I20260709 12:14:09.239233 31779 consensus_queue.cc:237] T ec7d33fd7f3245f68966bd7749ee53c3 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:14:09.240527 30780 consensus_queue.cc:260] T ec7d33fd7f3245f68966bd7749ee53c3 P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:14:09.246464 30780 raft_consensus.cc:3060] T ec7d33fd7f3245f68966bd7749ee53c3 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:09.258663 30780 raft_consensus.cc:2468] T ec7d33fd7f3245f68966bd7749ee53c3 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 2.
I20260709 12:14:09.267843 30605 catalog_manager.cc:5697] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460 reported cstate change: term changed from 2 to 3, leader changed from 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132) to 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129). New cstate: current_term: 3 leader_uuid: "6c5665c17e904fc692bce76fc57b2460" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:09.269207 30605 catalog_manager.cc:5697] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460 reported cstate change: term changed from 2 to 3, leader changed from 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132) to 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129). New cstate: current_term: 3 leader_uuid: "6c5665c17e904fc692bce76fc57b2460" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:09.277808 31770 raft_consensus.cc:993] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7: : Instructing follower 6c5665c17e904fc692bce76fc57b2460 to start an election
I20260709 12:14:09.278323 31744 raft_consensus.cc:1081] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7 [term 1 LEADER]: Signalling peer 6c5665c17e904fc692bce76fc57b2460 to start an election
I20260709 12:14:09.279769 31647 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b66a7b6f8aa4803b482e392cc945db7"
dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
 from {username='slave'} at 127.0.0.1:54514
I20260709 12:14:09.280237 31647 raft_consensus.cc:493] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:09.280566 31647 raft_consensus.cc:3060] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:09.286845 30605 catalog_manager.cc:5697] T ec7d33fd7f3245f68966bd7749ee53c3 P 6c5665c17e904fc692bce76fc57b2460 reported cstate change: term changed from 1 to 2, leader changed from 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130) to 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129). New cstate: current_term: 2 leader_uuid: "6c5665c17e904fc692bce76fc57b2460" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:09.287889 31647 raft_consensus.cc:515] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:14:09.289939 31647 leader_election.cc:290] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 2 election: Requested vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:14:09.290524 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b66a7b6f8aa4803b482e392cc945db7" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:14:09.290769 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b66a7b6f8aa4803b482e392cc945db7" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
I20260709 12:14:09.291183 30851 raft_consensus.cc:3060] T 8b66a7b6f8aa4803b482e392cc945db7 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:09.291365 30928 raft_consensus.cc:3055] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:09.291651 30928 raft_consensus.cc:740] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Running, Role: LEADER
I20260709 12:14:09.292304 30928 consensus_queue.cc:260] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:14:09.293298 30928 raft_consensus.cc:3060] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:09.299588 30851 raft_consensus.cc:2468] T 8b66a7b6f8aa4803b482e392cc945db7 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 2.
I20260709 12:14:09.301008 30928 raft_consensus.cc:2468] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 2.
I20260709 12:14:09.302045 31516 leader_election.cc:304] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 6c5665c17e904fc692bce76fc57b2460; no voters: 
I20260709 12:14:09.302875 31778 raft_consensus.cc:2804] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:09.303251 31744 raft_consensus.cc:993] T d5a270750666414887b6fae2f3793dc5 P 15ad0880a63541ef965cb6acca4513d7: : Instructing follower 8130e18710c04a61a5d8bd019c6ffdad to start an election
I20260709 12:14:09.303409 31778 raft_consensus.cc:697] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460 [term 2 LEADER]: Becoming Leader. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Running, Role: LEADER
I20260709 12:14:09.303859 31770 raft_consensus.cc:1081] T d5a270750666414887b6fae2f3793dc5 P 15ad0880a63541ef965cb6acca4513d7 [term 1 LEADER]: Signalling peer 8130e18710c04a61a5d8bd019c6ffdad to start an election
I20260709 12:14:09.304610 31778 consensus_queue.cc:237] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:14:09.305466 30854 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d5a270750666414887b6fae2f3793dc5"
dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
 from {username='slave'} at 127.0.0.1:35910
I20260709 12:14:09.305963 30854 raft_consensus.cc:493] T d5a270750666414887b6fae2f3793dc5 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:09.306308 30854 raft_consensus.cc:3060] T d5a270750666414887b6fae2f3793dc5 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:09.313702 30854 raft_consensus.cc:515] T d5a270750666414887b6fae2f3793dc5 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:14:09.317313 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a270750666414887b6fae2f3793dc5" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:14:09.317588 30854 leader_election.cc:290] T d5a270750666414887b6fae2f3793dc5 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 2 election: Requested vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:14:09.317924 30778 raft_consensus.cc:3060] T d5a270750666414887b6fae2f3793dc5 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:09.328126 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a270750666414887b6fae2f3793dc5" candidate_uuid: "8130e18710c04a61a5d8bd019c6ffdad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
I20260709 12:14:09.328773 30928 raft_consensus.cc:3055] T d5a270750666414887b6fae2f3793dc5 P 15ad0880a63541ef965cb6acca4513d7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:09.329130 30928 raft_consensus.cc:740] T d5a270750666414887b6fae2f3793dc5 P 15ad0880a63541ef965cb6acca4513d7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Running, Role: LEADER
I20260709 12:14:09.329840 30928 consensus_queue.cc:260] T d5a270750666414887b6fae2f3793dc5 P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:14:09.330660 30928 raft_consensus.cc:3060] T d5a270750666414887b6fae2f3793dc5 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:09.330205 30605 catalog_manager.cc:5697] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460 reported cstate change: term changed from 1 to 2, leader changed from 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132) to 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129). New cstate: current_term: 2 leader_uuid: "6c5665c17e904fc692bce76fc57b2460" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:09.336674 30778 raft_consensus.cc:2468] T d5a270750666414887b6fae2f3793dc5 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 2.
I20260709 12:14:09.337744 30780 raft_consensus.cc:1240] T d5a270750666414887b6fae2f3793dc5 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Rejecting Update request from peer 15ad0880a63541ef965cb6acca4513d7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:09.338261 30822 leader_election.cc:304] T d5a270750666414887b6fae2f3793dc5 P 8130e18710c04a61a5d8bd019c6ffdad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8130e18710c04a61a5d8bd019c6ffdad, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:14:09.339273 31777 raft_consensus.cc:2804] T d5a270750666414887b6fae2f3793dc5 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:09.340086 31777 raft_consensus.cc:697] T d5a270750666414887b6fae2f3793dc5 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 LEADER]: Becoming Leader. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Running, Role: LEADER
I20260709 12:14:09.342013 30928 raft_consensus.cc:2468] T d5a270750666414887b6fae2f3793dc5 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8130e18710c04a61a5d8bd019c6ffdad in term 2.
I20260709 12:14:09.342604 31777 consensus_queue.cc:237] T d5a270750666414887b6fae2f3793dc5 P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:14:09.354957 30605 catalog_manager.cc:5697] T d5a270750666414887b6fae2f3793dc5 P 8130e18710c04a61a5d8bd019c6ffdad reported cstate change: term changed from 1 to 2, leader changed from 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132) to 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131). New cstate: current_term: 2 leader_uuid: "8130e18710c04a61a5d8bd019c6ffdad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:09.414716 31763 raft_consensus.cc:993] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad: : Instructing follower 6c5665c17e904fc692bce76fc57b2460 to start an election
I20260709 12:14:09.415285 31763 raft_consensus.cc:1081] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [term 4 LEADER]: Signalling peer 6c5665c17e904fc692bce76fc57b2460 to start an election
I20260709 12:14:09.416643 31647 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0317908edb88497b82c4e59ef1bac414"
dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
 from {username='slave'} at 127.0.0.1:54498
I20260709 12:14:09.417068 31647 raft_consensus.cc:493] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:09.417289 31647 raft_consensus.cc:3060] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:09.422712 31647 raft_consensus.cc:515] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:14:09.424003 31647 leader_election.cc:290] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 5 election: Requested vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:14:09.424721 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0317908edb88497b82c4e59ef1bac414" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:14:09.424999 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0317908edb88497b82c4e59ef1bac414" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:14:09.425352 30780 raft_consensus.cc:3060] T 0317908edb88497b82c4e59ef1bac414 P 84b98f9236604dd0b22ae23c5378a676 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:09.425544 30854 raft_consensus.cc:3055] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:09.425894 30854 raft_consensus.cc:740] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Running, Role: LEADER
I20260709 12:14:09.426560 30854 consensus_queue.cc:260] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:14:09.427477 30854 raft_consensus.cc:3060] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:09.430173 30780 raft_consensus.cc:2468] T 0317908edb88497b82c4e59ef1bac414 P 84b98f9236604dd0b22ae23c5378a676 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 5.
I20260709 12:14:09.431252 31515 leader_election.cc:304] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:14:09.431921 31778 raft_consensus.cc:2804] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:09.432355 31778 raft_consensus.cc:697] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [term 5 LEADER]: Becoming Leader. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Running, Role: LEADER
I20260709 12:14:09.432730 30854 raft_consensus.cc:2468] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 5.
I20260709 12:14:09.433403 31778 consensus_queue.cc:237] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:14:09.444192 30605 catalog_manager.cc:5697] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 reported cstate change: term changed from 4 to 5, leader changed from 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131) to 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129). New cstate: current_term: 5 leader_uuid: "6c5665c17e904fc692bce76fc57b2460" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:09.554533 30928 raft_consensus.cc:1275] T 1bbb677d9c544ed5a31297773b1508d6 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Refusing update from remote peer 8130e18710c04a61a5d8bd019c6ffdad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:09.555833 31763 consensus_queue.cc:1048] T 1bbb677d9c544ed5a31297773b1508d6 P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Connected to new peer: Peer: permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:09.567678 30778 raft_consensus.cc:1275] T 1bbb677d9c544ed5a31297773b1508d6 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Refusing update from remote peer 8130e18710c04a61a5d8bd019c6ffdad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:09.571159 31763 consensus_queue.cc:1048] T 1bbb677d9c544ed5a31297773b1508d6 P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Connected to new peer: Peer: permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:09.627140 30928 raft_consensus.cc:1275] T ec7d33fd7f3245f68966bd7749ee53c3 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Refusing update from remote peer 6c5665c17e904fc692bce76fc57b2460: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:09.628523 31778 consensus_queue.cc:1048] T ec7d33fd7f3245f68966bd7749ee53c3 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:09.641820 30778 raft_consensus.cc:1275] T ec7d33fd7f3245f68966bd7749ee53c3 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Refusing update from remote peer 6c5665c17e904fc692bce76fc57b2460: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:09.643487 31778 consensus_queue.cc:1048] T ec7d33fd7f3245f68966bd7749ee53c3 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:09.674070 30928 raft_consensus.cc:1275] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7 [term 3 FOLLOWER]: Refusing update from remote peer 6c5665c17e904fc692bce76fc57b2460: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:09.675153 31778 consensus_queue.cc:1048] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:09.684059 30778 raft_consensus.cc:1275] T baedd172e30a4ef4a6641302fdebd9c5 P 84b98f9236604dd0b22ae23c5378a676 [term 3 FOLLOWER]: Refusing update from remote peer 6c5665c17e904fc692bce76fc57b2460: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:09.686811 31781 consensus_queue.cc:1048] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:09.699651 30854 raft_consensus.cc:1275] T 8b66a7b6f8aa4803b482e392cc945db7 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Refusing update from remote peer 6c5665c17e904fc692bce76fc57b2460: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:09.701414 31781 consensus_queue.cc:1048] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:09.703222 30854 raft_consensus.cc:1275] T fd65967534164e9c805fc3d5d05e0369 P 8130e18710c04a61a5d8bd019c6ffdad [term 3 FOLLOWER]: Refusing update from remote peer 6c5665c17e904fc692bce76fc57b2460: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:09.713326 31781 consensus_queue.cc:1048] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:09.728566 30928 raft_consensus.cc:1275] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Refusing update from remote peer 6c5665c17e904fc692bce76fc57b2460: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:09.730716 31781 consensus_queue.cc:1048] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:09.732167 30928 raft_consensus.cc:1275] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7 [term 3 FOLLOWER]: Refusing update from remote peer 6c5665c17e904fc692bce76fc57b2460: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:09.736184 31779 consensus_queue.cc:1048] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:09.912115 30924 raft_consensus.cc:1275] T d5a270750666414887b6fae2f3793dc5 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Refusing update from remote peer 8130e18710c04a61a5d8bd019c6ffdad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:09.913407 31767 consensus_queue.cc:1048] T d5a270750666414887b6fae2f3793dc5 P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Connected to new peer: Peer: permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:09.922930 30778 raft_consensus.cc:1275] T d5a270750666414887b6fae2f3793dc5 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Refusing update from remote peer 8130e18710c04a61a5d8bd019c6ffdad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:09.924304 31777 consensus_queue.cc:1048] T d5a270750666414887b6fae2f3793dc5 P 8130e18710c04a61a5d8bd019c6ffdad [LEADER]: Connected to new peer: Peer: permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:09.935361 30778 raft_consensus.cc:1275] T 0317908edb88497b82c4e59ef1bac414 P 84b98f9236604dd0b22ae23c5378a676 [term 5 FOLLOWER]: Refusing update from remote peer 6c5665c17e904fc692bce76fc57b2460: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:14:09.936311 30855 raft_consensus.cc:1275] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [term 5 FOLLOWER]: Refusing update from remote peer 6c5665c17e904fc692bce76fc57b2460: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:14:09.937410 31804 consensus_queue.cc:1048] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:09.938163 31778 consensus_queue.cc:1048] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:10.164450 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:10.206836 30928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1eb80935abae44bf8dde4d54961c5fdb"
dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
mode: GRACEFUL
new_leader_uuid: "6c5665c17e904fc692bce76fc57b2460"
 from {username='slave'} at 127.0.0.1:40644
I20260709 12:14:10.207432 30928 raft_consensus.cc:606] T 1eb80935abae44bf8dde4d54961c5fdb P 15ad0880a63541ef965cb6acca4513d7 [term 2 LEADER]: Received request to transfer leadership to TS 6c5665c17e904fc692bce76fc57b2460
I20260709 12:14:10.210182 30854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2bd90e4c16c54e13ae2b1c1e08d6238c"
dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
mode: GRACEFUL
new_leader_uuid: "6c5665c17e904fc692bce76fc57b2460"
 from {username='slave'} at 127.0.0.1:49054
I20260709 12:14:10.210863 30854 raft_consensus.cc:606] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 8130e18710c04a61a5d8bd019c6ffdad [term 1 LEADER]: Received request to transfer leadership to TS 6c5665c17e904fc692bce76fc57b2460
I20260709 12:14:10.213881 30780 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0bb1498511242ef95085be49c10c4d3"
dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
mode: GRACEFUL
new_leader_uuid: "6c5665c17e904fc692bce76fc57b2460"
 from {username='slave'} at 127.0.0.1:46850
I20260709 12:14:10.214471 30780 raft_consensus.cc:606] T a0bb1498511242ef95085be49c10c4d3 P 84b98f9236604dd0b22ae23c5378a676 [term 2 LEADER]: Received request to transfer leadership to TS 6c5665c17e904fc692bce76fc57b2460
I20260709 12:14:10.222442 30924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c52d3c5b6b15499e9c834cf33954609a"
dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
mode: GRACEFUL
new_leader_uuid: "6c5665c17e904fc692bce76fc57b2460"
 from {username='slave'} at 127.0.0.1:40644
I20260709 12:14:10.223106 30924 raft_consensus.cc:606] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7 [term 2 LEADER]: Received request to transfer leadership to TS 6c5665c17e904fc692bce76fc57b2460
I20260709 12:14:10.225947 30855 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da25c47d7366434089b73f8af7ce453b"
dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
mode: GRACEFUL
new_leader_uuid: "15ad0880a63541ef965cb6acca4513d7"
 from {username='slave'} at 127.0.0.1:49054
I20260709 12:14:10.226537 30855 raft_consensus.cc:606] T da25c47d7366434089b73f8af7ce453b P 8130e18710c04a61a5d8bd019c6ffdad [term 1 LEADER]: Received request to transfer leadership to TS 15ad0880a63541ef965cb6acca4513d7
I20260709 12:14:10.227783 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:14:10.229539 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:10.230175 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:10.279989 31770 raft_consensus.cc:993] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7: : Instructing follower 6c5665c17e904fc692bce76fc57b2460 to start an election
I20260709 12:14:10.280493 31766 raft_consensus.cc:1081] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7 [term 2 LEADER]: Signalling peer 6c5665c17e904fc692bce76fc57b2460 to start an election
I20260709 12:14:10.281898 31647 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c52d3c5b6b15499e9c834cf33954609a"
dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
 from {username='slave'} at 127.0.0.1:54514
I20260709 12:14:10.282315 31647 raft_consensus.cc:493] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:10.282600 31647 raft_consensus.cc:3060] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:10.287423 31647 raft_consensus.cc:515] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:14:10.289065 31647 leader_election.cc:290] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 3 election: Requested vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:14:10.290133 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c52d3c5b6b15499e9c834cf33954609a" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
I20260709 12:14:10.290262 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c52d3c5b6b15499e9c834cf33954609a" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:14:10.290776 30928 raft_consensus.cc:3055] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:10.290958 30778 raft_consensus.cc:3060] T c52d3c5b6b15499e9c834cf33954609a P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:10.291154 30928 raft_consensus.cc:740] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Running, Role: LEADER
I20260709 12:14:10.291920 30928 consensus_queue.cc:260] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:14:10.293219 30928 raft_consensus.cc:3060] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:10.298925 30778 raft_consensus.cc:2468] T c52d3c5b6b15499e9c834cf33954609a P 84b98f9236604dd0b22ae23c5378a676 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 3.
I20260709 12:14:10.300038 30928 raft_consensus.cc:2468] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 3.
I20260709 12:14:10.300770 31515 leader_election.cc:304] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:14:10.301627 31778 raft_consensus.cc:2804] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:10.302081 31778 raft_consensus.cc:697] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 [term 3 LEADER]: Becoming Leader. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Running, Role: LEADER
I20260709 12:14:10.303050 31778 consensus_queue.cc:237] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:14:10.314651 30605 catalog_manager.cc:5697] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 reported cstate change: term changed from 2 to 3, leader changed from 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132) to 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129). New cstate: current_term: 3 leader_uuid: "6c5665c17e904fc692bce76fc57b2460" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:10.480499 31764 raft_consensus.cc:993] T a0bb1498511242ef95085be49c10c4d3 P 84b98f9236604dd0b22ae23c5378a676: : Instructing follower 6c5665c17e904fc692bce76fc57b2460 to start an election
I20260709 12:14:10.481011 31761 raft_consensus.cc:1081] T a0bb1498511242ef95085be49c10c4d3 P 84b98f9236604dd0b22ae23c5378a676 [term 2 LEADER]: Signalling peer 6c5665c17e904fc692bce76fc57b2460 to start an election
I20260709 12:14:10.482513 31647 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0bb1498511242ef95085be49c10c4d3"
dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
 from {username='slave'} at 127.0.0.1:54516
I20260709 12:14:10.482954 31647 raft_consensus.cc:493] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:10.483253 31647 raft_consensus.cc:3060] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:10.489037 31647 raft_consensus.cc:515] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:14:10.490566 31647 leader_election.cc:290] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 3 election: Requested vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:14:10.491080 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0bb1498511242ef95085be49c10c4d3" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:14:10.491664 30778 raft_consensus.cc:3055] T a0bb1498511242ef95085be49c10c4d3 P 84b98f9236604dd0b22ae23c5378a676 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:10.491760 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0bb1498511242ef95085be49c10c4d3" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:14:10.492043 30778 raft_consensus.cc:740] T a0bb1498511242ef95085be49c10c4d3 P 84b98f9236604dd0b22ae23c5378a676 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Running, Role: LEADER
I20260709 12:14:10.492513 30855 raft_consensus.cc:3060] T a0bb1498511242ef95085be49c10c4d3 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:10.493062 30778 consensus_queue.cc:260] T a0bb1498511242ef95085be49c10c4d3 P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:14:10.494267 30778 raft_consensus.cc:3060] T a0bb1498511242ef95085be49c10c4d3 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:10.499102 30855 raft_consensus.cc:2468] T a0bb1498511242ef95085be49c10c4d3 P 8130e18710c04a61a5d8bd019c6ffdad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 3.
I20260709 12:14:10.499972 30778 raft_consensus.cc:2468] T a0bb1498511242ef95085be49c10c4d3 P 84b98f9236604dd0b22ae23c5378a676 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 3.
I20260709 12:14:10.500222 31515 leader_election.cc:304] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 
I20260709 12:14:10.501137 31778 raft_consensus.cc:2804] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:10.501616 31778 raft_consensus.cc:697] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460 [term 3 LEADER]: Becoming Leader. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Running, Role: LEADER
I20260709 12:14:10.502385 31778 consensus_queue.cc:237] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:14:10.512856 30605 catalog_manager.cc:5697] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460 reported cstate change: term changed from 2 to 3, leader changed from 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130) to 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129). New cstate: current_term: 3 leader_uuid: "6c5665c17e904fc692bce76fc57b2460" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:10.553011 31763 raft_consensus.cc:993] T da25c47d7366434089b73f8af7ce453b P 8130e18710c04a61a5d8bd019c6ffdad: : Instructing follower 15ad0880a63541ef965cb6acca4513d7 to start an election
I20260709 12:14:10.553503 31767 raft_consensus.cc:1081] T da25c47d7366434089b73f8af7ce453b P 8130e18710c04a61a5d8bd019c6ffdad [term 1 LEADER]: Signalling peer 15ad0880a63541ef965cb6acca4513d7 to start an election
I20260709 12:14:10.555241 30928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da25c47d7366434089b73f8af7ce453b"
dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
 from {username='slave'} at 127.0.0.1:53440
I20260709 12:14:10.555747 30928 raft_consensus.cc:493] T da25c47d7366434089b73f8af7ce453b P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:10.556003 30928 raft_consensus.cc:3060] T da25c47d7366434089b73f8af7ce453b P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:10.561555 30928 raft_consensus.cc:515] T da25c47d7366434089b73f8af7ce453b P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:14:10.564067 30928 leader_election.cc:290] T da25c47d7366434089b73f8af7ce453b P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 election: Requested vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:14:10.565809 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da25c47d7366434089b73f8af7ce453b" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:14:10.566427 30855 raft_consensus.cc:3055] T da25c47d7366434089b73f8af7ce453b P 8130e18710c04a61a5d8bd019c6ffdad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:10.566753 30855 raft_consensus.cc:740] T da25c47d7366434089b73f8af7ce453b P 8130e18710c04a61a5d8bd019c6ffdad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Running, Role: LEADER
I20260709 12:14:10.566622 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da25c47d7366434089b73f8af7ce453b" candidate_uuid: "15ad0880a63541ef965cb6acca4513d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:14:10.567399 30778 raft_consensus.cc:3060] T da25c47d7366434089b73f8af7ce453b P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:10.567683 30855 consensus_queue.cc:260] T da25c47d7366434089b73f8af7ce453b P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:14:10.568670 30855 raft_consensus.cc:3060] T da25c47d7366434089b73f8af7ce453b P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:10.574608 30855 raft_consensus.cc:2468] T da25c47d7366434089b73f8af7ce453b P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 2.
I20260709 12:14:10.575690 30778 raft_consensus.cc:2468] T da25c47d7366434089b73f8af7ce453b P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15ad0880a63541ef965cb6acca4513d7 in term 2.
I20260709 12:14:10.575709 30896 leader_election.cc:304] T da25c47d7366434089b73f8af7ce453b P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 
I20260709 12:14:10.577275 31766 raft_consensus.cc:2804] T da25c47d7366434089b73f8af7ce453b P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:10.577667 31766 raft_consensus.cc:697] T da25c47d7366434089b73f8af7ce453b P 15ad0880a63541ef965cb6acca4513d7 [term 2 LEADER]: Becoming Leader. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Running, Role: LEADER
I20260709 12:14:10.578366 31766 consensus_queue.cc:237] T da25c47d7366434089b73f8af7ce453b P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } }
I20260709 12:14:10.599007 30605 catalog_manager.cc:5697] T da25c47d7366434089b73f8af7ce453b P 15ad0880a63541ef965cb6acca4513d7 reported cstate change: term changed from 1 to 2, leader changed from 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131) to 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132). New cstate: current_term: 2 leader_uuid: "15ad0880a63541ef965cb6acca4513d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:10.655745 31817 raft_consensus.cc:993] T 1eb80935abae44bf8dde4d54961c5fdb P 15ad0880a63541ef965cb6acca4513d7: : Instructing follower 6c5665c17e904fc692bce76fc57b2460 to start an election
I20260709 12:14:10.656224 31766 raft_consensus.cc:1081] T 1eb80935abae44bf8dde4d54961c5fdb P 15ad0880a63541ef965cb6acca4513d7 [term 2 LEADER]: Signalling peer 6c5665c17e904fc692bce76fc57b2460 to start an election
I20260709 12:14:10.657299 31767 raft_consensus.cc:993] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 8130e18710c04a61a5d8bd019c6ffdad: : Instructing follower 6c5665c17e904fc692bce76fc57b2460 to start an election
I20260709 12:14:10.657557 31645 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1eb80935abae44bf8dde4d54961c5fdb"
dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
 from {username='slave'} at 127.0.0.1:54514
I20260709 12:14:10.657871 31763 raft_consensus.cc:1081] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 8130e18710c04a61a5d8bd019c6ffdad [term 1 LEADER]: Signalling peer 6c5665c17e904fc692bce76fc57b2460 to start an election
I20260709 12:14:10.658133 31645 raft_consensus.cc:493] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:10.658511 31645 raft_consensus.cc:3060] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:10.659401 31647 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2bd90e4c16c54e13ae2b1c1e08d6238c"
dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
 from {username='slave'} at 127.0.0.1:54498
I20260709 12:14:10.659868 31647 raft_consensus.cc:493] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:10.660152 31647 raft_consensus.cc:3060] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:10.663515 31645 raft_consensus.cc:515] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:14:10.665234 31647 raft_consensus.cc:515] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:14:10.665664 31645 leader_election.cc:290] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 3 election: Requested vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035)
I20260709 12:14:10.665905 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb80935abae44bf8dde4d54961c5fdb" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:14:10.666460 30855 raft_consensus.cc:3060] T 1eb80935abae44bf8dde4d54961c5fdb P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:10.666383 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb80935abae44bf8dde4d54961c5fdb" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
I20260709 12:14:10.668038 30928 raft_consensus.cc:3055] T 1eb80935abae44bf8dde4d54961c5fdb P 15ad0880a63541ef965cb6acca4513d7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:10.667128 31647 leader_election.cc:290] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 2 election: Requested vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:14:10.668335 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd90e4c16c54e13ae2b1c1e08d6238c" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:14:10.668396 30928 raft_consensus.cc:740] T 1eb80935abae44bf8dde4d54961c5fdb P 15ad0880a63541ef965cb6acca4513d7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Running, Role: LEADER
I20260709 12:14:10.669102 30778 raft_consensus.cc:3060] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:10.669868 30928 consensus_queue.cc:260] T 1eb80935abae44bf8dde4d54961c5fdb P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:14:10.671325 30928 raft_consensus.cc:3060] T 1eb80935abae44bf8dde4d54961c5fdb P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:10.674027 30855 raft_consensus.cc:2468] T 1eb80935abae44bf8dde4d54961c5fdb P 8130e18710c04a61a5d8bd019c6ffdad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 3.
I20260709 12:14:10.675114 31515 leader_election.cc:304] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 
I20260709 12:14:10.675525 30778 raft_consensus.cc:2468] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 2.
I20260709 12:14:10.676409 31778 raft_consensus.cc:2804] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:10.676966 31778 raft_consensus.cc:697] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460 [term 3 LEADER]: Becoming Leader. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Running, Role: LEADER
I20260709 12:14:10.668349 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd90e4c16c54e13ae2b1c1e08d6238c" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:14:10.677769 30854 raft_consensus.cc:3055] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 8130e18710c04a61a5d8bd019c6ffdad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:10.678154 30854 raft_consensus.cc:740] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 8130e18710c04a61a5d8bd019c6ffdad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8130e18710c04a61a5d8bd019c6ffdad, State: Running, Role: LEADER
I20260709 12:14:10.677838 31778 consensus_queue.cc:237] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:14:10.684832 31515 leader_election.cc:304] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:14:10.686542 31784 raft_consensus.cc:2804] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:10.678964 30854 consensus_queue.cc:260] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 8130e18710c04a61a5d8bd019c6ffdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:14:10.687026 31784 raft_consensus.cc:697] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 6c5665c17e904fc692bce76fc57b2460 [term 2 LEADER]: Becoming Leader. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Running, Role: LEADER
I20260709 12:14:10.687687 30854 raft_consensus.cc:3060] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:10.687887 31784 consensus_queue.cc:237] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:14:10.704371 30854 raft_consensus.cc:2468] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 2.
I20260709 12:14:10.679014 30928 raft_consensus.cc:2468] T 1eb80935abae44bf8dde4d54961c5fdb P 15ad0880a63541ef965cb6acca4513d7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 3.
I20260709 12:14:10.712580 30605 catalog_manager.cc:5697] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460 reported cstate change: term changed from 2 to 3, leader changed from 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132) to 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129). New cstate: current_term: 3 leader_uuid: "6c5665c17e904fc692bce76fc57b2460" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:10.727464 30605 catalog_manager.cc:5697] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 6c5665c17e904fc692bce76fc57b2460 reported cstate change: term changed from 1 to 2, leader changed from 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131) to 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129). New cstate: current_term: 2 leader_uuid: "6c5665c17e904fc692bce76fc57b2460" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:10.817569 30778 raft_consensus.cc:1275] T c52d3c5b6b15499e9c834cf33954609a P 84b98f9236604dd0b22ae23c5378a676 [term 3 FOLLOWER]: Refusing update from remote peer 6c5665c17e904fc692bce76fc57b2460: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:10.818900 31804 consensus_queue.cc:1048] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:10.836795 30924 raft_consensus.cc:1275] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7 [term 3 FOLLOWER]: Refusing update from remote peer 6c5665c17e904fc692bce76fc57b2460: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:10.862864 31804 consensus_queue.cc:1048] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:10.954947 30778 raft_consensus.cc:1275] T a0bb1498511242ef95085be49c10c4d3 P 84b98f9236604dd0b22ae23c5378a676 [term 3 FOLLOWER]: Refusing update from remote peer 6c5665c17e904fc692bce76fc57b2460: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:10.956259 31820 consensus_queue.cc:1048] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:10.966696 30854 raft_consensus.cc:1275] T a0bb1498511242ef95085be49c10c4d3 P 8130e18710c04a61a5d8bd019c6ffdad [term 3 FOLLOWER]: Refusing update from remote peer 6c5665c17e904fc692bce76fc57b2460: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:10.968361 31784 consensus_queue.cc:1048] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:10.971473 30778 raft_consensus.cc:1275] T da25c47d7366434089b73f8af7ce453b P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Refusing update from remote peer 15ad0880a63541ef965cb6acca4513d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:10.972659 31766 consensus_queue.cc:1048] T da25c47d7366434089b73f8af7ce453b P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:10.984580 30854 raft_consensus.cc:1275] T da25c47d7366434089b73f8af7ce453b P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Refusing update from remote peer 15ad0880a63541ef965cb6acca4513d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:10.986460 31817 consensus_queue.cc:1048] T da25c47d7366434089b73f8af7ce453b P 15ad0880a63541ef965cb6acca4513d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:11.187048 30854 raft_consensus.cc:1275] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Refusing update from remote peer 6c5665c17e904fc692bce76fc57b2460: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:11.188508 31784 consensus_queue.cc:1048] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:11.198218 30778 raft_consensus.cc:1275] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Refusing update from remote peer 6c5665c17e904fc692bce76fc57b2460: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:11.200616 31778 consensus_queue.cc:1048] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:11.215677 30854 raft_consensus.cc:1275] T 1eb80935abae44bf8dde4d54961c5fdb P 8130e18710c04a61a5d8bd019c6ffdad [term 3 FOLLOWER]: Refusing update from remote peer 6c5665c17e904fc692bce76fc57b2460: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:11.217594 31820 consensus_queue.cc:1048] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:11.232293 30924 raft_consensus.cc:1275] T 1eb80935abae44bf8dde4d54961c5fdb P 15ad0880a63541ef965cb6acca4513d7 [term 3 FOLLOWER]: Refusing update from remote peer 6c5665c17e904fc692bce76fc57b2460: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:11.233798 31778 consensus_queue.cc:1048] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:11.269280 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:11.313745 30778 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "554acf71459c4e59b886396df52b3004"
dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
mode: GRACEFUL
new_leader_uuid: "6c5665c17e904fc692bce76fc57b2460"
 from {username='slave'} at 127.0.0.1:46850
I20260709 12:14:11.314311 30778 raft_consensus.cc:606] T 554acf71459c4e59b886396df52b3004 P 84b98f9236604dd0b22ae23c5378a676 [term 1 LEADER]: Received request to transfer leadership to TS 6c5665c17e904fc692bce76fc57b2460
I20260709 12:14:11.316905 30928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a318673515aa415db1aa91d126a5b724"
dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
mode: GRACEFUL
new_leader_uuid: "6c5665c17e904fc692bce76fc57b2460"
 from {username='slave'} at 127.0.0.1:40644
I20260709 12:14:11.317420 30928 raft_consensus.cc:606] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7 [term 1 LEADER]: Received request to transfer leadership to TS 6c5665c17e904fc692bce76fc57b2460
I20260709 12:14:11.320174 30778 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cdf560ffbc0c4b8b80beb6494a13d9cd"
dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
mode: GRACEFUL
new_leader_uuid: "6c5665c17e904fc692bce76fc57b2460"
 from {username='slave'} at 127.0.0.1:46850
I20260709 12:14:11.320591 30778 raft_consensus.cc:606] T cdf560ffbc0c4b8b80beb6494a13d9cd P 84b98f9236604dd0b22ae23c5378a676 [term 2 LEADER]: Received request to transfer leadership to TS 6c5665c17e904fc692bce76fc57b2460
I20260709 12:14:11.322674 30778 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e57ee667f8a246eb98ab6b169eb779b9"
dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
mode: GRACEFUL
new_leader_uuid: "6c5665c17e904fc692bce76fc57b2460"
 from {username='slave'} at 127.0.0.1:46850
I20260709 12:14:11.323096 30778 raft_consensus.cc:606] T e57ee667f8a246eb98ab6b169eb779b9 P 84b98f9236604dd0b22ae23c5378a676 [term 1 LEADER]: Received request to transfer leadership to TS 6c5665c17e904fc692bce76fc57b2460
I20260709 12:14:11.325006 30778 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0fbdcbe46b34107bbbf63f69c98e244"
dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
mode: GRACEFUL
new_leader_uuid: "6c5665c17e904fc692bce76fc57b2460"
 from {username='slave'} at 127.0.0.1:46850
I20260709 12:14:11.325436 30778 raft_consensus.cc:606] T f0fbdcbe46b34107bbbf63f69c98e244 P 84b98f9236604dd0b22ae23c5378a676 [term 1 LEADER]: Received request to transfer leadership to TS 6c5665c17e904fc692bce76fc57b2460
I20260709 12:14:11.326458 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:14:11.328027 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:11.328685 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:11.445788 31766 raft_consensus.cc:993] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7: : Instructing follower 6c5665c17e904fc692bce76fc57b2460 to start an election
I20260709 12:14:11.446261 31770 raft_consensus.cc:1081] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7 [term 1 LEADER]: Signalling peer 6c5665c17e904fc692bce76fc57b2460 to start an election
I20260709 12:14:11.447603 31645 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a318673515aa415db1aa91d126a5b724"
dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
 from {username='slave'} at 127.0.0.1:54514
I20260709 12:14:11.448045 31645 raft_consensus.cc:493] T a318673515aa415db1aa91d126a5b724 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:11.448293 31645 raft_consensus.cc:3060] T a318673515aa415db1aa91d126a5b724 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:11.453665 31645 raft_consensus.cc:515] T a318673515aa415db1aa91d126a5b724 P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:14:11.455236 31645 leader_election.cc:290] T a318673515aa415db1aa91d126a5b724 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 2 election: Requested vote from peers 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132:43035), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:14:11.455848 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a318673515aa415db1aa91d126a5b724" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "15ad0880a63541ef965cb6acca4513d7"
I20260709 12:14:11.456441 30928 raft_consensus.cc:3055] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:11.456856 30928 raft_consensus.cc:740] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 15ad0880a63541ef965cb6acca4513d7, State: Running, Role: LEADER
I20260709 12:14:11.456357 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a318673515aa415db1aa91d126a5b724" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:14:11.457340 30778 raft_consensus.cc:3060] T a318673515aa415db1aa91d126a5b724 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:11.457563 30928 consensus_queue.cc:260] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:14:11.458736 30928 raft_consensus.cc:3060] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:11.463701 31764 raft_consensus.cc:993] T e57ee667f8a246eb98ab6b169eb779b9 P 84b98f9236604dd0b22ae23c5378a676: : Instructing follower 6c5665c17e904fc692bce76fc57b2460 to start an election
I20260709 12:14:11.464003 30778 raft_consensus.cc:2468] T a318673515aa415db1aa91d126a5b724 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 2.
I20260709 12:14:11.464141 31764 raft_consensus.cc:1081] T e57ee667f8a246eb98ab6b169eb779b9 P 84b98f9236604dd0b22ae23c5378a676 [term 1 LEADER]: Signalling peer 6c5665c17e904fc692bce76fc57b2460 to start an election
I20260709 12:14:11.464982 31515 leader_election.cc:304] T a318673515aa415db1aa91d126a5b724 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460, 84b98f9236604dd0b22ae23c5378a676; no voters: 
I20260709 12:14:11.465762 31804 raft_consensus.cc:2804] T a318673515aa415db1aa91d126a5b724 P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:11.466259 31804 raft_consensus.cc:697] T a318673515aa415db1aa91d126a5b724 P 6c5665c17e904fc692bce76fc57b2460 [term 2 LEADER]: Becoming Leader. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Running, Role: LEADER
I20260709 12:14:11.466421 31645 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e57ee667f8a246eb98ab6b169eb779b9"
dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
 from {username='slave'} at 127.0.0.1:54516
I20260709 12:14:11.467010 31645 raft_consensus.cc:493] T e57ee667f8a246eb98ab6b169eb779b9 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:11.467345 31645 raft_consensus.cc:3060] T e57ee667f8a246eb98ab6b169eb779b9 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:11.467213 31804 consensus_queue.cc:237] T a318673515aa415db1aa91d126a5b724 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:14:11.469035 30928 raft_consensus.cc:2468] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 2.
I20260709 12:14:11.474715 31645 raft_consensus.cc:515] T e57ee667f8a246eb98ab6b169eb779b9 P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:14:11.476598 31645 leader_election.cc:290] T e57ee667f8a246eb98ab6b169eb779b9 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 2 election: Requested vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:14:11.478497 30607 catalog_manager.cc:5697] T a318673515aa415db1aa91d126a5b724 P 6c5665c17e904fc692bce76fc57b2460 reported cstate change: term changed from 1 to 2, leader changed from 15ad0880a63541ef965cb6acca4513d7 (127.20.196.132) to 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129). New cstate: current_term: 2 leader_uuid: "6c5665c17e904fc692bce76fc57b2460" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:11.479712 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57ee667f8a246eb98ab6b169eb779b9" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:14:11.480232 30854 raft_consensus.cc:3060] T e57ee667f8a246eb98ab6b169eb779b9 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:11.480064 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57ee667f8a246eb98ab6b169eb779b9" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:14:11.482187 30778 raft_consensus.cc:3055] T e57ee667f8a246eb98ab6b169eb779b9 P 84b98f9236604dd0b22ae23c5378a676 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:11.482683 30778 raft_consensus.cc:740] T e57ee667f8a246eb98ab6b169eb779b9 P 84b98f9236604dd0b22ae23c5378a676 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Running, Role: LEADER
I20260709 12:14:11.487087 30854 raft_consensus.cc:2468] T e57ee667f8a246eb98ab6b169eb779b9 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 2.
I20260709 12:14:11.483670 30778 consensus_queue.cc:260] T e57ee667f8a246eb98ab6b169eb779b9 P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:14:11.488333 30778 raft_consensus.cc:3060] T e57ee667f8a246eb98ab6b169eb779b9 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:11.488977 31515 leader_election.cc:304] T e57ee667f8a246eb98ab6b169eb779b9 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 
I20260709 12:14:11.490422 31804 raft_consensus.cc:2804] T e57ee667f8a246eb98ab6b169eb779b9 P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:11.491089 31804 raft_consensus.cc:697] T e57ee667f8a246eb98ab6b169eb779b9 P 6c5665c17e904fc692bce76fc57b2460 [term 2 LEADER]: Becoming Leader. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Running, Role: LEADER
I20260709 12:14:11.492022 31804 consensus_queue.cc:237] T e57ee667f8a246eb98ab6b169eb779b9 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:14:11.496747 30778 raft_consensus.cc:2468] T e57ee667f8a246eb98ab6b169eb779b9 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 2.
I20260709 12:14:11.511662 30605 catalog_manager.cc:5697] T e57ee667f8a246eb98ab6b169eb779b9 P 6c5665c17e904fc692bce76fc57b2460 reported cstate change: term changed from 1 to 2, leader changed from 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130) to 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129). New cstate: current_term: 2 leader_uuid: "6c5665c17e904fc692bce76fc57b2460" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:11.515636 31811 raft_consensus.cc:993] T 554acf71459c4e59b886396df52b3004 P 84b98f9236604dd0b22ae23c5378a676: : Instructing follower 6c5665c17e904fc692bce76fc57b2460 to start an election
I20260709 12:14:11.516269 31836 raft_consensus.cc:1081] T 554acf71459c4e59b886396df52b3004 P 84b98f9236604dd0b22ae23c5378a676 [term 1 LEADER]: Signalling peer 6c5665c17e904fc692bce76fc57b2460 to start an election
I20260709 12:14:11.517869 31645 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "554acf71459c4e59b886396df52b3004"
dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
 from {username='slave'} at 127.0.0.1:54516
I20260709 12:14:11.518395 31645 raft_consensus.cc:493] T 554acf71459c4e59b886396df52b3004 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:11.518714 31645 raft_consensus.cc:3060] T 554acf71459c4e59b886396df52b3004 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:11.524185 31811 raft_consensus.cc:993] T cdf560ffbc0c4b8b80beb6494a13d9cd P 84b98f9236604dd0b22ae23c5378a676: : Instructing follower 6c5665c17e904fc692bce76fc57b2460 to start an election
I20260709 12:14:11.524713 31811 raft_consensus.cc:1081] T cdf560ffbc0c4b8b80beb6494a13d9cd P 84b98f9236604dd0b22ae23c5378a676 [term 2 LEADER]: Signalling peer 6c5665c17e904fc692bce76fc57b2460 to start an election
I20260709 12:14:11.526378 31648 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cdf560ffbc0c4b8b80beb6494a13d9cd"
dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
 from {username='slave'} at 127.0.0.1:54516
I20260709 12:14:11.526916 31648 raft_consensus.cc:493] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:11.527365 31648 raft_consensus.cc:3060] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:11.526937 31645 raft_consensus.cc:515] T 554acf71459c4e59b886396df52b3004 P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:14:11.528993 31645 leader_election.cc:290] T 554acf71459c4e59b886396df52b3004 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 2 election: Requested vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:14:11.529870 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554acf71459c4e59b886396df52b3004" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:14:11.530351 30778 raft_consensus.cc:3055] T 554acf71459c4e59b886396df52b3004 P 84b98f9236604dd0b22ae23c5378a676 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:11.530587 30778 raft_consensus.cc:740] T 554acf71459c4e59b886396df52b3004 P 84b98f9236604dd0b22ae23c5378a676 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Running, Role: LEADER
I20260709 12:14:11.531313 30778 consensus_queue.cc:260] T 554acf71459c4e59b886396df52b3004 P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:14:11.532325 30778 raft_consensus.cc:3060] T 554acf71459c4e59b886396df52b3004 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:11.533200 31648 raft_consensus.cc:515] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:14:11.535138 31648 leader_election.cc:290] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 3 election: Requested vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:14:11.535295 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554acf71459c4e59b886396df52b3004" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:14:11.535681 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf560ffbc0c4b8b80beb6494a13d9cd" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:14:11.535903 30854 raft_consensus.cc:3060] T 554acf71459c4e59b886396df52b3004 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:11.536160 30780 raft_consensus.cc:3055] T cdf560ffbc0c4b8b80beb6494a13d9cd P 84b98f9236604dd0b22ae23c5378a676 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:11.536085 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf560ffbc0c4b8b80beb6494a13d9cd" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:14:11.536497 30780 raft_consensus.cc:740] T cdf560ffbc0c4b8b80beb6494a13d9cd P 84b98f9236604dd0b22ae23c5378a676 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Running, Role: LEADER
I20260709 12:14:11.536682 30855 raft_consensus.cc:3060] T cdf560ffbc0c4b8b80beb6494a13d9cd P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:11.537189 30780 consensus_queue.cc:260] T cdf560ffbc0c4b8b80beb6494a13d9cd P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:14:11.537982 30780 raft_consensus.cc:3060] T cdf560ffbc0c4b8b80beb6494a13d9cd P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:11.543210 30855 raft_consensus.cc:2468] T cdf560ffbc0c4b8b80beb6494a13d9cd P 8130e18710c04a61a5d8bd019c6ffdad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 3.
I20260709 12:14:11.544198 30780 raft_consensus.cc:2468] T cdf560ffbc0c4b8b80beb6494a13d9cd P 84b98f9236604dd0b22ae23c5378a676 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 3.
I20260709 12:14:11.544430 31515 leader_election.cc:304] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 
I20260709 12:14:11.545836 31804 raft_consensus.cc:2804] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:11.546365 31804 raft_consensus.cc:697] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460 [term 3 LEADER]: Becoming Leader. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Running, Role: LEADER
I20260709 12:14:11.547271 31804 consensus_queue.cc:237] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:14:11.548115 30854 raft_consensus.cc:2468] T 554acf71459c4e59b886396df52b3004 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 2.
I20260709 12:14:11.548550 30778 raft_consensus.cc:2468] T 554acf71459c4e59b886396df52b3004 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 2.
I20260709 12:14:11.549089 31515 leader_election.cc:304] T 554acf71459c4e59b886396df52b3004 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 
I20260709 12:14:11.549856 31778 raft_consensus.cc:2804] T 554acf71459c4e59b886396df52b3004 P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:11.550376 31778 raft_consensus.cc:697] T 554acf71459c4e59b886396df52b3004 P 6c5665c17e904fc692bce76fc57b2460 [term 2 LEADER]: Becoming Leader. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Running, Role: LEADER
I20260709 12:14:11.551363 31778 consensus_queue.cc:237] T 554acf71459c4e59b886396df52b3004 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:14:11.557548 30605 catalog_manager.cc:5697] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460 reported cstate change: term changed from 2 to 3, leader changed from 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130) to 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129). New cstate: current_term: 3 leader_uuid: "6c5665c17e904fc692bce76fc57b2460" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:11.572955 30605 catalog_manager.cc:5697] T 554acf71459c4e59b886396df52b3004 P 6c5665c17e904fc692bce76fc57b2460 reported cstate change: term changed from 1 to 2, leader changed from 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130) to 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129). New cstate: current_term: 2 leader_uuid: "6c5665c17e904fc692bce76fc57b2460" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:11.917935 30780 raft_consensus.cc:1275] T e57ee667f8a246eb98ab6b169eb779b9 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Refusing update from remote peer 6c5665c17e904fc692bce76fc57b2460: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:11.919142 31784 consensus_queue.cc:1048] T e57ee667f8a246eb98ab6b169eb779b9 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:11.931372 31836 raft_consensus.cc:993] T f0fbdcbe46b34107bbbf63f69c98e244 P 84b98f9236604dd0b22ae23c5378a676: : Instructing follower 6c5665c17e904fc692bce76fc57b2460 to start an election
I20260709 12:14:11.935925 31811 raft_consensus.cc:1081] T f0fbdcbe46b34107bbbf63f69c98e244 P 84b98f9236604dd0b22ae23c5378a676 [term 1 LEADER]: Signalling peer 6c5665c17e904fc692bce76fc57b2460 to start an election
I20260709 12:14:11.937844 31648 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0fbdcbe46b34107bbbf63f69c98e244"
dest_uuid: "6c5665c17e904fc692bce76fc57b2460"
 from {username='slave'} at 127.0.0.1:54516
I20260709 12:14:11.938254 30854 raft_consensus.cc:1275] T e57ee667f8a246eb98ab6b169eb779b9 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Refusing update from remote peer 6c5665c17e904fc692bce76fc57b2460: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:11.938360 31648 raft_consensus.cc:493] T f0fbdcbe46b34107bbbf63f69c98e244 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:11.938868 31648 raft_consensus.cc:3060] T f0fbdcbe46b34107bbbf63f69c98e244 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:11.939224 30855 raft_consensus.cc:1275] T cdf560ffbc0c4b8b80beb6494a13d9cd P 8130e18710c04a61a5d8bd019c6ffdad [term 3 FOLLOWER]: Refusing update from remote peer 6c5665c17e904fc692bce76fc57b2460: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:11.941861 31778 consensus_queue.cc:1048] T e57ee667f8a246eb98ab6b169eb779b9 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:11.942176 31804 consensus_queue.cc:1048] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:11.946393 31648 raft_consensus.cc:515] T f0fbdcbe46b34107bbbf63f69c98e244 P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:14:11.954326 31648 leader_election.cc:290] T f0fbdcbe46b34107bbbf63f69c98e244 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 2 election: Requested vote from peers 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083), 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179)
I20260709 12:14:11.960126 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fbdcbe46b34107bbbf63f69c98e244" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "84b98f9236604dd0b22ae23c5378a676"
I20260709 12:14:11.960829 30780 raft_consensus.cc:3055] T f0fbdcbe46b34107bbbf63f69c98e244 P 84b98f9236604dd0b22ae23c5378a676 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:11.961215 30780 raft_consensus.cc:740] T f0fbdcbe46b34107bbbf63f69c98e244 P 84b98f9236604dd0b22ae23c5378a676 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 84b98f9236604dd0b22ae23c5378a676, State: Running, Role: LEADER
I20260709 12:14:11.963466 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0fbdcbe46b34107bbbf63f69c98e244" candidate_uuid: "6c5665c17e904fc692bce76fc57b2460" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8130e18710c04a61a5d8bd019c6ffdad"
I20260709 12:14:11.964303 30851 raft_consensus.cc:3060] T f0fbdcbe46b34107bbbf63f69c98e244 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:11.962218 30780 consensus_queue.cc:260] T f0fbdcbe46b34107bbbf63f69c98e244 P 84b98f9236604dd0b22ae23c5378a676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:14:11.973219 30780 raft_consensus.cc:3060] T f0fbdcbe46b34107bbbf63f69c98e244 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:11.985746 30851 raft_consensus.cc:2468] T f0fbdcbe46b34107bbbf63f69c98e244 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 2.
I20260709 12:14:11.988432 30780 raft_consensus.cc:2468] T f0fbdcbe46b34107bbbf63f69c98e244 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5665c17e904fc692bce76fc57b2460 in term 2.
I20260709 12:14:11.989707 31515 leader_election.cc:304] T f0fbdcbe46b34107bbbf63f69c98e244 P 6c5665c17e904fc692bce76fc57b2460 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c5665c17e904fc692bce76fc57b2460, 8130e18710c04a61a5d8bd019c6ffdad; no voters: 
I20260709 12:14:11.990535 31778 raft_consensus.cc:2804] T f0fbdcbe46b34107bbbf63f69c98e244 P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:11.990970 31778 raft_consensus.cc:697] T f0fbdcbe46b34107bbbf63f69c98e244 P 6c5665c17e904fc692bce76fc57b2460 [term 2 LEADER]: Becoming Leader. State: Replica: 6c5665c17e904fc692bce76fc57b2460, State: Running, Role: LEADER
I20260709 12:14:11.991909 30780 raft_consensus.cc:1275] T cdf560ffbc0c4b8b80beb6494a13d9cd P 84b98f9236604dd0b22ae23c5378a676 [term 3 FOLLOWER]: Refusing update from remote peer 6c5665c17e904fc692bce76fc57b2460: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:11.993225 31778 consensus_queue.cc:237] T f0fbdcbe46b34107bbbf63f69c98e244 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } }
I20260709 12:14:11.996085 31804 consensus_queue.cc:1048] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:12.010046 30607 catalog_manager.cc:5697] T f0fbdcbe46b34107bbbf63f69c98e244 P 6c5665c17e904fc692bce76fc57b2460 reported cstate change: term changed from 1 to 2, leader changed from 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130) to 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129). New cstate: current_term: 2 leader_uuid: "6c5665c17e904fc692bce76fc57b2460" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:12.015583 30778 raft_consensus.cc:1275] T a318673515aa415db1aa91d126a5b724 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Refusing update from remote peer 6c5665c17e904fc692bce76fc57b2460: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:12.018945 31804 consensus_queue.cc:1048] T a318673515aa415db1aa91d126a5b724 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:12.030616 30928 raft_consensus.cc:1275] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Refusing update from remote peer 6c5665c17e904fc692bce76fc57b2460: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:12.032976 31784 consensus_queue.cc:1048] T a318673515aa415db1aa91d126a5b724 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:12.038830 30851 raft_consensus.cc:1275] T 554acf71459c4e59b886396df52b3004 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Refusing update from remote peer 6c5665c17e904fc692bce76fc57b2460: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:12.040445 31778 consensus_queue.cc:1048] T 554acf71459c4e59b886396df52b3004 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:12.075413 30778 raft_consensus.cc:1275] T 554acf71459c4e59b886396df52b3004 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Refusing update from remote peer 6c5665c17e904fc692bce76fc57b2460: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:12.080637 31784 consensus_queue.cc:1048] T 554acf71459c4e59b886396df52b3004 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:12.782512 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:12.854342 30778 raft_consensus.cc:1275] T f0fbdcbe46b34107bbbf63f69c98e244 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Refusing update from remote peer 6c5665c17e904fc692bce76fc57b2460: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:12.874706 30854 raft_consensus.cc:1275] T f0fbdcbe46b34107bbbf63f69c98e244 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Refusing update from remote peer 6c5665c17e904fc692bce76fc57b2460: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:12.978330 31804 consensus_queue.cc:1048] T f0fbdcbe46b34107bbbf63f69c98e244 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:12.981506 31804 consensus_queue.cc:1048] T f0fbdcbe46b34107bbbf63f69c98e244 P 6c5665c17e904fc692bce76fc57b2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:14:13.139932 30896 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:42179, user_credentials={real_user=slave}} blocked reactor thread for 220196us
I20260709 12:14:13.210214 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:13.212129 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:13.214145 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:13.281766 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:13.313791 21266 tablet_server.cc:179] TabletServer@127.20.196.129:40909 shutting down...
I20260709 12:14:13.346455 21266 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:13.347471 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:13.348433 21266 raft_consensus.cc:2243] T 21c0ba9bb1d64ab398c606450f72e966 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.348992 21266 raft_consensus.cc:2272] T 21c0ba9bb1d64ab398c606450f72e966 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.351532 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:13.352190 21266 raft_consensus.cc:2243] T c5afc0720ca546d8b13026e7c7a30c1e P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.352588 21266 raft_consensus.cc:2272] T c5afc0720ca546d8b13026e7c7a30c1e P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.358215 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:13.359208 21266 raft_consensus.cc:2243] T ca92b4f3c36b42fb9aa2f575c06344fe P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.359733 21266 raft_consensus.cc:2272] T ca92b4f3c36b42fb9aa2f575c06344fe P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:13.361573 30824 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 325 similar messages]
I20260709 12:14:13.364827 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:13.365831 21266 raft_consensus.cc:2243] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.366374 21266 raft_consensus.cc:2272] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.369628 21266 tablet_replica.cc:333] stopping tablet replica
W20260709 12:14:13.369776 30824 consensus_peers.cc:597] T 2971ad17262c4b5e8665700af97ec254 P 8130e18710c04a61a5d8bd019c6ffdad -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:13.370368 21266 raft_consensus.cc:2243] T 56a566949cf345d08d43f13ccff4be37 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:13.370455 30824 consensus_peers.cc:597] T 8c580512b11742d4977ff026ff8fc795 P 8130e18710c04a61a5d8bd019c6ffdad -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:13.370900 21266 raft_consensus.cc:2272] T 56a566949cf345d08d43f13ccff4be37 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.373567 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:13.374336 21266 raft_consensus.cc:2243] T 671d30cec67d47a89e8ec6fab0c53c48 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.374776 21266 raft_consensus.cc:2272] T 671d30cec67d47a89e8ec6fab0c53c48 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.377619 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:13.378350 21266 raft_consensus.cc:2243] T e57ee667f8a246eb98ab6b169eb779b9 P 6c5665c17e904fc692bce76fc57b2460 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:13.379405 21266 raft_consensus.cc:2272] T e57ee667f8a246eb98ab6b169eb779b9 P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.381796 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:13.382663 21266 raft_consensus.cc:2243] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:13.383652 21266 raft_consensus.cc:2272] T fd65967534164e9c805fc3d5d05e0369 P 6c5665c17e904fc692bce76fc57b2460 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.386224 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:13.387192 21266 raft_consensus.cc:2243] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.387699 21266 raft_consensus.cc:2272] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:13.390276 30898 consensus_peers.cc:597] T 5d636204e40644318b4758f37c7b0474 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:13.390681 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:13.391561 21266 raft_consensus.cc:2243] T f0fbdcbe46b34107bbbf63f69c98e244 P 6c5665c17e904fc692bce76fc57b2460 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:13.392365 21266 raft_consensus.cc:2272] T f0fbdcbe46b34107bbbf63f69c98e244 P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.395476 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:13.396234 21266 raft_consensus.cc:2243] T bb358c4df82f4168bc1debdfc4e7aa9c P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.396816 21266 raft_consensus.cc:2272] T bb358c4df82f4168bc1debdfc4e7aa9c P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.399305 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:13.399976 21266 raft_consensus.cc:2243] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:13.400710 21266 raft_consensus.cc:2272] T a0bb1498511242ef95085be49c10c4d3 P 6c5665c17e904fc692bce76fc57b2460 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.403258 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:13.404073 21266 raft_consensus.cc:2243] T 745e2cea61c44c3a80bdc49add504a75 P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.404577 21266 raft_consensus.cc:2272] T 745e2cea61c44c3a80bdc49add504a75 P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.406723 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:13.407330 21266 raft_consensus.cc:2243] T a4b7489c1b104bf2bb461bcdca7e6f42 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.407712 21266 raft_consensus.cc:2272] T a4b7489c1b104bf2bb461bcdca7e6f42 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.410038 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:13.411005 21266 raft_consensus.cc:2243] T fa9f00939aba452180334d67a6d33010 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.411520 21266 raft_consensus.cc:2272] T fa9f00939aba452180334d67a6d33010 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.414011 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:13.414566 21266 raft_consensus.cc:2243] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:13.415495 21266 raft_consensus.cc:2272] T 1eb80935abae44bf8dde4d54961c5fdb P 6c5665c17e904fc692bce76fc57b2460 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.418563 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:13.419399 21266 raft_consensus.cc:2243] T 554acf71459c4e59b886396df52b3004 P 6c5665c17e904fc692bce76fc57b2460 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:13.420346 21266 raft_consensus.cc:2272] T 554acf71459c4e59b886396df52b3004 P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.424110 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:13.425180 21266 raft_consensus.cc:2243] T 8c580512b11742d4977ff026ff8fc795 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.425946 21266 raft_consensus.cc:2272] T 8c580512b11742d4977ff026ff8fc795 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.429302 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:13.430307 21266 raft_consensus.cc:2243] T 32c211a79de247c8b5cef16a2d0a4dcb P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.430868 21266 raft_consensus.cc:2272] T 32c211a79de247c8b5cef16a2d0a4dcb P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.436318 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:13.437006 21266 raft_consensus.cc:2243] T 2cf56cf233cc48a5a720300bc769fa6a P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.437667 21266 raft_consensus.cc:2272] T 2cf56cf233cc48a5a720300bc769fa6a P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.440184 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:13.440853 21266 raft_consensus.cc:2243] T 0203e5cc33ca470eb9c1f366291c344d P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.441320 21266 raft_consensus.cc:2272] T 0203e5cc33ca470eb9c1f366291c344d P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.443679 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:13.444312 21266 raft_consensus.cc:2243] T 7b23395f850d4699b8d289f501c96f60 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.444900 21266 raft_consensus.cc:2272] T 7b23395f850d4699b8d289f501c96f60 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.447860 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:13.448709 21266 raft_consensus.cc:2243] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:13.449712 21266 raft_consensus.cc:2272] T c52d3c5b6b15499e9c834cf33954609a P 6c5665c17e904fc692bce76fc57b2460 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:13.449934 30824 consensus_peers.cc:597] T bb358c4df82f4168bc1debdfc4e7aa9c P 8130e18710c04a61a5d8bd019c6ffdad -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:13.452164 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:13.452891 21266 raft_consensus.cc:2243] T b9cc9d529de24234b98ed5e152fd4b24 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.453312 21266 raft_consensus.cc:2272] T b9cc9d529de24234b98ed5e152fd4b24 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.455803 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:13.456395 21266 raft_consensus.cc:2243] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:13.457185 21266 raft_consensus.cc:2272] T cdf560ffbc0c4b8b80beb6494a13d9cd P 6c5665c17e904fc692bce76fc57b2460 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.459756 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:13.460309 21266 raft_consensus.cc:2243] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:13.461278 21266 raft_consensus.cc:2272] T baedd172e30a4ef4a6641302fdebd9c5 P 6c5665c17e904fc692bce76fc57b2460 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.463428 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:13.464003 21266 raft_consensus.cc:2243] T 34e3009dd96f4545b2abe325ac95e960 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.464402 21266 raft_consensus.cc:2272] T 34e3009dd96f4545b2abe325ac95e960 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.466809 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:13.467420 21266 raft_consensus.cc:2243] T 2ff9e0d905854cceb79f96f500a07339 P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.467870 21266 raft_consensus.cc:2272] T 2ff9e0d905854cceb79f96f500a07339 P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.470211 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:13.471048 21266 raft_consensus.cc:2243] T 76d4dde0196948ef92f68df770af02b0 P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.471640 21266 raft_consensus.cc:2272] T 76d4dde0196948ef92f68df770af02b0 P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.474512 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:13.475260 21266 raft_consensus.cc:2243] T 2971ad17262c4b5e8665700af97ec254 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.475798 21266 raft_consensus.cc:2272] T 2971ad17262c4b5e8665700af97ec254 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:13.476032 30898 consensus_peers.cc:597] T 2ff9e0d905854cceb79f96f500a07339 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:13.478609 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:13.479478 21266 raft_consensus.cc:2243] T eb58d3a8bd8540ff9871ea41021a5025 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.479948 21266 raft_consensus.cc:2272] T eb58d3a8bd8540ff9871ea41021a5025 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.482851 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:13.483678 21266 raft_consensus.cc:2243] T a318673515aa415db1aa91d126a5b724 P 6c5665c17e904fc692bce76fc57b2460 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:13.484632 21266 raft_consensus.cc:2272] T a318673515aa415db1aa91d126a5b724 P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.487428 21266 tablet_replica.cc:333] stopping tablet replica
W20260709 12:14:13.487277 30824 consensus_peers.cc:597] T c449839430794851b61ffba23f946c4f P 8130e18710c04a61a5d8bd019c6ffdad -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:13.488334 21266 raft_consensus.cc:2243] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:13.489327 21266 raft_consensus.cc:2272] T 8b66a7b6f8aa4803b482e392cc945db7 P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.492120 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:13.492794 21266 raft_consensus.cc:2243] T 5d636204e40644318b4758f37c7b0474 P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.493331 21266 raft_consensus.cc:2272] T 5d636204e40644318b4758f37c7b0474 P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:13.494328 30824 consensus_peers.cc:597] T a6a5bd717fa048aabdd0879bcea0fd60 P 8130e18710c04a61a5d8bd019c6ffdad -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:13.495853 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:13.496479 21266 raft_consensus.cc:2243] T 660d2eb6dd3f4e96aab252cfd980be89 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.497043 21266 raft_consensus.cc:2272] T 660d2eb6dd3f4e96aab252cfd980be89 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.499835 21266 tablet_replica.cc:333] stopping tablet replica
W20260709 12:14:13.500511 30824 consensus_peers.cc:597] T 615eb2fb16414287bc0956a27523b7f4 P 8130e18710c04a61a5d8bd019c6ffdad -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:13.500648 21266 raft_consensus.cc:2243] T c449839430794851b61ffba23f946c4f P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.501211 21266 raft_consensus.cc:2272] T c449839430794851b61ffba23f946c4f P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.503433 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:13.504004 21266 raft_consensus.cc:2243] T 3e0e49105b2d44f09c55f7cc603f9b91 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.504398 21266 raft_consensus.cc:2272] T 3e0e49105b2d44f09c55f7cc603f9b91 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.506800 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:13.507520 21266 raft_consensus.cc:2243] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 6c5665c17e904fc692bce76fc57b2460 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:13.508443 21266 raft_consensus.cc:2272] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.511262 21266 tablet_replica.cc:333] stopping tablet replica
W20260709 12:14:13.511955 30898 consensus_peers.cc:597] T 660d2eb6dd3f4e96aab252cfd980be89 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:13.512001 21266 raft_consensus.cc:2243] T 615eb2fb16414287bc0956a27523b7f4 P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.512769 21266 raft_consensus.cc:2272] T 615eb2fb16414287bc0956a27523b7f4 P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.515367 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:13.515985 21266 raft_consensus.cc:2243] T ec7d33fd7f3245f68966bd7749ee53c3 P 6c5665c17e904fc692bce76fc57b2460 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:13.516758 21266 raft_consensus.cc:2272] T ec7d33fd7f3245f68966bd7749ee53c3 P 6c5665c17e904fc692bce76fc57b2460 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:13.516953 30750 consensus_peers.cc:597] T 76d4dde0196948ef92f68df770af02b0 P 84b98f9236604dd0b22ae23c5378a676 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:13.519479 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:13.520298 21266 raft_consensus.cc:2243] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:14:13.521224 21266 raft_consensus.cc:2272] T 0317908edb88497b82c4e59ef1bac414 P 6c5665c17e904fc692bce76fc57b2460 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.523959 21266 tablet_replica.cc:333] stopping tablet replica
W20260709 12:14:13.524600 30898 consensus_peers.cc:597] T 671d30cec67d47a89e8ec6fab0c53c48 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:13.524636 21266 raft_consensus.cc:2243] T a6a5bd717fa048aabdd0879bcea0fd60 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.525509 21266 raft_consensus.cc:2272] T a6a5bd717fa048aabdd0879bcea0fd60 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.527653 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:13.528128 21266 raft_consensus.cc:2243] T f351526ad9564be4be05825c266794c7 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.528438 21266 raft_consensus.cc:2272] T f351526ad9564be4be05825c266794c7 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.530278 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:13.530838 21266 raft_consensus.cc:2243] T 99164e2d6f664ceab4d5921867d62c31 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.531270 21266 raft_consensus.cc:2272] T 99164e2d6f664ceab4d5921867d62c31 P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.533154 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:13.533612 21266 raft_consensus.cc:2243] T a3ffdffa995943d28fc038fce9198caf P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.533969 21266 raft_consensus.cc:2272] T a3ffdffa995943d28fc038fce9198caf P 6c5665c17e904fc692bce76fc57b2460 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:13.549774 30750 consensus_peers.cc:597] T 56a566949cf345d08d43f13ccff4be37 P 84b98f9236604dd0b22ae23c5378a676 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:13.562578 30898 consensus_peers.cc:597] T 34e3009dd96f4545b2abe325ac95e960 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:13.568295 30898 consensus_peers.cc:597] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:13.571338 30824 consensus_peers.cc:597] T 7b23395f850d4699b8d289f501c96f60 P 8130e18710c04a61a5d8bd019c6ffdad -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:13.575158 30750 consensus_peers.cc:597] T a3ffdffa995943d28fc038fce9198caf P 84b98f9236604dd0b22ae23c5378a676 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:13.591758 30750 consensus_peers.cc:597] T 745e2cea61c44c3a80bdc49add504a75 P 84b98f9236604dd0b22ae23c5378a676 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:13.614087 30750 consensus_peers.cc:597] T c5afc0720ca546d8b13026e7c7a30c1e P 84b98f9236604dd0b22ae23c5378a676 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:13.616636 21266 tablet_server.cc:196] TabletServer@127.20.196.129:40909 shutdown complete.
W20260709 12:14:13.637813 30898 consensus_peers.cc:597] T 99164e2d6f664ceab4d5921867d62c31 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:13.640316 30898 consensus_peers.cc:597] T a4b7489c1b104bf2bb461bcdca7e6f42 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:13.652900 30824 consensus_peers.cc:597] T 21c0ba9bb1d64ab398c606450f72e966 P 8130e18710c04a61a5d8bd019c6ffdad -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:13.661000 30750 consensus_peers.cc:597] T eb58d3a8bd8540ff9871ea41021a5025 P 84b98f9236604dd0b22ae23c5378a676 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:13.669994 30750 consensus_peers.cc:597] T 0203e5cc33ca470eb9c1f366291c344d P 84b98f9236604dd0b22ae23c5378a676 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:13.674595 30750 consensus_peers.cc:597] T 2cf56cf233cc48a5a720300bc769fa6a P 84b98f9236604dd0b22ae23c5378a676 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:13.697840 30898 consensus_peers.cc:597] T fa9f00939aba452180334d67a6d33010 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:13.707175 30750 consensus_peers.cc:597] T b9cc9d529de24234b98ed5e152fd4b24 P 84b98f9236604dd0b22ae23c5378a676 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:13.709100 30898 consensus_peers.cc:597] T 32c211a79de247c8b5cef16a2d0a4dcb P 15ad0880a63541ef965cb6acca4513d7 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:13.712015 30953 debug-util.cc:398] Leaking SignalData structure 0x7b080003fec0 after lost signal to thread 21269
W20260709 12:14:13.713241 30953 debug-util.cc:398] Leaking SignalData structure 0x7b0800254c80 after lost signal to thread 30641
W20260709 12:14:13.714605 30953 debug-util.cc:398] Leaking SignalData structure 0x7b08001b54c0 after lost signal to thread 30808
I20260709 12:14:13.715272 21266 tablet_server.cc:179] TabletServer@127.20.196.130:0 shutting down...
W20260709 12:14:13.715813 30953 debug-util.cc:398] Leaking SignalData structure 0x7b080014f320 after lost signal to thread 30882
W20260709 12:14:13.717172 30953 debug-util.cc:398] Leaking SignalData structure 0x7b0800309660 after lost signal to thread 30956
W20260709 12:14:13.718456 30953 debug-util.cc:398] Leaking SignalData structure 0x7b080023acc0 after lost signal to thread 31679
W20260709 12:14:13.728147 30822 consensus_peers.cc:597] T 615eb2fb16414287bc0956a27523b7f4 P 8130e18710c04a61a5d8bd019c6ffdad -> Peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Couldn't send request to peer 84b98f9236604dd0b22ae23c5378a676. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:13.730263 30750 consensus_peers.cc:597] T 3e0e49105b2d44f09c55f7cc603f9b91 P 84b98f9236604dd0b22ae23c5378a676 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:13.733757 30750 consensus_peers.cc:597] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 84b98f9236604dd0b22ae23c5378a676 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:13.738518 30822 consensus_peers.cc:597] T 1bbb677d9c544ed5a31297773b1508d6 P 8130e18710c04a61a5d8bd019c6ffdad -> Peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Couldn't send request to peer 84b98f9236604dd0b22ae23c5378a676. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:13.742818 30896 consensus_peers.cc:597] T 2137918dbdc34ac29180015bd93261de P 15ad0880a63541ef965cb6acca4513d7 -> Peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Couldn't send request to peer 84b98f9236604dd0b22ae23c5378a676. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:13.746224 30822 consensus_peers.cc:597] T d5a270750666414887b6fae2f3793dc5 P 8130e18710c04a61a5d8bd019c6ffdad -> Peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Couldn't send request to peer 84b98f9236604dd0b22ae23c5378a676. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:13.758397 30896 consensus_peers.cc:597] T 5323645d8e844a489d166a94c77c2af1 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Couldn't send request to peer 84b98f9236604dd0b22ae23c5378a676. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:13.769767 21266 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:13.770830 21266 tablet_replica.cc:333] T 2cf56cf233cc48a5a720300bc769fa6a P 84b98f9236604dd0b22ae23c5378a676: stopping tablet replica
I20260709 12:14:13.771823 21266 raft_consensus.cc:2243] T 2cf56cf233cc48a5a720300bc769fa6a P 84b98f9236604dd0b22ae23c5378a676 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:13.772959 21266 raft_consensus.cc:2272] T 2cf56cf233cc48a5a720300bc769fa6a P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.780589 21266 tablet_replica.cc:333] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 84b98f9236604dd0b22ae23c5378a676: stopping tablet replica
I20260709 12:14:13.781558 21266 raft_consensus.cc:2243] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.782146 21266 raft_consensus.cc:2272] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.784777 21266 tablet_replica.cc:333] T 3e0e49105b2d44f09c55f7cc603f9b91 P 84b98f9236604dd0b22ae23c5378a676: stopping tablet replica
I20260709 12:14:13.785512 21266 raft_consensus.cc:2243] T 3e0e49105b2d44f09c55f7cc603f9b91 P 84b98f9236604dd0b22ae23c5378a676 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:13.786327 21266 raft_consensus.cc:2272] T 3e0e49105b2d44f09c55f7cc603f9b91 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.789320 21266 tablet_replica.cc:333] T 0317908edb88497b82c4e59ef1bac414 P 84b98f9236604dd0b22ae23c5378a676: stopping tablet replica
W20260709 12:14:13.789788 30750 consensus_peers.cc:597] T f351526ad9564be4be05825c266794c7 P 84b98f9236604dd0b22ae23c5378a676 -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:13.790052 21266 raft_consensus.cc:2243] T 0317908edb88497b82c4e59ef1bac414 P 84b98f9236604dd0b22ae23c5378a676 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.790616 21266 raft_consensus.cc:2272] T 0317908edb88497b82c4e59ef1bac414 P 84b98f9236604dd0b22ae23c5378a676 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:13.793021 30896 consensus_peers.cc:597] T 660d2eb6dd3f4e96aab252cfd980be89 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Couldn't send request to peer 84b98f9236604dd0b22ae23c5378a676. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:13.793282 21266 tablet_replica.cc:333] T 554acf71459c4e59b886396df52b3004 P 84b98f9236604dd0b22ae23c5378a676: stopping tablet replica
I20260709 12:14:13.794246 21266 raft_consensus.cc:2243] T 554acf71459c4e59b886396df52b3004 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.794793 21266 raft_consensus.cc:2272] T 554acf71459c4e59b886396df52b3004 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.797572 21266 tablet_replica.cc:333] T f351526ad9564be4be05825c266794c7 P 84b98f9236604dd0b22ae23c5378a676: stopping tablet replica
W20260709 12:14:13.798378 30824 consensus_peers.cc:597] T ca92b4f3c36b42fb9aa2f575c06344fe P 8130e18710c04a61a5d8bd019c6ffdad -> Peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Couldn't send request to peer 6c5665c17e904fc692bce76fc57b2460. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:13.798384 21266 raft_consensus.cc:2243] T f351526ad9564be4be05825c266794c7 P 84b98f9236604dd0b22ae23c5378a676 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:13.801019 21266 raft_consensus.cc:2272] T f351526ad9564be4be05825c266794c7 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.804055 21266 tablet_replica.cc:333] T 2137918dbdc34ac29180015bd93261de P 84b98f9236604dd0b22ae23c5378a676: stopping tablet replica
I20260709 12:14:13.804926 21266 raft_consensus.cc:2243] T 2137918dbdc34ac29180015bd93261de P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.805502 21266 raft_consensus.cc:2272] T 2137918dbdc34ac29180015bd93261de P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.808177 21266 tablet_replica.cc:333] T 1bbb677d9c544ed5a31297773b1508d6 P 84b98f9236604dd0b22ae23c5378a676: stopping tablet replica
I20260709 12:14:13.808931 21266 raft_consensus.cc:2243] T 1bbb677d9c544ed5a31297773b1508d6 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.809625 21266 raft_consensus.cc:2272] T 1bbb677d9c544ed5a31297773b1508d6 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.812222 21266 tablet_replica.cc:333] T 4031508121204ef4a2f5f2f0e9508cab P 84b98f9236604dd0b22ae23c5378a676: stopping tablet replica
I20260709 12:14:13.813007 21266 raft_consensus.cc:2243] T 4031508121204ef4a2f5f2f0e9508cab P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.813578 21266 raft_consensus.cc:2272] T 4031508121204ef4a2f5f2f0e9508cab P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.816778 21266 tablet_replica.cc:333] T baedd172e30a4ef4a6641302fdebd9c5 P 84b98f9236604dd0b22ae23c5378a676: stopping tablet replica
I20260709 12:14:13.817679 21266 raft_consensus.cc:2243] T baedd172e30a4ef4a6641302fdebd9c5 P 84b98f9236604dd0b22ae23c5378a676 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.818212 21266 raft_consensus.cc:2272] T baedd172e30a4ef4a6641302fdebd9c5 P 84b98f9236604dd0b22ae23c5378a676 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.820974 21266 tablet_replica.cc:333] T a3ffdffa995943d28fc038fce9198caf P 84b98f9236604dd0b22ae23c5378a676: stopping tablet replica
I20260709 12:14:13.821796 21266 raft_consensus.cc:2243] T a3ffdffa995943d28fc038fce9198caf P 84b98f9236604dd0b22ae23c5378a676 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:13.822908 21266 raft_consensus.cc:2272] T a3ffdffa995943d28fc038fce9198caf P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.825626 21266 tablet_replica.cc:333] T 5323645d8e844a489d166a94c77c2af1 P 84b98f9236604dd0b22ae23c5378a676: stopping tablet replica
I20260709 12:14:13.826508 21266 raft_consensus.cc:2243] T 5323645d8e844a489d166a94c77c2af1 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.827143 21266 raft_consensus.cc:2272] T 5323645d8e844a489d166a94c77c2af1 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.830128 21266 tablet_replica.cc:333] T ac15e10cad8e4cbc9763eacc349d9549 P 84b98f9236604dd0b22ae23c5378a676: stopping tablet replica
I20260709 12:14:13.831176 21266 raft_consensus.cc:2243] T ac15e10cad8e4cbc9763eacc349d9549 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.831760 21266 raft_consensus.cc:2272] T ac15e10cad8e4cbc9763eacc349d9549 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.834659 21266 tablet_replica.cc:333] T b6f09adc18e2485cbafdb86cfe535721 P 84b98f9236604dd0b22ae23c5378a676: stopping tablet replica
I20260709 12:14:13.835476 21266 raft_consensus.cc:2243] T b6f09adc18e2485cbafdb86cfe535721 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.836017 21266 raft_consensus.cc:2272] T b6f09adc18e2485cbafdb86cfe535721 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.838850 21266 tablet_replica.cc:333] T b9cc9d529de24234b98ed5e152fd4b24 P 84b98f9236604dd0b22ae23c5378a676: stopping tablet replica
I20260709 12:14:13.839675 21266 raft_consensus.cc:2243] T b9cc9d529de24234b98ed5e152fd4b24 P 84b98f9236604dd0b22ae23c5378a676 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:13.840746 21266 raft_consensus.cc:2272] T b9cc9d529de24234b98ed5e152fd4b24 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.843461 21266 tablet_replica.cc:333] T cdf560ffbc0c4b8b80beb6494a13d9cd P 84b98f9236604dd0b22ae23c5378a676: stopping tablet replica
I20260709 12:14:13.844357 21266 raft_consensus.cc:2243] T cdf560ffbc0c4b8b80beb6494a13d9cd P 84b98f9236604dd0b22ae23c5378a676 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.844902 21266 raft_consensus.cc:2272] T cdf560ffbc0c4b8b80beb6494a13d9cd P 84b98f9236604dd0b22ae23c5378a676 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.847499 21266 tablet_replica.cc:333] T 0203e5cc33ca470eb9c1f366291c344d P 84b98f9236604dd0b22ae23c5378a676: stopping tablet replica
I20260709 12:14:13.848367 21266 raft_consensus.cc:2243] T 0203e5cc33ca470eb9c1f366291c344d P 84b98f9236604dd0b22ae23c5378a676 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:13.849545 21266 raft_consensus.cc:2272] T 0203e5cc33ca470eb9c1f366291c344d P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.852283 21266 tablet_replica.cc:333] T 660d2eb6dd3f4e96aab252cfd980be89 P 84b98f9236604dd0b22ae23c5378a676: stopping tablet replica
I20260709 12:14:13.853109 21266 raft_consensus.cc:2243] T 660d2eb6dd3f4e96aab252cfd980be89 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.853686 21266 raft_consensus.cc:2272] T 660d2eb6dd3f4e96aab252cfd980be89 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.856428 21266 tablet_replica.cc:333] T c449839430794851b61ffba23f946c4f P 84b98f9236604dd0b22ae23c5378a676: stopping tablet replica
I20260709 12:14:13.857229 21266 raft_consensus.cc:2243] T c449839430794851b61ffba23f946c4f P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.857963 21266 raft_consensus.cc:2272] T c449839430794851b61ffba23f946c4f P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.860934 21266 tablet_replica.cc:333] T 5d636204e40644318b4758f37c7b0474 P 84b98f9236604dd0b22ae23c5378a676: stopping tablet replica
I20260709 12:14:13.861780 21266 raft_consensus.cc:2243] T 5d636204e40644318b4758f37c7b0474 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.862317 21266 raft_consensus.cc:2272] T 5d636204e40644318b4758f37c7b0474 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.865140 21266 tablet_replica.cc:333] T c52d3c5b6b15499e9c834cf33954609a P 84b98f9236604dd0b22ae23c5378a676: stopping tablet replica
I20260709 12:14:13.865881 21266 raft_consensus.cc:2243] T c52d3c5b6b15499e9c834cf33954609a P 84b98f9236604dd0b22ae23c5378a676 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.866498 21266 raft_consensus.cc:2272] T c52d3c5b6b15499e9c834cf33954609a P 84b98f9236604dd0b22ae23c5378a676 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.869165 21266 tablet_replica.cc:333] T d5a270750666414887b6fae2f3793dc5 P 84b98f9236604dd0b22ae23c5378a676: stopping tablet replica
I20260709 12:14:13.869896 21266 raft_consensus.cc:2243] T d5a270750666414887b6fae2f3793dc5 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.870420 21266 raft_consensus.cc:2272] T d5a270750666414887b6fae2f3793dc5 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.872951 21266 tablet_replica.cc:333] T da25c47d7366434089b73f8af7ce453b P 84b98f9236604dd0b22ae23c5378a676: stopping tablet replica
I20260709 12:14:13.873698 21266 raft_consensus.cc:2243] T da25c47d7366434089b73f8af7ce453b P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.874209 21266 raft_consensus.cc:2272] T da25c47d7366434089b73f8af7ce453b P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.876811 21266 tablet_replica.cc:333] T a4b7489c1b104bf2bb461bcdca7e6f42 P 84b98f9236604dd0b22ae23c5378a676: stopping tablet replica
I20260709 12:14:13.877637 21266 raft_consensus.cc:2243] T a4b7489c1b104bf2bb461bcdca7e6f42 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.878269 21266 raft_consensus.cc:2272] T a4b7489c1b104bf2bb461bcdca7e6f42 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:13.879091 30822 consensus_peers.cc:597] T c449839430794851b61ffba23f946c4f P 8130e18710c04a61a5d8bd019c6ffdad -> Peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Couldn't send request to peer 84b98f9236604dd0b22ae23c5378a676. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:13.881251 21266 tablet_replica.cc:333] T 745e2cea61c44c3a80bdc49add504a75 P 84b98f9236604dd0b22ae23c5378a676: stopping tablet replica
I20260709 12:14:13.882206 21266 raft_consensus.cc:2243] T 745e2cea61c44c3a80bdc49add504a75 P 84b98f9236604dd0b22ae23c5378a676 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:13.883271 21266 raft_consensus.cc:2272] T 745e2cea61c44c3a80bdc49add504a75 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.886039 21266 tablet_replica.cc:333] T a0bb1498511242ef95085be49c10c4d3 P 84b98f9236604dd0b22ae23c5378a676: stopping tablet replica
I20260709 12:14:13.886866 21266 raft_consensus.cc:2243] T a0bb1498511242ef95085be49c10c4d3 P 84b98f9236604dd0b22ae23c5378a676 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.887434 21266 raft_consensus.cc:2272] T a0bb1498511242ef95085be49c10c4d3 P 84b98f9236604dd0b22ae23c5378a676 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:13.889688 30896 consensus_peers.cc:597] T b6f09adc18e2485cbafdb86cfe535721 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Couldn't send request to peer 84b98f9236604dd0b22ae23c5378a676. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:13.890393 21266 tablet_replica.cc:333] T e57ee667f8a246eb98ab6b169eb779b9 P 84b98f9236604dd0b22ae23c5378a676: stopping tablet replica
I20260709 12:14:13.891338 21266 raft_consensus.cc:2243] T e57ee667f8a246eb98ab6b169eb779b9 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.891957 21266 raft_consensus.cc:2272] T e57ee667f8a246eb98ab6b169eb779b9 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.894738 21266 tablet_replica.cc:333] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 84b98f9236604dd0b22ae23c5378a676: stopping tablet replica
I20260709 12:14:13.895545 21266 raft_consensus.cc:2243] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 84b98f9236604dd0b22ae23c5378a676 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:13.896622 21266 raft_consensus.cc:2272] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.899421 21266 tablet_replica.cc:333] T c5afc0720ca546d8b13026e7c7a30c1e P 84b98f9236604dd0b22ae23c5378a676: stopping tablet replica
I20260709 12:14:13.900207 21266 raft_consensus.cc:2243] T c5afc0720ca546d8b13026e7c7a30c1e P 84b98f9236604dd0b22ae23c5378a676 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:13.901239 21266 raft_consensus.cc:2272] T c5afc0720ca546d8b13026e7c7a30c1e P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.903909 21266 tablet_replica.cc:333] T ec7d33fd7f3245f68966bd7749ee53c3 P 84b98f9236604dd0b22ae23c5378a676: stopping tablet replica
I20260709 12:14:13.904688 21266 raft_consensus.cc:2243] T ec7d33fd7f3245f68966bd7749ee53c3 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.905216 21266 raft_consensus.cc:2272] T ec7d33fd7f3245f68966bd7749ee53c3 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.908067 21266 tablet_replica.cc:333] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 84b98f9236604dd0b22ae23c5378a676: stopping tablet replica
I20260709 12:14:13.908843 21266 raft_consensus.cc:2243] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.909363 21266 raft_consensus.cc:2272] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.912034 21266 tablet_replica.cc:333] T 615eb2fb16414287bc0956a27523b7f4 P 84b98f9236604dd0b22ae23c5378a676: stopping tablet replica
I20260709 12:14:13.912827 21266 raft_consensus.cc:2243] T 615eb2fb16414287bc0956a27523b7f4 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.913386 21266 raft_consensus.cc:2272] T 615eb2fb16414287bc0956a27523b7f4 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.917426 21266 tablet_replica.cc:333] T 56a566949cf345d08d43f13ccff4be37 P 84b98f9236604dd0b22ae23c5378a676: stopping tablet replica
I20260709 12:14:13.918180 21266 raft_consensus.cc:2243] T 56a566949cf345d08d43f13ccff4be37 P 84b98f9236604dd0b22ae23c5378a676 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:13.919327 21266 raft_consensus.cc:2272] T 56a566949cf345d08d43f13ccff4be37 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.923218 21266 tablet_replica.cc:333] T 671d30cec67d47a89e8ec6fab0c53c48 P 84b98f9236604dd0b22ae23c5378a676: stopping tablet replica
I20260709 12:14:13.924003 21266 raft_consensus.cc:2243] T 671d30cec67d47a89e8ec6fab0c53c48 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.924525 21266 raft_consensus.cc:2272] T 671d30cec67d47a89e8ec6fab0c53c48 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.927222 21266 tablet_replica.cc:333] T dcddf9f7713c4d04abedc36356c1888f P 84b98f9236604dd0b22ae23c5378a676: stopping tablet replica
I20260709 12:14:13.928058 21266 raft_consensus.cc:2243] T dcddf9f7713c4d04abedc36356c1888f P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.928587 21266 raft_consensus.cc:2272] T dcddf9f7713c4d04abedc36356c1888f P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.931480 21266 tablet_replica.cc:333] T 2ff9e0d905854cceb79f96f500a07339 P 84b98f9236604dd0b22ae23c5378a676: stopping tablet replica
I20260709 12:14:13.932278 21266 raft_consensus.cc:2243] T 2ff9e0d905854cceb79f96f500a07339 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.932874 21266 raft_consensus.cc:2272] T 2ff9e0d905854cceb79f96f500a07339 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:13.933315 30822 consensus_peers.cc:597] T dcddf9f7713c4d04abedc36356c1888f P 8130e18710c04a61a5d8bd019c6ffdad -> Peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Couldn't send request to peer 84b98f9236604dd0b22ae23c5378a676. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:13.935917 21266 tablet_replica.cc:333] T b047acdc74424afc81c6380239209821 P 84b98f9236604dd0b22ae23c5378a676: stopping tablet replica
I20260709 12:14:13.936779 21266 raft_consensus.cc:2243] T b047acdc74424afc81c6380239209821 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.937320 21266 raft_consensus.cc:2272] T b047acdc74424afc81c6380239209821 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.940088 21266 tablet_replica.cc:333] T 472c5cafdab84ead8ce9b93950070d13 P 84b98f9236604dd0b22ae23c5378a676: stopping tablet replica
I20260709 12:14:13.940896 21266 raft_consensus.cc:2243] T 472c5cafdab84ead8ce9b93950070d13 P 84b98f9236604dd0b22ae23c5378a676 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:13.941910 21266 raft_consensus.cc:2272] T 472c5cafdab84ead8ce9b93950070d13 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.944717 21266 tablet_replica.cc:333] T 491ae2039a6347a896b3a5aeacaa71b2 P 84b98f9236604dd0b22ae23c5378a676: stopping tablet replica
I20260709 12:14:13.945458 21266 raft_consensus.cc:2243] T 491ae2039a6347a896b3a5aeacaa71b2 P 84b98f9236604dd0b22ae23c5378a676 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:13.946506 21266 raft_consensus.cc:2272] T 491ae2039a6347a896b3a5aeacaa71b2 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.959909 21266 tablet_replica.cc:333] T f0fbdcbe46b34107bbbf63f69c98e244 P 84b98f9236604dd0b22ae23c5378a676: stopping tablet replica
I20260709 12:14:13.960731 21266 raft_consensus.cc:2243] T f0fbdcbe46b34107bbbf63f69c98e244 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.961320 21266 raft_consensus.cc:2272] T f0fbdcbe46b34107bbbf63f69c98e244 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.970366 21266 tablet_replica.cc:333] T 76d4dde0196948ef92f68df770af02b0 P 84b98f9236604dd0b22ae23c5378a676: stopping tablet replica
I20260709 12:14:13.971477 21266 raft_consensus.cc:2243] T 76d4dde0196948ef92f68df770af02b0 P 84b98f9236604dd0b22ae23c5378a676 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:13.972726 21266 raft_consensus.cc:2272] T 76d4dde0196948ef92f68df770af02b0 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.974972 21266 tablet_replica.cc:333] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 84b98f9236604dd0b22ae23c5378a676: stopping tablet replica
I20260709 12:14:13.975692 21266 raft_consensus.cc:2243] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 84b98f9236604dd0b22ae23c5378a676 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:13.976691 21266 raft_consensus.cc:2272] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.979287 21266 tablet_replica.cc:333] T a318673515aa415db1aa91d126a5b724 P 84b98f9236604dd0b22ae23c5378a676: stopping tablet replica
I20260709 12:14:13.979925 21266 raft_consensus.cc:2243] T a318673515aa415db1aa91d126a5b724 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:13.980378 21266 raft_consensus.cc:2272] T a318673515aa415db1aa91d126a5b724 P 84b98f9236604dd0b22ae23c5378a676 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:13.982123 21266 tablet_replica.cc:333] T eb58d3a8bd8540ff9871ea41021a5025 P 84b98f9236604dd0b22ae23c5378a676: stopping tablet replica
I20260709 12:14:13.982586 21266 raft_consensus.cc:2243] T eb58d3a8bd8540ff9871ea41021a5025 P 84b98f9236604dd0b22ae23c5378a676 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:13.983378 21266 raft_consensus.cc:2272] T eb58d3a8bd8540ff9871ea41021a5025 P 84b98f9236604dd0b22ae23c5378a676 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:14.013828 30896 consensus_peers.cc:597] T 2ff9e0d905854cceb79f96f500a07339 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Couldn't send request to peer 84b98f9236604dd0b22ae23c5378a676. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:14.036729 30896 consensus_peers.cc:597] T 5d636204e40644318b4758f37c7b0474 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Couldn't send request to peer 84b98f9236604dd0b22ae23c5378a676. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:14.062601 21266 tablet_server.cc:196] TabletServer@127.20.196.130:0 shutdown complete.
W20260709 12:14:14.064172 30896 consensus_peers.cc:597] T da25c47d7366434089b73f8af7ce453b P 15ad0880a63541ef965cb6acca4513d7 -> Peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Couldn't send request to peer 84b98f9236604dd0b22ae23c5378a676. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:40083: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:14.075173 30822 consensus_peers.cc:597] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 8130e18710c04a61a5d8bd019c6ffdad -> Peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Couldn't send request to peer 84b98f9236604dd0b22ae23c5378a676. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:40083: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:14.113899 30822 consensus_peers.cc:597] T 4031508121204ef4a2f5f2f0e9508cab P 8130e18710c04a61a5d8bd019c6ffdad -> Peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Couldn't send request to peer 84b98f9236604dd0b22ae23c5378a676. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:40083: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:14.120124 30896 consensus_peers.cc:597] T b047acdc74424afc81c6380239209821 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Couldn't send request to peer 84b98f9236604dd0b22ae23c5378a676. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:40083: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:14.152002 21266 tablet_server.cc:179] TabletServer@127.20.196.131:0 shutting down...
W20260709 12:14:14.184842 30896 consensus_peers.cc:597] T a4b7489c1b104bf2bb461bcdca7e6f42 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Couldn't send request to peer 84b98f9236604dd0b22ae23c5378a676. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:40083: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:14.207739 21266 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:14.208878 21266 tablet_replica.cc:333] T 2cf56cf233cc48a5a720300bc769fa6a P 8130e18710c04a61a5d8bd019c6ffdad: stopping tablet replica
I20260709 12:14:14.209662 21266 raft_consensus.cc:2243] T 2cf56cf233cc48a5a720300bc769fa6a P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.210253 21266 raft_consensus.cc:2272] T 2cf56cf233cc48a5a720300bc769fa6a P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.213114 21266 tablet_replica.cc:333] T fa9f00939aba452180334d67a6d33010 P 8130e18710c04a61a5d8bd019c6ffdad: stopping tablet replica
I20260709 12:14:14.213765 21266 raft_consensus.cc:2243] T fa9f00939aba452180334d67a6d33010 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.214212 21266 raft_consensus.cc:2272] T fa9f00939aba452180334d67a6d33010 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.216279 21266 tablet_replica.cc:333] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 8130e18710c04a61a5d8bd019c6ffdad: stopping tablet replica
I20260709 12:14:14.216902 21266 raft_consensus.cc:2243] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:14.217713 21266 raft_consensus.cc:2272] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.219736 21266 tablet_replica.cc:333] T 56a566949cf345d08d43f13ccff4be37 P 8130e18710c04a61a5d8bd019c6ffdad: stopping tablet replica
I20260709 12:14:14.220316 21266 raft_consensus.cc:2243] T 56a566949cf345d08d43f13ccff4be37 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.220752 21266 raft_consensus.cc:2272] T 56a566949cf345d08d43f13ccff4be37 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.222534 21266 tablet_replica.cc:333] T 32c211a79de247c8b5cef16a2d0a4dcb P 8130e18710c04a61a5d8bd019c6ffdad: stopping tablet replica
I20260709 12:14:14.223320 21266 raft_consensus.cc:2243] T 32c211a79de247c8b5cef16a2d0a4dcb P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.223843 21266 raft_consensus.cc:2272] T 32c211a79de247c8b5cef16a2d0a4dcb P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.226485 21266 tablet_replica.cc:333] T ca92b4f3c36b42fb9aa2f575c06344fe P 8130e18710c04a61a5d8bd019c6ffdad: stopping tablet replica
I20260709 12:14:14.227350 21266 raft_consensus.cc:2243] T ca92b4f3c36b42fb9aa2f575c06344fe P 8130e18710c04a61a5d8bd019c6ffdad [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:14.228374 21266 raft_consensus.cc:2272] T ca92b4f3c36b42fb9aa2f575c06344fe P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:14.228678 30896 consensus_peers.cc:597] T fa9f00939aba452180334d67a6d33010 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179): Couldn't send request to peer 8130e18710c04a61a5d8bd019c6ffdad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:14.231076 21266 tablet_replica.cc:333] T 1bbb677d9c544ed5a31297773b1508d6 P 8130e18710c04a61a5d8bd019c6ffdad: stopping tablet replica
I20260709 12:14:14.231848 21266 raft_consensus.cc:2243] T 1bbb677d9c544ed5a31297773b1508d6 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:14.232609 21266 raft_consensus.cc:2272] T 1bbb677d9c544ed5a31297773b1508d6 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.234516 21266 tablet_replica.cc:333] T 4031508121204ef4a2f5f2f0e9508cab P 8130e18710c04a61a5d8bd019c6ffdad: stopping tablet replica
I20260709 12:14:14.235157 21266 raft_consensus.cc:2243] T 4031508121204ef4a2f5f2f0e9508cab P 8130e18710c04a61a5d8bd019c6ffdad [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:14.236080 21266 raft_consensus.cc:2272] T 4031508121204ef4a2f5f2f0e9508cab P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.238605 21266 tablet_replica.cc:333] T 5323645d8e844a489d166a94c77c2af1 P 8130e18710c04a61a5d8bd019c6ffdad: stopping tablet replica
W20260709 12:14:14.238965 30896 consensus_peers.cc:597] T 32c211a79de247c8b5cef16a2d0a4dcb P 15ad0880a63541ef965cb6acca4513d7 -> Peer 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179): Couldn't send request to peer 8130e18710c04a61a5d8bd019c6ffdad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:14.239406 21266 raft_consensus.cc:2243] T 5323645d8e844a489d166a94c77c2af1 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.239935 21266 raft_consensus.cc:2272] T 5323645d8e844a489d166a94c77c2af1 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.242153 21266 tablet_replica.cc:333] T a3ffdffa995943d28fc038fce9198caf P 8130e18710c04a61a5d8bd019c6ffdad: stopping tablet replica
I20260709 12:14:14.242882 21266 raft_consensus.cc:2243] T a3ffdffa995943d28fc038fce9198caf P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.243369 21266 raft_consensus.cc:2272] T a3ffdffa995943d28fc038fce9198caf P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.245518 21266 tablet_replica.cc:333] T 2137918dbdc34ac29180015bd93261de P 8130e18710c04a61a5d8bd019c6ffdad: stopping tablet replica
I20260709 12:14:14.246068 21266 raft_consensus.cc:2243] T 2137918dbdc34ac29180015bd93261de P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.246498 21266 raft_consensus.cc:2272] T 2137918dbdc34ac29180015bd93261de P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.248685 21266 tablet_replica.cc:333] T 2971ad17262c4b5e8665700af97ec254 P 8130e18710c04a61a5d8bd019c6ffdad: stopping tablet replica
I20260709 12:14:14.249284 21266 raft_consensus.cc:2243] T 2971ad17262c4b5e8665700af97ec254 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:14.250150 21266 raft_consensus.cc:2272] T 2971ad17262c4b5e8665700af97ec254 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.252622 21266 tablet_replica.cc:333] T 34e3009dd96f4545b2abe325ac95e960 P 8130e18710c04a61a5d8bd019c6ffdad: stopping tablet replica
W20260709 12:14:14.252609 30896 consensus_peers.cc:597] T b6f09adc18e2485cbafdb86cfe535721 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179): Couldn't send request to peer 8130e18710c04a61a5d8bd019c6ffdad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:14.253531 21266 raft_consensus.cc:2243] T 34e3009dd96f4545b2abe325ac95e960 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.253911 21266 raft_consensus.cc:2272] T 34e3009dd96f4545b2abe325ac95e960 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.256124 21266 tablet_replica.cc:333] T dcddf9f7713c4d04abedc36356c1888f P 8130e18710c04a61a5d8bd019c6ffdad: stopping tablet replica
I20260709 12:14:14.256711 21266 raft_consensus.cc:2243] T dcddf9f7713c4d04abedc36356c1888f P 8130e18710c04a61a5d8bd019c6ffdad [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:14.257443 21266 raft_consensus.cc:2272] T dcddf9f7713c4d04abedc36356c1888f P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.259856 21266 tablet_replica.cc:333] T bb358c4df82f4168bc1debdfc4e7aa9c P 8130e18710c04a61a5d8bd019c6ffdad: stopping tablet replica
I20260709 12:14:14.260458 21266 raft_consensus.cc:2243] T bb358c4df82f4168bc1debdfc4e7aa9c P 8130e18710c04a61a5d8bd019c6ffdad [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:14.261261 21266 raft_consensus.cc:2272] T bb358c4df82f4168bc1debdfc4e7aa9c P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.263903 21266 tablet_replica.cc:333] T b6f09adc18e2485cbafdb86cfe535721 P 8130e18710c04a61a5d8bd019c6ffdad: stopping tablet replica
I20260709 12:14:14.264464 21266 raft_consensus.cc:2243] T b6f09adc18e2485cbafdb86cfe535721 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:14.264572 30822 consensus_peers.cc:597] T ac15e10cad8e4cbc9763eacc349d9549 P 8130e18710c04a61a5d8bd019c6ffdad -> Peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Couldn't send request to peer 84b98f9236604dd0b22ae23c5378a676. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:40083: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:14.265131 21266 raft_consensus.cc:2272] T b6f09adc18e2485cbafdb86cfe535721 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.267282 21266 tablet_replica.cc:333] T ac15e10cad8e4cbc9763eacc349d9549 P 8130e18710c04a61a5d8bd019c6ffdad: stopping tablet replica
I20260709 12:14:14.267835 21266 raft_consensus.cc:2243] T ac15e10cad8e4cbc9763eacc349d9549 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:14.268549 21266 raft_consensus.cc:2272] T ac15e10cad8e4cbc9763eacc349d9549 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.270522 21266 tablet_replica.cc:333] T 615eb2fb16414287bc0956a27523b7f4 P 8130e18710c04a61a5d8bd019c6ffdad: stopping tablet replica
I20260709 12:14:14.271129 21266 raft_consensus.cc:2243] T 615eb2fb16414287bc0956a27523b7f4 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:14.271879 21266 raft_consensus.cc:2272] T 615eb2fb16414287bc0956a27523b7f4 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.273995 21266 tablet_replica.cc:333] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 8130e18710c04a61a5d8bd019c6ffdad: stopping tablet replica
I20260709 12:14:14.274559 21266 raft_consensus.cc:2243] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.275399 21266 raft_consensus.cc:2272] T 2bd90e4c16c54e13ae2b1c1e08d6238c P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.277721 21266 tablet_replica.cc:333] T 554acf71459c4e59b886396df52b3004 P 8130e18710c04a61a5d8bd019c6ffdad: stopping tablet replica
I20260709 12:14:14.278551 21266 raft_consensus.cc:2243] T 554acf71459c4e59b886396df52b3004 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.279088 21266 raft_consensus.cc:2272] T 554acf71459c4e59b886396df52b3004 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.281792 21266 tablet_replica.cc:333] T 1eb80935abae44bf8dde4d54961c5fdb P 8130e18710c04a61a5d8bd019c6ffdad: stopping tablet replica
W20260709 12:14:14.281842 30896 consensus_peers.cc:597] T 671d30cec67d47a89e8ec6fab0c53c48 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Couldn't send request to peer 84b98f9236604dd0b22ae23c5378a676. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:40083: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:14.282706 21266 raft_consensus.cc:2243] T 1eb80935abae44bf8dde4d54961c5fdb P 8130e18710c04a61a5d8bd019c6ffdad [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.283334 21266 raft_consensus.cc:2272] T 1eb80935abae44bf8dde4d54961c5fdb P 8130e18710c04a61a5d8bd019c6ffdad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.286185 21266 tablet_replica.cc:333] T 8c580512b11742d4977ff026ff8fc795 P 8130e18710c04a61a5d8bd019c6ffdad: stopping tablet replica
I20260709 12:14:14.287034 21266 raft_consensus.cc:2243] T 8c580512b11742d4977ff026ff8fc795 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:14.288028 21266 raft_consensus.cc:2272] T 8c580512b11742d4977ff026ff8fc795 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.290653 21266 tablet_replica.cc:333] T 99164e2d6f664ceab4d5921867d62c31 P 8130e18710c04a61a5d8bd019c6ffdad: stopping tablet replica
I20260709 12:14:14.291368 21266 raft_consensus.cc:2243] T 99164e2d6f664ceab4d5921867d62c31 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.291918 21266 raft_consensus.cc:2272] T 99164e2d6f664ceab4d5921867d62c31 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.294745 21266 tablet_replica.cc:333] T b047acdc74424afc81c6380239209821 P 8130e18710c04a61a5d8bd019c6ffdad: stopping tablet replica
I20260709 12:14:14.295477 21266 raft_consensus.cc:2243] T b047acdc74424afc81c6380239209821 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.296030 21266 raft_consensus.cc:2272] T b047acdc74424afc81c6380239209821 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.298693 21266 tablet_replica.cc:333] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 8130e18710c04a61a5d8bd019c6ffdad: stopping tablet replica
I20260709 12:14:14.299453 21266 raft_consensus.cc:2243] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.299971 21266 raft_consensus.cc:2272] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.302537 21266 tablet_replica.cc:333] T cdf560ffbc0c4b8b80beb6494a13d9cd P 8130e18710c04a61a5d8bd019c6ffdad: stopping tablet replica
I20260709 12:14:14.303321 21266 raft_consensus.cc:2243] T cdf560ffbc0c4b8b80beb6494a13d9cd P 8130e18710c04a61a5d8bd019c6ffdad [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.303807 21266 raft_consensus.cc:2272] T cdf560ffbc0c4b8b80beb6494a13d9cd P 8130e18710c04a61a5d8bd019c6ffdad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.305833 21266 tablet_replica.cc:333] T 0203e5cc33ca470eb9c1f366291c344d P 8130e18710c04a61a5d8bd019c6ffdad: stopping tablet replica
I20260709 12:14:14.306598 21266 raft_consensus.cc:2243] T 0203e5cc33ca470eb9c1f366291c344d P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.307137 21266 raft_consensus.cc:2272] T 0203e5cc33ca470eb9c1f366291c344d P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.309769 21266 tablet_replica.cc:333] T 7b23395f850d4699b8d289f501c96f60 P 8130e18710c04a61a5d8bd019c6ffdad: stopping tablet replica
I20260709 12:14:14.310488 21266 raft_consensus.cc:2243] T 7b23395f850d4699b8d289f501c96f60 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:14.311399 21266 raft_consensus.cc:2272] T 7b23395f850d4699b8d289f501c96f60 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.314013 21266 tablet_replica.cc:333] T d5a270750666414887b6fae2f3793dc5 P 8130e18710c04a61a5d8bd019c6ffdad: stopping tablet replica
I20260709 12:14:14.314733 21266 raft_consensus.cc:2243] T d5a270750666414887b6fae2f3793dc5 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:14.315624 21266 raft_consensus.cc:2272] T d5a270750666414887b6fae2f3793dc5 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.318410 21266 tablet_replica.cc:333] T da25c47d7366434089b73f8af7ce453b P 8130e18710c04a61a5d8bd019c6ffdad: stopping tablet replica
I20260709 12:14:14.319160 21266 raft_consensus.cc:2243] T da25c47d7366434089b73f8af7ce453b P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.319654 21266 raft_consensus.cc:2272] T da25c47d7366434089b73f8af7ce453b P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.322181 21266 tablet_replica.cc:333] T eb58d3a8bd8540ff9871ea41021a5025 P 8130e18710c04a61a5d8bd019c6ffdad: stopping tablet replica
I20260709 12:14:14.322786 21266 raft_consensus.cc:2243] T eb58d3a8bd8540ff9871ea41021a5025 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.323208 21266 raft_consensus.cc:2272] T eb58d3a8bd8540ff9871ea41021a5025 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.325169 21266 tablet_replica.cc:333] T c449839430794851b61ffba23f946c4f P 8130e18710c04a61a5d8bd019c6ffdad: stopping tablet replica
I20260709 12:14:14.325708 21266 raft_consensus.cc:2243] T c449839430794851b61ffba23f946c4f P 8130e18710c04a61a5d8bd019c6ffdad [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:14.326475 21266 raft_consensus.cc:2272] T c449839430794851b61ffba23f946c4f P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.328522 21266 tablet_replica.cc:333] T 472c5cafdab84ead8ce9b93950070d13 P 8130e18710c04a61a5d8bd019c6ffdad: stopping tablet replica
I20260709 12:14:14.329057 21266 raft_consensus.cc:2243] T 472c5cafdab84ead8ce9b93950070d13 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.329488 21266 raft_consensus.cc:2272] T 472c5cafdab84ead8ce9b93950070d13 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.331434 21266 tablet_replica.cc:333] T f0fbdcbe46b34107bbbf63f69c98e244 P 8130e18710c04a61a5d8bd019c6ffdad: stopping tablet replica
I20260709 12:14:14.332005 21266 raft_consensus.cc:2243] T f0fbdcbe46b34107bbbf63f69c98e244 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.332406 21266 raft_consensus.cc:2272] T f0fbdcbe46b34107bbbf63f69c98e244 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.334259 21266 tablet_replica.cc:333] T 491ae2039a6347a896b3a5aeacaa71b2 P 8130e18710c04a61a5d8bd019c6ffdad: stopping tablet replica
I20260709 12:14:14.334772 21266 raft_consensus.cc:2243] T 491ae2039a6347a896b3a5aeacaa71b2 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.335204 21266 raft_consensus.cc:2272] T 491ae2039a6347a896b3a5aeacaa71b2 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.337854 21266 tablet_replica.cc:333] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 8130e18710c04a61a5d8bd019c6ffdad: stopping tablet replica
I20260709 12:14:14.338539 21266 raft_consensus.cc:2243] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.339099 21266 raft_consensus.cc:2272] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:14.339978 30896 consensus_peers.cc:597] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179): Couldn't send request to peer 8130e18710c04a61a5d8bd019c6ffdad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:14.341163 21266 tablet_replica.cc:333] T e57ee667f8a246eb98ab6b169eb779b9 P 8130e18710c04a61a5d8bd019c6ffdad: stopping tablet replica
I20260709 12:14:14.341768 21266 raft_consensus.cc:2243] T e57ee667f8a246eb98ab6b169eb779b9 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.342173 21266 raft_consensus.cc:2272] T e57ee667f8a246eb98ab6b169eb779b9 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.344008 21266 tablet_replica.cc:333] T fd65967534164e9c805fc3d5d05e0369 P 8130e18710c04a61a5d8bd019c6ffdad: stopping tablet replica
I20260709 12:14:14.344563 21266 raft_consensus.cc:2243] T fd65967534164e9c805fc3d5d05e0369 P 8130e18710c04a61a5d8bd019c6ffdad [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.345026 21266 raft_consensus.cc:2272] T fd65967534164e9c805fc3d5d05e0369 P 8130e18710c04a61a5d8bd019c6ffdad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.347426 21266 tablet_replica.cc:333] T 745e2cea61c44c3a80bdc49add504a75 P 8130e18710c04a61a5d8bd019c6ffdad: stopping tablet replica
I20260709 12:14:14.348171 21266 raft_consensus.cc:2243] T 745e2cea61c44c3a80bdc49add504a75 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.348626 21266 raft_consensus.cc:2272] T 745e2cea61c44c3a80bdc49add504a75 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.350762 21266 tablet_replica.cc:333] T a0bb1498511242ef95085be49c10c4d3 P 8130e18710c04a61a5d8bd019c6ffdad: stopping tablet replica
I20260709 12:14:14.351322 21266 raft_consensus.cc:2243] T a0bb1498511242ef95085be49c10c4d3 P 8130e18710c04a61a5d8bd019c6ffdad [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.351737 21266 raft_consensus.cc:2272] T a0bb1498511242ef95085be49c10c4d3 P 8130e18710c04a61a5d8bd019c6ffdad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.353564 21266 tablet_replica.cc:333] T 21c0ba9bb1d64ab398c606450f72e966 P 8130e18710c04a61a5d8bd019c6ffdad: stopping tablet replica
I20260709 12:14:14.354051 21266 raft_consensus.cc:2243] T 21c0ba9bb1d64ab398c606450f72e966 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:14.354836 21266 raft_consensus.cc:2272] T 21c0ba9bb1d64ab398c606450f72e966 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.357421 21266 tablet_replica.cc:333] T 8b66a7b6f8aa4803b482e392cc945db7 P 8130e18710c04a61a5d8bd019c6ffdad: stopping tablet replica
I20260709 12:14:14.358166 21266 raft_consensus.cc:2243] T 8b66a7b6f8aa4803b482e392cc945db7 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.358659 21266 raft_consensus.cc:2272] T 8b66a7b6f8aa4803b482e392cc945db7 P 8130e18710c04a61a5d8bd019c6ffdad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.361089 21266 tablet_replica.cc:333] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad: stopping tablet replica
I20260709 12:14:14.361618 21266 raft_consensus.cc:2243] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.362027 21266 raft_consensus.cc:2272] T 0317908edb88497b82c4e59ef1bac414 P 8130e18710c04a61a5d8bd019c6ffdad [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.364051 21266 tablet_replica.cc:333] T a6a5bd717fa048aabdd0879bcea0fd60 P 8130e18710c04a61a5d8bd019c6ffdad: stopping tablet replica
I20260709 12:14:14.364512 21266 raft_consensus.cc:2243] T a6a5bd717fa048aabdd0879bcea0fd60 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:14.365407 21266 raft_consensus.cc:2272] T a6a5bd717fa048aabdd0879bcea0fd60 P 8130e18710c04a61a5d8bd019c6ffdad [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:14.425629 30896 consensus_peers.cc:597] T 99164e2d6f664ceab4d5921867d62c31 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179): Couldn't send request to peer 8130e18710c04a61a5d8bd019c6ffdad. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.131:42179: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:14.434260 21266 tablet_server.cc:196] TabletServer@127.20.196.131:0 shutdown complete.
W20260709 12:14:14.453558 30896 consensus_peers.cc:597] T 5323645d8e844a489d166a94c77c2af1 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179): Couldn't send request to peer 8130e18710c04a61a5d8bd019c6ffdad. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.131:42179: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:14.485347 30896 consensus_peers.cc:597] T 2137918dbdc34ac29180015bd93261de P 15ad0880a63541ef965cb6acca4513d7 -> Peer 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179): Couldn't send request to peer 8130e18710c04a61a5d8bd019c6ffdad. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.131:42179: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:14.511639 21266 tablet_server.cc:179] TabletServer@127.20.196.132:0 shutting down...
W20260709 12:14:14.542502 30896 consensus_peers.cc:597] T 34e3009dd96f4545b2abe325ac95e960 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179): Couldn't send request to peer 8130e18710c04a61a5d8bd019c6ffdad. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.131:42179: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:14.565171 21266 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:14.566325 21266 tablet_replica.cc:333] T fa9f00939aba452180334d67a6d33010 P 15ad0880a63541ef965cb6acca4513d7: stopping tablet replica
I20260709 12:14:14.567391 21266 raft_consensus.cc:2243] T fa9f00939aba452180334d67a6d33010 P 15ad0880a63541ef965cb6acca4513d7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:14.568436 21266 raft_consensus.cc:2272] T fa9f00939aba452180334d67a6d33010 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.571106 21266 tablet_replica.cc:333] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 15ad0880a63541ef965cb6acca4513d7: stopping tablet replica
I20260709 12:14:14.571949 21266 raft_consensus.cc:2243] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.572521 21266 raft_consensus.cc:2272] T 71c3fcab3f8f41238feeb802a6d2dbc9 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.574858 21266 tablet_replica.cc:333] T a4b7489c1b104bf2bb461bcdca7e6f42 P 15ad0880a63541ef965cb6acca4513d7: stopping tablet replica
I20260709 12:14:14.575505 21266 raft_consensus.cc:2243] T a4b7489c1b104bf2bb461bcdca7e6f42 P 15ad0880a63541ef965cb6acca4513d7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:14.576316 21266 raft_consensus.cc:2272] T a4b7489c1b104bf2bb461bcdca7e6f42 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.578326 21266 tablet_replica.cc:333] T 32c211a79de247c8b5cef16a2d0a4dcb P 15ad0880a63541ef965cb6acca4513d7: stopping tablet replica
I20260709 12:14:14.579020 21266 raft_consensus.cc:2243] T 32c211a79de247c8b5cef16a2d0a4dcb P 15ad0880a63541ef965cb6acca4513d7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:14.579337 31889 raft_consensus.cc:493] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c5665c17e904fc692bce76fc57b2460)
I20260709 12:14:14.579892 21266 raft_consensus.cc:2272] T 32c211a79de247c8b5cef16a2d0a4dcb P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.579819 31889 raft_consensus.cc:515] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } } peers { permanent_uuid: "84b98f9236604dd0b22ae23c5378a676" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40083 } }
I20260709 12:14:14.581557 31889 leader_election.cc:290] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909), 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083)
I20260709 12:14:14.582372 21266 tablet_replica.cc:333] T ca92b4f3c36b42fb9aa2f575c06344fe P 15ad0880a63541ef965cb6acca4513d7: stopping tablet replica
I20260709 12:14:14.583318 21266 raft_consensus.cc:2243] T ca92b4f3c36b42fb9aa2f575c06344fe P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.583818 21266 raft_consensus.cc:2272] T ca92b4f3c36b42fb9aa2f575c06344fe P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:14.585805 30896 leader_election.cc:336] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 84b98f9236604dd0b22ae23c5378a676 (127.20.196.130:40083): Network error: Client connection negotiation failed: client connection to 127.20.196.130:40083: connect: Connection refused (error 111)
W20260709 12:14:14.586346 30898 leader_election.cc:336] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111)
I20260709 12:14:14.586628 21266 tablet_replica.cc:333] T 3e0e49105b2d44f09c55f7cc603f9b91 P 15ad0880a63541ef965cb6acca4513d7: stopping tablet replica
I20260709 12:14:14.586808 30898 leader_election.cc:304] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7; no voters: 6c5665c17e904fc692bce76fc57b2460, 84b98f9236604dd0b22ae23c5378a676
I20260709 12:14:14.587527 31889 raft_consensus.cc:2749] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:14.587549 21266 raft_consensus.cc:2243] T 3e0e49105b2d44f09c55f7cc603f9b91 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.588255 21266 raft_consensus.cc:2272] T 3e0e49105b2d44f09c55f7cc603f9b91 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.590503 21266 tablet_replica.cc:333] T ec7d33fd7f3245f68966bd7749ee53c3 P 15ad0880a63541ef965cb6acca4513d7: stopping tablet replica
I20260709 12:14:14.591341 21266 raft_consensus.cc:2243] T ec7d33fd7f3245f68966bd7749ee53c3 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.591903 21266 raft_consensus.cc:2272] T ec7d33fd7f3245f68966bd7749ee53c3 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.594190 21266 tablet_replica.cc:333] T 4031508121204ef4a2f5f2f0e9508cab P 15ad0880a63541ef965cb6acca4513d7: stopping tablet replica
I20260709 12:14:14.594849 21266 raft_consensus.cc:2243] T 4031508121204ef4a2f5f2f0e9508cab P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.595340 21266 raft_consensus.cc:2272] T 4031508121204ef4a2f5f2f0e9508cab P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.597295 21266 tablet_replica.cc:333] T 1bbb677d9c544ed5a31297773b1508d6 P 15ad0880a63541ef965cb6acca4513d7: stopping tablet replica
I20260709 12:14:14.597859 21266 raft_consensus.cc:2243] T 1bbb677d9c544ed5a31297773b1508d6 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.598302 21266 raft_consensus.cc:2272] T 1bbb677d9c544ed5a31297773b1508d6 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.600231 21266 tablet_replica.cc:333] T 2137918dbdc34ac29180015bd93261de P 15ad0880a63541ef965cb6acca4513d7: stopping tablet replica
I20260709 12:14:14.600787 21266 raft_consensus.cc:2243] T 2137918dbdc34ac29180015bd93261de P 15ad0880a63541ef965cb6acca4513d7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:14.601192 31889 raft_consensus.cc:493] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6c5665c17e904fc692bce76fc57b2460)
I20260709 12:14:14.601626 21266 raft_consensus.cc:2272] T 2137918dbdc34ac29180015bd93261de P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.601629 31889 raft_consensus.cc:515] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:14:14.603646 31889 leader_election.cc:290] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:14:14.604167 21266 tablet_replica.cc:333] T f351526ad9564be4be05825c266794c7 P 15ad0880a63541ef965cb6acca4513d7: stopping tablet replica
I20260709 12:14:14.604812 21266 raft_consensus.cc:2243] T f351526ad9564be4be05825c266794c7 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.605345 21266 raft_consensus.cc:2272] T f351526ad9564be4be05825c266794c7 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:14.607602 30896 leader_election.cc:336] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179): Network error: Client connection negotiation failed: client connection to 127.20.196.131:42179: connect: Connection refused (error 111)
I20260709 12:14:14.608210 21266 tablet_replica.cc:333] T 5323645d8e844a489d166a94c77c2af1 P 15ad0880a63541ef965cb6acca4513d7: stopping tablet replica
W20260709 12:14:14.608103 30898 leader_election.cc:336] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111)
I20260709 12:14:14.608769 30898 leader_election.cc:304] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7; no voters: 6c5665c17e904fc692bce76fc57b2460, 8130e18710c04a61a5d8bd019c6ffdad
I20260709 12:14:14.608968 21266 raft_consensus.cc:2243] T 5323645d8e844a489d166a94c77c2af1 P 15ad0880a63541ef965cb6acca4513d7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:14.609331 31889 raft_consensus.cc:2749] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:14.610594 21266 raft_consensus.cc:2272] T 5323645d8e844a489d166a94c77c2af1 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.612663 21266 tablet_replica.cc:333] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7: stopping tablet replica
I20260709 12:14:14.613232 21266 raft_consensus.cc:2243] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.613637 21266 raft_consensus.cc:2272] T baedd172e30a4ef4a6641302fdebd9c5 P 15ad0880a63541ef965cb6acca4513d7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.615522 21266 tablet_replica.cc:333] T 2971ad17262c4b5e8665700af97ec254 P 15ad0880a63541ef965cb6acca4513d7: stopping tablet replica
I20260709 12:14:14.616057 21266 raft_consensus.cc:2243] T 2971ad17262c4b5e8665700af97ec254 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.616489 21266 raft_consensus.cc:2272] T 2971ad17262c4b5e8665700af97ec254 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.618307 21266 tablet_replica.cc:333] T 34e3009dd96f4545b2abe325ac95e960 P 15ad0880a63541ef965cb6acca4513d7: stopping tablet replica
I20260709 12:14:14.618849 21266 raft_consensus.cc:2243] T 34e3009dd96f4545b2abe325ac95e960 P 15ad0880a63541ef965cb6acca4513d7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:14.619653 21266 raft_consensus.cc:2272] T 34e3009dd96f4545b2abe325ac95e960 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.621475 21266 tablet_replica.cc:333] T 2ff9e0d905854cceb79f96f500a07339 P 15ad0880a63541ef965cb6acca4513d7: stopping tablet replica
I20260709 12:14:14.621999 21266 raft_consensus.cc:2243] T 2ff9e0d905854cceb79f96f500a07339 P 15ad0880a63541ef965cb6acca4513d7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:14.622818 21266 raft_consensus.cc:2272] T 2ff9e0d905854cceb79f96f500a07339 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.625054 21266 tablet_replica.cc:333] T dcddf9f7713c4d04abedc36356c1888f P 15ad0880a63541ef965cb6acca4513d7: stopping tablet replica
I20260709 12:14:14.625758 21266 raft_consensus.cc:2243] T dcddf9f7713c4d04abedc36356c1888f P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.626232 21266 raft_consensus.cc:2272] T dcddf9f7713c4d04abedc36356c1888f P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.659655 21266 tablet_replica.cc:333] T b9cc9d529de24234b98ed5e152fd4b24 P 15ad0880a63541ef965cb6acca4513d7: stopping tablet replica
I20260709 12:14:14.662640 21266 raft_consensus.cc:2243] T b9cc9d529de24234b98ed5e152fd4b24 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.664042 21266 raft_consensus.cc:2272] T b9cc9d529de24234b98ed5e152fd4b24 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:14.666437 30896 consensus_peers.cc:597] T da25c47d7366434089b73f8af7ce453b P 15ad0880a63541ef965cb6acca4513d7 -> Peer 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179): Couldn't send request to peer 8130e18710c04a61a5d8bd019c6ffdad. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.131:42179: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:14.668286 21266 tablet_replica.cc:333] T bb358c4df82f4168bc1debdfc4e7aa9c P 15ad0880a63541ef965cb6acca4513d7: stopping tablet replica
I20260709 12:14:14.669034 21266 raft_consensus.cc:2243] T bb358c4df82f4168bc1debdfc4e7aa9c P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.669670 21266 raft_consensus.cc:2272] T bb358c4df82f4168bc1debdfc4e7aa9c P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.673521 21266 tablet_replica.cc:333] T ac15e10cad8e4cbc9763eacc349d9549 P 15ad0880a63541ef965cb6acca4513d7: stopping tablet replica
I20260709 12:14:14.675199 21266 raft_consensus.cc:2243] T ac15e10cad8e4cbc9763eacc349d9549 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.676167 21266 raft_consensus.cc:2272] T ac15e10cad8e4cbc9763eacc349d9549 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.679366 21266 tablet_replica.cc:333] T b6f09adc18e2485cbafdb86cfe535721 P 15ad0880a63541ef965cb6acca4513d7: stopping tablet replica
I20260709 12:14:14.679979 21266 raft_consensus.cc:2243] T b6f09adc18e2485cbafdb86cfe535721 P 15ad0880a63541ef965cb6acca4513d7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:14.681257 21266 raft_consensus.cc:2272] T b6f09adc18e2485cbafdb86cfe535721 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.684115 21266 tablet_replica.cc:333] T 1eb80935abae44bf8dde4d54961c5fdb P 15ad0880a63541ef965cb6acca4513d7: stopping tablet replica
I20260709 12:14:14.685163 21266 raft_consensus.cc:2243] T 1eb80935abae44bf8dde4d54961c5fdb P 15ad0880a63541ef965cb6acca4513d7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.685742 21266 raft_consensus.cc:2272] T 1eb80935abae44bf8dde4d54961c5fdb P 15ad0880a63541ef965cb6acca4513d7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.688831 21266 tablet_replica.cc:333] T 8c580512b11742d4977ff026ff8fc795 P 15ad0880a63541ef965cb6acca4513d7: stopping tablet replica
I20260709 12:14:14.690027 21266 raft_consensus.cc:2243] T 8c580512b11742d4977ff026ff8fc795 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.690701 21266 raft_consensus.cc:2272] T 8c580512b11742d4977ff026ff8fc795 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.693989 21266 tablet_replica.cc:333] T c5afc0720ca546d8b13026e7c7a30c1e P 15ad0880a63541ef965cb6acca4513d7: stopping tablet replica
I20260709 12:14:14.694626 21266 raft_consensus.cc:2243] T c5afc0720ca546d8b13026e7c7a30c1e P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.695248 21266 raft_consensus.cc:2272] T c5afc0720ca546d8b13026e7c7a30c1e P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.698372 21266 tablet_replica.cc:333] T 660d2eb6dd3f4e96aab252cfd980be89 P 15ad0880a63541ef965cb6acca4513d7: stopping tablet replica
I20260709 12:14:14.699846 21266 raft_consensus.cc:2243] T 660d2eb6dd3f4e96aab252cfd980be89 P 15ad0880a63541ef965cb6acca4513d7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:14.702203 21266 raft_consensus.cc:2272] T 660d2eb6dd3f4e96aab252cfd980be89 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.704715 21266 tablet_replica.cc:333] T 5d636204e40644318b4758f37c7b0474 P 15ad0880a63541ef965cb6acca4513d7: stopping tablet replica
I20260709 12:14:14.706103 21266 raft_consensus.cc:2243] T 5d636204e40644318b4758f37c7b0474 P 15ad0880a63541ef965cb6acca4513d7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:14.708230 21266 raft_consensus.cc:2272] T 5d636204e40644318b4758f37c7b0474 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:14.710544 30896 consensus_peers.cc:597] T b047acdc74424afc81c6380239209821 P 15ad0880a63541ef965cb6acca4513d7 -> Peer 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179): Couldn't send request to peer 8130e18710c04a61a5d8bd019c6ffdad. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.131:42179: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:14.711088 21266 tablet_replica.cc:333] T 99164e2d6f664ceab4d5921867d62c31 P 15ad0880a63541ef965cb6acca4513d7: stopping tablet replica
I20260709 12:14:14.711953 21266 raft_consensus.cc:2243] T 99164e2d6f664ceab4d5921867d62c31 P 15ad0880a63541ef965cb6acca4513d7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:14.713985 21266 raft_consensus.cc:2272] T 99164e2d6f664ceab4d5921867d62c31 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.717406 21266 tablet_replica.cc:333] T 21c0ba9bb1d64ab398c606450f72e966 P 15ad0880a63541ef965cb6acca4513d7: stopping tablet replica
I20260709 12:14:14.717975 21266 raft_consensus.cc:2243] T 21c0ba9bb1d64ab398c606450f72e966 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.718531 21266 raft_consensus.cc:2272] T 21c0ba9bb1d64ab398c606450f72e966 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.721475 21266 tablet_replica.cc:333] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7: stopping tablet replica
I20260709 12:14:14.722471 21266 raft_consensus.cc:2243] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.723115 21266 raft_consensus.cc:2272] T fd65967534164e9c805fc3d5d05e0369 P 15ad0880a63541ef965cb6acca4513d7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.725771 21266 tablet_replica.cc:333] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 15ad0880a63541ef965cb6acca4513d7: stopping tablet replica
I20260709 12:14:14.726352 21266 raft_consensus.cc:2243] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.726928 21266 raft_consensus.cc:2272] T 5324c1d1d0cd4e6e96c28c96ebcbb03f P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.729547 21266 tablet_replica.cc:333] T 7b23395f850d4699b8d289f501c96f60 P 15ad0880a63541ef965cb6acca4513d7: stopping tablet replica
I20260709 12:14:14.730206 21266 raft_consensus.cc:2243] T 7b23395f850d4699b8d289f501c96f60 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.730717 21266 raft_consensus.cc:2272] T 7b23395f850d4699b8d289f501c96f60 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.733453 21266 tablet_replica.cc:333] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7: stopping tablet replica
I20260709 12:14:14.734150 21266 raft_consensus.cc:2243] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.734583 31895 raft_consensus.cc:493] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c5665c17e904fc692bce76fc57b2460)
I20260709 12:14:14.735044 21266 raft_consensus.cc:2272] T c52d3c5b6b15499e9c834cf33954609a P 15ad0880a63541ef965cb6acca4513d7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.735447 31895 raft_consensus.cc:515] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8130e18710c04a61a5d8bd019c6ffdad" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 42179 } } peers { permanent_uuid: "15ad0880a63541ef965cb6acca4513d7" member_type: VOTER last_known_addr { host: "127.20.196.132" port: 43035 } } peers { permanent_uuid: "6c5665c17e904fc692bce76fc57b2460" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40909 } }
I20260709 12:14:14.738073 21266 tablet_replica.cc:333] T da25c47d7366434089b73f8af7ce453b P 15ad0880a63541ef965cb6acca4513d7: stopping tablet replica
I20260709 12:14:14.738145 31895 leader_election.cc:290] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179), 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909)
I20260709 12:14:14.739261 21266 raft_consensus.cc:2243] T da25c47d7366434089b73f8af7ce453b P 15ad0880a63541ef965cb6acca4513d7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:14.741573 21266 raft_consensus.cc:2272] T da25c47d7366434089b73f8af7ce453b P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:14.742453 30896 leader_election.cc:336] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8130e18710c04a61a5d8bd019c6ffdad (127.20.196.131:42179): Network error: Client connection negotiation failed: client connection to 127.20.196.131:42179: connect: Connection refused (error 111)
W20260709 12:14:14.743187 30898 leader_election.cc:336] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6c5665c17e904fc692bce76fc57b2460 (127.20.196.129:40909): Network error: Client connection negotiation failed: client connection to 127.20.196.129:40909: connect: Connection refused (error 111)
I20260709 12:14:14.743666 30898 leader_election.cc:304] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15ad0880a63541ef965cb6acca4513d7; no voters: 6c5665c17e904fc692bce76fc57b2460, 8130e18710c04a61a5d8bd019c6ffdad
I20260709 12:14:14.744541 31895 raft_consensus.cc:2749] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:14.745810 21266 tablet_replica.cc:333] T d5a270750666414887b6fae2f3793dc5 P 15ad0880a63541ef965cb6acca4513d7: stopping tablet replica
I20260709 12:14:14.746686 21266 raft_consensus.cc:2243] T d5a270750666414887b6fae2f3793dc5 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.747551 21266 raft_consensus.cc:2272] T d5a270750666414887b6fae2f3793dc5 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.750103 21266 tablet_replica.cc:333] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 15ad0880a63541ef965cb6acca4513d7: stopping tablet replica
I20260709 12:14:14.750639 21266 raft_consensus.cc:2243] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 15ad0880a63541ef965cb6acca4513d7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:14.751936 21266 raft_consensus.cc:2272] T 0b3eb62be46741aa9c0364ddea2ca5c9 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.754161 21266 tablet_replica.cc:333] T b047acdc74424afc81c6380239209821 P 15ad0880a63541ef965cb6acca4513d7: stopping tablet replica
I20260709 12:14:14.754851 21266 raft_consensus.cc:2243] T b047acdc74424afc81c6380239209821 P 15ad0880a63541ef965cb6acca4513d7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:14.755864 21266 raft_consensus.cc:2272] T b047acdc74424afc81c6380239209821 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.758347 21266 tablet_replica.cc:333] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7: stopping tablet replica
I20260709 12:14:14.758921 21266 raft_consensus.cc:2243] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.759557 21266 raft_consensus.cc:2272] T a318673515aa415db1aa91d126a5b724 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.761972 21266 tablet_replica.cc:333] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7: stopping tablet replica
I20260709 12:14:14.762490 21266 raft_consensus.cc:2243] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.763073 21266 raft_consensus.cc:2272] T 8b66a7b6f8aa4803b482e392cc945db7 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.765206 21266 tablet_replica.cc:333] T 671d30cec67d47a89e8ec6fab0c53c48 P 15ad0880a63541ef965cb6acca4513d7: stopping tablet replica
I20260709 12:14:14.765784 21266 raft_consensus.cc:2243] T 671d30cec67d47a89e8ec6fab0c53c48 P 15ad0880a63541ef965cb6acca4513d7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:14.766824 21266 raft_consensus.cc:2272] T 671d30cec67d47a89e8ec6fab0c53c48 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.769192 21266 tablet_replica.cc:333] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 15ad0880a63541ef965cb6acca4513d7: stopping tablet replica
I20260709 12:14:14.769750 21266 raft_consensus.cc:2243] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.770309 21266 raft_consensus.cc:2272] T 5b500ac0d6a6419b8bc041e830d2dcf7 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.772490 21266 tablet_replica.cc:333] T 472c5cafdab84ead8ce9b93950070d13 P 15ad0880a63541ef965cb6acca4513d7: stopping tablet replica
I20260709 12:14:14.773000 21266 raft_consensus.cc:2243] T 472c5cafdab84ead8ce9b93950070d13 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.773581 21266 raft_consensus.cc:2272] T 472c5cafdab84ead8ce9b93950070d13 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.775868 21266 tablet_replica.cc:333] T 491ae2039a6347a896b3a5aeacaa71b2 P 15ad0880a63541ef965cb6acca4513d7: stopping tablet replica
I20260709 12:14:14.776396 21266 raft_consensus.cc:2243] T 491ae2039a6347a896b3a5aeacaa71b2 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.776989 21266 raft_consensus.cc:2272] T 491ae2039a6347a896b3a5aeacaa71b2 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.779392 21266 tablet_replica.cc:333] T a6a5bd717fa048aabdd0879bcea0fd60 P 15ad0880a63541ef965cb6acca4513d7: stopping tablet replica
I20260709 12:14:14.779874 21266 raft_consensus.cc:2243] T a6a5bd717fa048aabdd0879bcea0fd60 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.780391 21266 raft_consensus.cc:2272] T a6a5bd717fa048aabdd0879bcea0fd60 P 15ad0880a63541ef965cb6acca4513d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.782615 21266 tablet_replica.cc:333] T 76d4dde0196948ef92f68df770af02b0 P 15ad0880a63541ef965cb6acca4513d7: stopping tablet replica
I20260709 12:14:14.783118 21266 raft_consensus.cc:2243] T 76d4dde0196948ef92f68df770af02b0 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.783669 21266 raft_consensus.cc:2272] T 76d4dde0196948ef92f68df770af02b0 P 15ad0880a63541ef965cb6acca4513d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.917868 21266 tablet_server.cc:196] TabletServer@127.20.196.132:0 shutdown complete.
I20260709 12:14:15.002154 21266 master.cc:562] Master@127.20.196.190:44745 shutting down...
I20260709 12:14:15.027092 21266 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 52770f65168a4e6a9c2fbf4335348a18 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:15.027937 21266 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 52770f65168a4e6a9c2fbf4335348a18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:15.028312 21266 tablet_replica.cc:333] T 00000000000000000000000000000000 P 52770f65168a4e6a9c2fbf4335348a18: stopping tablet replica
I20260709 12:14:15.051666 21266 master.cc:584] Master@127.20.196.190:44745 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (33932 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:14:15.153612 21266 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.196.190:34873
I20260709 12:14:15.154712 21266 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:15.160378 31896 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:15.160401 31897 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:15.162561 31899 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:15.163434 21266 server_base.cc:1061] running on GCE node
I20260709 12:14:15.164590 21266 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:15.164763 21266 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:15.164873 21266 hybrid_clock.cc:648] HybridClock initialized: now 1783599255164862 us; error 0 us; skew 500 ppm
I20260709 12:14:15.165316 21266 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:15.167801 21266 webserver.cc:533] Webserver started at http://127.20.196.190:34181/ using document root <none> and password file <none>
I20260709 12:14:15.168258 21266 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:15.168416 21266 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:15.168623 21266 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:15.169759 21266 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894355727-21266-0/minicluster-data/master-0-root/instance:
uuid: "efe29e3ae67d4f96b2dceef2e544b286"
format_stamp: "Formatted at 2026-07-09 12:14:15 on dist-test-slave-h6sg"
I20260709 12:14:15.174685 21266 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:14:15.178191 31904 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:15.179095 21266 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:14:15.179388 21266 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894355727-21266-0/minicluster-data/master-0-root
uuid: "efe29e3ae67d4f96b2dceef2e544b286"
format_stamp: "Formatted at 2026-07-09 12:14:15 on dist-test-slave-h6sg"
I20260709 12:14:15.179675 21266 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894355727-21266-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894355727-21266-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894355727-21266-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:15.191345 21266 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:15.192727 21266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:15.234371 21266 rpc_server.cc:307] RPC server started. Bound to: 127.20.196.190:34873
I20260709 12:14:15.234500 31955 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.196.190:34873 every 8 connection(s)
I20260709 12:14:15.238523 31956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.250950 31956 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P efe29e3ae67d4f96b2dceef2e544b286: Bootstrap starting.
I20260709 12:14:15.256297 31956 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P efe29e3ae67d4f96b2dceef2e544b286: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:15.260965 31956 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P efe29e3ae67d4f96b2dceef2e544b286: No bootstrap required, opened a new log
I20260709 12:14:15.263533 31956 raft_consensus.cc:359] T 00000000000000000000000000000000 P efe29e3ae67d4f96b2dceef2e544b286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efe29e3ae67d4f96b2dceef2e544b286" member_type: VOTER }
I20260709 12:14:15.263968 31956 raft_consensus.cc:385] T 00000000000000000000000000000000 P efe29e3ae67d4f96b2dceef2e544b286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:15.264253 31956 raft_consensus.cc:740] T 00000000000000000000000000000000 P efe29e3ae67d4f96b2dceef2e544b286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efe29e3ae67d4f96b2dceef2e544b286, State: Initialized, Role: FOLLOWER
I20260709 12:14:15.264953 31956 consensus_queue.cc:260] T 00000000000000000000000000000000 P efe29e3ae67d4f96b2dceef2e544b286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efe29e3ae67d4f96b2dceef2e544b286" member_type: VOTER }
I20260709 12:14:15.265461 31956 raft_consensus.cc:399] T 00000000000000000000000000000000 P efe29e3ae67d4f96b2dceef2e544b286 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:14:15.265718 31956 raft_consensus.cc:493] T 00000000000000000000000000000000 P efe29e3ae67d4f96b2dceef2e544b286 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:14:15.266013 31956 raft_consensus.cc:3060] T 00000000000000000000000000000000 P efe29e3ae67d4f96b2dceef2e544b286 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:15.271240 31956 raft_consensus.cc:515] T 00000000000000000000000000000000 P efe29e3ae67d4f96b2dceef2e544b286 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efe29e3ae67d4f96b2dceef2e544b286" member_type: VOTER }
I20260709 12:14:15.271782 31956 leader_election.cc:304] T 00000000000000000000000000000000 P efe29e3ae67d4f96b2dceef2e544b286 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: efe29e3ae67d4f96b2dceef2e544b286; no voters: 
I20260709 12:14:15.273028 31956 leader_election.cc:290] T 00000000000000000000000000000000 P efe29e3ae67d4f96b2dceef2e544b286 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:14:15.273442 31959 raft_consensus.cc:2804] T 00000000000000000000000000000000 P efe29e3ae67d4f96b2dceef2e544b286 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:15.274793 31959 raft_consensus.cc:697] T 00000000000000000000000000000000 P efe29e3ae67d4f96b2dceef2e544b286 [term 1 LEADER]: Becoming Leader. State: Replica: efe29e3ae67d4f96b2dceef2e544b286, State: Running, Role: LEADER
I20260709 12:14:15.275530 31959 consensus_queue.cc:237] T 00000000000000000000000000000000 P efe29e3ae67d4f96b2dceef2e544b286 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efe29e3ae67d4f96b2dceef2e544b286" member_type: VOTER }
I20260709 12:14:15.276358 31956 sys_catalog.cc:565] T 00000000000000000000000000000000 P efe29e3ae67d4f96b2dceef2e544b286 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:14:15.280767 31961 sys_catalog.cc:455] T 00000000000000000000000000000000 P efe29e3ae67d4f96b2dceef2e544b286 [sys.catalog]: SysCatalogTable state changed. Reason: New leader efe29e3ae67d4f96b2dceef2e544b286. Latest consensus state: current_term: 1 leader_uuid: "efe29e3ae67d4f96b2dceef2e544b286" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efe29e3ae67d4f96b2dceef2e544b286" member_type: VOTER } }
I20260709 12:14:15.281533 31961 sys_catalog.cc:458] T 00000000000000000000000000000000 P efe29e3ae67d4f96b2dceef2e544b286 [sys.catalog]: This master's current role is: LEADER
I20260709 12:14:15.282609 31960 sys_catalog.cc:455] T 00000000000000000000000000000000 P efe29e3ae67d4f96b2dceef2e544b286 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "efe29e3ae67d4f96b2dceef2e544b286" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efe29e3ae67d4f96b2dceef2e544b286" member_type: VOTER } }
I20260709 12:14:15.283222 31960 sys_catalog.cc:458] T 00000000000000000000000000000000 P efe29e3ae67d4f96b2dceef2e544b286 [sys.catalog]: This master's current role is: LEADER
I20260709 12:14:15.284575 31967 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:14:15.289333 31967 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:14:15.291637 21266 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:14:15.298381 31967 catalog_manager.cc:1383] Generated new cluster ID: 49a1142ff73b447182e42c108d72455b
I20260709 12:14:15.298678 31967 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:14:15.328442 31967 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:14:15.329962 31967 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:14:15.345683 31967 catalog_manager.cc:6070] T 00000000000000000000000000000000 P efe29e3ae67d4f96b2dceef2e544b286: Generated new TSK 0
I20260709 12:14:15.346287 31967 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:14:15.357990 21266 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:15.364563 31977 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:15.365823 31978 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:15.367565 31980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:15.367884 21266 server_base.cc:1061] running on GCE node
I20260709 12:14:15.369742 21266 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:15.369982 21266 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:15.370157 21266 hybrid_clock.cc:648] HybridClock initialized: now 1783599255370134 us; error 0 us; skew 500 ppm
I20260709 12:14:15.370702 21266 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:15.374001 21266 webserver.cc:533] Webserver started at http://127.20.196.129:46735/ using document root <none> and password file <none>
I20260709 12:14:15.374593 21266 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:15.374759 21266 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:15.375133 21266 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:15.376330 21266 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894355727-21266-0/minicluster-data/ts-0-root/instance:
uuid: "868ecd261e0249c984eb3d8afacef7e1"
format_stamp: "Formatted at 2026-07-09 12:14:15 on dist-test-slave-h6sg"
I20260709 12:14:15.381524 21266 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:14:15.385088 31985 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:15.385989 21266 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:14:15.386289 21266 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894355727-21266-0/minicluster-data/ts-0-root
uuid: "868ecd261e0249c984eb3d8afacef7e1"
format_stamp: "Formatted at 2026-07-09 12:14:15 on dist-test-slave-h6sg"
I20260709 12:14:15.386588 21266 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894355727-21266-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894355727-21266-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894355727-21266-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:15.397369 21266 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:15.398538 21266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:15.400014 21266 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:15.402415 21266 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:15.402634 21266 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:15.402892 21266 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:15.403105 21266 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:14:15.444716 21266 rpc_server.cc:307] RPC server started. Bound to: 127.20.196.129:45117
I20260709 12:14:15.444859 32047 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.196.129:45117 every 8 connection(s)
I20260709 12:14:15.450094 21266 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:15.458011 32052 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:15.463605 32053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:15.472544 32048 heartbeater.cc:344] Connected to a master server at 127.20.196.190:34873
I20260709 12:14:15.472592 21266 server_base.cc:1061] running on GCE node
W20260709 12:14:15.472646 32055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:15.473238 32048 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:15.474128 32048 heartbeater.cc:507] Master 127.20.196.190:34873 requested a full tablet report, sending...
I20260709 12:14:15.474275 21266 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:15.474596 21266 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:15.474779 21266 hybrid_clock.cc:648] HybridClock initialized: now 1783599255474764 us; error 0 us; skew 500 ppm
I20260709 12:14:15.475425 21266 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:15.476333 31921 ts_manager.cc:194] Registered new tserver with Master: 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117)
I20260709 12:14:15.478286 31921 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37402
I20260709 12:14:15.478343 21266 webserver.cc:533] Webserver started at http://127.20.196.130:41365/ using document root <none> and password file <none>
I20260709 12:14:15.479015 21266 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:15.479240 21266 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:15.479568 21266 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:15.480952 21266 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894355727-21266-0/minicluster-data/ts-1-root/instance:
uuid: "908f087afb9c4a04812368ab534a03b2"
format_stamp: "Formatted at 2026-07-09 12:14:15 on dist-test-slave-h6sg"
I20260709 12:14:15.486109 21266 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:14:15.489655 32060 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:15.490486 21266 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:14:15.490784 21266 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894355727-21266-0/minicluster-data/ts-1-root
uuid: "908f087afb9c4a04812368ab534a03b2"
format_stamp: "Formatted at 2026-07-09 12:14:15 on dist-test-slave-h6sg"
I20260709 12:14:15.491139 21266 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894355727-21266-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894355727-21266-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894355727-21266-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:15.504978 21266 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:15.506170 21266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:15.507675 21266 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:15.509811 21266 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:15.510049 21266 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:15.510290 21266 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:15.510469 21266 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:15.551291 21266 rpc_server.cc:307] RPC server started. Bound to: 127.20.196.130:35965
I20260709 12:14:15.551389 32122 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.196.130:35965 every 8 connection(s)
I20260709 12:14:15.556385 21266 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:15.564654 32126 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:15.566936 32127 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:15.569191 32123 heartbeater.cc:344] Connected to a master server at 127.20.196.190:34873
I20260709 12:14:15.569707 32123 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:15.569931 21266 server_base.cc:1061] running on GCE node
I20260709 12:14:15.570792 32123 heartbeater.cc:507] Master 127.20.196.190:34873 requested a full tablet report, sending...
W20260709 12:14:15.570942 32129 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:15.572125 21266 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:15.572438 21266 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:15.572626 21266 hybrid_clock.cc:648] HybridClock initialized: now 1783599255572607 us; error 0 us; skew 500 ppm
I20260709 12:14:15.573338 21266 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:15.573395 31921 ts_manager.cc:194] Registered new tserver with Master: 908f087afb9c4a04812368ab534a03b2 (127.20.196.130:35965)
I20260709 12:14:15.575358 31921 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37408
I20260709 12:14:15.576238 21266 webserver.cc:533] Webserver started at http://127.20.196.131:38919/ using document root <none> and password file <none>
I20260709 12:14:15.576862 21266 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:15.577095 21266 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:15.577394 21266 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:15.578559 21266 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894355727-21266-0/minicluster-data/ts-2-root/instance:
uuid: "665d4526e98a4f9898fab4723f981688"
format_stamp: "Formatted at 2026-07-09 12:14:15 on dist-test-slave-h6sg"
I20260709 12:14:15.583254 21266 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 12:14:15.586725 32134 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:15.587503 21266 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:14:15.587841 21266 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894355727-21266-0/minicluster-data/ts-2-root
uuid: "665d4526e98a4f9898fab4723f981688"
format_stamp: "Formatted at 2026-07-09 12:14:15 on dist-test-slave-h6sg"
I20260709 12:14:15.588184 21266 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894355727-21266-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894355727-21266-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894355727-21266-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:15.611828 21266 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:15.613154 21266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:15.614775 21266 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:15.617023 21266 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:15.617250 21266 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:15.617504 21266 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:15.617681 21266 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:15.661000 21266 rpc_server.cc:307] RPC server started. Bound to: 127.20.196.131:34699
I20260709 12:14:15.661101 32196 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.196.131:34699 every 8 connection(s)
I20260709 12:14:15.674880 32197 heartbeater.cc:344] Connected to a master server at 127.20.196.190:34873
I20260709 12:14:15.675344 32197 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:15.676069 32197 heartbeater.cc:507] Master 127.20.196.190:34873 requested a full tablet report, sending...
I20260709 12:14:15.678308 31921 ts_manager.cc:194] Registered new tserver with Master: 665d4526e98a4f9898fab4723f981688 (127.20.196.131:34699)
I20260709 12:14:15.679046 21266 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014919603s
I20260709 12:14:15.679965 31921 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46102
I20260709 12:14:15.705420 31921 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46106:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:14:15.708323 31921 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:14:15.799741 32013 tablet_service.cc:1511] Processing CreateTablet for tablet 37a856e5a8fa4b3d9fee7d843a26ef4a (DEFAULT_TABLE table=test-workload [id=6d15510f23af4601a7439402c8e5bcfc]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:14:15.801291 32013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37a856e5a8fa4b3d9fee7d843a26ef4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.808591 32012 tablet_service.cc:1511] Processing CreateTablet for tablet 15e900af838f4693b1d6f89ddee06965 (DEFAULT_TABLE table=test-workload [id=6d15510f23af4601a7439402c8e5bcfc]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:14:15.810278 32012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15e900af838f4693b1d6f89ddee06965. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.811913 32088 tablet_service.cc:1511] Processing CreateTablet for tablet 37a856e5a8fa4b3d9fee7d843a26ef4a (DEFAULT_TABLE table=test-workload [id=6d15510f23af4601a7439402c8e5bcfc]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:14:15.813335 32088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37a856e5a8fa4b3d9fee7d843a26ef4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.813795 32084 tablet_service.cc:1511] Processing CreateTablet for tablet 5cc7453e227a424c8b6645700e8cf4c8 (DEFAULT_TABLE table=test-workload [id=6d15510f23af4601a7439402c8e5bcfc]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:14:15.814236 32087 tablet_service.cc:1511] Processing CreateTablet for tablet 15e900af838f4693b1d6f89ddee06965 (DEFAULT_TABLE table=test-workload [id=6d15510f23af4601a7439402c8e5bcfc]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:14:15.815248 32084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cc7453e227a424c8b6645700e8cf4c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.815743 32011 tablet_service.cc:1511] Processing CreateTablet for tablet 50f879d2e1ef4a1384e7d77f4a3cf7f8 (DEFAULT_TABLE table=test-workload [id=6d15510f23af4601a7439402c8e5bcfc]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:14:15.817123 32011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50f879d2e1ef4a1384e7d77f4a3cf7f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.816906 32086 tablet_service.cc:1511] Processing CreateTablet for tablet 50f879d2e1ef4a1384e7d77f4a3cf7f8 (DEFAULT_TABLE table=test-workload [id=6d15510f23af4601a7439402c8e5bcfc]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:14:15.818296 32086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50f879d2e1ef4a1384e7d77f4a3cf7f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.820144 32085 tablet_service.cc:1511] Processing CreateTablet for tablet 6b89a1496f2c48959a93e4883a24148b (DEFAULT_TABLE table=test-workload [id=6d15510f23af4601a7439402c8e5bcfc]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:14:15.821472 32085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b89a1496f2c48959a93e4883a24148b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.824267 32083 tablet_service.cc:1511] Processing CreateTablet for tablet 496807cff0764aed8aac43768f03db67 (DEFAULT_TABLE table=test-workload [id=6d15510f23af4601a7439402c8e5bcfc]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:14:15.825698 32083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 496807cff0764aed8aac43768f03db67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.828675 32082 tablet_service.cc:1511] Processing CreateTablet for tablet 823ba3672286465bab521797c8fc296d (DEFAULT_TABLE table=test-workload [id=6d15510f23af4601a7439402c8e5bcfc]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:14:15.830673 32082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 823ba3672286465bab521797c8fc296d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.833523 32010 tablet_service.cc:1511] Processing CreateTablet for tablet 6b89a1496f2c48959a93e4883a24148b (DEFAULT_TABLE table=test-workload [id=6d15510f23af4601a7439402c8e5bcfc]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:14:15.836956 32009 tablet_service.cc:1511] Processing CreateTablet for tablet 5cc7453e227a424c8b6645700e8cf4c8 (DEFAULT_TABLE table=test-workload [id=6d15510f23af4601a7439402c8e5bcfc]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:14:15.837561 32006 tablet_service.cc:1511] Processing CreateTablet for tablet aa412a4ecaeb4b1b87bb9d9175e8fdc4 (DEFAULT_TABLE table=test-workload [id=6d15510f23af4601a7439402c8e5bcfc]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:14:15.838665 32010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b89a1496f2c48959a93e4883a24148b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.840356 32008 tablet_service.cc:1511] Processing CreateTablet for tablet 496807cff0764aed8aac43768f03db67 (DEFAULT_TABLE table=test-workload [id=6d15510f23af4601a7439402c8e5bcfc]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:14:15.841482 32162 tablet_service.cc:1511] Processing CreateTablet for tablet 37a856e5a8fa4b3d9fee7d843a26ef4a (DEFAULT_TABLE table=test-workload [id=6d15510f23af4601a7439402c8e5bcfc]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:14:15.842484 32007 tablet_service.cc:1511] Processing CreateTablet for tablet 823ba3672286465bab521797c8fc296d (DEFAULT_TABLE table=test-workload [id=6d15510f23af4601a7439402c8e5bcfc]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:14:15.842917 32162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37a856e5a8fa4b3d9fee7d843a26ef4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.852238 32081 tablet_service.cc:1511] Processing CreateTablet for tablet e0cb4663d72d461ca2ef6c680aee59cb (DEFAULT_TABLE table=test-workload [id=6d15510f23af4601a7439402c8e5bcfc]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:14:15.844228 32161 tablet_service.cc:1511] Processing CreateTablet for tablet 15e900af838f4693b1d6f89ddee06965 (DEFAULT_TABLE table=test-workload [id=6d15510f23af4601a7439402c8e5bcfc]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:14:15.856051 32161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15e900af838f4693b1d6f89ddee06965. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.844856 32006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa412a4ecaeb4b1b87bb9d9175e8fdc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.845811 32160 tablet_service.cc:1511] Processing CreateTablet for tablet 50f879d2e1ef4a1384e7d77f4a3cf7f8 (DEFAULT_TABLE table=test-workload [id=6d15510f23af4601a7439402c8e5bcfc]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:14:15.860163 32160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50f879d2e1ef4a1384e7d77f4a3cf7f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.861786 32007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 823ba3672286465bab521797c8fc296d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.847265 32159 tablet_service.cc:1511] Processing CreateTablet for tablet 6b89a1496f2c48959a93e4883a24148b (DEFAULT_TABLE table=test-workload [id=6d15510f23af4601a7439402c8e5bcfc]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:14:15.864427 32159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b89a1496f2c48959a93e4883a24148b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.847343 32087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15e900af838f4693b1d6f89ddee06965. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.868033 32081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0cb4663d72d461ca2ef6c680aee59cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.848716 32158 tablet_service.cc:1511] Processing CreateTablet for tablet 5cc7453e227a424c8b6645700e8cf4c8 (DEFAULT_TABLE table=test-workload [id=6d15510f23af4601a7439402c8e5bcfc]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:14:15.869621 32158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cc7453e227a424c8b6645700e8cf4c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.871378 32008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 496807cff0764aed8aac43768f03db67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.850999 32156 tablet_service.cc:1511] Processing CreateTablet for tablet 823ba3672286465bab521797c8fc296d (DEFAULT_TABLE table=test-workload [id=6d15510f23af4601a7439402c8e5bcfc]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:14:15.873025 32156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 823ba3672286465bab521797c8fc296d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.849854 32157 tablet_service.cc:1511] Processing CreateTablet for tablet 496807cff0764aed8aac43768f03db67 (DEFAULT_TABLE table=test-workload [id=6d15510f23af4601a7439402c8e5bcfc]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:14:15.875367 32009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cc7453e227a424c8b6645700e8cf4c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.875770 32157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 496807cff0764aed8aac43768f03db67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.887634 32080 tablet_service.cc:1511] Processing CreateTablet for tablet 9ce346322e2f42f08714e116defd9b56 (DEFAULT_TABLE table=test-workload [id=6d15510f23af4601a7439402c8e5bcfc]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:14:15.889107 32080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ce346322e2f42f08714e116defd9b56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.891963 32005 tablet_service.cc:1511] Processing CreateTablet for tablet e0cb4663d72d461ca2ef6c680aee59cb (DEFAULT_TABLE table=test-workload [id=6d15510f23af4601a7439402c8e5bcfc]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:14:15.893970 32155 tablet_service.cc:1511] Processing CreateTablet for tablet aa412a4ecaeb4b1b87bb9d9175e8fdc4 (DEFAULT_TABLE table=test-workload [id=6d15510f23af4601a7439402c8e5bcfc]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:14:15.894621 32004 tablet_service.cc:1511] Processing CreateTablet for tablet 9ce346322e2f42f08714e116defd9b56 (DEFAULT_TABLE table=test-workload [id=6d15510f23af4601a7439402c8e5bcfc]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:14:15.896241 32154 tablet_service.cc:1511] Processing CreateTablet for tablet e0cb4663d72d461ca2ef6c680aee59cb (DEFAULT_TABLE table=test-workload [id=6d15510f23af4601a7439402c8e5bcfc]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:14:15.897779 32155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa412a4ecaeb4b1b87bb9d9175e8fdc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.899542 32088 tablet_service.cc:1511] Processing CreateTablet for tablet aa412a4ecaeb4b1b87bb9d9175e8fdc4 (DEFAULT_TABLE table=test-workload [id=6d15510f23af4601a7439402c8e5bcfc]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:14:15.901044 32088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa412a4ecaeb4b1b87bb9d9175e8fdc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.905189 32154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0cb4663d72d461ca2ef6c680aee59cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.914944 32004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ce346322e2f42f08714e116defd9b56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.919633 32005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0cb4663d72d461ca2ef6c680aee59cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.962718 32157 tablet_service.cc:1511] Processing CreateTablet for tablet 9ce346322e2f42f08714e116defd9b56 (DEFAULT_TABLE table=test-workload [id=6d15510f23af4601a7439402c8e5bcfc]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:14:15.964498 32157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ce346322e2f42f08714e116defd9b56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.985014 32212 tablet_bootstrap.cc:492] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2: Bootstrap starting.
I20260709 12:14:15.985122 32213 tablet_bootstrap.cc:492] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688: Bootstrap starting.
I20260709 12:14:16.017275 32214 tablet_bootstrap.cc:492] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 868ecd261e0249c984eb3d8afacef7e1: Bootstrap starting.
I20260709 12:14:16.029378 32214 tablet_bootstrap.cc:654] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 868ecd261e0249c984eb3d8afacef7e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.041446 32212 tablet_bootstrap.cc:654] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.048605 32213 tablet_bootstrap.cc:654] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.054023 32214 tablet_bootstrap.cc:492] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 868ecd261e0249c984eb3d8afacef7e1: No bootstrap required, opened a new log
I20260709 12:14:16.054605 32212 tablet_bootstrap.cc:492] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2: No bootstrap required, opened a new log
I20260709 12:14:16.054641 32214 ts_tablet_manager.cc:1403] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 868ecd261e0249c984eb3d8afacef7e1: Time spent bootstrapping tablet: real 0.038s	user 0.018s	sys 0.001s
I20260709 12:14:16.055184 32212 ts_tablet_manager.cc:1403] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2: Time spent bootstrapping tablet: real 0.071s	user 0.014s	sys 0.000s
I20260709 12:14:16.055701 32213 tablet_bootstrap.cc:492] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688: No bootstrap required, opened a new log
I20260709 12:14:16.056447 32213 ts_tablet_manager.cc:1403] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688: Time spent bootstrapping tablet: real 0.072s	user 0.008s	sys 0.011s
I20260709 12:14:16.058866 32212 raft_consensus.cc:359] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.058794 32214 raft_consensus.cc:359] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.059731 32212 raft_consensus.cc:385] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.060014 32214 raft_consensus.cc:385] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.059762 32213 raft_consensus.cc:359] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.060134 32212 raft_consensus.cc:740] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 908f087afb9c4a04812368ab534a03b2, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.060527 32214 raft_consensus.cc:740] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 868ecd261e0249c984eb3d8afacef7e1, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.060626 32213 raft_consensus.cc:385] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.061106 32213 raft_consensus.cc:740] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665d4526e98a4f9898fab4723f981688, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.061097 32212 consensus_queue.cc:260] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.061443 32214 consensus_queue.cc:260] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 868ecd261e0249c984eb3d8afacef7e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.062142 32213 consensus_queue.cc:260] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.063544 32123 heartbeater.cc:499] Master 127.20.196.190:34873 was elected leader, sending a full tablet report...
I20260709 12:14:16.064977 32197 heartbeater.cc:499] Master 127.20.196.190:34873 was elected leader, sending a full tablet report...
I20260709 12:14:16.065866 32213 ts_tablet_manager.cc:1434] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:14:16.067289 32213 tablet_bootstrap.cc:492] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 665d4526e98a4f9898fab4723f981688: Bootstrap starting.
I20260709 12:14:16.071996 32212 ts_tablet_manager.cc:1434] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:14:16.073165 32212 tablet_bootstrap.cc:492] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 908f087afb9c4a04812368ab534a03b2: Bootstrap starting.
I20260709 12:14:16.076068 32213 tablet_bootstrap.cc:654] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 665d4526e98a4f9898fab4723f981688: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.079916 32212 tablet_bootstrap.cc:654] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 908f087afb9c4a04812368ab534a03b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.082234 32048 heartbeater.cc:499] Master 127.20.196.190:34873 was elected leader, sending a full tablet report...
I20260709 12:14:16.083010 32214 ts_tablet_manager.cc:1434] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 868ecd261e0249c984eb3d8afacef7e1: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.014s
I20260709 12:14:16.084194 32214 tablet_bootstrap.cc:492] T 15e900af838f4693b1d6f89ddee06965 P 868ecd261e0249c984eb3d8afacef7e1: Bootstrap starting.
I20260709 12:14:16.093919 32214 tablet_bootstrap.cc:654] T 15e900af838f4693b1d6f89ddee06965 P 868ecd261e0249c984eb3d8afacef7e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.096064 32213 tablet_bootstrap.cc:492] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 665d4526e98a4f9898fab4723f981688: No bootstrap required, opened a new log
I20260709 12:14:16.096709 32213 ts_tablet_manager.cc:1403] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 665d4526e98a4f9898fab4723f981688: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.003s
I20260709 12:14:16.097903 32212 tablet_bootstrap.cc:492] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 908f087afb9c4a04812368ab534a03b2: No bootstrap required, opened a new log
I20260709 12:14:16.098738 32212 ts_tablet_manager.cc:1403] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 908f087afb9c4a04812368ab534a03b2: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.009s
I20260709 12:14:16.099771 32213 raft_consensus.cc:359] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } }
I20260709 12:14:16.100585 32213 raft_consensus.cc:385] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.100941 32213 raft_consensus.cc:740] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665d4526e98a4f9898fab4723f981688, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.101771 32213 consensus_queue.cc:260] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 665d4526e98a4f9898fab4723f981688 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } }
I20260709 12:14:16.104326 32213 ts_tablet_manager.cc:1434] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 665d4526e98a4f9898fab4723f981688: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:14:16.103706 32212 raft_consensus.cc:359] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } }
I20260709 12:14:16.104964 32212 raft_consensus.cc:385] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.105460 32213 tablet_bootstrap.cc:492] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 665d4526e98a4f9898fab4723f981688: Bootstrap starting.
I20260709 12:14:16.105490 32212 raft_consensus.cc:740] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 908f087afb9c4a04812368ab534a03b2, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.107138 32212 consensus_queue.cc:260] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 908f087afb9c4a04812368ab534a03b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } }
I20260709 12:14:16.110893 32214 tablet_bootstrap.cc:492] T 15e900af838f4693b1d6f89ddee06965 P 868ecd261e0249c984eb3d8afacef7e1: No bootstrap required, opened a new log
I20260709 12:14:16.111109 32212 ts_tablet_manager.cc:1434] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 908f087afb9c4a04812368ab534a03b2: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.004s
I20260709 12:14:16.112684 32213 tablet_bootstrap.cc:654] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 665d4526e98a4f9898fab4723f981688: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.113564 32212 tablet_bootstrap.cc:492] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2: Bootstrap starting.
I20260709 12:14:16.112823 32214 ts_tablet_manager.cc:1403] T 15e900af838f4693b1d6f89ddee06965 P 868ecd261e0249c984eb3d8afacef7e1: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.011s
I20260709 12:14:16.120080 32214 raft_consensus.cc:359] T 15e900af838f4693b1d6f89ddee06965 P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.120965 32214 raft_consensus.cc:385] T 15e900af838f4693b1d6f89ddee06965 P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.121340 32214 raft_consensus.cc:740] T 15e900af838f4693b1d6f89ddee06965 P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 868ecd261e0249c984eb3d8afacef7e1, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.122249 32212 tablet_bootstrap.cc:654] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.122351 32214 consensus_queue.cc:260] T 15e900af838f4693b1d6f89ddee06965 P 868ecd261e0249c984eb3d8afacef7e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.125349 32214 ts_tablet_manager.cc:1434] T 15e900af838f4693b1d6f89ddee06965 P 868ecd261e0249c984eb3d8afacef7e1: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:14:16.126912 32214 tablet_bootstrap.cc:492] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 868ecd261e0249c984eb3d8afacef7e1: Bootstrap starting.
I20260709 12:14:16.134663 32212 tablet_bootstrap.cc:492] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2: No bootstrap required, opened a new log
I20260709 12:14:16.135313 32214 tablet_bootstrap.cc:654] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 868ecd261e0249c984eb3d8afacef7e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.135398 32212 ts_tablet_manager.cc:1403] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2: Time spent bootstrapping tablet: real 0.022s	user 0.019s	sys 0.002s
I20260709 12:14:16.139377 32212 raft_consensus.cc:359] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.140496 32212 raft_consensus.cc:385] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.140987 32212 raft_consensus.cc:740] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 908f087afb9c4a04812368ab534a03b2, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.142319 32212 consensus_queue.cc:260] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.147388 32212 ts_tablet_manager.cc:1434] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:14:16.147555 32214 tablet_bootstrap.cc:492] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 868ecd261e0249c984eb3d8afacef7e1: No bootstrap required, opened a new log
I20260709 12:14:16.148161 32214 ts_tablet_manager.cc:1403] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 868ecd261e0249c984eb3d8afacef7e1: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.003s
I20260709 12:14:16.148204 32218 raft_consensus.cc:493] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.148528 32212 tablet_bootstrap.cc:492] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 908f087afb9c4a04812368ab534a03b2: Bootstrap starting.
I20260709 12:14:16.149027 32218 raft_consensus.cc:515] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } }
I20260709 12:14:16.151423 32214 raft_consensus.cc:359] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } }
I20260709 12:14:16.152345 32214 raft_consensus.cc:385] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.152695 32214 raft_consensus.cc:740] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 868ecd261e0249c984eb3d8afacef7e1, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.153509 32214 consensus_queue.cc:260] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 868ecd261e0249c984eb3d8afacef7e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } }
I20260709 12:14:16.155917 32212 tablet_bootstrap.cc:654] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 908f087afb9c4a04812368ab534a03b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.156144 32214 ts_tablet_manager.cc:1434] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 868ecd261e0249c984eb3d8afacef7e1: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 12:14:16.157371 32214 tablet_bootstrap.cc:492] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 868ecd261e0249c984eb3d8afacef7e1: Bootstrap starting.
W20260709 12:14:16.165297 32198 tablet.cc:2406] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 665d4526e98a4f9898fab4723f981688: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:14:16.166580 32214 tablet_bootstrap.cc:654] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 868ecd261e0249c984eb3d8afacef7e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.162751 32218 leader_election.cc:290] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 908f087afb9c4a04812368ab534a03b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117), 665d4526e98a4f9898fab4723f981688 (127.20.196.131:34699)
I20260709 12:14:16.180189 32214 tablet_bootstrap.cc:492] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 868ecd261e0249c984eb3d8afacef7e1: No bootstrap required, opened a new log
I20260709 12:14:16.181034 32214 ts_tablet_manager.cc:1403] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 868ecd261e0249c984eb3d8afacef7e1: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.008s
I20260709 12:14:16.185535 32214 raft_consensus.cc:359] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.189292 32214 raft_consensus.cc:385] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.189742 32214 raft_consensus.cc:740] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 868ecd261e0249c984eb3d8afacef7e1, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.191717 32214 consensus_queue.cc:260] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 868ecd261e0249c984eb3d8afacef7e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.195184 32214 ts_tablet_manager.cc:1434] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 868ecd261e0249c984eb3d8afacef7e1: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 12:14:16.199601 32214 tablet_bootstrap.cc:492] T 823ba3672286465bab521797c8fc296d P 868ecd261e0249c984eb3d8afacef7e1: Bootstrap starting.
I20260709 12:14:16.210170 32214 tablet_bootstrap.cc:654] T 823ba3672286465bab521797c8fc296d P 868ecd261e0249c984eb3d8afacef7e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.223176 32214 tablet_bootstrap.cc:492] T 823ba3672286465bab521797c8fc296d P 868ecd261e0249c984eb3d8afacef7e1: No bootstrap required, opened a new log
I20260709 12:14:16.223953 32214 ts_tablet_manager.cc:1403] T 823ba3672286465bab521797c8fc296d P 868ecd261e0249c984eb3d8afacef7e1: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.003s
I20260709 12:14:16.228014 32214 raft_consensus.cc:359] T 823ba3672286465bab521797c8fc296d P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.229074 32214 raft_consensus.cc:385] T 823ba3672286465bab521797c8fc296d P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.229511 32214 raft_consensus.cc:740] T 823ba3672286465bab521797c8fc296d P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 868ecd261e0249c984eb3d8afacef7e1, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.230549 32214 consensus_queue.cc:260] T 823ba3672286465bab521797c8fc296d P 868ecd261e0249c984eb3d8afacef7e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.234300 32214 ts_tablet_manager.cc:1434] T 823ba3672286465bab521797c8fc296d P 868ecd261e0249c984eb3d8afacef7e1: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 12:14:16.235776 32214 tablet_bootstrap.cc:492] T 5cc7453e227a424c8b6645700e8cf4c8 P 868ecd261e0249c984eb3d8afacef7e1: Bootstrap starting.
I20260709 12:14:16.244647 32214 tablet_bootstrap.cc:654] T 5cc7453e227a424c8b6645700e8cf4c8 P 868ecd261e0249c984eb3d8afacef7e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.245777 32213 tablet_bootstrap.cc:492] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 665d4526e98a4f9898fab4723f981688: No bootstrap required, opened a new log
I20260709 12:14:16.246460 32213 ts_tablet_manager.cc:1403] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 665d4526e98a4f9898fab4723f981688: Time spent bootstrapping tablet: real 0.141s	user 0.048s	sys 0.087s
I20260709 12:14:16.249643 32213 raft_consensus.cc:359] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.250418 32213 raft_consensus.cc:385] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.250775 32213 raft_consensus.cc:740] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665d4526e98a4f9898fab4723f981688, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.251668 32213 consensus_queue.cc:260] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 665d4526e98a4f9898fab4723f981688 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.257946 32214 tablet_bootstrap.cc:492] T 5cc7453e227a424c8b6645700e8cf4c8 P 868ecd261e0249c984eb3d8afacef7e1: No bootstrap required, opened a new log
I20260709 12:14:16.258875 32214 ts_tablet_manager.cc:1403] T 5cc7453e227a424c8b6645700e8cf4c8 P 868ecd261e0249c984eb3d8afacef7e1: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.005s
I20260709 12:14:16.261700 32213 ts_tablet_manager.cc:1434] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 665d4526e98a4f9898fab4723f981688: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:14:16.262944 32172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a856e5a8fa4b3d9fee7d843a26ef4a" candidate_uuid: "908f087afb9c4a04812368ab534a03b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665d4526e98a4f9898fab4723f981688" is_pre_election: true
I20260709 12:14:16.263674 32172 raft_consensus.cc:2468] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 908f087afb9c4a04812368ab534a03b2 in term 0.
I20260709 12:14:16.263866 32214 raft_consensus.cc:359] T 5cc7453e227a424c8b6645700e8cf4c8 P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.264998 32214 raft_consensus.cc:385] T 5cc7453e227a424c8b6645700e8cf4c8 P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.265196 32063 leader_election.cc:304] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 908f087afb9c4a04812368ab534a03b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 665d4526e98a4f9898fab4723f981688, 908f087afb9c4a04812368ab534a03b2; no voters: 
I20260709 12:14:16.265501 32214 raft_consensus.cc:740] T 5cc7453e227a424c8b6645700e8cf4c8 P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 868ecd261e0249c984eb3d8afacef7e1, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.266152 32218 raft_consensus.cc:2804] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:16.266542 32218 raft_consensus.cc:493] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:16.266894 32218 raft_consensus.cc:3060] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.267103 32214 consensus_queue.cc:260] T 5cc7453e227a424c8b6645700e8cf4c8 P 868ecd261e0249c984eb3d8afacef7e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.268272 32213 tablet_bootstrap.cc:492] T 6b89a1496f2c48959a93e4883a24148b P 665d4526e98a4f9898fab4723f981688: Bootstrap starting.
I20260709 12:14:16.275074 32214 ts_tablet_manager.cc:1434] T 5cc7453e227a424c8b6645700e8cf4c8 P 868ecd261e0249c984eb3d8afacef7e1: Time spent starting tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 12:14:16.276815 32214 tablet_bootstrap.cc:492] T e0cb4663d72d461ca2ef6c680aee59cb P 868ecd261e0249c984eb3d8afacef7e1: Bootstrap starting.
I20260709 12:14:16.278420 32213 tablet_bootstrap.cc:654] T 6b89a1496f2c48959a93e4883a24148b P 665d4526e98a4f9898fab4723f981688: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:16.287147 31969 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:16.287456 32218 raft_consensus.cc:515] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 908f087afb9c4a04812368ab534a03b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } }
I20260709 12:14:16.289268 32214 tablet_bootstrap.cc:654] T e0cb4663d72d461ca2ef6c680aee59cb P 868ecd261e0249c984eb3d8afacef7e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.295743 32212 tablet_bootstrap.cc:492] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 908f087afb9c4a04812368ab534a03b2: No bootstrap required, opened a new log
I20260709 12:14:16.296006 32214 tablet_bootstrap.cc:492] T e0cb4663d72d461ca2ef6c680aee59cb P 868ecd261e0249c984eb3d8afacef7e1: No bootstrap required, opened a new log
I20260709 12:14:16.296317 32212 ts_tablet_manager.cc:1403] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 908f087afb9c4a04812368ab534a03b2: Time spent bootstrapping tablet: real 0.148s	user 0.066s	sys 0.075s
I20260709 12:14:16.296551 32214 ts_tablet_manager.cc:1403] T e0cb4663d72d461ca2ef6c680aee59cb P 868ecd261e0249c984eb3d8afacef7e1: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.000s
I20260709 12:14:16.296327 32023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a856e5a8fa4b3d9fee7d843a26ef4a" candidate_uuid: "908f087afb9c4a04812368ab534a03b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "868ecd261e0249c984eb3d8afacef7e1" is_pre_election: true
I20260709 12:14:16.297732 32023 raft_consensus.cc:2468] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 908f087afb9c4a04812368ab534a03b2 in term 0.
I20260709 12:14:16.299654 32212 raft_consensus.cc:359] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.299849 32214 raft_consensus.cc:359] T e0cb4663d72d461ca2ef6c680aee59cb P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.300473 32212 raft_consensus.cc:385] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.300549 32214 raft_consensus.cc:385] T e0cb4663d72d461ca2ef6c680aee59cb P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.300843 32212 raft_consensus.cc:740] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 908f087afb9c4a04812368ab534a03b2, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.300935 32214 raft_consensus.cc:740] T e0cb4663d72d461ca2ef6c680aee59cb P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 868ecd261e0249c984eb3d8afacef7e1, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.301712 32212 consensus_queue.cc:260] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 908f087afb9c4a04812368ab534a03b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.301863 32214 consensus_queue.cc:260] T e0cb4663d72d461ca2ef6c680aee59cb P 868ecd261e0249c984eb3d8afacef7e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.303831 32219 raft_consensus.cc:493] T 15e900af838f4693b1d6f89ddee06965 P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.304525 32219 raft_consensus.cc:515] T 15e900af838f4693b1d6f89ddee06965 P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.307544 32023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a856e5a8fa4b3d9fee7d843a26ef4a" candidate_uuid: "908f087afb9c4a04812368ab534a03b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "868ecd261e0249c984eb3d8afacef7e1"
I20260709 12:14:16.308580 32023 raft_consensus.cc:3060] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.313301 32220 raft_consensus.cc:493] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.313849 32220 raft_consensus.cc:515] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.319928 32219 leader_election.cc:290] T 15e900af838f4693b1d6f89ddee06965 P 868ecd261e0249c984eb3d8afacef7e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 908f087afb9c4a04812368ab534a03b2 (127.20.196.130:35965), 665d4526e98a4f9898fab4723f981688 (127.20.196.131:34699)
I20260709 12:14:16.325201 32220 leader_election.cc:290] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 665d4526e98a4f9898fab4723f981688 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117), 908f087afb9c4a04812368ab534a03b2 (127.20.196.130:35965)
I20260709 12:14:16.332491 32218 leader_election.cc:290] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 908f087afb9c4a04812368ab534a03b2 [CANDIDATE]: Term 1 election: Requested vote from peers 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117), 665d4526e98a4f9898fab4723f981688 (127.20.196.131:34699)
I20260709 12:14:16.345723 32023 raft_consensus.cc:2468] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 908f087afb9c4a04812368ab534a03b2 in term 1.
I20260709 12:14:16.355572 32172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a856e5a8fa4b3d9fee7d843a26ef4a" candidate_uuid: "908f087afb9c4a04812368ab534a03b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665d4526e98a4f9898fab4723f981688"
I20260709 12:14:16.356374 32172 raft_consensus.cc:3060] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.362622 32219 raft_consensus.cc:493] T e0cb4663d72d461ca2ef6c680aee59cb P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.363296 32219 raft_consensus.cc:515] T e0cb4663d72d461ca2ef6c680aee59cb P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.365532 32219 leader_election.cc:290] T e0cb4663d72d461ca2ef6c680aee59cb P 868ecd261e0249c984eb3d8afacef7e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 908f087afb9c4a04812368ab534a03b2 (127.20.196.130:35965), 665d4526e98a4f9898fab4723f981688 (127.20.196.131:34699)
I20260709 12:14:16.365813 32172 raft_consensus.cc:2468] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 665d4526e98a4f9898fab4723f981688 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 908f087afb9c4a04812368ab534a03b2 in term 1.
I20260709 12:14:16.367401 32063 leader_election.cc:304] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 908f087afb9c4a04812368ab534a03b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 665d4526e98a4f9898fab4723f981688, 908f087afb9c4a04812368ab534a03b2; no voters: 
I20260709 12:14:16.367844 32220 raft_consensus.cc:493] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.368319 32220 raft_consensus.cc:515] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.368646 32219 raft_consensus.cc:493] T 823ba3672286465bab521797c8fc296d P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.369339 32219 raft_consensus.cc:515] T 823ba3672286465bab521797c8fc296d P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.370285 32220 leader_election.cc:290] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117), 908f087afb9c4a04812368ab534a03b2 (127.20.196.130:35965)
I20260709 12:14:16.373585 32219 leader_election.cc:290] T 823ba3672286465bab521797c8fc296d P 868ecd261e0249c984eb3d8afacef7e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 908f087afb9c4a04812368ab534a03b2 (127.20.196.130:35965), 665d4526e98a4f9898fab4723f981688 (127.20.196.131:34699)
I20260709 12:14:16.370119 32218 raft_consensus.cc:2804] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 908f087afb9c4a04812368ab534a03b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:16.387112 32022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496807cff0764aed8aac43768f03db67" candidate_uuid: "665d4526e98a4f9898fab4723f981688" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "868ecd261e0249c984eb3d8afacef7e1" is_pre_election: true
I20260709 12:14:16.387306 32218 raft_consensus.cc:697] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 908f087afb9c4a04812368ab534a03b2 [term 1 LEADER]: Becoming Leader. State: Replica: 908f087afb9c4a04812368ab534a03b2, State: Running, Role: LEADER
I20260709 12:14:16.388185 32218 consensus_queue.cc:237] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 908f087afb9c4a04812368ab534a03b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } }
I20260709 12:14:16.388805 32171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0cb4663d72d461ca2ef6c680aee59cb" candidate_uuid: "868ecd261e0249c984eb3d8afacef7e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665d4526e98a4f9898fab4723f981688" is_pre_election: true
I20260709 12:14:16.380921 32098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e900af838f4693b1d6f89ddee06965" candidate_uuid: "868ecd261e0249c984eb3d8afacef7e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "908f087afb9c4a04812368ab534a03b2" is_pre_election: true
I20260709 12:14:16.389418 32170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823ba3672286465bab521797c8fc296d" candidate_uuid: "868ecd261e0249c984eb3d8afacef7e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665d4526e98a4f9898fab4723f981688" is_pre_election: true
I20260709 12:14:16.382855 32097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0cb4663d72d461ca2ef6c680aee59cb" candidate_uuid: "868ecd261e0249c984eb3d8afacef7e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "908f087afb9c4a04812368ab534a03b2" is_pre_election: true
I20260709 12:14:16.390331 32023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa412a4ecaeb4b1b87bb9d9175e8fdc4" candidate_uuid: "665d4526e98a4f9898fab4723f981688" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "868ecd261e0249c984eb3d8afacef7e1" is_pre_election: true
I20260709 12:14:16.384693 32096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823ba3672286465bab521797c8fc296d" candidate_uuid: "868ecd261e0249c984eb3d8afacef7e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "908f087afb9c4a04812368ab534a03b2" is_pre_election: true
I20260709 12:14:16.385919 32212 ts_tablet_manager.cc:1434] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 908f087afb9c4a04812368ab534a03b2: Time spent starting tablet: real 0.089s	user 0.037s	sys 0.050s
I20260709 12:14:16.386664 32214 ts_tablet_manager.cc:1434] T e0cb4663d72d461ca2ef6c680aee59cb P 868ecd261e0249c984eb3d8afacef7e1: Time spent starting tablet: real 0.090s	user 0.024s	sys 0.005s
I20260709 12:14:16.389384 32172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e900af838f4693b1d6f89ddee06965" candidate_uuid: "868ecd261e0249c984eb3d8afacef7e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665d4526e98a4f9898fab4723f981688" is_pre_election: true
I20260709 12:14:16.391043 32023 raft_consensus.cc:2468] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665d4526e98a4f9898fab4723f981688 in term 0.
W20260709 12:14:16.391064 31988 leader_election.cc:343] T e0cb4663d72d461ca2ef6c680aee59cb P 868ecd261e0249c984eb3d8afacef7e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 665d4526e98a4f9898fab4723f981688 (127.20.196.131:34699): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:16.397352 31988 leader_election.cc:343] T 823ba3672286465bab521797c8fc296d P 868ecd261e0249c984eb3d8afacef7e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 665d4526e98a4f9898fab4723f981688 (127.20.196.131:34699): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:16.392174 32212 tablet_bootstrap.cc:492] T 6b89a1496f2c48959a93e4883a24148b P 908f087afb9c4a04812368ab534a03b2: Bootstrap starting.
I20260709 12:14:16.393126 32214 tablet_bootstrap.cc:492] T 6b89a1496f2c48959a93e4883a24148b P 868ecd261e0249c984eb3d8afacef7e1: Bootstrap starting.
W20260709 12:14:16.393383 31987 leader_election.cc:343] T 15e900af838f4693b1d6f89ddee06965 P 868ecd261e0249c984eb3d8afacef7e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 908f087afb9c4a04812368ab534a03b2 (127.20.196.130:35965): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:16.398947 31987 leader_election.cc:343] T e0cb4663d72d461ca2ef6c680aee59cb P 868ecd261e0249c984eb3d8afacef7e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 908f087afb9c4a04812368ab534a03b2 (127.20.196.130:35965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:16.393217 32213 tablet_bootstrap.cc:492] T 6b89a1496f2c48959a93e4883a24148b P 665d4526e98a4f9898fab4723f981688: No bootstrap required, opened a new log
I20260709 12:14:16.399504 31987 leader_election.cc:304] T e0cb4663d72d461ca2ef6c680aee59cb P 868ecd261e0249c984eb3d8afacef7e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868ecd261e0249c984eb3d8afacef7e1; no voters: 665d4526e98a4f9898fab4723f981688, 908f087afb9c4a04812368ab534a03b2
I20260709 12:14:16.400830 32213 ts_tablet_manager.cc:1403] T 6b89a1496f2c48959a93e4883a24148b P 665d4526e98a4f9898fab4723f981688: Time spent bootstrapping tablet: real 0.134s	user 0.028s	sys 0.023s
W20260709 12:14:16.401342 31987 leader_election.cc:343] T 823ba3672286465bab521797c8fc296d P 868ecd261e0249c984eb3d8afacef7e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 908f087afb9c4a04812368ab534a03b2 (127.20.196.130:35965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:16.401830 31987 leader_election.cc:304] T 823ba3672286465bab521797c8fc296d P 868ecd261e0249c984eb3d8afacef7e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868ecd261e0249c984eb3d8afacef7e1; no voters: 665d4526e98a4f9898fab4723f981688, 908f087afb9c4a04812368ab534a03b2
I20260709 12:14:16.402817 32219 raft_consensus.cc:2749] T e0cb4663d72d461ca2ef6c680aee59cb P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:16.403483 32219 raft_consensus.cc:2749] T 823ba3672286465bab521797c8fc296d P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:16.404625 31918 catalog_manager.cc:5697] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 908f087afb9c4a04812368ab534a03b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 908f087afb9c4a04812368ab534a03b2 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "908f087afb9c4a04812368ab534a03b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:16.408985 32212 tablet_bootstrap.cc:654] T 6b89a1496f2c48959a93e4883a24148b P 908f087afb9c4a04812368ab534a03b2: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:16.393961 32135 leader_election.cc:343] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:16.410284 31988 leader_election.cc:343] T 15e900af838f4693b1d6f89ddee06965 P 868ecd261e0249c984eb3d8afacef7e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 665d4526e98a4f9898fab4723f981688 (127.20.196.131:34699): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:16.410502 32096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa412a4ecaeb4b1b87bb9d9175e8fdc4" candidate_uuid: "665d4526e98a4f9898fab4723f981688" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "908f087afb9c4a04812368ab534a03b2" is_pre_election: true
I20260709 12:14:16.410722 31988 leader_election.cc:304] T 15e900af838f4693b1d6f89ddee06965 P 868ecd261e0249c984eb3d8afacef7e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868ecd261e0249c984eb3d8afacef7e1; no voters: 665d4526e98a4f9898fab4723f981688, 908f087afb9c4a04812368ab534a03b2
I20260709 12:14:16.411188 32096 raft_consensus.cc:2468] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665d4526e98a4f9898fab4723f981688 in term 0.
I20260709 12:14:16.412235 32097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496807cff0764aed8aac43768f03db67" candidate_uuid: "665d4526e98a4f9898fab4723f981688" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "908f087afb9c4a04812368ab534a03b2" is_pre_election: true
I20260709 12:14:16.412892 32097 raft_consensus.cc:2468] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665d4526e98a4f9898fab4723f981688 in term 0.
I20260709 12:14:16.413177 32214 tablet_bootstrap.cc:654] T 6b89a1496f2c48959a93e4883a24148b P 868ecd261e0249c984eb3d8afacef7e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.414338 32236 raft_consensus.cc:2749] T 15e900af838f4693b1d6f89ddee06965 P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:16.412240 32135 leader_election.cc:304] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 665d4526e98a4f9898fab4723f981688 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 665d4526e98a4f9898fab4723f981688, 868ecd261e0249c984eb3d8afacef7e1; no voters: 
I20260709 12:14:16.416715 32213 raft_consensus.cc:359] T 6b89a1496f2c48959a93e4883a24148b P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.417492 32213 raft_consensus.cc:385] T 6b89a1496f2c48959a93e4883a24148b P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.417748 32213 raft_consensus.cc:740] T 6b89a1496f2c48959a93e4883a24148b P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665d4526e98a4f9898fab4723f981688, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.418257 32136 leader_election.cc:304] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 665d4526e98a4f9898fab4723f981688, 908f087afb9c4a04812368ab534a03b2; no voters: 868ecd261e0249c984eb3d8afacef7e1
I20260709 12:14:16.418671 32213 consensus_queue.cc:260] T 6b89a1496f2c48959a93e4883a24148b P 665d4526e98a4f9898fab4723f981688 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.419734 32220 raft_consensus.cc:2804] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:16.420228 32220 raft_consensus.cc:493] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:16.420650 32220 raft_consensus.cc:3060] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.421489 32218 raft_consensus.cc:493] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.422200 32218 raft_consensus.cc:515] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.427264 32172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cc7453e227a424c8b6645700e8cf4c8" candidate_uuid: "908f087afb9c4a04812368ab534a03b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665d4526e98a4f9898fab4723f981688" is_pre_election: true
I20260709 12:14:16.427685 32246 raft_consensus.cc:2804] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:16.428114 32246 raft_consensus.cc:493] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:16.428450 32246 raft_consensus.cc:3060] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:16.428967 32063 leader_election.cc:343] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 665d4526e98a4f9898fab4723f981688 (127.20.196.131:34699): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:16.430154 32218 leader_election.cc:290] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117), 665d4526e98a4f9898fab4723f981688 (127.20.196.131:34699)
I20260709 12:14:16.430406 32023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cc7453e227a424c8b6645700e8cf4c8" candidate_uuid: "908f087afb9c4a04812368ab534a03b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "868ecd261e0249c984eb3d8afacef7e1" is_pre_election: true
I20260709 12:14:16.431268 32023 raft_consensus.cc:2468] T 5cc7453e227a424c8b6645700e8cf4c8 P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 908f087afb9c4a04812368ab534a03b2 in term 0.
I20260709 12:14:16.432838 32061 leader_election.cc:304] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868ecd261e0249c984eb3d8afacef7e1, 908f087afb9c4a04812368ab534a03b2; no voters: 665d4526e98a4f9898fab4723f981688
I20260709 12:14:16.433301 32214 tablet_bootstrap.cc:492] T 6b89a1496f2c48959a93e4883a24148b P 868ecd261e0249c984eb3d8afacef7e1: No bootstrap required, opened a new log
I20260709 12:14:16.433912 32218 raft_consensus.cc:2804] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:16.434412 32218 raft_consensus.cc:493] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:16.434942 32218 raft_consensus.cc:3060] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.435166 32213 ts_tablet_manager.cc:1434] T 6b89a1496f2c48959a93e4883a24148b P 665d4526e98a4f9898fab4723f981688: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.006s
I20260709 12:14:16.436265 32213 tablet_bootstrap.cc:492] T e0cb4663d72d461ca2ef6c680aee59cb P 665d4526e98a4f9898fab4723f981688: Bootstrap starting.
I20260709 12:14:16.434453 32214 ts_tablet_manager.cc:1403] T 6b89a1496f2c48959a93e4883a24148b P 868ecd261e0249c984eb3d8afacef7e1: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.006s
I20260709 12:14:16.439682 32214 raft_consensus.cc:359] T 6b89a1496f2c48959a93e4883a24148b P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.440400 32214 raft_consensus.cc:385] T 6b89a1496f2c48959a93e4883a24148b P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.440654 32214 raft_consensus.cc:740] T 6b89a1496f2c48959a93e4883a24148b P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 868ecd261e0249c984eb3d8afacef7e1, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.441437 32214 consensus_queue.cc:260] T 6b89a1496f2c48959a93e4883a24148b P 868ecd261e0249c984eb3d8afacef7e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.436389 32212 tablet_bootstrap.cc:492] T 6b89a1496f2c48959a93e4883a24148b P 908f087afb9c4a04812368ab534a03b2: No bootstrap required, opened a new log
I20260709 12:14:16.443503 32212 ts_tablet_manager.cc:1403] T 6b89a1496f2c48959a93e4883a24148b P 908f087afb9c4a04812368ab534a03b2: Time spent bootstrapping tablet: real 0.052s	user 0.023s	sys 0.009s
I20260709 12:14:16.446688 32212 raft_consensus.cc:359] T 6b89a1496f2c48959a93e4883a24148b P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.447589 32212 raft_consensus.cc:385] T 6b89a1496f2c48959a93e4883a24148b P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.442766 32220 raft_consensus.cc:515] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 665d4526e98a4f9898fab4723f981688 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.447966 32212 raft_consensus.cc:740] T 6b89a1496f2c48959a93e4883a24148b P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 908f087afb9c4a04812368ab534a03b2, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.449410 32246 raft_consensus.cc:515] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.452754 32218 raft_consensus.cc:515] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.453860 32246 leader_election.cc:290] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [CANDIDATE]: Term 1 election: Requested vote from peers 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117), 908f087afb9c4a04812368ab534a03b2 (127.20.196.130:35965)
I20260709 12:14:16.449856 32214 ts_tablet_manager.cc:1434] T 6b89a1496f2c48959a93e4883a24148b P 868ecd261e0249c984eb3d8afacef7e1: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:14:16.454501 32236 raft_consensus.cc:493] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.455523 32214 tablet_bootstrap.cc:492] T 9ce346322e2f42f08714e116defd9b56 P 868ecd261e0249c984eb3d8afacef7e1: Bootstrap starting.
I20260709 12:14:16.456503 32022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496807cff0764aed8aac43768f03db67" candidate_uuid: "665d4526e98a4f9898fab4723f981688" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "868ecd261e0249c984eb3d8afacef7e1"
I20260709 12:14:16.456574 32172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cc7453e227a424c8b6645700e8cf4c8" candidate_uuid: "908f087afb9c4a04812368ab534a03b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665d4526e98a4f9898fab4723f981688"
I20260709 12:14:16.455119 32236 raft_consensus.cc:515] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
W20260709 12:14:16.458331 32063 leader_election.cc:343] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 665d4526e98a4f9898fab4723f981688 (127.20.196.131:34699): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:16.459021 32218 leader_election.cc:290] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 [CANDIDATE]: Term 1 election: Requested vote from peers 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117), 665d4526e98a4f9898fab4723f981688 (127.20.196.131:34699)
W20260709 12:14:16.460428 32135 leader_election.cc:343] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:16.460567 32172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50f879d2e1ef4a1384e7d77f4a3cf7f8" candidate_uuid: "868ecd261e0249c984eb3d8afacef7e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665d4526e98a4f9898fab4723f981688" is_pre_election: true
I20260709 12:14:16.461108 32236 leader_election.cc:290] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 868ecd261e0249c984eb3d8afacef7e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 908f087afb9c4a04812368ab534a03b2 (127.20.196.130:35965), 665d4526e98a4f9898fab4723f981688 (127.20.196.131:34699)
I20260709 12:14:16.461551 32214 tablet_bootstrap.cc:654] T 9ce346322e2f42f08714e116defd9b56 P 868ecd261e0249c984eb3d8afacef7e1: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:16.461988 31988 leader_election.cc:343] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 868ecd261e0249c984eb3d8afacef7e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 665d4526e98a4f9898fab4723f981688 (127.20.196.131:34699): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:16.462903 32097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50f879d2e1ef4a1384e7d77f4a3cf7f8" candidate_uuid: "868ecd261e0249c984eb3d8afacef7e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "908f087afb9c4a04812368ab534a03b2" is_pre_election: true
I20260709 12:14:16.465215 32097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496807cff0764aed8aac43768f03db67" candidate_uuid: "665d4526e98a4f9898fab4723f981688" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "908f087afb9c4a04812368ab534a03b2"
I20260709 12:14:16.465821 32022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cc7453e227a424c8b6645700e8cf4c8" candidate_uuid: "908f087afb9c4a04812368ab534a03b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "868ecd261e0249c984eb3d8afacef7e1"
I20260709 12:14:16.465936 32097 raft_consensus.cc:3060] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.466446 32022 raft_consensus.cc:3060] T 5cc7453e227a424c8b6645700e8cf4c8 P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.468070 32096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa412a4ecaeb4b1b87bb9d9175e8fdc4" candidate_uuid: "665d4526e98a4f9898fab4723f981688" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "908f087afb9c4a04812368ab534a03b2"
I20260709 12:14:16.468636 32096 raft_consensus.cc:3060] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:16.469671 31987 leader_election.cc:343] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 868ecd261e0249c984eb3d8afacef7e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 908f087afb9c4a04812368ab534a03b2 (127.20.196.130:35965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:16.470127 31987 leader_election.cc:304] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 868ecd261e0249c984eb3d8afacef7e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868ecd261e0249c984eb3d8afacef7e1; no voters: 665d4526e98a4f9898fab4723f981688, 908f087afb9c4a04812368ab534a03b2
I20260709 12:14:16.476300 32096 raft_consensus.cc:2468] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 908f087afb9c4a04812368ab534a03b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665d4526e98a4f9898fab4723f981688 in term 1.
I20260709 12:14:16.476951 32022 raft_consensus.cc:2468] T 5cc7453e227a424c8b6645700e8cf4c8 P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 908f087afb9c4a04812368ab534a03b2 in term 1.
I20260709 12:14:16.477738 32136 leader_election.cc:304] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 665d4526e98a4f9898fab4723f981688 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 665d4526e98a4f9898fab4723f981688, 908f087afb9c4a04812368ab534a03b2; no voters: 
I20260709 12:14:16.450201 32023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa412a4ecaeb4b1b87bb9d9175e8fdc4" candidate_uuid: "665d4526e98a4f9898fab4723f981688" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "868ecd261e0249c984eb3d8afacef7e1"
I20260709 12:14:16.478579 32061 leader_election.cc:304] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 868ecd261e0249c984eb3d8afacef7e1, 908f087afb9c4a04812368ab534a03b2; no voters: 665d4526e98a4f9898fab4723f981688
I20260709 12:14:16.466841 32220 leader_election.cc:290] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 665d4526e98a4f9898fab4723f981688 [CANDIDATE]: Term 1 election: Requested vote from peers 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117), 908f087afb9c4a04812368ab534a03b2 (127.20.196.130:35965)
I20260709 12:14:16.478765 32023 raft_consensus.cc:3060] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.478793 32246 raft_consensus.cc:2804] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 665d4526e98a4f9898fab4723f981688 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:16.480422 32246 raft_consensus.cc:697] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 665d4526e98a4f9898fab4723f981688 [term 1 LEADER]: Becoming Leader. State: Replica: 665d4526e98a4f9898fab4723f981688, State: Running, Role: LEADER
I20260709 12:14:16.450114 32212 consensus_queue.cc:260] T 6b89a1496f2c48959a93e4883a24148b P 908f087afb9c4a04812368ab534a03b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.481323 32246 consensus_queue.cc:237] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 665d4526e98a4f9898fab4723f981688 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.482019 32235 raft_consensus.cc:2804] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:16.450701 32213 tablet_bootstrap.cc:654] T e0cb4663d72d461ca2ef6c680aee59cb P 665d4526e98a4f9898fab4723f981688: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.477829 32236 raft_consensus.cc:2749] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:16.477816 32097 raft_consensus.cc:2468] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665d4526e98a4f9898fab4723f981688 in term 1.
I20260709 12:14:16.501953 32235 raft_consensus.cc:697] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 [term 1 LEADER]: Becoming Leader. State: Replica: 908f087afb9c4a04812368ab534a03b2, State: Running, Role: LEADER
I20260709 12:14:16.503254 32235 consensus_queue.cc:237] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.506178 32213 tablet_bootstrap.cc:492] T e0cb4663d72d461ca2ef6c680aee59cb P 665d4526e98a4f9898fab4723f981688: No bootstrap required, opened a new log
I20260709 12:14:16.506896 32213 ts_tablet_manager.cc:1403] T e0cb4663d72d461ca2ef6c680aee59cb P 665d4526e98a4f9898fab4723f981688: Time spent bootstrapping tablet: real 0.071s	user 0.012s	sys 0.006s
I20260709 12:14:16.499612 32023 raft_consensus.cc:2468] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665d4526e98a4f9898fab4723f981688 in term 1.
I20260709 12:14:16.506937 32214 tablet_bootstrap.cc:492] T 9ce346322e2f42f08714e116defd9b56 P 868ecd261e0249c984eb3d8afacef7e1: No bootstrap required, opened a new log
I20260709 12:14:16.509007 32214 ts_tablet_manager.cc:1403] T 9ce346322e2f42f08714e116defd9b56 P 868ecd261e0249c984eb3d8afacef7e1: Time spent bootstrapping tablet: real 0.054s	user 0.022s	sys 0.029s
I20260709 12:14:16.497663 32212 ts_tablet_manager.cc:1434] T 6b89a1496f2c48959a93e4883a24148b P 908f087afb9c4a04812368ab534a03b2: Time spent starting tablet: real 0.054s	user 0.001s	sys 0.007s
I20260709 12:14:16.510733 32212 tablet_bootstrap.cc:492] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 908f087afb9c4a04812368ab534a03b2: Bootstrap starting.
I20260709 12:14:16.510645 32213 raft_consensus.cc:359] T e0cb4663d72d461ca2ef6c680aee59cb P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.511566 32213 raft_consensus.cc:385] T e0cb4663d72d461ca2ef6c680aee59cb P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.511890 32213 raft_consensus.cc:740] T e0cb4663d72d461ca2ef6c680aee59cb P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665d4526e98a4f9898fab4723f981688, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.511773 32214 raft_consensus.cc:359] T 9ce346322e2f42f08714e116defd9b56 P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.512518 32214 raft_consensus.cc:385] T 9ce346322e2f42f08714e116defd9b56 P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.512997 32214 raft_consensus.cc:740] T 9ce346322e2f42f08714e116defd9b56 P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 868ecd261e0249c984eb3d8afacef7e1, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.512641 32213 consensus_queue.cc:260] T e0cb4663d72d461ca2ef6c680aee59cb P 665d4526e98a4f9898fab4723f981688 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.507223 32136 leader_election.cc:304] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 665d4526e98a4f9898fab4723f981688, 908f087afb9c4a04812368ab534a03b2; no voters: 868ecd261e0249c984eb3d8afacef7e1
I20260709 12:14:16.513806 32214 consensus_queue.cc:260] T 9ce346322e2f42f08714e116defd9b56 P 868ecd261e0249c984eb3d8afacef7e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.514197 32246 raft_consensus.cc:2804] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:16.514936 32213 ts_tablet_manager.cc:1434] T e0cb4663d72d461ca2ef6c680aee59cb P 665d4526e98a4f9898fab4723f981688: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 12:14:16.517985 32214 ts_tablet_manager.cc:1434] T 9ce346322e2f42f08714e116defd9b56 P 868ecd261e0249c984eb3d8afacef7e1: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:14:16.515051 32246 raft_consensus.cc:697] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [term 1 LEADER]: Becoming Leader. State: Replica: 665d4526e98a4f9898fab4723f981688, State: Running, Role: LEADER
I20260709 12:14:16.519168 32214 tablet_bootstrap.cc:492] T 496807cff0764aed8aac43768f03db67 P 868ecd261e0249c984eb3d8afacef7e1: Bootstrap starting.
I20260709 12:14:16.519325 32246 consensus_queue.cc:237] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.521669 32212 tablet_bootstrap.cc:654] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 908f087afb9c4a04812368ab534a03b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.525496 32214 tablet_bootstrap.cc:654] T 496807cff0764aed8aac43768f03db67 P 868ecd261e0249c984eb3d8afacef7e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.517606 31917 catalog_manager.cc:5697] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 665d4526e98a4f9898fab4723f981688 reported cstate change: term changed from 0 to 1, leader changed from <none> to 665d4526e98a4f9898fab4723f981688 (127.20.196.131). New cstate: current_term: 1 leader_uuid: "665d4526e98a4f9898fab4723f981688" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:16.515973 32213 tablet_bootstrap.cc:492] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688: Bootstrap starting.
I20260709 12:14:16.538205 32212 tablet_bootstrap.cc:492] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 908f087afb9c4a04812368ab534a03b2: No bootstrap required, opened a new log
I20260709 12:14:16.538727 32212 ts_tablet_manager.cc:1403] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 908f087afb9c4a04812368ab534a03b2: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.003s
I20260709 12:14:16.541709 32212 raft_consensus.cc:359] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.542430 32212 raft_consensus.cc:385] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.542712 32212 raft_consensus.cc:740] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 908f087afb9c4a04812368ab534a03b2, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.542940 31920 catalog_manager.cc:5697] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 908f087afb9c4a04812368ab534a03b2 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "908f087afb9c4a04812368ab534a03b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:16.543592 32212 consensus_queue.cc:260] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 908f087afb9c4a04812368ab534a03b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.546164 32212 ts_tablet_manager.cc:1434] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 908f087afb9c4a04812368ab534a03b2: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:14:16.547205 32212 tablet_bootstrap.cc:492] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2: Bootstrap starting.
I20260709 12:14:16.549608 32246 raft_consensus.cc:493] T 6b89a1496f2c48959a93e4883a24148b P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.550258 32246 raft_consensus.cc:515] T 6b89a1496f2c48959a93e4883a24148b P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.553033 32246 leader_election.cc:290] T 6b89a1496f2c48959a93e4883a24148b P 665d4526e98a4f9898fab4723f981688 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117), 908f087afb9c4a04812368ab534a03b2 (127.20.196.130:35965)
I20260709 12:14:16.553803 32023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b89a1496f2c48959a93e4883a24148b" candidate_uuid: "665d4526e98a4f9898fab4723f981688" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "868ecd261e0249c984eb3d8afacef7e1" is_pre_election: true
I20260709 12:14:16.554060 32212 tablet_bootstrap.cc:654] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.554490 32023 raft_consensus.cc:2468] T 6b89a1496f2c48959a93e4883a24148b P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665d4526e98a4f9898fab4723f981688 in term 0.
I20260709 12:14:16.555713 32097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b89a1496f2c48959a93e4883a24148b" candidate_uuid: "665d4526e98a4f9898fab4723f981688" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "908f087afb9c4a04812368ab534a03b2" is_pre_election: true
I20260709 12:14:16.555994 32213 tablet_bootstrap.cc:654] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.556393 32097 raft_consensus.cc:2468] T 6b89a1496f2c48959a93e4883a24148b P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665d4526e98a4f9898fab4723f981688 in term 0.
I20260709 12:14:16.558107 32135 leader_election.cc:304] T 6b89a1496f2c48959a93e4883a24148b P 665d4526e98a4f9898fab4723f981688 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 665d4526e98a4f9898fab4723f981688, 868ecd261e0249c984eb3d8afacef7e1; no voters: 
I20260709 12:14:16.561574 32214 tablet_bootstrap.cc:492] T 496807cff0764aed8aac43768f03db67 P 868ecd261e0249c984eb3d8afacef7e1: No bootstrap required, opened a new log
I20260709 12:14:16.561942 32214 ts_tablet_manager.cc:1403] T 496807cff0764aed8aac43768f03db67 P 868ecd261e0249c984eb3d8afacef7e1: Time spent bootstrapping tablet: real 0.043s	user 0.022s	sys 0.016s
I20260709 12:14:16.563560 32246 raft_consensus.cc:2804] T 6b89a1496f2c48959a93e4883a24148b P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:16.564544 32214 raft_consensus.cc:359] T 496807cff0764aed8aac43768f03db67 P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.565373 32246 raft_consensus.cc:493] T 6b89a1496f2c48959a93e4883a24148b P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:16.565431 32214 raft_consensus.cc:385] T 496807cff0764aed8aac43768f03db67 P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.565011 32213 tablet_bootstrap.cc:492] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688: No bootstrap required, opened a new log
I20260709 12:14:16.565842 32246 raft_consensus.cc:3060] T 6b89a1496f2c48959a93e4883a24148b P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.566190 32213 ts_tablet_manager.cc:1403] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.004s
I20260709 12:14:16.565863 32214 raft_consensus.cc:740] T 496807cff0764aed8aac43768f03db67 P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 868ecd261e0249c984eb3d8afacef7e1, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.569963 32214 consensus_queue.cc:260] T 496807cff0764aed8aac43768f03db67 P 868ecd261e0249c984eb3d8afacef7e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.572347 32214 ts_tablet_manager.cc:1434] T 496807cff0764aed8aac43768f03db67 P 868ecd261e0249c984eb3d8afacef7e1: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:14:16.573040 32213 raft_consensus.cc:359] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.573763 32213 raft_consensus.cc:385] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.574072 32213 raft_consensus.cc:740] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665d4526e98a4f9898fab4723f981688, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.574879 32213 consensus_queue.cc:260] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.577136 32213 ts_tablet_manager.cc:1434] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:14:16.577586 32246 raft_consensus.cc:515] T 6b89a1496f2c48959a93e4883a24148b P 665d4526e98a4f9898fab4723f981688 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.578187 32213 tablet_bootstrap.cc:492] T 5cc7453e227a424c8b6645700e8cf4c8 P 665d4526e98a4f9898fab4723f981688: Bootstrap starting.
I20260709 12:14:16.579777 32246 leader_election.cc:290] T 6b89a1496f2c48959a93e4883a24148b P 665d4526e98a4f9898fab4723f981688 [CANDIDATE]: Term 1 election: Requested vote from peers 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117), 908f087afb9c4a04812368ab534a03b2 (127.20.196.130:35965)
I20260709 12:14:16.581530 32023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b89a1496f2c48959a93e4883a24148b" candidate_uuid: "665d4526e98a4f9898fab4723f981688" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "868ecd261e0249c984eb3d8afacef7e1"
I20260709 12:14:16.581787 32097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b89a1496f2c48959a93e4883a24148b" candidate_uuid: "665d4526e98a4f9898fab4723f981688" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "908f087afb9c4a04812368ab534a03b2"
I20260709 12:14:16.582226 32023 raft_consensus.cc:3060] T 6b89a1496f2c48959a93e4883a24148b P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.582726 32097 raft_consensus.cc:3060] T 6b89a1496f2c48959a93e4883a24148b P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.585240 32213 tablet_bootstrap.cc:654] T 5cc7453e227a424c8b6645700e8cf4c8 P 665d4526e98a4f9898fab4723f981688: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.589543 31917 catalog_manager.cc:5697] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 reported cstate change: term changed from 0 to 1, leader changed from <none> to 665d4526e98a4f9898fab4723f981688 (127.20.196.131). New cstate: current_term: 1 leader_uuid: "665d4526e98a4f9898fab4723f981688" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:16.594566 32097 raft_consensus.cc:2468] T 6b89a1496f2c48959a93e4883a24148b P 908f087afb9c4a04812368ab534a03b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665d4526e98a4f9898fab4723f981688 in term 1.
I20260709 12:14:16.596753 32136 leader_election.cc:304] T 6b89a1496f2c48959a93e4883a24148b P 665d4526e98a4f9898fab4723f981688 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 665d4526e98a4f9898fab4723f981688, 908f087afb9c4a04812368ab534a03b2; no voters: 
I20260709 12:14:16.597195 32213 tablet_bootstrap.cc:492] T 5cc7453e227a424c8b6645700e8cf4c8 P 665d4526e98a4f9898fab4723f981688: No bootstrap required, opened a new log
I20260709 12:14:16.597774 32213 ts_tablet_manager.cc:1403] T 5cc7453e227a424c8b6645700e8cf4c8 P 665d4526e98a4f9898fab4723f981688: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 12:14:16.598210 32246 raft_consensus.cc:2804] T 6b89a1496f2c48959a93e4883a24148b P 665d4526e98a4f9898fab4723f981688 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:16.598371 32023 raft_consensus.cc:2468] T 6b89a1496f2c48959a93e4883a24148b P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665d4526e98a4f9898fab4723f981688 in term 1.
I20260709 12:14:16.600095 32246 raft_consensus.cc:697] T 6b89a1496f2c48959a93e4883a24148b P 665d4526e98a4f9898fab4723f981688 [term 1 LEADER]: Becoming Leader. State: Replica: 665d4526e98a4f9898fab4723f981688, State: Running, Role: LEADER
I20260709 12:14:16.601420 32246 consensus_queue.cc:237] T 6b89a1496f2c48959a93e4883a24148b P 665d4526e98a4f9898fab4723f981688 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.601871 32213 raft_consensus.cc:359] T 5cc7453e227a424c8b6645700e8cf4c8 P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.602658 32213 raft_consensus.cc:385] T 5cc7453e227a424c8b6645700e8cf4c8 P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.602962 32213 raft_consensus.cc:740] T 5cc7453e227a424c8b6645700e8cf4c8 P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665d4526e98a4f9898fab4723f981688, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.603829 32213 consensus_queue.cc:260] T 5cc7453e227a424c8b6645700e8cf4c8 P 665d4526e98a4f9898fab4723f981688 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.606302 32213 ts_tablet_manager.cc:1434] T 5cc7453e227a424c8b6645700e8cf4c8 P 665d4526e98a4f9898fab4723f981688: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:14:16.607319 32213 tablet_bootstrap.cc:492] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688: Bootstrap starting.
I20260709 12:14:16.613915 32213 tablet_bootstrap.cc:654] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.621017 32213 tablet_bootstrap.cc:492] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688: No bootstrap required, opened a new log
I20260709 12:14:16.621374 32213 ts_tablet_manager.cc:1403] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688: Time spent bootstrapping tablet: real 0.014s	user 0.005s	sys 0.007s
I20260709 12:14:16.621807 32212 tablet_bootstrap.cc:492] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2: No bootstrap required, opened a new log
I20260709 12:14:16.622418 32212 ts_tablet_manager.cc:1403] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2: Time spent bootstrapping tablet: real 0.075s	user 0.025s	sys 0.040s
I20260709 12:14:16.623798 32213 raft_consensus.cc:359] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.624540 32213 raft_consensus.cc:385] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.624812 32213 raft_consensus.cc:740] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665d4526e98a4f9898fab4723f981688, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.624718 32212 raft_consensus.cc:359] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.625560 32212 raft_consensus.cc:385] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.625898 32212 raft_consensus.cc:740] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 908f087afb9c4a04812368ab534a03b2, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.625697 32213 consensus_queue.cc:260] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.625942 31917 catalog_manager.cc:5697] T 6b89a1496f2c48959a93e4883a24148b P 665d4526e98a4f9898fab4723f981688 reported cstate change: term changed from 0 to 1, leader changed from <none> to 665d4526e98a4f9898fab4723f981688 (127.20.196.131). New cstate: current_term: 1 leader_uuid: "665d4526e98a4f9898fab4723f981688" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:16.626726 32212 consensus_queue.cc:260] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.627846 32213 ts_tablet_manager.cc:1434] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:14:16.628777 32213 tablet_bootstrap.cc:492] T 9ce346322e2f42f08714e116defd9b56 P 665d4526e98a4f9898fab4723f981688: Bootstrap starting.
I20260709 12:14:16.629062 32212 ts_tablet_manager.cc:1434] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:14:16.630100 32212 tablet_bootstrap.cc:492] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2: Bootstrap starting.
I20260709 12:14:16.634143 32236 raft_consensus.cc:493] T 9ce346322e2f42f08714e116defd9b56 P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.634385 32213 tablet_bootstrap.cc:654] T 9ce346322e2f42f08714e116defd9b56 P 665d4526e98a4f9898fab4723f981688: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.634722 32236 raft_consensus.cc:515] T 9ce346322e2f42f08714e116defd9b56 P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.635569 32212 tablet_bootstrap.cc:654] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.651450 32097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce346322e2f42f08714e116defd9b56" candidate_uuid: "868ecd261e0249c984eb3d8afacef7e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "908f087afb9c4a04812368ab534a03b2" is_pre_election: true
I20260709 12:14:16.652401 32097 raft_consensus.cc:2468] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868ecd261e0249c984eb3d8afacef7e1 in term 0.
I20260709 12:14:16.653834 31987 leader_election.cc:304] T 9ce346322e2f42f08714e116defd9b56 P 868ecd261e0249c984eb3d8afacef7e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868ecd261e0249c984eb3d8afacef7e1, 908f087afb9c4a04812368ab534a03b2; no voters: 
I20260709 12:14:16.654198 32213 tablet_bootstrap.cc:492] T 9ce346322e2f42f08714e116defd9b56 P 665d4526e98a4f9898fab4723f981688: No bootstrap required, opened a new log
I20260709 12:14:16.654752 32213 ts_tablet_manager.cc:1403] T 9ce346322e2f42f08714e116defd9b56 P 665d4526e98a4f9898fab4723f981688: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.012s
I20260709 12:14:16.654682 32219 raft_consensus.cc:2804] T 9ce346322e2f42f08714e116defd9b56 P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:16.655369 32219 raft_consensus.cc:493] T 9ce346322e2f42f08714e116defd9b56 P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:16.655668 32219 raft_consensus.cc:3060] T 9ce346322e2f42f08714e116defd9b56 P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.657634 32213 raft_consensus.cc:359] T 9ce346322e2f42f08714e116defd9b56 P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.658258 32213 raft_consensus.cc:385] T 9ce346322e2f42f08714e116defd9b56 P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.658486 32213 raft_consensus.cc:740] T 9ce346322e2f42f08714e116defd9b56 P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665d4526e98a4f9898fab4723f981688, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.659263 32213 consensus_queue.cc:260] T 9ce346322e2f42f08714e116defd9b56 P 665d4526e98a4f9898fab4723f981688 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.659963 32172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce346322e2f42f08714e116defd9b56" candidate_uuid: "868ecd261e0249c984eb3d8afacef7e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665d4526e98a4f9898fab4723f981688" is_pre_election: true
I20260709 12:14:16.660615 32172 raft_consensus.cc:2468] T 9ce346322e2f42f08714e116defd9b56 P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 868ecd261e0249c984eb3d8afacef7e1 in term 0.
I20260709 12:14:16.661361 32213 ts_tablet_manager.cc:1434] T 9ce346322e2f42f08714e116defd9b56 P 665d4526e98a4f9898fab4723f981688: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 12:14:16.662204 32236 leader_election.cc:290] T 9ce346322e2f42f08714e116defd9b56 P 868ecd261e0249c984eb3d8afacef7e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 908f087afb9c4a04812368ab534a03b2 (127.20.196.130:35965), 665d4526e98a4f9898fab4723f981688 (127.20.196.131:34699)
I20260709 12:14:16.655016 32212 tablet_bootstrap.cc:492] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2: No bootstrap required, opened a new log
I20260709 12:14:16.662675 32219 raft_consensus.cc:515] T 9ce346322e2f42f08714e116defd9b56 P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.663170 32213 tablet_bootstrap.cc:492] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 665d4526e98a4f9898fab4723f981688: Bootstrap starting.
I20260709 12:14:16.663306 32212 ts_tablet_manager.cc:1403] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.013s
I20260709 12:14:16.665572 32097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce346322e2f42f08714e116defd9b56" candidate_uuid: "868ecd261e0249c984eb3d8afacef7e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "908f087afb9c4a04812368ab534a03b2"
I20260709 12:14:16.666147 32097 raft_consensus.cc:3060] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.666154 32212 raft_consensus.cc:359] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.667265 32212 raft_consensus.cc:385] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.667582 32212 raft_consensus.cc:740] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 908f087afb9c4a04812368ab534a03b2, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.668350 32212 consensus_queue.cc:260] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.669739 32213 tablet_bootstrap.cc:654] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 665d4526e98a4f9898fab4723f981688: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.670552 32212 ts_tablet_manager.cc:1434] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:14:16.673810 32097 raft_consensus.cc:2468] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868ecd261e0249c984eb3d8afacef7e1 in term 1.
I20260709 12:14:16.675082 31987 leader_election.cc:304] T 9ce346322e2f42f08714e116defd9b56 P 868ecd261e0249c984eb3d8afacef7e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868ecd261e0249c984eb3d8afacef7e1, 908f087afb9c4a04812368ab534a03b2; no voters: 
I20260709 12:14:16.675926 32236 raft_consensus.cc:2804] T 9ce346322e2f42f08714e116defd9b56 P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:16.677740 32212 tablet_bootstrap.cc:492] T e0cb4663d72d461ca2ef6c680aee59cb P 908f087afb9c4a04812368ab534a03b2: Bootstrap starting.
I20260709 12:14:16.686749 32212 tablet_bootstrap.cc:654] T e0cb4663d72d461ca2ef6c680aee59cb P 908f087afb9c4a04812368ab534a03b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.692734 32172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce346322e2f42f08714e116defd9b56" candidate_uuid: "868ecd261e0249c984eb3d8afacef7e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665d4526e98a4f9898fab4723f981688"
I20260709 12:14:16.693390 32172 raft_consensus.cc:3060] T 9ce346322e2f42f08714e116defd9b56 P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.695259 32219 leader_election.cc:290] T 9ce346322e2f42f08714e116defd9b56 P 868ecd261e0249c984eb3d8afacef7e1 [CANDIDATE]: Term 1 election: Requested vote from peers 908f087afb9c4a04812368ab534a03b2 (127.20.196.130:35965), 665d4526e98a4f9898fab4723f981688 (127.20.196.131:34699)
I20260709 12:14:16.697721 32236 raft_consensus.cc:697] T 9ce346322e2f42f08714e116defd9b56 P 868ecd261e0249c984eb3d8afacef7e1 [term 1 LEADER]: Becoming Leader. State: Replica: 868ecd261e0249c984eb3d8afacef7e1, State: Running, Role: LEADER
I20260709 12:14:16.698681 32236 consensus_queue.cc:237] T 9ce346322e2f42f08714e116defd9b56 P 868ecd261e0249c984eb3d8afacef7e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.700678 32172 raft_consensus.cc:2468] T 9ce346322e2f42f08714e116defd9b56 P 665d4526e98a4f9898fab4723f981688 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 868ecd261e0249c984eb3d8afacef7e1 in term 1.
I20260709 12:14:16.704970 32213 tablet_bootstrap.cc:492] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 665d4526e98a4f9898fab4723f981688: No bootstrap required, opened a new log
I20260709 12:14:16.705502 32213 ts_tablet_manager.cc:1403] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 665d4526e98a4f9898fab4723f981688: Time spent bootstrapping tablet: real 0.043s	user 0.026s	sys 0.013s
I20260709 12:14:16.705020 32212 tablet_bootstrap.cc:492] T e0cb4663d72d461ca2ef6c680aee59cb P 908f087afb9c4a04812368ab534a03b2: No bootstrap required, opened a new log
I20260709 12:14:16.707723 32212 ts_tablet_manager.cc:1403] T e0cb4663d72d461ca2ef6c680aee59cb P 908f087afb9c4a04812368ab534a03b2: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.007s
I20260709 12:14:16.708384 32213 raft_consensus.cc:359] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.709097 32213 raft_consensus.cc:385] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.709582 32213 raft_consensus.cc:740] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665d4526e98a4f9898fab4723f981688, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.709059 31918 catalog_manager.cc:5697] T 9ce346322e2f42f08714e116defd9b56 P 868ecd261e0249c984eb3d8afacef7e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129). New cstate: current_term: 1 leader_uuid: "868ecd261e0249c984eb3d8afacef7e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:16.710371 32213 consensus_queue.cc:260] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 665d4526e98a4f9898fab4723f981688 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.710875 32212 raft_consensus.cc:359] T e0cb4663d72d461ca2ef6c680aee59cb P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.711634 32212 raft_consensus.cc:385] T e0cb4663d72d461ca2ef6c680aee59cb P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.711948 32212 raft_consensus.cc:740] T e0cb4663d72d461ca2ef6c680aee59cb P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 908f087afb9c4a04812368ab534a03b2, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.712337 32213 ts_tablet_manager.cc:1434] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 665d4526e98a4f9898fab4723f981688: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:14:16.712752 32212 consensus_queue.cc:260] T e0cb4663d72d461ca2ef6c680aee59cb P 908f087afb9c4a04812368ab534a03b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.715157 32212 ts_tablet_manager.cc:1434] T e0cb4663d72d461ca2ef6c680aee59cb P 908f087afb9c4a04812368ab534a03b2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:14:16.716411 32212 tablet_bootstrap.cc:492] T 15e900af838f4693b1d6f89ddee06965 P 908f087afb9c4a04812368ab534a03b2: Bootstrap starting.
I20260709 12:14:16.722879 32212 tablet_bootstrap.cc:654] T 15e900af838f4693b1d6f89ddee06965 P 908f087afb9c4a04812368ab534a03b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.727509 32212 tablet_bootstrap.cc:492] T 15e900af838f4693b1d6f89ddee06965 P 908f087afb9c4a04812368ab534a03b2: No bootstrap required, opened a new log
I20260709 12:14:16.727908 32212 ts_tablet_manager.cc:1403] T 15e900af838f4693b1d6f89ddee06965 P 908f087afb9c4a04812368ab534a03b2: Time spent bootstrapping tablet: real 0.012s	user 0.006s	sys 0.004s
I20260709 12:14:16.729816 32212 raft_consensus.cc:359] T 15e900af838f4693b1d6f89ddee06965 P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.730296 32212 raft_consensus.cc:385] T 15e900af838f4693b1d6f89ddee06965 P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.730504 32212 raft_consensus.cc:740] T 15e900af838f4693b1d6f89ddee06965 P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 908f087afb9c4a04812368ab534a03b2, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.731112 32212 consensus_queue.cc:260] T 15e900af838f4693b1d6f89ddee06965 P 908f087afb9c4a04812368ab534a03b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.732820 32212 ts_tablet_manager.cc:1434] T 15e900af838f4693b1d6f89ddee06965 P 908f087afb9c4a04812368ab534a03b2: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:14:16.779382 32246 raft_consensus.cc:493] T e0cb4663d72d461ca2ef6c680aee59cb P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.779922 32246 raft_consensus.cc:515] T e0cb4663d72d461ca2ef6c680aee59cb P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.781569 32246 leader_election.cc:290] T e0cb4663d72d461ca2ef6c680aee59cb P 665d4526e98a4f9898fab4723f981688 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117), 908f087afb9c4a04812368ab534a03b2 (127.20.196.130:35965)
I20260709 12:14:16.782552 32023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0cb4663d72d461ca2ef6c680aee59cb" candidate_uuid: "665d4526e98a4f9898fab4723f981688" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "868ecd261e0249c984eb3d8afacef7e1" is_pre_election: true
I20260709 12:14:16.782776 32097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0cb4663d72d461ca2ef6c680aee59cb" candidate_uuid: "665d4526e98a4f9898fab4723f981688" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "908f087afb9c4a04812368ab534a03b2" is_pre_election: true
I20260709 12:14:16.783156 32246 raft_consensus.cc:493] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.783288 32023 raft_consensus.cc:2468] T e0cb4663d72d461ca2ef6c680aee59cb P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665d4526e98a4f9898fab4723f981688 in term 0.
I20260709 12:14:16.783486 32097 raft_consensus.cc:2468] T e0cb4663d72d461ca2ef6c680aee59cb P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665d4526e98a4f9898fab4723f981688 in term 0.
I20260709 12:14:16.783740 32246 raft_consensus.cc:515] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.784423 32135 leader_election.cc:304] T e0cb4663d72d461ca2ef6c680aee59cb P 665d4526e98a4f9898fab4723f981688 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 665d4526e98a4f9898fab4723f981688, 868ecd261e0249c984eb3d8afacef7e1; no voters: 
I20260709 12:14:16.785210 32220 raft_consensus.cc:2804] T e0cb4663d72d461ca2ef6c680aee59cb P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:16.785581 32220 raft_consensus.cc:493] T e0cb4663d72d461ca2ef6c680aee59cb P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:16.785823 32246 leader_election.cc:290] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117), 908f087afb9c4a04812368ab534a03b2 (127.20.196.130:35965)
I20260709 12:14:16.785913 32220 raft_consensus.cc:3060] T e0cb4663d72d461ca2ef6c680aee59cb P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.786696 32023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e900af838f4693b1d6f89ddee06965" candidate_uuid: "665d4526e98a4f9898fab4723f981688" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "868ecd261e0249c984eb3d8afacef7e1" is_pre_election: true
I20260709 12:14:16.786827 32097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e900af838f4693b1d6f89ddee06965" candidate_uuid: "665d4526e98a4f9898fab4723f981688" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "908f087afb9c4a04812368ab534a03b2" is_pre_election: true
I20260709 12:14:16.787392 32023 raft_consensus.cc:2468] T 15e900af838f4693b1d6f89ddee06965 P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665d4526e98a4f9898fab4723f981688 in term 0.
I20260709 12:14:16.787456 32097 raft_consensus.cc:2468] T 15e900af838f4693b1d6f89ddee06965 P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665d4526e98a4f9898fab4723f981688 in term 0.
I20260709 12:14:16.788533 32135 leader_election.cc:304] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 665d4526e98a4f9898fab4723f981688, 868ecd261e0249c984eb3d8afacef7e1; no voters: 
I20260709 12:14:16.789287 32246 raft_consensus.cc:2804] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:16.789592 32246 raft_consensus.cc:493] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:16.789867 32246 raft_consensus.cc:3060] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.792415 32220 raft_consensus.cc:515] T e0cb4663d72d461ca2ef6c680aee59cb P 665d4526e98a4f9898fab4723f981688 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.794484 32220 leader_election.cc:290] T e0cb4663d72d461ca2ef6c680aee59cb P 665d4526e98a4f9898fab4723f981688 [CANDIDATE]: Term 1 election: Requested vote from peers 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117), 908f087afb9c4a04812368ab534a03b2 (127.20.196.130:35965)
I20260709 12:14:16.795297 32023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0cb4663d72d461ca2ef6c680aee59cb" candidate_uuid: "665d4526e98a4f9898fab4723f981688" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "868ecd261e0249c984eb3d8afacef7e1"
I20260709 12:14:16.795754 32097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0cb4663d72d461ca2ef6c680aee59cb" candidate_uuid: "665d4526e98a4f9898fab4723f981688" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "908f087afb9c4a04812368ab534a03b2"
I20260709 12:14:16.795863 32023 raft_consensus.cc:3060] T e0cb4663d72d461ca2ef6c680aee59cb P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.796365 32097 raft_consensus.cc:3060] T e0cb4663d72d461ca2ef6c680aee59cb P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.795909 32246 raft_consensus.cc:515] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.798283 32246 leader_election.cc:290] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688 [CANDIDATE]: Term 1 election: Requested vote from peers 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117), 908f087afb9c4a04812368ab534a03b2 (127.20.196.130:35965)
I20260709 12:14:16.799042 32022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e900af838f4693b1d6f89ddee06965" candidate_uuid: "665d4526e98a4f9898fab4723f981688" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "868ecd261e0249c984eb3d8afacef7e1"
I20260709 12:14:16.799352 32096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e900af838f4693b1d6f89ddee06965" candidate_uuid: "665d4526e98a4f9898fab4723f981688" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "908f087afb9c4a04812368ab534a03b2"
I20260709 12:14:16.799719 32022 raft_consensus.cc:3060] T 15e900af838f4693b1d6f89ddee06965 P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.799927 32096 raft_consensus.cc:3060] T 15e900af838f4693b1d6f89ddee06965 P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.803151 32097 raft_consensus.cc:2468] T e0cb4663d72d461ca2ef6c680aee59cb P 908f087afb9c4a04812368ab534a03b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665d4526e98a4f9898fab4723f981688 in term 1.
I20260709 12:14:16.804164 32136 leader_election.cc:304] T e0cb4663d72d461ca2ef6c680aee59cb P 665d4526e98a4f9898fab4723f981688 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 665d4526e98a4f9898fab4723f981688, 908f087afb9c4a04812368ab534a03b2; no voters: 
I20260709 12:14:16.804852 32246 raft_consensus.cc:2804] T e0cb4663d72d461ca2ef6c680aee59cb P 665d4526e98a4f9898fab4723f981688 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:16.805284 32246 raft_consensus.cc:697] T e0cb4663d72d461ca2ef6c680aee59cb P 665d4526e98a4f9898fab4723f981688 [term 1 LEADER]: Becoming Leader. State: Replica: 665d4526e98a4f9898fab4723f981688, State: Running, Role: LEADER
I20260709 12:14:16.806002 32246 consensus_queue.cc:237] T e0cb4663d72d461ca2ef6c680aee59cb P 665d4526e98a4f9898fab4723f981688 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.806855 32096 raft_consensus.cc:2468] T 15e900af838f4693b1d6f89ddee06965 P 908f087afb9c4a04812368ab534a03b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665d4526e98a4f9898fab4723f981688 in term 1.
I20260709 12:14:16.806855 32022 raft_consensus.cc:2468] T 15e900af838f4693b1d6f89ddee06965 P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665d4526e98a4f9898fab4723f981688 in term 1.
I20260709 12:14:16.808174 32136 leader_election.cc:304] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 665d4526e98a4f9898fab4723f981688, 908f087afb9c4a04812368ab534a03b2; no voters: 
I20260709 12:14:16.809612 32246 raft_consensus.cc:2804] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:16.810142 32246 raft_consensus.cc:697] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688 [term 1 LEADER]: Becoming Leader. State: Replica: 665d4526e98a4f9898fab4723f981688, State: Running, Role: LEADER
I20260709 12:14:16.810935 32246 consensus_queue.cc:237] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.813398 32220 raft_consensus.cc:493] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.813184 32235 consensus_queue.cc:1048] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 908f087afb9c4a04812368ab534a03b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:16.813900 32220 raft_consensus.cc:515] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.815066 32023 raft_consensus.cc:2468] T e0cb4663d72d461ca2ef6c680aee59cb P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665d4526e98a4f9898fab4723f981688 in term 1.
I20260709 12:14:16.818660 31919 catalog_manager.cc:5697] T e0cb4663d72d461ca2ef6c680aee59cb P 665d4526e98a4f9898fab4723f981688 reported cstate change: term changed from 0 to 1, leader changed from <none> to 665d4526e98a4f9898fab4723f981688 (127.20.196.131). New cstate: current_term: 1 leader_uuid: "665d4526e98a4f9898fab4723f981688" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:16.823225 32096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823ba3672286465bab521797c8fc296d" candidate_uuid: "665d4526e98a4f9898fab4723f981688" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "908f087afb9c4a04812368ab534a03b2" is_pre_election: true
I20260709 12:14:16.824432 32023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823ba3672286465bab521797c8fc296d" candidate_uuid: "665d4526e98a4f9898fab4723f981688" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "868ecd261e0249c984eb3d8afacef7e1" is_pre_election: true
I20260709 12:14:16.825088 32023 raft_consensus.cc:2468] T 823ba3672286465bab521797c8fc296d P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665d4526e98a4f9898fab4723f981688 in term 0.
I20260709 12:14:16.826354 32135 leader_election.cc:304] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 665d4526e98a4f9898fab4723f981688, 868ecd261e0249c984eb3d8afacef7e1; no voters: 
I20260709 12:14:16.827209 32246 raft_consensus.cc:2804] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:16.827570 32246 raft_consensus.cc:493] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:16.827878 32246 raft_consensus.cc:3060] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.823899 32096 raft_consensus.cc:2468] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 665d4526e98a4f9898fab4723f981688 in term 0.
I20260709 12:14:16.832551 32220 leader_election.cc:290] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117), 908f087afb9c4a04812368ab534a03b2 (127.20.196.130:35965)
I20260709 12:14:16.836280 32246 raft_consensus.cc:515] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.837800 31918 catalog_manager.cc:5697] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688 reported cstate change: term changed from 0 to 1, leader changed from <none> to 665d4526e98a4f9898fab4723f981688 (127.20.196.131). New cstate: current_term: 1 leader_uuid: "665d4526e98a4f9898fab4723f981688" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:16.840674 32022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823ba3672286465bab521797c8fc296d" candidate_uuid: "665d4526e98a4f9898fab4723f981688" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "868ecd261e0249c984eb3d8afacef7e1"
I20260709 12:14:16.841315 32022 raft_consensus.cc:3060] T 823ba3672286465bab521797c8fc296d P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.842648 32235 consensus_queue.cc:1048] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 908f087afb9c4a04812368ab534a03b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:16.847285 32236 raft_consensus.cc:493] T 496807cff0764aed8aac43768f03db67 P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.847821 32236 raft_consensus.cc:515] T 496807cff0764aed8aac43768f03db67 P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.848958 32022 raft_consensus.cc:2468] T 823ba3672286465bab521797c8fc296d P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665d4526e98a4f9898fab4723f981688 in term 1.
I20260709 12:14:16.850013 32236 leader_election.cc:290] T 496807cff0764aed8aac43768f03db67 P 868ecd261e0249c984eb3d8afacef7e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 908f087afb9c4a04812368ab534a03b2 (127.20.196.130:35965), 665d4526e98a4f9898fab4723f981688 (127.20.196.131:34699)
I20260709 12:14:16.850333 32246 leader_election.cc:290] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [CANDIDATE]: Term 1 election: Requested vote from peers 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117), 908f087afb9c4a04812368ab534a03b2 (127.20.196.130:35965)
I20260709 12:14:16.851473 32096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823ba3672286465bab521797c8fc296d" candidate_uuid: "665d4526e98a4f9898fab4723f981688" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "908f087afb9c4a04812368ab534a03b2"
I20260709 12:14:16.851661 32097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496807cff0764aed8aac43768f03db67" candidate_uuid: "868ecd261e0249c984eb3d8afacef7e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "908f087afb9c4a04812368ab534a03b2" is_pre_election: true
I20260709 12:14:16.852074 32096 raft_consensus.cc:3060] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.852450 32097 raft_consensus.cc:2393] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 868ecd261e0249c984eb3d8afacef7e1 in current term 1: Already voted for candidate 665d4526e98a4f9898fab4723f981688 in this term.
I20260709 12:14:16.852574 32135 leader_election.cc:304] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 665d4526e98a4f9898fab4723f981688, 868ecd261e0249c984eb3d8afacef7e1; no voters: 
I20260709 12:14:16.853180 32170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496807cff0764aed8aac43768f03db67" candidate_uuid: "868ecd261e0249c984eb3d8afacef7e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665d4526e98a4f9898fab4723f981688" is_pre_election: true
I20260709 12:14:16.853551 32246 raft_consensus.cc:2804] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:16.854171 32246 raft_consensus.cc:697] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [term 1 LEADER]: Becoming Leader. State: Replica: 665d4526e98a4f9898fab4723f981688, State: Running, Role: LEADER
I20260709 12:14:16.854668 31988 leader_election.cc:304] T 496807cff0764aed8aac43768f03db67 P 868ecd261e0249c984eb3d8afacef7e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 868ecd261e0249c984eb3d8afacef7e1; no voters: 665d4526e98a4f9898fab4723f981688, 908f087afb9c4a04812368ab534a03b2
I20260709 12:14:16.855557 32246 consensus_queue.cc:237] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.856554 32236 raft_consensus.cc:3060] T 496807cff0764aed8aac43768f03db67 P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.860373 32096 raft_consensus.cc:2468] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665d4526e98a4f9898fab4723f981688 in term 1.
I20260709 12:14:16.864078 32236 raft_consensus.cc:2749] T 496807cff0764aed8aac43768f03db67 P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:16.870645 31918 catalog_manager.cc:5697] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 reported cstate change: term changed from 0 to 1, leader changed from <none> to 665d4526e98a4f9898fab4723f981688 (127.20.196.131). New cstate: current_term: 1 leader_uuid: "665d4526e98a4f9898fab4723f981688" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:16.935680 32235 raft_consensus.cc:493] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.936520 32235 raft_consensus.cc:515] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.939230 32235 leader_election.cc:290] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 908f087afb9c4a04812368ab534a03b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117), 665d4526e98a4f9898fab4723f981688 (127.20.196.131:34699)
I20260709 12:14:16.940148 32022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50f879d2e1ef4a1384e7d77f4a3cf7f8" candidate_uuid: "908f087afb9c4a04812368ab534a03b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "868ecd261e0249c984eb3d8afacef7e1" is_pre_election: true
I20260709 12:14:16.940696 32172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50f879d2e1ef4a1384e7d77f4a3cf7f8" candidate_uuid: "908f087afb9c4a04812368ab534a03b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665d4526e98a4f9898fab4723f981688" is_pre_election: true
I20260709 12:14:16.940907 32022 raft_consensus.cc:2468] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 908f087afb9c4a04812368ab534a03b2 in term 0.
I20260709 12:14:16.941361 32172 raft_consensus.cc:2468] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 908f087afb9c4a04812368ab534a03b2 in term 0.
I20260709 12:14:16.942236 32061 leader_election.cc:304] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 908f087afb9c4a04812368ab534a03b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868ecd261e0249c984eb3d8afacef7e1, 908f087afb9c4a04812368ab534a03b2; no voters: 
I20260709 12:14:16.943095 32235 raft_consensus.cc:2804] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:16.943363 32235 raft_consensus.cc:493] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:16.943617 32235 raft_consensus.cc:3060] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 908f087afb9c4a04812368ab534a03b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.952318 32235 raft_consensus.cc:515] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 908f087afb9c4a04812368ab534a03b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.955386 32022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50f879d2e1ef4a1384e7d77f4a3cf7f8" candidate_uuid: "908f087afb9c4a04812368ab534a03b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "868ecd261e0249c984eb3d8afacef7e1"
I20260709 12:14:16.954854 32235 leader_election.cc:290] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 908f087afb9c4a04812368ab534a03b2 [CANDIDATE]: Term 1 election: Requested vote from peers 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117), 665d4526e98a4f9898fab4723f981688 (127.20.196.131:34699)
I20260709 12:14:16.955921 32170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50f879d2e1ef4a1384e7d77f4a3cf7f8" candidate_uuid: "908f087afb9c4a04812368ab534a03b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "665d4526e98a4f9898fab4723f981688"
I20260709 12:14:16.956066 32022 raft_consensus.cc:3060] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 868ecd261e0249c984eb3d8afacef7e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.955562 32172 raft_consensus.cc:3060] T 5cc7453e227a424c8b6645700e8cf4c8 P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.956669 32170 raft_consensus.cc:3060] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 665d4526e98a4f9898fab4723f981688 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.963428 32170 raft_consensus.cc:2468] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 665d4526e98a4f9898fab4723f981688 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 908f087afb9c4a04812368ab534a03b2 in term 1.
I20260709 12:14:16.963418 32022 raft_consensus.cc:2468] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 908f087afb9c4a04812368ab534a03b2 in term 1.
I20260709 12:14:16.964776 32061 leader_election.cc:304] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 908f087afb9c4a04812368ab534a03b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868ecd261e0249c984eb3d8afacef7e1, 908f087afb9c4a04812368ab534a03b2; no voters: 
I20260709 12:14:16.965852 32235 raft_consensus.cc:2804] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 908f087afb9c4a04812368ab534a03b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:16.966291 32218 consensus_queue.cc:1048] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:16.966429 32235 raft_consensus.cc:697] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 908f087afb9c4a04812368ab534a03b2 [term 1 LEADER]: Becoming Leader. State: Replica: 908f087afb9c4a04812368ab534a03b2, State: Running, Role: LEADER
I20260709 12:14:16.967403 32235 consensus_queue.cc:237] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 908f087afb9c4a04812368ab534a03b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:16.977166 31918 catalog_manager.cc:5697] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 908f087afb9c4a04812368ab534a03b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 908f087afb9c4a04812368ab534a03b2 (127.20.196.130). New cstate: current_term: 1 leader_uuid: "908f087afb9c4a04812368ab534a03b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:16.981353 32235 consensus_queue.cc:1048] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:16.986097 32245 consensus_queue.cc:1048] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 665d4526e98a4f9898fab4723f981688 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:16.987757 32245 consensus_queue.cc:1048] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 665d4526e98a4f9898fab4723f981688 [LEADER]: Connected to new peer: Peer: permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:16.994839 32245 consensus_queue.cc:1048] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [LEADER]: Connected to new peer: Peer: permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:17.018481 32245 consensus_queue.cc:1048] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:17.047851 32245 consensus_queue.cc:1048] T 6b89a1496f2c48959a93e4883a24148b P 665d4526e98a4f9898fab4723f981688 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:17.059932 32246 consensus_queue.cc:1048] T 6b89a1496f2c48959a93e4883a24148b P 665d4526e98a4f9898fab4723f981688 [LEADER]: Connected to new peer: Peer: permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:17.126240 32266 consensus_queue.cc:1048] T 9ce346322e2f42f08714e116defd9b56 P 868ecd261e0249c984eb3d8afacef7e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:17.137421 32236 consensus_queue.cc:1048] T 9ce346322e2f42f08714e116defd9b56 P 868ecd261e0249c984eb3d8afacef7e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:17.199867 21266 ts_manager.cc:295] Set tserver state for 868ecd261e0249c984eb3d8afacef7e1 to MAINTENANCE_MODE
I20260709 12:14:17.200537 21266 tablet_server.cc:179] TabletServer@127.20.196.129:0 shutting down...
W20260709 12:14:17.211959 32061 consensus_peers.cc:597] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 908f087afb9c4a04812368ab534a03b2 -> Peer 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117): Couldn't send request to peer 868ecd261e0249c984eb3d8afacef7e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:17.228240 21266 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:17.228925 21266 tablet_replica.cc:333] T 496807cff0764aed8aac43768f03db67 P 868ecd261e0249c984eb3d8afacef7e1: stopping tablet replica
I20260709 12:14:17.229529 21266 raft_consensus.cc:2243] T 496807cff0764aed8aac43768f03db67 P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:17.230011 21266 raft_consensus.cc:2272] T 496807cff0764aed8aac43768f03db67 P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:17.232738 21266 tablet_replica.cc:333] T 9ce346322e2f42f08714e116defd9b56 P 868ecd261e0249c984eb3d8afacef7e1: stopping tablet replica
I20260709 12:14:17.233338 21266 raft_consensus.cc:2243] T 9ce346322e2f42f08714e116defd9b56 P 868ecd261e0249c984eb3d8afacef7e1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:17.234190 21266 raft_consensus.cc:2272] T 9ce346322e2f42f08714e116defd9b56 P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:17.236294 21266 tablet_replica.cc:333] T 6b89a1496f2c48959a93e4883a24148b P 868ecd261e0249c984eb3d8afacef7e1: stopping tablet replica
I20260709 12:14:17.236868 21266 raft_consensus.cc:2243] T 6b89a1496f2c48959a93e4883a24148b P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:17.237263 21266 raft_consensus.cc:2272] T 6b89a1496f2c48959a93e4883a24148b P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:17.239415 21266 tablet_replica.cc:333] T 5cc7453e227a424c8b6645700e8cf4c8 P 868ecd261e0249c984eb3d8afacef7e1: stopping tablet replica
I20260709 12:14:17.239965 21266 raft_consensus.cc:2243] T 5cc7453e227a424c8b6645700e8cf4c8 P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:17.240386 21266 raft_consensus.cc:2272] T 5cc7453e227a424c8b6645700e8cf4c8 P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:17.242679 21266 tablet_replica.cc:333] T 823ba3672286465bab521797c8fc296d P 868ecd261e0249c984eb3d8afacef7e1: stopping tablet replica
I20260709 12:14:17.243359 21266 raft_consensus.cc:2243] T 823ba3672286465bab521797c8fc296d P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:17.243734 21266 raft_consensus.cc:2272] T 823ba3672286465bab521797c8fc296d P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:17.245450 21266 tablet_replica.cc:333] T e0cb4663d72d461ca2ef6c680aee59cb P 868ecd261e0249c984eb3d8afacef7e1: stopping tablet replica
I20260709 12:14:17.245982 21266 raft_consensus.cc:2243] T e0cb4663d72d461ca2ef6c680aee59cb P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:17.246358 21266 raft_consensus.cc:2272] T e0cb4663d72d461ca2ef6c680aee59cb P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:17.247242 32135 consensus_peers.cc:597] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688 -> Peer 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117): Couldn't send request to peer 868ecd261e0249c984eb3d8afacef7e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:17.248106 21266 tablet_replica.cc:333] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 868ecd261e0249c984eb3d8afacef7e1: stopping tablet replica
I20260709 12:14:17.248719 21266 raft_consensus.cc:2243] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:17.249131 21266 raft_consensus.cc:2272] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:17.251443 21266 tablet_replica.cc:333] T 15e900af838f4693b1d6f89ddee06965 P 868ecd261e0249c984eb3d8afacef7e1: stopping tablet replica
I20260709 12:14:17.251973 21266 raft_consensus.cc:2243] T 15e900af838f4693b1d6f89ddee06965 P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:17.252350 21266 raft_consensus.cc:2272] T 15e900af838f4693b1d6f89ddee06965 P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:17.254024 21266 tablet_replica.cc:333] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 868ecd261e0249c984eb3d8afacef7e1: stopping tablet replica
I20260709 12:14:17.254536 21266 raft_consensus.cc:2243] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:17.254932 21266 raft_consensus.cc:2272] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:17.257267 21266 tablet_replica.cc:333] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 868ecd261e0249c984eb3d8afacef7e1: stopping tablet replica
I20260709 12:14:17.257758 21266 raft_consensus.cc:2243] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:17.258122 21266 raft_consensus.cc:2272] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:17.286477 21266 tablet_server.cc:196] TabletServer@127.20.196.129:0 shutdown complete.
W20260709 12:14:17.288152 31969 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:14:17.327962 32246 consensus_queue.cc:1048] T e0cb4663d72d461ca2ef6c680aee59cb P 665d4526e98a4f9898fab4723f981688 [LEADER]: Connected to new peer: Peer: permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:14:17.344288 32135 consensus_peers.cc:597] T e0cb4663d72d461ca2ef6c680aee59cb P 665d4526e98a4f9898fab4723f981688 -> Peer 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117): Couldn't send request to peer 868ecd261e0249c984eb3d8afacef7e1. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:45117: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:17.376020 32135 consensus_peers.cc:597] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 -> Peer 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117): Couldn't send request to peer 868ecd261e0249c984eb3d8afacef7e1. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:45117: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:17.393290 32246 consensus_queue.cc:1048] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688 [LEADER]: Connected to new peer: Peer: permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:17.460356 32246 consensus_queue.cc:1048] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [LEADER]: Connected to new peer: Peer: permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:17.467371 32295 consensus_queue.cc:1048] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 908f087afb9c4a04812368ab534a03b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:14:17.483965 32061 consensus_peers.cc:597] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 -> Peer 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117): Couldn't send request to peer 868ecd261e0249c984eb3d8afacef7e1. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:45117: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:17.484517 32061 consensus_peers.cc:597] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 908f087afb9c4a04812368ab534a03b2 -> Peer 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117): Couldn't send request to peer 868ecd261e0249c984eb3d8afacef7e1. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:45117: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:17.567724 32135 consensus_peers.cc:597] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 665d4526e98a4f9898fab4723f981688 -> Peer 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117): Couldn't send request to peer 868ecd261e0249c984eb3d8afacef7e1. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:45117: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:17.590741 32135 consensus_peers.cc:597] T 6b89a1496f2c48959a93e4883a24148b P 665d4526e98a4f9898fab4723f981688 -> Peer 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117): Couldn't send request to peer 868ecd261e0249c984eb3d8afacef7e1. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:45117: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:17.602953 32135 consensus_peers.cc:597] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 -> Peer 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117): Couldn't send request to peer 868ecd261e0249c984eb3d8afacef7e1. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:45117: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:18.289166 31969 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:14:18.492056 32061 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.196.129:45117: connect: Connection refused (error 111) [suppressed 129 similar messages]
I20260709 12:14:18.636703 32295 raft_consensus.cc:493] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 868ecd261e0249c984eb3d8afacef7e1)
I20260709 12:14:18.637241 32295 raft_consensus.cc:515] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:18.639209 32295 leader_election.cc:290] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117), 665d4526e98a4f9898fab4723f981688 (127.20.196.131:34699)
I20260709 12:14:18.640200 32172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce346322e2f42f08714e116defd9b56" candidate_uuid: "908f087afb9c4a04812368ab534a03b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "665d4526e98a4f9898fab4723f981688" is_pre_election: true
I20260709 12:14:18.640988 32172 raft_consensus.cc:2468] T 9ce346322e2f42f08714e116defd9b56 P 665d4526e98a4f9898fab4723f981688 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 908f087afb9c4a04812368ab534a03b2 in term 1.
I20260709 12:14:18.641491 32246 raft_consensus.cc:493] T 9ce346322e2f42f08714e116defd9b56 P 665d4526e98a4f9898fab4723f981688 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 868ecd261e0249c984eb3d8afacef7e1)
I20260709 12:14:18.641999 32246 raft_consensus.cc:515] T 9ce346322e2f42f08714e116defd9b56 P 665d4526e98a4f9898fab4723f981688 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:18.642406 32063 leader_election.cc:304] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 665d4526e98a4f9898fab4723f981688, 908f087afb9c4a04812368ab534a03b2; no voters: 
I20260709 12:14:18.643385 32295 raft_consensus.cc:2804] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:18.643852 32295 raft_consensus.cc:493] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 868ecd261e0249c984eb3d8afacef7e1)
W20260709 12:14:18.644018 32061 leader_election.cc:336] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117): Network error: Client connection negotiation failed: client connection to 127.20.196.129:45117: connect: Connection refused (error 111)
I20260709 12:14:18.644392 32295 raft_consensus.cc:3060] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:18.644857 32246 leader_election.cc:290] T 9ce346322e2f42f08714e116defd9b56 P 665d4526e98a4f9898fab4723f981688 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117), 908f087afb9c4a04812368ab534a03b2 (127.20.196.130:35965)
I20260709 12:14:18.646631 32096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce346322e2f42f08714e116defd9b56" candidate_uuid: "665d4526e98a4f9898fab4723f981688" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "908f087afb9c4a04812368ab534a03b2" is_pre_election: true
W20260709 12:14:18.650005 32135 leader_election.cc:336] T 9ce346322e2f42f08714e116defd9b56 P 665d4526e98a4f9898fab4723f981688 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117): Network error: Client connection negotiation failed: client connection to 127.20.196.129:45117: connect: Connection refused (error 111)
I20260709 12:14:18.651702 32295 raft_consensus.cc:515] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:18.652725 32096 raft_consensus.cc:2393] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 665d4526e98a4f9898fab4723f981688 in current term 2: Already voted for candidate 908f087afb9c4a04812368ab534a03b2 in this term.
I20260709 12:14:18.653558 32295 leader_election.cc:290] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 [CANDIDATE]: Term 2 election: Requested vote from peers 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117), 665d4526e98a4f9898fab4723f981688 (127.20.196.131:34699)
I20260709 12:14:18.654752 32172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce346322e2f42f08714e116defd9b56" candidate_uuid: "908f087afb9c4a04812368ab534a03b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "665d4526e98a4f9898fab4723f981688"
I20260709 12:14:18.655447 32172 raft_consensus.cc:3060] T 9ce346322e2f42f08714e116defd9b56 P 665d4526e98a4f9898fab4723f981688 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:18.655793 32136 leader_election.cc:304] T 9ce346322e2f42f08714e116defd9b56 P 665d4526e98a4f9898fab4723f981688 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 665d4526e98a4f9898fab4723f981688; no voters: 868ecd261e0249c984eb3d8afacef7e1, 908f087afb9c4a04812368ab534a03b2
W20260709 12:14:18.658180 32061 leader_election.cc:336] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117): Network error: Client connection negotiation failed: client connection to 127.20.196.129:45117: connect: Connection refused (error 111)
I20260709 12:14:18.661827 32172 raft_consensus.cc:2468] T 9ce346322e2f42f08714e116defd9b56 P 665d4526e98a4f9898fab4723f981688 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 908f087afb9c4a04812368ab534a03b2 in term 2.
I20260709 12:14:18.662312 32246 raft_consensus.cc:2749] T 9ce346322e2f42f08714e116defd9b56 P 665d4526e98a4f9898fab4723f981688 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:18.662930 32063 leader_election.cc:304] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 665d4526e98a4f9898fab4723f981688, 908f087afb9c4a04812368ab534a03b2; no voters: 868ecd261e0249c984eb3d8afacef7e1
I20260709 12:14:18.663750 32295 raft_consensus.cc:2804] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:18.664321 32295 raft_consensus.cc:697] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 [term 2 LEADER]: Becoming Leader. State: Replica: 908f087afb9c4a04812368ab534a03b2, State: Running, Role: LEADER
I20260709 12:14:18.665242 32295 consensus_queue.cc:237] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:18.672508 31918 catalog_manager.cc:5697] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 reported cstate change: term changed from 1 to 2, leader changed from 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129) to 908f087afb9c4a04812368ab534a03b2 (127.20.196.130). New cstate: current_term: 2 leader_uuid: "908f087afb9c4a04812368ab534a03b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:19.200748 32061 consensus_peers.cc:597] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 -> Peer 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117): Couldn't send request to peer 868ecd261e0249c984eb3d8afacef7e1. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:45117: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:19.258394 32172 raft_consensus.cc:1275] T 9ce346322e2f42f08714e116defd9b56 P 665d4526e98a4f9898fab4723f981688 [term 2 FOLLOWER]: Refusing update from remote peer 908f087afb9c4a04812368ab534a03b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:19.259986 32295 consensus_queue.cc:1048] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:14:19.290115 31969 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:14:19.502684 32061 consensus_peers.cc:597] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 908f087afb9c4a04812368ab534a03b2 -> Peer 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117): Couldn't send request to peer 868ecd261e0249c984eb3d8afacef7e1. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:45117: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:19.638841 32135 consensus_peers.cc:597] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688 -> Peer 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117): Couldn't send request to peer 868ecd261e0249c984eb3d8afacef7e1. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:45117: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:19.687610 32135 consensus_peers.cc:597] T e0cb4663d72d461ca2ef6c680aee59cb P 665d4526e98a4f9898fab4723f981688 -> Peer 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117): Couldn't send request to peer 868ecd261e0249c984eb3d8afacef7e1. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:45117: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:19.726598 32135 consensus_peers.cc:597] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 -> Peer 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117): Couldn't send request to peer 868ecd261e0249c984eb3d8afacef7e1. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:45117: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:20.002125 32061 consensus_peers.cc:597] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 908f087afb9c4a04812368ab534a03b2 -> Peer 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117): Couldn't send request to peer 868ecd261e0249c984eb3d8afacef7e1. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:45117: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:20.167371 32135 consensus_peers.cc:597] T 6b89a1496f2c48959a93e4883a24148b P 665d4526e98a4f9898fab4723f981688 -> Peer 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117): Couldn't send request to peer 868ecd261e0249c984eb3d8afacef7e1. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:45117: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:20.192605 32061 consensus_peers.cc:597] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 -> Peer 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117): Couldn't send request to peer 868ecd261e0249c984eb3d8afacef7e1. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:45117: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:20.291131 31969 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:14:20.293931 32135 consensus_peers.cc:597] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 665d4526e98a4f9898fab4723f981688 -> Peer 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117): Couldn't send request to peer 868ecd261e0249c984eb3d8afacef7e1. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:45117: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:20.361107 32135 consensus_peers.cc:597] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 -> Peer 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117): Couldn't send request to peer 868ecd261e0249c984eb3d8afacef7e1. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:45117: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:21.292165 31969 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:14:21.637879 32061 consensus_peers.cc:597] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 -> Peer 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117): Couldn't send request to peer 868ecd261e0249c984eb3d8afacef7e1. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:45117: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:21.943869 32061 consensus_peers.cc:597] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 908f087afb9c4a04812368ab534a03b2 -> Peer 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117): Couldn't send request to peer 868ecd261e0249c984eb3d8afacef7e1. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:45117: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:22.754891 31969 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:14:22.783840 32135 consensus_peers.cc:597] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 -> Peer 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117): Couldn't send request to peer 868ecd261e0249c984eb3d8afacef7e1. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:45117: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:22.830751 32135 consensus_peers.cc:597] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688 -> Peer 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117): Couldn't send request to peer 868ecd261e0249c984eb3d8afacef7e1. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:45117: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:22.848923 32135 consensus_peers.cc:597] T e0cb4663d72d461ca2ef6c680aee59cb P 665d4526e98a4f9898fab4723f981688 -> Peer 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117): Couldn't send request to peer 868ecd261e0249c984eb3d8afacef7e1. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:45117: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:22.853307 32061 consensus_peers.cc:597] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 908f087afb9c4a04812368ab534a03b2 -> Peer 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117): Couldn't send request to peer 868ecd261e0249c984eb3d8afacef7e1. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:45117: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:23.033083 21266 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:23.039639 32323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:23.039980 32324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:23.042972 21266 server_base.cc:1061] running on GCE node
W20260709 12:14:23.043917 32327 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:23.045053 21266 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:23.045323 21266 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:23.045508 21266 hybrid_clock.cc:648] HybridClock initialized: now 1783599263045494 us; error 0 us; skew 500 ppm
I20260709 12:14:23.046020 21266 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:23.048657 21266 webserver.cc:533] Webserver started at http://127.20.196.129:46735/ using document root <none> and password file <none>
I20260709 12:14:23.049170 21266 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:23.049373 21266 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:14:23.052726 21266 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 12:14:23.056375 32331 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:23.057253 21266 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:14:23.057574 21266 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894355727-21266-0/minicluster-data/ts-0-root
uuid: "868ecd261e0249c984eb3d8afacef7e1"
format_stamp: "Formatted at 2026-07-09 12:14:15 on dist-test-slave-h6sg"
I20260709 12:14:23.057886 21266 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894355727-21266-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894355727-21266-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894355727-21266-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:23.078348 21266 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:23.079577 21266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:23.081291 21266 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:23.085567 32338 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 12:14:23.137387 21266 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:14:23.137730 21266 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.053s	user 0.001s	sys 0.002s
I20260709 12:14:23.138113 21266 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 12:14:23.142935 32338 tablet_bootstrap.cc:492] T e0cb4663d72d461ca2ef6c680aee59cb P 868ecd261e0249c984eb3d8afacef7e1: Bootstrap starting.
I20260709 12:14:23.153120 32338 tablet_bootstrap.cc:492] T e0cb4663d72d461ca2ef6c680aee59cb P 868ecd261e0249c984eb3d8afacef7e1: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:23.153853 32338 tablet_bootstrap.cc:492] T e0cb4663d72d461ca2ef6c680aee59cb P 868ecd261e0249c984eb3d8afacef7e1: Bootstrap complete.
I20260709 12:14:23.154422 32338 ts_tablet_manager.cc:1403] T e0cb4663d72d461ca2ef6c680aee59cb P 868ecd261e0249c984eb3d8afacef7e1: Time spent bootstrapping tablet: real 0.012s	user 0.005s	sys 0.004s
I20260709 12:14:23.156453 32338 raft_consensus.cc:359] T e0cb4663d72d461ca2ef6c680aee59cb P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:23.156996 32338 raft_consensus.cc:740] T e0cb4663d72d461ca2ef6c680aee59cb P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 868ecd261e0249c984eb3d8afacef7e1, State: Initialized, Role: FOLLOWER
I20260709 12:14:23.157677 32338 consensus_queue.cc:260] T e0cb4663d72d461ca2ef6c680aee59cb P 868ecd261e0249c984eb3d8afacef7e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:23.159987 32338 ts_tablet_manager.cc:1434] T e0cb4663d72d461ca2ef6c680aee59cb P 868ecd261e0249c984eb3d8afacef7e1: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.004s
I20260709 12:14:23.160655 32338 tablet_bootstrap.cc:492] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 868ecd261e0249c984eb3d8afacef7e1: Bootstrap starting.
I20260709 12:14:23.172237 32338 tablet_bootstrap.cc:492] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 868ecd261e0249c984eb3d8afacef7e1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:23.172969 32338 tablet_bootstrap.cc:492] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 868ecd261e0249c984eb3d8afacef7e1: Bootstrap complete.
I20260709 12:14:23.173520 32338 ts_tablet_manager.cc:1403] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 868ecd261e0249c984eb3d8afacef7e1: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 12:14:23.175565 32338 raft_consensus.cc:359] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } }
I20260709 12:14:23.175923 21266 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:14:23.176162 32338 raft_consensus.cc:740] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 868ecd261e0249c984eb3d8afacef7e1, State: Initialized, Role: FOLLOWER
I20260709 12:14:23.176380 21266 ts_tablet_manager.cc:595] Time spent register tablets: real 0.038s	user 0.038s	sys 0.000s
I20260709 12:14:23.176999 32338 consensus_queue.cc:260] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 868ecd261e0249c984eb3d8afacef7e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } }
I20260709 12:14:23.178723 32338 ts_tablet_manager.cc:1434] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 868ecd261e0249c984eb3d8afacef7e1: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:14:23.179389 32338 tablet_bootstrap.cc:492] T 823ba3672286465bab521797c8fc296d P 868ecd261e0249c984eb3d8afacef7e1: Bootstrap starting.
I20260709 12:14:23.190651 32338 tablet_bootstrap.cc:492] T 823ba3672286465bab521797c8fc296d P 868ecd261e0249c984eb3d8afacef7e1: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:23.191474 32338 tablet_bootstrap.cc:492] T 823ba3672286465bab521797c8fc296d P 868ecd261e0249c984eb3d8afacef7e1: Bootstrap complete.
I20260709 12:14:23.192198 32338 ts_tablet_manager.cc:1403] T 823ba3672286465bab521797c8fc296d P 868ecd261e0249c984eb3d8afacef7e1: Time spent bootstrapping tablet: real 0.013s	user 0.006s	sys 0.006s
I20260709 12:14:23.194288 32338 raft_consensus.cc:359] T 823ba3672286465bab521797c8fc296d P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:23.195075 32338 raft_consensus.cc:740] T 823ba3672286465bab521797c8fc296d P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 868ecd261e0249c984eb3d8afacef7e1, State: Initialized, Role: FOLLOWER
I20260709 12:14:23.195847 32338 consensus_queue.cc:260] T 823ba3672286465bab521797c8fc296d P 868ecd261e0249c984eb3d8afacef7e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:23.197795 32338 ts_tablet_manager.cc:1434] T 823ba3672286465bab521797c8fc296d P 868ecd261e0249c984eb3d8afacef7e1: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.002s
I20260709 12:14:23.198534 32338 tablet_bootstrap.cc:492] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 868ecd261e0249c984eb3d8afacef7e1: Bootstrap starting.
I20260709 12:14:23.213017 32338 tablet_bootstrap.cc:492] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 868ecd261e0249c984eb3d8afacef7e1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:23.214154 32338 tablet_bootstrap.cc:492] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 868ecd261e0249c984eb3d8afacef7e1: Bootstrap complete.
I20260709 12:14:23.214826 32338 ts_tablet_manager.cc:1403] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 868ecd261e0249c984eb3d8afacef7e1: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 12:14:23.216841 32338 raft_consensus.cc:359] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:23.217361 32338 raft_consensus.cc:740] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 868ecd261e0249c984eb3d8afacef7e1, State: Initialized, Role: FOLLOWER
I20260709 12:14:23.218082 32338 consensus_queue.cc:260] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 868ecd261e0249c984eb3d8afacef7e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
W20260709 12:14:23.218762 32135 consensus_peers.cc:597] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 665d4526e98a4f9898fab4723f981688 -> Peer 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117): Couldn't send request to peer 868ecd261e0249c984eb3d8afacef7e1. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:45117: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:23.219998 32338 ts_tablet_manager.cc:1434] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 868ecd261e0249c984eb3d8afacef7e1: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:14:23.220707 32338 tablet_bootstrap.cc:492] T 9ce346322e2f42f08714e116defd9b56 P 868ecd261e0249c984eb3d8afacef7e1: Bootstrap starting.
I20260709 12:14:23.232196 32338 tablet_bootstrap.cc:492] T 9ce346322e2f42f08714e116defd9b56 P 868ecd261e0249c984eb3d8afacef7e1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:23.232928 32338 tablet_bootstrap.cc:492] T 9ce346322e2f42f08714e116defd9b56 P 868ecd261e0249c984eb3d8afacef7e1: Bootstrap complete.
I20260709 12:14:23.233573 32338 ts_tablet_manager.cc:1403] T 9ce346322e2f42f08714e116defd9b56 P 868ecd261e0249c984eb3d8afacef7e1: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 12:14:23.235630 32338 raft_consensus.cc:359] T 9ce346322e2f42f08714e116defd9b56 P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:23.236186 32338 raft_consensus.cc:740] T 9ce346322e2f42f08714e116defd9b56 P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 868ecd261e0249c984eb3d8afacef7e1, State: Initialized, Role: FOLLOWER
I20260709 12:14:23.236781 32338 consensus_queue.cc:260] T 9ce346322e2f42f08714e116defd9b56 P 868ecd261e0249c984eb3d8afacef7e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:23.238445 32338 ts_tablet_manager.cc:1434] T 9ce346322e2f42f08714e116defd9b56 P 868ecd261e0249c984eb3d8afacef7e1: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:14:23.239132 32338 tablet_bootstrap.cc:492] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 868ecd261e0249c984eb3d8afacef7e1: Bootstrap starting.
I20260709 12:14:23.244953 21266 rpc_server.cc:307] RPC server started. Bound to: 127.20.196.129:45117
I20260709 12:14:23.245075 32400 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.196.129:45117 every 8 connection(s)
I20260709 12:14:23.248407 32338 tablet_bootstrap.cc:492] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 868ecd261e0249c984eb3d8afacef7e1: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:23.249332 32338 tablet_bootstrap.cc:492] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 868ecd261e0249c984eb3d8afacef7e1: Bootstrap complete.
I20260709 12:14:23.249816 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:23.250028 32338 ts_tablet_manager.cc:1403] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 868ecd261e0249c984eb3d8afacef7e1: Time spent bootstrapping tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 12:14:23.253201 32338 raft_consensus.cc:359] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:23.254117 32338 raft_consensus.cc:740] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 868ecd261e0249c984eb3d8afacef7e1, State: Initialized, Role: FOLLOWER
I20260709 12:14:23.254951 32338 consensus_queue.cc:260] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 868ecd261e0249c984eb3d8afacef7e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:23.256696 32338 ts_tablet_manager.cc:1434] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 868ecd261e0249c984eb3d8afacef7e1: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.004s
I20260709 12:14:23.257500 32338 tablet_bootstrap.cc:492] T 496807cff0764aed8aac43768f03db67 P 868ecd261e0249c984eb3d8afacef7e1: Bootstrap starting.
I20260709 12:14:23.278455 32338 tablet_bootstrap.cc:492] T 496807cff0764aed8aac43768f03db67 P 868ecd261e0249c984eb3d8afacef7e1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:23.279565 32338 tablet_bootstrap.cc:492] T 496807cff0764aed8aac43768f03db67 P 868ecd261e0249c984eb3d8afacef7e1: Bootstrap complete.
I20260709 12:14:23.280299 32338 ts_tablet_manager.cc:1403] T 496807cff0764aed8aac43768f03db67 P 868ecd261e0249c984eb3d8afacef7e1: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.000s
I20260709 12:14:23.282945 32338 raft_consensus.cc:359] T 496807cff0764aed8aac43768f03db67 P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:23.283732 32338 raft_consensus.cc:740] T 496807cff0764aed8aac43768f03db67 P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 868ecd261e0249c984eb3d8afacef7e1, State: Initialized, Role: FOLLOWER
I20260709 12:14:23.284519 32338 consensus_queue.cc:260] T 496807cff0764aed8aac43768f03db67 P 868ecd261e0249c984eb3d8afacef7e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:23.285153 32172 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "496807cff0764aed8aac43768f03db67"
dest_uuid: "665d4526e98a4f9898fab4723f981688"
mode: GRACEFUL
new_leader_uuid: "908f087afb9c4a04812368ab534a03b2"
 from {username='slave'} at 127.0.0.1:39180
I20260709 12:14:23.285704 32402 heartbeater.cc:344] Connected to a master server at 127.20.196.190:34873
I20260709 12:14:23.286088 32172 raft_consensus.cc:606] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [term 1 LEADER]: Received request to transfer leadership to TS 908f087afb9c4a04812368ab534a03b2
I20260709 12:14:23.286231 32402 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:23.286788 32338 ts_tablet_manager.cc:1434] T 496807cff0764aed8aac43768f03db67 P 868ecd261e0249c984eb3d8afacef7e1: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:14:23.287518 32402 heartbeater.cc:507] Master 127.20.196.190:34873 requested a full tablet report, sending...
I20260709 12:14:23.287683 32338 tablet_bootstrap.cc:492] T 6b89a1496f2c48959a93e4883a24148b P 868ecd261e0249c984eb3d8afacef7e1: Bootstrap starting.
I20260709 12:14:23.303755 31918 ts_manager.cc:194] Re-registered known tserver with Master: 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117)
I20260709 12:14:23.324245 31918 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46116
W20260709 12:14:23.324842 32061 consensus_peers.cc:597] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 -> Peer 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117): Couldn't send request to peer 868ecd261e0249c984eb3d8afacef7e1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:23.327996 32319 raft_consensus.cc:993] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688: : Instructing follower 908f087afb9c4a04812368ab534a03b2 to start an election
I20260709 12:14:23.328504 32402 heartbeater.cc:499] Master 127.20.196.190:34873 was elected leader, sending a full tablet report...
I20260709 12:14:23.328675 32319 raft_consensus.cc:1081] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [term 1 LEADER]: Signalling peer 908f087afb9c4a04812368ab534a03b2 to start an election
I20260709 12:14:23.333637 32098 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "496807cff0764aed8aac43768f03db67"
dest_uuid: "908f087afb9c4a04812368ab534a03b2"
 from {username='slave'} at 127.0.0.1:60672
I20260709 12:14:23.334295 32098 raft_consensus.cc:493] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:23.334702 32098 raft_consensus.cc:3060] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:23.343760 32098 raft_consensus.cc:515] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:23.349960 32096 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50f879d2e1ef4a1384e7d77f4a3cf7f8"
dest_uuid: "908f087afb9c4a04812368ab534a03b2"
mode: GRACEFUL
new_leader_uuid: "665d4526e98a4f9898fab4723f981688"
 from {username='slave'} at 127.0.0.1:60686
I20260709 12:14:23.350214 32375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496807cff0764aed8aac43768f03db67" candidate_uuid: "908f087afb9c4a04812368ab534a03b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "868ecd261e0249c984eb3d8afacef7e1"
I20260709 12:14:23.350605 32096 raft_consensus.cc:606] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 908f087afb9c4a04812368ab534a03b2 [term 1 LEADER]: Received request to transfer leadership to TS 665d4526e98a4f9898fab4723f981688
I20260709 12:14:23.351029 32375 raft_consensus.cc:3060] T 496807cff0764aed8aac43768f03db67 P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:23.351963 32098 leader_election.cc:290] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2 [CANDIDATE]: Term 2 election: Requested vote from peers 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117), 665d4526e98a4f9898fab4723f981688 (127.20.196.131:34699)
I20260709 12:14:23.355779 32172 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "823ba3672286465bab521797c8fc296d"
dest_uuid: "665d4526e98a4f9898fab4723f981688"
mode: GRACEFUL
new_leader_uuid: "908f087afb9c4a04812368ab534a03b2"
 from {username='slave'} at 127.0.0.1:39180
I20260709 12:14:23.356385 32172 raft_consensus.cc:606] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [term 1 LEADER]: Received request to transfer leadership to TS 908f087afb9c4a04812368ab534a03b2
I20260709 12:14:23.356271 32170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496807cff0764aed8aac43768f03db67" candidate_uuid: "908f087afb9c4a04812368ab534a03b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "665d4526e98a4f9898fab4723f981688"
I20260709 12:14:23.357096 32170 raft_consensus.cc:3055] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:23.357456 32170 raft_consensus.cc:740] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 665d4526e98a4f9898fab4723f981688, State: Running, Role: LEADER
I20260709 12:14:23.357860 32338 tablet_bootstrap.cc:492] T 6b89a1496f2c48959a93e4883a24148b P 868ecd261e0249c984eb3d8afacef7e1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:23.358539 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:14:23.358289 32170 consensus_queue.cc:260] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:23.358932 32338 tablet_bootstrap.cc:492] T 6b89a1496f2c48959a93e4883a24148b P 868ecd261e0249c984eb3d8afacef7e1: Bootstrap complete.
I20260709 12:14:23.359261 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:23.359761 32338 ts_tablet_manager.cc:1403] T 6b89a1496f2c48959a93e4883a24148b P 868ecd261e0249c984eb3d8afacef7e1: Time spent bootstrapping tablet: real 0.072s	user 0.035s	sys 0.019s
I20260709 12:14:23.360195 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:23.359607 32170 raft_consensus.cc:3060] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:23.365736 32135 consensus_peers.cc:597] T 6b89a1496f2c48959a93e4883a24148b P 665d4526e98a4f9898fab4723f981688 -> Peer 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117): Couldn't send request to peer 868ecd261e0249c984eb3d8afacef7e1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:23.371538 32375 raft_consensus.cc:2468] T 496807cff0764aed8aac43768f03db67 P 868ecd261e0249c984eb3d8afacef7e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 908f087afb9c4a04812368ab534a03b2 in term 2.
I20260709 12:14:23.362872 32338 raft_consensus.cc:359] T 6b89a1496f2c48959a93e4883a24148b P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:23.372588 32374 raft_consensus.cc:1240] T 496807cff0764aed8aac43768f03db67 P 868ecd261e0249c984eb3d8afacef7e1 [term 2 FOLLOWER]: Rejecting Update request from peer 665d4526e98a4f9898fab4723f981688 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:23.372812 32338 raft_consensus.cc:740] T 6b89a1496f2c48959a93e4883a24148b P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 868ecd261e0249c984eb3d8afacef7e1, State: Initialized, Role: FOLLOWER
I20260709 12:14:23.373097 32061 leader_election.cc:304] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868ecd261e0249c984eb3d8afacef7e1, 908f087afb9c4a04812368ab534a03b2; no voters: 
I20260709 12:14:23.373967 32170 raft_consensus.cc:2468] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 908f087afb9c4a04812368ab534a03b2 in term 2.
I20260709 12:14:23.374301 32320 raft_consensus.cc:2804] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:23.373696 32338 consensus_queue.cc:260] T 6b89a1496f2c48959a93e4883a24148b P 868ecd261e0249c984eb3d8afacef7e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:23.380431 32338 ts_tablet_manager.cc:1434] T 6b89a1496f2c48959a93e4883a24148b P 868ecd261e0249c984eb3d8afacef7e1: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:14:23.381577 32338 tablet_bootstrap.cc:492] T 15e900af838f4693b1d6f89ddee06965 P 868ecd261e0249c984eb3d8afacef7e1: Bootstrap starting.
I20260709 12:14:23.391814 32320 raft_consensus.cc:697] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2 [term 2 LEADER]: Becoming Leader. State: Replica: 908f087afb9c4a04812368ab534a03b2, State: Running, Role: LEADER
I20260709 12:14:23.392903 32320 consensus_queue.cc:237] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:23.397434 32338 tablet_bootstrap.cc:492] T 15e900af838f4693b1d6f89ddee06965 P 868ecd261e0249c984eb3d8afacef7e1: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:23.398381 32338 tablet_bootstrap.cc:492] T 15e900af838f4693b1d6f89ddee06965 P 868ecd261e0249c984eb3d8afacef7e1: Bootstrap complete.
I20260709 12:14:23.399154 32338 ts_tablet_manager.cc:1403] T 15e900af838f4693b1d6f89ddee06965 P 868ecd261e0249c984eb3d8afacef7e1: Time spent bootstrapping tablet: real 0.018s	user 0.017s	sys 0.000s
I20260709 12:14:23.402029 32372 raft_consensus.cc:3060] T 9ce346322e2f42f08714e116defd9b56 P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:23.402514 32338 raft_consensus.cc:359] T 15e900af838f4693b1d6f89ddee06965 P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:23.403328 32338 raft_consensus.cc:740] T 15e900af838f4693b1d6f89ddee06965 P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 868ecd261e0249c984eb3d8afacef7e1, State: Initialized, Role: FOLLOWER
I20260709 12:14:23.404188 32338 consensus_queue.cc:260] T 15e900af838f4693b1d6f89ddee06965 P 868ecd261e0249c984eb3d8afacef7e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:23.404304 31917 catalog_manager.cc:5697] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2 reported cstate change: term changed from 1 to 2, leader changed from 665d4526e98a4f9898fab4723f981688 (127.20.196.131) to 908f087afb9c4a04812368ab534a03b2 (127.20.196.130). New cstate: current_term: 2 leader_uuid: "908f087afb9c4a04812368ab534a03b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:23.406131 32338 ts_tablet_manager.cc:1434] T 15e900af838f4693b1d6f89ddee06965 P 868ecd261e0249c984eb3d8afacef7e1: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:14:23.407083 32338 tablet_bootstrap.cc:492] T 5cc7453e227a424c8b6645700e8cf4c8 P 868ecd261e0249c984eb3d8afacef7e1: Bootstrap starting.
I20260709 12:14:23.430887 32338 tablet_bootstrap.cc:492] T 5cc7453e227a424c8b6645700e8cf4c8 P 868ecd261e0249c984eb3d8afacef7e1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:23.431824 32338 tablet_bootstrap.cc:492] T 5cc7453e227a424c8b6645700e8cf4c8 P 868ecd261e0249c984eb3d8afacef7e1: Bootstrap complete.
I20260709 12:14:23.432508 32338 ts_tablet_manager.cc:1403] T 5cc7453e227a424c8b6645700e8cf4c8 P 868ecd261e0249c984eb3d8afacef7e1: Time spent bootstrapping tablet: real 0.026s	user 0.022s	sys 0.000s
I20260709 12:14:23.435393 32338 raft_consensus.cc:359] T 5cc7453e227a424c8b6645700e8cf4c8 P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:23.436088 32338 raft_consensus.cc:740] T 5cc7453e227a424c8b6645700e8cf4c8 P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 868ecd261e0249c984eb3d8afacef7e1, State: Initialized, Role: FOLLOWER
I20260709 12:14:23.436831 32338 consensus_queue.cc:260] T 5cc7453e227a424c8b6645700e8cf4c8 P 868ecd261e0249c984eb3d8afacef7e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:23.438946 32338 ts_tablet_manager.cc:1434] T 5cc7453e227a424c8b6645700e8cf4c8 P 868ecd261e0249c984eb3d8afacef7e1: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
W20260709 12:14:23.755920 31969 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:14:23.786558 32320 raft_consensus.cc:993] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 908f087afb9c4a04812368ab534a03b2: : Instructing follower 665d4526e98a4f9898fab4723f981688 to start an election
I20260709 12:14:23.787289 32320 raft_consensus.cc:1081] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 908f087afb9c4a04812368ab534a03b2 [term 1 LEADER]: Signalling peer 665d4526e98a4f9898fab4723f981688 to start an election
I20260709 12:14:23.788800 32170 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "50f879d2e1ef4a1384e7d77f4a3cf7f8"
dest_uuid: "665d4526e98a4f9898fab4723f981688"
 from {username='slave'} at 127.0.0.1:39170
I20260709 12:14:23.789350 32170 raft_consensus.cc:493] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 665d4526e98a4f9898fab4723f981688 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:23.789675 32170 raft_consensus.cc:3060] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 665d4526e98a4f9898fab4723f981688 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:23.795570 32170 raft_consensus.cc:515] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 665d4526e98a4f9898fab4723f981688 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:23.797175 32170 leader_election.cc:290] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 665d4526e98a4f9898fab4723f981688 [CANDIDATE]: Term 2 election: Requested vote from peers 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117), 908f087afb9c4a04812368ab534a03b2 (127.20.196.130:35965)
I20260709 12:14:23.797995 32374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50f879d2e1ef4a1384e7d77f4a3cf7f8" candidate_uuid: "665d4526e98a4f9898fab4723f981688" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "868ecd261e0249c984eb3d8afacef7e1"
I20260709 12:14:23.798202 32098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50f879d2e1ef4a1384e7d77f4a3cf7f8" candidate_uuid: "665d4526e98a4f9898fab4723f981688" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "908f087afb9c4a04812368ab534a03b2"
I20260709 12:14:23.798571 32374 raft_consensus.cc:3060] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:23.798903 32098 raft_consensus.cc:3055] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 908f087afb9c4a04812368ab534a03b2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:23.799273 32098 raft_consensus.cc:740] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 908f087afb9c4a04812368ab534a03b2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 908f087afb9c4a04812368ab534a03b2, State: Running, Role: LEADER
I20260709 12:14:23.799921 32098 consensus_queue.cc:260] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 908f087afb9c4a04812368ab534a03b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:23.800887 32098 raft_consensus.cc:3060] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 908f087afb9c4a04812368ab534a03b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:23.804170 32374 raft_consensus.cc:2468] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 868ecd261e0249c984eb3d8afacef7e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665d4526e98a4f9898fab4723f981688 in term 2.
I20260709 12:14:23.805361 32135 leader_election.cc:304] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 665d4526e98a4f9898fab4723f981688 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 665d4526e98a4f9898fab4723f981688, 868ecd261e0249c984eb3d8afacef7e1; no voters: 
I20260709 12:14:23.806143 32314 raft_consensus.cc:2804] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 665d4526e98a4f9898fab4723f981688 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:23.806600 32314 raft_consensus.cc:697] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 665d4526e98a4f9898fab4723f981688 [term 2 LEADER]: Becoming Leader. State: Replica: 665d4526e98a4f9898fab4723f981688, State: Running, Role: LEADER
I20260709 12:14:23.807410 32314 consensus_queue.cc:237] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 665d4526e98a4f9898fab4723f981688 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:23.807686 32098 raft_consensus.cc:2468] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 908f087afb9c4a04812368ab534a03b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665d4526e98a4f9898fab4723f981688 in term 2.
I20260709 12:14:23.809322 32374 raft_consensus.cc:1275] T 496807cff0764aed8aac43768f03db67 P 868ecd261e0249c984eb3d8afacef7e1 [term 2 FOLLOWER]: Refusing update from remote peer 908f087afb9c4a04812368ab534a03b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:23.810750 32320 consensus_queue.cc:1048] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:23.814869 31918 catalog_manager.cc:5697] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 665d4526e98a4f9898fab4723f981688 reported cstate change: term changed from 1 to 2, leader changed from 908f087afb9c4a04812368ab534a03b2 (127.20.196.130) to 665d4526e98a4f9898fab4723f981688 (127.20.196.131). New cstate: current_term: 2 leader_uuid: "665d4526e98a4f9898fab4723f981688" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:23.820952 32193 debug-util.cc:398] Leaking SignalData structure 0x7b0800266840 after lost signal to thread 21269
I20260709 12:14:23.828764 32170 raft_consensus.cc:1275] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [term 2 FOLLOWER]: Refusing update from remote peer 908f087afb9c4a04812368ab534a03b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:23.832683 32313 raft_consensus.cc:993] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688: : Instructing follower 908f087afb9c4a04812368ab534a03b2 to start an election
I20260709 12:14:23.832846 32416 consensus_queue.cc:1048] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:23.833165 32313 raft_consensus.cc:1081] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [term 1 LEADER]: Signalling peer 908f087afb9c4a04812368ab534a03b2 to start an election
I20260709 12:14:23.834942 32098 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "823ba3672286465bab521797c8fc296d"
dest_uuid: "908f087afb9c4a04812368ab534a03b2"
 from {username='slave'} at 127.0.0.1:60672
I20260709 12:14:23.835455 32098 raft_consensus.cc:493] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:23.835762 32098 raft_consensus.cc:3060] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:23.841526 32098 raft_consensus.cc:515] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:23.843490 32098 leader_election.cc:290] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2 [CANDIDATE]: Term 2 election: Requested vote from peers 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117), 665d4526e98a4f9898fab4723f981688 (127.20.196.131:34699)
I20260709 12:14:23.844455 32374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823ba3672286465bab521797c8fc296d" candidate_uuid: "908f087afb9c4a04812368ab534a03b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "868ecd261e0249c984eb3d8afacef7e1"
I20260709 12:14:23.845081 32374 raft_consensus.cc:3060] T 823ba3672286465bab521797c8fc296d P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:23.845872 32172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823ba3672286465bab521797c8fc296d" candidate_uuid: "908f087afb9c4a04812368ab534a03b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "665d4526e98a4f9898fab4723f981688"
I20260709 12:14:23.846472 32172 raft_consensus.cc:3055] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:23.846764 32172 raft_consensus.cc:740] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 665d4526e98a4f9898fab4723f981688, State: Running, Role: LEADER
I20260709 12:14:23.847605 32172 consensus_queue.cc:260] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:23.848877 32172 raft_consensus.cc:3060] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:23.852386 32374 raft_consensus.cc:2468] T 823ba3672286465bab521797c8fc296d P 868ecd261e0249c984eb3d8afacef7e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 908f087afb9c4a04812368ab534a03b2 in term 2.
I20260709 12:14:23.853710 32061 leader_election.cc:304] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868ecd261e0249c984eb3d8afacef7e1, 908f087afb9c4a04812368ab534a03b2; no voters: 
I20260709 12:14:23.855160 32416 raft_consensus.cc:2804] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:23.855640 32416 raft_consensus.cc:697] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2 [term 2 LEADER]: Becoming Leader. State: Replica: 908f087afb9c4a04812368ab534a03b2, State: Running, Role: LEADER
I20260709 12:14:23.856431 32416 consensus_queue.cc:237] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:23.859629 32172 raft_consensus.cc:2468] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 908f087afb9c4a04812368ab534a03b2 in term 2.
I20260709 12:14:23.865370 31917 catalog_manager.cc:5697] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2 reported cstate change: term changed from 1 to 2, leader changed from 665d4526e98a4f9898fab4723f981688 (127.20.196.131) to 908f087afb9c4a04812368ab534a03b2 (127.20.196.130). New cstate: current_term: 2 leader_uuid: "908f087afb9c4a04812368ab534a03b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:24.279305 32374 raft_consensus.cc:1275] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 868ecd261e0249c984eb3d8afacef7e1 [term 2 FOLLOWER]: Refusing update from remote peer 665d4526e98a4f9898fab4723f981688: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:24.280405 32098 raft_consensus.cc:1275] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 908f087afb9c4a04812368ab534a03b2 [term 2 FOLLOWER]: Refusing update from remote peer 665d4526e98a4f9898fab4723f981688: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:24.280764 32319 consensus_queue.cc:1048] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 665d4526e98a4f9898fab4723f981688 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:24.282491 32313 consensus_queue.cc:1048] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 665d4526e98a4f9898fab4723f981688 [LEADER]: Connected to new peer: Peer: permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:24.314867 32374 raft_consensus.cc:1275] T 823ba3672286465bab521797c8fc296d P 868ecd261e0249c984eb3d8afacef7e1 [term 2 FOLLOWER]: Refusing update from remote peer 908f087afb9c4a04812368ab534a03b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:24.316588 32416 consensus_queue.cc:1048] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:24.325256 32172 raft_consensus.cc:1275] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [term 2 FOLLOWER]: Refusing update from remote peer 908f087afb9c4a04812368ab534a03b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:24.327270 32417 consensus_queue.cc:1048] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:24.372725 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:24.380587 32170 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15e900af838f4693b1d6f89ddee06965"
dest_uuid: "665d4526e98a4f9898fab4723f981688"
mode: GRACEFUL
new_leader_uuid: "908f087afb9c4a04812368ab534a03b2"
 from {username='slave'} at 127.0.0.1:39180
I20260709 12:14:24.381335 32170 raft_consensus.cc:606] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688 [term 1 LEADER]: Received request to transfer leadership to TS 908f087afb9c4a04812368ab534a03b2
I20260709 12:14:24.384488 32098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "496807cff0764aed8aac43768f03db67"
dest_uuid: "908f087afb9c4a04812368ab534a03b2"
mode: GRACEFUL
new_leader_uuid: "665d4526e98a4f9898fab4723f981688"
 from {username='slave'} at 127.0.0.1:60686
I20260709 12:14:24.385151 32098 raft_consensus.cc:606] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2 [term 2 LEADER]: Received request to transfer leadership to TS 665d4526e98a4f9898fab4723f981688
I20260709 12:14:24.388006 32098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5cc7453e227a424c8b6645700e8cf4c8"
dest_uuid: "908f087afb9c4a04812368ab534a03b2"
mode: GRACEFUL
new_leader_uuid: "665d4526e98a4f9898fab4723f981688"
 from {username='slave'} at 127.0.0.1:60686
I20260709 12:14:24.388599 32098 raft_consensus.cc:606] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 [term 1 LEADER]: Received request to transfer leadership to TS 665d4526e98a4f9898fab4723f981688
I20260709 12:14:24.389832 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:14:24.390380 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:24.391081 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:14:24.757702 31969 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:14:24.771325 32417 raft_consensus.cc:993] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2: : Instructing follower 665d4526e98a4f9898fab4723f981688 to start an election
I20260709 12:14:24.771886 32435 raft_consensus.cc:993] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2: : Instructing follower 665d4526e98a4f9898fab4723f981688 to start an election
I20260709 12:14:24.772395 32416 raft_consensus.cc:1081] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 [term 1 LEADER]: Signalling peer 665d4526e98a4f9898fab4723f981688 to start an election
I20260709 12:14:24.772696 32417 raft_consensus.cc:1081] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2 [term 2 LEADER]: Signalling peer 665d4526e98a4f9898fab4723f981688 to start an election
I20260709 12:14:24.774861 32172 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5cc7453e227a424c8b6645700e8cf4c8"
dest_uuid: "665d4526e98a4f9898fab4723f981688"
 from {username='slave'} at 127.0.0.1:39170
I20260709 12:14:24.775331 32170 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "496807cff0764aed8aac43768f03db67"
dest_uuid: "665d4526e98a4f9898fab4723f981688"
 from {username='slave'} at 127.0.0.1:39170
I20260709 12:14:24.776079 32172 raft_consensus.cc:493] T 5cc7453e227a424c8b6645700e8cf4c8 P 665d4526e98a4f9898fab4723f981688 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:24.776218 32170 raft_consensus.cc:493] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:24.776693 32172 raft_consensus.cc:3060] T 5cc7453e227a424c8b6645700e8cf4c8 P 665d4526e98a4f9898fab4723f981688 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:24.776813 32170 raft_consensus.cc:3060] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:24.788857 32172 raft_consensus.cc:515] T 5cc7453e227a424c8b6645700e8cf4c8 P 665d4526e98a4f9898fab4723f981688 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:24.790063 32170 raft_consensus.cc:515] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:24.792313 32372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cc7453e227a424c8b6645700e8cf4c8" candidate_uuid: "665d4526e98a4f9898fab4723f981688" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "868ecd261e0249c984eb3d8afacef7e1"
I20260709 12:14:24.792609 32170 leader_election.cc:290] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [CANDIDATE]: Term 3 election: Requested vote from peers 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117), 908f087afb9c4a04812368ab534a03b2 (127.20.196.130:35965)
I20260709 12:14:24.793565 32372 raft_consensus.cc:3060] T 5cc7453e227a424c8b6645700e8cf4c8 P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:24.796197 32096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496807cff0764aed8aac43768f03db67" candidate_uuid: "665d4526e98a4f9898fab4723f981688" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "908f087afb9c4a04812368ab534a03b2"
I20260709 12:14:24.797060 32096 raft_consensus.cc:3055] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:24.797469 32096 raft_consensus.cc:740] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 908f087afb9c4a04812368ab534a03b2, State: Running, Role: LEADER
I20260709 12:14:24.798763 32096 consensus_queue.cc:260] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:24.792780 32098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cc7453e227a424c8b6645700e8cf4c8" candidate_uuid: "665d4526e98a4f9898fab4723f981688" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "908f087afb9c4a04812368ab534a03b2"
I20260709 12:14:24.801752 32172 leader_election.cc:290] T 5cc7453e227a424c8b6645700e8cf4c8 P 665d4526e98a4f9898fab4723f981688 [CANDIDATE]: Term 2 election: Requested vote from peers 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117), 908f087afb9c4a04812368ab534a03b2 (127.20.196.130:35965)
I20260709 12:14:24.803068 32098 raft_consensus.cc:3055] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:24.803766 32098 raft_consensus.cc:740] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 908f087afb9c4a04812368ab534a03b2, State: Running, Role: LEADER
I20260709 12:14:24.804008 32374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496807cff0764aed8aac43768f03db67" candidate_uuid: "665d4526e98a4f9898fab4723f981688" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "868ecd261e0249c984eb3d8afacef7e1"
I20260709 12:14:24.805034 32374 raft_consensus.cc:3060] T 496807cff0764aed8aac43768f03db67 P 868ecd261e0249c984eb3d8afacef7e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:24.801630 32096 raft_consensus.cc:3060] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:24.805343 32098 consensus_queue.cc:260] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:24.807345 32098 raft_consensus.cc:3060] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:24.820524 32374 raft_consensus.cc:2468] T 496807cff0764aed8aac43768f03db67 P 868ecd261e0249c984eb3d8afacef7e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665d4526e98a4f9898fab4723f981688 in term 3.
I20260709 12:14:24.825800 32096 raft_consensus.cc:2468] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665d4526e98a4f9898fab4723f981688 in term 3.
I20260709 12:14:24.828190 32136 leader_election.cc:304] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 665d4526e98a4f9898fab4723f981688, 908f087afb9c4a04812368ab534a03b2; no voters: 
I20260709 12:14:24.830309 32313 raft_consensus.cc:2804] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:24.843317 32372 raft_consensus.cc:2468] T 5cc7453e227a424c8b6645700e8cf4c8 P 868ecd261e0249c984eb3d8afacef7e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665d4526e98a4f9898fab4723f981688 in term 2.
I20260709 12:14:24.832204 32098 raft_consensus.cc:2468] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665d4526e98a4f9898fab4723f981688 in term 2.
I20260709 12:14:24.845103 32135 leader_election.cc:304] T 5cc7453e227a424c8b6645700e8cf4c8 P 665d4526e98a4f9898fab4723f981688 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 665d4526e98a4f9898fab4723f981688, 868ecd261e0249c984eb3d8afacef7e1; no voters: 
I20260709 12:14:24.857092 32439 raft_consensus.cc:2804] T 5cc7453e227a424c8b6645700e8cf4c8 P 665d4526e98a4f9898fab4723f981688 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:24.857712 32313 raft_consensus.cc:697] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [term 3 LEADER]: Becoming Leader. State: Replica: 665d4526e98a4f9898fab4723f981688, State: Running, Role: LEADER
I20260709 12:14:24.858135 32442 raft_consensus.cc:993] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688: : Instructing follower 908f087afb9c4a04812368ab534a03b2 to start an election
I20260709 12:14:24.859447 32439 raft_consensus.cc:697] T 5cc7453e227a424c8b6645700e8cf4c8 P 665d4526e98a4f9898fab4723f981688 [term 2 LEADER]: Becoming Leader. State: Replica: 665d4526e98a4f9898fab4723f981688, State: Running, Role: LEADER
I20260709 12:14:24.860445 32442 raft_consensus.cc:1081] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688 [term 1 LEADER]: Signalling peer 908f087afb9c4a04812368ab534a03b2 to start an election
I20260709 12:14:24.860769 32439 consensus_queue.cc:237] T 5cc7453e227a424c8b6645700e8cf4c8 P 665d4526e98a4f9898fab4723f981688 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:24.860517 32313 consensus_queue.cc:237] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:24.870018 32098 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15e900af838f4693b1d6f89ddee06965"
dest_uuid: "908f087afb9c4a04812368ab534a03b2"
 from {username='slave'} at 127.0.0.1:60672
I20260709 12:14:24.870699 32098 raft_consensus.cc:493] T 15e900af838f4693b1d6f89ddee06965 P 908f087afb9c4a04812368ab534a03b2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:24.871137 32098 raft_consensus.cc:3060] T 15e900af838f4693b1d6f89ddee06965 P 908f087afb9c4a04812368ab534a03b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:24.879887 32098 raft_consensus.cc:515] T 15e900af838f4693b1d6f89ddee06965 P 908f087afb9c4a04812368ab534a03b2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:24.879284 31917 catalog_manager.cc:5697] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 reported cstate change: term changed from 2 to 3, leader changed from 908f087afb9c4a04812368ab534a03b2 (127.20.196.130) to 665d4526e98a4f9898fab4723f981688 (127.20.196.131). New cstate: current_term: 3 leader_uuid: "665d4526e98a4f9898fab4723f981688" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:24.883126 32374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e900af838f4693b1d6f89ddee06965" candidate_uuid: "908f087afb9c4a04812368ab534a03b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "868ecd261e0249c984eb3d8afacef7e1"
I20260709 12:14:24.883301 32098 leader_election.cc:290] T 15e900af838f4693b1d6f89ddee06965 P 908f087afb9c4a04812368ab534a03b2 [CANDIDATE]: Term 2 election: Requested vote from peers 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117), 665d4526e98a4f9898fab4723f981688 (127.20.196.131:34699)
I20260709 12:14:24.883855 32374 raft_consensus.cc:3060] T 15e900af838f4693b1d6f89ddee06965 P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:24.888470 32172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e900af838f4693b1d6f89ddee06965" candidate_uuid: "908f087afb9c4a04812368ab534a03b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "665d4526e98a4f9898fab4723f981688"
I20260709 12:14:24.889114 32172 raft_consensus.cc:3055] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:24.889456 32172 raft_consensus.cc:740] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 665d4526e98a4f9898fab4723f981688, State: Running, Role: LEADER
I20260709 12:14:24.890503 32172 consensus_queue.cc:260] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:24.892005 32172 raft_consensus.cc:3060] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:24.895953 32374 raft_consensus.cc:2468] T 15e900af838f4693b1d6f89ddee06965 P 868ecd261e0249c984eb3d8afacef7e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 908f087afb9c4a04812368ab534a03b2 in term 2.
I20260709 12:14:24.897626 32061 leader_election.cc:304] T 15e900af838f4693b1d6f89ddee06965 P 908f087afb9c4a04812368ab534a03b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868ecd261e0249c984eb3d8afacef7e1, 908f087afb9c4a04812368ab534a03b2; no voters: 
I20260709 12:14:24.898636 32435 raft_consensus.cc:2804] T 15e900af838f4693b1d6f89ddee06965 P 908f087afb9c4a04812368ab534a03b2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:24.899137 32435 raft_consensus.cc:697] T 15e900af838f4693b1d6f89ddee06965 P 908f087afb9c4a04812368ab534a03b2 [term 2 LEADER]: Becoming Leader. State: Replica: 908f087afb9c4a04812368ab534a03b2, State: Running, Role: LEADER
I20260709 12:14:24.899523 32172 raft_consensus.cc:2468] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 908f087afb9c4a04812368ab534a03b2 in term 2.
I20260709 12:14:24.901430 32435 consensus_queue.cc:237] T 15e900af838f4693b1d6f89ddee06965 P 908f087afb9c4a04812368ab534a03b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:24.912719 31918 catalog_manager.cc:5697] T 15e900af838f4693b1d6f89ddee06965 P 908f087afb9c4a04812368ab534a03b2 reported cstate change: term changed from 1 to 2, leader changed from 665d4526e98a4f9898fab4723f981688 (127.20.196.131) to 908f087afb9c4a04812368ab534a03b2 (127.20.196.130). New cstate: current_term: 2 leader_uuid: "908f087afb9c4a04812368ab534a03b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:24.917363 31917 catalog_manager.cc:5697] T 5cc7453e227a424c8b6645700e8cf4c8 P 665d4526e98a4f9898fab4723f981688 reported cstate change: term changed from 1 to 2, leader changed from 908f087afb9c4a04812368ab534a03b2 (127.20.196.130) to 665d4526e98a4f9898fab4723f981688 (127.20.196.131). New cstate: current_term: 2 leader_uuid: "665d4526e98a4f9898fab4723f981688" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:25.249164 32098 raft_consensus.cc:1275] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 [term 2 FOLLOWER]: Refusing update from remote peer 665d4526e98a4f9898fab4723f981688: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:25.250656 32439 consensus_queue.cc:1048] T 5cc7453e227a424c8b6645700e8cf4c8 P 665d4526e98a4f9898fab4723f981688 [LEADER]: Connected to new peer: Peer: permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:25.264887 32374 raft_consensus.cc:1275] T 5cc7453e227a424c8b6645700e8cf4c8 P 868ecd261e0249c984eb3d8afacef7e1 [term 2 FOLLOWER]: Refusing update from remote peer 665d4526e98a4f9898fab4723f981688: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:25.266415 32439 consensus_queue.cc:1048] T 5cc7453e227a424c8b6645700e8cf4c8 P 665d4526e98a4f9898fab4723f981688 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:25.310607 32374 raft_consensus.cc:1275] T 15e900af838f4693b1d6f89ddee06965 P 868ecd261e0249c984eb3d8afacef7e1 [term 2 FOLLOWER]: Refusing update from remote peer 908f087afb9c4a04812368ab534a03b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:25.312075 32435 consensus_queue.cc:1048] T 15e900af838f4693b1d6f89ddee06965 P 908f087afb9c4a04812368ab534a03b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:25.325736 32172 raft_consensus.cc:1275] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688 [term 2 FOLLOWER]: Refusing update from remote peer 908f087afb9c4a04812368ab534a03b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:25.328023 32417 consensus_queue.cc:1048] T 15e900af838f4693b1d6f89ddee06965 P 908f087afb9c4a04812368ab534a03b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:25.328217 32374 raft_consensus.cc:1275] T 496807cff0764aed8aac43768f03db67 P 868ecd261e0249c984eb3d8afacef7e1 [term 3 FOLLOWER]: Refusing update from remote peer 665d4526e98a4f9898fab4723f981688: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:25.330551 32439 consensus_queue.cc:1048] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:25.356868 32098 raft_consensus.cc:1275] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2 [term 3 FOLLOWER]: Refusing update from remote peer 665d4526e98a4f9898fab4723f981688: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:25.358587 32440 consensus_queue.cc:1048] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [LEADER]: Connected to new peer: Peer: permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:25.398556 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:25.409392 32172 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "496807cff0764aed8aac43768f03db67"
dest_uuid: "665d4526e98a4f9898fab4723f981688"
mode: GRACEFUL
new_leader_uuid: "908f087afb9c4a04812368ab534a03b2"
 from {username='slave'} at 127.0.0.1:39180
I20260709 12:14:25.410291 32172 raft_consensus.cc:606] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [term 3 LEADER]: Received request to transfer leadership to TS 908f087afb9c4a04812368ab534a03b2
I20260709 12:14:25.413683 32098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "823ba3672286465bab521797c8fc296d"
dest_uuid: "908f087afb9c4a04812368ab534a03b2"
mode: GRACEFUL
new_leader_uuid: "665d4526e98a4f9898fab4723f981688"
 from {username='slave'} at 127.0.0.1:60686
I20260709 12:14:25.414278 32098 raft_consensus.cc:606] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2 [term 2 LEADER]: Received request to transfer leadership to TS 665d4526e98a4f9898fab4723f981688
I20260709 12:14:25.417383 32172 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa412a4ecaeb4b1b87bb9d9175e8fdc4"
dest_uuid: "665d4526e98a4f9898fab4723f981688"
mode: GRACEFUL
new_leader_uuid: "908f087afb9c4a04812368ab534a03b2"
 from {username='slave'} at 127.0.0.1:39180
I20260709 12:14:25.418083 32172 raft_consensus.cc:606] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 665d4526e98a4f9898fab4723f981688 [term 1 LEADER]: Received request to transfer leadership to TS 908f087afb9c4a04812368ab534a03b2
I20260709 12:14:25.419530 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:14:25.420284 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:25.420315 32417 raft_consensus.cc:993] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2: : Instructing follower 665d4526e98a4f9898fab4723f981688 to start an election
I20260709 12:14:25.421059 32416 raft_consensus.cc:1081] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2 [term 2 LEADER]: Signalling peer 665d4526e98a4f9898fab4723f981688 to start an election
I20260709 12:14:25.421448 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:25.422915 32172 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "823ba3672286465bab521797c8fc296d"
dest_uuid: "665d4526e98a4f9898fab4723f981688"
 from {username='slave'} at 127.0.0.1:39170
I20260709 12:14:25.423596 32172 raft_consensus.cc:493] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:25.423969 32172 raft_consensus.cc:3060] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:25.429929 32172 raft_consensus.cc:515] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:25.431649 32172 leader_election.cc:290] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [CANDIDATE]: Term 3 election: Requested vote from peers 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117), 908f087afb9c4a04812368ab534a03b2 (127.20.196.130:35965)
I20260709 12:14:25.432548 32372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823ba3672286465bab521797c8fc296d" candidate_uuid: "665d4526e98a4f9898fab4723f981688" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "868ecd261e0249c984eb3d8afacef7e1"
I20260709 12:14:25.433197 32372 raft_consensus.cc:3060] T 823ba3672286465bab521797c8fc296d P 868ecd261e0249c984eb3d8afacef7e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:25.436216 32098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823ba3672286465bab521797c8fc296d" candidate_uuid: "665d4526e98a4f9898fab4723f981688" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "908f087afb9c4a04812368ab534a03b2"
I20260709 12:14:25.436942 32098 raft_consensus.cc:3055] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:25.437309 32098 raft_consensus.cc:740] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 908f087afb9c4a04812368ab534a03b2, State: Running, Role: LEADER
I20260709 12:14:25.438318 32098 consensus_queue.cc:260] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:25.439946 32098 raft_consensus.cc:3060] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:25.440310 32372 raft_consensus.cc:2468] T 823ba3672286465bab521797c8fc296d P 868ecd261e0249c984eb3d8afacef7e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665d4526e98a4f9898fab4723f981688 in term 3.
I20260709 12:14:25.441839 32135 leader_election.cc:304] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 665d4526e98a4f9898fab4723f981688, 868ecd261e0249c984eb3d8afacef7e1; no voters: 
I20260709 12:14:25.442724 32440 raft_consensus.cc:2804] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:25.443265 32440 raft_consensus.cc:697] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [term 3 LEADER]: Becoming Leader. State: Replica: 665d4526e98a4f9898fab4723f981688, State: Running, Role: LEADER
I20260709 12:14:25.444319 32440 consensus_queue.cc:237] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:25.446914 32098 raft_consensus.cc:2468] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665d4526e98a4f9898fab4723f981688 in term 3.
I20260709 12:14:25.453642 31918 catalog_manager.cc:5697] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 reported cstate change: term changed from 2 to 3, leader changed from 908f087afb9c4a04812368ab534a03b2 (127.20.196.130) to 665d4526e98a4f9898fab4723f981688 (127.20.196.131). New cstate: current_term: 3 leader_uuid: "665d4526e98a4f9898fab4723f981688" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:25.729729 32442 raft_consensus.cc:993] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 665d4526e98a4f9898fab4723f981688: : Instructing follower 908f087afb9c4a04812368ab534a03b2 to start an election
I20260709 12:14:25.730278 32440 raft_consensus.cc:1081] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 665d4526e98a4f9898fab4723f981688 [term 1 LEADER]: Signalling peer 908f087afb9c4a04812368ab534a03b2 to start an election
I20260709 12:14:25.731910 32098 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa412a4ecaeb4b1b87bb9d9175e8fdc4"
dest_uuid: "908f087afb9c4a04812368ab534a03b2"
 from {username='slave'} at 127.0.0.1:60672
I20260709 12:14:25.732447 32098 raft_consensus.cc:493] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 908f087afb9c4a04812368ab534a03b2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:25.732828 32098 raft_consensus.cc:3060] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 908f087afb9c4a04812368ab534a03b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:25.741058 32098 raft_consensus.cc:515] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 908f087afb9c4a04812368ab534a03b2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:25.743496 32098 leader_election.cc:290] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 908f087afb9c4a04812368ab534a03b2 [CANDIDATE]: Term 2 election: Requested vote from peers 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117), 665d4526e98a4f9898fab4723f981688 (127.20.196.131:34699)
I20260709 12:14:25.744009 32172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa412a4ecaeb4b1b87bb9d9175e8fdc4" candidate_uuid: "908f087afb9c4a04812368ab534a03b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "665d4526e98a4f9898fab4723f981688"
I20260709 12:14:25.744630 32172 raft_consensus.cc:3055] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 665d4526e98a4f9898fab4723f981688 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:25.744913 32172 raft_consensus.cc:740] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 665d4526e98a4f9898fab4723f981688 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 665d4526e98a4f9898fab4723f981688, State: Running, Role: LEADER
I20260709 12:14:25.745169 32372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa412a4ecaeb4b1b87bb9d9175e8fdc4" candidate_uuid: "908f087afb9c4a04812368ab534a03b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "868ecd261e0249c984eb3d8afacef7e1"
I20260709 12:14:25.745826 32372 raft_consensus.cc:3060] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:25.745828 32172 consensus_queue.cc:260] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 665d4526e98a4f9898fab4723f981688 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:25.747470 32172 raft_consensus.cc:3060] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 665d4526e98a4f9898fab4723f981688 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:25.752952 32372 raft_consensus.cc:2468] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 868ecd261e0249c984eb3d8afacef7e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 908f087afb9c4a04812368ab534a03b2 in term 2.
I20260709 12:14:25.754168 32061 leader_election.cc:304] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 908f087afb9c4a04812368ab534a03b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868ecd261e0249c984eb3d8afacef7e1, 908f087afb9c4a04812368ab534a03b2; no voters: 
I20260709 12:14:25.755353 32416 raft_consensus.cc:2804] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 908f087afb9c4a04812368ab534a03b2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:25.755909 32416 raft_consensus.cc:697] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 908f087afb9c4a04812368ab534a03b2 [term 2 LEADER]: Becoming Leader. State: Replica: 908f087afb9c4a04812368ab534a03b2, State: Running, Role: LEADER
I20260709 12:14:25.756871 32416 consensus_queue.cc:237] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 908f087afb9c4a04812368ab534a03b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:25.757376 32172 raft_consensus.cc:2468] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 665d4526e98a4f9898fab4723f981688 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 908f087afb9c4a04812368ab534a03b2 in term 2.
W20260709 12:14:25.759155 31969 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:14:25.765853 31918 catalog_manager.cc:5697] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 908f087afb9c4a04812368ab534a03b2 reported cstate change: term changed from 1 to 2, leader changed from 665d4526e98a4f9898fab4723f981688 (127.20.196.131) to 908f087afb9c4a04812368ab534a03b2 (127.20.196.130). New cstate: current_term: 2 leader_uuid: "908f087afb9c4a04812368ab534a03b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:25.777427 32440 raft_consensus.cc:993] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688: : Instructing follower 908f087afb9c4a04812368ab534a03b2 to start an election
I20260709 12:14:25.777961 32442 raft_consensus.cc:1081] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [term 3 LEADER]: Signalling peer 908f087afb9c4a04812368ab534a03b2 to start an election
I20260709 12:14:25.779582 32098 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "496807cff0764aed8aac43768f03db67"
dest_uuid: "908f087afb9c4a04812368ab534a03b2"
 from {username='slave'} at 127.0.0.1:60672
I20260709 12:14:25.780571 32098 raft_consensus.cc:493] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:25.780967 32098 raft_consensus.cc:3060] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:25.789125 32098 raft_consensus.cc:515] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:25.791462 32098 leader_election.cc:290] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2 [CANDIDATE]: Term 4 election: Requested vote from peers 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117), 665d4526e98a4f9898fab4723f981688 (127.20.196.131:34699)
I20260709 12:14:25.792232 32372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496807cff0764aed8aac43768f03db67" candidate_uuid: "908f087afb9c4a04812368ab534a03b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "868ecd261e0249c984eb3d8afacef7e1"
I20260709 12:14:25.792601 32172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496807cff0764aed8aac43768f03db67" candidate_uuid: "908f087afb9c4a04812368ab534a03b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "665d4526e98a4f9898fab4723f981688"
I20260709 12:14:25.792889 32372 raft_consensus.cc:3060] T 496807cff0764aed8aac43768f03db67 P 868ecd261e0249c984eb3d8afacef7e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:25.793246 32172 raft_consensus.cc:3055] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:25.793596 32172 raft_consensus.cc:740] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 665d4526e98a4f9898fab4723f981688, State: Running, Role: LEADER
I20260709 12:14:25.794366 32172 consensus_queue.cc:260] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:25.795686 32172 raft_consensus.cc:3060] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:25.799607 32372 raft_consensus.cc:2468] T 496807cff0764aed8aac43768f03db67 P 868ecd261e0249c984eb3d8afacef7e1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 908f087afb9c4a04812368ab534a03b2 in term 4.
I20260709 12:14:25.800894 32061 leader_election.cc:304] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868ecd261e0249c984eb3d8afacef7e1, 908f087afb9c4a04812368ab534a03b2; no voters: 
I20260709 12:14:25.801746 32416 raft_consensus.cc:2804] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:25.802258 32416 raft_consensus.cc:697] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2 [term 4 LEADER]: Becoming Leader. State: Replica: 908f087afb9c4a04812368ab534a03b2, State: Running, Role: LEADER
I20260709 12:14:25.803169 32416 consensus_queue.cc:237] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:25.805893 32172 raft_consensus.cc:2468] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 908f087afb9c4a04812368ab534a03b2 in term 4.
I20260709 12:14:25.813241 31918 catalog_manager.cc:5697] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2 reported cstate change: term changed from 3 to 4, leader changed from 665d4526e98a4f9898fab4723f981688 (127.20.196.131) to 908f087afb9c4a04812368ab534a03b2 (127.20.196.130). New cstate: current_term: 4 leader_uuid: "908f087afb9c4a04812368ab534a03b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:25.845408 32374 raft_consensus.cc:1275] T 823ba3672286465bab521797c8fc296d P 868ecd261e0249c984eb3d8afacef7e1 [term 3 FOLLOWER]: Refusing update from remote peer 665d4526e98a4f9898fab4723f981688: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:25.846869 32442 consensus_queue.cc:1048] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:25.859184 32098 raft_consensus.cc:1275] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2 [term 3 FOLLOWER]: Refusing update from remote peer 665d4526e98a4f9898fab4723f981688: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:25.860816 32440 consensus_queue.cc:1048] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [LEADER]: Connected to new peer: Peer: permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:26.275956 32172 raft_consensus.cc:1275] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [term 4 FOLLOWER]: Refusing update from remote peer 908f087afb9c4a04812368ab534a03b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:14:26.277076 32417 consensus_queue.cc:1048] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:26.284739 32374 raft_consensus.cc:1275] T 496807cff0764aed8aac43768f03db67 P 868ecd261e0249c984eb3d8afacef7e1 [term 4 FOLLOWER]: Refusing update from remote peer 908f087afb9c4a04812368ab534a03b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:14:26.288525 32435 consensus_queue.cc:1048] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:26.324905 32374 raft_consensus.cc:1275] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 868ecd261e0249c984eb3d8afacef7e1 [term 2 FOLLOWER]: Refusing update from remote peer 908f087afb9c4a04812368ab534a03b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:26.326474 32417 consensus_queue.cc:1048] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 908f087afb9c4a04812368ab534a03b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:26.343462 32172 raft_consensus.cc:1275] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 665d4526e98a4f9898fab4723f981688 [term 2 FOLLOWER]: Refusing update from remote peer 908f087afb9c4a04812368ab534a03b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:26.344877 32465 consensus_queue.cc:1048] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 908f087afb9c4a04812368ab534a03b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:26.433902 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:26.445314 32098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37a856e5a8fa4b3d9fee7d843a26ef4a"
dest_uuid: "908f087afb9c4a04812368ab534a03b2"
mode: GRACEFUL
new_leader_uuid: "665d4526e98a4f9898fab4723f981688"
 from {username='slave'} at 127.0.0.1:60686
I20260709 12:14:26.445901 32098 raft_consensus.cc:606] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 908f087afb9c4a04812368ab534a03b2 [term 1 LEADER]: Received request to transfer leadership to TS 665d4526e98a4f9898fab4723f981688
I20260709 12:14:26.448731 32172 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5cc7453e227a424c8b6645700e8cf4c8"
dest_uuid: "665d4526e98a4f9898fab4723f981688"
mode: GRACEFUL
new_leader_uuid: "908f087afb9c4a04812368ab534a03b2"
 from {username='slave'} at 127.0.0.1:39180
I20260709 12:14:26.449329 32172 raft_consensus.cc:606] T 5cc7453e227a424c8b6645700e8cf4c8 P 665d4526e98a4f9898fab4723f981688 [term 2 LEADER]: Received request to transfer leadership to TS 908f087afb9c4a04812368ab534a03b2
I20260709 12:14:26.452052 32098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ce346322e2f42f08714e116defd9b56"
dest_uuid: "908f087afb9c4a04812368ab534a03b2"
mode: GRACEFUL
new_leader_uuid: "665d4526e98a4f9898fab4723f981688"
 from {username='slave'} at 127.0.0.1:60686
I20260709 12:14:26.452531 32098 raft_consensus.cc:606] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 [term 2 LEADER]: Received request to transfer leadership to TS 665d4526e98a4f9898fab4723f981688
I20260709 12:14:26.453794 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:14:26.454281 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:26.454836 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:26.515257 32435 raft_consensus.cc:993] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 908f087afb9c4a04812368ab534a03b2: : Instructing follower 665d4526e98a4f9898fab4723f981688 to start an election
I20260709 12:14:26.515864 32465 raft_consensus.cc:1081] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 908f087afb9c4a04812368ab534a03b2 [term 1 LEADER]: Signalling peer 665d4526e98a4f9898fab4723f981688 to start an election
I20260709 12:14:26.517612 32172 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37a856e5a8fa4b3d9fee7d843a26ef4a"
dest_uuid: "665d4526e98a4f9898fab4723f981688"
 from {username='slave'} at 127.0.0.1:39170
I20260709 12:14:26.518105 32172 raft_consensus.cc:493] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 665d4526e98a4f9898fab4723f981688 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:26.518414 32172 raft_consensus.cc:3060] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 665d4526e98a4f9898fab4723f981688 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:26.523267 32172 raft_consensus.cc:515] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 665d4526e98a4f9898fab4723f981688 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } }
I20260709 12:14:26.524812 32172 leader_election.cc:290] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 665d4526e98a4f9898fab4723f981688 [CANDIDATE]: Term 2 election: Requested vote from peers 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117), 908f087afb9c4a04812368ab534a03b2 (127.20.196.130:35965)
I20260709 12:14:26.526088 32098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a856e5a8fa4b3d9fee7d843a26ef4a" candidate_uuid: "665d4526e98a4f9898fab4723f981688" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "908f087afb9c4a04812368ab534a03b2"
I20260709 12:14:26.525918 32374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a856e5a8fa4b3d9fee7d843a26ef4a" candidate_uuid: "665d4526e98a4f9898fab4723f981688" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "868ecd261e0249c984eb3d8afacef7e1"
I20260709 12:14:26.526695 32098 raft_consensus.cc:3055] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 908f087afb9c4a04812368ab534a03b2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:26.526747 32374 raft_consensus.cc:3060] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:26.527190 32098 raft_consensus.cc:740] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 908f087afb9c4a04812368ab534a03b2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 908f087afb9c4a04812368ab534a03b2, State: Running, Role: LEADER
I20260709 12:14:26.528230 32098 consensus_queue.cc:260] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 908f087afb9c4a04812368ab534a03b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } }
I20260709 12:14:26.529644 32098 raft_consensus.cc:3060] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 908f087afb9c4a04812368ab534a03b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:26.535145 32374 raft_consensus.cc:2468] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 868ecd261e0249c984eb3d8afacef7e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665d4526e98a4f9898fab4723f981688 in term 2.
I20260709 12:14:26.536716 32135 leader_election.cc:304] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 665d4526e98a4f9898fab4723f981688 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 665d4526e98a4f9898fab4723f981688, 868ecd261e0249c984eb3d8afacef7e1; no voters: 
I20260709 12:14:26.537320 32098 raft_consensus.cc:2468] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 908f087afb9c4a04812368ab534a03b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665d4526e98a4f9898fab4723f981688 in term 2.
I20260709 12:14:26.537549 32473 raft_consensus.cc:2804] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 665d4526e98a4f9898fab4723f981688 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:26.538120 32473 raft_consensus.cc:697] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 665d4526e98a4f9898fab4723f981688 [term 2 LEADER]: Becoming Leader. State: Replica: 665d4526e98a4f9898fab4723f981688, State: Running, Role: LEADER
I20260709 12:14:26.539443 32473 consensus_queue.cc:237] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 665d4526e98a4f9898fab4723f981688 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } }
I20260709 12:14:26.547621 31917 catalog_manager.cc:5697] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 665d4526e98a4f9898fab4723f981688 reported cstate change: term changed from 1 to 2, leader changed from 908f087afb9c4a04812368ab534a03b2 (127.20.196.130) to 665d4526e98a4f9898fab4723f981688 (127.20.196.131). New cstate: current_term: 2 leader_uuid: "665d4526e98a4f9898fab4723f981688" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:26.760329 31969 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:14:26.764680 32435 raft_consensus.cc:993] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2: : Instructing follower 665d4526e98a4f9898fab4723f981688 to start an election
I20260709 12:14:26.765247 32465 raft_consensus.cc:1081] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 [term 2 LEADER]: Signalling peer 665d4526e98a4f9898fab4723f981688 to start an election
I20260709 12:14:26.766682 32172 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ce346322e2f42f08714e116defd9b56"
dest_uuid: "665d4526e98a4f9898fab4723f981688"
 from {username='slave'} at 127.0.0.1:39170
I20260709 12:14:26.767177 32172 raft_consensus.cc:493] T 9ce346322e2f42f08714e116defd9b56 P 665d4526e98a4f9898fab4723f981688 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:26.767480 32172 raft_consensus.cc:3060] T 9ce346322e2f42f08714e116defd9b56 P 665d4526e98a4f9898fab4723f981688 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:26.772019 32172 raft_consensus.cc:515] T 9ce346322e2f42f08714e116defd9b56 P 665d4526e98a4f9898fab4723f981688 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:26.773379 32172 leader_election.cc:290] T 9ce346322e2f42f08714e116defd9b56 P 665d4526e98a4f9898fab4723f981688 [CANDIDATE]: Term 3 election: Requested vote from peers 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117), 908f087afb9c4a04812368ab534a03b2 (127.20.196.130:35965)
I20260709 12:14:26.774344 32098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce346322e2f42f08714e116defd9b56" candidate_uuid: "665d4526e98a4f9898fab4723f981688" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "908f087afb9c4a04812368ab534a03b2"
I20260709 12:14:26.774523 32374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce346322e2f42f08714e116defd9b56" candidate_uuid: "665d4526e98a4f9898fab4723f981688" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "868ecd261e0249c984eb3d8afacef7e1"
I20260709 12:14:26.774963 32098 raft_consensus.cc:3055] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:26.775400 32098 raft_consensus.cc:740] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 908f087afb9c4a04812368ab534a03b2, State: Running, Role: LEADER
I20260709 12:14:26.775341 32374 raft_consensus.cc:3060] T 9ce346322e2f42f08714e116defd9b56 P 868ecd261e0249c984eb3d8afacef7e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:26.776381 32098 consensus_queue.cc:260] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:26.777379 32098 raft_consensus.cc:3060] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:26.782008 32098 raft_consensus.cc:2468] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665d4526e98a4f9898fab4723f981688 in term 3.
I20260709 12:14:26.783340 32136 leader_election.cc:304] T 9ce346322e2f42f08714e116defd9b56 P 665d4526e98a4f9898fab4723f981688 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 665d4526e98a4f9898fab4723f981688, 908f087afb9c4a04812368ab534a03b2; no voters: 
I20260709 12:14:26.783648 32374 raft_consensus.cc:2468] T 9ce346322e2f42f08714e116defd9b56 P 868ecd261e0249c984eb3d8afacef7e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665d4526e98a4f9898fab4723f981688 in term 3.
I20260709 12:14:26.784042 32473 raft_consensus.cc:2804] T 9ce346322e2f42f08714e116defd9b56 P 665d4526e98a4f9898fab4723f981688 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:26.784603 32473 raft_consensus.cc:697] T 9ce346322e2f42f08714e116defd9b56 P 665d4526e98a4f9898fab4723f981688 [term 3 LEADER]: Becoming Leader. State: Replica: 665d4526e98a4f9898fab4723f981688, State: Running, Role: LEADER
I20260709 12:14:26.785513 32473 consensus_queue.cc:237] T 9ce346322e2f42f08714e116defd9b56 P 665d4526e98a4f9898fab4723f981688 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:26.793342 31917 catalog_manager.cc:5697] T 9ce346322e2f42f08714e116defd9b56 P 665d4526e98a4f9898fab4723f981688 reported cstate change: term changed from 2 to 3, leader changed from 908f087afb9c4a04812368ab534a03b2 (127.20.196.130) to 665d4526e98a4f9898fab4723f981688 (127.20.196.131). New cstate: current_term: 3 leader_uuid: "665d4526e98a4f9898fab4723f981688" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:26.877662 32440 raft_consensus.cc:993] T 5cc7453e227a424c8b6645700e8cf4c8 P 665d4526e98a4f9898fab4723f981688: : Instructing follower 908f087afb9c4a04812368ab534a03b2 to start an election
I20260709 12:14:26.878187 32473 raft_consensus.cc:1081] T 5cc7453e227a424c8b6645700e8cf4c8 P 665d4526e98a4f9898fab4723f981688 [term 2 LEADER]: Signalling peer 908f087afb9c4a04812368ab534a03b2 to start an election
I20260709 12:14:26.879693 32098 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5cc7453e227a424c8b6645700e8cf4c8"
dest_uuid: "908f087afb9c4a04812368ab534a03b2"
 from {username='slave'} at 127.0.0.1:60672
I20260709 12:14:26.880332 32098 raft_consensus.cc:493] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:26.880613 32098 raft_consensus.cc:3060] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:26.887054 32098 raft_consensus.cc:515] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:26.890569 32374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cc7453e227a424c8b6645700e8cf4c8" candidate_uuid: "908f087afb9c4a04812368ab534a03b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "868ecd261e0249c984eb3d8afacef7e1"
I20260709 12:14:26.891168 32374 raft_consensus.cc:3060] T 5cc7453e227a424c8b6645700e8cf4c8 P 868ecd261e0249c984eb3d8afacef7e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:26.897095 32374 raft_consensus.cc:2468] T 5cc7453e227a424c8b6645700e8cf4c8 P 868ecd261e0249c984eb3d8afacef7e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 908f087afb9c4a04812368ab534a03b2 in term 3.
I20260709 12:14:26.898204 32061 leader_election.cc:304] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868ecd261e0249c984eb3d8afacef7e1, 908f087afb9c4a04812368ab534a03b2; no voters: 
I20260709 12:14:26.898273 32098 leader_election.cc:290] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 [CANDIDATE]: Term 3 election: Requested vote from peers 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117), 665d4526e98a4f9898fab4723f981688 (127.20.196.131:34699)
I20260709 12:14:26.899075 32465 raft_consensus.cc:2804] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:26.899303 32172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cc7453e227a424c8b6645700e8cf4c8" candidate_uuid: "908f087afb9c4a04812368ab534a03b2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "665d4526e98a4f9898fab4723f981688"
I20260709 12:14:26.899572 32465 raft_consensus.cc:697] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 [term 3 LEADER]: Becoming Leader. State: Replica: 908f087afb9c4a04812368ab534a03b2, State: Running, Role: LEADER
I20260709 12:14:26.900000 32172 raft_consensus.cc:3055] T 5cc7453e227a424c8b6645700e8cf4c8 P 665d4526e98a4f9898fab4723f981688 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:26.900313 32172 raft_consensus.cc:740] T 5cc7453e227a424c8b6645700e8cf4c8 P 665d4526e98a4f9898fab4723f981688 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 665d4526e98a4f9898fab4723f981688, State: Running, Role: LEADER
I20260709 12:14:26.900462 32465 consensus_queue.cc:237] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:26.901088 32172 consensus_queue.cc:260] T 5cc7453e227a424c8b6645700e8cf4c8 P 665d4526e98a4f9898fab4723f981688 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:26.902496 32172 raft_consensus.cc:3060] T 5cc7453e227a424c8b6645700e8cf4c8 P 665d4526e98a4f9898fab4723f981688 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:26.907908 31917 catalog_manager.cc:5697] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 reported cstate change: term changed from 2 to 3, leader changed from 665d4526e98a4f9898fab4723f981688 (127.20.196.131) to 908f087afb9c4a04812368ab534a03b2 (127.20.196.130). New cstate: current_term: 3 leader_uuid: "908f087afb9c4a04812368ab534a03b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:26.910290 32172 raft_consensus.cc:2468] T 5cc7453e227a424c8b6645700e8cf4c8 P 665d4526e98a4f9898fab4723f981688 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 908f087afb9c4a04812368ab534a03b2 in term 3.
I20260709 12:14:27.059937 32098 raft_consensus.cc:1275] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 908f087afb9c4a04812368ab534a03b2 [term 2 FOLLOWER]: Refusing update from remote peer 665d4526e98a4f9898fab4723f981688: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:27.061089 32473 consensus_queue.cc:1048] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 665d4526e98a4f9898fab4723f981688 [LEADER]: Connected to new peer: Peer: permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:27.071583 32374 raft_consensus.cc:1275] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 868ecd261e0249c984eb3d8afacef7e1 [term 2 FOLLOWER]: Refusing update from remote peer 665d4526e98a4f9898fab4723f981688: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:27.073174 32473 consensus_queue.cc:1048] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 665d4526e98a4f9898fab4723f981688 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:27.330339 32098 raft_consensus.cc:1275] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 [term 3 FOLLOWER]: Refusing update from remote peer 665d4526e98a4f9898fab4723f981688: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:27.331590 32473 consensus_queue.cc:1048] T 9ce346322e2f42f08714e116defd9b56 P 665d4526e98a4f9898fab4723f981688 [LEADER]: Connected to new peer: Peer: permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:27.342033 32374 raft_consensus.cc:1275] T 9ce346322e2f42f08714e116defd9b56 P 868ecd261e0249c984eb3d8afacef7e1 [term 3 FOLLOWER]: Refusing update from remote peer 665d4526e98a4f9898fab4723f981688: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:27.345242 32487 consensus_queue.cc:1048] T 9ce346322e2f42f08714e116defd9b56 P 665d4526e98a4f9898fab4723f981688 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:14:27.415987 32172 raft_consensus.cc:1275] T 5cc7453e227a424c8b6645700e8cf4c8 P 665d4526e98a4f9898fab4723f981688 [term 3 FOLLOWER]: Refusing update from remote peer 908f087afb9c4a04812368ab534a03b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:27.417516 32465 consensus_queue.cc:1048] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:27.428435 32374 raft_consensus.cc:1275] T 5cc7453e227a424c8b6645700e8cf4c8 P 868ecd261e0249c984eb3d8afacef7e1 [term 3 FOLLOWER]: Refusing update from remote peer 908f087afb9c4a04812368ab534a03b2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:27.429968 32490 consensus_queue.cc:1048] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:27.461417 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:27.468693 32098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15e900af838f4693b1d6f89ddee06965"
dest_uuid: "908f087afb9c4a04812368ab534a03b2"
mode: GRACEFUL
new_leader_uuid: "665d4526e98a4f9898fab4723f981688"
 from {username='slave'} at 127.0.0.1:60686
I20260709 12:14:27.469277 32098 raft_consensus.cc:606] T 15e900af838f4693b1d6f89ddee06965 P 908f087afb9c4a04812368ab534a03b2 [term 2 LEADER]: Received request to transfer leadership to TS 665d4526e98a4f9898fab4723f981688
I20260709 12:14:27.471899 32172 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "823ba3672286465bab521797c8fc296d"
dest_uuid: "665d4526e98a4f9898fab4723f981688"
mode: GRACEFUL
new_leader_uuid: "908f087afb9c4a04812368ab534a03b2"
 from {username='slave'} at 127.0.0.1:39180
I20260709 12:14:27.472427 32172 raft_consensus.cc:606] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [term 3 LEADER]: Received request to transfer leadership to TS 908f087afb9c4a04812368ab534a03b2
I20260709 12:14:27.475099 32172 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ce346322e2f42f08714e116defd9b56"
dest_uuid: "665d4526e98a4f9898fab4723f981688"
mode: GRACEFUL
new_leader_uuid: "908f087afb9c4a04812368ab534a03b2"
 from {username='slave'} at 127.0.0.1:39180
I20260709 12:14:27.475474 32172 raft_consensus.cc:606] T 9ce346322e2f42f08714e116defd9b56 P 665d4526e98a4f9898fab4723f981688 [term 3 LEADER]: Received request to transfer leadership to TS 908f087afb9c4a04812368ab534a03b2
I20260709 12:14:27.476365 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:14:27.476794 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:27.477334 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:27.704335 32473 raft_consensus.cc:993] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688: : Instructing follower 908f087afb9c4a04812368ab534a03b2 to start an election
I20260709 12:14:27.704854 32440 raft_consensus.cc:1081] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [term 3 LEADER]: Signalling peer 908f087afb9c4a04812368ab534a03b2 to start an election
I20260709 12:14:27.706228 32096 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "823ba3672286465bab521797c8fc296d"
dest_uuid: "908f087afb9c4a04812368ab534a03b2"
 from {username='slave'} at 127.0.0.1:60672
I20260709 12:14:27.706673 32096 raft_consensus.cc:493] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:27.707042 32096 raft_consensus.cc:3060] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:27.712457 32096 raft_consensus.cc:515] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:27.714124 32096 leader_election.cc:290] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2 [CANDIDATE]: Term 4 election: Requested vote from peers 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117), 665d4526e98a4f9898fab4723f981688 (127.20.196.131:34699)
I20260709 12:14:27.715143 32374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823ba3672286465bab521797c8fc296d" candidate_uuid: "908f087afb9c4a04812368ab534a03b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "868ecd261e0249c984eb3d8afacef7e1"
I20260709 12:14:27.715842 32374 raft_consensus.cc:3060] T 823ba3672286465bab521797c8fc296d P 868ecd261e0249c984eb3d8afacef7e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:27.715826 32172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823ba3672286465bab521797c8fc296d" candidate_uuid: "908f087afb9c4a04812368ab534a03b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "665d4526e98a4f9898fab4723f981688"
I20260709 12:14:27.716557 32172 raft_consensus.cc:3055] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:27.716940 32172 raft_consensus.cc:740] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 665d4526e98a4f9898fab4723f981688, State: Running, Role: LEADER
I20260709 12:14:27.717929 32416 raft_consensus.cc:993] T 15e900af838f4693b1d6f89ddee06965 P 908f087afb9c4a04812368ab534a03b2: : Instructing follower 665d4526e98a4f9898fab4723f981688 to start an election
I20260709 12:14:27.718515 32465 raft_consensus.cc:1081] T 15e900af838f4693b1d6f89ddee06965 P 908f087afb9c4a04812368ab534a03b2 [term 2 LEADER]: Signalling peer 665d4526e98a4f9898fab4723f981688 to start an election
I20260709 12:14:27.718565 32172 consensus_queue.cc:260] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:27.721314 32170 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15e900af838f4693b1d6f89ddee06965"
dest_uuid: "665d4526e98a4f9898fab4723f981688"
 from {username='slave'} at 127.0.0.1:39170
I20260709 12:14:27.721791 32170 raft_consensus.cc:493] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:27.721743 32172 raft_consensus.cc:3060] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:27.722410 32170 raft_consensus.cc:3060] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:27.723464 32374 raft_consensus.cc:2468] T 823ba3672286465bab521797c8fc296d P 868ecd261e0249c984eb3d8afacef7e1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 908f087afb9c4a04812368ab534a03b2 in term 4.
I20260709 12:14:27.724344 32061 leader_election.cc:304] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868ecd261e0249c984eb3d8afacef7e1, 908f087afb9c4a04812368ab534a03b2; no voters: 
I20260709 12:14:27.725085 32416 raft_consensus.cc:2804] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:27.725566 32416 raft_consensus.cc:697] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2 [term 4 LEADER]: Becoming Leader. State: Replica: 908f087afb9c4a04812368ab534a03b2, State: Running, Role: LEADER
I20260709 12:14:27.726429 32416 consensus_queue.cc:237] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:27.728881 32172 raft_consensus.cc:2468] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 908f087afb9c4a04812368ab534a03b2 in term 4.
I20260709 12:14:27.728996 32170 raft_consensus.cc:515] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:27.731648 32170 leader_election.cc:290] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688 [CANDIDATE]: Term 3 election: Requested vote from peers 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117), 908f087afb9c4a04812368ab534a03b2 (127.20.196.130:35965)
I20260709 12:14:27.731927 32374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e900af838f4693b1d6f89ddee06965" candidate_uuid: "665d4526e98a4f9898fab4723f981688" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "868ecd261e0249c984eb3d8afacef7e1"
I20260709 12:14:27.732508 32374 raft_consensus.cc:3060] T 15e900af838f4693b1d6f89ddee06965 P 868ecd261e0249c984eb3d8afacef7e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:27.734333 31917 catalog_manager.cc:5697] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2 reported cstate change: term changed from 3 to 4, leader changed from 665d4526e98a4f9898fab4723f981688 (127.20.196.131) to 908f087afb9c4a04812368ab534a03b2 (127.20.196.130). New cstate: current_term: 4 leader_uuid: "908f087afb9c4a04812368ab534a03b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:27.738608 32096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e900af838f4693b1d6f89ddee06965" candidate_uuid: "665d4526e98a4f9898fab4723f981688" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "908f087afb9c4a04812368ab534a03b2"
I20260709 12:14:27.739249 32096 raft_consensus.cc:3055] T 15e900af838f4693b1d6f89ddee06965 P 908f087afb9c4a04812368ab534a03b2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:27.739540 32096 raft_consensus.cc:740] T 15e900af838f4693b1d6f89ddee06965 P 908f087afb9c4a04812368ab534a03b2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 908f087afb9c4a04812368ab534a03b2, State: Running, Role: LEADER
I20260709 12:14:27.737680 32374 raft_consensus.cc:2468] T 15e900af838f4693b1d6f89ddee06965 P 868ecd261e0249c984eb3d8afacef7e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665d4526e98a4f9898fab4723f981688 in term 3.
I20260709 12:14:27.740437 32096 consensus_queue.cc:260] T 15e900af838f4693b1d6f89ddee06965 P 908f087afb9c4a04812368ab534a03b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:27.741510 32135 leader_election.cc:304] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 665d4526e98a4f9898fab4723f981688, 868ecd261e0249c984eb3d8afacef7e1; no voters: 
I20260709 12:14:27.741899 32096 raft_consensus.cc:3060] T 15e900af838f4693b1d6f89ddee06965 P 908f087afb9c4a04812368ab534a03b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:27.742290 32487 raft_consensus.cc:2804] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:27.742861 32487 raft_consensus.cc:697] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688 [term 3 LEADER]: Becoming Leader. State: Replica: 665d4526e98a4f9898fab4723f981688, State: Running, Role: LEADER
I20260709 12:14:27.743727 32487 consensus_queue.cc:237] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:27.750422 32096 raft_consensus.cc:2468] T 15e900af838f4693b1d6f89ddee06965 P 908f087afb9c4a04812368ab534a03b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 665d4526e98a4f9898fab4723f981688 in term 3.
I20260709 12:14:27.757077 31917 catalog_manager.cc:5697] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688 reported cstate change: term changed from 2 to 3, leader changed from 908f087afb9c4a04812368ab534a03b2 (127.20.196.130) to 665d4526e98a4f9898fab4723f981688 (127.20.196.131). New cstate: current_term: 3 leader_uuid: "665d4526e98a4f9898fab4723f981688" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:27.761217 31969 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:14:27.778055 32473 raft_consensus.cc:993] T 9ce346322e2f42f08714e116defd9b56 P 665d4526e98a4f9898fab4723f981688: : Instructing follower 908f087afb9c4a04812368ab534a03b2 to start an election
I20260709 12:14:27.778633 32487 raft_consensus.cc:1081] T 9ce346322e2f42f08714e116defd9b56 P 665d4526e98a4f9898fab4723f981688 [term 3 LEADER]: Signalling peer 908f087afb9c4a04812368ab534a03b2 to start an election
I20260709 12:14:27.779973 32096 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ce346322e2f42f08714e116defd9b56"
dest_uuid: "908f087afb9c4a04812368ab534a03b2"
 from {username='slave'} at 127.0.0.1:60672
I20260709 12:14:27.780398 32096 raft_consensus.cc:493] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:27.780728 32096 raft_consensus.cc:3060] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:27.785934 32096 raft_consensus.cc:515] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:27.787578 32096 leader_election.cc:290] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 [CANDIDATE]: Term 4 election: Requested vote from peers 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117), 665d4526e98a4f9898fab4723f981688 (127.20.196.131:34699)
I20260709 12:14:27.788337 32374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce346322e2f42f08714e116defd9b56" candidate_uuid: "908f087afb9c4a04812368ab534a03b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "868ecd261e0249c984eb3d8afacef7e1"
I20260709 12:14:27.788589 32170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce346322e2f42f08714e116defd9b56" candidate_uuid: "908f087afb9c4a04812368ab534a03b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "665d4526e98a4f9898fab4723f981688"
I20260709 12:14:27.788973 32374 raft_consensus.cc:3060] T 9ce346322e2f42f08714e116defd9b56 P 868ecd261e0249c984eb3d8afacef7e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:27.789130 32170 raft_consensus.cc:3055] T 9ce346322e2f42f08714e116defd9b56 P 665d4526e98a4f9898fab4723f981688 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:27.789513 32170 raft_consensus.cc:740] T 9ce346322e2f42f08714e116defd9b56 P 665d4526e98a4f9898fab4723f981688 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 665d4526e98a4f9898fab4723f981688, State: Running, Role: LEADER
I20260709 12:14:27.790300 32170 consensus_queue.cc:260] T 9ce346322e2f42f08714e116defd9b56 P 665d4526e98a4f9898fab4723f981688 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:27.791546 32170 raft_consensus.cc:3060] T 9ce346322e2f42f08714e116defd9b56 P 665d4526e98a4f9898fab4723f981688 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:27.795495 32374 raft_consensus.cc:2468] T 9ce346322e2f42f08714e116defd9b56 P 868ecd261e0249c984eb3d8afacef7e1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 908f087afb9c4a04812368ab534a03b2 in term 4.
I20260709 12:14:27.796641 32061 leader_election.cc:304] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 868ecd261e0249c984eb3d8afacef7e1, 908f087afb9c4a04812368ab534a03b2; no voters: 
I20260709 12:14:27.797366 32416 raft_consensus.cc:2804] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:27.797825 32170 raft_consensus.cc:2468] T 9ce346322e2f42f08714e116defd9b56 P 665d4526e98a4f9898fab4723f981688 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 908f087afb9c4a04812368ab534a03b2 in term 4.
I20260709 12:14:27.797818 32416 raft_consensus.cc:697] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 [term 4 LEADER]: Becoming Leader. State: Replica: 908f087afb9c4a04812368ab534a03b2, State: Running, Role: LEADER
I20260709 12:14:27.798955 32416 consensus_queue.cc:237] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } }
I20260709 12:14:27.805045 31917 catalog_manager.cc:5697] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 reported cstate change: term changed from 3 to 4, leader changed from 665d4526e98a4f9898fab4723f981688 (127.20.196.131) to 908f087afb9c4a04812368ab534a03b2 (127.20.196.130). New cstate: current_term: 4 leader_uuid: "908f087afb9c4a04812368ab534a03b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:28.187830 32096 raft_consensus.cc:1275] T 15e900af838f4693b1d6f89ddee06965 P 908f087afb9c4a04812368ab534a03b2 [term 3 FOLLOWER]: Refusing update from remote peer 665d4526e98a4f9898fab4723f981688: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:28.189174 32487 consensus_queue.cc:1048] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688 [LEADER]: Connected to new peer: Peer: permanent_uuid: "908f087afb9c4a04812368ab534a03b2" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 35965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:28.202289 32374 raft_consensus.cc:1275] T 15e900af838f4693b1d6f89ddee06965 P 868ecd261e0249c984eb3d8afacef7e1 [term 3 FOLLOWER]: Refusing update from remote peer 665d4526e98a4f9898fab4723f981688: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:28.203974 32487 consensus_queue.cc:1048] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:28.290823 32170 raft_consensus.cc:1275] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [term 4 FOLLOWER]: Refusing update from remote peer 908f087afb9c4a04812368ab534a03b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:14:28.291913 32416 consensus_queue.cc:1048] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:28.303449 32374 raft_consensus.cc:1275] T 823ba3672286465bab521797c8fc296d P 868ecd261e0249c984eb3d8afacef7e1 [term 4 FOLLOWER]: Refusing update from remote peer 908f087afb9c4a04812368ab534a03b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:14:28.305052 32374 raft_consensus.cc:1275] T 9ce346322e2f42f08714e116defd9b56 P 868ecd261e0249c984eb3d8afacef7e1 [term 4 FOLLOWER]: Refusing update from remote peer 908f087afb9c4a04812368ab534a03b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:14:28.305348 32416 consensus_queue.cc:1048] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:28.306334 32490 consensus_queue.cc:1048] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868ecd261e0249c984eb3d8afacef7e1" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 45117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:28.318655 32170 raft_consensus.cc:1275] T 9ce346322e2f42f08714e116defd9b56 P 665d4526e98a4f9898fab4723f981688 [term 4 FOLLOWER]: Refusing update from remote peer 908f087afb9c4a04812368ab534a03b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:14:28.320047 32490 consensus_queue.cc:1048] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "665d4526e98a4f9898fab4723f981688" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 34699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:28.483870 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:28.514844 21266 tablet_server.cc:179] TabletServer@127.20.196.129:45117 shutting down...
I20260709 12:14:28.541966 21266 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:28.542913 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:28.543802 21266 raft_consensus.cc:2243] T 5cc7453e227a424c8b6645700e8cf4c8 P 868ecd261e0249c984eb3d8afacef7e1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:28.544310 21266 raft_consensus.cc:2272] T 5cc7453e227a424c8b6645700e8cf4c8 P 868ecd261e0249c984eb3d8afacef7e1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:28.546657 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:28.547423 21266 raft_consensus.cc:2243] T 6b89a1496f2c48959a93e4883a24148b P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:28.547860 21266 raft_consensus.cc:2272] T 6b89a1496f2c48959a93e4883a24148b P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:28.550164 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:28.550776 21266 raft_consensus.cc:2243] T 496807cff0764aed8aac43768f03db67 P 868ecd261e0249c984eb3d8afacef7e1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:28.551270 21266 raft_consensus.cc:2272] T 496807cff0764aed8aac43768f03db67 P 868ecd261e0249c984eb3d8afacef7e1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:28.553596 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:28.554171 21266 raft_consensus.cc:2243] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 868ecd261e0249c984eb3d8afacef7e1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:28.554766 21266 raft_consensus.cc:2272] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 868ecd261e0249c984eb3d8afacef7e1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:28.556941 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:28.557591 21266 raft_consensus.cc:2243] T 9ce346322e2f42f08714e116defd9b56 P 868ecd261e0249c984eb3d8afacef7e1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:28.558058 21266 raft_consensus.cc:2272] T 9ce346322e2f42f08714e116defd9b56 P 868ecd261e0249c984eb3d8afacef7e1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:28.560912 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:28.561508 21266 raft_consensus.cc:2243] T 15e900af838f4693b1d6f89ddee06965 P 868ecd261e0249c984eb3d8afacef7e1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:28.561961 21266 raft_consensus.cc:2272] T 15e900af838f4693b1d6f89ddee06965 P 868ecd261e0249c984eb3d8afacef7e1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:28.565102 21266 tablet_replica.cc:333] stopping tablet replica
W20260709 12:14:28.565183 32135 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 85 similar messages]
I20260709 12:14:28.565778 21266 raft_consensus.cc:2243] T e0cb4663d72d461ca2ef6c680aee59cb P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:28.566341 21266 raft_consensus.cc:2272] T e0cb4663d72d461ca2ef6c680aee59cb P 868ecd261e0249c984eb3d8afacef7e1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:28.568240 32135 consensus_peers.cc:597] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 665d4526e98a4f9898fab4723f981688 -> Peer 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117): Couldn't send request to peer 868ecd261e0249c984eb3d8afacef7e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:28.568997 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:28.569685 21266 raft_consensus.cc:2243] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 868ecd261e0249c984eb3d8afacef7e1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:28.570111 21266 raft_consensus.cc:2272] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 868ecd261e0249c984eb3d8afacef7e1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:28.572299 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:28.572800 21266 raft_consensus.cc:2243] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 868ecd261e0249c984eb3d8afacef7e1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:28.573210 21266 raft_consensus.cc:2272] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 868ecd261e0249c984eb3d8afacef7e1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:28.576352 21266 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:28.576962 21266 raft_consensus.cc:2243] T 823ba3672286465bab521797c8fc296d P 868ecd261e0249c984eb3d8afacef7e1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:28.577553 21266 raft_consensus.cc:2272] T 823ba3672286465bab521797c8fc296d P 868ecd261e0249c984eb3d8afacef7e1 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:28.579138 32061 consensus_peers.cc:597] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 908f087afb9c4a04812368ab534a03b2 -> Peer 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117): Couldn't send request to peer 868ecd261e0249c984eb3d8afacef7e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:28.609746 21266 tablet_server.cc:196] TabletServer@127.20.196.129:45117 shutdown complete.
I20260709 12:14:28.636970 21266 tablet_server.cc:179] TabletServer@127.20.196.130:0 shutting down...
I20260709 12:14:28.666419 21266 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:28.667541 21266 tablet_replica.cc:333] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2: stopping tablet replica
W20260709 12:14:28.667831 32061 consensus_peers.cc:597] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2 -> Peer 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117): Couldn't send request to peer 868ecd261e0249c984eb3d8afacef7e1. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:45117: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:28.668459 21266 raft_consensus.cc:2243] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:14:28.669380 21266 raft_consensus.cc:2272] T 823ba3672286465bab521797c8fc296d P 908f087afb9c4a04812368ab534a03b2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:28.672391 21266 tablet_replica.cc:333] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2: stopping tablet replica
I20260709 12:14:28.672968 21266 raft_consensus.cc:2243] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:14:28.673736 21266 raft_consensus.cc:2272] T 9ce346322e2f42f08714e116defd9b56 P 908f087afb9c4a04812368ab534a03b2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:28.676659 21266 tablet_replica.cc:333] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 908f087afb9c4a04812368ab534a03b2: stopping tablet replica
I20260709 12:14:28.677281 21266 raft_consensus.cc:2243] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 908f087afb9c4a04812368ab534a03b2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:28.677778 21266 raft_consensus.cc:2272] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 908f087afb9c4a04812368ab534a03b2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:28.679986 21266 tablet_replica.cc:333] T 6b89a1496f2c48959a93e4883a24148b P 908f087afb9c4a04812368ab534a03b2: stopping tablet replica
I20260709 12:14:28.680544 21266 raft_consensus.cc:2243] T 6b89a1496f2c48959a93e4883a24148b P 908f087afb9c4a04812368ab534a03b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:28.680961 21266 raft_consensus.cc:2272] T 6b89a1496f2c48959a93e4883a24148b P 908f087afb9c4a04812368ab534a03b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:28.683162 21266 tablet_replica.cc:333] T 15e900af838f4693b1d6f89ddee06965 P 908f087afb9c4a04812368ab534a03b2: stopping tablet replica
I20260709 12:14:28.683775 21266 raft_consensus.cc:2243] T 15e900af838f4693b1d6f89ddee06965 P 908f087afb9c4a04812368ab534a03b2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:28.684173 21266 raft_consensus.cc:2272] T 15e900af838f4693b1d6f89ddee06965 P 908f087afb9c4a04812368ab534a03b2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:28.686493 21266 tablet_replica.cc:333] T e0cb4663d72d461ca2ef6c680aee59cb P 908f087afb9c4a04812368ab534a03b2: stopping tablet replica
I20260709 12:14:28.687068 21266 raft_consensus.cc:2243] T e0cb4663d72d461ca2ef6c680aee59cb P 908f087afb9c4a04812368ab534a03b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:28.687495 21266 raft_consensus.cc:2272] T e0cb4663d72d461ca2ef6c680aee59cb P 908f087afb9c4a04812368ab534a03b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:28.689584 21266 tablet_replica.cc:333] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 908f087afb9c4a04812368ab534a03b2: stopping tablet replica
I20260709 12:14:28.690150 21266 raft_consensus.cc:2243] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 908f087afb9c4a04812368ab534a03b2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:28.690551 21266 raft_consensus.cc:2272] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 908f087afb9c4a04812368ab534a03b2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:28.692715 21266 tablet_replica.cc:333] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 908f087afb9c4a04812368ab534a03b2: stopping tablet replica
I20260709 12:14:28.693208 21266 raft_consensus.cc:2243] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 908f087afb9c4a04812368ab534a03b2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:28.693995 21266 raft_consensus.cc:2272] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 908f087afb9c4a04812368ab534a03b2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:28.696038 21266 tablet_replica.cc:333] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2: stopping tablet replica
I20260709 12:14:28.696532 21266 raft_consensus.cc:2243] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:14:28.697273 21266 raft_consensus.cc:2272] T 496807cff0764aed8aac43768f03db67 P 908f087afb9c4a04812368ab534a03b2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:28.701211 21266 tablet_replica.cc:333] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2: stopping tablet replica
I20260709 12:14:28.701870 21266 raft_consensus.cc:2243] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 [term 3 LEADER]: Raft consensus shutting down.
W20260709 12:14:28.702577 32136 consensus_peers.cc:597] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 665d4526e98a4f9898fab4723f981688 -> Peer 908f087afb9c4a04812368ab534a03b2 (127.20.196.130:35965): Couldn't send request to peer 908f087afb9c4a04812368ab534a03b2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:28.702803 21266 raft_consensus.cc:2272] T 5cc7453e227a424c8b6645700e8cf4c8 P 908f087afb9c4a04812368ab534a03b2 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:28.715764 32136 consensus_peers.cc:597] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688 -> Peer 908f087afb9c4a04812368ab534a03b2 (127.20.196.130:35965): Couldn't send request to peer 908f087afb9c4a04812368ab534a03b2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:28.735733 21266 tablet_server.cc:196] TabletServer@127.20.196.130:0 shutdown complete.
W20260709 12:14:28.754065 32136 consensus_peers.cc:597] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 665d4526e98a4f9898fab4723f981688 -> Peer 908f087afb9c4a04812368ab534a03b2 (127.20.196.130:35965): Couldn't send request to peer 908f087afb9c4a04812368ab534a03b2. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:35965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:28.760762 32135 consensus_peers.cc:597] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688 -> Peer 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117): Couldn't send request to peer 868ecd261e0249c984eb3d8afacef7e1. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:45117: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:28.762235 31969 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:14:28.765465 32136 consensus_peers.cc:597] T 6b89a1496f2c48959a93e4883a24148b P 665d4526e98a4f9898fab4723f981688 -> Peer 908f087afb9c4a04812368ab534a03b2 (127.20.196.130:35965): Couldn't send request to peer 908f087afb9c4a04812368ab534a03b2. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:35965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:28.768455 21266 tablet_server.cc:179] TabletServer@127.20.196.131:0 shutting down...
I20260709 12:14:28.798879 21266 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:14:28.799126 32136 consensus_peers.cc:597] T e0cb4663d72d461ca2ef6c680aee59cb P 665d4526e98a4f9898fab4723f981688 -> Peer 908f087afb9c4a04812368ab534a03b2 (127.20.196.130:35965): Couldn't send request to peer 908f087afb9c4a04812368ab534a03b2. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:35965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:28.799763 21266 tablet_replica.cc:333] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 665d4526e98a4f9898fab4723f981688: stopping tablet replica
I20260709 12:14:28.801045 21266 raft_consensus.cc:2243] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 665d4526e98a4f9898fab4723f981688 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:28.802217 21266 raft_consensus.cc:2272] T 50f879d2e1ef4a1384e7d77f4a3cf7f8 P 665d4526e98a4f9898fab4723f981688 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:28.805092 32135 consensus_peers.cc:597] T e0cb4663d72d461ca2ef6c680aee59cb P 665d4526e98a4f9898fab4723f981688 -> Peer 868ecd261e0249c984eb3d8afacef7e1 (127.20.196.129:45117): Couldn't send request to peer 868ecd261e0249c984eb3d8afacef7e1. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:45117: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:28.805380 21266 tablet_replica.cc:333] T 9ce346322e2f42f08714e116defd9b56 P 665d4526e98a4f9898fab4723f981688: stopping tablet replica
I20260709 12:14:28.806125 21266 raft_consensus.cc:2243] T 9ce346322e2f42f08714e116defd9b56 P 665d4526e98a4f9898fab4723f981688 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:28.806543 21266 raft_consensus.cc:2272] T 9ce346322e2f42f08714e116defd9b56 P 665d4526e98a4f9898fab4723f981688 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:28.809309 21266 tablet_replica.cc:333] T 5cc7453e227a424c8b6645700e8cf4c8 P 665d4526e98a4f9898fab4723f981688: stopping tablet replica
I20260709 12:14:28.809942 21266 raft_consensus.cc:2243] T 5cc7453e227a424c8b6645700e8cf4c8 P 665d4526e98a4f9898fab4723f981688 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:28.810387 21266 raft_consensus.cc:2272] T 5cc7453e227a424c8b6645700e8cf4c8 P 665d4526e98a4f9898fab4723f981688 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:28.812623 21266 tablet_replica.cc:333] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688: stopping tablet replica
I20260709 12:14:28.813213 21266 raft_consensus.cc:2243] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:28.813647 21266 raft_consensus.cc:2272] T 823ba3672286465bab521797c8fc296d P 665d4526e98a4f9898fab4723f981688 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:28.816329 21266 tablet_replica.cc:333] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688: stopping tablet replica
I20260709 12:14:28.816982 21266 raft_consensus.cc:2243] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:28.817790 21266 raft_consensus.cc:2272] T 15e900af838f4693b1d6f89ddee06965 P 665d4526e98a4f9898fab4723f981688 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:28.820220 21266 tablet_replica.cc:333] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 665d4526e98a4f9898fab4723f981688: stopping tablet replica
I20260709 12:14:28.820786 21266 raft_consensus.cc:2243] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 665d4526e98a4f9898fab4723f981688 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:28.821511 21266 raft_consensus.cc:2272] T 37a856e5a8fa4b3d9fee7d843a26ef4a P 665d4526e98a4f9898fab4723f981688 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:28.823457 21266 tablet_replica.cc:333] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 665d4526e98a4f9898fab4723f981688: stopping tablet replica
I20260709 12:14:28.823962 21266 raft_consensus.cc:2243] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 665d4526e98a4f9898fab4723f981688 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:28.824378 21266 raft_consensus.cc:2272] T aa412a4ecaeb4b1b87bb9d9175e8fdc4 P 665d4526e98a4f9898fab4723f981688 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:28.826330 21266 tablet_replica.cc:333] T e0cb4663d72d461ca2ef6c680aee59cb P 665d4526e98a4f9898fab4723f981688: stopping tablet replica
I20260709 12:14:28.826831 21266 raft_consensus.cc:2243] T e0cb4663d72d461ca2ef6c680aee59cb P 665d4526e98a4f9898fab4723f981688 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:28.827608 21266 raft_consensus.cc:2272] T e0cb4663d72d461ca2ef6c680aee59cb P 665d4526e98a4f9898fab4723f981688 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:28.829665 21266 tablet_replica.cc:333] T 6b89a1496f2c48959a93e4883a24148b P 665d4526e98a4f9898fab4723f981688: stopping tablet replica
I20260709 12:14:28.830173 21266 raft_consensus.cc:2243] T 6b89a1496f2c48959a93e4883a24148b P 665d4526e98a4f9898fab4723f981688 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:28.831144 21266 raft_consensus.cc:2272] T 6b89a1496f2c48959a93e4883a24148b P 665d4526e98a4f9898fab4723f981688 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:28.833134 21266 tablet_replica.cc:333] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688: stopping tablet replica
I20260709 12:14:28.833627 21266 raft_consensus.cc:2243] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:28.834031 21266 raft_consensus.cc:2272] T 496807cff0764aed8aac43768f03db67 P 665d4526e98a4f9898fab4723f981688 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:28.884182 21266 tablet_server.cc:196] TabletServer@127.20.196.131:0 shutdown complete.
I20260709 12:14:28.911862 21266 master.cc:562] Master@127.20.196.190:34873 shutting down...
I20260709 12:14:28.936774 21266 raft_consensus.cc:2243] T 00000000000000000000000000000000 P efe29e3ae67d4f96b2dceef2e544b286 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:28.937295 21266 raft_consensus.cc:2272] T 00000000000000000000000000000000 P efe29e3ae67d4f96b2dceef2e544b286 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:28.937671 21266 tablet_replica.cc:333] T 00000000000000000000000000000000 P efe29e3ae67d4f96b2dceef2e544b286: stopping tablet replica
I20260709 12:14:28.958604 21266 master.cc:584] Master@127.20.196.190:34873 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13850 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:14:29.004379 21266 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.196.190:39345
I20260709 12:14:29.005462 21266 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:29.011520 32517 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:29.011569 32516 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:29.012188 32519 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:29.013127 21266 server_base.cc:1061] running on GCE node
I20260709 12:14:29.014060 21266 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:29.014237 21266 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:29.014366 21266 hybrid_clock.cc:648] HybridClock initialized: now 1783599269014355 us; error 0 us; skew 500 ppm
I20260709 12:14:29.014851 21266 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:29.017315 21266 webserver.cc:533] Webserver started at http://127.20.196.190:39995/ using document root <none> and password file <none>
I20260709 12:14:29.017776 21266 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:29.017932 21266 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:29.018157 21266 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:29.019649 21266 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894355727-21266-0/minicluster-data/master-0-root/instance:
uuid: "507d525e1ddc4fd094e4e46f127a0c28"
format_stamp: "Formatted at 2026-07-09 12:14:29 on dist-test-slave-h6sg"
I20260709 12:14:29.023983 21266 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 12:14:29.027323 32524 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:29.028075 21266 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:14:29.028322 21266 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894355727-21266-0/minicluster-data/master-0-root
uuid: "507d525e1ddc4fd094e4e46f127a0c28"
format_stamp: "Formatted at 2026-07-09 12:14:29 on dist-test-slave-h6sg"
I20260709 12:14:29.028550 21266 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894355727-21266-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894355727-21266-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894355727-21266-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:29.040343 21266 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:29.041464 21266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:29.079855 21266 rpc_server.cc:307] RPC server started. Bound to: 127.20.196.190:39345
I20260709 12:14:29.079978 32575 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.196.190:39345 every 8 connection(s)
I20260709 12:14:29.083719 32576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:29.095029 32576 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 507d525e1ddc4fd094e4e46f127a0c28: Bootstrap starting.
I20260709 12:14:29.099974 32576 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 507d525e1ddc4fd094e4e46f127a0c28: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:29.104257 32576 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 507d525e1ddc4fd094e4e46f127a0c28: No bootstrap required, opened a new log
I20260709 12:14:29.106400 32576 raft_consensus.cc:359] T 00000000000000000000000000000000 P 507d525e1ddc4fd094e4e46f127a0c28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "507d525e1ddc4fd094e4e46f127a0c28" member_type: VOTER }
I20260709 12:14:29.106755 32576 raft_consensus.cc:385] T 00000000000000000000000000000000 P 507d525e1ddc4fd094e4e46f127a0c28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:29.107075 32576 raft_consensus.cc:740] T 00000000000000000000000000000000 P 507d525e1ddc4fd094e4e46f127a0c28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 507d525e1ddc4fd094e4e46f127a0c28, State: Initialized, Role: FOLLOWER
I20260709 12:14:29.107722 32576 consensus_queue.cc:260] T 00000000000000000000000000000000 P 507d525e1ddc4fd094e4e46f127a0c28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "507d525e1ddc4fd094e4e46f127a0c28" member_type: VOTER }
I20260709 12:14:29.108161 32576 raft_consensus.cc:399] T 00000000000000000000000000000000 P 507d525e1ddc4fd094e4e46f127a0c28 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:14:29.108384 32576 raft_consensus.cc:493] T 00000000000000000000000000000000 P 507d525e1ddc4fd094e4e46f127a0c28 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:14:29.108657 32576 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 507d525e1ddc4fd094e4e46f127a0c28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:29.113423 32576 raft_consensus.cc:515] T 00000000000000000000000000000000 P 507d525e1ddc4fd094e4e46f127a0c28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "507d525e1ddc4fd094e4e46f127a0c28" member_type: VOTER }
I20260709 12:14:29.113924 32576 leader_election.cc:304] T 00000000000000000000000000000000 P 507d525e1ddc4fd094e4e46f127a0c28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 507d525e1ddc4fd094e4e46f127a0c28; no voters: 
I20260709 12:14:29.115088 32576 leader_election.cc:290] T 00000000000000000000000000000000 P 507d525e1ddc4fd094e4e46f127a0c28 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:14:29.115442 32579 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 507d525e1ddc4fd094e4e46f127a0c28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:29.116813 32579 raft_consensus.cc:697] T 00000000000000000000000000000000 P 507d525e1ddc4fd094e4e46f127a0c28 [term 1 LEADER]: Becoming Leader. State: Replica: 507d525e1ddc4fd094e4e46f127a0c28, State: Running, Role: LEADER
I20260709 12:14:29.117494 32579 consensus_queue.cc:237] T 00000000000000000000000000000000 P 507d525e1ddc4fd094e4e46f127a0c28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "507d525e1ddc4fd094e4e46f127a0c28" member_type: VOTER }
I20260709 12:14:29.118090 32576 sys_catalog.cc:565] T 00000000000000000000000000000000 P 507d525e1ddc4fd094e4e46f127a0c28 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:14:29.122310 32581 sys_catalog.cc:455] T 00000000000000000000000000000000 P 507d525e1ddc4fd094e4e46f127a0c28 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 507d525e1ddc4fd094e4e46f127a0c28. Latest consensus state: current_term: 1 leader_uuid: "507d525e1ddc4fd094e4e46f127a0c28" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "507d525e1ddc4fd094e4e46f127a0c28" member_type: VOTER } }
I20260709 12:14:29.122822 32581 sys_catalog.cc:458] T 00000000000000000000000000000000 P 507d525e1ddc4fd094e4e46f127a0c28 [sys.catalog]: This master's current role is: LEADER
I20260709 12:14:29.124030 32580 sys_catalog.cc:455] T 00000000000000000000000000000000 P 507d525e1ddc4fd094e4e46f127a0c28 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "507d525e1ddc4fd094e4e46f127a0c28" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "507d525e1ddc4fd094e4e46f127a0c28" member_type: VOTER } }
I20260709 12:14:29.124759 32580 sys_catalog.cc:458] T 00000000000000000000000000000000 P 507d525e1ddc4fd094e4e46f127a0c28 [sys.catalog]: This master's current role is: LEADER
I20260709 12:14:29.126327 32586 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:14:29.134110 32586 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:14:29.135136 21266 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:14:29.142580 32586 catalog_manager.cc:1383] Generated new cluster ID: a51f78a7307e4b30882bc49f718c50a6
I20260709 12:14:29.142858 32586 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:14:29.156168 32586 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:14:29.157495 32586 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:14:29.177071 32586 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 507d525e1ddc4fd094e4e46f127a0c28: Generated new TSK 0
I20260709 12:14:29.177700 32586 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:14:29.201975 21266 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:29.208179 32597 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:29.209566 32598 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:29.210971 32600 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:29.211345 21266 server_base.cc:1061] running on GCE node
I20260709 12:14:29.212771 21266 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:29.212963 21266 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:29.213086 21266 hybrid_clock.cc:648] HybridClock initialized: now 1783599269213076 us; error 0 us; skew 500 ppm
I20260709 12:14:29.213603 21266 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:29.215929 21266 webserver.cc:533] Webserver started at http://127.20.196.129:42421/ using document root <none> and password file <none>
I20260709 12:14:29.216347 21266 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:29.216498 21266 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:29.216715 21266 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:29.217815 21266 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894355727-21266-0/minicluster-data/ts-0-root/instance:
uuid: "8503e8182df24f0785ec09456fc77984"
format_stamp: "Formatted at 2026-07-09 12:14:29 on dist-test-slave-h6sg"
I20260709 12:14:29.222224 21266 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:14:29.225849 32605 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:29.226603 21266 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:14:29.226924 21266 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894355727-21266-0/minicluster-data/ts-0-root
uuid: "8503e8182df24f0785ec09456fc77984"
format_stamp: "Formatted at 2026-07-09 12:14:29 on dist-test-slave-h6sg"
I20260709 12:14:29.227273 21266 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894355727-21266-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894355727-21266-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894355727-21266-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:29.250043 21266 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:29.251299 21266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:29.252807 21266 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:29.255198 21266 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:29.255414 21266 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:29.255659 21266 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:29.255844 21266 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:29.297056 21266 rpc_server.cc:307] RPC server started. Bound to: 127.20.196.129:34575
I20260709 12:14:29.297199 32667 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.196.129:34575 every 8 connection(s)
I20260709 12:14:29.302306 21266 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:29.309017 32672 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:29.310263 32673 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:29.315692 32675 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:29.318151 32668 heartbeater.cc:344] Connected to a master server at 127.20.196.190:39345
I20260709 12:14:29.318631 32668 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:29.318917 21266 server_base.cc:1061] running on GCE node
I20260709 12:14:29.319665 32668 heartbeater.cc:507] Master 127.20.196.190:39345 requested a full tablet report, sending...
I20260709 12:14:29.320258 21266 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:29.320564 21266 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:29.320808 21266 hybrid_clock.cc:648] HybridClock initialized: now 1783599269320787 us; error 0 us; skew 500 ppm
I20260709 12:14:29.321547 21266 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:29.321938 32541 ts_manager.cc:194] Registered new tserver with Master: 8503e8182df24f0785ec09456fc77984 (127.20.196.129:34575)
I20260709 12:14:29.324180 32541 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36714
I20260709 12:14:29.324353 21266 webserver.cc:533] Webserver started at http://127.20.196.130:39811/ using document root <none> and password file <none>
I20260709 12:14:29.324998 21266 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:29.325240 21266 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:29.325583 21266 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:29.327335 21266 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894355727-21266-0/minicluster-data/ts-1-root/instance:
uuid: "10a56c552e37487a8966c512682ef9cd"
format_stamp: "Formatted at 2026-07-09 12:14:29 on dist-test-slave-h6sg"
I20260709 12:14:29.332459 21266 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:14:29.335865 32680 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:29.336774 21266 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:14:29.337116 21266 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894355727-21266-0/minicluster-data/ts-1-root
uuid: "10a56c552e37487a8966c512682ef9cd"
format_stamp: "Formatted at 2026-07-09 12:14:29 on dist-test-slave-h6sg"
I20260709 12:14:29.337416 21266 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894355727-21266-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894355727-21266-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894355727-21266-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:29.356652 21266 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:29.357931 21266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:29.359531 21266 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:29.361831 21266 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:29.362075 21266 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:29.362332 21266 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:29.362525 21266 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:29.405278 21266 rpc_server.cc:307] RPC server started. Bound to: 127.20.196.130:40383
I20260709 12:14:29.405407 32742 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.196.130:40383 every 8 connection(s)
I20260709 12:14:29.410643 21266 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:29.418363 32747 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:29.418937 32746 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:29.423458 32749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:29.424531 32743 heartbeater.cc:344] Connected to a master server at 127.20.196.190:39345
I20260709 12:14:29.425051 32743 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:29.425369 21266 server_base.cc:1061] running on GCE node
I20260709 12:14:29.426110 32743 heartbeater.cc:507] Master 127.20.196.190:39345 requested a full tablet report, sending...
I20260709 12:14:29.426367 21266 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:29.426671 21266 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:29.426862 21266 hybrid_clock.cc:648] HybridClock initialized: now 1783599269426844 us; error 0 us; skew 500 ppm
I20260709 12:14:29.427634 21266 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:29.428429 32541 ts_manager.cc:194] Registered new tserver with Master: 10a56c552e37487a8966c512682ef9cd (127.20.196.130:40383)
I20260709 12:14:29.430229 32541 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36720
I20260709 12:14:29.430451 21266 webserver.cc:533] Webserver started at http://127.20.196.131:42245/ using document root <none> and password file <none>
I20260709 12:14:29.431202 21266 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:29.431478 21266 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:29.431777 21266 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:29.433056 21266 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894355727-21266-0/minicluster-data/ts-2-root/instance:
uuid: "8bbff56d78544420af697aec65b316a3"
format_stamp: "Formatted at 2026-07-09 12:14:29 on dist-test-slave-h6sg"
I20260709 12:14:29.437709 21266 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:14:29.441285 32754 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:29.442119 21266 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:14:29.442430 21266 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894355727-21266-0/minicluster-data/ts-2-root
uuid: "8bbff56d78544420af697aec65b316a3"
format_stamp: "Formatted at 2026-07-09 12:14:29 on dist-test-slave-h6sg"
I20260709 12:14:29.442764 21266 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894355727-21266-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894355727-21266-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894355727-21266-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:29.463877 21266 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:29.465075 21266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:29.466621 21266 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:29.468833 21266 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:29.469061 21266 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:29.469332 21266 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:29.469513 21266 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:29.509145 21266 rpc_server.cc:307] RPC server started. Bound to: 127.20.196.131:35939
I20260709 12:14:29.509264   348 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.196.131:35939 every 8 connection(s)
I20260709 12:14:29.523502   349 heartbeater.cc:344] Connected to a master server at 127.20.196.190:39345
I20260709 12:14:29.523967   349 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:29.524646   349 heartbeater.cc:507] Master 127.20.196.190:39345 requested a full tablet report, sending...
I20260709 12:14:29.526681 32541 ts_manager.cc:194] Registered new tserver with Master: 8bbff56d78544420af697aec65b316a3 (127.20.196.131:35939)
I20260709 12:14:29.527170 21266 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014908389s
I20260709 12:14:29.528260 32541 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36722
I20260709 12:14:29.554209 32541 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36726:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:14:29.556494 32541 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:14:29.612879 32708 tablet_service.cc:1511] Processing CreateTablet for tablet 0f63f46f5d9e4ab485b65cba33d83c3b (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=c5bf8a7855264b08bad7e0539c13ab5b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:14:29.613065 32707 tablet_service.cc:1511] Processing CreateTablet for tablet 49c7c074b1f9451488656eee9848b339 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=c5bf8a7855264b08bad7e0539c13ab5b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:14:29.614440 32708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f63f46f5d9e4ab485b65cba33d83c3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:29.615118 32707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49c7c074b1f9451488656eee9848b339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:29.618512 32632 tablet_service.cc:1511] Processing CreateTablet for tablet 49c7c074b1f9451488656eee9848b339 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=c5bf8a7855264b08bad7e0539c13ab5b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:14:29.620052 32632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49c7c074b1f9451488656eee9848b339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:29.619781 32633 tablet_service.cc:1511] Processing CreateTablet for tablet 0f63f46f5d9e4ab485b65cba33d83c3b (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=c5bf8a7855264b08bad7e0539c13ab5b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:14:29.621158 32633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f63f46f5d9e4ab485b65cba33d83c3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:29.622504   313 tablet_service.cc:1511] Processing CreateTablet for tablet 49c7c074b1f9451488656eee9848b339 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=c5bf8a7855264b08bad7e0539c13ab5b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:14:29.623915   313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49c7c074b1f9451488656eee9848b339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:29.618603   314 tablet_service.cc:1511] Processing CreateTablet for tablet 0f63f46f5d9e4ab485b65cba33d83c3b (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=c5bf8a7855264b08bad7e0539c13ab5b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:14:29.627367   314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f63f46f5d9e4ab485b65cba33d83c3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:29.647295   364 tablet_bootstrap.cc:492] T 0f63f46f5d9e4ab485b65cba33d83c3b P 10a56c552e37487a8966c512682ef9cd: Bootstrap starting.
I20260709 12:14:29.649204   365 tablet_bootstrap.cc:492] T 0f63f46f5d9e4ab485b65cba33d83c3b P 8503e8182df24f0785ec09456fc77984: Bootstrap starting.
I20260709 12:14:29.656828   365 tablet_bootstrap.cc:654] T 0f63f46f5d9e4ab485b65cba33d83c3b P 8503e8182df24f0785ec09456fc77984: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:29.667552   364 tablet_bootstrap.cc:654] T 0f63f46f5d9e4ab485b65cba33d83c3b P 10a56c552e37487a8966c512682ef9cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:29.668213   367 tablet_bootstrap.cc:492] T 49c7c074b1f9451488656eee9848b339 P 8bbff56d78544420af697aec65b316a3: Bootstrap starting.
I20260709 12:14:29.669602   365 tablet_bootstrap.cc:492] T 0f63f46f5d9e4ab485b65cba33d83c3b P 8503e8182df24f0785ec09456fc77984: No bootstrap required, opened a new log
I20260709 12:14:29.670070   365 ts_tablet_manager.cc:1403] T 0f63f46f5d9e4ab485b65cba33d83c3b P 8503e8182df24f0785ec09456fc77984: Time spent bootstrapping tablet: real 0.021s	user 0.003s	sys 0.015s
I20260709 12:14:29.672710   365 raft_consensus.cc:359] T 0f63f46f5d9e4ab485b65cba33d83c3b P 8503e8182df24f0785ec09456fc77984 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:29.673327   365 raft_consensus.cc:385] T 0f63f46f5d9e4ab485b65cba33d83c3b P 8503e8182df24f0785ec09456fc77984 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:29.673247   364 tablet_bootstrap.cc:492] T 0f63f46f5d9e4ab485b65cba33d83c3b P 10a56c552e37487a8966c512682ef9cd: No bootstrap required, opened a new log
I20260709 12:14:29.673795   365 raft_consensus.cc:740] T 0f63f46f5d9e4ab485b65cba33d83c3b P 8503e8182df24f0785ec09456fc77984 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8503e8182df24f0785ec09456fc77984, State: Initialized, Role: FOLLOWER
I20260709 12:14:29.674723   365 consensus_queue.cc:260] T 0f63f46f5d9e4ab485b65cba33d83c3b P 8503e8182df24f0785ec09456fc77984 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:29.675133   364 ts_tablet_manager.cc:1403] T 0f63f46f5d9e4ab485b65cba33d83c3b P 10a56c552e37487a8966c512682ef9cd: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.004s
I20260709 12:14:29.675617   367 tablet_bootstrap.cc:654] T 49c7c074b1f9451488656eee9848b339 P 8bbff56d78544420af697aec65b316a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:29.677204 32668 heartbeater.cc:499] Master 127.20.196.190:39345 was elected leader, sending a full tablet report...
I20260709 12:14:29.677666   365 ts_tablet_manager.cc:1434] T 0f63f46f5d9e4ab485b65cba33d83c3b P 8503e8182df24f0785ec09456fc77984: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:14:29.678663   365 tablet_bootstrap.cc:492] T 49c7c074b1f9451488656eee9848b339 P 8503e8182df24f0785ec09456fc77984: Bootstrap starting.
I20260709 12:14:29.678790   364 raft_consensus.cc:359] T 0f63f46f5d9e4ab485b65cba33d83c3b P 10a56c552e37487a8966c512682ef9cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:29.679663   364 raft_consensus.cc:385] T 0f63f46f5d9e4ab485b65cba33d83c3b P 10a56c552e37487a8966c512682ef9cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:29.680015   364 raft_consensus.cc:740] T 0f63f46f5d9e4ab485b65cba33d83c3b P 10a56c552e37487a8966c512682ef9cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10a56c552e37487a8966c512682ef9cd, State: Initialized, Role: FOLLOWER
I20260709 12:14:29.680831   364 consensus_queue.cc:260] T 0f63f46f5d9e4ab485b65cba33d83c3b P 10a56c552e37487a8966c512682ef9cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:29.687111   365 tablet_bootstrap.cc:654] T 49c7c074b1f9451488656eee9848b339 P 8503e8182df24f0785ec09456fc77984: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:29.703176 32743 heartbeater.cc:499] Master 127.20.196.190:39345 was elected leader, sending a full tablet report...
I20260709 12:14:29.703881   367 tablet_bootstrap.cc:492] T 49c7c074b1f9451488656eee9848b339 P 8bbff56d78544420af697aec65b316a3: No bootstrap required, opened a new log
I20260709 12:14:29.704058   365 tablet_bootstrap.cc:492] T 49c7c074b1f9451488656eee9848b339 P 8503e8182df24f0785ec09456fc77984: No bootstrap required, opened a new log
I20260709 12:14:29.704454   367 ts_tablet_manager.cc:1403] T 49c7c074b1f9451488656eee9848b339 P 8bbff56d78544420af697aec65b316a3: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.021s
I20260709 12:14:29.704507   365 ts_tablet_manager.cc:1403] T 49c7c074b1f9451488656eee9848b339 P 8503e8182df24f0785ec09456fc77984: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.012s
I20260709 12:14:29.705827   364 ts_tablet_manager.cc:1434] T 0f63f46f5d9e4ab485b65cba33d83c3b P 10a56c552e37487a8966c512682ef9cd: Time spent starting tablet: real 0.030s	user 0.023s	sys 0.004s
I20260709 12:14:29.706871   364 tablet_bootstrap.cc:492] T 49c7c074b1f9451488656eee9848b339 P 10a56c552e37487a8966c512682ef9cd: Bootstrap starting.
I20260709 12:14:29.707794   367 raft_consensus.cc:359] T 49c7c074b1f9451488656eee9848b339 P 8bbff56d78544420af697aec65b316a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:29.708566   367 raft_consensus.cc:385] T 49c7c074b1f9451488656eee9848b339 P 8bbff56d78544420af697aec65b316a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:29.708310   365 raft_consensus.cc:359] T 49c7c074b1f9451488656eee9848b339 P 8503e8182df24f0785ec09456fc77984 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:29.708935   367 raft_consensus.cc:740] T 49c7c074b1f9451488656eee9848b339 P 8bbff56d78544420af697aec65b316a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bbff56d78544420af697aec65b316a3, State: Initialized, Role: FOLLOWER
I20260709 12:14:29.709146   365 raft_consensus.cc:385] T 49c7c074b1f9451488656eee9848b339 P 8503e8182df24f0785ec09456fc77984 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:29.709676   365 raft_consensus.cc:740] T 49c7c074b1f9451488656eee9848b339 P 8503e8182df24f0785ec09456fc77984 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8503e8182df24f0785ec09456fc77984, State: Initialized, Role: FOLLOWER
I20260709 12:14:29.709785   367 consensus_queue.cc:260] T 49c7c074b1f9451488656eee9848b339 P 8bbff56d78544420af697aec65b316a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:29.710649   365 consensus_queue.cc:260] T 49c7c074b1f9451488656eee9848b339 P 8503e8182df24f0785ec09456fc77984 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:29.714880   364 tablet_bootstrap.cc:654] T 49c7c074b1f9451488656eee9848b339 P 10a56c552e37487a8966c512682ef9cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:29.715317   365 ts_tablet_manager.cc:1434] T 49c7c074b1f9451488656eee9848b339 P 8503e8182df24f0785ec09456fc77984: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 12:14:29.722085   364 tablet_bootstrap.cc:492] T 49c7c074b1f9451488656eee9848b339 P 10a56c552e37487a8966c512682ef9cd: No bootstrap required, opened a new log
I20260709 12:14:29.722822   364 ts_tablet_manager.cc:1403] T 49c7c074b1f9451488656eee9848b339 P 10a56c552e37487a8966c512682ef9cd: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 12:14:29.724116   349 heartbeater.cc:499] Master 127.20.196.190:39345 was elected leader, sending a full tablet report...
I20260709 12:14:29.724697   367 ts_tablet_manager.cc:1434] T 49c7c074b1f9451488656eee9848b339 P 8bbff56d78544420af697aec65b316a3: Time spent starting tablet: real 0.020s	user 0.011s	sys 0.007s
I20260709 12:14:29.725989   364 raft_consensus.cc:359] T 49c7c074b1f9451488656eee9848b339 P 10a56c552e37487a8966c512682ef9cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:29.726735   364 raft_consensus.cc:385] T 49c7c074b1f9451488656eee9848b339 P 10a56c552e37487a8966c512682ef9cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:29.727020   367 tablet_bootstrap.cc:492] T 0f63f46f5d9e4ab485b65cba33d83c3b P 8bbff56d78544420af697aec65b316a3: Bootstrap starting.
I20260709 12:14:29.727075   364 raft_consensus.cc:740] T 49c7c074b1f9451488656eee9848b339 P 10a56c552e37487a8966c512682ef9cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10a56c552e37487a8966c512682ef9cd, State: Initialized, Role: FOLLOWER
I20260709 12:14:29.728267   364 consensus_queue.cc:260] T 49c7c074b1f9451488656eee9848b339 P 10a56c552e37487a8966c512682ef9cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:29.730427   364 ts_tablet_manager.cc:1434] T 49c7c074b1f9451488656eee9848b339 P 10a56c552e37487a8966c512682ef9cd: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:14:29.734484   367 tablet_bootstrap.cc:654] T 0f63f46f5d9e4ab485b65cba33d83c3b P 8bbff56d78544420af697aec65b316a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:29.739432   367 tablet_bootstrap.cc:492] T 0f63f46f5d9e4ab485b65cba33d83c3b P 8bbff56d78544420af697aec65b316a3: No bootstrap required, opened a new log
I20260709 12:14:29.739840   367 ts_tablet_manager.cc:1403] T 0f63f46f5d9e4ab485b65cba33d83c3b P 8bbff56d78544420af697aec65b316a3: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 12:14:29.742064   367 raft_consensus.cc:359] T 0f63f46f5d9e4ab485b65cba33d83c3b P 8bbff56d78544420af697aec65b316a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:29.742573   367 raft_consensus.cc:385] T 0f63f46f5d9e4ab485b65cba33d83c3b P 8bbff56d78544420af697aec65b316a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:29.742797   367 raft_consensus.cc:740] T 0f63f46f5d9e4ab485b65cba33d83c3b P 8bbff56d78544420af697aec65b316a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bbff56d78544420af697aec65b316a3, State: Initialized, Role: FOLLOWER
I20260709 12:14:29.743467   367 consensus_queue.cc:260] T 0f63f46f5d9e4ab485b65cba33d83c3b P 8bbff56d78544420af697aec65b316a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:29.745198   367 ts_tablet_manager.cc:1434] T 0f63f46f5d9e4ab485b65cba33d83c3b P 8bbff56d78544420af697aec65b316a3: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:14:29.860806   371 raft_consensus.cc:493] T 0f63f46f5d9e4ab485b65cba33d83c3b P 10a56c552e37487a8966c512682ef9cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.861435   371 raft_consensus.cc:515] T 0f63f46f5d9e4ab485b65cba33d83c3b P 10a56c552e37487a8966c512682ef9cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:29.863770   371 leader_election.cc:290] T 0f63f46f5d9e4ab485b65cba33d83c3b P 10a56c552e37487a8966c512682ef9cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8503e8182df24f0785ec09456fc77984 (127.20.196.129:34575), 8bbff56d78544420af697aec65b316a3 (127.20.196.131:35939)
I20260709 12:14:29.873591 32643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f63f46f5d9e4ab485b65cba33d83c3b" candidate_uuid: "10a56c552e37487a8966c512682ef9cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8503e8182df24f0785ec09456fc77984" is_pre_election: true
I20260709 12:14:29.874329 32643 raft_consensus.cc:2468] T 0f63f46f5d9e4ab485b65cba33d83c3b P 8503e8182df24f0785ec09456fc77984 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10a56c552e37487a8966c512682ef9cd in term 0.
I20260709 12:14:29.875525   324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f63f46f5d9e4ab485b65cba33d83c3b" candidate_uuid: "10a56c552e37487a8966c512682ef9cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bbff56d78544420af697aec65b316a3" is_pre_election: true
I20260709 12:14:29.875787 32682 leader_election.cc:304] T 0f63f46f5d9e4ab485b65cba33d83c3b P 10a56c552e37487a8966c512682ef9cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10a56c552e37487a8966c512682ef9cd, 8503e8182df24f0785ec09456fc77984; no voters: 
I20260709 12:14:29.876309   324 raft_consensus.cc:2468] T 0f63f46f5d9e4ab485b65cba33d83c3b P 8bbff56d78544420af697aec65b316a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10a56c552e37487a8966c512682ef9cd in term 0.
I20260709 12:14:29.876616   371 raft_consensus.cc:2804] T 0f63f46f5d9e4ab485b65cba33d83c3b P 10a56c552e37487a8966c512682ef9cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:29.877023   371 raft_consensus.cc:493] T 0f63f46f5d9e4ab485b65cba33d83c3b P 10a56c552e37487a8966c512682ef9cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:29.877306   371 raft_consensus.cc:3060] T 0f63f46f5d9e4ab485b65cba33d83c3b P 10a56c552e37487a8966c512682ef9cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:29.882654   371 raft_consensus.cc:515] T 0f63f46f5d9e4ab485b65cba33d83c3b P 10a56c552e37487a8966c512682ef9cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:29.884289   371 leader_election.cc:290] T 0f63f46f5d9e4ab485b65cba33d83c3b P 10a56c552e37487a8966c512682ef9cd [CANDIDATE]: Term 1 election: Requested vote from peers 8503e8182df24f0785ec09456fc77984 (127.20.196.129:34575), 8bbff56d78544420af697aec65b316a3 (127.20.196.131:35939)
I20260709 12:14:29.885080 32643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f63f46f5d9e4ab485b65cba33d83c3b" candidate_uuid: "10a56c552e37487a8966c512682ef9cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8503e8182df24f0785ec09456fc77984"
I20260709 12:14:29.885464   324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f63f46f5d9e4ab485b65cba33d83c3b" candidate_uuid: "10a56c552e37487a8966c512682ef9cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bbff56d78544420af697aec65b316a3"
I20260709 12:14:29.885707 32643 raft_consensus.cc:3060] T 0f63f46f5d9e4ab485b65cba33d83c3b P 8503e8182df24f0785ec09456fc77984 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:29.886046   324 raft_consensus.cc:3060] T 0f63f46f5d9e4ab485b65cba33d83c3b P 8bbff56d78544420af697aec65b316a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:29.891381 32643 raft_consensus.cc:2468] T 0f63f46f5d9e4ab485b65cba33d83c3b P 8503e8182df24f0785ec09456fc77984 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10a56c552e37487a8966c512682ef9cd in term 1.
I20260709 12:14:29.891520   324 raft_consensus.cc:2468] T 0f63f46f5d9e4ab485b65cba33d83c3b P 8bbff56d78544420af697aec65b316a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10a56c552e37487a8966c512682ef9cd in term 1.
I20260709 12:14:29.892620 32682 leader_election.cc:304] T 0f63f46f5d9e4ab485b65cba33d83c3b P 10a56c552e37487a8966c512682ef9cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10a56c552e37487a8966c512682ef9cd, 8503e8182df24f0785ec09456fc77984; no voters: 
I20260709 12:14:29.893309   371 raft_consensus.cc:2804] T 0f63f46f5d9e4ab485b65cba33d83c3b P 10a56c552e37487a8966c512682ef9cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:29.894301   371 raft_consensus.cc:697] T 0f63f46f5d9e4ab485b65cba33d83c3b P 10a56c552e37487a8966c512682ef9cd [term 1 LEADER]: Becoming Leader. State: Replica: 10a56c552e37487a8966c512682ef9cd, State: Running, Role: LEADER
I20260709 12:14:29.895033   371 consensus_queue.cc:237] T 0f63f46f5d9e4ab485b65cba33d83c3b P 10a56c552e37487a8966c512682ef9cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:29.902387 32540 catalog_manager.cc:5697] T 0f63f46f5d9e4ab485b65cba33d83c3b P 10a56c552e37487a8966c512682ef9cd reported cstate change: term changed from 0 to 1, leader changed from <none> to 10a56c552e37487a8966c512682ef9cd (127.20.196.130). New cstate: current_term: 1 leader_uuid: "10a56c552e37487a8966c512682ef9cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:29.991318   369 raft_consensus.cc:493] T 49c7c074b1f9451488656eee9848b339 P 8503e8182df24f0785ec09456fc77984 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.991881   369 raft_consensus.cc:515] T 49c7c074b1f9451488656eee9848b339 P 8503e8182df24f0785ec09456fc77984 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:29.994171   369 leader_election.cc:290] T 49c7c074b1f9451488656eee9848b339 P 8503e8182df24f0785ec09456fc77984 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10a56c552e37487a8966c512682ef9cd (127.20.196.130:40383), 8bbff56d78544420af697aec65b316a3 (127.20.196.131:35939)
I20260709 12:14:30.004565 32718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c7c074b1f9451488656eee9848b339" candidate_uuid: "8503e8182df24f0785ec09456fc77984" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10a56c552e37487a8966c512682ef9cd" is_pre_election: true
I20260709 12:14:30.005373 32718 raft_consensus.cc:2468] T 49c7c074b1f9451488656eee9848b339 P 10a56c552e37487a8966c512682ef9cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8503e8182df24f0785ec09456fc77984 in term 0.
I20260709 12:14:30.005710   324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c7c074b1f9451488656eee9848b339" candidate_uuid: "8503e8182df24f0785ec09456fc77984" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bbff56d78544420af697aec65b316a3" is_pre_election: true
I20260709 12:14:30.006417   324 raft_consensus.cc:2468] T 49c7c074b1f9451488656eee9848b339 P 8bbff56d78544420af697aec65b316a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8503e8182df24f0785ec09456fc77984 in term 0.
I20260709 12:14:30.006711 32608 leader_election.cc:304] T 49c7c074b1f9451488656eee9848b339 P 8503e8182df24f0785ec09456fc77984 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10a56c552e37487a8966c512682ef9cd, 8503e8182df24f0785ec09456fc77984; no voters: 
I20260709 12:14:30.007529   369 raft_consensus.cc:2804] T 49c7c074b1f9451488656eee9848b339 P 8503e8182df24f0785ec09456fc77984 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:30.007845   369 raft_consensus.cc:493] T 49c7c074b1f9451488656eee9848b339 P 8503e8182df24f0785ec09456fc77984 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:30.008085   369 raft_consensus.cc:3060] T 49c7c074b1f9451488656eee9848b339 P 8503e8182df24f0785ec09456fc77984 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:30.013616   369 raft_consensus.cc:515] T 49c7c074b1f9451488656eee9848b339 P 8503e8182df24f0785ec09456fc77984 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:30.015488   369 leader_election.cc:290] T 49c7c074b1f9451488656eee9848b339 P 8503e8182df24f0785ec09456fc77984 [CANDIDATE]: Term 1 election: Requested vote from peers 10a56c552e37487a8966c512682ef9cd (127.20.196.130:40383), 8bbff56d78544420af697aec65b316a3 (127.20.196.131:35939)
I20260709 12:14:30.016496 32718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c7c074b1f9451488656eee9848b339" candidate_uuid: "8503e8182df24f0785ec09456fc77984" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10a56c552e37487a8966c512682ef9cd"
I20260709 12:14:30.016780   324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c7c074b1f9451488656eee9848b339" candidate_uuid: "8503e8182df24f0785ec09456fc77984" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bbff56d78544420af697aec65b316a3"
I20260709 12:14:30.017131 32718 raft_consensus.cc:3060] T 49c7c074b1f9451488656eee9848b339 P 10a56c552e37487a8966c512682ef9cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:30.017447   324 raft_consensus.cc:3060] T 49c7c074b1f9451488656eee9848b339 P 8bbff56d78544420af697aec65b316a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:30.022745 32718 raft_consensus.cc:2468] T 49c7c074b1f9451488656eee9848b339 P 10a56c552e37487a8966c512682ef9cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8503e8182df24f0785ec09456fc77984 in term 1.
I20260709 12:14:30.023065   324 raft_consensus.cc:2468] T 49c7c074b1f9451488656eee9848b339 P 8bbff56d78544420af697aec65b316a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8503e8182df24f0785ec09456fc77984 in term 1.
I20260709 12:14:30.023970 32608 leader_election.cc:304] T 49c7c074b1f9451488656eee9848b339 P 8503e8182df24f0785ec09456fc77984 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10a56c552e37487a8966c512682ef9cd, 8503e8182df24f0785ec09456fc77984; no voters: 
I20260709 12:14:30.024596   369 raft_consensus.cc:2804] T 49c7c074b1f9451488656eee9848b339 P 8503e8182df24f0785ec09456fc77984 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:30.025524   369 raft_consensus.cc:697] T 49c7c074b1f9451488656eee9848b339 P 8503e8182df24f0785ec09456fc77984 [term 1 LEADER]: Becoming Leader. State: Replica: 8503e8182df24f0785ec09456fc77984, State: Running, Role: LEADER
I20260709 12:14:30.026294   369 consensus_queue.cc:237] T 49c7c074b1f9451488656eee9848b339 P 8503e8182df24f0785ec09456fc77984 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:30.033094 32540 catalog_manager.cc:5697] T 49c7c074b1f9451488656eee9848b339 P 8503e8182df24f0785ec09456fc77984 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8503e8182df24f0785ec09456fc77984 (127.20.196.129). New cstate: current_term: 1 leader_uuid: "8503e8182df24f0785ec09456fc77984" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:30.110320 32540 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36730:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:14:30.112368 32540 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260709 12:14:30.129143 32589 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:30.138067 32632 tablet_service.cc:1511] Processing CreateTablet for tablet a0b1fb2f9e444b70b7b5b3262faf3a8d (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=4ec0e4f5bd2744faa1994e8d7da349cb]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:14:30.139142 32707 tablet_service.cc:1511] Processing CreateTablet for tablet a0b1fb2f9e444b70b7b5b3262faf3a8d (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=4ec0e4f5bd2744faa1994e8d7da349cb]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:14:30.139495 32632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0b1fb2f9e444b70b7b5b3262faf3a8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:30.140437 32707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0b1fb2f9e444b70b7b5b3262faf3a8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:30.142437   313 tablet_service.cc:1511] Processing CreateTablet for tablet a0b1fb2f9e444b70b7b5b3262faf3a8d (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=4ec0e4f5bd2744faa1994e8d7da349cb]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:14:30.142850 32633 tablet_service.cc:1511] Processing CreateTablet for tablet 5023cbec6af84cfc8ecef70591ce02d2 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=4ec0e4f5bd2744faa1994e8d7da349cb]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:14:30.143734   313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0b1fb2f9e444b70b7b5b3262faf3a8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:30.144114 32633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5023cbec6af84cfc8ecef70591ce02d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:30.153585 32708 tablet_service.cc:1511] Processing CreateTablet for tablet 5023cbec6af84cfc8ecef70591ce02d2 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=4ec0e4f5bd2744faa1994e8d7da349cb]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:14:30.154963 32708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5023cbec6af84cfc8ecef70591ce02d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:30.155957   314 tablet_service.cc:1511] Processing CreateTablet for tablet 5023cbec6af84cfc8ecef70591ce02d2 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=4ec0e4f5bd2744faa1994e8d7da349cb]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:14:30.157277   314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5023cbec6af84cfc8ecef70591ce02d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:30.156349   365 tablet_bootstrap.cc:492] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8503e8182df24f0785ec09456fc77984: Bootstrap starting.
I20260709 12:14:30.164988   365 tablet_bootstrap.cc:654] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8503e8182df24f0785ec09456fc77984: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:30.172001   367 tablet_bootstrap.cc:492] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8bbff56d78544420af697aec65b316a3: Bootstrap starting.
I20260709 12:14:30.176776   364 tablet_bootstrap.cc:492] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 10a56c552e37487a8966c512682ef9cd: Bootstrap starting.
I20260709 12:14:30.178678   367 tablet_bootstrap.cc:654] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8bbff56d78544420af697aec65b316a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:30.179536   365 tablet_bootstrap.cc:492] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8503e8182df24f0785ec09456fc77984: No bootstrap required, opened a new log
I20260709 12:14:30.180140   365 ts_tablet_manager.cc:1403] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8503e8182df24f0785ec09456fc77984: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.002s
I20260709 12:14:30.183797   365 raft_consensus.cc:359] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8503e8182df24f0785ec09456fc77984 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:30.184629   365 raft_consensus.cc:385] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8503e8182df24f0785ec09456fc77984 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:30.184973   364 tablet_bootstrap.cc:654] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 10a56c552e37487a8966c512682ef9cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:30.184969   365 raft_consensus.cc:740] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8503e8182df24f0785ec09456fc77984 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8503e8182df24f0785ec09456fc77984, State: Initialized, Role: FOLLOWER
I20260709 12:14:30.185725   367 tablet_bootstrap.cc:492] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8bbff56d78544420af697aec65b316a3: No bootstrap required, opened a new log
I20260709 12:14:30.186240   367 ts_tablet_manager.cc:1403] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8bbff56d78544420af697aec65b316a3: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 12:14:30.186182   365 consensus_queue.cc:260] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8503e8182df24f0785ec09456fc77984 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:30.188728   365 ts_tablet_manager.cc:1434] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8503e8182df24f0785ec09456fc77984: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:14:30.189776   365 tablet_bootstrap.cc:492] T 5023cbec6af84cfc8ecef70591ce02d2 P 8503e8182df24f0785ec09456fc77984: Bootstrap starting.
I20260709 12:14:30.189558   367 raft_consensus.cc:359] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8bbff56d78544420af697aec65b316a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:30.190303   367 raft_consensus.cc:385] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8bbff56d78544420af697aec65b316a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:30.190594   367 raft_consensus.cc:740] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8bbff56d78544420af697aec65b316a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bbff56d78544420af697aec65b316a3, State: Initialized, Role: FOLLOWER
I20260709 12:14:30.191468   367 consensus_queue.cc:260] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8bbff56d78544420af697aec65b316a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:30.195796   367 ts_tablet_manager.cc:1434] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8bbff56d78544420af697aec65b316a3: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.004s
I20260709 12:14:30.196848   367 tablet_bootstrap.cc:492] T 5023cbec6af84cfc8ecef70591ce02d2 P 8bbff56d78544420af697aec65b316a3: Bootstrap starting.
I20260709 12:14:30.197057   365 tablet_bootstrap.cc:654] T 5023cbec6af84cfc8ecef70591ce02d2 P 8503e8182df24f0785ec09456fc77984: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:30.205307   367 tablet_bootstrap.cc:654] T 5023cbec6af84cfc8ecef70591ce02d2 P 8bbff56d78544420af697aec65b316a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:30.205468   364 tablet_bootstrap.cc:492] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 10a56c552e37487a8966c512682ef9cd: No bootstrap required, opened a new log
I20260709 12:14:30.206727   364 ts_tablet_manager.cc:1403] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 10a56c552e37487a8966c512682ef9cd: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.003s
I20260709 12:14:30.209911   364 raft_consensus.cc:359] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 10a56c552e37487a8966c512682ef9cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:30.210785   364 raft_consensus.cc:385] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 10a56c552e37487a8966c512682ef9cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:30.211179   364 raft_consensus.cc:740] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 10a56c552e37487a8966c512682ef9cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10a56c552e37487a8966c512682ef9cd, State: Initialized, Role: FOLLOWER
I20260709 12:14:30.212313   364 consensus_queue.cc:260] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 10a56c552e37487a8966c512682ef9cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:30.215348   364 ts_tablet_manager.cc:1434] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 10a56c552e37487a8966c512682ef9cd: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.006s
I20260709 12:14:30.215888   367 tablet_bootstrap.cc:492] T 5023cbec6af84cfc8ecef70591ce02d2 P 8bbff56d78544420af697aec65b316a3: No bootstrap required, opened a new log
I20260709 12:14:30.215891   365 tablet_bootstrap.cc:492] T 5023cbec6af84cfc8ecef70591ce02d2 P 8503e8182df24f0785ec09456fc77984: No bootstrap required, opened a new log
I20260709 12:14:30.216449   364 tablet_bootstrap.cc:492] T 5023cbec6af84cfc8ecef70591ce02d2 P 10a56c552e37487a8966c512682ef9cd: Bootstrap starting.
I20260709 12:14:30.216737   365 ts_tablet_manager.cc:1403] T 5023cbec6af84cfc8ecef70591ce02d2 P 8503e8182df24f0785ec09456fc77984: Time spent bootstrapping tablet: real 0.027s	user 0.022s	sys 0.004s
I20260709 12:14:30.216681   367 ts_tablet_manager.cc:1403] T 5023cbec6af84cfc8ecef70591ce02d2 P 8bbff56d78544420af697aec65b316a3: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.008s
I20260709 12:14:30.220224   365 raft_consensus.cc:359] T 5023cbec6af84cfc8ecef70591ce02d2 P 8503e8182df24f0785ec09456fc77984 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:30.221024   365 raft_consensus.cc:385] T 5023cbec6af84cfc8ecef70591ce02d2 P 8503e8182df24f0785ec09456fc77984 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:30.221473   365 raft_consensus.cc:740] T 5023cbec6af84cfc8ecef70591ce02d2 P 8503e8182df24f0785ec09456fc77984 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8503e8182df24f0785ec09456fc77984, State: Initialized, Role: FOLLOWER
I20260709 12:14:30.221072   367 raft_consensus.cc:359] T 5023cbec6af84cfc8ecef70591ce02d2 P 8bbff56d78544420af697aec65b316a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:30.222031   367 raft_consensus.cc:385] T 5023cbec6af84cfc8ecef70591ce02d2 P 8bbff56d78544420af697aec65b316a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:30.222405   367 raft_consensus.cc:740] T 5023cbec6af84cfc8ecef70591ce02d2 P 8bbff56d78544420af697aec65b316a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bbff56d78544420af697aec65b316a3, State: Initialized, Role: FOLLOWER
I20260709 12:14:30.222456   365 consensus_queue.cc:260] T 5023cbec6af84cfc8ecef70591ce02d2 P 8503e8182df24f0785ec09456fc77984 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:30.223887   364 tablet_bootstrap.cc:654] T 5023cbec6af84cfc8ecef70591ce02d2 P 10a56c552e37487a8966c512682ef9cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:30.223562   367 consensus_queue.cc:260] T 5023cbec6af84cfc8ecef70591ce02d2 P 8bbff56d78544420af697aec65b316a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:30.227202   365 ts_tablet_manager.cc:1434] T 5023cbec6af84cfc8ecef70591ce02d2 P 8503e8182df24f0785ec09456fc77984: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:14:30.231202   367 ts_tablet_manager.cc:1434] T 5023cbec6af84cfc8ecef70591ce02d2 P 8bbff56d78544420af697aec65b316a3: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.003s
I20260709 12:14:30.232987   364 tablet_bootstrap.cc:492] T 5023cbec6af84cfc8ecef70591ce02d2 P 10a56c552e37487a8966c512682ef9cd: No bootstrap required, opened a new log
I20260709 12:14:30.233589   364 ts_tablet_manager.cc:1403] T 5023cbec6af84cfc8ecef70591ce02d2 P 10a56c552e37487a8966c512682ef9cd: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.001s
I20260709 12:14:30.236627   364 raft_consensus.cc:359] T 5023cbec6af84cfc8ecef70591ce02d2 P 10a56c552e37487a8966c512682ef9cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:30.237337   364 raft_consensus.cc:385] T 5023cbec6af84cfc8ecef70591ce02d2 P 10a56c552e37487a8966c512682ef9cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:30.237628   364 raft_consensus.cc:740] T 5023cbec6af84cfc8ecef70591ce02d2 P 10a56c552e37487a8966c512682ef9cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10a56c552e37487a8966c512682ef9cd, State: Initialized, Role: FOLLOWER
I20260709 12:14:30.238220   364 consensus_queue.cc:260] T 5023cbec6af84cfc8ecef70591ce02d2 P 10a56c552e37487a8966c512682ef9cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:30.240641   364 ts_tablet_manager.cc:1434] T 5023cbec6af84cfc8ecef70591ce02d2 P 10a56c552e37487a8966c512682ef9cd: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:14:30.266786   371 raft_consensus.cc:493] T 5023cbec6af84cfc8ecef70591ce02d2 P 10a56c552e37487a8966c512682ef9cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.267062   369 raft_consensus.cc:493] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8503e8182df24f0785ec09456fc77984 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.267411   371 raft_consensus.cc:515] T 5023cbec6af84cfc8ecef70591ce02d2 P 10a56c552e37487a8966c512682ef9cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:30.267657   369 raft_consensus.cc:515] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8503e8182df24f0785ec09456fc77984 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:30.269531   369 leader_election.cc:290] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8503e8182df24f0785ec09456fc77984 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10a56c552e37487a8966c512682ef9cd (127.20.196.130:40383), 8bbff56d78544420af697aec65b316a3 (127.20.196.131:35939)
I20260709 12:14:30.270411 32643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5023cbec6af84cfc8ecef70591ce02d2" candidate_uuid: "10a56c552e37487a8966c512682ef9cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8503e8182df24f0785ec09456fc77984" is_pre_election: true
I20260709 12:14:30.270411 32718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b1fb2f9e444b70b7b5b3262faf3a8d" candidate_uuid: "8503e8182df24f0785ec09456fc77984" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10a56c552e37487a8966c512682ef9cd" is_pre_election: true
I20260709 12:14:30.271160   324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b1fb2f9e444b70b7b5b3262faf3a8d" candidate_uuid: "8503e8182df24f0785ec09456fc77984" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bbff56d78544420af697aec65b316a3" is_pre_election: true
I20260709 12:14:30.270503   371 leader_election.cc:290] T 5023cbec6af84cfc8ecef70591ce02d2 P 10a56c552e37487a8966c512682ef9cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8503e8182df24f0785ec09456fc77984 (127.20.196.129:34575), 8bbff56d78544420af697aec65b316a3 (127.20.196.131:35939)
I20260709 12:14:30.271247   323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5023cbec6af84cfc8ecef70591ce02d2" candidate_uuid: "10a56c552e37487a8966c512682ef9cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bbff56d78544420af697aec65b316a3" is_pre_election: true
I20260709 12:14:30.271255 32643 raft_consensus.cc:2468] T 5023cbec6af84cfc8ecef70591ce02d2 P 8503e8182df24f0785ec09456fc77984 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10a56c552e37487a8966c512682ef9cd in term 0.
I20260709 12:14:30.271932   324 raft_consensus.cc:2468] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8bbff56d78544420af697aec65b316a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8503e8182df24f0785ec09456fc77984 in term 0.
I20260709 12:14:30.271332 32718 raft_consensus.cc:2468] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 10a56c552e37487a8966c512682ef9cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8503e8182df24f0785ec09456fc77984 in term 0.
I20260709 12:14:30.272300   323 raft_consensus.cc:2468] T 5023cbec6af84cfc8ecef70591ce02d2 P 8bbff56d78544420af697aec65b316a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10a56c552e37487a8966c512682ef9cd in term 0.
I20260709 12:14:30.273459 32682 leader_election.cc:304] T 5023cbec6af84cfc8ecef70591ce02d2 P 10a56c552e37487a8966c512682ef9cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10a56c552e37487a8966c512682ef9cd, 8503e8182df24f0785ec09456fc77984; no voters: 
I20260709 12:14:30.273455 32608 leader_election.cc:304] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8503e8182df24f0785ec09456fc77984 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10a56c552e37487a8966c512682ef9cd, 8503e8182df24f0785ec09456fc77984; no voters: 
I20260709 12:14:30.274473   369 raft_consensus.cc:2804] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8503e8182df24f0785ec09456fc77984 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:30.274711   371 raft_consensus.cc:2804] T 5023cbec6af84cfc8ecef70591ce02d2 P 10a56c552e37487a8966c512682ef9cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:30.274868   369 raft_consensus.cc:493] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8503e8182df24f0785ec09456fc77984 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:30.275235   371 raft_consensus.cc:493] T 5023cbec6af84cfc8ecef70591ce02d2 P 10a56c552e37487a8966c512682ef9cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:30.275454   369 raft_consensus.cc:3060] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8503e8182df24f0785ec09456fc77984 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:30.275650   371 raft_consensus.cc:3060] T 5023cbec6af84cfc8ecef70591ce02d2 P 10a56c552e37487a8966c512682ef9cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:30.280781   371 raft_consensus.cc:515] T 5023cbec6af84cfc8ecef70591ce02d2 P 10a56c552e37487a8966c512682ef9cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:30.280792   369 raft_consensus.cc:515] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8503e8182df24f0785ec09456fc77984 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:30.282604   371 leader_election.cc:290] T 5023cbec6af84cfc8ecef70591ce02d2 P 10a56c552e37487a8966c512682ef9cd [CANDIDATE]: Term 1 election: Requested vote from peers 8503e8182df24f0785ec09456fc77984 (127.20.196.129:34575), 8bbff56d78544420af697aec65b316a3 (127.20.196.131:35939)
I20260709 12:14:30.282636   369 leader_election.cc:290] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8503e8182df24f0785ec09456fc77984 [CANDIDATE]: Term 1 election: Requested vote from peers 10a56c552e37487a8966c512682ef9cd (127.20.196.130:40383), 8bbff56d78544420af697aec65b316a3 (127.20.196.131:35939)
I20260709 12:14:30.283397 32643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5023cbec6af84cfc8ecef70591ce02d2" candidate_uuid: "10a56c552e37487a8966c512682ef9cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8503e8182df24f0785ec09456fc77984"
I20260709 12:14:30.283844   323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b1fb2f9e444b70b7b5b3262faf3a8d" candidate_uuid: "8503e8182df24f0785ec09456fc77984" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bbff56d78544420af697aec65b316a3"
I20260709 12:14:30.283993 32643 raft_consensus.cc:3060] T 5023cbec6af84cfc8ecef70591ce02d2 P 8503e8182df24f0785ec09456fc77984 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:30.284041 32718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b1fb2f9e444b70b7b5b3262faf3a8d" candidate_uuid: "8503e8182df24f0785ec09456fc77984" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10a56c552e37487a8966c512682ef9cd"
I20260709 12:14:30.284236   324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5023cbec6af84cfc8ecef70591ce02d2" candidate_uuid: "10a56c552e37487a8966c512682ef9cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bbff56d78544420af697aec65b316a3"
I20260709 12:14:30.284428   323 raft_consensus.cc:3060] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8bbff56d78544420af697aec65b316a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:30.284849 32718 raft_consensus.cc:3060] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 10a56c552e37487a8966c512682ef9cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:30.284981   324 raft_consensus.cc:3060] T 5023cbec6af84cfc8ecef70591ce02d2 P 8bbff56d78544420af697aec65b316a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:30.291518 32643 raft_consensus.cc:2468] T 5023cbec6af84cfc8ecef70591ce02d2 P 8503e8182df24f0785ec09456fc77984 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10a56c552e37487a8966c512682ef9cd in term 1.
I20260709 12:14:30.291932   323 raft_consensus.cc:2468] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8bbff56d78544420af697aec65b316a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8503e8182df24f0785ec09456fc77984 in term 1.
I20260709 12:14:30.292064   324 raft_consensus.cc:2468] T 5023cbec6af84cfc8ecef70591ce02d2 P 8bbff56d78544420af697aec65b316a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10a56c552e37487a8966c512682ef9cd in term 1.
I20260709 12:14:30.292064 32718 raft_consensus.cc:2468] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 10a56c552e37487a8966c512682ef9cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8503e8182df24f0785ec09456fc77984 in term 1.
I20260709 12:14:30.292990 32682 leader_election.cc:304] T 5023cbec6af84cfc8ecef70591ce02d2 P 10a56c552e37487a8966c512682ef9cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10a56c552e37487a8966c512682ef9cd, 8503e8182df24f0785ec09456fc77984; no voters: 
I20260709 12:14:30.293344 32608 leader_election.cc:304] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8503e8182df24f0785ec09456fc77984 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8503e8182df24f0785ec09456fc77984, 8bbff56d78544420af697aec65b316a3; no voters: 
I20260709 12:14:30.293888   371 raft_consensus.cc:2804] T 5023cbec6af84cfc8ecef70591ce02d2 P 10a56c552e37487a8966c512682ef9cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:30.294155   369 raft_consensus.cc:2804] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8503e8182df24f0785ec09456fc77984 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:30.294689   369 raft_consensus.cc:697] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8503e8182df24f0785ec09456fc77984 [term 1 LEADER]: Becoming Leader. State: Replica: 8503e8182df24f0785ec09456fc77984, State: Running, Role: LEADER
I20260709 12:14:30.294432   371 raft_consensus.cc:697] T 5023cbec6af84cfc8ecef70591ce02d2 P 10a56c552e37487a8966c512682ef9cd [term 1 LEADER]: Becoming Leader. State: Replica: 10a56c552e37487a8966c512682ef9cd, State: Running, Role: LEADER
I20260709 12:14:30.295547   369 consensus_queue.cc:237] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8503e8182df24f0785ec09456fc77984 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:30.295761   371 consensus_queue.cc:237] T 5023cbec6af84cfc8ecef70591ce02d2 P 10a56c552e37487a8966c512682ef9cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:30.303951 32539 catalog_manager.cc:5697] T 5023cbec6af84cfc8ecef70591ce02d2 P 10a56c552e37487a8966c512682ef9cd reported cstate change: term changed from 0 to 1, leader changed from <none> to 10a56c552e37487a8966c512682ef9cd (127.20.196.130). New cstate: current_term: 1 leader_uuid: "10a56c552e37487a8966c512682ef9cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:30.304621 32538 catalog_manager.cc:5697] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8503e8182df24f0785ec09456fc77984 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8503e8182df24f0785ec09456fc77984 (127.20.196.129). New cstate: current_term: 1 leader_uuid: "8503e8182df24f0785ec09456fc77984" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:30.349647 32718 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f63f46f5d9e4ab485b65cba33d83c3b"
dest_uuid: "10a56c552e37487a8966c512682ef9cd"
mode: GRACEFUL
new_leader_uuid: "8503e8182df24f0785ec09456fc77984"
 from {username='slave'} at 127.0.0.1:42934
I20260709 12:14:30.350234 32718 raft_consensus.cc:606] T 0f63f46f5d9e4ab485b65cba33d83c3b P 10a56c552e37487a8966c512682ef9cd [term 1 LEADER]: Received request to transfer leadership to TS 8503e8182df24f0785ec09456fc77984
I20260709 12:14:30.363956 32643 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49c7c074b1f9451488656eee9848b339"
dest_uuid: "8503e8182df24f0785ec09456fc77984"
mode: GRACEFUL
new_leader_uuid: "10a56c552e37487a8966c512682ef9cd"
 from {username='slave'} at 127.0.0.1:45652
I20260709 12:14:30.364481 32643 raft_consensus.cc:606] T 49c7c074b1f9451488656eee9848b339 P 8503e8182df24f0785ec09456fc77984 [term 1 LEADER]: Received request to transfer leadership to TS 10a56c552e37487a8966c512682ef9cd
I20260709 12:14:30.372771 32718 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5023cbec6af84cfc8ecef70591ce02d2"
dest_uuid: "10a56c552e37487a8966c512682ef9cd"
mode: GRACEFUL
new_leader_uuid: "8503e8182df24f0785ec09456fc77984"
 from {username='slave'} at 127.0.0.1:42934
I20260709 12:14:30.373288 32718 raft_consensus.cc:606] T 5023cbec6af84cfc8ecef70591ce02d2 P 10a56c552e37487a8966c512682ef9cd [term 1 LEADER]: Received request to transfer leadership to TS 8503e8182df24f0785ec09456fc77984
I20260709 12:14:30.388103   371 consensus_queue.cc:1048] T 0f63f46f5d9e4ab485b65cba33d83c3b P 10a56c552e37487a8966c512682ef9cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:30.404417   371 consensus_queue.cc:1048] T 0f63f46f5d9e4ab485b65cba33d83c3b P 10a56c552e37487a8966c512682ef9cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:30.415230   381 consensus_queue.cc:1048] T 49c7c074b1f9451488656eee9848b339 P 8503e8182df24f0785ec09456fc77984 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:30.426924   401 raft_consensus.cc:993] T 0f63f46f5d9e4ab485b65cba33d83c3b P 10a56c552e37487a8966c512682ef9cd: : Instructing follower 8503e8182df24f0785ec09456fc77984 to start an election
I20260709 12:14:30.428059   401 raft_consensus.cc:1081] T 0f63f46f5d9e4ab485b65cba33d83c3b P 10a56c552e37487a8966c512682ef9cd [term 1 LEADER]: Signalling peer 8503e8182df24f0785ec09456fc77984 to start an election
I20260709 12:14:30.430402 32643 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f63f46f5d9e4ab485b65cba33d83c3b"
dest_uuid: "8503e8182df24f0785ec09456fc77984"
 from {username='slave'} at 127.0.0.1:45640
I20260709 12:14:30.430974 32643 raft_consensus.cc:493] T 0f63f46f5d9e4ab485b65cba33d83c3b P 8503e8182df24f0785ec09456fc77984 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:30.431396 32643 raft_consensus.cc:3060] T 0f63f46f5d9e4ab485b65cba33d83c3b P 8503e8182df24f0785ec09456fc77984 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:30.436383   369 raft_consensus.cc:993] T 49c7c074b1f9451488656eee9848b339 P 8503e8182df24f0785ec09456fc77984: : Instructing follower 10a56c552e37487a8966c512682ef9cd to start an election
I20260709 12:14:30.436892   381 raft_consensus.cc:1081] T 49c7c074b1f9451488656eee9848b339 P 8503e8182df24f0785ec09456fc77984 [term 1 LEADER]: Signalling peer 10a56c552e37487a8966c512682ef9cd to start an election
I20260709 12:14:30.437791 32643 raft_consensus.cc:515] T 0f63f46f5d9e4ab485b65cba33d83c3b P 8503e8182df24f0785ec09456fc77984 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:30.439242 32718 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49c7c074b1f9451488656eee9848b339"
dest_uuid: "10a56c552e37487a8966c512682ef9cd"
 from {username='slave'} at 127.0.0.1:42932
I20260709 12:14:30.439955 32718 raft_consensus.cc:493] T 49c7c074b1f9451488656eee9848b339 P 10a56c552e37487a8966c512682ef9cd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:30.440080 32643 leader_election.cc:290] T 0f63f46f5d9e4ab485b65cba33d83c3b P 8503e8182df24f0785ec09456fc77984 [CANDIDATE]: Term 2 election: Requested vote from peers 10a56c552e37487a8966c512682ef9cd (127.20.196.130:40383), 8bbff56d78544420af697aec65b316a3 (127.20.196.131:35939)
I20260709 12:14:30.440368 32718 raft_consensus.cc:3060] T 49c7c074b1f9451488656eee9848b339 P 10a56c552e37487a8966c512682ef9cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:30.442003   323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f63f46f5d9e4ab485b65cba33d83c3b" candidate_uuid: "8503e8182df24f0785ec09456fc77984" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8bbff56d78544420af697aec65b316a3"
I20260709 12:14:30.442561   323 raft_consensus.cc:3060] T 0f63f46f5d9e4ab485b65cba33d83c3b P 8bbff56d78544420af697aec65b316a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:30.442533 32717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f63f46f5d9e4ab485b65cba33d83c3b" candidate_uuid: "8503e8182df24f0785ec09456fc77984" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10a56c552e37487a8966c512682ef9cd"
I20260709 12:14:30.443615 32717 raft_consensus.cc:3055] T 0f63f46f5d9e4ab485b65cba33d83c3b P 10a56c552e37487a8966c512682ef9cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:30.443940 32717 raft_consensus.cc:740] T 0f63f46f5d9e4ab485b65cba33d83c3b P 10a56c552e37487a8966c512682ef9cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10a56c552e37487a8966c512682ef9cd, State: Running, Role: LEADER
I20260709 12:14:30.444746 32717 consensus_queue.cc:260] T 0f63f46f5d9e4ab485b65cba33d83c3b P 10a56c552e37487a8966c512682ef9cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:30.446070 32717 raft_consensus.cc:3060] T 0f63f46f5d9e4ab485b65cba33d83c3b P 10a56c552e37487a8966c512682ef9cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:30.449570   323 raft_consensus.cc:2468] T 0f63f46f5d9e4ab485b65cba33d83c3b P 8bbff56d78544420af697aec65b316a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8503e8182df24f0785ec09456fc77984 in term 2.
I20260709 12:14:30.450917 32608 leader_election.cc:304] T 0f63f46f5d9e4ab485b65cba33d83c3b P 8503e8182df24f0785ec09456fc77984 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8503e8182df24f0785ec09456fc77984, 8bbff56d78544420af697aec65b316a3; no voters: 
I20260709 12:14:30.452280   381 consensus_queue.cc:1048] T 49c7c074b1f9451488656eee9848b339 P 8503e8182df24f0785ec09456fc77984 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:30.452343 32718 raft_consensus.cc:515] T 49c7c074b1f9451488656eee9848b339 P 10a56c552e37487a8966c512682ef9cd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:30.453644   381 raft_consensus.cc:2804] T 0f63f46f5d9e4ab485b65cba33d83c3b P 8503e8182df24f0785ec09456fc77984 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:30.454095   381 raft_consensus.cc:697] T 0f63f46f5d9e4ab485b65cba33d83c3b P 8503e8182df24f0785ec09456fc77984 [term 2 LEADER]: Becoming Leader. State: Replica: 8503e8182df24f0785ec09456fc77984, State: Running, Role: LEADER
I20260709 12:14:30.455120 32718 leader_election.cc:290] T 49c7c074b1f9451488656eee9848b339 P 10a56c552e37487a8966c512682ef9cd [CANDIDATE]: Term 2 election: Requested vote from peers 8503e8182df24f0785ec09456fc77984 (127.20.196.129:34575), 8bbff56d78544420af697aec65b316a3 (127.20.196.131:35939)
I20260709 12:14:30.455875 32643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c7c074b1f9451488656eee9848b339" candidate_uuid: "10a56c552e37487a8966c512682ef9cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8503e8182df24f0785ec09456fc77984"
I20260709 12:14:30.456092   323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c7c074b1f9451488656eee9848b339" candidate_uuid: "10a56c552e37487a8966c512682ef9cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8bbff56d78544420af697aec65b316a3"
I20260709 12:14:30.456734   323 raft_consensus.cc:3060] T 49c7c074b1f9451488656eee9848b339 P 8bbff56d78544420af697aec65b316a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:30.463725   323 raft_consensus.cc:2468] T 49c7c074b1f9451488656eee9848b339 P 8bbff56d78544420af697aec65b316a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10a56c552e37487a8966c512682ef9cd in term 2.
I20260709 12:14:30.464758 32683 leader_election.cc:304] T 49c7c074b1f9451488656eee9848b339 P 10a56c552e37487a8966c512682ef9cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10a56c552e37487a8966c512682ef9cd, 8bbff56d78544420af697aec65b316a3; no voters: 
I20260709 12:14:30.465530   371 raft_consensus.cc:2804] T 49c7c074b1f9451488656eee9848b339 P 10a56c552e37487a8966c512682ef9cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:30.454900   381 consensus_queue.cc:237] T 0f63f46f5d9e4ab485b65cba33d83c3b P 8503e8182df24f0785ec09456fc77984 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:30.465998   371 raft_consensus.cc:697] T 49c7c074b1f9451488656eee9848b339 P 10a56c552e37487a8966c512682ef9cd [term 2 LEADER]: Becoming Leader. State: Replica: 10a56c552e37487a8966c512682ef9cd, State: Running, Role: LEADER
I20260709 12:14:30.466920   371 consensus_queue.cc:237] T 49c7c074b1f9451488656eee9848b339 P 10a56c552e37487a8966c512682ef9cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:30.475844 32717 raft_consensus.cc:2468] T 0f63f46f5d9e4ab485b65cba33d83c3b P 10a56c552e37487a8966c512682ef9cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8503e8182df24f0785ec09456fc77984 in term 2.
I20260709 12:14:30.476626 32541 catalog_manager.cc:5697] T 49c7c074b1f9451488656eee9848b339 P 10a56c552e37487a8966c512682ef9cd reported cstate change: term changed from 1 to 2, leader changed from 8503e8182df24f0785ec09456fc77984 (127.20.196.129) to 10a56c552e37487a8966c512682ef9cd (127.20.196.130). New cstate: current_term: 2 leader_uuid: "10a56c552e37487a8966c512682ef9cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:30.476667 32540 catalog_manager.cc:5697] T 0f63f46f5d9e4ab485b65cba33d83c3b P 8503e8182df24f0785ec09456fc77984 reported cstate change: term changed from 1 to 2, leader changed from 10a56c552e37487a8966c512682ef9cd (127.20.196.130) to 8503e8182df24f0785ec09456fc77984 (127.20.196.129). New cstate: current_term: 2 leader_uuid: "8503e8182df24f0785ec09456fc77984" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:30.480398 32643 raft_consensus.cc:3055] T 49c7c074b1f9451488656eee9848b339 P 8503e8182df24f0785ec09456fc77984 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:30.480926 32643 raft_consensus.cc:740] T 49c7c074b1f9451488656eee9848b339 P 8503e8182df24f0785ec09456fc77984 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8503e8182df24f0785ec09456fc77984, State: Running, Role: LEADER
I20260709 12:14:30.482148 32643 consensus_queue.cc:260] T 49c7c074b1f9451488656eee9848b339 P 8503e8182df24f0785ec09456fc77984 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:30.483431 32643 raft_consensus.cc:3060] T 49c7c074b1f9451488656eee9848b339 P 8503e8182df24f0785ec09456fc77984 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:30.494586 32643 raft_consensus.cc:2468] T 49c7c074b1f9451488656eee9848b339 P 8503e8182df24f0785ec09456fc77984 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10a56c552e37487a8966c512682ef9cd in term 2.
W20260709 12:14:30.495234 32608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:35939, user_credentials={real_user=slave}} blocked reactor thread for 44410.6us
I20260709 12:14:30.497326   323 raft_consensus.cc:1240] T 49c7c074b1f9451488656eee9848b339 P 8bbff56d78544420af697aec65b316a3 [term 2 FOLLOWER]: Rejecting Update request from peer 8503e8182df24f0785ec09456fc77984 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:14:30.498227 32717 raft_consensus.cc:1240] T 49c7c074b1f9451488656eee9848b339 P 10a56c552e37487a8966c512682ef9cd [term 2 LEADER]: Rejecting Update request from peer 8503e8182df24f0785ec09456fc77984 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:30.741349   371 consensus_queue.cc:1048] T 5023cbec6af84cfc8ecef70591ce02d2 P 10a56c552e37487a8966c512682ef9cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:30.751983   371 consensus_queue.cc:1048] T 5023cbec6af84cfc8ecef70591ce02d2 P 10a56c552e37487a8966c512682ef9cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:30.759267   371 raft_consensus.cc:993] T 5023cbec6af84cfc8ecef70591ce02d2 P 10a56c552e37487a8966c512682ef9cd: : Instructing follower 8503e8182df24f0785ec09456fc77984 to start an election
I20260709 12:14:30.759773   410 raft_consensus.cc:1081] T 5023cbec6af84cfc8ecef70591ce02d2 P 10a56c552e37487a8966c512682ef9cd [term 1 LEADER]: Signalling peer 8503e8182df24f0785ec09456fc77984 to start an election
I20260709 12:14:30.761529 32643 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5023cbec6af84cfc8ecef70591ce02d2"
dest_uuid: "8503e8182df24f0785ec09456fc77984"
 from {username='slave'} at 127.0.0.1:45640
I20260709 12:14:30.762032 32643 raft_consensus.cc:493] T 5023cbec6af84cfc8ecef70591ce02d2 P 8503e8182df24f0785ec09456fc77984 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:30.762439 32643 raft_consensus.cc:3060] T 5023cbec6af84cfc8ecef70591ce02d2 P 8503e8182df24f0785ec09456fc77984 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:30.767594 32643 raft_consensus.cc:515] T 5023cbec6af84cfc8ecef70591ce02d2 P 8503e8182df24f0785ec09456fc77984 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:30.769608 32643 leader_election.cc:290] T 5023cbec6af84cfc8ecef70591ce02d2 P 8503e8182df24f0785ec09456fc77984 [CANDIDATE]: Term 2 election: Requested vote from peers 10a56c552e37487a8966c512682ef9cd (127.20.196.130:40383), 8bbff56d78544420af697aec65b316a3 (127.20.196.131:35939)
I20260709 12:14:30.770646   323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5023cbec6af84cfc8ecef70591ce02d2" candidate_uuid: "8503e8182df24f0785ec09456fc77984" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8bbff56d78544420af697aec65b316a3"
I20260709 12:14:30.770627 32717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5023cbec6af84cfc8ecef70591ce02d2" candidate_uuid: "8503e8182df24f0785ec09456fc77984" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10a56c552e37487a8966c512682ef9cd"
I20260709 12:14:30.771500   323 raft_consensus.cc:3060] T 5023cbec6af84cfc8ecef70591ce02d2 P 8bbff56d78544420af697aec65b316a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:30.771571 32717 raft_consensus.cc:3055] T 5023cbec6af84cfc8ecef70591ce02d2 P 10a56c552e37487a8966c512682ef9cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:30.772004 32717 raft_consensus.cc:740] T 5023cbec6af84cfc8ecef70591ce02d2 P 10a56c552e37487a8966c512682ef9cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10a56c552e37487a8966c512682ef9cd, State: Running, Role: LEADER
I20260709 12:14:30.772837 32717 consensus_queue.cc:260] T 5023cbec6af84cfc8ecef70591ce02d2 P 10a56c552e37487a8966c512682ef9cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:30.774124 32717 raft_consensus.cc:3060] T 5023cbec6af84cfc8ecef70591ce02d2 P 10a56c552e37487a8966c512682ef9cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:30.778656   323 raft_consensus.cc:2468] T 5023cbec6af84cfc8ecef70591ce02d2 P 8bbff56d78544420af697aec65b316a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8503e8182df24f0785ec09456fc77984 in term 2.
I20260709 12:14:30.779879 32608 leader_election.cc:304] T 5023cbec6af84cfc8ecef70591ce02d2 P 8503e8182df24f0785ec09456fc77984 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8503e8182df24f0785ec09456fc77984, 8bbff56d78544420af697aec65b316a3; no voters: 
I20260709 12:14:30.780684   408 raft_consensus.cc:2804] T 5023cbec6af84cfc8ecef70591ce02d2 P 8503e8182df24f0785ec09456fc77984 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:30.781121   408 raft_consensus.cc:697] T 5023cbec6af84cfc8ecef70591ce02d2 P 8503e8182df24f0785ec09456fc77984 [term 2 LEADER]: Becoming Leader. State: Replica: 8503e8182df24f0785ec09456fc77984, State: Running, Role: LEADER
I20260709 12:14:30.781183 32717 raft_consensus.cc:2468] T 5023cbec6af84cfc8ecef70591ce02d2 P 10a56c552e37487a8966c512682ef9cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8503e8182df24f0785ec09456fc77984 in term 2.
I20260709 12:14:30.782047   408 consensus_queue.cc:237] T 5023cbec6af84cfc8ecef70591ce02d2 P 8503e8182df24f0785ec09456fc77984 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:30.788736 32541 catalog_manager.cc:5697] T 5023cbec6af84cfc8ecef70591ce02d2 P 8503e8182df24f0785ec09456fc77984 reported cstate change: term changed from 1 to 2, leader changed from 10a56c552e37487a8966c512682ef9cd (127.20.196.130) to 8503e8182df24f0785ec09456fc77984 (127.20.196.129). New cstate: current_term: 2 leader_uuid: "8503e8182df24f0785ec09456fc77984" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:30.856860 21266 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:14:30.858457 21266 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:14:30.858868 21266 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:14:30.869938 32643 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0b1fb2f9e444b70b7b5b3262faf3a8d"
dest_uuid: "8503e8182df24f0785ec09456fc77984"
mode: GRACEFUL
new_leader_uuid: "8bbff56d78544420af697aec65b316a3"
 from {username='slave'} at 127.0.0.1:45668
I20260709 12:14:30.870441 32643 raft_consensus.cc:606] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8503e8182df24f0785ec09456fc77984 [term 1 LEADER]: Received request to transfer leadership to TS 8bbff56d78544420af697aec65b316a3
I20260709 12:14:30.871503 21266 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:14:30.881695   323 raft_consensus.cc:1275] T 0f63f46f5d9e4ab485b65cba33d83c3b P 8bbff56d78544420af697aec65b316a3 [term 2 FOLLOWER]: Refusing update from remote peer 8503e8182df24f0785ec09456fc77984: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:30.883045   408 consensus_queue.cc:1048] T 0f63f46f5d9e4ab485b65cba33d83c3b P 8503e8182df24f0785ec09456fc77984 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:30.896411 32717 raft_consensus.cc:1275] T 0f63f46f5d9e4ab485b65cba33d83c3b P 10a56c552e37487a8966c512682ef9cd [term 2 FOLLOWER]: Refusing update from remote peer 8503e8182df24f0785ec09456fc77984: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:30.897778   369 consensus_queue.cc:1048] T 0f63f46f5d9e4ab485b65cba33d83c3b P 8503e8182df24f0785ec09456fc77984 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:30.903402   369 consensus_queue.cc:1048] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8503e8182df24f0785ec09456fc77984 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:30.914785   408 consensus_queue.cc:1048] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8503e8182df24f0785ec09456fc77984 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:30.925473   323 raft_consensus.cc:1275] T 49c7c074b1f9451488656eee9848b339 P 8bbff56d78544420af697aec65b316a3 [term 2 FOLLOWER]: Refusing update from remote peer 10a56c552e37487a8966c512682ef9cd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:30.926857   410 consensus_queue.cc:1048] T 49c7c074b1f9451488656eee9848b339 P 10a56c552e37487a8966c512682ef9cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:30.927824   369 raft_consensus.cc:993] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8503e8182df24f0785ec09456fc77984: : Instructing follower 8bbff56d78544420af697aec65b316a3 to start an election
I20260709 12:14:30.928331   369 raft_consensus.cc:1081] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8503e8182df24f0785ec09456fc77984 [term 1 LEADER]: Signalling peer 8bbff56d78544420af697aec65b316a3 to start an election
I20260709 12:14:30.931452   323 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0b1fb2f9e444b70b7b5b3262faf3a8d"
dest_uuid: "8bbff56d78544420af697aec65b316a3"
 from {username='slave'} at 127.0.0.1:39242
I20260709 12:14:30.931989   323 raft_consensus.cc:493] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8bbff56d78544420af697aec65b316a3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:30.932044 32643 raft_consensus.cc:1275] T 49c7c074b1f9451488656eee9848b339 P 8503e8182df24f0785ec09456fc77984 [term 2 FOLLOWER]: Refusing update from remote peer 10a56c552e37487a8966c512682ef9cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:30.932422   323 raft_consensus.cc:3060] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8bbff56d78544420af697aec65b316a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:30.933468   410 consensus_queue.cc:1048] T 49c7c074b1f9451488656eee9848b339 P 10a56c552e37487a8966c512682ef9cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:30.947623   323 raft_consensus.cc:515] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8bbff56d78544420af697aec65b316a3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:30.957319   323 leader_election.cc:290] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8bbff56d78544420af697aec65b316a3 [CANDIDATE]: Term 2 election: Requested vote from peers 8503e8182df24f0785ec09456fc77984 (127.20.196.129:34575), 10a56c552e37487a8966c512682ef9cd (127.20.196.130:40383)
I20260709 12:14:30.977319 32717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b1fb2f9e444b70b7b5b3262faf3a8d" candidate_uuid: "8bbff56d78544420af697aec65b316a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10a56c552e37487a8966c512682ef9cd"
I20260709 12:14:30.977952 32643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b1fb2f9e444b70b7b5b3262faf3a8d" candidate_uuid: "8bbff56d78544420af697aec65b316a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8503e8182df24f0785ec09456fc77984"
I20260709 12:14:30.977990 32717 raft_consensus.cc:3060] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 10a56c552e37487a8966c512682ef9cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:30.978631 32643 raft_consensus.cc:3055] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8503e8182df24f0785ec09456fc77984 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:30.978971 32643 raft_consensus.cc:740] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8503e8182df24f0785ec09456fc77984 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8503e8182df24f0785ec09456fc77984, State: Running, Role: LEADER
I20260709 12:14:30.979758 32643 consensus_queue.cc:260] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8503e8182df24f0785ec09456fc77984 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:30.980947 32643 raft_consensus.cc:3060] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8503e8182df24f0785ec09456fc77984 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:30.984447 32717 raft_consensus.cc:2468] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 10a56c552e37487a8966c512682ef9cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bbff56d78544420af697aec65b316a3 in term 2.
I20260709 12:14:30.985683 32757 leader_election.cc:304] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8bbff56d78544420af697aec65b316a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10a56c552e37487a8966c512682ef9cd, 8bbff56d78544420af697aec65b316a3; no voters: 
I20260709 12:14:30.986523   373 raft_consensus.cc:2804] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8bbff56d78544420af697aec65b316a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:30.987447 32643 raft_consensus.cc:2468] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8503e8182df24f0785ec09456fc77984 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bbff56d78544420af697aec65b316a3 in term 2.
I20260709 12:14:30.987699   373 raft_consensus.cc:697] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8bbff56d78544420af697aec65b316a3 [term 2 LEADER]: Becoming Leader. State: Replica: 8bbff56d78544420af697aec65b316a3, State: Running, Role: LEADER
I20260709 12:14:30.988708   373 consensus_queue.cc:237] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8bbff56d78544420af697aec65b316a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } } peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } }
I20260709 12:14:30.995179 32537 catalog_manager.cc:5697] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8bbff56d78544420af697aec65b316a3 reported cstate change: term changed from 1 to 2, leader changed from 8503e8182df24f0785ec09456fc77984 (127.20.196.129) to 8bbff56d78544420af697aec65b316a3 (127.20.196.131). New cstate: current_term: 2 leader_uuid: "8bbff56d78544420af697aec65b316a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8503e8182df24f0785ec09456fc77984" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 34575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10a56c552e37487a8966c512682ef9cd" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8bbff56d78544420af697aec65b316a3" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 35939 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:31.042914 21266 tablet_server.cc:179] TabletServer@127.20.196.129:0 shutting down...
I20260709 12:14:31.065006 21266 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:31.065663 21266 tablet_replica.cc:333] T 5023cbec6af84cfc8ecef70591ce02d2 P 8503e8182df24f0785ec09456fc77984: stopping tablet replica
I20260709 12:14:31.066246 21266 raft_consensus.cc:2243] T 5023cbec6af84cfc8ecef70591ce02d2 P 8503e8182df24f0785ec09456fc77984 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:31.066844 21266 pending_rounds.cc:70] T 5023cbec6af84cfc8ecef70591ce02d2 P 8503e8182df24f0785ec09456fc77984: Trying to abort 1 pending ops.
I20260709 12:14:31.067080 21266 pending_rounds.cc:77] T 5023cbec6af84cfc8ecef70591ce02d2 P 8503e8182df24f0785ec09456fc77984: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305622613132496896 op_type: NO_OP noop_request { }
I20260709 12:14:31.067385 21266 raft_consensus.cc:2889] T 5023cbec6af84cfc8ecef70591ce02d2 P 8503e8182df24f0785ec09456fc77984 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:31.067692 21266 raft_consensus.cc:2272] T 5023cbec6af84cfc8ecef70591ce02d2 P 8503e8182df24f0785ec09456fc77984 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:31.070013 21266 tablet_replica.cc:333] T 49c7c074b1f9451488656eee9848b339 P 8503e8182df24f0785ec09456fc77984: stopping tablet replica
I20260709 12:14:31.070559 21266 raft_consensus.cc:2243] T 49c7c074b1f9451488656eee9848b339 P 8503e8182df24f0785ec09456fc77984 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:31.071061 21266 raft_consensus.cc:2272] T 49c7c074b1f9451488656eee9848b339 P 8503e8182df24f0785ec09456fc77984 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:31.073114 21266 tablet_replica.cc:333] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8503e8182df24f0785ec09456fc77984: stopping tablet replica
I20260709 12:14:31.073633 21266 raft_consensus.cc:2243] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8503e8182df24f0785ec09456fc77984 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:31.074069 21266 raft_consensus.cc:2272] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8503e8182df24f0785ec09456fc77984 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:31.076330 21266 tablet_replica.cc:333] T 0f63f46f5d9e4ab485b65cba33d83c3b P 8503e8182df24f0785ec09456fc77984: stopping tablet replica
I20260709 12:14:31.076835 21266 raft_consensus.cc:2243] T 0f63f46f5d9e4ab485b65cba33d83c3b P 8503e8182df24f0785ec09456fc77984 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:31.077646 21266 raft_consensus.cc:2272] T 0f63f46f5d9e4ab485b65cba33d83c3b P 8503e8182df24f0785ec09456fc77984 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:31.101135 21266 tablet_server.cc:196] TabletServer@127.20.196.129:0 shutdown complete.
I20260709 12:14:31.113377 21266 tablet_server.cc:179] TabletServer@127.20.196.130:0 shutting down...
I20260709 12:14:31.131084 21266 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:31.131783 21266 tablet_replica.cc:333] T 5023cbec6af84cfc8ecef70591ce02d2 P 10a56c552e37487a8966c512682ef9cd: stopping tablet replica
I20260709 12:14:31.132390 21266 raft_consensus.cc:2243] T 5023cbec6af84cfc8ecef70591ce02d2 P 10a56c552e37487a8966c512682ef9cd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:31.132858 21266 raft_consensus.cc:2272] T 5023cbec6af84cfc8ecef70591ce02d2 P 10a56c552e37487a8966c512682ef9cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:31.135207 21266 tablet_replica.cc:333] T 49c7c074b1f9451488656eee9848b339 P 10a56c552e37487a8966c512682ef9cd: stopping tablet replica
I20260709 12:14:31.135752 21266 raft_consensus.cc:2243] T 49c7c074b1f9451488656eee9848b339 P 10a56c552e37487a8966c512682ef9cd [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:31.136617 21266 raft_consensus.cc:2272] T 49c7c074b1f9451488656eee9848b339 P 10a56c552e37487a8966c512682ef9cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:31.139324 21266 tablet_replica.cc:333] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 10a56c552e37487a8966c512682ef9cd: stopping tablet replica
I20260709 12:14:31.139838 21266 raft_consensus.cc:2243] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 10a56c552e37487a8966c512682ef9cd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:31.140261 21266 raft_consensus.cc:2272] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 10a56c552e37487a8966c512682ef9cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:31.142619 21266 tablet_replica.cc:333] T 0f63f46f5d9e4ab485b65cba33d83c3b P 10a56c552e37487a8966c512682ef9cd: stopping tablet replica
I20260709 12:14:31.143182 21266 raft_consensus.cc:2243] T 0f63f46f5d9e4ab485b65cba33d83c3b P 10a56c552e37487a8966c512682ef9cd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:31.143606 21266 raft_consensus.cc:2272] T 0f63f46f5d9e4ab485b65cba33d83c3b P 10a56c552e37487a8966c512682ef9cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:31.167342 21266 tablet_server.cc:196] TabletServer@127.20.196.130:0 shutdown complete.
I20260709 12:14:31.179565 21266 tablet_server.cc:179] TabletServer@127.20.196.131:0 shutting down...
I20260709 12:14:31.197985 21266 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:31.198596 21266 tablet_replica.cc:333] T 5023cbec6af84cfc8ecef70591ce02d2 P 8bbff56d78544420af697aec65b316a3: stopping tablet replica
I20260709 12:14:31.199235 21266 raft_consensus.cc:2243] T 5023cbec6af84cfc8ecef70591ce02d2 P 8bbff56d78544420af697aec65b316a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:31.199705 21266 raft_consensus.cc:2272] T 5023cbec6af84cfc8ecef70591ce02d2 P 8bbff56d78544420af697aec65b316a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:31.201928 21266 tablet_replica.cc:333] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8bbff56d78544420af697aec65b316a3: stopping tablet replica
I20260709 12:14:31.202446 21266 raft_consensus.cc:2243] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8bbff56d78544420af697aec65b316a3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:31.203135 21266 pending_rounds.cc:70] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8bbff56d78544420af697aec65b316a3: Trying to abort 1 pending ops.
I20260709 12:14:31.203298 21266 pending_rounds.cc:77] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8bbff56d78544420af697aec65b316a3: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305622613977575424 op_type: NO_OP noop_request { }
I20260709 12:14:31.203575 21266 raft_consensus.cc:2889] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8bbff56d78544420af697aec65b316a3 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:31.203898 21266 raft_consensus.cc:2272] T a0b1fb2f9e444b70b7b5b3262faf3a8d P 8bbff56d78544420af697aec65b316a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:31.206202 21266 tablet_replica.cc:333] T 0f63f46f5d9e4ab485b65cba33d83c3b P 8bbff56d78544420af697aec65b316a3: stopping tablet replica
I20260709 12:14:31.206710 21266 raft_consensus.cc:2243] T 0f63f46f5d9e4ab485b65cba33d83c3b P 8bbff56d78544420af697aec65b316a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:31.207185 21266 raft_consensus.cc:2272] T 0f63f46f5d9e4ab485b65cba33d83c3b P 8bbff56d78544420af697aec65b316a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:31.209336 21266 tablet_replica.cc:333] T 49c7c074b1f9451488656eee9848b339 P 8bbff56d78544420af697aec65b316a3: stopping tablet replica
I20260709 12:14:31.209810 21266 raft_consensus.cc:2243] T 49c7c074b1f9451488656eee9848b339 P 8bbff56d78544420af697aec65b316a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:31.210223 21266 raft_consensus.cc:2272] T 49c7c074b1f9451488656eee9848b339 P 8bbff56d78544420af697aec65b316a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:31.232368 21266 tablet_server.cc:196] TabletServer@127.20.196.131:0 shutdown complete.
I20260709 12:14:31.244663 21266 master.cc:562] Master@127.20.196.190:39345 shutting down...
I20260709 12:14:31.259775 21266 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 507d525e1ddc4fd094e4e46f127a0c28 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:31.260288 21266 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 507d525e1ddc4fd094e4e46f127a0c28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:31.260547 21266 tablet_replica.cc:333] T 00000000000000000000000000000000 P 507d525e1ddc4fd094e4e46f127a0c28: stopping tablet replica
I20260709 12:14:31.284009 21266 master.cc:584] Master@127.20.196.190:39345 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2307 ms)
[----------] 6 tests from LeaderRebalancerTest (376790 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:14:31.311691 21266 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.196.190:36763
I20260709 12:14:31.312789 21266 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:31.317660   420 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:31.317684   421 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:31.320906 21266 server_base.cc:1061] running on GCE node
W20260709 12:14:31.321295   423 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:31.322260 21266 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:31.322441 21266 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:31.322558 21266 hybrid_clock.cc:648] HybridClock initialized: now 1783599271322542 us; error 0 us; skew 500 ppm
I20260709 12:14:31.323259 21266 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:31.325364 21266 webserver.cc:533] Webserver started at http://127.20.196.190:46321/ using document root <none> and password file <none>
I20260709 12:14:31.325784 21266 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:31.325935 21266 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:31.326131 21266 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:31.327226 21266 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894355727-21266-0/minicluster-data/master-0-root/instance:
uuid: "da06e69c54bd4e21a51d544b95bbb1aa"
format_stamp: "Formatted at 2026-07-09 12:14:31 on dist-test-slave-h6sg"
I20260709 12:14:31.331419 21266 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:14:31.334610   428 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:31.335456 21266 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:14:31.335700 21266 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894355727-21266-0/minicluster-data/master-0-root
uuid: "da06e69c54bd4e21a51d544b95bbb1aa"
format_stamp: "Formatted at 2026-07-09 12:14:31 on dist-test-slave-h6sg"
I20260709 12:14:31.335943 21266 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894355727-21266-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894355727-21266-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894355727-21266-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:31.356119 21266 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:31.357134 21266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:31.392030 21266 rpc_server.cc:307] RPC server started. Bound to: 127.20.196.190:36763
I20260709 12:14:31.392198   479 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.196.190:36763 every 8 connection(s)
I20260709 12:14:31.395849   480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:31.406263   480 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da06e69c54bd4e21a51d544b95bbb1aa: Bootstrap starting.
I20260709 12:14:31.410897   480 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P da06e69c54bd4e21a51d544b95bbb1aa: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:31.414848   480 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da06e69c54bd4e21a51d544b95bbb1aa: No bootstrap required, opened a new log
I20260709 12:14:31.416996   480 raft_consensus.cc:359] T 00000000000000000000000000000000 P da06e69c54bd4e21a51d544b95bbb1aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da06e69c54bd4e21a51d544b95bbb1aa" member_type: VOTER }
I20260709 12:14:31.417383   480 raft_consensus.cc:385] T 00000000000000000000000000000000 P da06e69c54bd4e21a51d544b95bbb1aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:31.417614   480 raft_consensus.cc:740] T 00000000000000000000000000000000 P da06e69c54bd4e21a51d544b95bbb1aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da06e69c54bd4e21a51d544b95bbb1aa, State: Initialized, Role: FOLLOWER
I20260709 12:14:31.418226   480 consensus_queue.cc:260] T 00000000000000000000000000000000 P da06e69c54bd4e21a51d544b95bbb1aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da06e69c54bd4e21a51d544b95bbb1aa" member_type: VOTER }
I20260709 12:14:31.418670   480 raft_consensus.cc:399] T 00000000000000000000000000000000 P da06e69c54bd4e21a51d544b95bbb1aa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:14:31.418907   480 raft_consensus.cc:493] T 00000000000000000000000000000000 P da06e69c54bd4e21a51d544b95bbb1aa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:14:31.419201   480 raft_consensus.cc:3060] T 00000000000000000000000000000000 P da06e69c54bd4e21a51d544b95bbb1aa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:31.423697   480 raft_consensus.cc:515] T 00000000000000000000000000000000 P da06e69c54bd4e21a51d544b95bbb1aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da06e69c54bd4e21a51d544b95bbb1aa" member_type: VOTER }
I20260709 12:14:31.424209   480 leader_election.cc:304] T 00000000000000000000000000000000 P da06e69c54bd4e21a51d544b95bbb1aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: da06e69c54bd4e21a51d544b95bbb1aa; no voters: 
I20260709 12:14:31.425293   480 leader_election.cc:290] T 00000000000000000000000000000000 P da06e69c54bd4e21a51d544b95bbb1aa [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:14:31.425655   483 raft_consensus.cc:2804] T 00000000000000000000000000000000 P da06e69c54bd4e21a51d544b95bbb1aa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:31.427081   483 raft_consensus.cc:697] T 00000000000000000000000000000000 P da06e69c54bd4e21a51d544b95bbb1aa [term 1 LEADER]: Becoming Leader. State: Replica: da06e69c54bd4e21a51d544b95bbb1aa, State: Running, Role: LEADER
I20260709 12:14:31.427767   483 consensus_queue.cc:237] T 00000000000000000000000000000000 P da06e69c54bd4e21a51d544b95bbb1aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da06e69c54bd4e21a51d544b95bbb1aa" member_type: VOTER }
I20260709 12:14:31.428069   480 sys_catalog.cc:565] T 00000000000000000000000000000000 P da06e69c54bd4e21a51d544b95bbb1aa [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:14:31.430528   485 sys_catalog.cc:455] T 00000000000000000000000000000000 P da06e69c54bd4e21a51d544b95bbb1aa [sys.catalog]: SysCatalogTable state changed. Reason: New leader da06e69c54bd4e21a51d544b95bbb1aa. Latest consensus state: current_term: 1 leader_uuid: "da06e69c54bd4e21a51d544b95bbb1aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da06e69c54bd4e21a51d544b95bbb1aa" member_type: VOTER } }
I20260709 12:14:31.431214   485 sys_catalog.cc:458] T 00000000000000000000000000000000 P da06e69c54bd4e21a51d544b95bbb1aa [sys.catalog]: This master's current role is: LEADER
I20260709 12:14:31.433435   484 sys_catalog.cc:455] T 00000000000000000000000000000000 P da06e69c54bd4e21a51d544b95bbb1aa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "da06e69c54bd4e21a51d544b95bbb1aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da06e69c54bd4e21a51d544b95bbb1aa" member_type: VOTER } }
I20260709 12:14:31.434108   484 sys_catalog.cc:458] T 00000000000000000000000000000000 P da06e69c54bd4e21a51d544b95bbb1aa [sys.catalog]: This master's current role is: LEADER
I20260709 12:14:31.435945   488 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:14:31.440829   488 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:14:31.444931 21266 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:14:31.449424   488 catalog_manager.cc:1383] Generated new cluster ID: 521ad05ce9074ec68a749fc81336ef55
I20260709 12:14:31.449751   488 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:14:31.466117   488 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:14:31.467478   488 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:14:31.479965   488 catalog_manager.cc:6070] T 00000000000000000000000000000000 P da06e69c54bd4e21a51d544b95bbb1aa: Generated new TSK 0
I20260709 12:14:31.480552   488 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:14:31.511332 21266 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:31.517886   501 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:31.518286   502 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:31.521522 21266 server_base.cc:1061] running on GCE node
W20260709 12:14:31.521492   504 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:31.522756 21266 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:31.522974 21266 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:31.523188 21266 hybrid_clock.cc:648] HybridClock initialized: now 1783599271523172 us; error 0 us; skew 500 ppm
I20260709 12:14:31.523667 21266 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:31.526039 21266 webserver.cc:533] Webserver started at http://127.20.196.129:40065/ using document root <none> and password file <none>
I20260709 12:14:31.526480 21266 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:31.526633 21266 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:31.526842 21266 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:31.527926 21266 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894355727-21266-0/minicluster-data/ts-0-root/instance:
uuid: "f5d77cbf0f464436a88ee930055f8e05"
format_stamp: "Formatted at 2026-07-09 12:14:31 on dist-test-slave-h6sg"
I20260709 12:14:31.532284 21266 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:14:31.535477   509 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:31.536193 21266 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:14:31.536486 21266 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894355727-21266-0/minicluster-data/ts-0-root
uuid: "f5d77cbf0f464436a88ee930055f8e05"
format_stamp: "Formatted at 2026-07-09 12:14:31 on dist-test-slave-h6sg"
I20260709 12:14:31.536787 21266 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894355727-21266-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894355727-21266-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894355727-21266-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:31.571594 21266 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:31.572744 21266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:31.574183 21266 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:31.576371 21266 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:31.576591 21266 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:31.576834 21266 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:31.577013 21266 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:31.615643 21266 rpc_server.cc:307] RPC server started. Bound to: 127.20.196.129:38935
I20260709 12:14:31.615769   571 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.196.129:38935 every 8 connection(s)
I20260709 12:14:31.620321 21266 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:31.627548   576 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:31.627942   577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:31.630731   579 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:31.631472 21266 server_base.cc:1061] running on GCE node
I20260709 12:14:31.632537 21266 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:31.632840 21266 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:31.633059 21266 hybrid_clock.cc:648] HybridClock initialized: now 1783599271633040 us; error 0 us; skew 500 ppm
I20260709 12:14:31.633787 21266 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:31.634330   572 heartbeater.cc:344] Connected to a master server at 127.20.196.190:36763
I20260709 12:14:31.634822   572 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:31.635614   572 heartbeater.cc:507] Master 127.20.196.190:36763 requested a full tablet report, sending...
I20260709 12:14:31.636366 21266 webserver.cc:533] Webserver started at http://127.20.196.130:46519/ using document root <none> and password file <none>
I20260709 12:14:31.637055 21266 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:31.637328 21266 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:31.637660 21266 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:31.638063   445 ts_manager.cc:194] Registered new tserver with Master: f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935)
I20260709 12:14:31.639189 21266 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894355727-21266-0/minicluster-data/ts-1-root/instance:
uuid: "41958dc5e81443978e08a337fbb255bc"
format_stamp: "Formatted at 2026-07-09 12:14:31 on dist-test-slave-h6sg"
I20260709 12:14:31.640607   445 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53084
I20260709 12:14:31.644276 21266 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:14:31.647733   584 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:31.648725 21266 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:14:31.649153 21266 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894355727-21266-0/minicluster-data/ts-1-root
uuid: "41958dc5e81443978e08a337fbb255bc"
format_stamp: "Formatted at 2026-07-09 12:14:31 on dist-test-slave-h6sg"
I20260709 12:14:31.649459 21266 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894355727-21266-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894355727-21266-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894355727-21266-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:31.665024 21266 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:31.666072 21266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:31.667528 21266 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:31.669664 21266 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:31.669891 21266 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:31.670122 21266 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:31.670292 21266 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:31.708196 21266 rpc_server.cc:307] RPC server started. Bound to: 127.20.196.130:34883
I20260709 12:14:31.708293   646 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.196.130:34883 every 8 connection(s)
I20260709 12:14:31.712980 21266 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:31.719678   650 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:31.721814   651 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:31.724623 21266 server_base.cc:1061] running on GCE node
W20260709 12:14:31.725139   653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:31.725696   647 heartbeater.cc:344] Connected to a master server at 127.20.196.190:36763
I20260709 12:14:31.726184   647 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:31.726373 21266 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:31.726672 21266 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:31.726888 21266 hybrid_clock.cc:648] HybridClock initialized: now 1783599271726867 us; error 0 us; skew 500 ppm
I20260709 12:14:31.727124   647 heartbeater.cc:507] Master 127.20.196.190:36763 requested a full tablet report, sending...
I20260709 12:14:31.727685 21266 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:31.729779   445 ts_manager.cc:194] Registered new tserver with Master: 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883)
I20260709 12:14:31.730522 21266 webserver.cc:533] Webserver started at http://127.20.196.131:38803/ using document root <none> and password file <none>
I20260709 12:14:31.731149 21266 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:31.731356 21266 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:31.731413   445 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53100
I20260709 12:14:31.731635 21266 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:31.733074 21266 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894355727-21266-0/minicluster-data/ts-2-root/instance:
uuid: "21975c12fc284bc18715d45d96e9e63a"
format_stamp: "Formatted at 2026-07-09 12:14:31 on dist-test-slave-h6sg"
I20260709 12:14:31.737656 21266 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:14:31.741796   658 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:31.742708 21266 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:14:31.743165 21266 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894355727-21266-0/minicluster-data/ts-2-root
uuid: "21975c12fc284bc18715d45d96e9e63a"
format_stamp: "Formatted at 2026-07-09 12:14:31 on dist-test-slave-h6sg"
I20260709 12:14:31.743449 21266 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894355727-21266-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894355727-21266-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894355727-21266-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:31.762605 21266 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:31.763769 21266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:31.765175 21266 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:31.767427 21266 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:31.767609 21266 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:31.767905 21266 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:31.768054 21266 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:31.807396 21266 rpc_server.cc:307] RPC server started. Bound to: 127.20.196.131:37559
I20260709 12:14:31.807525   720 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.196.131:37559 every 8 connection(s)
I20260709 12:14:31.821640   721 heartbeater.cc:344] Connected to a master server at 127.20.196.190:36763
I20260709 12:14:31.822129   721 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:31.822906   721 heartbeater.cc:507] Master 127.20.196.190:36763 requested a full tablet report, sending...
I20260709 12:14:31.825107   445 ts_manager.cc:194] Registered new tserver with Master: 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559)
I20260709 12:14:31.825730 21266 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015128006s
I20260709 12:14:31.826910   445 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53110
I20260709 12:14:31.852156   445 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53114:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:14:31.854626   445 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:14:31.937677   537 tablet_service.cc:1511] Processing CreateTablet for tablet cd37500fb41a464bbe7f9a9652e5f0df (DEFAULT_TABLE table=test-workload [id=4a06efee6a094ce092edb550dda320bc]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:31.940053   536 tablet_service.cc:1511] Processing CreateTablet for tablet 687d784a386b40c797cfe8eb4778a7e6 (DEFAULT_TABLE table=test-workload [id=4a06efee6a094ce092edb550dda320bc]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:31.940656   612 tablet_service.cc:1511] Processing CreateTablet for tablet cd37500fb41a464bbe7f9a9652e5f0df (DEFAULT_TABLE table=test-workload [id=4a06efee6a094ce092edb550dda320bc]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:31.940964   611 tablet_service.cc:1511] Processing CreateTablet for tablet 687d784a386b40c797cfe8eb4778a7e6 (DEFAULT_TABLE table=test-workload [id=4a06efee6a094ce092edb550dda320bc]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:31.942065   612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd37500fb41a464bbe7f9a9652e5f0df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:31.942353   535 tablet_service.cc:1511] Processing CreateTablet for tablet 0595bc4b26de41a097a82c178a1df812 (DEFAULT_TABLE table=test-workload [id=4a06efee6a094ce092edb550dda320bc]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:31.943017   610 tablet_service.cc:1511] Processing CreateTablet for tablet 0595bc4b26de41a097a82c178a1df812 (DEFAULT_TABLE table=test-workload [id=4a06efee6a094ce092edb550dda320bc]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:31.944406   610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0595bc4b26de41a097a82c178a1df812. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:31.945016   533 tablet_service.cc:1511] Processing CreateTablet for tablet 07cbfec7b89b48f4bdc040734e73e4d7 (DEFAULT_TABLE table=test-workload [id=4a06efee6a094ce092edb550dda320bc]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:31.944931   534 tablet_service.cc:1511] Processing CreateTablet for tablet a660883dd53541948b37b480edad2988 (DEFAULT_TABLE table=test-workload [id=4a06efee6a094ce092edb550dda320bc]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:31.947372   537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd37500fb41a464bbe7f9a9652e5f0df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:31.947403   532 tablet_service.cc:1511] Processing CreateTablet for tablet 84f90776262f4fe7901e972d2cfe0964 (DEFAULT_TABLE table=test-workload [id=4a06efee6a094ce092edb550dda320bc]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:31.948015   609 tablet_service.cc:1511] Processing CreateTablet for tablet a660883dd53541948b37b480edad2988 (DEFAULT_TABLE table=test-workload [id=4a06efee6a094ce092edb550dda320bc]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:31.948868   532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84f90776262f4fe7901e972d2cfe0964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:31.949353   609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a660883dd53541948b37b480edad2988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:31.951023   533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07cbfec7b89b48f4bdc040734e73e4d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:31.951766   534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a660883dd53541948b37b480edad2988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:31.952054   608 tablet_service.cc:1511] Processing CreateTablet for tablet 07cbfec7b89b48f4bdc040734e73e4d7 (DEFAULT_TABLE table=test-workload [id=4a06efee6a094ce092edb550dda320bc]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:31.953465   608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07cbfec7b89b48f4bdc040734e73e4d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:31.953815   531 tablet_service.cc:1511] Processing CreateTablet for tablet b949a4dcd53f45cb8acb010c7d4d0904 (DEFAULT_TABLE table=test-workload [id=4a06efee6a094ce092edb550dda320bc]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:31.956063   607 tablet_service.cc:1511] Processing CreateTablet for tablet 84f90776262f4fe7901e972d2cfe0964 (DEFAULT_TABLE table=test-workload [id=4a06efee6a094ce092edb550dda320bc]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:31.957418   607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84f90776262f4fe7901e972d2cfe0964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:31.957083   530 tablet_service.cc:1511] Processing CreateTablet for tablet 83a2e1850e8c47b880013ccc28f23290 (DEFAULT_TABLE table=test-workload [id=4a06efee6a094ce092edb550dda320bc]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:31.956058   529 tablet_service.cc:1511] Processing CreateTablet for tablet b5be268a4ee9400e94dc432e237e8774 (DEFAULT_TABLE table=test-workload [id=4a06efee6a094ce092edb550dda320bc]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:31.960052   606 tablet_service.cc:1511] Processing CreateTablet for tablet b949a4dcd53f45cb8acb010c7d4d0904 (DEFAULT_TABLE table=test-workload [id=4a06efee6a094ce092edb550dda320bc]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:31.960222   685 tablet_service.cc:1511] Processing CreateTablet for tablet 687d784a386b40c797cfe8eb4778a7e6 (DEFAULT_TABLE table=test-workload [id=4a06efee6a094ce092edb550dda320bc]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:31.961386   606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b949a4dcd53f45cb8acb010c7d4d0904. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:31.961709   685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 687d784a386b40c797cfe8eb4778a7e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:31.962327   686 tablet_service.cc:1511] Processing CreateTablet for tablet cd37500fb41a464bbe7f9a9652e5f0df (DEFAULT_TABLE table=test-workload [id=4a06efee6a094ce092edb550dda320bc]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:31.963620   686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd37500fb41a464bbe7f9a9652e5f0df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:31.964053   684 tablet_service.cc:1511] Processing CreateTablet for tablet 0595bc4b26de41a097a82c178a1df812 (DEFAULT_TABLE table=test-workload [id=4a06efee6a094ce092edb550dda320bc]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:31.965446   684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0595bc4b26de41a097a82c178a1df812. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:31.952481   536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 687d784a386b40c797cfe8eb4778a7e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:31.965750   680 tablet_service.cc:1511] Processing CreateTablet for tablet b949a4dcd53f45cb8acb010c7d4d0904 (DEFAULT_TABLE table=test-workload [id=4a06efee6a094ce092edb550dda320bc]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:31.968027   681 tablet_service.cc:1511] Processing CreateTablet for tablet 84f90776262f4fe7901e972d2cfe0964 (DEFAULT_TABLE table=test-workload [id=4a06efee6a094ce092edb550dda320bc]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:31.970156   682 tablet_service.cc:1511] Processing CreateTablet for tablet 07cbfec7b89b48f4bdc040734e73e4d7 (DEFAULT_TABLE table=test-workload [id=4a06efee6a094ce092edb550dda320bc]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:31.964097   605 tablet_service.cc:1511] Processing CreateTablet for tablet 83a2e1850e8c47b880013ccc28f23290 (DEFAULT_TABLE table=test-workload [id=4a06efee6a094ce092edb550dda320bc]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:31.972383   605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83a2e1850e8c47b880013ccc28f23290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:31.972043   683 tablet_service.cc:1511] Processing CreateTablet for tablet a660883dd53541948b37b480edad2988 (DEFAULT_TABLE table=test-workload [id=4a06efee6a094ce092edb550dda320bc]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:31.973650   680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b949a4dcd53f45cb8acb010c7d4d0904. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:31.964205   679 tablet_service.cc:1511] Processing CreateTablet for tablet 83a2e1850e8c47b880013ccc28f23290 (DEFAULT_TABLE table=test-workload [id=4a06efee6a094ce092edb550dda320bc]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:31.976644   679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83a2e1850e8c47b880013ccc28f23290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:31.979471   531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b949a4dcd53f45cb8acb010c7d4d0904. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:31.983812   611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 687d784a386b40c797cfe8eb4778a7e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:31.987389   681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84f90776262f4fe7901e972d2cfe0964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:31.988955   736 tablet_bootstrap.cc:492] T cd37500fb41a464bbe7f9a9652e5f0df P 21975c12fc284bc18715d45d96e9e63a: Bootstrap starting.
I20260709 12:14:31.991384   683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a660883dd53541948b37b480edad2988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:31.995860   682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07cbfec7b89b48f4bdc040734e73e4d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:31.996469   736 tablet_bootstrap.cc:654] T cd37500fb41a464bbe7f9a9652e5f0df P 21975c12fc284bc18715d45d96e9e63a: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:31.999358   535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0595bc4b26de41a097a82c178a1df812. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:32.000466   737 tablet_bootstrap.cc:492] T cd37500fb41a464bbe7f9a9652e5f0df P 41958dc5e81443978e08a337fbb255bc: Bootstrap starting.
I20260709 12:14:32.003353   529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5be268a4ee9400e94dc432e237e8774. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:32.006781   737 tablet_bootstrap.cc:654] T cd37500fb41a464bbe7f9a9652e5f0df P 41958dc5e81443978e08a337fbb255bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:32.007588   530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83a2e1850e8c47b880013ccc28f23290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:32.037245   612 tablet_service.cc:1511] Processing CreateTablet for tablet b5be268a4ee9400e94dc432e237e8774 (DEFAULT_TABLE table=test-workload [id=4a06efee6a094ce092edb550dda320bc]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:32.038681   612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5be268a4ee9400e94dc432e237e8774. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:32.037182   679 tablet_service.cc:1511] Processing CreateTablet for tablet b5be268a4ee9400e94dc432e237e8774 (DEFAULT_TABLE table=test-workload [id=4a06efee6a094ce092edb550dda320bc]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:32.044427   679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5be268a4ee9400e94dc432e237e8774. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:32.069024   736 tablet_bootstrap.cc:492] T cd37500fb41a464bbe7f9a9652e5f0df P 21975c12fc284bc18715d45d96e9e63a: No bootstrap required, opened a new log
I20260709 12:14:32.069628   736 ts_tablet_manager.cc:1403] T cd37500fb41a464bbe7f9a9652e5f0df P 21975c12fc284bc18715d45d96e9e63a: Time spent bootstrapping tablet: real 0.081s	user 0.000s	sys 0.012s
I20260709 12:14:32.072594   736 raft_consensus.cc:359] T cd37500fb41a464bbe7f9a9652e5f0df P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.073312   736 raft_consensus.cc:385] T cd37500fb41a464bbe7f9a9652e5f0df P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:32.073602   736 raft_consensus.cc:740] T cd37500fb41a464bbe7f9a9652e5f0df P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21975c12fc284bc18715d45d96e9e63a, State: Initialized, Role: FOLLOWER
I20260709 12:14:32.093921   736 consensus_queue.cc:260] T cd37500fb41a464bbe7f9a9652e5f0df P 21975c12fc284bc18715d45d96e9e63a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.140879   737 tablet_bootstrap.cc:492] T cd37500fb41a464bbe7f9a9652e5f0df P 41958dc5e81443978e08a337fbb255bc: No bootstrap required, opened a new log
I20260709 12:14:32.141499   737 ts_tablet_manager.cc:1403] T cd37500fb41a464bbe7f9a9652e5f0df P 41958dc5e81443978e08a337fbb255bc: Time spent bootstrapping tablet: real 0.141s	user 0.007s	sys 0.015s
I20260709 12:14:32.143292   721 heartbeater.cc:499] Master 127.20.196.190:36763 was elected leader, sending a full tablet report...
I20260709 12:14:32.145640   740 tablet_bootstrap.cc:492] T 83a2e1850e8c47b880013ccc28f23290 P f5d77cbf0f464436a88ee930055f8e05: Bootstrap starting.
I20260709 12:14:32.145612   737 raft_consensus.cc:359] T cd37500fb41a464bbe7f9a9652e5f0df P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.146608   737 raft_consensus.cc:385] T cd37500fb41a464bbe7f9a9652e5f0df P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:32.147025   737 raft_consensus.cc:740] T cd37500fb41a464bbe7f9a9652e5f0df P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41958dc5e81443978e08a337fbb255bc, State: Initialized, Role: FOLLOWER
I20260709 12:14:32.147975   737 consensus_queue.cc:260] T cd37500fb41a464bbe7f9a9652e5f0df P 41958dc5e81443978e08a337fbb255bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.143316   736 ts_tablet_manager.cc:1434] T cd37500fb41a464bbe7f9a9652e5f0df P 21975c12fc284bc18715d45d96e9e63a: Time spent starting tablet: real 0.073s	user 0.008s	sys 0.014s
I20260709 12:14:32.151337   736 tablet_bootstrap.cc:492] T 83a2e1850e8c47b880013ccc28f23290 P 21975c12fc284bc18715d45d96e9e63a: Bootstrap starting.
I20260709 12:14:32.153318   740 tablet_bootstrap.cc:654] T 83a2e1850e8c47b880013ccc28f23290 P f5d77cbf0f464436a88ee930055f8e05: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:32.158383   736 tablet_bootstrap.cc:654] T 83a2e1850e8c47b880013ccc28f23290 P 21975c12fc284bc18715d45d96e9e63a: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:32.174561   737 ts_tablet_manager.cc:1434] T cd37500fb41a464bbe7f9a9652e5f0df P 41958dc5e81443978e08a337fbb255bc: Time spent starting tablet: real 0.033s	user 0.014s	sys 0.017s
I20260709 12:14:32.175055   647 heartbeater.cc:499] Master 127.20.196.190:36763 was elected leader, sending a full tablet report...
I20260709 12:14:32.175894   737 tablet_bootstrap.cc:492] T a660883dd53541948b37b480edad2988 P 41958dc5e81443978e08a337fbb255bc: Bootstrap starting.
I20260709 12:14:32.176957   740 tablet_bootstrap.cc:492] T 83a2e1850e8c47b880013ccc28f23290 P f5d77cbf0f464436a88ee930055f8e05: No bootstrap required, opened a new log
I20260709 12:14:32.177656   740 ts_tablet_manager.cc:1403] T 83a2e1850e8c47b880013ccc28f23290 P f5d77cbf0f464436a88ee930055f8e05: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.011s
I20260709 12:14:32.182291   736 tablet_bootstrap.cc:492] T 83a2e1850e8c47b880013ccc28f23290 P 21975c12fc284bc18715d45d96e9e63a: No bootstrap required, opened a new log
I20260709 12:14:32.182368   737 tablet_bootstrap.cc:654] T a660883dd53541948b37b480edad2988 P 41958dc5e81443978e08a337fbb255bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:32.183028   736 ts_tablet_manager.cc:1403] T 83a2e1850e8c47b880013ccc28f23290 P 21975c12fc284bc18715d45d96e9e63a: Time spent bootstrapping tablet: real 0.032s	user 0.018s	sys 0.014s
I20260709 12:14:32.182317   740 raft_consensus.cc:359] T 83a2e1850e8c47b880013ccc28f23290 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.183578   740 raft_consensus.cc:385] T 83a2e1850e8c47b880013ccc28f23290 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:32.183911   740 raft_consensus.cc:740] T 83a2e1850e8c47b880013ccc28f23290 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d77cbf0f464436a88ee930055f8e05, State: Initialized, Role: FOLLOWER
I20260709 12:14:32.184834   740 consensus_queue.cc:260] T 83a2e1850e8c47b880013ccc28f23290 P f5d77cbf0f464436a88ee930055f8e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.186292   736 raft_consensus.cc:359] T 83a2e1850e8c47b880013ccc28f23290 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.187319   736 raft_consensus.cc:385] T 83a2e1850e8c47b880013ccc28f23290 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:32.187701   736 raft_consensus.cc:740] T 83a2e1850e8c47b880013ccc28f23290 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21975c12fc284bc18715d45d96e9e63a, State: Initialized, Role: FOLLOWER
I20260709 12:14:32.188651   736 consensus_queue.cc:260] T 83a2e1850e8c47b880013ccc28f23290 P 21975c12fc284bc18715d45d96e9e63a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.191568   736 ts_tablet_manager.cc:1434] T 83a2e1850e8c47b880013ccc28f23290 P 21975c12fc284bc18715d45d96e9e63a: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:14:32.192663   736 tablet_bootstrap.cc:492] T 687d784a386b40c797cfe8eb4778a7e6 P 21975c12fc284bc18715d45d96e9e63a: Bootstrap starting.
I20260709 12:14:32.194618   737 tablet_bootstrap.cc:492] T a660883dd53541948b37b480edad2988 P 41958dc5e81443978e08a337fbb255bc: No bootstrap required, opened a new log
I20260709 12:14:32.195276   737 ts_tablet_manager.cc:1403] T a660883dd53541948b37b480edad2988 P 41958dc5e81443978e08a337fbb255bc: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.006s
I20260709 12:14:32.198360   737 raft_consensus.cc:359] T a660883dd53541948b37b480edad2988 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.198997   736 tablet_bootstrap.cc:654] T 687d784a386b40c797cfe8eb4778a7e6 P 21975c12fc284bc18715d45d96e9e63a: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:32.199313   737 raft_consensus.cc:385] T a660883dd53541948b37b480edad2988 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:32.199684   737 raft_consensus.cc:740] T a660883dd53541948b37b480edad2988 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41958dc5e81443978e08a337fbb255bc, State: Initialized, Role: FOLLOWER
I20260709 12:14:32.200651   737 consensus_queue.cc:260] T a660883dd53541948b37b480edad2988 P 41958dc5e81443978e08a337fbb255bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.203631   737 ts_tablet_manager.cc:1434] T a660883dd53541948b37b480edad2988 P 41958dc5e81443978e08a337fbb255bc: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 12:14:32.205071   737 tablet_bootstrap.cc:492] T 07cbfec7b89b48f4bdc040734e73e4d7 P 41958dc5e81443978e08a337fbb255bc: Bootstrap starting.
I20260709 12:14:32.215656   737 tablet_bootstrap.cc:654] T 07cbfec7b89b48f4bdc040734e73e4d7 P 41958dc5e81443978e08a337fbb255bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:32.217939   736 tablet_bootstrap.cc:492] T 687d784a386b40c797cfe8eb4778a7e6 P 21975c12fc284bc18715d45d96e9e63a: No bootstrap required, opened a new log
I20260709 12:14:32.218619   736 ts_tablet_manager.cc:1403] T 687d784a386b40c797cfe8eb4778a7e6 P 21975c12fc284bc18715d45d96e9e63a: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.008s
I20260709 12:14:32.222607   736 raft_consensus.cc:359] T 687d784a386b40c797cfe8eb4778a7e6 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.223694   736 raft_consensus.cc:385] T 687d784a386b40c797cfe8eb4778a7e6 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:32.224144   736 raft_consensus.cc:740] T 687d784a386b40c797cfe8eb4778a7e6 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21975c12fc284bc18715d45d96e9e63a, State: Initialized, Role: FOLLOWER
I20260709 12:14:32.225306   736 consensus_queue.cc:260] T 687d784a386b40c797cfe8eb4778a7e6 P 21975c12fc284bc18715d45d96e9e63a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.228224   572 heartbeater.cc:499] Master 127.20.196.190:36763 was elected leader, sending a full tablet report...
I20260709 12:14:32.228840   740 ts_tablet_manager.cc:1434] T 83a2e1850e8c47b880013ccc28f23290 P f5d77cbf0f464436a88ee930055f8e05: Time spent starting tablet: real 0.051s	user 0.032s	sys 0.018s
I20260709 12:14:32.229910   740 tablet_bootstrap.cc:492] T 687d784a386b40c797cfe8eb4778a7e6 P f5d77cbf0f464436a88ee930055f8e05: Bootstrap starting.
I20260709 12:14:32.231015   736 ts_tablet_manager.cc:1434] T 687d784a386b40c797cfe8eb4778a7e6 P 21975c12fc284bc18715d45d96e9e63a: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:14:32.232468   736 tablet_bootstrap.cc:492] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a: Bootstrap starting.
I20260709 12:14:32.236006   740 tablet_bootstrap.cc:654] T 687d784a386b40c797cfe8eb4778a7e6 P f5d77cbf0f464436a88ee930055f8e05: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:32.235865   742 raft_consensus.cc:493] T a660883dd53541948b37b480edad2988 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.236608   742 raft_consensus.cc:515] T a660883dd53541948b37b480edad2988 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.241730   736 tablet_bootstrap.cc:654] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:32.242179   742 leader_election.cc:290] T a660883dd53541948b37b480edad2988 P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935), 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559)
I20260709 12:14:32.256443   736 tablet_bootstrap.cc:492] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a: No bootstrap required, opened a new log
I20260709 12:14:32.257159   736 ts_tablet_manager.cc:1403] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a: Time spent bootstrapping tablet: real 0.025s	user 0.020s	sys 0.000s
I20260709 12:14:32.260952   736 raft_consensus.cc:359] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.261915   736 raft_consensus.cc:385] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:32.262290   736 raft_consensus.cc:740] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21975c12fc284bc18715d45d96e9e63a, State: Initialized, Role: FOLLOWER
I20260709 12:14:32.263279   736 consensus_queue.cc:260] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.266176   736 ts_tablet_manager.cc:1434] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 12:14:32.276490   740 tablet_bootstrap.cc:492] T 687d784a386b40c797cfe8eb4778a7e6 P f5d77cbf0f464436a88ee930055f8e05: No bootstrap required, opened a new log
I20260709 12:14:32.276906   737 tablet_bootstrap.cc:492] T 07cbfec7b89b48f4bdc040734e73e4d7 P 41958dc5e81443978e08a337fbb255bc: No bootstrap required, opened a new log
I20260709 12:14:32.277110   740 ts_tablet_manager.cc:1403] T 687d784a386b40c797cfe8eb4778a7e6 P f5d77cbf0f464436a88ee930055f8e05: Time spent bootstrapping tablet: real 0.047s	user 0.020s	sys 0.013s
I20260709 12:14:32.277447   737 ts_tablet_manager.cc:1403] T 07cbfec7b89b48f4bdc040734e73e4d7 P 41958dc5e81443978e08a337fbb255bc: Time spent bootstrapping tablet: real 0.073s	user 0.036s	sys 0.016s
I20260709 12:14:32.275182   736 tablet_bootstrap.cc:492] T a660883dd53541948b37b480edad2988 P 21975c12fc284bc18715d45d96e9e63a: Bootstrap starting.
I20260709 12:14:32.280299   740 raft_consensus.cc:359] T 687d784a386b40c797cfe8eb4778a7e6 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.281137   547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a660883dd53541948b37b480edad2988" candidate_uuid: "41958dc5e81443978e08a337fbb255bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d77cbf0f464436a88ee930055f8e05" is_pre_election: true
W20260709 12:14:32.282877   587 leader_election.cc:343] T a660883dd53541948b37b480edad2988 P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:32.281141   740 raft_consensus.cc:385] T 687d784a386b40c797cfe8eb4778a7e6 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:32.284082   740 raft_consensus.cc:740] T 687d784a386b40c797cfe8eb4778a7e6 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d77cbf0f464436a88ee930055f8e05, State: Initialized, Role: FOLLOWER
I20260709 12:14:32.284857   740 consensus_queue.cc:260] T 687d784a386b40c797cfe8eb4778a7e6 P f5d77cbf0f464436a88ee930055f8e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.286213   736 tablet_bootstrap.cc:654] T a660883dd53541948b37b480edad2988 P 21975c12fc284bc18715d45d96e9e63a: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:32.286674   696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a660883dd53541948b37b480edad2988" candidate_uuid: "41958dc5e81443978e08a337fbb255bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21975c12fc284bc18715d45d96e9e63a" is_pre_election: true
I20260709 12:14:32.287119   740 ts_tablet_manager.cc:1434] T 687d784a386b40c797cfe8eb4778a7e6 P f5d77cbf0f464436a88ee930055f8e05: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:14:32.288148   740 tablet_bootstrap.cc:492] T a660883dd53541948b37b480edad2988 P f5d77cbf0f464436a88ee930055f8e05: Bootstrap starting.
W20260709 12:14:32.288242   586 leader_election.cc:343] T a660883dd53541948b37b480edad2988 P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:32.288787   586 leader_election.cc:304] T a660883dd53541948b37b480edad2988 P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41958dc5e81443978e08a337fbb255bc; no voters: 21975c12fc284bc18715d45d96e9e63a, f5d77cbf0f464436a88ee930055f8e05
I20260709 12:14:32.289994   742 raft_consensus.cc:2749] T a660883dd53541948b37b480edad2988 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:32.289938   737 raft_consensus.cc:359] T 07cbfec7b89b48f4bdc040734e73e4d7 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.290879   737 raft_consensus.cc:385] T 07cbfec7b89b48f4bdc040734e73e4d7 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:32.291224   737 raft_consensus.cc:740] T 07cbfec7b89b48f4bdc040734e73e4d7 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41958dc5e81443978e08a337fbb255bc, State: Initialized, Role: FOLLOWER
I20260709 12:14:32.292032   737 consensus_queue.cc:260] T 07cbfec7b89b48f4bdc040734e73e4d7 P 41958dc5e81443978e08a337fbb255bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.294049   736 tablet_bootstrap.cc:492] T a660883dd53541948b37b480edad2988 P 21975c12fc284bc18715d45d96e9e63a: No bootstrap required, opened a new log
I20260709 12:14:32.294546   740 tablet_bootstrap.cc:654] T a660883dd53541948b37b480edad2988 P f5d77cbf0f464436a88ee930055f8e05: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:32.294582   736 ts_tablet_manager.cc:1403] T a660883dd53541948b37b480edad2988 P 21975c12fc284bc18715d45d96e9e63a: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.000s
I20260709 12:14:32.297066   737 ts_tablet_manager.cc:1434] T 07cbfec7b89b48f4bdc040734e73e4d7 P 41958dc5e81443978e08a337fbb255bc: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:14:32.298382   737 tablet_bootstrap.cc:492] T 0595bc4b26de41a097a82c178a1df812 P 41958dc5e81443978e08a337fbb255bc: Bootstrap starting.
I20260709 12:14:32.299984   736 raft_consensus.cc:359] T a660883dd53541948b37b480edad2988 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.300779   736 raft_consensus.cc:385] T a660883dd53541948b37b480edad2988 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:32.301084   736 raft_consensus.cc:740] T a660883dd53541948b37b480edad2988 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21975c12fc284bc18715d45d96e9e63a, State: Initialized, Role: FOLLOWER
I20260709 12:14:32.301992   736 consensus_queue.cc:260] T a660883dd53541948b37b480edad2988 P 21975c12fc284bc18715d45d96e9e63a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.304531   736 ts_tablet_manager.cc:1434] T a660883dd53541948b37b480edad2988 P 21975c12fc284bc18715d45d96e9e63a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:14:32.305529   736 tablet_bootstrap.cc:492] T b949a4dcd53f45cb8acb010c7d4d0904 P 21975c12fc284bc18715d45d96e9e63a: Bootstrap starting.
I20260709 12:14:32.307534   737 tablet_bootstrap.cc:654] T 0595bc4b26de41a097a82c178a1df812 P 41958dc5e81443978e08a337fbb255bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:32.311990   736 tablet_bootstrap.cc:654] T b949a4dcd53f45cb8acb010c7d4d0904 P 21975c12fc284bc18715d45d96e9e63a: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:32.320667   736 tablet_bootstrap.cc:492] T b949a4dcd53f45cb8acb010c7d4d0904 P 21975c12fc284bc18715d45d96e9e63a: No bootstrap required, opened a new log
I20260709 12:14:32.320685   740 tablet_bootstrap.cc:492] T a660883dd53541948b37b480edad2988 P f5d77cbf0f464436a88ee930055f8e05: No bootstrap required, opened a new log
I20260709 12:14:32.321059   737 tablet_bootstrap.cc:492] T 0595bc4b26de41a097a82c178a1df812 P 41958dc5e81443978e08a337fbb255bc: No bootstrap required, opened a new log
I20260709 12:14:32.321341   736 ts_tablet_manager.cc:1403] T b949a4dcd53f45cb8acb010c7d4d0904 P 21975c12fc284bc18715d45d96e9e63a: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 12:14:32.321415   740 ts_tablet_manager.cc:1403] T a660883dd53541948b37b480edad2988 P f5d77cbf0f464436a88ee930055f8e05: Time spent bootstrapping tablet: real 0.033s	user 0.024s	sys 0.008s
I20260709 12:14:32.321542   737 ts_tablet_manager.cc:1403] T 0595bc4b26de41a097a82c178a1df812 P 41958dc5e81443978e08a337fbb255bc: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.013s
I20260709 12:14:32.323987   736 raft_consensus.cc:359] T b949a4dcd53f45cb8acb010c7d4d0904 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.324564   736 raft_consensus.cc:385] T b949a4dcd53f45cb8acb010c7d4d0904 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:32.324872   736 raft_consensus.cc:740] T b949a4dcd53f45cb8acb010c7d4d0904 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21975c12fc284bc18715d45d96e9e63a, State: Initialized, Role: FOLLOWER
I20260709 12:14:32.324586   740 raft_consensus.cc:359] T a660883dd53541948b37b480edad2988 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.324867   737 raft_consensus.cc:359] T 0595bc4b26de41a097a82c178a1df812 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.325490   740 raft_consensus.cc:385] T a660883dd53541948b37b480edad2988 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:32.325730   737 raft_consensus.cc:385] T 0595bc4b26de41a097a82c178a1df812 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:32.325824   740 raft_consensus.cc:740] T a660883dd53541948b37b480edad2988 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d77cbf0f464436a88ee930055f8e05, State: Initialized, Role: FOLLOWER
I20260709 12:14:32.326226   737 raft_consensus.cc:740] T 0595bc4b26de41a097a82c178a1df812 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41958dc5e81443978e08a337fbb255bc, State: Initialized, Role: FOLLOWER
I20260709 12:14:32.325762   736 consensus_queue.cc:260] T b949a4dcd53f45cb8acb010c7d4d0904 P 21975c12fc284bc18715d45d96e9e63a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.326872   740 consensus_queue.cc:260] T a660883dd53541948b37b480edad2988 P f5d77cbf0f464436a88ee930055f8e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.327044   737 consensus_queue.cc:260] T 0595bc4b26de41a097a82c178a1df812 P 41958dc5e81443978e08a337fbb255bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.328408   736 ts_tablet_manager.cc:1434] T b949a4dcd53f45cb8acb010c7d4d0904 P 21975c12fc284bc18715d45d96e9e63a: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:14:32.329466   736 tablet_bootstrap.cc:492] T b5be268a4ee9400e94dc432e237e8774 P 21975c12fc284bc18715d45d96e9e63a: Bootstrap starting.
I20260709 12:14:32.331892   740 ts_tablet_manager.cc:1434] T a660883dd53541948b37b480edad2988 P f5d77cbf0f464436a88ee930055f8e05: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:14:32.332954   740 tablet_bootstrap.cc:492] T cd37500fb41a464bbe7f9a9652e5f0df P f5d77cbf0f464436a88ee930055f8e05: Bootstrap starting.
I20260709 12:14:32.333096   737 ts_tablet_manager.cc:1434] T 0595bc4b26de41a097a82c178a1df812 P 41958dc5e81443978e08a337fbb255bc: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 12:14:32.334115   737 tablet_bootstrap.cc:492] T b949a4dcd53f45cb8acb010c7d4d0904 P 41958dc5e81443978e08a337fbb255bc: Bootstrap starting.
I20260709 12:14:32.337939   736 tablet_bootstrap.cc:654] T b5be268a4ee9400e94dc432e237e8774 P 21975c12fc284bc18715d45d96e9e63a: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:32.340451   737 tablet_bootstrap.cc:654] T b949a4dcd53f45cb8acb010c7d4d0904 P 41958dc5e81443978e08a337fbb255bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:32.340451   740 tablet_bootstrap.cc:654] T cd37500fb41a464bbe7f9a9652e5f0df P f5d77cbf0f464436a88ee930055f8e05: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:32.349758   736 tablet_bootstrap.cc:492] T b5be268a4ee9400e94dc432e237e8774 P 21975c12fc284bc18715d45d96e9e63a: No bootstrap required, opened a new log
I20260709 12:14:32.350381   736 ts_tablet_manager.cc:1403] T b5be268a4ee9400e94dc432e237e8774 P 21975c12fc284bc18715d45d96e9e63a: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.009s
I20260709 12:14:32.353531   736 raft_consensus.cc:359] T b5be268a4ee9400e94dc432e237e8774 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.354331   736 raft_consensus.cc:385] T b5be268a4ee9400e94dc432e237e8774 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:32.354679   736 raft_consensus.cc:740] T b5be268a4ee9400e94dc432e237e8774 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21975c12fc284bc18715d45d96e9e63a, State: Initialized, Role: FOLLOWER
I20260709 12:14:32.356868   736 consensus_queue.cc:260] T b5be268a4ee9400e94dc432e237e8774 P 21975c12fc284bc18715d45d96e9e63a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.358057   737 tablet_bootstrap.cc:492] T b949a4dcd53f45cb8acb010c7d4d0904 P 41958dc5e81443978e08a337fbb255bc: No bootstrap required, opened a new log
I20260709 12:14:32.358613   737 ts_tablet_manager.cc:1403] T b949a4dcd53f45cb8acb010c7d4d0904 P 41958dc5e81443978e08a337fbb255bc: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.011s
I20260709 12:14:32.359277   742 raft_consensus.cc:493] T 07cbfec7b89b48f4bdc040734e73e4d7 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.359853   742 raft_consensus.cc:515] T 07cbfec7b89b48f4bdc040734e73e4d7 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.360231   736 ts_tablet_manager.cc:1434] T b5be268a4ee9400e94dc432e237e8774 P 21975c12fc284bc18715d45d96e9e63a: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.004s
I20260709 12:14:32.361461   736 tablet_bootstrap.cc:492] T 84f90776262f4fe7901e972d2cfe0964 P 21975c12fc284bc18715d45d96e9e63a: Bootstrap starting.
I20260709 12:14:32.361747   737 raft_consensus.cc:359] T b949a4dcd53f45cb8acb010c7d4d0904 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.362488   737 raft_consensus.cc:385] T b949a4dcd53f45cb8acb010c7d4d0904 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:32.362829   740 tablet_bootstrap.cc:492] T cd37500fb41a464bbe7f9a9652e5f0df P f5d77cbf0f464436a88ee930055f8e05: No bootstrap required, opened a new log
I20260709 12:14:32.362771   737 raft_consensus.cc:740] T b949a4dcd53f45cb8acb010c7d4d0904 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41958dc5e81443978e08a337fbb255bc, State: Initialized, Role: FOLLOWER
I20260709 12:14:32.363392   740 ts_tablet_manager.cc:1403] T cd37500fb41a464bbe7f9a9652e5f0df P f5d77cbf0f464436a88ee930055f8e05: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.007s
I20260709 12:14:32.364476   547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07cbfec7b89b48f4bdc040734e73e4d7" candidate_uuid: "41958dc5e81443978e08a337fbb255bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d77cbf0f464436a88ee930055f8e05" is_pre_election: true
I20260709 12:14:32.364558   746 raft_consensus.cc:493] T 687d784a386b40c797cfe8eb4778a7e6 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.365545   696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07cbfec7b89b48f4bdc040734e73e4d7" candidate_uuid: "41958dc5e81443978e08a337fbb255bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21975c12fc284bc18715d45d96e9e63a" is_pre_election: true
I20260709 12:14:32.366006   746 raft_consensus.cc:515] T 687d784a386b40c797cfe8eb4778a7e6 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.366456   740 raft_consensus.cc:359] T cd37500fb41a464bbe7f9a9652e5f0df P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.367259   740 raft_consensus.cc:385] T cd37500fb41a464bbe7f9a9652e5f0df P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:14:32.367336   586 leader_election.cc:343] T 07cbfec7b89b48f4bdc040734e73e4d7 P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:32.368191   742 leader_election.cc:290] T 07cbfec7b89b48f4bdc040734e73e4d7 P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935), 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559)
I20260709 12:14:32.367563   740 raft_consensus.cc:740] T cd37500fb41a464bbe7f9a9652e5f0df P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d77cbf0f464436a88ee930055f8e05, State: Initialized, Role: FOLLOWER
W20260709 12:14:32.371099   587 leader_election.cc:343] T 07cbfec7b89b48f4bdc040734e73e4d7 P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:32.371573   587 leader_election.cc:304] T 07cbfec7b89b48f4bdc040734e73e4d7 P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41958dc5e81443978e08a337fbb255bc; no voters: 21975c12fc284bc18715d45d96e9e63a, f5d77cbf0f464436a88ee930055f8e05
I20260709 12:14:32.371625   740 consensus_queue.cc:260] T cd37500fb41a464bbe7f9a9652e5f0df P f5d77cbf0f464436a88ee930055f8e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.372725   742 raft_consensus.cc:2749] T 07cbfec7b89b48f4bdc040734e73e4d7 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:32.374118   736 tablet_bootstrap.cc:654] T 84f90776262f4fe7901e972d2cfe0964 P 21975c12fc284bc18715d45d96e9e63a: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:32.374327   746 leader_election.cc:290] T 687d784a386b40c797cfe8eb4778a7e6 P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883), 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559)
I20260709 12:14:32.386868   736 tablet_bootstrap.cc:492] T 84f90776262f4fe7901e972d2cfe0964 P 21975c12fc284bc18715d45d96e9e63a: No bootstrap required, opened a new log
I20260709 12:14:32.387411   736 ts_tablet_manager.cc:1403] T 84f90776262f4fe7901e972d2cfe0964 P 21975c12fc284bc18715d45d96e9e63a: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.012s
I20260709 12:14:32.363850   737 consensus_queue.cc:260] T b949a4dcd53f45cb8acb010c7d4d0904 P 41958dc5e81443978e08a337fbb255bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.389436   736 raft_consensus.cc:359] T 84f90776262f4fe7901e972d2cfe0964 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.390056   736 raft_consensus.cc:385] T 84f90776262f4fe7901e972d2cfe0964 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:32.390304   736 raft_consensus.cc:740] T 84f90776262f4fe7901e972d2cfe0964 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21975c12fc284bc18715d45d96e9e63a, State: Initialized, Role: FOLLOWER
I20260709 12:14:32.390906   736 consensus_queue.cc:260] T 84f90776262f4fe7901e972d2cfe0964 P 21975c12fc284bc18715d45d96e9e63a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.395152   736 ts_tablet_manager.cc:1434] T 84f90776262f4fe7901e972d2cfe0964 P 21975c12fc284bc18715d45d96e9e63a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:14:32.396078   736 tablet_bootstrap.cc:492] T 07cbfec7b89b48f4bdc040734e73e4d7 P 21975c12fc284bc18715d45d96e9e63a: Bootstrap starting.
I20260709 12:14:32.399852   737 ts_tablet_manager.cc:1434] T b949a4dcd53f45cb8acb010c7d4d0904 P 41958dc5e81443978e08a337fbb255bc: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.005s
I20260709 12:14:32.403419   737 tablet_bootstrap.cc:492] T 84f90776262f4fe7901e972d2cfe0964 P 41958dc5e81443978e08a337fbb255bc: Bootstrap starting.
I20260709 12:14:32.405123   746 raft_consensus.cc:493] T 83a2e1850e8c47b880013ccc28f23290 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.405630   746 raft_consensus.cc:515] T 83a2e1850e8c47b880013ccc28f23290 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.402289   736 tablet_bootstrap.cc:654] T 07cbfec7b89b48f4bdc040734e73e4d7 P 21975c12fc284bc18715d45d96e9e63a: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:32.407894   746 leader_election.cc:290] T 83a2e1850e8c47b880013ccc28f23290 P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883), 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559)
I20260709 12:14:32.409309   741 raft_consensus.cc:493] T a660883dd53541948b37b480edad2988 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.410241   741 raft_consensus.cc:515] T a660883dd53541948b37b480edad2988 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.414254   737 tablet_bootstrap.cc:654] T 84f90776262f4fe7901e972d2cfe0964 P 41958dc5e81443978e08a337fbb255bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:32.418838   741 leader_election.cc:290] T a660883dd53541948b37b480edad2988 P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935), 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883)
I20260709 12:14:32.421206   740 ts_tablet_manager.cc:1434] T cd37500fb41a464bbe7f9a9652e5f0df P f5d77cbf0f464436a88ee930055f8e05: Time spent starting tablet: real 0.057s	user 0.025s	sys 0.024s
I20260709 12:14:32.422595   741 raft_consensus.cc:493] T 687d784a386b40c797cfe8eb4778a7e6 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.423362   741 raft_consensus.cc:515] T 687d784a386b40c797cfe8eb4778a7e6 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.424777   740 tablet_bootstrap.cc:492] T 84f90776262f4fe7901e972d2cfe0964 P f5d77cbf0f464436a88ee930055f8e05: Bootstrap starting.
I20260709 12:14:32.427472   741 leader_election.cc:290] T 687d784a386b40c797cfe8eb4778a7e6 P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935), 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883)
I20260709 12:14:32.429509   761 raft_consensus.cc:493] T a660883dd53541948b37b480edad2988 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.430467   622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687d784a386b40c797cfe8eb4778a7e6" candidate_uuid: "f5d77cbf0f464436a88ee930055f8e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41958dc5e81443978e08a337fbb255bc" is_pre_election: true
I20260709 12:14:32.431478   621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a2e1850e8c47b880013ccc28f23290" candidate_uuid: "f5d77cbf0f464436a88ee930055f8e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41958dc5e81443978e08a337fbb255bc" is_pre_election: true
W20260709 12:14:32.434192   511 leader_election.cc:343] T 83a2e1850e8c47b880013ccc28f23290 P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:32.435119   511 leader_election.cc:343] T 687d784a386b40c797cfe8eb4778a7e6 P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:32.430063   761 raft_consensus.cc:515] T a660883dd53541948b37b480edad2988 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
W20260709 12:14:32.440089   493 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:32.441308   761 leader_election.cc:290] T a660883dd53541948b37b480edad2988 P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883), 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559)
I20260709 12:14:32.442173   622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a660883dd53541948b37b480edad2988" candidate_uuid: "f5d77cbf0f464436a88ee930055f8e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41958dc5e81443978e08a337fbb255bc" is_pre_election: true
I20260709 12:14:32.443014   622 raft_consensus.cc:2468] T a660883dd53541948b37b480edad2988 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5d77cbf0f464436a88ee930055f8e05 in term 0.
I20260709 12:14:32.444612   740 tablet_bootstrap.cc:654] T 84f90776262f4fe7901e972d2cfe0964 P f5d77cbf0f464436a88ee930055f8e05: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:32.445158   511 leader_election.cc:304] T a660883dd53541948b37b480edad2988 P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41958dc5e81443978e08a337fbb255bc, f5d77cbf0f464436a88ee930055f8e05; no voters: 
I20260709 12:14:32.446388   761 raft_consensus.cc:2804] T a660883dd53541948b37b480edad2988 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:32.446888   761 raft_consensus.cc:493] T a660883dd53541948b37b480edad2988 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:32.447391   761 raft_consensus.cc:3060] T a660883dd53541948b37b480edad2988 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:32.461218   547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a660883dd53541948b37b480edad2988" candidate_uuid: "21975c12fc284bc18715d45d96e9e63a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d77cbf0f464436a88ee930055f8e05" is_pre_election: true
I20260709 12:14:32.463626   621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687d784a386b40c797cfe8eb4778a7e6" candidate_uuid: "21975c12fc284bc18715d45d96e9e63a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41958dc5e81443978e08a337fbb255bc" is_pre_election: true
I20260709 12:14:32.465103   622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a660883dd53541948b37b480edad2988" candidate_uuid: "21975c12fc284bc18715d45d96e9e63a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41958dc5e81443978e08a337fbb255bc" is_pre_election: true
I20260709 12:14:32.465739   622 raft_consensus.cc:2468] T a660883dd53541948b37b480edad2988 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21975c12fc284bc18715d45d96e9e63a in term 0.
I20260709 12:14:32.468024   546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687d784a386b40c797cfe8eb4778a7e6" candidate_uuid: "21975c12fc284bc18715d45d96e9e63a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d77cbf0f464436a88ee930055f8e05" is_pre_election: true
I20260709 12:14:32.468896   546 raft_consensus.cc:2468] T 687d784a386b40c797cfe8eb4778a7e6 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21975c12fc284bc18715d45d96e9e63a in term 0.
I20260709 12:14:32.470759   661 leader_election.cc:304] T 687d784a386b40c797cfe8eb4778a7e6 P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21975c12fc284bc18715d45d96e9e63a, f5d77cbf0f464436a88ee930055f8e05; no voters: 
I20260709 12:14:32.471421   736 tablet_bootstrap.cc:492] T 07cbfec7b89b48f4bdc040734e73e4d7 P 21975c12fc284bc18715d45d96e9e63a: No bootstrap required, opened a new log
I20260709 12:14:32.471982   736 ts_tablet_manager.cc:1403] T 07cbfec7b89b48f4bdc040734e73e4d7 P 21975c12fc284bc18715d45d96e9e63a: Time spent bootstrapping tablet: real 0.076s	user 0.008s	sys 0.032s
I20260709 12:14:32.472059   741 raft_consensus.cc:2804] T 687d784a386b40c797cfe8eb4778a7e6 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:32.472654   741 raft_consensus.cc:493] T 687d784a386b40c797cfe8eb4778a7e6 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:32.473273   741 raft_consensus.cc:3060] T 687d784a386b40c797cfe8eb4778a7e6 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:32.473946   761 raft_consensus.cc:515] T a660883dd53541948b37b480edad2988 P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.475319   547 raft_consensus.cc:2393] T a660883dd53541948b37b480edad2988 P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21975c12fc284bc18715d45d96e9e63a in current term 1: Already voted for candidate f5d77cbf0f464436a88ee930055f8e05 in this term.
I20260709 12:14:32.475060   736 raft_consensus.cc:359] T 07cbfec7b89b48f4bdc040734e73e4d7 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.475890   736 raft_consensus.cc:385] T 07cbfec7b89b48f4bdc040734e73e4d7 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:32.476224   736 raft_consensus.cc:740] T 07cbfec7b89b48f4bdc040734e73e4d7 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21975c12fc284bc18715d45d96e9e63a, State: Initialized, Role: FOLLOWER
I20260709 12:14:32.478473   737 tablet_bootstrap.cc:492] T 84f90776262f4fe7901e972d2cfe0964 P 41958dc5e81443978e08a337fbb255bc: No bootstrap required, opened a new log
I20260709 12:14:32.478518   622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a660883dd53541948b37b480edad2988" candidate_uuid: "f5d77cbf0f464436a88ee930055f8e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41958dc5e81443978e08a337fbb255bc"
I20260709 12:14:32.479177   737 ts_tablet_manager.cc:1403] T 84f90776262f4fe7901e972d2cfe0964 P 41958dc5e81443978e08a337fbb255bc: Time spent bootstrapping tablet: real 0.076s	user 0.020s	sys 0.016s
I20260709 12:14:32.479317   622 raft_consensus.cc:3060] T a660883dd53541948b37b480edad2988 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:32.480901   740 tablet_bootstrap.cc:492] T 84f90776262f4fe7901e972d2cfe0964 P f5d77cbf0f464436a88ee930055f8e05: No bootstrap required, opened a new log
I20260709 12:14:32.481841   740 ts_tablet_manager.cc:1403] T 84f90776262f4fe7901e972d2cfe0964 P f5d77cbf0f464436a88ee930055f8e05: Time spent bootstrapping tablet: real 0.057s	user 0.022s	sys 0.017s
I20260709 12:14:32.483387   696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687d784a386b40c797cfe8eb4778a7e6" candidate_uuid: "f5d77cbf0f464436a88ee930055f8e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21975c12fc284bc18715d45d96e9e63a" is_pre_election: true
I20260709 12:14:32.481232   761 leader_election.cc:290] T a660883dd53541948b37b480edad2988 P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 1 election: Requested vote from peers 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883), 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559)
I20260709 12:14:32.483243   736 consensus_queue.cc:260] T 07cbfec7b89b48f4bdc040734e73e4d7 P 21975c12fc284bc18715d45d96e9e63a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.482306   737 raft_consensus.cc:359] T 84f90776262f4fe7901e972d2cfe0964 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.484244   741 raft_consensus.cc:515] T 687d784a386b40c797cfe8eb4778a7e6 P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.484648   737 raft_consensus.cc:385] T 84f90776262f4fe7901e972d2cfe0964 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:32.485044   737 raft_consensus.cc:740] T 84f90776262f4fe7901e972d2cfe0964 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41958dc5e81443978e08a337fbb255bc, State: Initialized, Role: FOLLOWER
I20260709 12:14:32.485437   696 raft_consensus.cc:2393] T 687d784a386b40c797cfe8eb4778a7e6 P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5d77cbf0f464436a88ee930055f8e05 in current term 1: Already voted for candidate 21975c12fc284bc18715d45d96e9e63a in this term.
I20260709 12:14:32.485582   740 raft_consensus.cc:359] T 84f90776262f4fe7901e972d2cfe0964 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.485879   737 consensus_queue.cc:260] T 84f90776262f4fe7901e972d2cfe0964 P 41958dc5e81443978e08a337fbb255bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.486171   695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a2e1850e8c47b880013ccc28f23290" candidate_uuid: "f5d77cbf0f464436a88ee930055f8e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21975c12fc284bc18715d45d96e9e63a" is_pre_election: true
I20260709 12:14:32.486501   740 raft_consensus.cc:385] T 84f90776262f4fe7901e972d2cfe0964 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:32.486923   695 raft_consensus.cc:2468] T 83a2e1850e8c47b880013ccc28f23290 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5d77cbf0f464436a88ee930055f8e05 in term 0.
I20260709 12:14:32.487123   740 raft_consensus.cc:740] T 84f90776262f4fe7901e972d2cfe0964 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d77cbf0f464436a88ee930055f8e05, State: Initialized, Role: FOLLOWER
I20260709 12:14:32.487982   741 leader_election.cc:290] T 687d784a386b40c797cfe8eb4778a7e6 P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 1 election: Requested vote from peers f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935), 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883)
I20260709 12:14:32.488787   547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687d784a386b40c797cfe8eb4778a7e6" candidate_uuid: "21975c12fc284bc18715d45d96e9e63a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d77cbf0f464436a88ee930055f8e05"
I20260709 12:14:32.488456   740 consensus_queue.cc:260] T 84f90776262f4fe7901e972d2cfe0964 P f5d77cbf0f464436a88ee930055f8e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.494707   547 raft_consensus.cc:3060] T 687d784a386b40c797cfe8eb4778a7e6 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:32.489847   737 ts_tablet_manager.cc:1434] T 84f90776262f4fe7901e972d2cfe0964 P 41958dc5e81443978e08a337fbb255bc: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:14:32.496145   742 raft_consensus.cc:493] T 84f90776262f4fe7901e972d2cfe0964 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.496866   740 ts_tablet_manager.cc:1434] T 84f90776262f4fe7901e972d2cfe0964 P f5d77cbf0f464436a88ee930055f8e05: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:14:32.496681   742 raft_consensus.cc:515] T 84f90776262f4fe7901e972d2cfe0964 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.497262   737 tablet_bootstrap.cc:492] T b5be268a4ee9400e94dc432e237e8774 P 41958dc5e81443978e08a337fbb255bc: Bootstrap starting.
I20260709 12:14:32.498109   740 tablet_bootstrap.cc:492] T b5be268a4ee9400e94dc432e237e8774 P f5d77cbf0f464436a88ee930055f8e05: Bootstrap starting.
I20260709 12:14:32.498873   742 leader_election.cc:290] T 84f90776262f4fe7901e972d2cfe0964 P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935), 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559)
I20260709 12:14:32.490082   695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a660883dd53541948b37b480edad2988" candidate_uuid: "f5d77cbf0f464436a88ee930055f8e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21975c12fc284bc18715d45d96e9e63a" is_pre_election: true
I20260709 12:14:32.499651   695 raft_consensus.cc:2468] T a660883dd53541948b37b480edad2988 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5d77cbf0f464436a88ee930055f8e05 in term 0.
I20260709 12:14:32.491400   696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a660883dd53541948b37b480edad2988" candidate_uuid: "f5d77cbf0f464436a88ee930055f8e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21975c12fc284bc18715d45d96e9e63a"
I20260709 12:14:32.500634   696 raft_consensus.cc:3060] T a660883dd53541948b37b480edad2988 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:32.503647   546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f90776262f4fe7901e972d2cfe0964" candidate_uuid: "41958dc5e81443978e08a337fbb255bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d77cbf0f464436a88ee930055f8e05" is_pre_election: true
I20260709 12:14:32.504446   737 tablet_bootstrap.cc:654] T b5be268a4ee9400e94dc432e237e8774 P 41958dc5e81443978e08a337fbb255bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:32.493793   736 ts_tablet_manager.cc:1434] T 07cbfec7b89b48f4bdc040734e73e4d7 P 21975c12fc284bc18715d45d96e9e63a: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.002s
I20260709 12:14:32.494064   622 raft_consensus.cc:2468] T a660883dd53541948b37b480edad2988 P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d77cbf0f464436a88ee930055f8e05 in term 1.
I20260709 12:14:32.504340   546 raft_consensus.cc:2468] T 84f90776262f4fe7901e972d2cfe0964 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41958dc5e81443978e08a337fbb255bc in term 0.
I20260709 12:14:32.505026   695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f90776262f4fe7901e972d2cfe0964" candidate_uuid: "41958dc5e81443978e08a337fbb255bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21975c12fc284bc18715d45d96e9e63a" is_pre_election: true
I20260709 12:14:32.505671   695 raft_consensus.cc:2468] T 84f90776262f4fe7901e972d2cfe0964 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41958dc5e81443978e08a337fbb255bc in term 0.
I20260709 12:14:32.506006   587 leader_election.cc:304] T 84f90776262f4fe7901e972d2cfe0964 P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41958dc5e81443978e08a337fbb255bc, f5d77cbf0f464436a88ee930055f8e05; no voters: 
I20260709 12:14:32.506971   742 raft_consensus.cc:2804] T 84f90776262f4fe7901e972d2cfe0964 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:14:32.491513   660 leader_election.cc:343] T 687d784a386b40c797cfe8eb4778a7e6 P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:32.507450   742 raft_consensus.cc:493] T 84f90776262f4fe7901e972d2cfe0964 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:32.507902   742 raft_consensus.cc:3060] T 84f90776262f4fe7901e972d2cfe0964 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:32.508234   660 leader_election.cc:304] T a660883dd53541948b37b480edad2988 P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21975c12fc284bc18715d45d96e9e63a, 41958dc5e81443978e08a337fbb255bc; no voters: f5d77cbf0f464436a88ee930055f8e05
I20260709 12:14:32.510331   511 leader_election.cc:304] T 687d784a386b40c797cfe8eb4778a7e6 P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5d77cbf0f464436a88ee930055f8e05; no voters: 21975c12fc284bc18715d45d96e9e63a, 41958dc5e81443978e08a337fbb255bc
I20260709 12:14:32.516306   742 raft_consensus.cc:515] T 84f90776262f4fe7901e972d2cfe0964 P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.517074   511 leader_election.cc:304] T a660883dd53541948b37b480edad2988 P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41958dc5e81443978e08a337fbb255bc, f5d77cbf0f464436a88ee930055f8e05; no voters: 
I20260709 12:14:32.520422   546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f90776262f4fe7901e972d2cfe0964" candidate_uuid: "41958dc5e81443978e08a337fbb255bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d77cbf0f464436a88ee930055f8e05"
I20260709 12:14:32.520820   746 raft_consensus.cc:2804] T a660883dd53541948b37b480edad2988 P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:32.517984   740 tablet_bootstrap.cc:654] T b5be268a4ee9400e94dc432e237e8774 P f5d77cbf0f464436a88ee930055f8e05: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:32.521001   546 raft_consensus.cc:3060] T 84f90776262f4fe7901e972d2cfe0964 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:32.525815   742 leader_election.cc:290] T 84f90776262f4fe7901e972d2cfe0964 P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 election: Requested vote from peers f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935), 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559)
I20260709 12:14:32.526446   742 raft_consensus.cc:493] T cd37500fb41a464bbe7f9a9652e5f0df P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.526939   742 raft_consensus.cc:515] T cd37500fb41a464bbe7f9a9652e5f0df P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.528321   547 raft_consensus.cc:2468] T 687d784a386b40c797cfe8eb4778a7e6 P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21975c12fc284bc18715d45d96e9e63a in term 1.
I20260709 12:14:32.528841   761 raft_consensus.cc:2749] T 687d784a386b40c797cfe8eb4778a7e6 P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:32.529971   695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f90776262f4fe7901e972d2cfe0964" candidate_uuid: "41958dc5e81443978e08a337fbb255bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21975c12fc284bc18715d45d96e9e63a"
I20260709 12:14:32.530804   695 raft_consensus.cc:3060] T 84f90776262f4fe7901e972d2cfe0964 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:32.531510   545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd37500fb41a464bbe7f9a9652e5f0df" candidate_uuid: "41958dc5e81443978e08a337fbb255bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d77cbf0f464436a88ee930055f8e05" is_pre_election: true
I20260709 12:14:32.532191   545 raft_consensus.cc:2468] T cd37500fb41a464bbe7f9a9652e5f0df P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41958dc5e81443978e08a337fbb255bc in term 0.
I20260709 12:14:32.533084   694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd37500fb41a464bbe7f9a9652e5f0df" candidate_uuid: "41958dc5e81443978e08a337fbb255bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21975c12fc284bc18715d45d96e9e63a" is_pre_election: true
I20260709 12:14:32.533512   587 leader_election.cc:304] T cd37500fb41a464bbe7f9a9652e5f0df P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41958dc5e81443978e08a337fbb255bc, f5d77cbf0f464436a88ee930055f8e05; no voters: 
I20260709 12:14:32.533771   694 raft_consensus.cc:2468] T cd37500fb41a464bbe7f9a9652e5f0df P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41958dc5e81443978e08a337fbb255bc in term 0.
I20260709 12:14:32.535669   742 leader_election.cc:290] T cd37500fb41a464bbe7f9a9652e5f0df P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935), 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559)
I20260709 12:14:32.535868   661 leader_election.cc:304] T 687d784a386b40c797cfe8eb4778a7e6 P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21975c12fc284bc18715d45d96e9e63a, f5d77cbf0f464436a88ee930055f8e05; no voters: 
I20260709 12:14:32.537300   742 raft_consensus.cc:2804] T cd37500fb41a464bbe7f9a9652e5f0df P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:32.537712   742 raft_consensus.cc:493] T cd37500fb41a464bbe7f9a9652e5f0df P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:32.538123   742 raft_consensus.cc:3060] T cd37500fb41a464bbe7f9a9652e5f0df P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:32.539271   511 leader_election.cc:304] T 83a2e1850e8c47b880013ccc28f23290 P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21975c12fc284bc18715d45d96e9e63a, f5d77cbf0f464436a88ee930055f8e05; no voters: 41958dc5e81443978e08a337fbb255bc
I20260709 12:14:32.540282   740 tablet_bootstrap.cc:492] T b5be268a4ee9400e94dc432e237e8774 P f5d77cbf0f464436a88ee930055f8e05: No bootstrap required, opened a new log
I20260709 12:14:32.540377   761 raft_consensus.cc:2804] T 83a2e1850e8c47b880013ccc28f23290 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:32.540870   740 ts_tablet_manager.cc:1403] T b5be268a4ee9400e94dc432e237e8774 P f5d77cbf0f464436a88ee930055f8e05: Time spent bootstrapping tablet: real 0.043s	user 0.004s	sys 0.009s
I20260709 12:14:32.541016   761 raft_consensus.cc:493] T 83a2e1850e8c47b880013ccc28f23290 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:32.541558   761 raft_consensus.cc:3060] T 83a2e1850e8c47b880013ccc28f23290 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:32.544492   622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687d784a386b40c797cfe8eb4778a7e6" candidate_uuid: "21975c12fc284bc18715d45d96e9e63a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41958dc5e81443978e08a337fbb255bc"
I20260709 12:14:32.547505   737 tablet_bootstrap.cc:492] T b5be268a4ee9400e94dc432e237e8774 P 41958dc5e81443978e08a337fbb255bc: No bootstrap required, opened a new log
I20260709 12:14:32.548040   737 ts_tablet_manager.cc:1403] T b5be268a4ee9400e94dc432e237e8774 P 41958dc5e81443978e08a337fbb255bc: Time spent bootstrapping tablet: real 0.051s	user 0.022s	sys 0.025s
I20260709 12:14:32.549146   742 raft_consensus.cc:515] T cd37500fb41a464bbe7f9a9652e5f0df P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.549855   696 raft_consensus.cc:2468] T a660883dd53541948b37b480edad2988 P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d77cbf0f464436a88ee930055f8e05 in term 1.
I20260709 12:14:32.549790   761 raft_consensus.cc:515] T 83a2e1850e8c47b880013ccc28f23290 P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.550489   741 raft_consensus.cc:2764] T a660883dd53541948b37b480edad2988 P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:14:32.545450   740 raft_consensus.cc:359] T b5be268a4ee9400e94dc432e237e8774 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.551695   741 raft_consensus.cc:2804] T 687d784a386b40c797cfe8eb4778a7e6 P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:32.551044   737 raft_consensus.cc:359] T b5be268a4ee9400e94dc432e237e8774 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.552542   741 raft_consensus.cc:697] T 687d784a386b40c797cfe8eb4778a7e6 P 21975c12fc284bc18715d45d96e9e63a [term 1 LEADER]: Becoming Leader. State: Replica: 21975c12fc284bc18715d45d96e9e63a, State: Running, Role: LEADER
I20260709 12:14:32.552772   737 raft_consensus.cc:385] T b5be268a4ee9400e94dc432e237e8774 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:32.552829   547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd37500fb41a464bbe7f9a9652e5f0df" candidate_uuid: "41958dc5e81443978e08a337fbb255bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d77cbf0f464436a88ee930055f8e05"
I20260709 12:14:32.553303   737 raft_consensus.cc:740] T b5be268a4ee9400e94dc432e237e8774 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41958dc5e81443978e08a337fbb255bc, State: Initialized, Role: FOLLOWER
I20260709 12:14:32.552016   761 leader_election.cc:290] T 83a2e1850e8c47b880013ccc28f23290 P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 1 election: Requested vote from peers 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883), 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559)
I20260709 12:14:32.553553   547 raft_consensus.cc:3060] T cd37500fb41a464bbe7f9a9652e5f0df P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:32.553480   741 consensus_queue.cc:237] T 687d784a386b40c797cfe8eb4778a7e6 P 21975c12fc284bc18715d45d96e9e63a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.554320   737 consensus_queue.cc:260] T b5be268a4ee9400e94dc432e237e8774 P 41958dc5e81443978e08a337fbb255bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.556340   775 raft_consensus.cc:493] T b949a4dcd53f45cb8acb010c7d4d0904 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.556810   775 raft_consensus.cc:515] T b949a4dcd53f45cb8acb010c7d4d0904 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.557500   737 ts_tablet_manager.cc:1434] T b5be268a4ee9400e94dc432e237e8774 P 41958dc5e81443978e08a337fbb255bc: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.002s
I20260709 12:14:32.558552   737 tablet_bootstrap.cc:492] T 83a2e1850e8c47b880013ccc28f23290 P 41958dc5e81443978e08a337fbb255bc: Bootstrap starting.
I20260709 12:14:32.559126   775 leader_election.cc:290] T b949a4dcd53f45cb8acb010c7d4d0904 P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935), 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559)
W20260709 12:14:32.559617   660 leader_election.cc:343] T 687d784a386b40c797cfe8eb4778a7e6 P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:32.559899   694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a2e1850e8c47b880013ccc28f23290" candidate_uuid: "f5d77cbf0f464436a88ee930055f8e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21975c12fc284bc18715d45d96e9e63a"
I20260709 12:14:32.560554   694 raft_consensus.cc:3060] T 83a2e1850e8c47b880013ccc28f23290 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:32.551715   740 raft_consensus.cc:385] T b5be268a4ee9400e94dc432e237e8774 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:32.563660   740 raft_consensus.cc:740] T b5be268a4ee9400e94dc432e237e8774 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d77cbf0f464436a88ee930055f8e05, State: Initialized, Role: FOLLOWER
I20260709 12:14:32.563958   693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b949a4dcd53f45cb8acb010c7d4d0904" candidate_uuid: "41958dc5e81443978e08a337fbb255bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21975c12fc284bc18715d45d96e9e63a" is_pre_election: true
I20260709 12:14:32.564555   740 consensus_queue.cc:260] T b5be268a4ee9400e94dc432e237e8774 P f5d77cbf0f464436a88ee930055f8e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.567126   740 ts_tablet_manager.cc:1434] T b5be268a4ee9400e94dc432e237e8774 P f5d77cbf0f464436a88ee930055f8e05: Time spent starting tablet: real 0.026s	user 0.003s	sys 0.006s
I20260709 12:14:32.583557   737 tablet_bootstrap.cc:654] T 83a2e1850e8c47b880013ccc28f23290 P 41958dc5e81443978e08a337fbb255bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:32.584230   740 tablet_bootstrap.cc:492] T b949a4dcd53f45cb8acb010c7d4d0904 P f5d77cbf0f464436a88ee930055f8e05: Bootstrap starting.
I20260709 12:14:32.574201   443 catalog_manager.cc:5697] T 687d784a386b40c797cfe8eb4778a7e6 P 21975c12fc284bc18715d45d96e9e63a reported cstate change: term changed from 0 to 1, leader changed from <none> to 21975c12fc284bc18715d45d96e9e63a (127.20.196.131). New cstate: current_term: 1 leader_uuid: "21975c12fc284bc18715d45d96e9e63a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:32.588984   694 raft_consensus.cc:2468] T 83a2e1850e8c47b880013ccc28f23290 P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d77cbf0f464436a88ee930055f8e05 in term 1.
I20260709 12:14:32.569824   546 raft_consensus.cc:2468] T 84f90776262f4fe7901e972d2cfe0964 P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41958dc5e81443978e08a337fbb255bc in term 1.
I20260709 12:14:32.564652   693 raft_consensus.cc:2468] T b949a4dcd53f45cb8acb010c7d4d0904 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41958dc5e81443978e08a337fbb255bc in term 0.
I20260709 12:14:32.590436   511 leader_election.cc:304] T 83a2e1850e8c47b880013ccc28f23290 P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21975c12fc284bc18715d45d96e9e63a, f5d77cbf0f464436a88ee930055f8e05; no voters: 
I20260709 12:14:32.590591   587 leader_election.cc:304] T 84f90776262f4fe7901e972d2cfe0964 P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41958dc5e81443978e08a337fbb255bc, f5d77cbf0f464436a88ee930055f8e05; no voters: 
I20260709 12:14:32.590900   586 leader_election.cc:304] T b949a4dcd53f45cb8acb010c7d4d0904 P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21975c12fc284bc18715d45d96e9e63a, 41958dc5e81443978e08a337fbb255bc; no voters: 
I20260709 12:14:32.591830   775 raft_consensus.cc:2804] T 84f90776262f4fe7901e972d2cfe0964 P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:32.593132   740 tablet_bootstrap.cc:654] T b949a4dcd53f45cb8acb010c7d4d0904 P f5d77cbf0f464436a88ee930055f8e05: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:32.595430   547 raft_consensus.cc:2468] T cd37500fb41a464bbe7f9a9652e5f0df P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41958dc5e81443978e08a337fbb255bc in term 1.
I20260709 12:14:32.583050   622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a2e1850e8c47b880013ccc28f23290" candidate_uuid: "f5d77cbf0f464436a88ee930055f8e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41958dc5e81443978e08a337fbb255bc"
I20260709 12:14:32.569396   545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b949a4dcd53f45cb8acb010c7d4d0904" candidate_uuid: "41958dc5e81443978e08a337fbb255bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d77cbf0f464436a88ee930055f8e05" is_pre_election: true
I20260709 12:14:32.582746   746 raft_consensus.cc:697] T a660883dd53541948b37b480edad2988 P f5d77cbf0f464436a88ee930055f8e05 [term 1 LEADER]: Becoming Leader. State: Replica: f5d77cbf0f464436a88ee930055f8e05, State: Running, Role: LEADER
W20260709 12:14:32.600977   511 leader_election.cc:343] T 83a2e1850e8c47b880013ccc28f23290 P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:32.597208   773 raft_consensus.cc:2804] T 83a2e1850e8c47b880013ccc28f23290 P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:32.601608   746 consensus_queue.cc:237] T a660883dd53541948b37b480edad2988 P f5d77cbf0f464436a88ee930055f8e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.598310   693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd37500fb41a464bbe7f9a9652e5f0df" candidate_uuid: "41958dc5e81443978e08a337fbb255bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21975c12fc284bc18715d45d96e9e63a"
I20260709 12:14:32.597942   772 raft_consensus.cc:2804] T b949a4dcd53f45cb8acb010c7d4d0904 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:14:32.602258   587 leader_election.cc:343] T b949a4dcd53f45cb8acb010c7d4d0904 P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:32.602730   772 raft_consensus.cc:493] T b949a4dcd53f45cb8acb010c7d4d0904 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:32.603286   772 raft_consensus.cc:3060] T b949a4dcd53f45cb8acb010c7d4d0904 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:32.604750   587 leader_election.cc:304] T cd37500fb41a464bbe7f9a9652e5f0df P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41958dc5e81443978e08a337fbb255bc, f5d77cbf0f464436a88ee930055f8e05; no voters: 
I20260709 12:14:32.599502   742 leader_election.cc:290] T cd37500fb41a464bbe7f9a9652e5f0df P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 election: Requested vote from peers f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935), 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559)
I20260709 12:14:32.602615   693 raft_consensus.cc:3060] T cd37500fb41a464bbe7f9a9652e5f0df P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:32.608330   742 raft_consensus.cc:2804] T cd37500fb41a464bbe7f9a9652e5f0df P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:32.609298   742 raft_consensus.cc:697] T cd37500fb41a464bbe7f9a9652e5f0df P 41958dc5e81443978e08a337fbb255bc [term 1 LEADER]: Becoming Leader. State: Replica: 41958dc5e81443978e08a337fbb255bc, State: Running, Role: LEADER
I20260709 12:14:32.602056   773 raft_consensus.cc:697] T 83a2e1850e8c47b880013ccc28f23290 P f5d77cbf0f464436a88ee930055f8e05 [term 1 LEADER]: Becoming Leader. State: Replica: f5d77cbf0f464436a88ee930055f8e05, State: Running, Role: LEADER
I20260709 12:14:32.610831   742 consensus_queue.cc:237] T cd37500fb41a464bbe7f9a9652e5f0df P 41958dc5e81443978e08a337fbb255bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.611667   773 consensus_queue.cc:237] T 83a2e1850e8c47b880013ccc28f23290 P f5d77cbf0f464436a88ee930055f8e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.613343   737 tablet_bootstrap.cc:492] T 83a2e1850e8c47b880013ccc28f23290 P 41958dc5e81443978e08a337fbb255bc: No bootstrap required, opened a new log
I20260709 12:14:32.613896   737 ts_tablet_manager.cc:1403] T 83a2e1850e8c47b880013ccc28f23290 P 41958dc5e81443978e08a337fbb255bc: Time spent bootstrapping tablet: real 0.056s	user 0.016s	sys 0.021s
I20260709 12:14:32.614317   693 raft_consensus.cc:2468] T cd37500fb41a464bbe7f9a9652e5f0df P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41958dc5e81443978e08a337fbb255bc in term 1.
I20260709 12:14:32.580932   695 raft_consensus.cc:2468] T 84f90776262f4fe7901e972d2cfe0964 P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41958dc5e81443978e08a337fbb255bc in term 1.
I20260709 12:14:32.616276   740 tablet_bootstrap.cc:492] T b949a4dcd53f45cb8acb010c7d4d0904 P f5d77cbf0f464436a88ee930055f8e05: No bootstrap required, opened a new log
I20260709 12:14:32.616901   740 ts_tablet_manager.cc:1403] T b949a4dcd53f45cb8acb010c7d4d0904 P f5d77cbf0f464436a88ee930055f8e05: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.001s
I20260709 12:14:32.617462   737 raft_consensus.cc:359] T 83a2e1850e8c47b880013ccc28f23290 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.618423   737 raft_consensus.cc:385] T 83a2e1850e8c47b880013ccc28f23290 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:32.620026   775 raft_consensus.cc:697] T 84f90776262f4fe7901e972d2cfe0964 P 41958dc5e81443978e08a337fbb255bc [term 1 LEADER]: Becoming Leader. State: Replica: 41958dc5e81443978e08a337fbb255bc, State: Running, Role: LEADER
I20260709 12:14:32.621081   775 consensus_queue.cc:237] T 84f90776262f4fe7901e972d2cfe0964 P 41958dc5e81443978e08a337fbb255bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.622412   772 raft_consensus.cc:515] T b949a4dcd53f45cb8acb010c7d4d0904 P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.626462   547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b949a4dcd53f45cb8acb010c7d4d0904" candidate_uuid: "41958dc5e81443978e08a337fbb255bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d77cbf0f464436a88ee930055f8e05"
I20260709 12:14:32.618762   737 raft_consensus.cc:740] T 83a2e1850e8c47b880013ccc28f23290 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41958dc5e81443978e08a337fbb255bc, State: Initialized, Role: FOLLOWER
I20260709 12:14:32.627542   740 raft_consensus.cc:359] T b949a4dcd53f45cb8acb010c7d4d0904 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
W20260709 12:14:32.627985   587 leader_election.cc:343] T b949a4dcd53f45cb8acb010c7d4d0904 P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:32.627576   737 consensus_queue.cc:260] T 83a2e1850e8c47b880013ccc28f23290 P 41958dc5e81443978e08a337fbb255bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.630486   737 ts_tablet_manager.cc:1434] T 83a2e1850e8c47b880013ccc28f23290 P 41958dc5e81443978e08a337fbb255bc: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:14:32.628387   740 raft_consensus.cc:385] T b949a4dcd53f45cb8acb010c7d4d0904 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:32.631357   740 raft_consensus.cc:740] T b949a4dcd53f45cb8acb010c7d4d0904 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d77cbf0f464436a88ee930055f8e05, State: Initialized, Role: FOLLOWER
I20260709 12:14:32.631711   737 tablet_bootstrap.cc:492] T 687d784a386b40c797cfe8eb4778a7e6 P 41958dc5e81443978e08a337fbb255bc: Bootstrap starting.
I20260709 12:14:32.632517   772 leader_election.cc:290] T b949a4dcd53f45cb8acb010c7d4d0904 P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 election: Requested vote from peers f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935), 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559)
I20260709 12:14:32.632265   740 consensus_queue.cc:260] T b949a4dcd53f45cb8acb010c7d4d0904 P f5d77cbf0f464436a88ee930055f8e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.635008   740 ts_tablet_manager.cc:1434] T b949a4dcd53f45cb8acb010c7d4d0904 P f5d77cbf0f464436a88ee930055f8e05: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:14:32.636179   740 tablet_bootstrap.cc:492] T 0595bc4b26de41a097a82c178a1df812 P f5d77cbf0f464436a88ee930055f8e05: Bootstrap starting.
I20260709 12:14:32.635877   443 catalog_manager.cc:5697] T a660883dd53541948b37b480edad2988 P f5d77cbf0f464436a88ee930055f8e05 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129). New cstate: current_term: 1 leader_uuid: "f5d77cbf0f464436a88ee930055f8e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:32.639181   737 tablet_bootstrap.cc:654] T 687d784a386b40c797cfe8eb4778a7e6 P 41958dc5e81443978e08a337fbb255bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:32.641644   693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b949a4dcd53f45cb8acb010c7d4d0904" candidate_uuid: "41958dc5e81443978e08a337fbb255bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21975c12fc284bc18715d45d96e9e63a"
I20260709 12:14:32.642262   693 raft_consensus.cc:3060] T b949a4dcd53f45cb8acb010c7d4d0904 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:32.644126   740 tablet_bootstrap.cc:654] T 0595bc4b26de41a097a82c178a1df812 P f5d77cbf0f464436a88ee930055f8e05: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:32.648131   444 catalog_manager.cc:5697] T 84f90776262f4fe7901e972d2cfe0964 P 41958dc5e81443978e08a337fbb255bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 41958dc5e81443978e08a337fbb255bc (127.20.196.130). New cstate: current_term: 1 leader_uuid: "41958dc5e81443978e08a337fbb255bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:32.650007   693 raft_consensus.cc:2468] T b949a4dcd53f45cb8acb010c7d4d0904 P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41958dc5e81443978e08a337fbb255bc in term 1.
I20260709 12:14:32.651173   586 leader_election.cc:304] T b949a4dcd53f45cb8acb010c7d4d0904 P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21975c12fc284bc18715d45d96e9e63a, 41958dc5e81443978e08a337fbb255bc; no voters: f5d77cbf0f464436a88ee930055f8e05
I20260709 12:14:32.651772   737 tablet_bootstrap.cc:492] T 687d784a386b40c797cfe8eb4778a7e6 P 41958dc5e81443978e08a337fbb255bc: No bootstrap required, opened a new log
I20260709 12:14:32.652347   775 raft_consensus.cc:2804] T b949a4dcd53f45cb8acb010c7d4d0904 P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:32.652485   737 ts_tablet_manager.cc:1403] T 687d784a386b40c797cfe8eb4778a7e6 P 41958dc5e81443978e08a337fbb255bc: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.003s
I20260709 12:14:32.654008   770 raft_consensus.cc:493] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.654531   770 raft_consensus.cc:515] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.656767   770 leader_election.cc:290] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935), 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883)
I20260709 12:14:32.652887   775 raft_consensus.cc:697] T b949a4dcd53f45cb8acb010c7d4d0904 P 41958dc5e81443978e08a337fbb255bc [term 1 LEADER]: Becoming Leader. State: Replica: 41958dc5e81443978e08a337fbb255bc, State: Running, Role: LEADER
I20260709 12:14:32.658332   775 consensus_queue.cc:237] T b949a4dcd53f45cb8acb010c7d4d0904 P 41958dc5e81443978e08a337fbb255bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.658625   547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0595bc4b26de41a097a82c178a1df812" candidate_uuid: "21975c12fc284bc18715d45d96e9e63a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d77cbf0f464436a88ee930055f8e05" is_pre_election: true
W20260709 12:14:32.660687   661 leader_election.cc:343] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:32.657449   737 raft_consensus.cc:359] T 687d784a386b40c797cfe8eb4778a7e6 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.661830   622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0595bc4b26de41a097a82c178a1df812" candidate_uuid: "21975c12fc284bc18715d45d96e9e63a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41958dc5e81443978e08a337fbb255bc" is_pre_election: true
I20260709 12:14:32.661897   737 raft_consensus.cc:385] T 687d784a386b40c797cfe8eb4778a7e6 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:32.662848   737 raft_consensus.cc:740] T 687d784a386b40c797cfe8eb4778a7e6 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41958dc5e81443978e08a337fbb255bc, State: Initialized, Role: FOLLOWER
I20260709 12:14:32.662739   622 raft_consensus.cc:2468] T 0595bc4b26de41a097a82c178a1df812 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21975c12fc284bc18715d45d96e9e63a in term 0.
I20260709 12:14:32.664827   740 tablet_bootstrap.cc:492] T 0595bc4b26de41a097a82c178a1df812 P f5d77cbf0f464436a88ee930055f8e05: No bootstrap required, opened a new log
I20260709 12:14:32.664618   737 consensus_queue.cc:260] T 687d784a386b40c797cfe8eb4778a7e6 P 41958dc5e81443978e08a337fbb255bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.665303   740 ts_tablet_manager.cc:1403] T 0595bc4b26de41a097a82c178a1df812 P f5d77cbf0f464436a88ee930055f8e05: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.010s
I20260709 12:14:32.666042   660 leader_election.cc:304] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21975c12fc284bc18715d45d96e9e63a, 41958dc5e81443978e08a337fbb255bc; no voters: f5d77cbf0f464436a88ee930055f8e05
I20260709 12:14:32.666950   737 ts_tablet_manager.cc:1434] T 687d784a386b40c797cfe8eb4778a7e6 P 41958dc5e81443978e08a337fbb255bc: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:14:32.668321   770 raft_consensus.cc:2804] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:32.668794   770 raft_consensus.cc:493] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:32.669174   770 raft_consensus.cc:3060] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:32.668062   740 raft_consensus.cc:359] T 0595bc4b26de41a097a82c178a1df812 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.670454   740 raft_consensus.cc:385] T 0595bc4b26de41a097a82c178a1df812 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:32.670785   740 raft_consensus.cc:740] T 0595bc4b26de41a097a82c178a1df812 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d77cbf0f464436a88ee930055f8e05, State: Initialized, Role: FOLLOWER
I20260709 12:14:32.671656   740 consensus_queue.cc:260] T 0595bc4b26de41a097a82c178a1df812 P f5d77cbf0f464436a88ee930055f8e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.673923   740 ts_tablet_manager.cc:1434] T 0595bc4b26de41a097a82c178a1df812 P f5d77cbf0f464436a88ee930055f8e05: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:14:32.675320   740 tablet_bootstrap.cc:492] T 07cbfec7b89b48f4bdc040734e73e4d7 P f5d77cbf0f464436a88ee930055f8e05: Bootstrap starting.
I20260709 12:14:32.674497   443 catalog_manager.cc:5697] T 83a2e1850e8c47b880013ccc28f23290 P f5d77cbf0f464436a88ee930055f8e05 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129). New cstate: current_term: 1 leader_uuid: "f5d77cbf0f464436a88ee930055f8e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:32.676934   741 raft_consensus.cc:493] T b5be268a4ee9400e94dc432e237e8774 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.677466   741 raft_consensus.cc:515] T b5be268a4ee9400e94dc432e237e8774 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.678061   770 raft_consensus.cc:515] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.679680   741 leader_election.cc:290] T b5be268a4ee9400e94dc432e237e8774 P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935), 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883)
I20260709 12:14:32.680830   622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5be268a4ee9400e94dc432e237e8774" candidate_uuid: "21975c12fc284bc18715d45d96e9e63a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41958dc5e81443978e08a337fbb255bc" is_pre_election: true
I20260709 12:14:32.681368   547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5be268a4ee9400e94dc432e237e8774" candidate_uuid: "21975c12fc284bc18715d45d96e9e63a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d77cbf0f464436a88ee930055f8e05" is_pre_election: true
I20260709 12:14:32.681809   622 raft_consensus.cc:2468] T b5be268a4ee9400e94dc432e237e8774 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21975c12fc284bc18715d45d96e9e63a in term 0.
I20260709 12:14:32.682035   547 raft_consensus.cc:2468] T b5be268a4ee9400e94dc432e237e8774 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21975c12fc284bc18715d45d96e9e63a in term 0.
I20260709 12:14:32.682324   740 tablet_bootstrap.cc:654] T 07cbfec7b89b48f4bdc040734e73e4d7 P f5d77cbf0f464436a88ee930055f8e05: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:32.683012   660 leader_election.cc:304] T b5be268a4ee9400e94dc432e237e8774 P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21975c12fc284bc18715d45d96e9e63a, 41958dc5e81443978e08a337fbb255bc; no voters: 
I20260709 12:14:32.684178   741 raft_consensus.cc:2804] T b5be268a4ee9400e94dc432e237e8774 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:32.684528   741 raft_consensus.cc:493] T b5be268a4ee9400e94dc432e237e8774 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:32.684857   741 raft_consensus.cc:3060] T b5be268a4ee9400e94dc432e237e8774 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:32.685499   547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0595bc4b26de41a097a82c178a1df812" candidate_uuid: "21975c12fc284bc18715d45d96e9e63a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d77cbf0f464436a88ee930055f8e05"
I20260709 12:14:32.686095   547 raft_consensus.cc:3060] T 0595bc4b26de41a097a82c178a1df812 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:32.690877   445 catalog_manager.cc:5697] T cd37500fb41a464bbe7f9a9652e5f0df P 41958dc5e81443978e08a337fbb255bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 41958dc5e81443978e08a337fbb255bc (127.20.196.130). New cstate: current_term: 1 leader_uuid: "41958dc5e81443978e08a337fbb255bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:32.692245   741 raft_consensus.cc:515] T b5be268a4ee9400e94dc432e237e8774 P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.693241   547 raft_consensus.cc:2468] T 0595bc4b26de41a097a82c178a1df812 P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21975c12fc284bc18715d45d96e9e63a in term 1.
I20260709 12:14:32.693953   775 raft_consensus.cc:493] T 83a2e1850e8c47b880013ccc28f23290 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.694527   775 raft_consensus.cc:515] T 83a2e1850e8c47b880013ccc28f23290 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.695549   741 leader_election.cc:290] T b5be268a4ee9400e94dc432e237e8774 P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 1 election: Requested vote from peers f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935), 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883)
I20260709 12:14:32.696307   740 tablet_bootstrap.cc:492] T 07cbfec7b89b48f4bdc040734e73e4d7 P f5d77cbf0f464436a88ee930055f8e05: No bootstrap required, opened a new log
I20260709 12:14:32.696295   622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5be268a4ee9400e94dc432e237e8774" candidate_uuid: "21975c12fc284bc18715d45d96e9e63a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41958dc5e81443978e08a337fbb255bc"
I20260709 12:14:32.696681   775 leader_election.cc:290] T 83a2e1850e8c47b880013ccc28f23290 P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935), 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559)
I20260709 12:14:32.697002   740 ts_tablet_manager.cc:1403] T 07cbfec7b89b48f4bdc040734e73e4d7 P f5d77cbf0f464436a88ee930055f8e05: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.013s
I20260709 12:14:32.697371   661 leader_election.cc:304] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21975c12fc284bc18715d45d96e9e63a, f5d77cbf0f464436a88ee930055f8e05; no voters: 
I20260709 12:14:32.693884   445 catalog_manager.cc:5697] T b949a4dcd53f45cb8acb010c7d4d0904 P 41958dc5e81443978e08a337fbb255bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 41958dc5e81443978e08a337fbb255bc (127.20.196.130). New cstate: current_term: 1 leader_uuid: "41958dc5e81443978e08a337fbb255bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:32.698750   693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a2e1850e8c47b880013ccc28f23290" candidate_uuid: "41958dc5e81443978e08a337fbb255bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21975c12fc284bc18715d45d96e9e63a" is_pre_election: true
I20260709 12:14:32.697012   622 raft_consensus.cc:3060] T b5be268a4ee9400e94dc432e237e8774 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:32.698750   545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a2e1850e8c47b880013ccc28f23290" candidate_uuid: "41958dc5e81443978e08a337fbb255bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d77cbf0f464436a88ee930055f8e05" is_pre_election: true
I20260709 12:14:32.699743   693 raft_consensus.cc:2393] T 83a2e1850e8c47b880013ccc28f23290 P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 41958dc5e81443978e08a337fbb255bc in current term 1: Already voted for candidate f5d77cbf0f464436a88ee930055f8e05 in this term.
I20260709 12:14:32.700002   740 raft_consensus.cc:359] T 07cbfec7b89b48f4bdc040734e73e4d7 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.700874   740 raft_consensus.cc:385] T 07cbfec7b89b48f4bdc040734e73e4d7 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:32.701121   740 raft_consensus.cc:740] T 07cbfec7b89b48f4bdc040734e73e4d7 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d77cbf0f464436a88ee930055f8e05, State: Initialized, Role: FOLLOWER
I20260709 12:14:32.701795   740 consensus_queue.cc:260] T 07cbfec7b89b48f4bdc040734e73e4d7 P f5d77cbf0f464436a88ee930055f8e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.703543   775 raft_consensus.cc:493] T 687d784a386b40c797cfe8eb4778a7e6 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.703886   740 ts_tablet_manager.cc:1434] T 07cbfec7b89b48f4bdc040734e73e4d7 P f5d77cbf0f464436a88ee930055f8e05: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:14:32.704209   587 leader_election.cc:304] T 83a2e1850e8c47b880013ccc28f23290 P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41958dc5e81443978e08a337fbb255bc; no voters: 21975c12fc284bc18715d45d96e9e63a, f5d77cbf0f464436a88ee930055f8e05
I20260709 12:14:32.704111   775 raft_consensus.cc:515] T 687d784a386b40c797cfe8eb4778a7e6 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.705161   772 raft_consensus.cc:3060] T 83a2e1850e8c47b880013ccc28f23290 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:32.706915   770 leader_election.cc:290] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 1 election: Requested vote from peers f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935), 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883)
I20260709 12:14:32.699673   547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5be268a4ee9400e94dc432e237e8774" candidate_uuid: "21975c12fc284bc18715d45d96e9e63a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d77cbf0f464436a88ee930055f8e05"
I20260709 12:14:32.707474   693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687d784a386b40c797cfe8eb4778a7e6" candidate_uuid: "41958dc5e81443978e08a337fbb255bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21975c12fc284bc18715d45d96e9e63a" is_pre_election: true
I20260709 12:14:32.708106   547 raft_consensus.cc:3060] T b5be268a4ee9400e94dc432e237e8774 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:32.708027   545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687d784a386b40c797cfe8eb4778a7e6" candidate_uuid: "41958dc5e81443978e08a337fbb255bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d77cbf0f464436a88ee930055f8e05" is_pre_election: true
I20260709 12:14:32.710155   545 raft_consensus.cc:2393] T 687d784a386b40c797cfe8eb4778a7e6 P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 41958dc5e81443978e08a337fbb255bc in current term 1: Already voted for candidate 21975c12fc284bc18715d45d96e9e63a in this term.
I20260709 12:14:32.711194   621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0595bc4b26de41a097a82c178a1df812" candidate_uuid: "21975c12fc284bc18715d45d96e9e63a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41958dc5e81443978e08a337fbb255bc"
I20260709 12:14:32.711344   587 leader_election.cc:304] T 687d784a386b40c797cfe8eb4778a7e6 P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41958dc5e81443978e08a337fbb255bc; no voters: 21975c12fc284bc18715d45d96e9e63a, f5d77cbf0f464436a88ee930055f8e05
I20260709 12:14:32.711809   621 raft_consensus.cc:3060] T 0595bc4b26de41a097a82c178a1df812 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:32.712121   742 raft_consensus.cc:3060] T 687d784a386b40c797cfe8eb4778a7e6 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:32.712430   772 raft_consensus.cc:2749] T 83a2e1850e8c47b880013ccc28f23290 P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:32.714816   547 raft_consensus.cc:2468] T b5be268a4ee9400e94dc432e237e8774 P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21975c12fc284bc18715d45d96e9e63a in term 1.
I20260709 12:14:32.719267   775 leader_election.cc:290] T 687d784a386b40c797cfe8eb4778a7e6 P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935), 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559)
I20260709 12:14:32.720511   621 raft_consensus.cc:2468] T 0595bc4b26de41a097a82c178a1df812 P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21975c12fc284bc18715d45d96e9e63a in term 1.
I20260709 12:14:32.721041   661 leader_election.cc:304] T b5be268a4ee9400e94dc432e237e8774 P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21975c12fc284bc18715d45d96e9e63a, f5d77cbf0f464436a88ee930055f8e05; no voters: 
I20260709 12:14:32.721962   741 raft_consensus.cc:2804] T b5be268a4ee9400e94dc432e237e8774 P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:32.707526   770 raft_consensus.cc:2804] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:32.723237   746 raft_consensus.cc:493] T 07cbfec7b89b48f4bdc040734e73e4d7 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.723850   770 raft_consensus.cc:697] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a [term 1 LEADER]: Becoming Leader. State: Replica: 21975c12fc284bc18715d45d96e9e63a, State: Running, Role: LEADER
I20260709 12:14:32.723768   746 raft_consensus.cc:515] T 07cbfec7b89b48f4bdc040734e73e4d7 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.725188   770 consensus_queue.cc:237] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.725946   746 leader_election.cc:290] T 07cbfec7b89b48f4bdc040734e73e4d7 P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883), 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559)
I20260709 12:14:32.726691   621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07cbfec7b89b48f4bdc040734e73e4d7" candidate_uuid: "f5d77cbf0f464436a88ee930055f8e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41958dc5e81443978e08a337fbb255bc" is_pre_election: true
I20260709 12:14:32.727350   621 raft_consensus.cc:2468] T 07cbfec7b89b48f4bdc040734e73e4d7 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5d77cbf0f464436a88ee930055f8e05 in term 0.
I20260709 12:14:32.728928   693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07cbfec7b89b48f4bdc040734e73e4d7" candidate_uuid: "f5d77cbf0f464436a88ee930055f8e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21975c12fc284bc18715d45d96e9e63a" is_pre_election: true
I20260709 12:14:32.729597   693 raft_consensus.cc:2468] T 07cbfec7b89b48f4bdc040734e73e4d7 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5d77cbf0f464436a88ee930055f8e05 in term 0.
I20260709 12:14:32.731346   511 leader_election.cc:304] T 07cbfec7b89b48f4bdc040734e73e4d7 P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21975c12fc284bc18715d45d96e9e63a, f5d77cbf0f464436a88ee930055f8e05; no voters: 
I20260709 12:14:32.732673   746 raft_consensus.cc:2804] T 07cbfec7b89b48f4bdc040734e73e4d7 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:32.733103   746 raft_consensus.cc:493] T 07cbfec7b89b48f4bdc040734e73e4d7 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:32.733486   746 raft_consensus.cc:3060] T 07cbfec7b89b48f4bdc040734e73e4d7 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:32.735539   742 raft_consensus.cc:2749] T 687d784a386b40c797cfe8eb4778a7e6 P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:32.739064   622 raft_consensus.cc:2468] T b5be268a4ee9400e94dc432e237e8774 P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21975c12fc284bc18715d45d96e9e63a in term 1.
I20260709 12:14:32.741153   741 raft_consensus.cc:697] T b5be268a4ee9400e94dc432e237e8774 P 21975c12fc284bc18715d45d96e9e63a [term 1 LEADER]: Becoming Leader. State: Replica: 21975c12fc284bc18715d45d96e9e63a, State: Running, Role: LEADER
I20260709 12:14:32.741353   746 raft_consensus.cc:515] T 07cbfec7b89b48f4bdc040734e73e4d7 P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.742309   741 consensus_queue.cc:237] T b5be268a4ee9400e94dc432e237e8774 P 21975c12fc284bc18715d45d96e9e63a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.743655   746 leader_election.cc:290] T 07cbfec7b89b48f4bdc040734e73e4d7 P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 1 election: Requested vote from peers 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883), 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559)
I20260709 12:14:32.744488   622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07cbfec7b89b48f4bdc040734e73e4d7" candidate_uuid: "f5d77cbf0f464436a88ee930055f8e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41958dc5e81443978e08a337fbb255bc"
I20260709 12:14:32.744776   693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07cbfec7b89b48f4bdc040734e73e4d7" candidate_uuid: "f5d77cbf0f464436a88ee930055f8e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21975c12fc284bc18715d45d96e9e63a"
I20260709 12:14:32.745149   622 raft_consensus.cc:3060] T 07cbfec7b89b48f4bdc040734e73e4d7 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:32.745354   693 raft_consensus.cc:3060] T 07cbfec7b89b48f4bdc040734e73e4d7 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:32.752172   622 raft_consensus.cc:2468] T 07cbfec7b89b48f4bdc040734e73e4d7 P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d77cbf0f464436a88ee930055f8e05 in term 1.
I20260709 12:14:32.753234   511 leader_election.cc:304] T 07cbfec7b89b48f4bdc040734e73e4d7 P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41958dc5e81443978e08a337fbb255bc, f5d77cbf0f464436a88ee930055f8e05; no voters: 
I20260709 12:14:32.753460   693 raft_consensus.cc:2468] T 07cbfec7b89b48f4bdc040734e73e4d7 P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d77cbf0f464436a88ee930055f8e05 in term 1.
I20260709 12:14:32.753994   746 raft_consensus.cc:2804] T 07cbfec7b89b48f4bdc040734e73e4d7 P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:32.753280   445 catalog_manager.cc:5697] T b5be268a4ee9400e94dc432e237e8774 P 21975c12fc284bc18715d45d96e9e63a reported cstate change: term changed from 0 to 1, leader changed from <none> to 21975c12fc284bc18715d45d96e9e63a (127.20.196.131). New cstate: current_term: 1 leader_uuid: "21975c12fc284bc18715d45d96e9e63a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:32.754777   746 raft_consensus.cc:697] T 07cbfec7b89b48f4bdc040734e73e4d7 P f5d77cbf0f464436a88ee930055f8e05 [term 1 LEADER]: Becoming Leader. State: Replica: f5d77cbf0f464436a88ee930055f8e05, State: Running, Role: LEADER
I20260709 12:14:32.755560   746 consensus_queue.cc:237] T 07cbfec7b89b48f4bdc040734e73e4d7 P f5d77cbf0f464436a88ee930055f8e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.763518   443 catalog_manager.cc:5697] T 07cbfec7b89b48f4bdc040734e73e4d7 P f5d77cbf0f464436a88ee930055f8e05 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129). New cstate: current_term: 1 leader_uuid: "f5d77cbf0f464436a88ee930055f8e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:32.766374   445 catalog_manager.cc:5697] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a reported cstate change: term changed from 0 to 1, leader changed from <none> to 21975c12fc284bc18715d45d96e9e63a (127.20.196.131). New cstate: current_term: 1 leader_uuid: "21975c12fc284bc18715d45d96e9e63a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:32.908521   622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd37500fb41a464bbe7f9a9652e5f0df"
dest_uuid: "41958dc5e81443978e08a337fbb255bc"
mode: GRACEFUL
new_leader_uuid: "f5d77cbf0f464436a88ee930055f8e05"
 from {username='slave'} at 127.0.0.1:33038
I20260709 12:14:32.909057   622 raft_consensus.cc:606] T cd37500fb41a464bbe7f9a9652e5f0df P 41958dc5e81443978e08a337fbb255bc [term 1 LEADER]: Received request to transfer leadership to TS f5d77cbf0f464436a88ee930055f8e05
I20260709 12:14:32.921136   693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "687d784a386b40c797cfe8eb4778a7e6"
dest_uuid: "21975c12fc284bc18715d45d96e9e63a"
mode: GRACEFUL
new_leader_uuid: "f5d77cbf0f464436a88ee930055f8e05"
 from {username='slave'} at 127.0.0.1:38638
I20260709 12:14:32.921658   693 raft_consensus.cc:606] T 687d784a386b40c797cfe8eb4778a7e6 P 21975c12fc284bc18715d45d96e9e63a [term 1 LEADER]: Received request to transfer leadership to TS f5d77cbf0f464436a88ee930055f8e05
I20260709 12:14:32.926940   693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0595bc4b26de41a097a82c178a1df812"
dest_uuid: "21975c12fc284bc18715d45d96e9e63a"
mode: GRACEFUL
new_leader_uuid: "f5d77cbf0f464436a88ee930055f8e05"
 from {username='slave'} at 127.0.0.1:38638
I20260709 12:14:32.927464   693 raft_consensus.cc:606] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a [term 1 LEADER]: Received request to transfer leadership to TS f5d77cbf0f464436a88ee930055f8e05
I20260709 12:14:32.942552   547 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07cbfec7b89b48f4bdc040734e73e4d7"
dest_uuid: "f5d77cbf0f464436a88ee930055f8e05"
mode: GRACEFUL
new_leader_uuid: "41958dc5e81443978e08a337fbb255bc"
 from {username='slave'} at 127.0.0.1:50018
I20260709 12:14:32.943166   547 raft_consensus.cc:606] T 07cbfec7b89b48f4bdc040734e73e4d7 P f5d77cbf0f464436a88ee930055f8e05 [term 1 LEADER]: Received request to transfer leadership to TS 41958dc5e81443978e08a337fbb255bc
I20260709 12:14:32.954380   547 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83a2e1850e8c47b880013ccc28f23290"
dest_uuid: "f5d77cbf0f464436a88ee930055f8e05"
mode: GRACEFUL
new_leader_uuid: "41958dc5e81443978e08a337fbb255bc"
 from {username='slave'} at 127.0.0.1:50018
I20260709 12:14:32.954918   547 raft_consensus.cc:606] T 83a2e1850e8c47b880013ccc28f23290 P f5d77cbf0f464436a88ee930055f8e05 [term 1 LEADER]: Received request to transfer leadership to TS 41958dc5e81443978e08a337fbb255bc
I20260709 12:14:32.959856   741 consensus_queue.cc:1048] T 687d784a386b40c797cfe8eb4778a7e6 P 21975c12fc284bc18715d45d96e9e63a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:32.965905   770 raft_consensus.cc:993] T 687d784a386b40c797cfe8eb4778a7e6 P 21975c12fc284bc18715d45d96e9e63a: : Instructing follower f5d77cbf0f464436a88ee930055f8e05 to start an election
I20260709 12:14:32.966645   741 raft_consensus.cc:1081] T 687d784a386b40c797cfe8eb4778a7e6 P 21975c12fc284bc18715d45d96e9e63a [term 1 LEADER]: Signalling peer f5d77cbf0f464436a88ee930055f8e05 to start an election
I20260709 12:14:32.968613   545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "687d784a386b40c797cfe8eb4778a7e6"
dest_uuid: "f5d77cbf0f464436a88ee930055f8e05"
 from {username='slave'} at 127.0.0.1:50008
I20260709 12:14:32.969221   545 raft_consensus.cc:493] T 687d784a386b40c797cfe8eb4778a7e6 P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:32.969655   545 raft_consensus.cc:3060] T 687d784a386b40c797cfe8eb4778a7e6 P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:32.974603   770 consensus_queue.cc:1048] T 687d784a386b40c797cfe8eb4778a7e6 P 21975c12fc284bc18715d45d96e9e63a [LEADER]: Connected to new peer: Peer: permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:32.977094   545 raft_consensus.cc:515] T 687d784a386b40c797cfe8eb4778a7e6 P f5d77cbf0f464436a88ee930055f8e05 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.979162   547 raft_consensus.cc:1240] T 687d784a386b40c797cfe8eb4778a7e6 P f5d77cbf0f464436a88ee930055f8e05 [term 2 FOLLOWER]: Rejecting Update request from peer 21975c12fc284bc18715d45d96e9e63a for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:32.981045   621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687d784a386b40c797cfe8eb4778a7e6" candidate_uuid: "f5d77cbf0f464436a88ee930055f8e05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41958dc5e81443978e08a337fbb255bc"
I20260709 12:14:32.981246   545 leader_election.cc:290] T 687d784a386b40c797cfe8eb4778a7e6 P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 2 election: Requested vote from peers 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883), 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559)
I20260709 12:14:32.981464   693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687d784a386b40c797cfe8eb4778a7e6" candidate_uuid: "f5d77cbf0f464436a88ee930055f8e05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21975c12fc284bc18715d45d96e9e63a"
I20260709 12:14:32.982110   693 raft_consensus.cc:3055] T 687d784a386b40c797cfe8eb4778a7e6 P 21975c12fc284bc18715d45d96e9e63a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:32.982438   693 raft_consensus.cc:740] T 687d784a386b40c797cfe8eb4778a7e6 P 21975c12fc284bc18715d45d96e9e63a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21975c12fc284bc18715d45d96e9e63a, State: Running, Role: LEADER
I20260709 12:14:32.983374   693 consensus_queue.cc:260] T 687d784a386b40c797cfe8eb4778a7e6 P 21975c12fc284bc18715d45d96e9e63a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.983743   746 raft_consensus.cc:493] T b949a4dcd53f45cb8acb010c7d4d0904 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.984179   693 raft_consensus.cc:3060] T 687d784a386b40c797cfe8eb4778a7e6 P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:32.984243   746 raft_consensus.cc:515] T b949a4dcd53f45cb8acb010c7d4d0904 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.986088   746 leader_election.cc:290] T b949a4dcd53f45cb8acb010c7d4d0904 P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883), 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559)
I20260709 12:14:32.986922   621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b949a4dcd53f45cb8acb010c7d4d0904" candidate_uuid: "f5d77cbf0f464436a88ee930055f8e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41958dc5e81443978e08a337fbb255bc" is_pre_election: true
I20260709 12:14:32.987356   695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b949a4dcd53f45cb8acb010c7d4d0904" candidate_uuid: "f5d77cbf0f464436a88ee930055f8e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21975c12fc284bc18715d45d96e9e63a" is_pre_election: true
I20260709 12:14:32.988303   695 raft_consensus.cc:2393] T b949a4dcd53f45cb8acb010c7d4d0904 P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5d77cbf0f464436a88ee930055f8e05 in current term 1: Already voted for candidate 41958dc5e81443978e08a337fbb255bc in this term.
I20260709 12:14:32.989696   511 leader_election.cc:304] T b949a4dcd53f45cb8acb010c7d4d0904 P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5d77cbf0f464436a88ee930055f8e05; no voters: 21975c12fc284bc18715d45d96e9e63a, 41958dc5e81443978e08a337fbb255bc
I20260709 12:14:32.990752   746 raft_consensus.cc:3060] T b949a4dcd53f45cb8acb010c7d4d0904 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:32.991573   693 raft_consensus.cc:2468] T 687d784a386b40c797cfe8eb4778a7e6 P 21975c12fc284bc18715d45d96e9e63a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d77cbf0f464436a88ee930055f8e05 in term 2.
I20260709 12:14:32.993410   511 leader_election.cc:304] T 687d784a386b40c797cfe8eb4778a7e6 P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21975c12fc284bc18715d45d96e9e63a, f5d77cbf0f464436a88ee930055f8e05; no voters: 41958dc5e81443978e08a337fbb255bc
I20260709 12:14:32.994988   773 raft_consensus.cc:2804] T 687d784a386b40c797cfe8eb4778a7e6 P f5d77cbf0f464436a88ee930055f8e05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:32.995481   773 raft_consensus.cc:697] T 687d784a386b40c797cfe8eb4778a7e6 P f5d77cbf0f464436a88ee930055f8e05 [term 2 LEADER]: Becoming Leader. State: Replica: f5d77cbf0f464436a88ee930055f8e05, State: Running, Role: LEADER
I20260709 12:14:32.996290   773 consensus_queue.cc:237] T 687d784a386b40c797cfe8eb4778a7e6 P f5d77cbf0f464436a88ee930055f8e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:32.998286   746 raft_consensus.cc:2749] T b949a4dcd53f45cb8acb010c7d4d0904 P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:33.003123   445 catalog_manager.cc:5697] T 687d784a386b40c797cfe8eb4778a7e6 P f5d77cbf0f464436a88ee930055f8e05 reported cstate change: term changed from 1 to 2, leader changed from 21975c12fc284bc18715d45d96e9e63a (127.20.196.131) to f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129). New cstate: current_term: 2 leader_uuid: "f5d77cbf0f464436a88ee930055f8e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:33.003784   746 consensus_queue.cc:1048] T a660883dd53541948b37b480edad2988 P f5d77cbf0f464436a88ee930055f8e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:33.019240   773 consensus_queue.cc:1048] T a660883dd53541948b37b480edad2988 P f5d77cbf0f464436a88ee930055f8e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:33.035989   773 consensus_queue.cc:1048] T 83a2e1850e8c47b880013ccc28f23290 P f5d77cbf0f464436a88ee930055f8e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:33.042514   746 raft_consensus.cc:993] T 83a2e1850e8c47b880013ccc28f23290 P f5d77cbf0f464436a88ee930055f8e05: : Instructing follower 41958dc5e81443978e08a337fbb255bc to start an election
I20260709 12:14:33.042995   761 raft_consensus.cc:1081] T 83a2e1850e8c47b880013ccc28f23290 P f5d77cbf0f464436a88ee930055f8e05 [term 1 LEADER]: Signalling peer 41958dc5e81443978e08a337fbb255bc to start an election
I20260709 12:14:33.045225   621 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83a2e1850e8c47b880013ccc28f23290"
dest_uuid: "41958dc5e81443978e08a337fbb255bc"
 from {username='slave'} at 127.0.0.1:33022
I20260709 12:14:33.045789   621 raft_consensus.cc:493] T 83a2e1850e8c47b880013ccc28f23290 P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:33.046161   621 raft_consensus.cc:3060] T 83a2e1850e8c47b880013ccc28f23290 P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:33.049211   761 consensus_queue.cc:1048] T 83a2e1850e8c47b880013ccc28f23290 P f5d77cbf0f464436a88ee930055f8e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:33.052670   621 raft_consensus.cc:515] T 83a2e1850e8c47b880013ccc28f23290 P 41958dc5e81443978e08a337fbb255bc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:33.053890   622 raft_consensus.cc:1240] T 83a2e1850e8c47b880013ccc28f23290 P 41958dc5e81443978e08a337fbb255bc [term 2 FOLLOWER]: Rejecting Update request from peer f5d77cbf0f464436a88ee930055f8e05 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:33.056150   621 leader_election.cc:290] T 83a2e1850e8c47b880013ccc28f23290 P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 2 election: Requested vote from peers f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935), 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559)
I20260709 12:14:33.056336   761 consensus_queue.cc:1059] T 83a2e1850e8c47b880013ccc28f23290 P f5d77cbf0f464436a88ee930055f8e05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:33.056874   547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a2e1850e8c47b880013ccc28f23290" candidate_uuid: "41958dc5e81443978e08a337fbb255bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5d77cbf0f464436a88ee930055f8e05"
I20260709 12:14:33.057122   761 raft_consensus.cc:3055] T 83a2e1850e8c47b880013ccc28f23290 P f5d77cbf0f464436a88ee930055f8e05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:33.057461   761 raft_consensus.cc:740] T 83a2e1850e8c47b880013ccc28f23290 P f5d77cbf0f464436a88ee930055f8e05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5d77cbf0f464436a88ee930055f8e05, State: Running, Role: LEADER
I20260709 12:14:33.058099   761 consensus_queue.cc:260] T 83a2e1850e8c47b880013ccc28f23290 P f5d77cbf0f464436a88ee930055f8e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:33.058910   761 raft_consensus.cc:3060] T 83a2e1850e8c47b880013ccc28f23290 P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:33.059403   695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a2e1850e8c47b880013ccc28f23290" candidate_uuid: "41958dc5e81443978e08a337fbb255bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21975c12fc284bc18715d45d96e9e63a"
I20260709 12:14:33.069823   547 raft_consensus.cc:2468] T 83a2e1850e8c47b880013ccc28f23290 P f5d77cbf0f464436a88ee930055f8e05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41958dc5e81443978e08a337fbb255bc in term 2.
I20260709 12:14:33.071643   587 leader_election.cc:304] T 83a2e1850e8c47b880013ccc28f23290 P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41958dc5e81443978e08a337fbb255bc, f5d77cbf0f464436a88ee930055f8e05; no voters: 21975c12fc284bc18715d45d96e9e63a
I20260709 12:14:33.072516   742 raft_consensus.cc:2804] T 83a2e1850e8c47b880013ccc28f23290 P 41958dc5e81443978e08a337fbb255bc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:33.073096   742 raft_consensus.cc:697] T 83a2e1850e8c47b880013ccc28f23290 P 41958dc5e81443978e08a337fbb255bc [term 2 LEADER]: Becoming Leader. State: Replica: 41958dc5e81443978e08a337fbb255bc, State: Running, Role: LEADER
I20260709 12:14:33.073216   772 consensus_queue.cc:1048] T b949a4dcd53f45cb8acb010c7d4d0904 P 41958dc5e81443978e08a337fbb255bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:33.074043   779 consensus_queue.cc:1048] T 84f90776262f4fe7901e972d2cfe0964 P 41958dc5e81443978e08a337fbb255bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:33.073990   742 consensus_queue.cc:237] T 83a2e1850e8c47b880013ccc28f23290 P 41958dc5e81443978e08a337fbb255bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:33.082494   445 catalog_manager.cc:5697] T 83a2e1850e8c47b880013ccc28f23290 P 41958dc5e81443978e08a337fbb255bc reported cstate change: term changed from 1 to 2, leader changed from f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129) to 41958dc5e81443978e08a337fbb255bc (127.20.196.130). New cstate: current_term: 2 leader_uuid: "41958dc5e81443978e08a337fbb255bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:33.089157   782 consensus_queue.cc:1048] T 84f90776262f4fe7901e972d2cfe0964 P 41958dc5e81443978e08a337fbb255bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:33.090701   782 consensus_queue.cc:1048] T cd37500fb41a464bbe7f9a9652e5f0df P 41958dc5e81443978e08a337fbb255bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:33.096405   782 consensus_queue.cc:1048] T b949a4dcd53f45cb8acb010c7d4d0904 P 41958dc5e81443978e08a337fbb255bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:33.125298   772 raft_consensus.cc:993] T cd37500fb41a464bbe7f9a9652e5f0df P 41958dc5e81443978e08a337fbb255bc: : Instructing follower f5d77cbf0f464436a88ee930055f8e05 to start an election
I20260709 12:14:33.125842   775 raft_consensus.cc:1081] T cd37500fb41a464bbe7f9a9652e5f0df P 41958dc5e81443978e08a337fbb255bc [term 1 LEADER]: Signalling peer f5d77cbf0f464436a88ee930055f8e05 to start an election
I20260709 12:14:33.128136   547 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd37500fb41a464bbe7f9a9652e5f0df"
dest_uuid: "f5d77cbf0f464436a88ee930055f8e05"
 from {username='slave'} at 127.0.0.1:50002
I20260709 12:14:33.128876   547 raft_consensus.cc:493] T cd37500fb41a464bbe7f9a9652e5f0df P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:33.129328   547 raft_consensus.cc:3060] T cd37500fb41a464bbe7f9a9652e5f0df P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:33.131175   775 consensus_queue.cc:1048] T cd37500fb41a464bbe7f9a9652e5f0df P 41958dc5e81443978e08a337fbb255bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:33.131983   770 consensus_queue.cc:1048] T b5be268a4ee9400e94dc432e237e8774 P 21975c12fc284bc18715d45d96e9e63a [LEADER]: Connected to new peer: Peer: permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:33.142809   547 raft_consensus.cc:515] T cd37500fb41a464bbe7f9a9652e5f0df P f5d77cbf0f464436a88ee930055f8e05 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:33.144006   545 raft_consensus.cc:1240] T cd37500fb41a464bbe7f9a9652e5f0df P f5d77cbf0f464436a88ee930055f8e05 [term 2 FOLLOWER]: Rejecting Update request from peer 41958dc5e81443978e08a337fbb255bc for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:33.147862   547 leader_election.cc:290] T cd37500fb41a464bbe7f9a9652e5f0df P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 2 election: Requested vote from peers 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883), 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559)
I20260709 12:14:33.148963   695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd37500fb41a464bbe7f9a9652e5f0df" candidate_uuid: "f5d77cbf0f464436a88ee930055f8e05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21975c12fc284bc18715d45d96e9e63a"
I20260709 12:14:33.149622   695 raft_consensus.cc:3060] T cd37500fb41a464bbe7f9a9652e5f0df P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:33.151104   621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd37500fb41a464bbe7f9a9652e5f0df" candidate_uuid: "f5d77cbf0f464436a88ee930055f8e05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41958dc5e81443978e08a337fbb255bc"
I20260709 12:14:33.151764   621 raft_consensus.cc:3055] T cd37500fb41a464bbe7f9a9652e5f0df P 41958dc5e81443978e08a337fbb255bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:33.152055   621 raft_consensus.cc:740] T cd37500fb41a464bbe7f9a9652e5f0df P 41958dc5e81443978e08a337fbb255bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 41958dc5e81443978e08a337fbb255bc, State: Running, Role: LEADER
I20260709 12:14:33.152853   621 consensus_queue.cc:260] T cd37500fb41a464bbe7f9a9652e5f0df P 41958dc5e81443978e08a337fbb255bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:33.153868   782 consensus_queue.cc:1059] T cd37500fb41a464bbe7f9a9652e5f0df P 41958dc5e81443978e08a337fbb255bc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:33.155673   792 consensus_queue.cc:1048] T b5be268a4ee9400e94dc432e237e8774 P 21975c12fc284bc18715d45d96e9e63a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:33.158537   621 raft_consensus.cc:3060] T cd37500fb41a464bbe7f9a9652e5f0df P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:33.165994   621 raft_consensus.cc:2468] T cd37500fb41a464bbe7f9a9652e5f0df P 41958dc5e81443978e08a337fbb255bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d77cbf0f464436a88ee930055f8e05 in term 2.
I20260709 12:14:33.167126   511 leader_election.cc:304] T cd37500fb41a464bbe7f9a9652e5f0df P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41958dc5e81443978e08a337fbb255bc, f5d77cbf0f464436a88ee930055f8e05; no voters: 
I20260709 12:14:33.167794   695 raft_consensus.cc:2468] T cd37500fb41a464bbe7f9a9652e5f0df P 21975c12fc284bc18715d45d96e9e63a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d77cbf0f464436a88ee930055f8e05 in term 2.
I20260709 12:14:33.168052   746 raft_consensus.cc:2804] T cd37500fb41a464bbe7f9a9652e5f0df P f5d77cbf0f464436a88ee930055f8e05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:33.168615   746 raft_consensus.cc:697] T cd37500fb41a464bbe7f9a9652e5f0df P f5d77cbf0f464436a88ee930055f8e05 [term 2 LEADER]: Becoming Leader. State: Replica: f5d77cbf0f464436a88ee930055f8e05, State: Running, Role: LEADER
I20260709 12:14:33.169478   746 consensus_queue.cc:237] T cd37500fb41a464bbe7f9a9652e5f0df P f5d77cbf0f464436a88ee930055f8e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:33.180462   445 catalog_manager.cc:5697] T cd37500fb41a464bbe7f9a9652e5f0df P f5d77cbf0f464436a88ee930055f8e05 reported cstate change: term changed from 1 to 2, leader changed from 41958dc5e81443978e08a337fbb255bc (127.20.196.130) to f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129). New cstate: current_term: 2 leader_uuid: "f5d77cbf0f464436a88ee930055f8e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:33.285398   746 consensus_queue.cc:1048] T 07cbfec7b89b48f4bdc040734e73e4d7 P f5d77cbf0f464436a88ee930055f8e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:33.286868   761 consensus_queue.cc:1048] T 07cbfec7b89b48f4bdc040734e73e4d7 P f5d77cbf0f464436a88ee930055f8e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:33.291630   792 consensus_queue.cc:1048] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a [LEADER]: Connected to new peer: Peer: permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:33.298022   773 raft_consensus.cc:993] T 07cbfec7b89b48f4bdc040734e73e4d7 P f5d77cbf0f464436a88ee930055f8e05: : Instructing follower 41958dc5e81443978e08a337fbb255bc to start an election
I20260709 12:14:33.300585   773 raft_consensus.cc:1081] T 07cbfec7b89b48f4bdc040734e73e4d7 P f5d77cbf0f464436a88ee930055f8e05 [term 1 LEADER]: Signalling peer 41958dc5e81443978e08a337fbb255bc to start an election
I20260709 12:14:33.304322   621 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07cbfec7b89b48f4bdc040734e73e4d7"
dest_uuid: "41958dc5e81443978e08a337fbb255bc"
 from {username='slave'} at 127.0.0.1:33022
I20260709 12:14:33.305033   621 raft_consensus.cc:493] T 07cbfec7b89b48f4bdc040734e73e4d7 P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:33.305467   621 raft_consensus.cc:3060] T 07cbfec7b89b48f4bdc040734e73e4d7 P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:33.313097   621 raft_consensus.cc:515] T 07cbfec7b89b48f4bdc040734e73e4d7 P 41958dc5e81443978e08a337fbb255bc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:33.314018   793 consensus_queue.cc:1048] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:33.315308   621 leader_election.cc:290] T 07cbfec7b89b48f4bdc040734e73e4d7 P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 2 election: Requested vote from peers f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935), 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559)
I20260709 12:14:33.316438   695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07cbfec7b89b48f4bdc040734e73e4d7" candidate_uuid: "41958dc5e81443978e08a337fbb255bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21975c12fc284bc18715d45d96e9e63a"
I20260709 12:14:33.315990   545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07cbfec7b89b48f4bdc040734e73e4d7" candidate_uuid: "41958dc5e81443978e08a337fbb255bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5d77cbf0f464436a88ee930055f8e05"
I20260709 12:14:33.317070   695 raft_consensus.cc:3060] T 07cbfec7b89b48f4bdc040734e73e4d7 P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:33.317286   545 raft_consensus.cc:3055] T 07cbfec7b89b48f4bdc040734e73e4d7 P f5d77cbf0f464436a88ee930055f8e05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:33.317679   545 raft_consensus.cc:740] T 07cbfec7b89b48f4bdc040734e73e4d7 P f5d77cbf0f464436a88ee930055f8e05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5d77cbf0f464436a88ee930055f8e05, State: Running, Role: LEADER
I20260709 12:14:33.318490   545 consensus_queue.cc:260] T 07cbfec7b89b48f4bdc040734e73e4d7 P f5d77cbf0f464436a88ee930055f8e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:33.319635   545 raft_consensus.cc:3060] T 07cbfec7b89b48f4bdc040734e73e4d7 P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:33.326889   793 raft_consensus.cc:993] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a: : Instructing follower f5d77cbf0f464436a88ee930055f8e05 to start an election
I20260709 12:14:33.327512   793 raft_consensus.cc:1081] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a [term 1 LEADER]: Signalling peer f5d77cbf0f464436a88ee930055f8e05 to start an election
I20260709 12:14:33.327566   545 raft_consensus.cc:2468] T 07cbfec7b89b48f4bdc040734e73e4d7 P f5d77cbf0f464436a88ee930055f8e05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41958dc5e81443978e08a337fbb255bc in term 2.
I20260709 12:14:33.329093   587 leader_election.cc:304] T 07cbfec7b89b48f4bdc040734e73e4d7 P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41958dc5e81443978e08a337fbb255bc, f5d77cbf0f464436a88ee930055f8e05; no voters: 
I20260709 12:14:33.330066   782 raft_consensus.cc:2804] T 07cbfec7b89b48f4bdc040734e73e4d7 P 41958dc5e81443978e08a337fbb255bc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:33.330355   695 raft_consensus.cc:2468] T 07cbfec7b89b48f4bdc040734e73e4d7 P 21975c12fc284bc18715d45d96e9e63a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41958dc5e81443978e08a337fbb255bc in term 2.
I20260709 12:14:33.330523   782 raft_consensus.cc:697] T 07cbfec7b89b48f4bdc040734e73e4d7 P 41958dc5e81443978e08a337fbb255bc [term 2 LEADER]: Becoming Leader. State: Replica: 41958dc5e81443978e08a337fbb255bc, State: Running, Role: LEADER
I20260709 12:14:33.331522   782 consensus_queue.cc:237] T 07cbfec7b89b48f4bdc040734e73e4d7 P 41958dc5e81443978e08a337fbb255bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:33.331933   545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0595bc4b26de41a097a82c178a1df812"
dest_uuid: "f5d77cbf0f464436a88ee930055f8e05"
 from {username='slave'} at 127.0.0.1:50008
I20260709 12:14:33.333817   545 raft_consensus.cc:493] T 0595bc4b26de41a097a82c178a1df812 P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:33.334249   545 raft_consensus.cc:3060] T 0595bc4b26de41a097a82c178a1df812 P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:33.340160   545 raft_consensus.cc:515] T 0595bc4b26de41a097a82c178a1df812 P f5d77cbf0f464436a88ee930055f8e05 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:33.341872   545 leader_election.cc:290] T 0595bc4b26de41a097a82c178a1df812 P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 2 election: Requested vote from peers 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883), 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559)
I20260709 12:14:33.341688   443 catalog_manager.cc:5697] T 07cbfec7b89b48f4bdc040734e73e4d7 P 41958dc5e81443978e08a337fbb255bc reported cstate change: term changed from 1 to 2, leader changed from f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129) to 41958dc5e81443978e08a337fbb255bc (127.20.196.130). New cstate: current_term: 2 leader_uuid: "41958dc5e81443978e08a337fbb255bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:33.342586   621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0595bc4b26de41a097a82c178a1df812" candidate_uuid: "f5d77cbf0f464436a88ee930055f8e05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41958dc5e81443978e08a337fbb255bc"
I20260709 12:14:33.343216   621 raft_consensus.cc:3060] T 0595bc4b26de41a097a82c178a1df812 P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:33.343246   695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0595bc4b26de41a097a82c178a1df812" candidate_uuid: "f5d77cbf0f464436a88ee930055f8e05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21975c12fc284bc18715d45d96e9e63a"
I20260709 12:14:33.343829   695 raft_consensus.cc:3055] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:33.344035   695 raft_consensus.cc:740] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21975c12fc284bc18715d45d96e9e63a, State: Running, Role: LEADER
I20260709 12:14:33.344791   695 consensus_queue.cc:260] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:33.346036   695 raft_consensus.cc:3060] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:33.349476   621 raft_consensus.cc:2468] T 0595bc4b26de41a097a82c178a1df812 P 41958dc5e81443978e08a337fbb255bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d77cbf0f464436a88ee930055f8e05 in term 2.
I20260709 12:14:33.350625   511 leader_election.cc:304] T 0595bc4b26de41a097a82c178a1df812 P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41958dc5e81443978e08a337fbb255bc, f5d77cbf0f464436a88ee930055f8e05; no voters: 
I20260709 12:14:33.351365   773 raft_consensus.cc:2804] T 0595bc4b26de41a097a82c178a1df812 P f5d77cbf0f464436a88ee930055f8e05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:33.351840   773 raft_consensus.cc:697] T 0595bc4b26de41a097a82c178a1df812 P f5d77cbf0f464436a88ee930055f8e05 [term 2 LEADER]: Becoming Leader. State: Replica: f5d77cbf0f464436a88ee930055f8e05, State: Running, Role: LEADER
I20260709 12:14:33.352676   695 raft_consensus.cc:2468] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d77cbf0f464436a88ee930055f8e05 in term 2.
I20260709 12:14:33.352648   773 consensus_queue.cc:237] T 0595bc4b26de41a097a82c178a1df812 P f5d77cbf0f464436a88ee930055f8e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:33.359392   443 catalog_manager.cc:5697] T 0595bc4b26de41a097a82c178a1df812 P f5d77cbf0f464436a88ee930055f8e05 reported cstate change: term changed from 1 to 2, leader changed from 21975c12fc284bc18715d45d96e9e63a (127.20.196.131) to f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129). New cstate: current_term: 2 leader_uuid: "f5d77cbf0f464436a88ee930055f8e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:33.460244   695 raft_consensus.cc:1275] T 687d784a386b40c797cfe8eb4778a7e6 P 21975c12fc284bc18715d45d96e9e63a [term 2 FOLLOWER]: Refusing update from remote peer f5d77cbf0f464436a88ee930055f8e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:33.461452   773 consensus_queue.cc:1048] T 687d784a386b40c797cfe8eb4778a7e6 P f5d77cbf0f464436a88ee930055f8e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:33.469970   621 raft_consensus.cc:3060] T 687d784a386b40c797cfe8eb4778a7e6 P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:33.477005   621 raft_consensus.cc:1275] T 687d784a386b40c797cfe8eb4778a7e6 P 41958dc5e81443978e08a337fbb255bc [term 2 FOLLOWER]: Refusing update from remote peer f5d77cbf0f464436a88ee930055f8e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:33.478276   819 consensus_queue.cc:1048] T 687d784a386b40c797cfe8eb4778a7e6 P f5d77cbf0f464436a88ee930055f8e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:33.623219   695 raft_consensus.cc:3060] T 83a2e1850e8c47b880013ccc28f23290 P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:33.629191   695 raft_consensus.cc:1275] T 83a2e1850e8c47b880013ccc28f23290 P 21975c12fc284bc18715d45d96e9e63a [term 2 FOLLOWER]: Refusing update from remote peer 41958dc5e81443978e08a337fbb255bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:33.630540   782 consensus_queue.cc:1048] T 83a2e1850e8c47b880013ccc28f23290 P 41958dc5e81443978e08a337fbb255bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:33.639662   545 raft_consensus.cc:1275] T 83a2e1850e8c47b880013ccc28f23290 P f5d77cbf0f464436a88ee930055f8e05 [term 2 FOLLOWER]: Refusing update from remote peer 41958dc5e81443978e08a337fbb255bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:33.641283   782 consensus_queue.cc:1048] T 83a2e1850e8c47b880013ccc28f23290 P 41958dc5e81443978e08a337fbb255bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:33.702857   621 raft_consensus.cc:1275] T cd37500fb41a464bbe7f9a9652e5f0df P 41958dc5e81443978e08a337fbb255bc [term 2 FOLLOWER]: Refusing update from remote peer f5d77cbf0f464436a88ee930055f8e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:33.704259   819 consensus_queue.cc:1048] T cd37500fb41a464bbe7f9a9652e5f0df P f5d77cbf0f464436a88ee930055f8e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:33.712560   695 raft_consensus.cc:1275] T cd37500fb41a464bbe7f9a9652e5f0df P 21975c12fc284bc18715d45d96e9e63a [term 2 FOLLOWER]: Refusing update from remote peer f5d77cbf0f464436a88ee930055f8e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:33.714561   819 consensus_queue.cc:1048] T cd37500fb41a464bbe7f9a9652e5f0df P f5d77cbf0f464436a88ee930055f8e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:33.737913   695 raft_consensus.cc:1275] T 07cbfec7b89b48f4bdc040734e73e4d7 P 21975c12fc284bc18715d45d96e9e63a [term 2 FOLLOWER]: Refusing update from remote peer 41958dc5e81443978e08a337fbb255bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:33.739192   782 consensus_queue.cc:1048] T 07cbfec7b89b48f4bdc040734e73e4d7 P 41958dc5e81443978e08a337fbb255bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:33.746858   545 raft_consensus.cc:1275] T 07cbfec7b89b48f4bdc040734e73e4d7 P f5d77cbf0f464436a88ee930055f8e05 [term 2 FOLLOWER]: Refusing update from remote peer 41958dc5e81443978e08a337fbb255bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:33.748653   782 consensus_queue.cc:1048] T 07cbfec7b89b48f4bdc040734e73e4d7 P 41958dc5e81443978e08a337fbb255bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:33.895215   621 raft_consensus.cc:1275] T 0595bc4b26de41a097a82c178a1df812 P 41958dc5e81443978e08a337fbb255bc [term 2 FOLLOWER]: Refusing update from remote peer f5d77cbf0f464436a88ee930055f8e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:33.896790   819 consensus_queue.cc:1048] T 0595bc4b26de41a097a82c178a1df812 P f5d77cbf0f464436a88ee930055f8e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:33.904585   695 raft_consensus.cc:1275] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a [term 2 FOLLOWER]: Refusing update from remote peer f5d77cbf0f464436a88ee930055f8e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:33.906747   819 consensus_queue.cc:1048] T 0595bc4b26de41a097a82c178a1df812 P f5d77cbf0f464436a88ee930055f8e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:35.995703   443 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45798:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:14:35.998442   443 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:14:36.059459   533 tablet_service.cc:1511] Processing CreateTablet for tablet bccb6d19bc454739bd69c05e22938ca5 (DEFAULT_TABLE table=soft_deleted_table [id=a1a1a413f4ef4acda055ef8a18dc12d8]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:36.060720   611 tablet_service.cc:1511] Processing CreateTablet for tablet bccb6d19bc454739bd69c05e22938ca5 (DEFAULT_TABLE table=soft_deleted_table [id=a1a1a413f4ef4acda055ef8a18dc12d8]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:36.062580   611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bccb6d19bc454739bd69c05e22938ca5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:36.062422   682 tablet_service.cc:1511] Processing CreateTablet for tablet bccb6d19bc454739bd69c05e22938ca5 (DEFAULT_TABLE table=soft_deleted_table [id=a1a1a413f4ef4acda055ef8a18dc12d8]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:36.064337   682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bccb6d19bc454739bd69c05e22938ca5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:36.065012   533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bccb6d19bc454739bd69c05e22938ca5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:36.065728   535 tablet_service.cc:1511] Processing CreateTablet for tablet c4938b6e0a5145449cf5658d192995d7 (DEFAULT_TABLE table=soft_deleted_table [id=a1a1a413f4ef4acda055ef8a18dc12d8]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:36.067389   535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4938b6e0a5145449cf5658d192995d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:36.067481   605 tablet_service.cc:1511] Processing CreateTablet for tablet c4938b6e0a5145449cf5658d192995d7 (DEFAULT_TABLE table=soft_deleted_table [id=a1a1a413f4ef4acda055ef8a18dc12d8]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:36.069108   605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4938b6e0a5145449cf5658d192995d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:36.070391   681 tablet_service.cc:1511] Processing CreateTablet for tablet c4938b6e0a5145449cf5658d192995d7 (DEFAULT_TABLE table=soft_deleted_table [id=a1a1a413f4ef4acda055ef8a18dc12d8]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:36.072129   681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4938b6e0a5145449cf5658d192995d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:36.083361   531 tablet_service.cc:1511] Processing CreateTablet for tablet e4898429379b4b4880b522f22145f62a (DEFAULT_TABLE table=soft_deleted_table [id=a1a1a413f4ef4acda055ef8a18dc12d8]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:36.084905   531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4898429379b4b4880b522f22145f62a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:36.097916   833 tablet_bootstrap.cc:492] T bccb6d19bc454739bd69c05e22938ca5 P 21975c12fc284bc18715d45d96e9e63a: Bootstrap starting.
I20260709 12:14:36.099973   612 tablet_service.cc:1511] Processing CreateTablet for tablet e4898429379b4b4880b522f22145f62a (DEFAULT_TABLE table=soft_deleted_table [id=a1a1a413f4ef4acda055ef8a18dc12d8]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:36.101465   612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4898429379b4b4880b522f22145f62a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:36.107375   833 tablet_bootstrap.cc:654] T bccb6d19bc454739bd69c05e22938ca5 P 21975c12fc284bc18715d45d96e9e63a: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:36.123853   836 tablet_bootstrap.cc:492] T c4938b6e0a5145449cf5658d192995d7 P 41958dc5e81443978e08a337fbb255bc: Bootstrap starting.
I20260709 12:14:36.126328   682 tablet_service.cc:1511] Processing CreateTablet for tablet e4898429379b4b4880b522f22145f62a (DEFAULT_TABLE table=soft_deleted_table [id=a1a1a413f4ef4acda055ef8a18dc12d8]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:36.130887   533 tablet_service.cc:1511] Processing CreateTablet for tablet 4836044424874856b0db3ba4cdacaf74 (DEFAULT_TABLE table=soft_deleted_table [id=a1a1a413f4ef4acda055ef8a18dc12d8]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:36.131732   682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4898429379b4b4880b522f22145f62a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:36.132233   533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4836044424874856b0db3ba4cdacaf74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:36.128203   834 tablet_bootstrap.cc:492] T bccb6d19bc454739bd69c05e22938ca5 P f5d77cbf0f464436a88ee930055f8e05: Bootstrap starting.
I20260709 12:14:36.143798   605 tablet_service.cc:1511] Processing CreateTablet for tablet 4836044424874856b0db3ba4cdacaf74 (DEFAULT_TABLE table=soft_deleted_table [id=a1a1a413f4ef4acda055ef8a18dc12d8]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:36.148128   605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4836044424874856b0db3ba4cdacaf74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:36.165696   679 tablet_service.cc:1511] Processing CreateTablet for tablet 4836044424874856b0db3ba4cdacaf74 (DEFAULT_TABLE table=soft_deleted_table [id=a1a1a413f4ef4acda055ef8a18dc12d8]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:36.167006   836 tablet_bootstrap.cc:654] T c4938b6e0a5145449cf5658d192995d7 P 41958dc5e81443978e08a337fbb255bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:36.167304   679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4836044424874856b0db3ba4cdacaf74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:36.169577   611 tablet_service.cc:1511] Processing CreateTablet for tablet 7661cfdd4178479ba812b94315dd21ab (DEFAULT_TABLE table=soft_deleted_table [id=a1a1a413f4ef4acda055ef8a18dc12d8]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:36.171123   611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7661cfdd4178479ba812b94315dd21ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:36.176903   535 tablet_service.cc:1511] Processing CreateTablet for tablet 7661cfdd4178479ba812b94315dd21ab (DEFAULT_TABLE table=soft_deleted_table [id=a1a1a413f4ef4acda055ef8a18dc12d8]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:36.178238   535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7661cfdd4178479ba812b94315dd21ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:36.183552   680 tablet_service.cc:1511] Processing CreateTablet for tablet 7661cfdd4178479ba812b94315dd21ab (DEFAULT_TABLE table=soft_deleted_table [id=a1a1a413f4ef4acda055ef8a18dc12d8]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:36.195986   680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7661cfdd4178479ba812b94315dd21ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:36.194182   834 tablet_bootstrap.cc:654] T bccb6d19bc454739bd69c05e22938ca5 P f5d77cbf0f464436a88ee930055f8e05: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:36.193375   530 tablet_service.cc:1511] Processing CreateTablet for tablet bc2db88da3264b91b1e8ec6ab9a0804e (DEFAULT_TABLE table=soft_deleted_table [id=a1a1a413f4ef4acda055ef8a18dc12d8]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:36.197431   530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc2db88da3264b91b1e8ec6ab9a0804e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:36.192929   833 tablet_bootstrap.cc:492] T bccb6d19bc454739bd69c05e22938ca5 P 21975c12fc284bc18715d45d96e9e63a: No bootstrap required, opened a new log
I20260709 12:14:36.203466   833 ts_tablet_manager.cc:1403] T bccb6d19bc454739bd69c05e22938ca5 P 21975c12fc284bc18715d45d96e9e63a: Time spent bootstrapping tablet: real 0.106s	user 0.009s	sys 0.025s
I20260709 12:14:36.207050   607 tablet_service.cc:1511] Processing CreateTablet for tablet bc2db88da3264b91b1e8ec6ab9a0804e (DEFAULT_TABLE table=soft_deleted_table [id=a1a1a413f4ef4acda055ef8a18dc12d8]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:36.208443   607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc2db88da3264b91b1e8ec6ab9a0804e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:36.211529   833 raft_consensus.cc:359] T bccb6d19bc454739bd69c05e22938ca5 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.219148   833 raft_consensus.cc:385] T bccb6d19bc454739bd69c05e22938ca5 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:36.212810   683 tablet_service.cc:1511] Processing CreateTablet for tablet bc2db88da3264b91b1e8ec6ab9a0804e (DEFAULT_TABLE table=soft_deleted_table [id=a1a1a413f4ef4acda055ef8a18dc12d8]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:36.224524   683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc2db88da3264b91b1e8ec6ab9a0804e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:36.223030   534 tablet_service.cc:1511] Processing CreateTablet for tablet adff2b2578704776809995fbb0a174b8 (DEFAULT_TABLE table=soft_deleted_table [id=a1a1a413f4ef4acda055ef8a18dc12d8]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:36.228081   534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adff2b2578704776809995fbb0a174b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:36.232712   606 tablet_service.cc:1511] Processing CreateTablet for tablet adff2b2578704776809995fbb0a174b8 (DEFAULT_TABLE table=soft_deleted_table [id=a1a1a413f4ef4acda055ef8a18dc12d8]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:36.234325   606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adff2b2578704776809995fbb0a174b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:36.234663   833 raft_consensus.cc:740] T bccb6d19bc454739bd69c05e22938ca5 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21975c12fc284bc18715d45d96e9e63a, State: Initialized, Role: FOLLOWER
I20260709 12:14:36.235735   833 consensus_queue.cc:260] T bccb6d19bc454739bd69c05e22938ca5 P 21975c12fc284bc18715d45d96e9e63a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.249257   684 tablet_service.cc:1511] Processing CreateTablet for tablet adff2b2578704776809995fbb0a174b8 (DEFAULT_TABLE table=soft_deleted_table [id=a1a1a413f4ef4acda055ef8a18dc12d8]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:36.251349   684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adff2b2578704776809995fbb0a174b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:36.267957   833 ts_tablet_manager.cc:1434] T bccb6d19bc454739bd69c05e22938ca5 P 21975c12fc284bc18715d45d96e9e63a: Time spent starting tablet: real 0.064s	user 0.009s	sys 0.000s
I20260709 12:14:36.272148   833 tablet_bootstrap.cc:492] T e4898429379b4b4880b522f22145f62a P 21975c12fc284bc18715d45d96e9e63a: Bootstrap starting.
I20260709 12:14:36.272327   612 tablet_service.cc:1511] Processing CreateTablet for tablet 72b3c830bc7346c5bcbb710b4c9cb9c0 (DEFAULT_TABLE table=soft_deleted_table [id=a1a1a413f4ef4acda055ef8a18dc12d8]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:36.276749   612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72b3c830bc7346c5bcbb710b4c9cb9c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:36.271014   531 tablet_service.cc:1511] Processing CreateTablet for tablet 72b3c830bc7346c5bcbb710b4c9cb9c0 (DEFAULT_TABLE table=soft_deleted_table [id=a1a1a413f4ef4acda055ef8a18dc12d8]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:36.280153   531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72b3c830bc7346c5bcbb710b4c9cb9c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:36.293578   833 tablet_bootstrap.cc:654] T e4898429379b4b4880b522f22145f62a P 21975c12fc284bc18715d45d96e9e63a: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:36.294234   681 tablet_service.cc:1511] Processing CreateTablet for tablet 72b3c830bc7346c5bcbb710b4c9cb9c0 (DEFAULT_TABLE table=soft_deleted_table [id=a1a1a413f4ef4acda055ef8a18dc12d8]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:36.295714   681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72b3c830bc7346c5bcbb710b4c9cb9c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:36.275300   834 tablet_bootstrap.cc:492] T bccb6d19bc454739bd69c05e22938ca5 P f5d77cbf0f464436a88ee930055f8e05: No bootstrap required, opened a new log
I20260709 12:14:36.273311   836 tablet_bootstrap.cc:492] T c4938b6e0a5145449cf5658d192995d7 P 41958dc5e81443978e08a337fbb255bc: No bootstrap required, opened a new log
I20260709 12:14:36.298070   834 ts_tablet_manager.cc:1403] T bccb6d19bc454739bd69c05e22938ca5 P f5d77cbf0f464436a88ee930055f8e05: Time spent bootstrapping tablet: real 0.170s	user 0.017s	sys 0.031s
I20260709 12:14:36.298168   836 ts_tablet_manager.cc:1403] T c4938b6e0a5145449cf5658d192995d7 P 41958dc5e81443978e08a337fbb255bc: Time spent bootstrapping tablet: real 0.175s	user 0.024s	sys 0.046s
I20260709 12:14:36.301676   836 raft_consensus.cc:359] T c4938b6e0a5145449cf5658d192995d7 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.302407   836 raft_consensus.cc:385] T c4938b6e0a5145449cf5658d192995d7 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:36.302692   836 raft_consensus.cc:740] T c4938b6e0a5145449cf5658d192995d7 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41958dc5e81443978e08a337fbb255bc, State: Initialized, Role: FOLLOWER
I20260709 12:14:36.307592   533 tablet_service.cc:1511] Processing CreateTablet for tablet 40970913ee644c928ddad5cbfacd6ed9 (DEFAULT_TABLE table=soft_deleted_table [id=a1a1a413f4ef4acda055ef8a18dc12d8]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:36.310730   836 consensus_queue.cc:260] T c4938b6e0a5145449cf5658d192995d7 P 41958dc5e81443978e08a337fbb255bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.316787   533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40970913ee644c928ddad5cbfacd6ed9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:36.320310   836 ts_tablet_manager.cc:1434] T c4938b6e0a5145449cf5658d192995d7 P 41958dc5e81443978e08a337fbb255bc: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:14:36.324249   836 tablet_bootstrap.cc:492] T bccb6d19bc454739bd69c05e22938ca5 P 41958dc5e81443978e08a337fbb255bc: Bootstrap starting.
I20260709 12:14:36.312927   834 raft_consensus.cc:359] T bccb6d19bc454739bd69c05e22938ca5 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.311220   605 tablet_service.cc:1511] Processing CreateTablet for tablet 40970913ee644c928ddad5cbfacd6ed9 (DEFAULT_TABLE table=soft_deleted_table [id=a1a1a413f4ef4acda055ef8a18dc12d8]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:36.328619   605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40970913ee644c928ddad5cbfacd6ed9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:36.332994   834 raft_consensus.cc:385] T bccb6d19bc454739bd69c05e22938ca5 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:36.333395   834 raft_consensus.cc:740] T bccb6d19bc454739bd69c05e22938ca5 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d77cbf0f464436a88ee930055f8e05, State: Initialized, Role: FOLLOWER
I20260709 12:14:36.336032   834 consensus_queue.cc:260] T bccb6d19bc454739bd69c05e22938ca5 P f5d77cbf0f464436a88ee930055f8e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.341465   834 ts_tablet_manager.cc:1434] T bccb6d19bc454739bd69c05e22938ca5 P f5d77cbf0f464436a88ee930055f8e05: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 12:14:36.339133   836 tablet_bootstrap.cc:654] T bccb6d19bc454739bd69c05e22938ca5 P 41958dc5e81443978e08a337fbb255bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:36.345474   683 tablet_service.cc:1511] Processing CreateTablet for tablet 40970913ee644c928ddad5cbfacd6ed9 (DEFAULT_TABLE table=soft_deleted_table [id=a1a1a413f4ef4acda055ef8a18dc12d8]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:36.351882   834 tablet_bootstrap.cc:492] T c4938b6e0a5145449cf5658d192995d7 P f5d77cbf0f464436a88ee930055f8e05: Bootstrap starting.
I20260709 12:14:36.355275   836 tablet_bootstrap.cc:492] T bccb6d19bc454739bd69c05e22938ca5 P 41958dc5e81443978e08a337fbb255bc: No bootstrap required, opened a new log
I20260709 12:14:36.364776   836 ts_tablet_manager.cc:1403] T bccb6d19bc454739bd69c05e22938ca5 P 41958dc5e81443978e08a337fbb255bc: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.003s
I20260709 12:14:36.368193   683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40970913ee644c928ddad5cbfacd6ed9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:36.371322   834 tablet_bootstrap.cc:654] T c4938b6e0a5145449cf5658d192995d7 P f5d77cbf0f464436a88ee930055f8e05: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:36.372934   836 raft_consensus.cc:359] T bccb6d19bc454739bd69c05e22938ca5 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.373883   836 raft_consensus.cc:385] T bccb6d19bc454739bd69c05e22938ca5 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:36.374218   836 raft_consensus.cc:740] T bccb6d19bc454739bd69c05e22938ca5 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41958dc5e81443978e08a337fbb255bc, State: Initialized, Role: FOLLOWER
I20260709 12:14:36.375146   836 consensus_queue.cc:260] T bccb6d19bc454739bd69c05e22938ca5 P 41958dc5e81443978e08a337fbb255bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.378820   836 ts_tablet_manager.cc:1434] T bccb6d19bc454739bd69c05e22938ca5 P 41958dc5e81443978e08a337fbb255bc: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:14:36.380393   836 tablet_bootstrap.cc:492] T e4898429379b4b4880b522f22145f62a P 41958dc5e81443978e08a337fbb255bc: Bootstrap starting.
I20260709 12:14:36.384652   834 tablet_bootstrap.cc:492] T c4938b6e0a5145449cf5658d192995d7 P f5d77cbf0f464436a88ee930055f8e05: No bootstrap required, opened a new log
I20260709 12:14:36.385322   834 ts_tablet_manager.cc:1403] T c4938b6e0a5145449cf5658d192995d7 P f5d77cbf0f464436a88ee930055f8e05: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.007s
I20260709 12:14:36.389112   834 raft_consensus.cc:359] T c4938b6e0a5145449cf5658d192995d7 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.390084   834 raft_consensus.cc:385] T c4938b6e0a5145449cf5658d192995d7 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:36.391604   836 tablet_bootstrap.cc:654] T e4898429379b4b4880b522f22145f62a P 41958dc5e81443978e08a337fbb255bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:36.393807   834 raft_consensus.cc:740] T c4938b6e0a5145449cf5658d192995d7 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d77cbf0f464436a88ee930055f8e05, State: Initialized, Role: FOLLOWER
I20260709 12:14:36.403760   836 tablet_bootstrap.cc:492] T e4898429379b4b4880b522f22145f62a P 41958dc5e81443978e08a337fbb255bc: No bootstrap required, opened a new log
I20260709 12:14:36.404395   836 ts_tablet_manager.cc:1403] T e4898429379b4b4880b522f22145f62a P 41958dc5e81443978e08a337fbb255bc: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.006s
I20260709 12:14:36.405012   834 consensus_queue.cc:260] T c4938b6e0a5145449cf5658d192995d7 P f5d77cbf0f464436a88ee930055f8e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.407636   836 raft_consensus.cc:359] T e4898429379b4b4880b522f22145f62a P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.408617   836 raft_consensus.cc:385] T e4898429379b4b4880b522f22145f62a P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:36.408982   836 raft_consensus.cc:740] T e4898429379b4b4880b522f22145f62a P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41958dc5e81443978e08a337fbb255bc, State: Initialized, Role: FOLLOWER
I20260709 12:14:36.409842   836 consensus_queue.cc:260] T e4898429379b4b4880b522f22145f62a P 41958dc5e81443978e08a337fbb255bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.412349   836 ts_tablet_manager.cc:1434] T e4898429379b4b4880b522f22145f62a P 41958dc5e81443978e08a337fbb255bc: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:14:36.408221   834 ts_tablet_manager.cc:1434] T c4938b6e0a5145449cf5658d192995d7 P f5d77cbf0f464436a88ee930055f8e05: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.002s
I20260709 12:14:36.413551   834 tablet_bootstrap.cc:492] T 7661cfdd4178479ba812b94315dd21ab P f5d77cbf0f464436a88ee930055f8e05: Bootstrap starting.
I20260709 12:14:36.420325   834 tablet_bootstrap.cc:654] T 7661cfdd4178479ba812b94315dd21ab P f5d77cbf0f464436a88ee930055f8e05: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:36.421983   836 tablet_bootstrap.cc:492] T bc2db88da3264b91b1e8ec6ab9a0804e P 41958dc5e81443978e08a337fbb255bc: Bootstrap starting.
I20260709 12:14:36.423321   833 tablet_bootstrap.cc:492] T e4898429379b4b4880b522f22145f62a P 21975c12fc284bc18715d45d96e9e63a: No bootstrap required, opened a new log
I20260709 12:14:36.423889   833 ts_tablet_manager.cc:1403] T e4898429379b4b4880b522f22145f62a P 21975c12fc284bc18715d45d96e9e63a: Time spent bootstrapping tablet: real 0.152s	user 0.038s	sys 0.071s
I20260709 12:14:36.427335   833 raft_consensus.cc:359] T e4898429379b4b4880b522f22145f62a P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.428123   833 raft_consensus.cc:385] T e4898429379b4b4880b522f22145f62a P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:36.428457   833 raft_consensus.cc:740] T e4898429379b4b4880b522f22145f62a P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21975c12fc284bc18715d45d96e9e63a, State: Initialized, Role: FOLLOWER
I20260709 12:14:36.429437   833 consensus_queue.cc:260] T e4898429379b4b4880b522f22145f62a P 21975c12fc284bc18715d45d96e9e63a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.431406   836 tablet_bootstrap.cc:654] T bc2db88da3264b91b1e8ec6ab9a0804e P 41958dc5e81443978e08a337fbb255bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:36.435492   782 raft_consensus.cc:493] T e4898429379b4b4880b522f22145f62a P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.436221   782 raft_consensus.cc:515] T e4898429379b4b4880b522f22145f62a P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.439977   695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4898429379b4b4880b522f22145f62a" candidate_uuid: "41958dc5e81443978e08a337fbb255bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21975c12fc284bc18715d45d96e9e63a" is_pre_election: true
I20260709 12:14:36.440230   833 ts_tablet_manager.cc:1434] T e4898429379b4b4880b522f22145f62a P 21975c12fc284bc18715d45d96e9e63a: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.001s
I20260709 12:14:36.440817   695 raft_consensus.cc:2468] T e4898429379b4b4880b522f22145f62a P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41958dc5e81443978e08a337fbb255bc in term 0.
I20260709 12:14:36.441581   833 tablet_bootstrap.cc:492] T c4938b6e0a5145449cf5658d192995d7 P 21975c12fc284bc18715d45d96e9e63a: Bootstrap starting.
I20260709 12:14:36.442411   782 leader_election.cc:290] T e4898429379b4b4880b522f22145f62a P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935), 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559)
I20260709 12:14:36.443480   586 leader_election.cc:304] T e4898429379b4b4880b522f22145f62a P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21975c12fc284bc18715d45d96e9e63a, 41958dc5e81443978e08a337fbb255bc; no voters: 
I20260709 12:14:36.445236   545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4898429379b4b4880b522f22145f62a" candidate_uuid: "41958dc5e81443978e08a337fbb255bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d77cbf0f464436a88ee930055f8e05" is_pre_election: true
I20260709 12:14:36.447844   782 raft_consensus.cc:2804] T e4898429379b4b4880b522f22145f62a P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:14:36.447912   587 leader_election.cc:343] T e4898429379b4b4880b522f22145f62a P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:36.448364   782 raft_consensus.cc:493] T e4898429379b4b4880b522f22145f62a P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:36.448710   782 raft_consensus.cc:3060] T e4898429379b4b4880b522f22145f62a P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:36.454759   833 tablet_bootstrap.cc:654] T c4938b6e0a5145449cf5658d192995d7 P 21975c12fc284bc18715d45d96e9e63a: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:36.457643   782 raft_consensus.cc:515] T e4898429379b4b4880b522f22145f62a P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.460594   545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4898429379b4b4880b522f22145f62a" candidate_uuid: "41958dc5e81443978e08a337fbb255bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d77cbf0f464436a88ee930055f8e05"
W20260709 12:14:36.462136   587 leader_election.cc:343] T e4898429379b4b4880b522f22145f62a P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:36.462509   782 leader_election.cc:290] T e4898429379b4b4880b522f22145f62a P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 election: Requested vote from peers f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935), 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559)
I20260709 12:14:36.463790   695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4898429379b4b4880b522f22145f62a" candidate_uuid: "41958dc5e81443978e08a337fbb255bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21975c12fc284bc18715d45d96e9e63a"
I20260709 12:14:36.464133   836 tablet_bootstrap.cc:492] T bc2db88da3264b91b1e8ec6ab9a0804e P 41958dc5e81443978e08a337fbb255bc: No bootstrap required, opened a new log
I20260709 12:14:36.464421   695 raft_consensus.cc:3060] T e4898429379b4b4880b522f22145f62a P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:36.464679   836 ts_tablet_manager.cc:1403] T bc2db88da3264b91b1e8ec6ab9a0804e P 41958dc5e81443978e08a337fbb255bc: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.009s
I20260709 12:14:36.464789   834 tablet_bootstrap.cc:492] T 7661cfdd4178479ba812b94315dd21ab P f5d77cbf0f464436a88ee930055f8e05: No bootstrap required, opened a new log
I20260709 12:14:36.465524   834 ts_tablet_manager.cc:1403] T 7661cfdd4178479ba812b94315dd21ab P f5d77cbf0f464436a88ee930055f8e05: Time spent bootstrapping tablet: real 0.052s	user 0.015s	sys 0.009s
I20260709 12:14:36.468379   833 tablet_bootstrap.cc:492] T c4938b6e0a5145449cf5658d192995d7 P 21975c12fc284bc18715d45d96e9e63a: No bootstrap required, opened a new log
I20260709 12:14:36.468096   836 raft_consensus.cc:359] T bc2db88da3264b91b1e8ec6ab9a0804e P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.468930   836 raft_consensus.cc:385] T bc2db88da3264b91b1e8ec6ab9a0804e P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:36.468973   833 ts_tablet_manager.cc:1403] T c4938b6e0a5145449cf5658d192995d7 P 21975c12fc284bc18715d45d96e9e63a: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.007s
I20260709 12:14:36.468837   834 raft_consensus.cc:359] T 7661cfdd4178479ba812b94315dd21ab P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.469460   836 raft_consensus.cc:740] T bc2db88da3264b91b1e8ec6ab9a0804e P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41958dc5e81443978e08a337fbb255bc, State: Initialized, Role: FOLLOWER
I20260709 12:14:36.469707   834 raft_consensus.cc:385] T 7661cfdd4178479ba812b94315dd21ab P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:36.470122   834 raft_consensus.cc:740] T 7661cfdd4178479ba812b94315dd21ab P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d77cbf0f464436a88ee930055f8e05, State: Initialized, Role: FOLLOWER
I20260709 12:14:36.470412   836 consensus_queue.cc:260] T bc2db88da3264b91b1e8ec6ab9a0804e P 41958dc5e81443978e08a337fbb255bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.471068   834 consensus_queue.cc:260] T 7661cfdd4178479ba812b94315dd21ab P f5d77cbf0f464436a88ee930055f8e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.472720   833 raft_consensus.cc:359] T c4938b6e0a5145449cf5658d192995d7 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.473471   833 raft_consensus.cc:385] T c4938b6e0a5145449cf5658d192995d7 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:36.473811   833 raft_consensus.cc:740] T c4938b6e0a5145449cf5658d192995d7 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21975c12fc284bc18715d45d96e9e63a, State: Initialized, Role: FOLLOWER
I20260709 12:14:36.474563   833 consensus_queue.cc:260] T c4938b6e0a5145449cf5658d192995d7 P 21975c12fc284bc18715d45d96e9e63a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.475394   836 ts_tablet_manager.cc:1434] T bc2db88da3264b91b1e8ec6ab9a0804e P 41958dc5e81443978e08a337fbb255bc: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:14:36.476459   836 tablet_bootstrap.cc:492] T 7661cfdd4178479ba812b94315dd21ab P 41958dc5e81443978e08a337fbb255bc: Bootstrap starting.
I20260709 12:14:36.478966   834 ts_tablet_manager.cc:1434] T 7661cfdd4178479ba812b94315dd21ab P f5d77cbf0f464436a88ee930055f8e05: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:14:36.480108   834 tablet_bootstrap.cc:492] T e4898429379b4b4880b522f22145f62a P f5d77cbf0f464436a88ee930055f8e05: Bootstrap starting.
I20260709 12:14:36.480602   833 ts_tablet_manager.cc:1434] T c4938b6e0a5145449cf5658d192995d7 P 21975c12fc284bc18715d45d96e9e63a: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:14:36.481729   833 tablet_bootstrap.cc:492] T 4836044424874856b0db3ba4cdacaf74 P 21975c12fc284bc18715d45d96e9e63a: Bootstrap starting.
W20260709 12:14:36.482031   493 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:36.485067   836 tablet_bootstrap.cc:654] T 7661cfdd4178479ba812b94315dd21ab P 41958dc5e81443978e08a337fbb255bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:36.489506   833 tablet_bootstrap.cc:654] T 4836044424874856b0db3ba4cdacaf74 P 21975c12fc284bc18715d45d96e9e63a: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:36.490942   834 tablet_bootstrap.cc:654] T e4898429379b4b4880b522f22145f62a P f5d77cbf0f464436a88ee930055f8e05: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:36.496919   695 raft_consensus.cc:2468] T e4898429379b4b4880b522f22145f62a P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41958dc5e81443978e08a337fbb255bc in term 1.
I20260709 12:14:36.497139   836 tablet_bootstrap.cc:492] T 7661cfdd4178479ba812b94315dd21ab P 41958dc5e81443978e08a337fbb255bc: No bootstrap required, opened a new log
I20260709 12:14:36.497782   836 ts_tablet_manager.cc:1403] T 7661cfdd4178479ba812b94315dd21ab P 41958dc5e81443978e08a337fbb255bc: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.008s
I20260709 12:14:36.499528   586 leader_election.cc:304] T e4898429379b4b4880b522f22145f62a P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21975c12fc284bc18715d45d96e9e63a, 41958dc5e81443978e08a337fbb255bc; no voters: f5d77cbf0f464436a88ee930055f8e05
I20260709 12:14:36.500795   782 raft_consensus.cc:2804] T e4898429379b4b4880b522f22145f62a P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:36.500801   836 raft_consensus.cc:359] T 7661cfdd4178479ba812b94315dd21ab P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.501827   836 raft_consensus.cc:385] T 7661cfdd4178479ba812b94315dd21ab P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:36.502240   836 raft_consensus.cc:740] T 7661cfdd4178479ba812b94315dd21ab P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41958dc5e81443978e08a337fbb255bc, State: Initialized, Role: FOLLOWER
I20260709 12:14:36.503270   836 consensus_queue.cc:260] T 7661cfdd4178479ba812b94315dd21ab P 41958dc5e81443978e08a337fbb255bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.509112   834 tablet_bootstrap.cc:492] T e4898429379b4b4880b522f22145f62a P f5d77cbf0f464436a88ee930055f8e05: No bootstrap required, opened a new log
I20260709 12:14:36.509904   834 ts_tablet_manager.cc:1403] T e4898429379b4b4880b522f22145f62a P f5d77cbf0f464436a88ee930055f8e05: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.004s
I20260709 12:14:36.513870   834 raft_consensus.cc:359] T e4898429379b4b4880b522f22145f62a P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.515549   834 raft_consensus.cc:385] T e4898429379b4b4880b522f22145f62a P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:36.515913   834 raft_consensus.cc:740] T e4898429379b4b4880b522f22145f62a P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d77cbf0f464436a88ee930055f8e05, State: Initialized, Role: FOLLOWER
I20260709 12:14:36.516714   834 consensus_queue.cc:260] T e4898429379b4b4880b522f22145f62a P f5d77cbf0f464436a88ee930055f8e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.517740   833 tablet_bootstrap.cc:492] T 4836044424874856b0db3ba4cdacaf74 P 21975c12fc284bc18715d45d96e9e63a: No bootstrap required, opened a new log
I20260709 12:14:36.518486   833 ts_tablet_manager.cc:1403] T 4836044424874856b0db3ba4cdacaf74 P 21975c12fc284bc18715d45d96e9e63a: Time spent bootstrapping tablet: real 0.037s	user 0.018s	sys 0.009s
I20260709 12:14:36.522600   833 raft_consensus.cc:359] T 4836044424874856b0db3ba4cdacaf74 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.523687   833 raft_consensus.cc:385] T 4836044424874856b0db3ba4cdacaf74 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:36.524140   833 raft_consensus.cc:740] T 4836044424874856b0db3ba4cdacaf74 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21975c12fc284bc18715d45d96e9e63a, State: Initialized, Role: FOLLOWER
I20260709 12:14:36.525336   833 consensus_queue.cc:260] T 4836044424874856b0db3ba4cdacaf74 P 21975c12fc284bc18715d45d96e9e63a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.528571   833 ts_tablet_manager.cc:1434] T 4836044424874856b0db3ba4cdacaf74 P 21975c12fc284bc18715d45d96e9e63a: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.002s
I20260709 12:14:36.530519   833 tablet_bootstrap.cc:492] T adff2b2578704776809995fbb0a174b8 P 21975c12fc284bc18715d45d96e9e63a: Bootstrap starting.
I20260709 12:14:36.538122   833 tablet_bootstrap.cc:654] T adff2b2578704776809995fbb0a174b8 P 21975c12fc284bc18715d45d96e9e63a: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:36.546157   834 ts_tablet_manager.cc:1434] T e4898429379b4b4880b522f22145f62a P f5d77cbf0f464436a88ee930055f8e05: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.010s
I20260709 12:14:36.547850   834 tablet_bootstrap.cc:492] T bc2db88da3264b91b1e8ec6ab9a0804e P f5d77cbf0f464436a88ee930055f8e05: Bootstrap starting.
I20260709 12:14:36.558594   834 tablet_bootstrap.cc:654] T bc2db88da3264b91b1e8ec6ab9a0804e P f5d77cbf0f464436a88ee930055f8e05: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:36.572760   834 tablet_bootstrap.cc:492] T bc2db88da3264b91b1e8ec6ab9a0804e P f5d77cbf0f464436a88ee930055f8e05: No bootstrap required, opened a new log
I20260709 12:14:36.573613   834 ts_tablet_manager.cc:1403] T bc2db88da3264b91b1e8ec6ab9a0804e P f5d77cbf0f464436a88ee930055f8e05: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.010s
I20260709 12:14:36.578608   834 raft_consensus.cc:359] T bc2db88da3264b91b1e8ec6ab9a0804e P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.579744   834 raft_consensus.cc:385] T bc2db88da3264b91b1e8ec6ab9a0804e P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:36.580252   834 raft_consensus.cc:740] T bc2db88da3264b91b1e8ec6ab9a0804e P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d77cbf0f464436a88ee930055f8e05, State: Initialized, Role: FOLLOWER
I20260709 12:14:36.581441   834 consensus_queue.cc:260] T bc2db88da3264b91b1e8ec6ab9a0804e P f5d77cbf0f464436a88ee930055f8e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.585155   834 ts_tablet_manager.cc:1434] T bc2db88da3264b91b1e8ec6ab9a0804e P f5d77cbf0f464436a88ee930055f8e05: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:14:36.586755   834 tablet_bootstrap.cc:492] T 4836044424874856b0db3ba4cdacaf74 P f5d77cbf0f464436a88ee930055f8e05: Bootstrap starting.
I20260709 12:14:36.596735   834 tablet_bootstrap.cc:654] T 4836044424874856b0db3ba4cdacaf74 P f5d77cbf0f464436a88ee930055f8e05: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:36.597002   511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.130:34883, user_credentials={real_user=slave}} blocked reactor thread for 78117.8us
I20260709 12:14:36.620849   782 raft_consensus.cc:697] T e4898429379b4b4880b522f22145f62a P 41958dc5e81443978e08a337fbb255bc [term 1 LEADER]: Becoming Leader. State: Replica: 41958dc5e81443978e08a337fbb255bc, State: Running, Role: LEADER
I20260709 12:14:36.622462   782 consensus_queue.cc:237] T e4898429379b4b4880b522f22145f62a P 41958dc5e81443978e08a337fbb255bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.630900   836 ts_tablet_manager.cc:1434] T 7661cfdd4178479ba812b94315dd21ab P 41958dc5e81443978e08a337fbb255bc: Time spent starting tablet: real 0.133s	user 0.066s	sys 0.065s
I20260709 12:14:36.632253   836 tablet_bootstrap.cc:492] T 4836044424874856b0db3ba4cdacaf74 P 41958dc5e81443978e08a337fbb255bc: Bootstrap starting.
I20260709 12:14:36.632489   834 tablet_bootstrap.cc:492] T 4836044424874856b0db3ba4cdacaf74 P f5d77cbf0f464436a88ee930055f8e05: No bootstrap required, opened a new log
I20260709 12:14:36.633105   834 ts_tablet_manager.cc:1403] T 4836044424874856b0db3ba4cdacaf74 P f5d77cbf0f464436a88ee930055f8e05: Time spent bootstrapping tablet: real 0.047s	user 0.022s	sys 0.008s
I20260709 12:14:36.632421   833 tablet_bootstrap.cc:492] T adff2b2578704776809995fbb0a174b8 P 21975c12fc284bc18715d45d96e9e63a: No bootstrap required, opened a new log
I20260709 12:14:36.634114   833 ts_tablet_manager.cc:1403] T adff2b2578704776809995fbb0a174b8 P 21975c12fc284bc18715d45d96e9e63a: Time spent bootstrapping tablet: real 0.104s	user 0.039s	sys 0.040s
I20260709 12:14:36.636338   834 raft_consensus.cc:359] T 4836044424874856b0db3ba4cdacaf74 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.637159   834 raft_consensus.cc:385] T 4836044424874856b0db3ba4cdacaf74 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:36.637481   834 raft_consensus.cc:740] T 4836044424874856b0db3ba4cdacaf74 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d77cbf0f464436a88ee930055f8e05, State: Initialized, Role: FOLLOWER
I20260709 12:14:36.639554   833 raft_consensus.cc:359] T adff2b2578704776809995fbb0a174b8 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.640236   836 tablet_bootstrap.cc:654] T 4836044424874856b0db3ba4cdacaf74 P 41958dc5e81443978e08a337fbb255bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:36.640344   833 raft_consensus.cc:385] T adff2b2578704776809995fbb0a174b8 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:36.641012   833 raft_consensus.cc:740] T adff2b2578704776809995fbb0a174b8 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21975c12fc284bc18715d45d96e9e63a, State: Initialized, Role: FOLLOWER
I20260709 12:14:36.640451   443 catalog_manager.cc:5697] T e4898429379b4b4880b522f22145f62a P 41958dc5e81443978e08a337fbb255bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 41958dc5e81443978e08a337fbb255bc (127.20.196.130). New cstate: current_term: 1 leader_uuid: "41958dc5e81443978e08a337fbb255bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:36.638365   834 consensus_queue.cc:260] T 4836044424874856b0db3ba4cdacaf74 P f5d77cbf0f464436a88ee930055f8e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.641924   833 consensus_queue.cc:260] T adff2b2578704776809995fbb0a174b8 P 21975c12fc284bc18715d45d96e9e63a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.644340   833 ts_tablet_manager.cc:1434] T adff2b2578704776809995fbb0a174b8 P 21975c12fc284bc18715d45d96e9e63a: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:14:36.645490   833 tablet_bootstrap.cc:492] T 7661cfdd4178479ba812b94315dd21ab P 21975c12fc284bc18715d45d96e9e63a: Bootstrap starting.
I20260709 12:14:36.652324   833 tablet_bootstrap.cc:654] T 7661cfdd4178479ba812b94315dd21ab P 21975c12fc284bc18715d45d96e9e63a: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:36.652364   836 tablet_bootstrap.cc:492] T 4836044424874856b0db3ba4cdacaf74 P 41958dc5e81443978e08a337fbb255bc: No bootstrap required, opened a new log
I20260709 12:14:36.653082   836 ts_tablet_manager.cc:1403] T 4836044424874856b0db3ba4cdacaf74 P 41958dc5e81443978e08a337fbb255bc: Time spent bootstrapping tablet: real 0.021s	user 0.003s	sys 0.016s
I20260709 12:14:36.656236   836 raft_consensus.cc:359] T 4836044424874856b0db3ba4cdacaf74 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.657001   836 raft_consensus.cc:385] T 4836044424874856b0db3ba4cdacaf74 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:36.657351   836 raft_consensus.cc:740] T 4836044424874856b0db3ba4cdacaf74 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41958dc5e81443978e08a337fbb255bc, State: Initialized, Role: FOLLOWER
I20260709 12:14:36.658195   836 consensus_queue.cc:260] T 4836044424874856b0db3ba4cdacaf74 P 41958dc5e81443978e08a337fbb255bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.660640   836 ts_tablet_manager.cc:1434] T 4836044424874856b0db3ba4cdacaf74 P 41958dc5e81443978e08a337fbb255bc: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:14:36.661527   834 ts_tablet_manager.cc:1434] T 4836044424874856b0db3ba4cdacaf74 P f5d77cbf0f464436a88ee930055f8e05: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.004s
I20260709 12:14:36.661742   836 tablet_bootstrap.cc:492] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 41958dc5e81443978e08a337fbb255bc: Bootstrap starting.
I20260709 12:14:36.662864   834 tablet_bootstrap.cc:492] T adff2b2578704776809995fbb0a174b8 P f5d77cbf0f464436a88ee930055f8e05: Bootstrap starting.
I20260709 12:14:36.665292   793 raft_consensus.cc:493] T adff2b2578704776809995fbb0a174b8 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.665839   793 raft_consensus.cc:515] T adff2b2578704776809995fbb0a174b8 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.668821   793 leader_election.cc:290] T adff2b2578704776809995fbb0a174b8 P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935), 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883)
I20260709 12:14:36.670020   545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adff2b2578704776809995fbb0a174b8" candidate_uuid: "21975c12fc284bc18715d45d96e9e63a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d77cbf0f464436a88ee930055f8e05" is_pre_election: true
I20260709 12:14:36.671897   782 raft_consensus.cc:493] T bc2db88da3264b91b1e8ec6ab9a0804e P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.672585   782 raft_consensus.cc:515] T bc2db88da3264b91b1e8ec6ab9a0804e P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.682416   819 raft_consensus.cc:493] T bccb6d19bc454739bd69c05e22938ca5 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.683138   819 raft_consensus.cc:515] T bccb6d19bc454739bd69c05e22938ca5 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.688031   793 raft_consensus.cc:493] T 4836044424874856b0db3ba4cdacaf74 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.688709   793 raft_consensus.cc:515] T 4836044424874856b0db3ba4cdacaf74 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.690812   854 raft_consensus.cc:493] T bc2db88da3264b91b1e8ec6ab9a0804e P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.691511   854 raft_consensus.cc:515] T bc2db88da3264b91b1e8ec6ab9a0804e P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.693334   852 raft_consensus.cc:493] T 7661cfdd4178479ba812b94315dd21ab P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.693994   852 raft_consensus.cc:515] T 7661cfdd4178479ba812b94315dd21ab P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.702528   853 raft_consensus.cc:493] T e4898429379b4b4880b522f22145f62a P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.703260   853 raft_consensus.cc:515] T e4898429379b4b4880b522f22145f62a P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.715364   834 tablet_bootstrap.cc:654] T adff2b2578704776809995fbb0a174b8 P f5d77cbf0f464436a88ee930055f8e05: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:36.716197   661 leader_election.cc:343] T adff2b2578704776809995fbb0a174b8 P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:36.716665   836 tablet_bootstrap.cc:654] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 41958dc5e81443978e08a337fbb255bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:36.722143   547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4836044424874856b0db3ba4cdacaf74" candidate_uuid: "21975c12fc284bc18715d45d96e9e63a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d77cbf0f464436a88ee930055f8e05" is_pre_election: true
I20260709 12:14:36.722885   547 raft_consensus.cc:2468] T 4836044424874856b0db3ba4cdacaf74 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21975c12fc284bc18715d45d96e9e63a in term 0.
I20260709 12:14:36.723839   833 tablet_bootstrap.cc:492] T 7661cfdd4178479ba812b94315dd21ab P 21975c12fc284bc18715d45d96e9e63a: No bootstrap required, opened a new log
I20260709 12:14:36.724331   661 leader_election.cc:304] T 4836044424874856b0db3ba4cdacaf74 P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21975c12fc284bc18715d45d96e9e63a, f5d77cbf0f464436a88ee930055f8e05; no voters: 
I20260709 12:14:36.724416   833 ts_tablet_manager.cc:1403] T 7661cfdd4178479ba812b94315dd21ab P 21975c12fc284bc18715d45d96e9e63a: Time spent bootstrapping tablet: real 0.079s	user 0.018s	sys 0.022s
I20260709 12:14:36.719774   793 leader_election.cc:290] T 4836044424874856b0db3ba4cdacaf74 P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935), 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883)
I20260709 12:14:36.731482   863 raft_consensus.cc:493] T bccb6d19bc454739bd69c05e22938ca5 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.732214   863 raft_consensus.cc:515] T bccb6d19bc454739bd69c05e22938ca5 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.735880   851 raft_consensus.cc:493] T c4938b6e0a5145449cf5658d192995d7 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.736632   851 raft_consensus.cc:515] T c4938b6e0a5145449cf5658d192995d7 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.737349   819 leader_election.cc:290] T bccb6d19bc454739bd69c05e22938ca5 P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883), 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559)
I20260709 12:14:36.738114   621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccb6d19bc454739bd69c05e22938ca5" candidate_uuid: "f5d77cbf0f464436a88ee930055f8e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41958dc5e81443978e08a337fbb255bc" is_pre_election: true
I20260709 12:14:36.738783   621 raft_consensus.cc:2468] T bccb6d19bc454739bd69c05e22938ca5 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5d77cbf0f464436a88ee930055f8e05 in term 0.
I20260709 12:14:36.739746   851 leader_election.cc:290] T c4938b6e0a5145449cf5658d192995d7 P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935), 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559)
I20260709 12:14:36.740752   695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccb6d19bc454739bd69c05e22938ca5" candidate_uuid: "f5d77cbf0f464436a88ee930055f8e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21975c12fc284bc18715d45d96e9e63a" is_pre_election: true
I20260709 12:14:36.741410   695 raft_consensus.cc:2468] T bccb6d19bc454739bd69c05e22938ca5 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5d77cbf0f464436a88ee930055f8e05 in term 0.
I20260709 12:14:36.742321   511 leader_election.cc:304] T bccb6d19bc454739bd69c05e22938ca5 P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41958dc5e81443978e08a337fbb255bc, f5d77cbf0f464436a88ee930055f8e05; no voters: 
I20260709 12:14:36.742745   547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4938b6e0a5145449cf5658d192995d7" candidate_uuid: "41958dc5e81443978e08a337fbb255bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d77cbf0f464436a88ee930055f8e05" is_pre_election: true
I20260709 12:14:36.749787   622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adff2b2578704776809995fbb0a174b8" candidate_uuid: "21975c12fc284bc18715d45d96e9e63a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41958dc5e81443978e08a337fbb255bc" is_pre_election: true
I20260709 12:14:36.745223   793 raft_consensus.cc:2804] T 4836044424874856b0db3ba4cdacaf74 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:36.743402   547 raft_consensus.cc:2468] T c4938b6e0a5145449cf5658d192995d7 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41958dc5e81443978e08a337fbb255bc in term 0.
I20260709 12:14:36.772325   587 leader_election.cc:304] T c4938b6e0a5145449cf5658d192995d7 P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41958dc5e81443978e08a337fbb255bc, f5d77cbf0f464436a88ee930055f8e05; no voters: 
I20260709 12:14:36.773530   851 raft_consensus.cc:2804] T c4938b6e0a5145449cf5658d192995d7 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:36.750242   782 leader_election.cc:290] T bc2db88da3264b91b1e8ec6ab9a0804e P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935), 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559)
I20260709 12:14:36.751971   819 raft_consensus.cc:2804] T bccb6d19bc454739bd69c05e22938ca5 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:36.769156   621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4836044424874856b0db3ba4cdacaf74" candidate_uuid: "21975c12fc284bc18715d45d96e9e63a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41958dc5e81443978e08a337fbb255bc" is_pre_election: true
I20260709 12:14:36.753579   852 leader_election.cc:290] T 7661cfdd4178479ba812b94315dd21ab P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883), 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559)
I20260709 12:14:36.751261   545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc2db88da3264b91b1e8ec6ab9a0804e" candidate_uuid: "41958dc5e81443978e08a337fbb255bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d77cbf0f464436a88ee930055f8e05" is_pre_election: true
I20260709 12:14:36.758383   853 leader_election.cc:290] T e4898429379b4b4880b522f22145f62a P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883), 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559)
I20260709 12:14:36.750545   854 leader_election.cc:290] T bc2db88da3264b91b1e8ec6ab9a0804e P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883), 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559)
I20260709 12:14:36.773972   851 raft_consensus.cc:493] T c4938b6e0a5145449cf5658d192995d7 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:36.778878   851 raft_consensus.cc:3060] T c4938b6e0a5145449cf5658d192995d7 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:36.778709   545 raft_consensus.cc:2468] T bc2db88da3264b91b1e8ec6ab9a0804e P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41958dc5e81443978e08a337fbb255bc in term 0.
I20260709 12:14:36.779352   695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4938b6e0a5145449cf5658d192995d7" candidate_uuid: "41958dc5e81443978e08a337fbb255bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21975c12fc284bc18715d45d96e9e63a" is_pre_election: true
I20260709 12:14:36.780023   695 raft_consensus.cc:2468] T c4938b6e0a5145449cf5658d192995d7 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41958dc5e81443978e08a337fbb255bc in term 0.
I20260709 12:14:36.780402   587 leader_election.cc:304] T bc2db88da3264b91b1e8ec6ab9a0804e P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41958dc5e81443978e08a337fbb255bc, f5d77cbf0f464436a88ee930055f8e05; no voters: 
I20260709 12:14:36.777822   621 raft_consensus.cc:2468] T 4836044424874856b0db3ba4cdacaf74 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21975c12fc284bc18715d45d96e9e63a in term 0.
I20260709 12:14:36.781590   782 raft_consensus.cc:2804] T bc2db88da3264b91b1e8ec6ab9a0804e P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:36.782122   782 raft_consensus.cc:493] T bc2db88da3264b91b1e8ec6ab9a0804e P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:36.782552   782 raft_consensus.cc:3060] T bc2db88da3264b91b1e8ec6ab9a0804e P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:36.783398   660 leader_election.cc:343] T adff2b2578704776809995fbb0a174b8 P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:36.783902   660 leader_election.cc:304] T adff2b2578704776809995fbb0a174b8 P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21975c12fc284bc18715d45d96e9e63a; no voters: 41958dc5e81443978e08a337fbb255bc, f5d77cbf0f464436a88ee930055f8e05
I20260709 12:14:36.786123   695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc2db88da3264b91b1e8ec6ab9a0804e" candidate_uuid: "41958dc5e81443978e08a337fbb255bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21975c12fc284bc18715d45d96e9e63a" is_pre_election: true
I20260709 12:14:36.770030   793 raft_consensus.cc:493] T 4836044424874856b0db3ba4cdacaf74 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:36.774724   819 raft_consensus.cc:493] T bccb6d19bc454739bd69c05e22938ca5 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:36.788231   819 raft_consensus.cc:3060] T bccb6d19bc454739bd69c05e22938ca5 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:36.787540   851 raft_consensus.cc:515] T c4938b6e0a5145449cf5658d192995d7 P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
W20260709 12:14:36.791069   586 leader_election.cc:343] T bc2db88da3264b91b1e8ec6ab9a0804e P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:36.791131   621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccb6d19bc454739bd69c05e22938ca5" candidate_uuid: "21975c12fc284bc18715d45d96e9e63a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41958dc5e81443978e08a337fbb255bc" is_pre_election: true
I20260709 12:14:36.792025   834 tablet_bootstrap.cc:492] T adff2b2578704776809995fbb0a174b8 P f5d77cbf0f464436a88ee930055f8e05: No bootstrap required, opened a new log
I20260709 12:14:36.792179   621 raft_consensus.cc:2468] T bccb6d19bc454739bd69c05e22938ca5 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21975c12fc284bc18715d45d96e9e63a in term 0.
I20260709 12:14:36.792593   834 ts_tablet_manager.cc:1403] T adff2b2578704776809995fbb0a174b8 P f5d77cbf0f464436a88ee930055f8e05: Time spent bootstrapping tablet: real 0.130s	user 0.018s	sys 0.013s
I20260709 12:14:36.793692   660 leader_election.cc:304] T bccb6d19bc454739bd69c05e22938ca5 P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21975c12fc284bc18715d45d96e9e63a, 41958dc5e81443978e08a337fbb255bc; no voters: 
I20260709 12:14:36.788266   793 raft_consensus.cc:3060] T 4836044424874856b0db3ba4cdacaf74 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:36.778122   863 leader_election.cc:290] T bccb6d19bc454739bd69c05e22938ca5 P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935), 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883)
W20260709 12:14:36.788156   511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:34883, user_credentials={real_user=slave}} blocked reactor thread for 45803.5us
I20260709 12:14:36.801887   851 leader_election.cc:290] T c4938b6e0a5145449cf5658d192995d7 P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 election: Requested vote from peers f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935), 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559)
I20260709 12:14:36.803210   866 raft_consensus.cc:2804] T bccb6d19bc454739bd69c05e22938ca5 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:36.803534   863 raft_consensus.cc:2749] T adff2b2578704776809995fbb0a174b8 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:36.803655   866 raft_consensus.cc:493] T bccb6d19bc454739bd69c05e22938ca5 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:36.801913   836 tablet_bootstrap.cc:492] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 41958dc5e81443978e08a337fbb255bc: No bootstrap required, opened a new log
I20260709 12:14:36.804899   836 ts_tablet_manager.cc:1403] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 41958dc5e81443978e08a337fbb255bc: Time spent bootstrapping tablet: real 0.143s	user 0.038s	sys 0.023s
I20260709 12:14:36.806466   621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc2db88da3264b91b1e8ec6ab9a0804e" candidate_uuid: "f5d77cbf0f464436a88ee930055f8e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41958dc5e81443978e08a337fbb255bc" is_pre_election: true
W20260709 12:14:36.799316   661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:38935, user_credentials={real_user=slave}} blocked reactor thread for 75090.7us
I20260709 12:14:36.794615   833 raft_consensus.cc:359] T 7661cfdd4178479ba812b94315dd21ab P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.808194   833 raft_consensus.cc:385] T 7661cfdd4178479ba812b94315dd21ab P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:36.808511   833 raft_consensus.cc:740] T 7661cfdd4178479ba812b94315dd21ab P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21975c12fc284bc18715d45d96e9e63a, State: Initialized, Role: FOLLOWER
I20260709 12:14:36.809357   834 raft_consensus.cc:359] T adff2b2578704776809995fbb0a174b8 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.810176   834 raft_consensus.cc:385] T adff2b2578704776809995fbb0a174b8 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:36.810552   834 raft_consensus.cc:740] T adff2b2578704776809995fbb0a174b8 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d77cbf0f464436a88ee930055f8e05, State: Initialized, Role: FOLLOWER
I20260709 12:14:36.810474   622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7661cfdd4178479ba812b94315dd21ab" candidate_uuid: "f5d77cbf0f464436a88ee930055f8e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41958dc5e81443978e08a337fbb255bc" is_pre_election: true
I20260709 12:14:36.811141   546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccb6d19bc454739bd69c05e22938ca5" candidate_uuid: "21975c12fc284bc18715d45d96e9e63a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d77cbf0f464436a88ee930055f8e05" is_pre_election: true
I20260709 12:14:36.811546   622 raft_consensus.cc:2468] T 7661cfdd4178479ba812b94315dd21ab P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5d77cbf0f464436a88ee930055f8e05 in term 0.
I20260709 12:14:36.811828   834 consensus_queue.cc:260] T adff2b2578704776809995fbb0a174b8 P f5d77cbf0f464436a88ee930055f8e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.813658   695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4938b6e0a5145449cf5658d192995d7" candidate_uuid: "41958dc5e81443978e08a337fbb255bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21975c12fc284bc18715d45d96e9e63a"
I20260709 12:14:36.814355   695 raft_consensus.cc:3060] T c4938b6e0a5145449cf5658d192995d7 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:36.814144   836 raft_consensus.cc:359] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.814925   836 raft_consensus.cc:385] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:36.815256   836 raft_consensus.cc:740] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41958dc5e81443978e08a337fbb255bc, State: Initialized, Role: FOLLOWER
I20260709 12:14:36.815574   819 raft_consensus.cc:515] T bccb6d19bc454739bd69c05e22938ca5 P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.816166   836 consensus_queue.cc:260] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 41958dc5e81443978e08a337fbb255bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.816751   546 raft_consensus.cc:2393] T bccb6d19bc454739bd69c05e22938ca5 P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21975c12fc284bc18715d45d96e9e63a in current term 1: Already voted for candidate f5d77cbf0f464436a88ee930055f8e05 in this term.
I20260709 12:14:36.809314   833 consensus_queue.cc:260] T 7661cfdd4178479ba812b94315dd21ab P 21975c12fc284bc18715d45d96e9e63a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.820699   836 ts_tablet_manager.cc:1434] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 41958dc5e81443978e08a337fbb255bc: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:14:36.821394   833 ts_tablet_manager.cc:1434] T 7661cfdd4178479ba812b94315dd21ab P 21975c12fc284bc18715d45d96e9e63a: Time spent starting tablet: real 0.096s	user 0.002s	sys 0.005s
I20260709 12:14:36.821827   819 leader_election.cc:290] T bccb6d19bc454739bd69c05e22938ca5 P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 1 election: Requested vote from peers 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883), 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559)
I20260709 12:14:36.822053   545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4938b6e0a5145449cf5658d192995d7" candidate_uuid: "41958dc5e81443978e08a337fbb255bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d77cbf0f464436a88ee930055f8e05"
I20260709 12:14:36.822485   833 tablet_bootstrap.cc:492] T bc2db88da3264b91b1e8ec6ab9a0804e P 21975c12fc284bc18715d45d96e9e63a: Bootstrap starting.
I20260709 12:14:36.822752   545 raft_consensus.cc:3060] T c4938b6e0a5145449cf5658d192995d7 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:36.804374   866 raft_consensus.cc:3060] T bccb6d19bc454739bd69c05e22938ca5 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:36.821897   836 tablet_bootstrap.cc:492] T 40970913ee644c928ddad5cbfacd6ed9 P 41958dc5e81443978e08a337fbb255bc: Bootstrap starting.
I20260709 12:14:36.832532   834 ts_tablet_manager.cc:1434] T adff2b2578704776809995fbb0a174b8 P f5d77cbf0f464436a88ee930055f8e05: Time spent starting tablet: real 0.040s	user 0.010s	sys 0.000s
I20260709 12:14:36.836448   622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4898429379b4b4880b522f22145f62a" candidate_uuid: "f5d77cbf0f464436a88ee930055f8e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41958dc5e81443978e08a337fbb255bc" is_pre_election: true
W20260709 12:14:36.837119   660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.130:34883, user_credentials={real_user=slave}} blocked reactor thread for 43516.4us
I20260709 12:14:36.836645   833 tablet_bootstrap.cc:654] T bc2db88da3264b91b1e8ec6ab9a0804e P 21975c12fc284bc18715d45d96e9e63a: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:36.841194   622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccb6d19bc454739bd69c05e22938ca5" candidate_uuid: "f5d77cbf0f464436a88ee930055f8e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41958dc5e81443978e08a337fbb255bc"
I20260709 12:14:36.842036   622 raft_consensus.cc:3060] T bccb6d19bc454739bd69c05e22938ca5 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:36.845433   834 tablet_bootstrap.cc:492] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P f5d77cbf0f464436a88ee930055f8e05: Bootstrap starting.
I20260709 12:14:36.846298   695 raft_consensus.cc:2468] T c4938b6e0a5145449cf5658d192995d7 P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41958dc5e81443978e08a337fbb255bc in term 1.
I20260709 12:14:36.848795   586 leader_election.cc:304] T c4938b6e0a5145449cf5658d192995d7 P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21975c12fc284bc18715d45d96e9e63a, 41958dc5e81443978e08a337fbb255bc; no voters: 
I20260709 12:14:36.849814   848 raft_consensus.cc:2804] T c4938b6e0a5145449cf5658d192995d7 P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:36.850335   848 raft_consensus.cc:697] T c4938b6e0a5145449cf5658d192995d7 P 41958dc5e81443978e08a337fbb255bc [term 1 LEADER]: Becoming Leader. State: Replica: 41958dc5e81443978e08a337fbb255bc, State: Running, Role: LEADER
I20260709 12:14:36.849932   793 raft_consensus.cc:515] T 4836044424874856b0db3ba4cdacaf74 P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.851215   848 consensus_queue.cc:237] T c4938b6e0a5145449cf5658d192995d7 P 41958dc5e81443978e08a337fbb255bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.859395   622 raft_consensus.cc:2468] T bccb6d19bc454739bd69c05e22938ca5 P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d77cbf0f464436a88ee930055f8e05 in term 1.
I20260709 12:14:36.859696   836 tablet_bootstrap.cc:654] T 40970913ee644c928ddad5cbfacd6ed9 P 41958dc5e81443978e08a337fbb255bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:36.860606   851 raft_consensus.cc:493] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.862854   851 raft_consensus.cc:515] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.864228   793 leader_election.cc:290] T 4836044424874856b0db3ba4cdacaf74 P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 1 election: Requested vote from peers f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935), 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883)
I20260709 12:14:36.865617   546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4836044424874856b0db3ba4cdacaf74" candidate_uuid: "21975c12fc284bc18715d45d96e9e63a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d77cbf0f464436a88ee930055f8e05"
I20260709 12:14:36.866183   851 leader_election.cc:290] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935), 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559)
I20260709 12:14:36.866267   546 raft_consensus.cc:3060] T 4836044424874856b0db3ba4cdacaf74 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:36.867906   693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b3c830bc7346c5bcbb710b4c9cb9c0" candidate_uuid: "41958dc5e81443978e08a337fbb255bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21975c12fc284bc18715d45d96e9e63a" is_pre_election: true
W20260709 12:14:36.869485   586 leader_election.cc:343] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:36.857141   511 leader_election.cc:304] T 7661cfdd4178479ba812b94315dd21ab P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41958dc5e81443978e08a337fbb255bc, f5d77cbf0f464436a88ee930055f8e05; no voters: 
I20260709 12:14:36.872073   694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7661cfdd4178479ba812b94315dd21ab" candidate_uuid: "f5d77cbf0f464436a88ee930055f8e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21975c12fc284bc18715d45d96e9e63a" is_pre_election: true
I20260709 12:14:36.872219   819 raft_consensus.cc:2804] T 7661cfdd4178479ba812b94315dd21ab P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:36.872726   819 raft_consensus.cc:493] T 7661cfdd4178479ba812b94315dd21ab P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:36.872812   694 raft_consensus.cc:2468] T 7661cfdd4178479ba812b94315dd21ab P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5d77cbf0f464436a88ee930055f8e05 in term 0.
I20260709 12:14:36.873152   819 raft_consensus.cc:3060] T 7661cfdd4178479ba812b94315dd21ab P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:36.873395   696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4898429379b4b4880b522f22145f62a" candidate_uuid: "f5d77cbf0f464436a88ee930055f8e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21975c12fc284bc18715d45d96e9e63a" is_pre_election: true
I20260709 12:14:36.872748   547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b3c830bc7346c5bcbb710b4c9cb9c0" candidate_uuid: "41958dc5e81443978e08a337fbb255bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d77cbf0f464436a88ee930055f8e05" is_pre_election: true
I20260709 12:14:36.874230   696 raft_consensus.cc:2393] T e4898429379b4b4880b522f22145f62a P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5d77cbf0f464436a88ee930055f8e05 in current term 1: Already voted for candidate 41958dc5e81443978e08a337fbb255bc in this term.
W20260709 12:14:36.875131   587 leader_election.cc:343] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:36.875617   587 leader_election.cc:304] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41958dc5e81443978e08a337fbb255bc; no voters: 21975c12fc284bc18715d45d96e9e63a, f5d77cbf0f464436a88ee930055f8e05
I20260709 12:14:36.876677   546 raft_consensus.cc:2468] T 4836044424874856b0db3ba4cdacaf74 P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21975c12fc284bc18715d45d96e9e63a in term 1.
I20260709 12:14:36.877466   696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccb6d19bc454739bd69c05e22938ca5" candidate_uuid: "f5d77cbf0f464436a88ee930055f8e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21975c12fc284bc18715d45d96e9e63a"
I20260709 12:14:36.877887   661 leader_election.cc:304] T 4836044424874856b0db3ba4cdacaf74 P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21975c12fc284bc18715d45d96e9e63a, f5d77cbf0f464436a88ee930055f8e05; no voters: 
I20260709 12:14:36.879122   545 raft_consensus.cc:2468] T c4938b6e0a5145449cf5658d192995d7 P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41958dc5e81443978e08a337fbb255bc in term 1.
I20260709 12:14:36.879971   870 raft_consensus.cc:2804] T 4836044424874856b0db3ba4cdacaf74 P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:36.880466   870 raft_consensus.cc:697] T 4836044424874856b0db3ba4cdacaf74 P 21975c12fc284bc18715d45d96e9e63a [term 1 LEADER]: Becoming Leader. State: Replica: 21975c12fc284bc18715d45d96e9e63a, State: Running, Role: LEADER
I20260709 12:14:36.881341   819 raft_consensus.cc:515] T 7661cfdd4178479ba812b94315dd21ab P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.883580   511 leader_election.cc:304] T bccb6d19bc454739bd69c05e22938ca5 P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41958dc5e81443978e08a337fbb255bc, f5d77cbf0f464436a88ee930055f8e05; no voters: 
I20260709 12:14:36.881294   870 consensus_queue.cc:237] T 4836044424874856b0db3ba4cdacaf74 P 21975c12fc284bc18715d45d96e9e63a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.885654   511 leader_election.cc:304] T e4898429379b4b4880b522f22145f62a P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5d77cbf0f464436a88ee930055f8e05; no voters: 21975c12fc284bc18715d45d96e9e63a, 41958dc5e81443978e08a337fbb255bc
I20260709 12:14:36.886507   854 raft_consensus.cc:2804] T bccb6d19bc454739bd69c05e22938ca5 P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:36.887075   854 raft_consensus.cc:697] T bccb6d19bc454739bd69c05e22938ca5 P f5d77cbf0f464436a88ee930055f8e05 [term 1 LEADER]: Becoming Leader. State: Replica: f5d77cbf0f464436a88ee930055f8e05, State: Running, Role: LEADER
I20260709 12:14:36.887303   852 raft_consensus.cc:3060] T e4898429379b4b4880b522f22145f62a P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:36.888008   854 consensus_queue.cc:237] T bccb6d19bc454739bd69c05e22938ca5 P f5d77cbf0f464436a88ee930055f8e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.891501   834 tablet_bootstrap.cc:654] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P f5d77cbf0f464436a88ee930055f8e05: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:36.897171   819 leader_election.cc:290] T 7661cfdd4178479ba812b94315dd21ab P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 1 election: Requested vote from peers 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883), 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559)
I20260709 12:14:36.897821   620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7661cfdd4178479ba812b94315dd21ab" candidate_uuid: "f5d77cbf0f464436a88ee930055f8e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41958dc5e81443978e08a337fbb255bc"
I20260709 12:14:36.897213   782 raft_consensus.cc:515] T bc2db88da3264b91b1e8ec6ab9a0804e P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.898422   620 raft_consensus.cc:3060] T 7661cfdd4178479ba812b94315dd21ab P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:36.898911   621 raft_consensus.cc:2393] T bc2db88da3264b91b1e8ec6ab9a0804e P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5d77cbf0f464436a88ee930055f8e05 in current term 1: Already voted for candidate 41958dc5e81443978e08a337fbb255bc in this term.
I20260709 12:14:36.901286   622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4836044424874856b0db3ba4cdacaf74" candidate_uuid: "21975c12fc284bc18715d45d96e9e63a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41958dc5e81443978e08a337fbb255bc"
I20260709 12:14:36.901959   622 raft_consensus.cc:3060] T 4836044424874856b0db3ba4cdacaf74 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:36.904524   852 raft_consensus.cc:2749] T e4898429379b4b4880b522f22145f62a P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:36.905298   695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc2db88da3264b91b1e8ec6ab9a0804e" candidate_uuid: "f5d77cbf0f464436a88ee930055f8e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21975c12fc284bc18715d45d96e9e63a" is_pre_election: true
I20260709 12:14:36.906749   620 raft_consensus.cc:2468] T 7661cfdd4178479ba812b94315dd21ab P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d77cbf0f464436a88ee930055f8e05 in term 1.
I20260709 12:14:36.891932   848 raft_consensus.cc:2749] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:36.908407   511 leader_election.cc:304] T 7661cfdd4178479ba812b94315dd21ab P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41958dc5e81443978e08a337fbb255bc, f5d77cbf0f464436a88ee930055f8e05; no voters: 
I20260709 12:14:36.900986   866 raft_consensus.cc:515] T bccb6d19bc454739bd69c05e22938ca5 P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.919790   782 leader_election.cc:290] T bc2db88da3264b91b1e8ec6ab9a0804e P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 election: Requested vote from peers f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935), 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559)
I20260709 12:14:36.920722   546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc2db88da3264b91b1e8ec6ab9a0804e" candidate_uuid: "41958dc5e81443978e08a337fbb255bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d77cbf0f464436a88ee930055f8e05"
I20260709 12:14:36.921092   695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc2db88da3264b91b1e8ec6ab9a0804e" candidate_uuid: "41958dc5e81443978e08a337fbb255bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21975c12fc284bc18715d45d96e9e63a"
I20260709 12:14:36.923415   546 raft_consensus.cc:3060] T bc2db88da3264b91b1e8ec6ab9a0804e P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:36.923614   586 leader_election.cc:343] T bc2db88da3264b91b1e8ec6ab9a0804e P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:36.922019   852 raft_consensus.cc:2804] T 7661cfdd4178479ba812b94315dd21ab P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:36.929359   696 raft_consensus.cc:2393] T bccb6d19bc454739bd69c05e22938ca5 P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f5d77cbf0f464436a88ee930055f8e05 in current term 1: Already voted for candidate 21975c12fc284bc18715d45d96e9e63a in this term.
I20260709 12:14:36.934924   620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccb6d19bc454739bd69c05e22938ca5" candidate_uuid: "21975c12fc284bc18715d45d96e9e63a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41958dc5e81443978e08a337fbb255bc"
W20260709 12:14:36.925612   511 leader_election.cc:343] T bc2db88da3264b91b1e8ec6ab9a0804e P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:36.931217   833 tablet_bootstrap.cc:492] T bc2db88da3264b91b1e8ec6ab9a0804e P 21975c12fc284bc18715d45d96e9e63a: No bootstrap required, opened a new log
I20260709 12:14:36.929584   695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7661cfdd4178479ba812b94315dd21ab" candidate_uuid: "f5d77cbf0f464436a88ee930055f8e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21975c12fc284bc18715d45d96e9e63a"
I20260709 12:14:36.933136   545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccb6d19bc454739bd69c05e22938ca5" candidate_uuid: "21975c12fc284bc18715d45d96e9e63a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d77cbf0f464436a88ee930055f8e05"
I20260709 12:14:36.932667   442 catalog_manager.cc:5697] T bccb6d19bc454739bd69c05e22938ca5 P f5d77cbf0f464436a88ee930055f8e05 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129). New cstate: current_term: 1 leader_uuid: "f5d77cbf0f464436a88ee930055f8e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:36.934867   852 raft_consensus.cc:697] T 7661cfdd4178479ba812b94315dd21ab P f5d77cbf0f464436a88ee930055f8e05 [term 1 LEADER]: Becoming Leader. State: Replica: f5d77cbf0f464436a88ee930055f8e05, State: Running, Role: LEADER
I20260709 12:14:36.932343   866 leader_election.cc:290] T bccb6d19bc454739bd69c05e22938ca5 P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 1 election: Requested vote from peers f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935), 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883)
I20260709 12:14:36.935887   695 raft_consensus.cc:3060] T 7661cfdd4178479ba812b94315dd21ab P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:36.942266   852 consensus_queue.cc:237] T 7661cfdd4178479ba812b94315dd21ab P f5d77cbf0f464436a88ee930055f8e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.946472   834 tablet_bootstrap.cc:492] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P f5d77cbf0f464436a88ee930055f8e05: No bootstrap required, opened a new log
I20260709 12:14:36.946970   834 ts_tablet_manager.cc:1403] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P f5d77cbf0f464436a88ee930055f8e05: Time spent bootstrapping tablet: real 0.102s	user 0.014s	sys 0.007s
I20260709 12:14:36.948747   695 raft_consensus.cc:2468] T 7661cfdd4178479ba812b94315dd21ab P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d77cbf0f464436a88ee930055f8e05 in term 1.
I20260709 12:14:36.949958   834 raft_consensus.cc:359] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.950646   834 raft_consensus.cc:385] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:36.950923   834 raft_consensus.cc:740] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d77cbf0f464436a88ee930055f8e05, State: Initialized, Role: FOLLOWER
I20260709 12:14:36.951601   834 consensus_queue.cc:260] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P f5d77cbf0f464436a88ee930055f8e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.953569   834 ts_tablet_manager.cc:1434] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P f5d77cbf0f464436a88ee930055f8e05: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:14:36.953343   442 catalog_manager.cc:5697] T 7661cfdd4178479ba812b94315dd21ab P f5d77cbf0f464436a88ee930055f8e05 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129). New cstate: current_term: 1 leader_uuid: "f5d77cbf0f464436a88ee930055f8e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:36.954532   834 tablet_bootstrap.cc:492] T 40970913ee644c928ddad5cbfacd6ed9 P f5d77cbf0f464436a88ee930055f8e05: Bootstrap starting.
I20260709 12:14:36.936750   622 raft_consensus.cc:2468] T 4836044424874856b0db3ba4cdacaf74 P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21975c12fc284bc18715d45d96e9e63a in term 1.
I20260709 12:14:36.937953   620 raft_consensus.cc:2393] T bccb6d19bc454739bd69c05e22938ca5 P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 21975c12fc284bc18715d45d96e9e63a in current term 1: Already voted for candidate f5d77cbf0f464436a88ee930055f8e05 in this term.
I20260709 12:14:36.939935   511 leader_election.cc:304] T bc2db88da3264b91b1e8ec6ab9a0804e P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5d77cbf0f464436a88ee930055f8e05; no voters: 21975c12fc284bc18715d45d96e9e63a, 41958dc5e81443978e08a337fbb255bc
I20260709 12:14:36.940400   833 ts_tablet_manager.cc:1403] T bc2db88da3264b91b1e8ec6ab9a0804e P 21975c12fc284bc18715d45d96e9e63a: Time spent bootstrapping tablet: real 0.118s	user 0.010s	sys 0.014s
I20260709 12:14:36.940495   546 raft_consensus.cc:2468] T bc2db88da3264b91b1e8ec6ab9a0804e P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41958dc5e81443978e08a337fbb255bc in term 1.
I20260709 12:14:36.941522   836 tablet_bootstrap.cc:492] T 40970913ee644c928ddad5cbfacd6ed9 P 41958dc5e81443978e08a337fbb255bc: No bootstrap required, opened a new log
I20260709 12:14:36.959461   836 ts_tablet_manager.cc:1403] T 40970913ee644c928ddad5cbfacd6ed9 P 41958dc5e81443978e08a337fbb255bc: Time spent bootstrapping tablet: real 0.138s	user 0.017s	sys 0.004s
I20260709 12:14:36.960105   587 leader_election.cc:304] T bc2db88da3264b91b1e8ec6ab9a0804e P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41958dc5e81443978e08a337fbb255bc, f5d77cbf0f464436a88ee930055f8e05; no voters: 21975c12fc284bc18715d45d96e9e63a
I20260709 12:14:36.961404   848 raft_consensus.cc:2804] T bc2db88da3264b91b1e8ec6ab9a0804e P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:36.961249   833 raft_consensus.cc:359] T bc2db88da3264b91b1e8ec6ab9a0804e P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.962337   848 raft_consensus.cc:697] T bc2db88da3264b91b1e8ec6ab9a0804e P 41958dc5e81443978e08a337fbb255bc [term 1 LEADER]: Becoming Leader. State: Replica: 41958dc5e81443978e08a337fbb255bc, State: Running, Role: LEADER
I20260709 12:14:36.962149   836 raft_consensus.cc:359] T 40970913ee644c928ddad5cbfacd6ed9 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.962074   833 raft_consensus.cc:385] T bc2db88da3264b91b1e8ec6ab9a0804e P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:36.962961   836 raft_consensus.cc:385] T 40970913ee644c928ddad5cbfacd6ed9 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:36.962890   660 leader_election.cc:304] T bccb6d19bc454739bd69c05e22938ca5 P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21975c12fc284bc18715d45d96e9e63a; no voters: 41958dc5e81443978e08a337fbb255bc, f5d77cbf0f464436a88ee930055f8e05
I20260709 12:14:36.963888   833 raft_consensus.cc:740] T bc2db88da3264b91b1e8ec6ab9a0804e P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21975c12fc284bc18715d45d96e9e63a, State: Initialized, Role: FOLLOWER
I20260709 12:14:36.964398   836 raft_consensus.cc:740] T 40970913ee644c928ddad5cbfacd6ed9 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41958dc5e81443978e08a337fbb255bc, State: Initialized, Role: FOLLOWER
I20260709 12:14:36.962891   854 raft_consensus.cc:2749] T bc2db88da3264b91b1e8ec6ab9a0804e P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:36.965165   836 consensus_queue.cc:260] T 40970913ee644c928ddad5cbfacd6ed9 P 41958dc5e81443978e08a337fbb255bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.966074   866 raft_consensus.cc:2749] T bccb6d19bc454739bd69c05e22938ca5 P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:14:36.966065   443 catalog_manager.cc:5697] T 4836044424874856b0db3ba4cdacaf74 P 21975c12fc284bc18715d45d96e9e63a reported cstate change: term changed from 0 to 1, leader changed from <none> to 21975c12fc284bc18715d45d96e9e63a (127.20.196.131). New cstate: current_term: 1 leader_uuid: "21975c12fc284bc18715d45d96e9e63a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:36.967492   836 ts_tablet_manager.cc:1434] T 40970913ee644c928ddad5cbfacd6ed9 P 41958dc5e81443978e08a337fbb255bc: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:14:36.965194   833 consensus_queue.cc:260] T bc2db88da3264b91b1e8ec6ab9a0804e P 21975c12fc284bc18715d45d96e9e63a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.968528   836 tablet_bootstrap.cc:492] T adff2b2578704776809995fbb0a174b8 P 41958dc5e81443978e08a337fbb255bc: Bootstrap starting.
I20260709 12:14:36.970255   833 ts_tablet_manager.cc:1434] T bc2db88da3264b91b1e8ec6ab9a0804e P 21975c12fc284bc18715d45d96e9e63a: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260709 12:14:36.971236   833 tablet_bootstrap.cc:492] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a: Bootstrap starting.
I20260709 12:14:36.963878   848 consensus_queue.cc:237] T bc2db88da3264b91b1e8ec6ab9a0804e P 41958dc5e81443978e08a337fbb255bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.975232   836 tablet_bootstrap.cc:654] T adff2b2578704776809995fbb0a174b8 P 41958dc5e81443978e08a337fbb255bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:36.978962   833 tablet_bootstrap.cc:654] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:36.979820   834 tablet_bootstrap.cc:654] T 40970913ee644c928ddad5cbfacd6ed9 P f5d77cbf0f464436a88ee930055f8e05: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:36.985283   836 tablet_bootstrap.cc:492] T adff2b2578704776809995fbb0a174b8 P 41958dc5e81443978e08a337fbb255bc: No bootstrap required, opened a new log
I20260709 12:14:36.985908   836 ts_tablet_manager.cc:1403] T adff2b2578704776809995fbb0a174b8 P 41958dc5e81443978e08a337fbb255bc: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.004s
I20260709 12:14:36.989465   833 tablet_bootstrap.cc:492] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a: No bootstrap required, opened a new log
I20260709 12:14:36.989423   836 raft_consensus.cc:359] T adff2b2578704776809995fbb0a174b8 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.990190   833 ts_tablet_manager.cc:1403] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.001s
I20260709 12:14:36.990512   836 raft_consensus.cc:385] T adff2b2578704776809995fbb0a174b8 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:36.990964   836 raft_consensus.cc:740] T adff2b2578704776809995fbb0a174b8 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41958dc5e81443978e08a337fbb255bc, State: Initialized, Role: FOLLOWER
I20260709 12:14:36.992103   836 consensus_queue.cc:260] T adff2b2578704776809995fbb0a174b8 P 41958dc5e81443978e08a337fbb255bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.993825   833 raft_consensus.cc:359] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.994633   833 raft_consensus.cc:385] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:36.994957   833 raft_consensus.cc:740] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21975c12fc284bc18715d45d96e9e63a, State: Initialized, Role: FOLLOWER
I20260709 12:14:36.995504   836 ts_tablet_manager.cc:1434] T adff2b2578704776809995fbb0a174b8 P 41958dc5e81443978e08a337fbb255bc: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.001s
I20260709 12:14:36.995875   833 consensus_queue.cc:260] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.997493   866 raft_consensus.cc:493] T bc2db88da3264b91b1e8ec6ab9a0804e P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.998456   833 ts_tablet_manager.cc:1434] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:14:36.998070   866 raft_consensus.cc:515] T bc2db88da3264b91b1e8ec6ab9a0804e P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:36.999434   833 tablet_bootstrap.cc:492] T 40970913ee644c928ddad5cbfacd6ed9 P 21975c12fc284bc18715d45d96e9e63a: Bootstrap starting.
I20260709 12:14:37.002182   622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc2db88da3264b91b1e8ec6ab9a0804e" candidate_uuid: "21975c12fc284bc18715d45d96e9e63a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41958dc5e81443978e08a337fbb255bc" is_pre_election: true
I20260709 12:14:37.003072   546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc2db88da3264b91b1e8ec6ab9a0804e" candidate_uuid: "21975c12fc284bc18715d45d96e9e63a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d77cbf0f464436a88ee930055f8e05" is_pre_election: true
I20260709 12:14:37.003885   546 raft_consensus.cc:2393] T bc2db88da3264b91b1e8ec6ab9a0804e P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21975c12fc284bc18715d45d96e9e63a in current term 1: Already voted for candidate 41958dc5e81443978e08a337fbb255bc in this term.
I20260709 12:14:37.004558   866 leader_election.cc:290] T bc2db88da3264b91b1e8ec6ab9a0804e P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935), 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883)
I20260709 12:14:37.005576   833 tablet_bootstrap.cc:654] T 40970913ee644c928ddad5cbfacd6ed9 P 21975c12fc284bc18715d45d96e9e63a: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:37.005577   661 leader_election.cc:304] T bc2db88da3264b91b1e8ec6ab9a0804e P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21975c12fc284bc18715d45d96e9e63a; no voters: 41958dc5e81443978e08a337fbb255bc, f5d77cbf0f464436a88ee930055f8e05
I20260709 12:14:37.007972   866 raft_consensus.cc:3060] T bc2db88da3264b91b1e8ec6ab9a0804e P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:37.021498   866 raft_consensus.cc:2749] T bc2db88da3264b91b1e8ec6ab9a0804e P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:37.024420   833 tablet_bootstrap.cc:492] T 40970913ee644c928ddad5cbfacd6ed9 P 21975c12fc284bc18715d45d96e9e63a: No bootstrap required, opened a new log
I20260709 12:14:37.025183   833 ts_tablet_manager.cc:1403] T 40970913ee644c928ddad5cbfacd6ed9 P 21975c12fc284bc18715d45d96e9e63a: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.008s
I20260709 12:14:37.027498   443 catalog_manager.cc:5697] T bc2db88da3264b91b1e8ec6ab9a0804e P 41958dc5e81443978e08a337fbb255bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 41958dc5e81443978e08a337fbb255bc (127.20.196.130). New cstate: current_term: 1 leader_uuid: "41958dc5e81443978e08a337fbb255bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:37.029028   833 raft_consensus.cc:359] T 40970913ee644c928ddad5cbfacd6ed9 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:37.029687   833 raft_consensus.cc:385] T 40970913ee644c928ddad5cbfacd6ed9 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:37.030035   833 raft_consensus.cc:740] T 40970913ee644c928ddad5cbfacd6ed9 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21975c12fc284bc18715d45d96e9e63a, State: Initialized, Role: FOLLOWER
I20260709 12:14:37.029567   443 catalog_manager.cc:5697] T c4938b6e0a5145449cf5658d192995d7 P 41958dc5e81443978e08a337fbb255bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 41958dc5e81443978e08a337fbb255bc (127.20.196.130). New cstate: current_term: 1 leader_uuid: "41958dc5e81443978e08a337fbb255bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:37.030759   833 consensus_queue.cc:260] T 40970913ee644c928ddad5cbfacd6ed9 P 21975c12fc284bc18715d45d96e9e63a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:37.031270   834 tablet_bootstrap.cc:492] T 40970913ee644c928ddad5cbfacd6ed9 P f5d77cbf0f464436a88ee930055f8e05: No bootstrap required, opened a new log
I20260709 12:14:37.031749   834 ts_tablet_manager.cc:1403] T 40970913ee644c928ddad5cbfacd6ed9 P f5d77cbf0f464436a88ee930055f8e05: Time spent bootstrapping tablet: real 0.077s	user 0.017s	sys 0.031s
I20260709 12:14:37.032974   833 ts_tablet_manager.cc:1434] T 40970913ee644c928ddad5cbfacd6ed9 P 21975c12fc284bc18715d45d96e9e63a: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:14:37.034368   834 raft_consensus.cc:359] T 40970913ee644c928ddad5cbfacd6ed9 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:37.035006   834 raft_consensus.cc:385] T 40970913ee644c928ddad5cbfacd6ed9 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:37.035322   834 raft_consensus.cc:740] T 40970913ee644c928ddad5cbfacd6ed9 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d77cbf0f464436a88ee930055f8e05, State: Initialized, Role: FOLLOWER
I20260709 12:14:37.036597   834 consensus_queue.cc:260] T 40970913ee644c928ddad5cbfacd6ed9 P f5d77cbf0f464436a88ee930055f8e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:37.038761   834 ts_tablet_manager.cc:1434] T 40970913ee644c928ddad5cbfacd6ed9 P f5d77cbf0f464436a88ee930055f8e05: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:14:37.117277   848 consensus_queue.cc:1048] T e4898429379b4b4880b522f22145f62a P 41958dc5e81443978e08a337fbb255bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:37.132395   854 raft_consensus.cc:493] T adff2b2578704776809995fbb0a174b8 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.133038   866 raft_consensus.cc:493] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.132992   854 raft_consensus.cc:515] T adff2b2578704776809995fbb0a174b8 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:37.133620   866 raft_consensus.cc:515] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:37.134848   851 consensus_queue.cc:1048] T e4898429379b4b4880b522f22145f62a P 41958dc5e81443978e08a337fbb255bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:37.135294   854 leader_election.cc:290] T adff2b2578704776809995fbb0a174b8 P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883), 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559)
I20260709 12:14:37.135794   866 leader_election.cc:290] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935), 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883)
I20260709 12:14:37.136930   695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adff2b2578704776809995fbb0a174b8" candidate_uuid: "f5d77cbf0f464436a88ee930055f8e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21975c12fc284bc18715d45d96e9e63a" is_pre_election: true
I20260709 12:14:37.141346   695 raft_consensus.cc:2468] T adff2b2578704776809995fbb0a174b8 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5d77cbf0f464436a88ee930055f8e05 in term 0.
I20260709 12:14:37.137969   620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adff2b2578704776809995fbb0a174b8" candidate_uuid: "f5d77cbf0f464436a88ee930055f8e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41958dc5e81443978e08a337fbb255bc" is_pre_election: true
I20260709 12:14:37.142092   620 raft_consensus.cc:2468] T adff2b2578704776809995fbb0a174b8 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5d77cbf0f464436a88ee930055f8e05 in term 0.
I20260709 12:14:37.137714   545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b3c830bc7346c5bcbb710b4c9cb9c0" candidate_uuid: "21975c12fc284bc18715d45d96e9e63a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d77cbf0f464436a88ee930055f8e05" is_pre_election: true
I20260709 12:14:37.143618   511 leader_election.cc:304] T adff2b2578704776809995fbb0a174b8 P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41958dc5e81443978e08a337fbb255bc, f5d77cbf0f464436a88ee930055f8e05; no voters: 
I20260709 12:14:37.137010   622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b3c830bc7346c5bcbb710b4c9cb9c0" candidate_uuid: "21975c12fc284bc18715d45d96e9e63a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41958dc5e81443978e08a337fbb255bc" is_pre_election: true
I20260709 12:14:37.144001   545 raft_consensus.cc:2468] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21975c12fc284bc18715d45d96e9e63a in term 0.
I20260709 12:14:37.145349   852 raft_consensus.cc:2804] T adff2b2578704776809995fbb0a174b8 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:37.146713   852 raft_consensus.cc:493] T adff2b2578704776809995fbb0a174b8 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:37.147136   852 raft_consensus.cc:3060] T adff2b2578704776809995fbb0a174b8 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:37.146232   661 leader_election.cc:304] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21975c12fc284bc18715d45d96e9e63a, f5d77cbf0f464436a88ee930055f8e05; no voters: 
I20260709 12:14:37.148241   866 raft_consensus.cc:2804] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:37.148572   866 raft_consensus.cc:493] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:37.144629   622 raft_consensus.cc:2468] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21975c12fc284bc18715d45d96e9e63a in term 0.
I20260709 12:14:37.149017   866 raft_consensus.cc:3060] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:37.155732   866 raft_consensus.cc:515] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:37.158658   866 leader_election.cc:290] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 1 election: Requested vote from peers f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935), 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883)
I20260709 12:14:37.158913   622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b3c830bc7346c5bcbb710b4c9cb9c0" candidate_uuid: "21975c12fc284bc18715d45d96e9e63a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41958dc5e81443978e08a337fbb255bc"
I20260709 12:14:37.159449   852 raft_consensus.cc:515] T adff2b2578704776809995fbb0a174b8 P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:37.159675   622 raft_consensus.cc:3060] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:37.159638   545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b3c830bc7346c5bcbb710b4c9cb9c0" candidate_uuid: "21975c12fc284bc18715d45d96e9e63a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d77cbf0f464436a88ee930055f8e05"
I20260709 12:14:37.163457   545 raft_consensus.cc:3060] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:37.165838   852 leader_election.cc:290] T adff2b2578704776809995fbb0a174b8 P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 1 election: Requested vote from peers 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883), 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559)
I20260709 12:14:37.167143   695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adff2b2578704776809995fbb0a174b8" candidate_uuid: "f5d77cbf0f464436a88ee930055f8e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21975c12fc284bc18715d45d96e9e63a"
I20260709 12:14:37.167374   620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adff2b2578704776809995fbb0a174b8" candidate_uuid: "f5d77cbf0f464436a88ee930055f8e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41958dc5e81443978e08a337fbb255bc"
I20260709 12:14:37.167757   695 raft_consensus.cc:3060] T adff2b2578704776809995fbb0a174b8 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:37.168009   620 raft_consensus.cc:3060] T adff2b2578704776809995fbb0a174b8 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:37.170933   545 raft_consensus.cc:2468] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21975c12fc284bc18715d45d96e9e63a in term 1.
I20260709 12:14:37.171010   622 raft_consensus.cc:2468] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21975c12fc284bc18715d45d96e9e63a in term 1.
I20260709 12:14:37.172318   661 leader_election.cc:304] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21975c12fc284bc18715d45d96e9e63a, f5d77cbf0f464436a88ee930055f8e05; no voters: 
I20260709 12:14:37.173163   866 raft_consensus.cc:2804] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:37.173617   866 raft_consensus.cc:697] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a [term 1 LEADER]: Becoming Leader. State: Replica: 21975c12fc284bc18715d45d96e9e63a, State: Running, Role: LEADER
I20260709 12:14:37.174494   695 raft_consensus.cc:2468] T adff2b2578704776809995fbb0a174b8 P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d77cbf0f464436a88ee930055f8e05 in term 1.
I20260709 12:14:37.174456   866 consensus_queue.cc:237] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:37.175551   511 leader_election.cc:304] T adff2b2578704776809995fbb0a174b8 P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21975c12fc284bc18715d45d96e9e63a, f5d77cbf0f464436a88ee930055f8e05; no voters: 
I20260709 12:14:37.175169   620 raft_consensus.cc:2468] T adff2b2578704776809995fbb0a174b8 P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d77cbf0f464436a88ee930055f8e05 in term 1.
I20260709 12:14:37.176923   852 raft_consensus.cc:2804] T adff2b2578704776809995fbb0a174b8 P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:37.177419   852 raft_consensus.cc:697] T adff2b2578704776809995fbb0a174b8 P f5d77cbf0f464436a88ee930055f8e05 [term 1 LEADER]: Becoming Leader. State: Replica: f5d77cbf0f464436a88ee930055f8e05, State: Running, Role: LEADER
I20260709 12:14:37.178311   852 consensus_queue.cc:237] T adff2b2578704776809995fbb0a174b8 P f5d77cbf0f464436a88ee930055f8e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:37.183943   443 catalog_manager.cc:5697] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a reported cstate change: term changed from 0 to 1, leader changed from <none> to 21975c12fc284bc18715d45d96e9e63a (127.20.196.131). New cstate: current_term: 1 leader_uuid: "21975c12fc284bc18715d45d96e9e63a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:37.185719   444 catalog_manager.cc:5697] T adff2b2578704776809995fbb0a174b8 P f5d77cbf0f464436a88ee930055f8e05 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129). New cstate: current_term: 1 leader_uuid: "f5d77cbf0f464436a88ee930055f8e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:37.227092   866 raft_consensus.cc:493] T 40970913ee644c928ddad5cbfacd6ed9 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.227603   866 raft_consensus.cc:515] T 40970913ee644c928ddad5cbfacd6ed9 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:37.229411   866 leader_election.cc:290] T 40970913ee644c928ddad5cbfacd6ed9 P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935), 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883)
I20260709 12:14:37.230270   545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40970913ee644c928ddad5cbfacd6ed9" candidate_uuid: "21975c12fc284bc18715d45d96e9e63a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d77cbf0f464436a88ee930055f8e05" is_pre_election: true
I20260709 12:14:37.230641   620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40970913ee644c928ddad5cbfacd6ed9" candidate_uuid: "21975c12fc284bc18715d45d96e9e63a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41958dc5e81443978e08a337fbb255bc" is_pre_election: true
I20260709 12:14:37.230919   545 raft_consensus.cc:2468] T 40970913ee644c928ddad5cbfacd6ed9 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21975c12fc284bc18715d45d96e9e63a in term 0.
I20260709 12:14:37.231334   620 raft_consensus.cc:2468] T 40970913ee644c928ddad5cbfacd6ed9 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21975c12fc284bc18715d45d96e9e63a in term 0.
I20260709 12:14:37.231953   661 leader_election.cc:304] T 40970913ee644c928ddad5cbfacd6ed9 P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21975c12fc284bc18715d45d96e9e63a, f5d77cbf0f464436a88ee930055f8e05; no voters: 
I20260709 12:14:37.232808   866 raft_consensus.cc:2804] T 40970913ee644c928ddad5cbfacd6ed9 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:37.233103   866 raft_consensus.cc:493] T 40970913ee644c928ddad5cbfacd6ed9 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:37.233392   866 raft_consensus.cc:3060] T 40970913ee644c928ddad5cbfacd6ed9 P 21975c12fc284bc18715d45d96e9e63a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:37.238693   866 raft_consensus.cc:515] T 40970913ee644c928ddad5cbfacd6ed9 P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:37.240275   866 leader_election.cc:290] T 40970913ee644c928ddad5cbfacd6ed9 P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 1 election: Requested vote from peers f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935), 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883)
I20260709 12:14:37.241232   545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40970913ee644c928ddad5cbfacd6ed9" candidate_uuid: "21975c12fc284bc18715d45d96e9e63a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d77cbf0f464436a88ee930055f8e05"
I20260709 12:14:37.241362   620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40970913ee644c928ddad5cbfacd6ed9" candidate_uuid: "21975c12fc284bc18715d45d96e9e63a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41958dc5e81443978e08a337fbb255bc"
I20260709 12:14:37.241894   545 raft_consensus.cc:3060] T 40970913ee644c928ddad5cbfacd6ed9 P f5d77cbf0f464436a88ee930055f8e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:37.241952   620 raft_consensus.cc:3060] T 40970913ee644c928ddad5cbfacd6ed9 P 41958dc5e81443978e08a337fbb255bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:37.247128   620 raft_consensus.cc:2468] T 40970913ee644c928ddad5cbfacd6ed9 P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21975c12fc284bc18715d45d96e9e63a in term 1.
I20260709 12:14:37.247391   545 raft_consensus.cc:2468] T 40970913ee644c928ddad5cbfacd6ed9 P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21975c12fc284bc18715d45d96e9e63a in term 1.
I20260709 12:14:37.248126   660 leader_election.cc:304] T 40970913ee644c928ddad5cbfacd6ed9 P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21975c12fc284bc18715d45d96e9e63a, 41958dc5e81443978e08a337fbb255bc; no voters: 
I20260709 12:14:37.249074   866 raft_consensus.cc:2804] T 40970913ee644c928ddad5cbfacd6ed9 P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:37.249559   866 raft_consensus.cc:697] T 40970913ee644c928ddad5cbfacd6ed9 P 21975c12fc284bc18715d45d96e9e63a [term 1 LEADER]: Becoming Leader. State: Replica: 21975c12fc284bc18715d45d96e9e63a, State: Running, Role: LEADER
I20260709 12:14:37.250211   866 consensus_queue.cc:237] T 40970913ee644c928ddad5cbfacd6ed9 P 21975c12fc284bc18715d45d96e9e63a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:37.257719   444 catalog_manager.cc:5697] T 40970913ee644c928ddad5cbfacd6ed9 P 21975c12fc284bc18715d45d96e9e63a reported cstate change: term changed from 0 to 1, leader changed from <none> to 21975c12fc284bc18715d45d96e9e63a (127.20.196.131). New cstate: current_term: 1 leader_uuid: "21975c12fc284bc18715d45d96e9e63a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:37.277216   620 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4938b6e0a5145449cf5658d192995d7"
dest_uuid: "41958dc5e81443978e08a337fbb255bc"
mode: GRACEFUL
new_leader_uuid: "f5d77cbf0f464436a88ee930055f8e05"
 from {username='slave'} at 127.0.0.1:33038
I20260709 12:14:37.277900   620 raft_consensus.cc:606] T c4938b6e0a5145449cf5658d192995d7 P 41958dc5e81443978e08a337fbb255bc [term 1 LEADER]: Received request to transfer leadership to TS f5d77cbf0f464436a88ee930055f8e05
I20260709 12:14:37.282749   620 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4898429379b4b4880b522f22145f62a"
dest_uuid: "41958dc5e81443978e08a337fbb255bc"
mode: GRACEFUL
new_leader_uuid: "f5d77cbf0f464436a88ee930055f8e05"
 from {username='slave'} at 127.0.0.1:33038
I20260709 12:14:37.283262   620 raft_consensus.cc:606] T e4898429379b4b4880b522f22145f62a P 41958dc5e81443978e08a337fbb255bc [term 1 LEADER]: Received request to transfer leadership to TS f5d77cbf0f464436a88ee930055f8e05
I20260709 12:14:37.288055   695 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4836044424874856b0db3ba4cdacaf74"
dest_uuid: "21975c12fc284bc18715d45d96e9e63a"
mode: GRACEFUL
new_leader_uuid: "f5d77cbf0f464436a88ee930055f8e05"
 from {username='slave'} at 127.0.0.1:38638
I20260709 12:14:37.288527   695 raft_consensus.cc:606] T 4836044424874856b0db3ba4cdacaf74 P 21975c12fc284bc18715d45d96e9e63a [term 1 LEADER]: Received request to transfer leadership to TS f5d77cbf0f464436a88ee930055f8e05
I20260709 12:14:37.293172   545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7661cfdd4178479ba812b94315dd21ab"
dest_uuid: "f5d77cbf0f464436a88ee930055f8e05"
mode: GRACEFUL
new_leader_uuid: "41958dc5e81443978e08a337fbb255bc"
 from {username='slave'} at 127.0.0.1:50018
I20260709 12:14:37.293654   545 raft_consensus.cc:606] T 7661cfdd4178479ba812b94315dd21ab P f5d77cbf0f464436a88ee930055f8e05 [term 1 LEADER]: Received request to transfer leadership to TS 41958dc5e81443978e08a337fbb255bc
I20260709 12:14:37.298695   852 consensus_queue.cc:1048] T bccb6d19bc454739bd69c05e22938ca5 P f5d77cbf0f464436a88ee930055f8e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:37.301330   545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "adff2b2578704776809995fbb0a174b8"
dest_uuid: "f5d77cbf0f464436a88ee930055f8e05"
mode: GRACEFUL
new_leader_uuid: "41958dc5e81443978e08a337fbb255bc"
 from {username='slave'} at 127.0.0.1:50018
I20260709 12:14:37.301818   545 raft_consensus.cc:606] T adff2b2578704776809995fbb0a174b8 P f5d77cbf0f464436a88ee930055f8e05 [term 1 LEADER]: Received request to transfer leadership to TS 41958dc5e81443978e08a337fbb255bc
I20260709 12:14:37.311275   852 consensus_queue.cc:1048] T bccb6d19bc454739bd69c05e22938ca5 P f5d77cbf0f464436a88ee930055f8e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:37.312134   695 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72b3c830bc7346c5bcbb710b4c9cb9c0"
dest_uuid: "21975c12fc284bc18715d45d96e9e63a"
mode: GRACEFUL
new_leader_uuid: "41958dc5e81443978e08a337fbb255bc"
 from {username='slave'} at 127.0.0.1:38638
I20260709 12:14:37.312740   695 raft_consensus.cc:606] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a [term 1 LEADER]: Received request to transfer leadership to TS 41958dc5e81443978e08a337fbb255bc
I20260709 12:14:37.312651   851 consensus_queue.cc:1048] T c4938b6e0a5145449cf5658d192995d7 P 41958dc5e81443978e08a337fbb255bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:37.333581   782 raft_consensus.cc:993] T c4938b6e0a5145449cf5658d192995d7 P 41958dc5e81443978e08a337fbb255bc: : Instructing follower f5d77cbf0f464436a88ee930055f8e05 to start an election
I20260709 12:14:37.335233   782 raft_consensus.cc:1081] T c4938b6e0a5145449cf5658d192995d7 P 41958dc5e81443978e08a337fbb255bc [term 1 LEADER]: Signalling peer f5d77cbf0f464436a88ee930055f8e05 to start an election
I20260709 12:14:37.343796   545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4938b6e0a5145449cf5658d192995d7"
dest_uuid: "f5d77cbf0f464436a88ee930055f8e05"
 from {username='slave'} at 127.0.0.1:50002
I20260709 12:14:37.344550   545 raft_consensus.cc:493] T c4938b6e0a5145449cf5658d192995d7 P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:37.347342   782 consensus_queue.cc:1048] T c4938b6e0a5145449cf5658d192995d7 P 41958dc5e81443978e08a337fbb255bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:37.349449   545 raft_consensus.cc:3060] T c4938b6e0a5145449cf5658d192995d7 P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:37.357002   545 raft_consensus.cc:515] T c4938b6e0a5145449cf5658d192995d7 P f5d77cbf0f464436a88ee930055f8e05 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:37.359151   545 leader_election.cc:290] T c4938b6e0a5145449cf5658d192995d7 P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 2 election: Requested vote from peers 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883), 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559)
I20260709 12:14:37.360257   695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4938b6e0a5145449cf5658d192995d7" candidate_uuid: "f5d77cbf0f464436a88ee930055f8e05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21975c12fc284bc18715d45d96e9e63a"
I20260709 12:14:37.361024   695 raft_consensus.cc:3060] T c4938b6e0a5145449cf5658d192995d7 P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:37.360932   620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4938b6e0a5145449cf5658d192995d7" candidate_uuid: "f5d77cbf0f464436a88ee930055f8e05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41958dc5e81443978e08a337fbb255bc"
I20260709 12:14:37.361665   620 raft_consensus.cc:3055] T c4938b6e0a5145449cf5658d192995d7 P 41958dc5e81443978e08a337fbb255bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:37.361918   620 raft_consensus.cc:740] T c4938b6e0a5145449cf5658d192995d7 P 41958dc5e81443978e08a337fbb255bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 41958dc5e81443978e08a337fbb255bc, State: Running, Role: LEADER
I20260709 12:14:37.362650   620 consensus_queue.cc:260] T c4938b6e0a5145449cf5658d192995d7 P 41958dc5e81443978e08a337fbb255bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:37.363725   620 raft_consensus.cc:3060] T c4938b6e0a5145449cf5658d192995d7 P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:37.366441   695 raft_consensus.cc:2468] T c4938b6e0a5145449cf5658d192995d7 P 21975c12fc284bc18715d45d96e9e63a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d77cbf0f464436a88ee930055f8e05 in term 2.
I20260709 12:14:37.367496   511 leader_election.cc:304] T c4938b6e0a5145449cf5658d192995d7 P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21975c12fc284bc18715d45d96e9e63a, f5d77cbf0f464436a88ee930055f8e05; no voters: 
I20260709 12:14:37.368363   868 raft_consensus.cc:2804] T c4938b6e0a5145449cf5658d192995d7 P f5d77cbf0f464436a88ee930055f8e05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:37.368831   868 raft_consensus.cc:697] T c4938b6e0a5145449cf5658d192995d7 P f5d77cbf0f464436a88ee930055f8e05 [term 2 LEADER]: Becoming Leader. State: Replica: f5d77cbf0f464436a88ee930055f8e05, State: Running, Role: LEADER
I20260709 12:14:37.370078   620 raft_consensus.cc:2468] T c4938b6e0a5145449cf5658d192995d7 P 41958dc5e81443978e08a337fbb255bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d77cbf0f464436a88ee930055f8e05 in term 2.
I20260709 12:14:37.369724   868 consensus_queue.cc:237] T c4938b6e0a5145449cf5658d192995d7 P f5d77cbf0f464436a88ee930055f8e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:37.377506   442 catalog_manager.cc:5697] T c4938b6e0a5145449cf5658d192995d7 P f5d77cbf0f464436a88ee930055f8e05 reported cstate change: term changed from 1 to 2, leader changed from 41958dc5e81443978e08a337fbb255bc (127.20.196.130) to f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129). New cstate: current_term: 2 leader_uuid: "f5d77cbf0f464436a88ee930055f8e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:37.397598   868 consensus_queue.cc:1048] T 7661cfdd4178479ba812b94315dd21ab P f5d77cbf0f464436a88ee930055f8e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:37.401459   782 consensus_queue.cc:1048] T bc2db88da3264b91b1e8ec6ab9a0804e P 41958dc5e81443978e08a337fbb255bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:37.403954   852 raft_consensus.cc:993] T 7661cfdd4178479ba812b94315dd21ab P f5d77cbf0f464436a88ee930055f8e05: : Instructing follower 41958dc5e81443978e08a337fbb255bc to start an election
I20260709 12:14:37.404508   852 raft_consensus.cc:1081] T 7661cfdd4178479ba812b94315dd21ab P f5d77cbf0f464436a88ee930055f8e05 [term 1 LEADER]: Signalling peer 41958dc5e81443978e08a337fbb255bc to start an election
I20260709 12:14:37.408370   620 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7661cfdd4178479ba812b94315dd21ab"
dest_uuid: "41958dc5e81443978e08a337fbb255bc"
 from {username='slave'} at 127.0.0.1:33022
I20260709 12:14:37.408959   620 raft_consensus.cc:493] T 7661cfdd4178479ba812b94315dd21ab P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:37.409407   620 raft_consensus.cc:3060] T 7661cfdd4178479ba812b94315dd21ab P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:37.417394   852 consensus_queue.cc:1048] T 7661cfdd4178479ba812b94315dd21ab P f5d77cbf0f464436a88ee930055f8e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:37.423627   848 consensus_queue.cc:1048] T bc2db88da3264b91b1e8ec6ab9a0804e P 41958dc5e81443978e08a337fbb255bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:37.418368   620 raft_consensus.cc:515] T 7661cfdd4178479ba812b94315dd21ab P 41958dc5e81443978e08a337fbb255bc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:37.427786   620 leader_election.cc:290] T 7661cfdd4178479ba812b94315dd21ab P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 2 election: Requested vote from peers f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935), 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559)
I20260709 12:14:37.428728   545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7661cfdd4178479ba812b94315dd21ab" candidate_uuid: "41958dc5e81443978e08a337fbb255bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5d77cbf0f464436a88ee930055f8e05"
I20260709 12:14:37.429324   695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7661cfdd4178479ba812b94315dd21ab" candidate_uuid: "41958dc5e81443978e08a337fbb255bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21975c12fc284bc18715d45d96e9e63a"
I20260709 12:14:37.429551   545 raft_consensus.cc:3055] T 7661cfdd4178479ba812b94315dd21ab P f5d77cbf0f464436a88ee930055f8e05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:37.431264   545 raft_consensus.cc:740] T 7661cfdd4178479ba812b94315dd21ab P f5d77cbf0f464436a88ee930055f8e05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5d77cbf0f464436a88ee930055f8e05, State: Running, Role: LEADER
I20260709 12:14:37.432381   545 consensus_queue.cc:260] T 7661cfdd4178479ba812b94315dd21ab P f5d77cbf0f464436a88ee930055f8e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:37.434119   545 raft_consensus.cc:3060] T 7661cfdd4178479ba812b94315dd21ab P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:37.444428   545 raft_consensus.cc:2468] T 7661cfdd4178479ba812b94315dd21ab P f5d77cbf0f464436a88ee930055f8e05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41958dc5e81443978e08a337fbb255bc in term 2.
I20260709 12:14:37.445686   587 leader_election.cc:304] T 7661cfdd4178479ba812b94315dd21ab P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41958dc5e81443978e08a337fbb255bc, f5d77cbf0f464436a88ee930055f8e05; no voters: 21975c12fc284bc18715d45d96e9e63a
I20260709 12:14:37.446517   851 raft_consensus.cc:2804] T 7661cfdd4178479ba812b94315dd21ab P 41958dc5e81443978e08a337fbb255bc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:37.447062   851 raft_consensus.cc:697] T 7661cfdd4178479ba812b94315dd21ab P 41958dc5e81443978e08a337fbb255bc [term 2 LEADER]: Becoming Leader. State: Replica: 41958dc5e81443978e08a337fbb255bc, State: Running, Role: LEADER
I20260709 12:14:37.447966   851 consensus_queue.cc:237] T 7661cfdd4178479ba812b94315dd21ab P 41958dc5e81443978e08a337fbb255bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:37.457453   442 catalog_manager.cc:5697] T 7661cfdd4178479ba812b94315dd21ab P 41958dc5e81443978e08a337fbb255bc reported cstate change: term changed from 1 to 2, leader changed from f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129) to 41958dc5e81443978e08a337fbb255bc (127.20.196.130). New cstate: current_term: 2 leader_uuid: "41958dc5e81443978e08a337fbb255bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:37.511384   866 consensus_queue.cc:1048] T 4836044424874856b0db3ba4cdacaf74 P 21975c12fc284bc18715d45d96e9e63a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:37.515517   870 consensus_queue.cc:1048] T 4836044424874856b0db3ba4cdacaf74 P 21975c12fc284bc18715d45d96e9e63a [LEADER]: Connected to new peer: Peer: permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:37.518348   866 raft_consensus.cc:993] T 4836044424874856b0db3ba4cdacaf74 P 21975c12fc284bc18715d45d96e9e63a: : Instructing follower f5d77cbf0f464436a88ee930055f8e05 to start an election
I20260709 12:14:37.519193   870 raft_consensus.cc:1081] T 4836044424874856b0db3ba4cdacaf74 P 21975c12fc284bc18715d45d96e9e63a [term 1 LEADER]: Signalling peer f5d77cbf0f464436a88ee930055f8e05 to start an election
I20260709 12:14:37.528801   546 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4836044424874856b0db3ba4cdacaf74"
dest_uuid: "f5d77cbf0f464436a88ee930055f8e05"
 from {username='slave'} at 127.0.0.1:50008
I20260709 12:14:37.531155   546 raft_consensus.cc:493] T 4836044424874856b0db3ba4cdacaf74 P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:37.531757   546 raft_consensus.cc:3060] T 4836044424874856b0db3ba4cdacaf74 P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:37.539004   546 raft_consensus.cc:515] T 4836044424874856b0db3ba4cdacaf74 P f5d77cbf0f464436a88ee930055f8e05 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:37.549165   620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4836044424874856b0db3ba4cdacaf74" candidate_uuid: "f5d77cbf0f464436a88ee930055f8e05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41958dc5e81443978e08a337fbb255bc"
I20260709 12:14:37.549739   546 leader_election.cc:290] T 4836044424874856b0db3ba4cdacaf74 P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 2 election: Requested vote from peers 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883), 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559)
I20260709 12:14:37.550897   693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4836044424874856b0db3ba4cdacaf74" candidate_uuid: "f5d77cbf0f464436a88ee930055f8e05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21975c12fc284bc18715d45d96e9e63a"
I20260709 12:14:37.551862   693 raft_consensus.cc:3055] T 4836044424874856b0db3ba4cdacaf74 P 21975c12fc284bc18715d45d96e9e63a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:37.552183   693 raft_consensus.cc:740] T 4836044424874856b0db3ba4cdacaf74 P 21975c12fc284bc18715d45d96e9e63a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21975c12fc284bc18715d45d96e9e63a, State: Running, Role: LEADER
I20260709 12:14:37.549932   620 raft_consensus.cc:3060] T 4836044424874856b0db3ba4cdacaf74 P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:37.553018   693 consensus_queue.cc:260] T 4836044424874856b0db3ba4cdacaf74 P 21975c12fc284bc18715d45d96e9e63a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:37.554317   693 raft_consensus.cc:3060] T 4836044424874856b0db3ba4cdacaf74 P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:37.559234   620 raft_consensus.cc:2468] T 4836044424874856b0db3ba4cdacaf74 P 41958dc5e81443978e08a337fbb255bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d77cbf0f464436a88ee930055f8e05 in term 2.
I20260709 12:14:37.560272   511 leader_election.cc:304] T 4836044424874856b0db3ba4cdacaf74 P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41958dc5e81443978e08a337fbb255bc, f5d77cbf0f464436a88ee930055f8e05; no voters: 
I20260709 12:14:37.560977   852 raft_consensus.cc:2804] T 4836044424874856b0db3ba4cdacaf74 P f5d77cbf0f464436a88ee930055f8e05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:37.561187   693 raft_consensus.cc:2468] T 4836044424874856b0db3ba4cdacaf74 P 21975c12fc284bc18715d45d96e9e63a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d77cbf0f464436a88ee930055f8e05 in term 2.
I20260709 12:14:37.561534   852 raft_consensus.cc:697] T 4836044424874856b0db3ba4cdacaf74 P f5d77cbf0f464436a88ee930055f8e05 [term 2 LEADER]: Becoming Leader. State: Replica: f5d77cbf0f464436a88ee930055f8e05, State: Running, Role: LEADER
I20260709 12:14:37.562462   852 consensus_queue.cc:237] T 4836044424874856b0db3ba4cdacaf74 P f5d77cbf0f464436a88ee930055f8e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:37.569607   442 catalog_manager.cc:5697] T 4836044424874856b0db3ba4cdacaf74 P f5d77cbf0f464436a88ee930055f8e05 reported cstate change: term changed from 1 to 2, leader changed from 21975c12fc284bc18715d45d96e9e63a (127.20.196.131) to f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129). New cstate: current_term: 2 leader_uuid: "f5d77cbf0f464436a88ee930055f8e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:37.587006   851 raft_consensus.cc:993] T e4898429379b4b4880b522f22145f62a P 41958dc5e81443978e08a337fbb255bc: : Instructing follower f5d77cbf0f464436a88ee930055f8e05 to start an election
I20260709 12:14:37.587527   848 raft_consensus.cc:1081] T e4898429379b4b4880b522f22145f62a P 41958dc5e81443978e08a337fbb255bc [term 1 LEADER]: Signalling peer f5d77cbf0f464436a88ee930055f8e05 to start an election
I20260709 12:14:37.589063   545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4898429379b4b4880b522f22145f62a"
dest_uuid: "f5d77cbf0f464436a88ee930055f8e05"
 from {username='slave'} at 127.0.0.1:50002
I20260709 12:14:37.589552   545 raft_consensus.cc:493] T e4898429379b4b4880b522f22145f62a P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:37.589855   545 raft_consensus.cc:3060] T e4898429379b4b4880b522f22145f62a P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:37.594828   545 raft_consensus.cc:515] T e4898429379b4b4880b522f22145f62a P f5d77cbf0f464436a88ee930055f8e05 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:37.596870   545 leader_election.cc:290] T e4898429379b4b4880b522f22145f62a P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 2 election: Requested vote from peers 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883), 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559)
I20260709 12:14:37.597596   620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4898429379b4b4880b522f22145f62a" candidate_uuid: "f5d77cbf0f464436a88ee930055f8e05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41958dc5e81443978e08a337fbb255bc"
I20260709 12:14:37.598058   693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4898429379b4b4880b522f22145f62a" candidate_uuid: "f5d77cbf0f464436a88ee930055f8e05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21975c12fc284bc18715d45d96e9e63a"
I20260709 12:14:37.598368   620 raft_consensus.cc:3055] T e4898429379b4b4880b522f22145f62a P 41958dc5e81443978e08a337fbb255bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:37.598747   693 raft_consensus.cc:3060] T e4898429379b4b4880b522f22145f62a P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:37.598762   620 raft_consensus.cc:740] T e4898429379b4b4880b522f22145f62a P 41958dc5e81443978e08a337fbb255bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 41958dc5e81443978e08a337fbb255bc, State: Running, Role: LEADER
I20260709 12:14:37.599888   620 consensus_queue.cc:260] T e4898429379b4b4880b522f22145f62a P 41958dc5e81443978e08a337fbb255bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:37.600875   620 raft_consensus.cc:3060] T e4898429379b4b4880b522f22145f62a P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:37.605715   620 raft_consensus.cc:2468] T e4898429379b4b4880b522f22145f62a P 41958dc5e81443978e08a337fbb255bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d77cbf0f464436a88ee930055f8e05 in term 2.
I20260709 12:14:37.605710   693 raft_consensus.cc:2468] T e4898429379b4b4880b522f22145f62a P 21975c12fc284bc18715d45d96e9e63a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d77cbf0f464436a88ee930055f8e05 in term 2.
I20260709 12:14:37.606927   511 leader_election.cc:304] T e4898429379b4b4880b522f22145f62a P f5d77cbf0f464436a88ee930055f8e05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41958dc5e81443978e08a337fbb255bc, f5d77cbf0f464436a88ee930055f8e05; no voters: 
I20260709 12:14:37.607657   852 raft_consensus.cc:2804] T e4898429379b4b4880b522f22145f62a P f5d77cbf0f464436a88ee930055f8e05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:37.608108   852 raft_consensus.cc:697] T e4898429379b4b4880b522f22145f62a P f5d77cbf0f464436a88ee930055f8e05 [term 2 LEADER]: Becoming Leader. State: Replica: f5d77cbf0f464436a88ee930055f8e05, State: Running, Role: LEADER
I20260709 12:14:37.608784   852 consensus_queue.cc:237] T e4898429379b4b4880b522f22145f62a P f5d77cbf0f464436a88ee930055f8e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:37.612535   902 consensus_queue.cc:1048] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a [LEADER]: Connected to new peer: Peer: permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:37.617727   442 catalog_manager.cc:5697] T e4898429379b4b4880b522f22145f62a P f5d77cbf0f464436a88ee930055f8e05 reported cstate change: term changed from 1 to 2, leader changed from 41958dc5e81443978e08a337fbb255bc (127.20.196.130) to f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129). New cstate: current_term: 2 leader_uuid: "f5d77cbf0f464436a88ee930055f8e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:37.620532   870 raft_consensus.cc:993] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a: : Instructing follower 41958dc5e81443978e08a337fbb255bc to start an election
I20260709 12:14:37.621049   866 raft_consensus.cc:1081] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a [term 1 LEADER]: Signalling peer 41958dc5e81443978e08a337fbb255bc to start an election
I20260709 12:14:37.623665   622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "72b3c830bc7346c5bcbb710b4c9cb9c0"
dest_uuid: "41958dc5e81443978e08a337fbb255bc"
 from {username='slave'} at 127.0.0.1:33034
I20260709 12:14:37.624212   622 raft_consensus.cc:493] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:37.624527   622 raft_consensus.cc:3060] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:37.631222   902 consensus_queue.cc:1048] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:37.637290   622 raft_consensus.cc:515] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 41958dc5e81443978e08a337fbb255bc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:37.641785   870 consensus_queue.cc:1048] T 40970913ee644c928ddad5cbfacd6ed9 P 21975c12fc284bc18715d45d96e9e63a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:37.644380   545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b3c830bc7346c5bcbb710b4c9cb9c0" candidate_uuid: "41958dc5e81443978e08a337fbb255bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5d77cbf0f464436a88ee930055f8e05"
I20260709 12:14:37.644573   622 leader_election.cc:290] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 2 election: Requested vote from peers f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935), 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559)
I20260709 12:14:37.644755   693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b3c830bc7346c5bcbb710b4c9cb9c0" candidate_uuid: "41958dc5e81443978e08a337fbb255bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21975c12fc284bc18715d45d96e9e63a"
I20260709 12:14:37.645509   693 raft_consensus.cc:3055] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:37.645902   693 raft_consensus.cc:740] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21975c12fc284bc18715d45d96e9e63a, State: Running, Role: LEADER
I20260709 12:14:37.644981   545 raft_consensus.cc:3060] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:37.646956   693 consensus_queue.cc:260] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:37.648185   693 raft_consensus.cc:3060] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:37.653846   545 raft_consensus.cc:2468] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P f5d77cbf0f464436a88ee930055f8e05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41958dc5e81443978e08a337fbb255bc in term 2.
I20260709 12:14:37.655659   587 leader_election.cc:304] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41958dc5e81443978e08a337fbb255bc, f5d77cbf0f464436a88ee930055f8e05; no voters: 
I20260709 12:14:37.656847   848 raft_consensus.cc:2804] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 41958dc5e81443978e08a337fbb255bc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:37.657600   848 raft_consensus.cc:697] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 41958dc5e81443978e08a337fbb255bc [term 2 LEADER]: Becoming Leader. State: Replica: 41958dc5e81443978e08a337fbb255bc, State: Running, Role: LEADER
I20260709 12:14:37.658104   866 consensus_queue.cc:1048] T 40970913ee644c928ddad5cbfacd6ed9 P 21975c12fc284bc18715d45d96e9e63a [LEADER]: Connected to new peer: Peer: permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:37.658725   848 consensus_queue.cc:237] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 41958dc5e81443978e08a337fbb255bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:37.669636   444 catalog_manager.cc:5697] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 41958dc5e81443978e08a337fbb255bc reported cstate change: term changed from 1 to 2, leader changed from 21975c12fc284bc18715d45d96e9e63a (127.20.196.131) to 41958dc5e81443978e08a337fbb255bc (127.20.196.130). New cstate: current_term: 2 leader_uuid: "41958dc5e81443978e08a337fbb255bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:37.678783   693 raft_consensus.cc:2468] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41958dc5e81443978e08a337fbb255bc in term 2.
I20260709 12:14:37.725653   852 consensus_queue.cc:1048] T adff2b2578704776809995fbb0a174b8 P f5d77cbf0f464436a88ee930055f8e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:37.736270   852 consensus_queue.cc:1048] T adff2b2578704776809995fbb0a174b8 P f5d77cbf0f464436a88ee930055f8e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:14:37.747018   852 raft_consensus.cc:993] T adff2b2578704776809995fbb0a174b8 P f5d77cbf0f464436a88ee930055f8e05: : Instructing follower 41958dc5e81443978e08a337fbb255bc to start an election
I20260709 12:14:37.747479   868 raft_consensus.cc:1081] T adff2b2578704776809995fbb0a174b8 P f5d77cbf0f464436a88ee930055f8e05 [term 1 LEADER]: Signalling peer 41958dc5e81443978e08a337fbb255bc to start an election
I20260709 12:14:37.748970   622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "adff2b2578704776809995fbb0a174b8"
dest_uuid: "41958dc5e81443978e08a337fbb255bc"
 from {username='slave'} at 127.0.0.1:33022
I20260709 12:14:37.749598   622 raft_consensus.cc:493] T adff2b2578704776809995fbb0a174b8 P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:37.750066   622 raft_consensus.cc:3060] T adff2b2578704776809995fbb0a174b8 P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:37.755442   622 raft_consensus.cc:515] T adff2b2578704776809995fbb0a174b8 P 41958dc5e81443978e08a337fbb255bc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:37.757196   622 leader_election.cc:290] T adff2b2578704776809995fbb0a174b8 P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 2 election: Requested vote from peers f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935), 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559)
I20260709 12:14:37.758155   546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adff2b2578704776809995fbb0a174b8" candidate_uuid: "41958dc5e81443978e08a337fbb255bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5d77cbf0f464436a88ee930055f8e05"
I20260709 12:14:37.758416   693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adff2b2578704776809995fbb0a174b8" candidate_uuid: "41958dc5e81443978e08a337fbb255bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21975c12fc284bc18715d45d96e9e63a"
I20260709 12:14:37.758857   546 raft_consensus.cc:3055] T adff2b2578704776809995fbb0a174b8 P f5d77cbf0f464436a88ee930055f8e05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:37.759163   693 raft_consensus.cc:3060] T adff2b2578704776809995fbb0a174b8 P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:37.759318   546 raft_consensus.cc:740] T adff2b2578704776809995fbb0a174b8 P f5d77cbf0f464436a88ee930055f8e05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5d77cbf0f464436a88ee930055f8e05, State: Running, Role: LEADER
I20260709 12:14:37.760154   546 consensus_queue.cc:260] T adff2b2578704776809995fbb0a174b8 P f5d77cbf0f464436a88ee930055f8e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:37.761108   546 raft_consensus.cc:3060] T adff2b2578704776809995fbb0a174b8 P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:37.766292   693 raft_consensus.cc:2468] T adff2b2578704776809995fbb0a174b8 P 21975c12fc284bc18715d45d96e9e63a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41958dc5e81443978e08a337fbb255bc in term 2.
I20260709 12:14:37.766435   546 raft_consensus.cc:2468] T adff2b2578704776809995fbb0a174b8 P f5d77cbf0f464436a88ee930055f8e05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41958dc5e81443978e08a337fbb255bc in term 2.
I20260709 12:14:37.767529   586 leader_election.cc:304] T adff2b2578704776809995fbb0a174b8 P 41958dc5e81443978e08a337fbb255bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21975c12fc284bc18715d45d96e9e63a, 41958dc5e81443978e08a337fbb255bc; no voters: 
I20260709 12:14:37.768401   848 raft_consensus.cc:2804] T adff2b2578704776809995fbb0a174b8 P 41958dc5e81443978e08a337fbb255bc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:37.768865   848 raft_consensus.cc:697] T adff2b2578704776809995fbb0a174b8 P 41958dc5e81443978e08a337fbb255bc [term 2 LEADER]: Becoming Leader. State: Replica: 41958dc5e81443978e08a337fbb255bc, State: Running, Role: LEADER
I20260709 12:14:37.769672   848 consensus_queue.cc:237] T adff2b2578704776809995fbb0a174b8 P 41958dc5e81443978e08a337fbb255bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:37.776283   443 catalog_manager.cc:5697] T adff2b2578704776809995fbb0a174b8 P 41958dc5e81443978e08a337fbb255bc reported cstate change: term changed from 1 to 2, leader changed from f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129) to 41958dc5e81443978e08a337fbb255bc (127.20.196.130). New cstate: current_term: 2 leader_uuid: "41958dc5e81443978e08a337fbb255bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:37.892145   693 raft_consensus.cc:3060] T 7661cfdd4178479ba812b94315dd21ab P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:37.897449   693 raft_consensus.cc:1275] T 7661cfdd4178479ba812b94315dd21ab P 21975c12fc284bc18715d45d96e9e63a [term 2 FOLLOWER]: Refusing update from remote peer 41958dc5e81443978e08a337fbb255bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:37.898806   851 consensus_queue.cc:1048] T 7661cfdd4178479ba812b94315dd21ab P 41958dc5e81443978e08a337fbb255bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:37.909873   546 raft_consensus.cc:1275] T 7661cfdd4178479ba812b94315dd21ab P f5d77cbf0f464436a88ee930055f8e05 [term 2 FOLLOWER]: Refusing update from remote peer 41958dc5e81443978e08a337fbb255bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:37.911329   851 consensus_queue.cc:1048] T 7661cfdd4178479ba812b94315dd21ab P 41958dc5e81443978e08a337fbb255bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:37.918637   693 raft_consensus.cc:1275] T c4938b6e0a5145449cf5658d192995d7 P 21975c12fc284bc18715d45d96e9e63a [term 2 FOLLOWER]: Refusing update from remote peer f5d77cbf0f464436a88ee930055f8e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:37.920199   868 consensus_queue.cc:1048] T c4938b6e0a5145449cf5658d192995d7 P f5d77cbf0f464436a88ee930055f8e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:37.928884   622 raft_consensus.cc:1275] T c4938b6e0a5145449cf5658d192995d7 P 41958dc5e81443978e08a337fbb255bc [term 2 FOLLOWER]: Refusing update from remote peer f5d77cbf0f464436a88ee930055f8e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:37.930656   854 consensus_queue.cc:1048] T c4938b6e0a5145449cf5658d192995d7 P f5d77cbf0f464436a88ee930055f8e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:38.009783   622 raft_consensus.cc:1275] T 4836044424874856b0db3ba4cdacaf74 P 41958dc5e81443978e08a337fbb255bc [term 2 FOLLOWER]: Refusing update from remote peer f5d77cbf0f464436a88ee930055f8e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:38.011045   854 consensus_queue.cc:1048] T 4836044424874856b0db3ba4cdacaf74 P f5d77cbf0f464436a88ee930055f8e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:38.020004   693 raft_consensus.cc:1275] T 4836044424874856b0db3ba4cdacaf74 P 21975c12fc284bc18715d45d96e9e63a [term 2 FOLLOWER]: Refusing update from remote peer f5d77cbf0f464436a88ee930055f8e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:38.021488   854 consensus_queue.cc:1048] T 4836044424874856b0db3ba4cdacaf74 P f5d77cbf0f464436a88ee930055f8e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:38.041013   693 raft_consensus.cc:1275] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a [term 2 FOLLOWER]: Refusing update from remote peer 41958dc5e81443978e08a337fbb255bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:38.042171   851 consensus_queue.cc:1048] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 41958dc5e81443978e08a337fbb255bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:38.051623   546 raft_consensus.cc:1275] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P f5d77cbf0f464436a88ee930055f8e05 [term 2 FOLLOWER]: Refusing update from remote peer 41958dc5e81443978e08a337fbb255bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:38.052965   851 consensus_queue.cc:1048] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 41958dc5e81443978e08a337fbb255bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:38.076443   693 raft_consensus.cc:1275] T e4898429379b4b4880b522f22145f62a P 21975c12fc284bc18715d45d96e9e63a [term 2 FOLLOWER]: Refusing update from remote peer f5d77cbf0f464436a88ee930055f8e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:38.077620   854 consensus_queue.cc:1048] T e4898429379b4b4880b522f22145f62a P f5d77cbf0f464436a88ee930055f8e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:38.085316   622 raft_consensus.cc:1275] T e4898429379b4b4880b522f22145f62a P 41958dc5e81443978e08a337fbb255bc [term 2 FOLLOWER]: Refusing update from remote peer f5d77cbf0f464436a88ee930055f8e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:38.087674   854 consensus_queue.cc:1048] T e4898429379b4b4880b522f22145f62a P f5d77cbf0f464436a88ee930055f8e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:38.171376   693 raft_consensus.cc:1275] T adff2b2578704776809995fbb0a174b8 P 21975c12fc284bc18715d45d96e9e63a [term 2 FOLLOWER]: Refusing update from remote peer 41958dc5e81443978e08a337fbb255bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:38.172601   851 consensus_queue.cc:1048] T adff2b2578704776809995fbb0a174b8 P 41958dc5e81443978e08a337fbb255bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:38.180186   546 raft_consensus.cc:1275] T adff2b2578704776809995fbb0a174b8 P f5d77cbf0f464436a88ee930055f8e05 [term 2 FOLLOWER]: Refusing update from remote peer 41958dc5e81443978e08a337fbb255bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:38.182090   851 consensus_queue.cc:1048] T adff2b2578704776809995fbb0a174b8 P 41958dc5e81443978e08a337fbb255bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:40.325884   444 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45798:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:14:40.345896   444 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45798:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:14:40.390681 21266 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:14:40.559630   947 tablet.cc:1724] T c4938b6e0a5145449cf5658d192995d7 P f5d77cbf0f464436a88ee930055f8e05: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:40.571642   951 tablet.cc:1724] T c4938b6e0a5145449cf5658d192995d7 P 21975c12fc284bc18715d45d96e9e63a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:40.580837   961 tablet.cc:1724] T e4898429379b4b4880b522f22145f62a P 21975c12fc284bc18715d45d96e9e63a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:14:40.609740   573 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:c4938b6e0a5145449cf5658d192995d7)
I20260709 12:14:40.625510   618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72b3c830bc7346c5bcbb710b4c9cb9c0"
dest_uuid: "41958dc5e81443978e08a337fbb255bc"
mode: GRACEFUL
new_leader_uuid: "21975c12fc284bc18715d45d96e9e63a"
 from {username='slave'} at 127.0.0.1:56226
I20260709 12:14:40.626273   618 raft_consensus.cc:606] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 41958dc5e81443978e08a337fbb255bc [term 2 LEADER]: Received request to transfer leadership to TS 21975c12fc284bc18715d45d96e9e63a
W20260709 12:14:40.655859   573 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:c4938b6e0a5145449cf5658d192995d7)
W20260709 12:14:40.659057   573 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:c4938b6e0a5145449cf5658d192995d7)
W20260709 12:14:40.683132   964 log.cc:927] Time spent T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:14:40.647231   960 tablet.cc:1724] T e4898429379b4b4880b522f22145f62a P f5d77cbf0f464436a88ee930055f8e05: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:40.699443   947 tablet.cc:1724] T bccb6d19bc454739bd69c05e22938ca5 P f5d77cbf0f464436a88ee930055f8e05: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:14:40.704435   958 log.cc:927] Time spent T 7661cfdd4178479ba812b94315dd21ab P f5d77cbf0f464436a88ee930055f8e05: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:14:40.721650   976 tablet.cc:1724] T adff2b2578704776809995fbb0a174b8 P 41958dc5e81443978e08a337fbb255bc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:40.721863   977 tablet.cc:1724] T bc2db88da3264b91b1e8ec6ab9a0804e P 21975c12fc284bc18715d45d96e9e63a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:40.718736   972 tablet.cc:1724] T bc2db88da3264b91b1e8ec6ab9a0804e P 41958dc5e81443978e08a337fbb255bc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:40.719220   969 tablet.cc:1724] T 4836044424874856b0db3ba4cdacaf74 P f5d77cbf0f464436a88ee930055f8e05: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:40.743158   970 tablet.cc:1724] T bc2db88da3264b91b1e8ec6ab9a0804e P f5d77cbf0f464436a88ee930055f8e05: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:40.745699   961 tablet.cc:1724] T 4836044424874856b0db3ba4cdacaf74 P 21975c12fc284bc18715d45d96e9e63a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:40.750207   957 raft_consensus.cc:993] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 41958dc5e81443978e08a337fbb255bc: : Instructing follower 21975c12fc284bc18715d45d96e9e63a to start an election
I20260709 12:14:40.750826   957 raft_consensus.cc:1081] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 41958dc5e81443978e08a337fbb255bc [term 2 LEADER]: Signalling peer 21975c12fc284bc18715d45d96e9e63a to start an election
I20260709 12:14:40.761729   694 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "72b3c830bc7346c5bcbb710b4c9cb9c0"
dest_uuid: "21975c12fc284bc18715d45d96e9e63a"
 from {username='slave'} at 127.0.0.1:38614
I20260709 12:14:40.743831   951 tablet.cc:1724] T bccb6d19bc454739bd69c05e22938ca5 P 21975c12fc284bc18715d45d96e9e63a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:40.762436   694 raft_consensus.cc:493] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:40.762902   694 raft_consensus.cc:3060] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:40.762079   974 tablet.cc:1724] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 41958dc5e81443978e08a337fbb255bc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:40.776821   947 tablet.cc:1724] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P f5d77cbf0f464436a88ee930055f8e05: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:40.794155   694 raft_consensus.cc:515] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:40.801375   694 leader_election.cc:290] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 3 election: Requested vote from peers f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935), 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883)
I20260709 12:14:40.802189   546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b3c830bc7346c5bcbb710b4c9cb9c0" candidate_uuid: "21975c12fc284bc18715d45d96e9e63a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "f5d77cbf0f464436a88ee930055f8e05"
I20260709 12:14:40.802033   978 tablet.cc:1724] T adff2b2578704776809995fbb0a174b8 P 21975c12fc284bc18715d45d96e9e63a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:40.807549   618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b3c830bc7346c5bcbb710b4c9cb9c0" candidate_uuid: "21975c12fc284bc18715d45d96e9e63a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "41958dc5e81443978e08a337fbb255bc"
I20260709 12:14:40.820988   546 raft_consensus.cc:3060] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P f5d77cbf0f464436a88ee930055f8e05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:40.822178   618 raft_consensus.cc:3055] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 41958dc5e81443978e08a337fbb255bc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:40.822733   618 raft_consensus.cc:740] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 41958dc5e81443978e08a337fbb255bc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 41958dc5e81443978e08a337fbb255bc, State: Running, Role: LEADER
I20260709 12:14:40.823559   618 consensus_queue.cc:260] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 41958dc5e81443978e08a337fbb255bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:40.824692   618 raft_consensus.cc:3060] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 41958dc5e81443978e08a337fbb255bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:40.838893   983 tablet.cc:1724] T 7661cfdd4178479ba812b94315dd21ab P 41958dc5e81443978e08a337fbb255bc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:40.848547   546 raft_consensus.cc:2468] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P f5d77cbf0f464436a88ee930055f8e05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21975c12fc284bc18715d45d96e9e63a in term 3.
I20260709 12:14:40.849561   618 raft_consensus.cc:2468] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 41958dc5e81443978e08a337fbb255bc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21975c12fc284bc18715d45d96e9e63a in term 3.
I20260709 12:14:40.850966   660 leader_election.cc:304] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21975c12fc284bc18715d45d96e9e63a, 41958dc5e81443978e08a337fbb255bc; no voters: 
I20260709 12:14:40.854362   912 raft_consensus.cc:2804] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:40.858189   912 raft_consensus.cc:697] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a [term 3 LEADER]: Becoming Leader. State: Replica: 21975c12fc284bc18715d45d96e9e63a, State: Running, Role: LEADER
I20260709 12:14:40.850104   961 tablet.cc:1724] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:40.861922   912 consensus_queue.cc:237] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:40.863461   972 tablet.cc:1724] T 40970913ee644c928ddad5cbfacd6ed9 P 41958dc5e81443978e08a337fbb255bc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:40.873940   969 tablet.cc:1724] T adff2b2578704776809995fbb0a174b8 P f5d77cbf0f464436a88ee930055f8e05: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:40.874886   961 tablet.cc:1724] T 7661cfdd4178479ba812b94315dd21ab P 21975c12fc284bc18715d45d96e9e63a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:40.901849   444 catalog_manager.cc:5697] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a reported cstate change: term changed from 2 to 3, leader changed from 41958dc5e81443978e08a337fbb255bc (127.20.196.130) to 21975c12fc284bc18715d45d96e9e63a (127.20.196.131). New cstate: current_term: 3 leader_uuid: "21975c12fc284bc18715d45d96e9e63a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:40.879172   976 tablet.cc:1724] T c4938b6e0a5145449cf5658d192995d7 P 41958dc5e81443978e08a337fbb255bc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:40.884220   974 tablet.cc:1724] T bccb6d19bc454739bd69c05e22938ca5 P 41958dc5e81443978e08a337fbb255bc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:40.885973   947 tablet.cc:1724] T 7661cfdd4178479ba812b94315dd21ab P f5d77cbf0f464436a88ee930055f8e05: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:40.887526   960 tablet.cc:1724] T 40970913ee644c928ddad5cbfacd6ed9 P f5d77cbf0f464436a88ee930055f8e05: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:40.888721   972 tablet.cc:1724] T 4836044424874856b0db3ba4cdacaf74 P 41958dc5e81443978e08a337fbb255bc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:40.888638   951 tablet.cc:1724] T 40970913ee644c928ddad5cbfacd6ed9 P 21975c12fc284bc18715d45d96e9e63a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:40.916311   546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4938b6e0a5145449cf5658d192995d7"
dest_uuid: "f5d77cbf0f464436a88ee930055f8e05"
mode: GRACEFUL
new_leader_uuid: "21975c12fc284bc18715d45d96e9e63a"
 from {username='slave'} at 127.0.0.1:35426
I20260709 12:14:40.917008   546 raft_consensus.cc:606] T c4938b6e0a5145449cf5658d192995d7 P f5d77cbf0f464436a88ee930055f8e05 [term 2 LEADER]: Received request to transfer leadership to TS 21975c12fc284bc18715d45d96e9e63a
I20260709 12:14:40.898839   983 tablet.cc:1724] T e4898429379b4b4880b522f22145f62a P 41958dc5e81443978e08a337fbb255bc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:40.924724 21266 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:14:40.925427 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:40.933924   444 catalog_manager.cc:5789] TS 21975c12fc284bc18715d45d96e9e63a (127.20.196.131:37559) does not have the latest schema for tablet 72b3c830bc7346c5bcbb710b4c9cb9c0 (table soft_deleted_table [id=a1a1a413f4ef4acda055ef8a18dc12d8]). Expected version 1 got 0
I20260709 12:14:40.939008   546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0595bc4b26de41a097a82c178a1df812"
dest_uuid: "f5d77cbf0f464436a88ee930055f8e05"
mode: GRACEFUL
new_leader_uuid: "21975c12fc284bc18715d45d96e9e63a"
 from {username='slave'} at 127.0.0.1:35426
I20260709 12:14:40.939616   546 raft_consensus.cc:606] T 0595bc4b26de41a097a82c178a1df812 P f5d77cbf0f464436a88ee930055f8e05 [term 2 LEADER]: Received request to transfer leadership to TS 21975c12fc284bc18715d45d96e9e63a
I20260709 12:14:40.952412   618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07cbfec7b89b48f4bdc040734e73e4d7"
dest_uuid: "41958dc5e81443978e08a337fbb255bc"
mode: GRACEFUL
new_leader_uuid: "21975c12fc284bc18715d45d96e9e63a"
 from {username='slave'} at 127.0.0.1:56226
I20260709 12:14:40.953037   618 raft_consensus.cc:606] T 07cbfec7b89b48f4bdc040734e73e4d7 P 41958dc5e81443978e08a337fbb255bc [term 2 LEADER]: Received request to transfer leadership to TS 21975c12fc284bc18715d45d96e9e63a
I20260709 12:14:40.953948   946 raft_consensus.cc:993] T c4938b6e0a5145449cf5658d192995d7 P f5d77cbf0f464436a88ee930055f8e05: : Instructing follower 21975c12fc284bc18715d45d96e9e63a to start an election
I20260709 12:14:40.954818   946 raft_consensus.cc:1081] T c4938b6e0a5145449cf5658d192995d7 P f5d77cbf0f464436a88ee930055f8e05 [term 2 LEADER]: Signalling peer 21975c12fc284bc18715d45d96e9e63a to start an election
I20260709 12:14:40.954962 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:14:40.955704 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:40.956609   694 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4938b6e0a5145449cf5658d192995d7"
dest_uuid: "21975c12fc284bc18715d45d96e9e63a"
 from {username='slave'} at 127.0.0.1:38628
I20260709 12:14:40.957188   694 raft_consensus.cc:493] T c4938b6e0a5145449cf5658d192995d7 P 21975c12fc284bc18715d45d96e9e63a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:40.957491   694 raft_consensus.cc:3060] T c4938b6e0a5145449cf5658d192995d7 P 21975c12fc284bc18715d45d96e9e63a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:40.965258   694 raft_consensus.cc:515] T c4938b6e0a5145449cf5658d192995d7 P 21975c12fc284bc18715d45d96e9e63a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:40.967919   546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4938b6e0a5145449cf5658d192995d7" candidate_uuid: "21975c12fc284bc18715d45d96e9e63a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "f5d77cbf0f464436a88ee930055f8e05"
I20260709 12:14:40.967939   694 leader_election.cc:290] T c4938b6e0a5145449cf5658d192995d7 P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 3 election: Requested vote from peers f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935), 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883)
I20260709 12:14:40.968166   618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4938b6e0a5145449cf5658d192995d7" candidate_uuid: "21975c12fc284bc18715d45d96e9e63a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "41958dc5e81443978e08a337fbb255bc"
I20260709 12:14:40.968560   546 raft_consensus.cc:3055] T c4938b6e0a5145449cf5658d192995d7 P f5d77cbf0f464436a88ee930055f8e05 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:40.968804   618 raft_consensus.cc:3060] T c4938b6e0a5145449cf5658d192995d7 P 41958dc5e81443978e08a337fbb255bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:40.968989   546 raft_consensus.cc:740] T c4938b6e0a5145449cf5658d192995d7 P f5d77cbf0f464436a88ee930055f8e05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5d77cbf0f464436a88ee930055f8e05, State: Running, Role: LEADER
I20260709 12:14:40.969913   546 consensus_queue.cc:260] T c4938b6e0a5145449cf5658d192995d7 P f5d77cbf0f464436a88ee930055f8e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:40.971203   546 raft_consensus.cc:3060] T c4938b6e0a5145449cf5658d192995d7 P f5d77cbf0f464436a88ee930055f8e05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:40.982213   546 raft_consensus.cc:2468] T c4938b6e0a5145449cf5658d192995d7 P f5d77cbf0f464436a88ee930055f8e05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21975c12fc284bc18715d45d96e9e63a in term 3.
I20260709 12:14:40.971279   443 catalog_manager.cc:6242] T 00000000000000000000000000000000 P da06e69c54bd4e21a51d544b95bbb1aa: soft_deleted_table [id=a1a1a413f4ef4acda055ef8a18dc12d8] alter complete (version 1)
I20260709 12:14:40.983494   661 leader_election.cc:304] T c4938b6e0a5145449cf5658d192995d7 P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21975c12fc284bc18715d45d96e9e63a, f5d77cbf0f464436a88ee930055f8e05; no voters: 
I20260709 12:14:40.984373   912 raft_consensus.cc:2804] T c4938b6e0a5145449cf5658d192995d7 P 21975c12fc284bc18715d45d96e9e63a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:40.984841   912 raft_consensus.cc:697] T c4938b6e0a5145449cf5658d192995d7 P 21975c12fc284bc18715d45d96e9e63a [term 3 LEADER]: Becoming Leader. State: Replica: 21975c12fc284bc18715d45d96e9e63a, State: Running, Role: LEADER
I20260709 12:14:40.985639   912 consensus_queue.cc:237] T c4938b6e0a5145449cf5658d192995d7 P 21975c12fc284bc18715d45d96e9e63a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:40.986249   618 raft_consensus.cc:2468] T c4938b6e0a5145449cf5658d192995d7 P 41958dc5e81443978e08a337fbb255bc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21975c12fc284bc18715d45d96e9e63a in term 3.
I20260709 12:14:40.999421   443 catalog_manager.cc:5697] T c4938b6e0a5145449cf5658d192995d7 P 21975c12fc284bc18715d45d96e9e63a reported cstate change: term changed from 2 to 3, leader changed from f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129) to 21975c12fc284bc18715d45d96e9e63a (127.20.196.131). New cstate: current_term: 3 leader_uuid: "21975c12fc284bc18715d45d96e9e63a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:41.024349   868 raft_consensus.cc:993] T 0595bc4b26de41a097a82c178a1df812 P f5d77cbf0f464436a88ee930055f8e05: : Instructing follower 21975c12fc284bc18715d45d96e9e63a to start an election
I20260709 12:14:41.024775   946 raft_consensus.cc:1081] T 0595bc4b26de41a097a82c178a1df812 P f5d77cbf0f464436a88ee930055f8e05 [term 2 LEADER]: Signalling peer 21975c12fc284bc18715d45d96e9e63a to start an election
I20260709 12:14:41.026141   694 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0595bc4b26de41a097a82c178a1df812"
dest_uuid: "21975c12fc284bc18715d45d96e9e63a"
 from {username='slave'} at 127.0.0.1:38628
I20260709 12:14:41.026561   694 raft_consensus.cc:493] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:41.026866   694 raft_consensus.cc:3060] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:41.032073   694 raft_consensus.cc:515] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:41.034227   694 leader_election.cc:290] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 3 election: Requested vote from peers f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935), 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883)
I20260709 12:14:41.034466   546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0595bc4b26de41a097a82c178a1df812" candidate_uuid: "21975c12fc284bc18715d45d96e9e63a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f5d77cbf0f464436a88ee930055f8e05"
I20260709 12:14:41.034900   618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0595bc4b26de41a097a82c178a1df812" candidate_uuid: "21975c12fc284bc18715d45d96e9e63a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "41958dc5e81443978e08a337fbb255bc"
I20260709 12:14:41.035161   546 raft_consensus.cc:3055] T 0595bc4b26de41a097a82c178a1df812 P f5d77cbf0f464436a88ee930055f8e05 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:41.035647   546 raft_consensus.cc:740] T 0595bc4b26de41a097a82c178a1df812 P f5d77cbf0f464436a88ee930055f8e05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5d77cbf0f464436a88ee930055f8e05, State: Running, Role: LEADER
I20260709 12:14:41.035723   618 raft_consensus.cc:3060] T 0595bc4b26de41a097a82c178a1df812 P 41958dc5e81443978e08a337fbb255bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:41.036429   546 consensus_queue.cc:260] T 0595bc4b26de41a097a82c178a1df812 P f5d77cbf0f464436a88ee930055f8e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:41.037495   546 raft_consensus.cc:3060] T 0595bc4b26de41a097a82c178a1df812 P f5d77cbf0f464436a88ee930055f8e05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:41.041021   618 raft_consensus.cc:2468] T 0595bc4b26de41a097a82c178a1df812 P 41958dc5e81443978e08a337fbb255bc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21975c12fc284bc18715d45d96e9e63a in term 3.
I20260709 12:14:41.042172   660 leader_election.cc:304] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21975c12fc284bc18715d45d96e9e63a, 41958dc5e81443978e08a337fbb255bc; no voters: 
I20260709 12:14:41.043025   912 raft_consensus.cc:2804] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:41.043126   546 raft_consensus.cc:2468] T 0595bc4b26de41a097a82c178a1df812 P f5d77cbf0f464436a88ee930055f8e05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21975c12fc284bc18715d45d96e9e63a in term 3.
I20260709 12:14:41.043563   912 raft_consensus.cc:697] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a [term 3 LEADER]: Becoming Leader. State: Replica: 21975c12fc284bc18715d45d96e9e63a, State: Running, Role: LEADER
I20260709 12:14:41.044396   912 consensus_queue.cc:237] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:41.051488   443 catalog_manager.cc:5697] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a reported cstate change: term changed from 2 to 3, leader changed from f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129) to 21975c12fc284bc18715d45d96e9e63a (127.20.196.131). New cstate: current_term: 3 leader_uuid: "21975c12fc284bc18715d45d96e9e63a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:41.375784   989 raft_consensus.cc:993] T 07cbfec7b89b48f4bdc040734e73e4d7 P 41958dc5e81443978e08a337fbb255bc: : Instructing follower 21975c12fc284bc18715d45d96e9e63a to start an election
I20260709 12:14:41.376310   948 raft_consensus.cc:1081] T 07cbfec7b89b48f4bdc040734e73e4d7 P 41958dc5e81443978e08a337fbb255bc [term 2 LEADER]: Signalling peer 21975c12fc284bc18715d45d96e9e63a to start an election
I20260709 12:14:41.377928   694 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07cbfec7b89b48f4bdc040734e73e4d7"
dest_uuid: "21975c12fc284bc18715d45d96e9e63a"
 from {username='slave'} at 127.0.0.1:38614
I20260709 12:14:41.378428   694 raft_consensus.cc:493] T 07cbfec7b89b48f4bdc040734e73e4d7 P 21975c12fc284bc18715d45d96e9e63a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:41.378731   694 raft_consensus.cc:3060] T 07cbfec7b89b48f4bdc040734e73e4d7 P 21975c12fc284bc18715d45d96e9e63a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:41.383669   694 raft_consensus.cc:515] T 07cbfec7b89b48f4bdc040734e73e4d7 P 21975c12fc284bc18715d45d96e9e63a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:41.385200   694 leader_election.cc:290] T 07cbfec7b89b48f4bdc040734e73e4d7 P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 3 election: Requested vote from peers f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935), 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883)
I20260709 12:14:41.385967   546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07cbfec7b89b48f4bdc040734e73e4d7" candidate_uuid: "21975c12fc284bc18715d45d96e9e63a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f5d77cbf0f464436a88ee930055f8e05"
I20260709 12:14:41.386226   618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07cbfec7b89b48f4bdc040734e73e4d7" candidate_uuid: "21975c12fc284bc18715d45d96e9e63a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "41958dc5e81443978e08a337fbb255bc"
I20260709 12:14:41.386547   546 raft_consensus.cc:3060] T 07cbfec7b89b48f4bdc040734e73e4d7 P f5d77cbf0f464436a88ee930055f8e05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:41.386831   618 raft_consensus.cc:3055] T 07cbfec7b89b48f4bdc040734e73e4d7 P 41958dc5e81443978e08a337fbb255bc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:41.387177   618 raft_consensus.cc:740] T 07cbfec7b89b48f4bdc040734e73e4d7 P 41958dc5e81443978e08a337fbb255bc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 41958dc5e81443978e08a337fbb255bc, State: Running, Role: LEADER
I20260709 12:14:41.387898   618 consensus_queue.cc:260] T 07cbfec7b89b48f4bdc040734e73e4d7 P 41958dc5e81443978e08a337fbb255bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:41.388947   618 raft_consensus.cc:3060] T 07cbfec7b89b48f4bdc040734e73e4d7 P 41958dc5e81443978e08a337fbb255bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:41.392035   546 raft_consensus.cc:2468] T 07cbfec7b89b48f4bdc040734e73e4d7 P f5d77cbf0f464436a88ee930055f8e05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21975c12fc284bc18715d45d96e9e63a in term 3.
I20260709 12:14:41.393093   661 leader_election.cc:304] T 07cbfec7b89b48f4bdc040734e73e4d7 P 21975c12fc284bc18715d45d96e9e63a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21975c12fc284bc18715d45d96e9e63a, f5d77cbf0f464436a88ee930055f8e05; no voters: 
I20260709 12:14:41.393895   912 raft_consensus.cc:2804] T 07cbfec7b89b48f4bdc040734e73e4d7 P 21975c12fc284bc18715d45d96e9e63a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:41.394279   912 raft_consensus.cc:697] T 07cbfec7b89b48f4bdc040734e73e4d7 P 21975c12fc284bc18715d45d96e9e63a [term 3 LEADER]: Becoming Leader. State: Replica: 21975c12fc284bc18715d45d96e9e63a, State: Running, Role: LEADER
I20260709 12:14:41.395071   912 consensus_queue.cc:237] T 07cbfec7b89b48f4bdc040734e73e4d7 P 21975c12fc284bc18715d45d96e9e63a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } }
I20260709 12:14:41.395378   618 raft_consensus.cc:2468] T 07cbfec7b89b48f4bdc040734e73e4d7 P 41958dc5e81443978e08a337fbb255bc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21975c12fc284bc18715d45d96e9e63a in term 3.
I20260709 12:14:41.402140   443 catalog_manager.cc:5697] T 07cbfec7b89b48f4bdc040734e73e4d7 P 21975c12fc284bc18715d45d96e9e63a reported cstate change: term changed from 2 to 3, leader changed from 41958dc5e81443978e08a337fbb255bc (127.20.196.130) to 21975c12fc284bc18715d45d96e9e63a (127.20.196.131). New cstate: current_term: 3 leader_uuid: "21975c12fc284bc18715d45d96e9e63a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21975c12fc284bc18715d45d96e9e63a" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 37559 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:41.419342   618 raft_consensus.cc:1275] T c4938b6e0a5145449cf5658d192995d7 P 41958dc5e81443978e08a337fbb255bc [term 3 FOLLOWER]: Refusing update from remote peer 21975c12fc284bc18715d45d96e9e63a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:14:41.420629   912 consensus_queue.cc:1048] T c4938b6e0a5145449cf5658d192995d7 P 21975c12fc284bc18715d45d96e9e63a [LEADER]: Connected to new peer: Peer: permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:41.432137   547 raft_consensus.cc:1275] T c4938b6e0a5145449cf5658d192995d7 P f5d77cbf0f464436a88ee930055f8e05 [term 3 FOLLOWER]: Refusing update from remote peer 21975c12fc284bc18715d45d96e9e63a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:14:41.434013   912 consensus_queue.cc:1048] T c4938b6e0a5145449cf5658d192995d7 P 21975c12fc284bc18715d45d96e9e63a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:41.451906   618 raft_consensus.cc:1275] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 41958dc5e81443978e08a337fbb255bc [term 3 FOLLOWER]: Refusing update from remote peer 21975c12fc284bc18715d45d96e9e63a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:14:41.453245   992 consensus_queue.cc:1048] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a [LEADER]: Connected to new peer: Peer: permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:41.464159   547 raft_consensus.cc:1275] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P f5d77cbf0f464436a88ee930055f8e05 [term 3 FOLLOWER]: Refusing update from remote peer 21975c12fc284bc18715d45d96e9e63a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:14:41.465615   992 consensus_queue.cc:1048] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:41.503685   618 raft_consensus.cc:1275] T 0595bc4b26de41a097a82c178a1df812 P 41958dc5e81443978e08a337fbb255bc [term 3 FOLLOWER]: Refusing update from remote peer 21975c12fc284bc18715d45d96e9e63a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:41.505020   992 consensus_queue.cc:1048] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a [LEADER]: Connected to new peer: Peer: permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:41.513301   547 raft_consensus.cc:1275] T 0595bc4b26de41a097a82c178a1df812 P f5d77cbf0f464436a88ee930055f8e05 [term 3 FOLLOWER]: Refusing update from remote peer 21975c12fc284bc18715d45d96e9e63a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:41.514678   993 consensus_queue.cc:1048] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:41.954908   618 raft_consensus.cc:1275] T 07cbfec7b89b48f4bdc040734e73e4d7 P 41958dc5e81443978e08a337fbb255bc [term 3 FOLLOWER]: Refusing update from remote peer 21975c12fc284bc18715d45d96e9e63a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:41.956207   993 consensus_queue.cc:1048] T 07cbfec7b89b48f4bdc040734e73e4d7 P 21975c12fc284bc18715d45d96e9e63a [LEADER]: Connected to new peer: Peer: permanent_uuid: "41958dc5e81443978e08a337fbb255bc" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 34883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:41.956924 21266 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:14:41.965969   547 raft_consensus.cc:1275] T 07cbfec7b89b48f4bdc040734e73e4d7 P f5d77cbf0f464436a88ee930055f8e05 [term 3 FOLLOWER]: Refusing update from remote peer 21975c12fc284bc18715d45d96e9e63a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:41.967407   973 consensus_queue.cc:1048] T 07cbfec7b89b48f4bdc040734e73e4d7 P 21975c12fc284bc18715d45d96e9e63a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d77cbf0f464436a88ee930055f8e05" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 38935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:41.972914 21266 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:14:41.973815 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:41.986959 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:41.987643 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:42.988670 21266 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:14:42.994758 21266 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:14:42.995217 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:43.000818 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:43.002352 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:44.003587 21266 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:14:44.012560 21266 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:14:44.013146 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:44.018966 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:44.019484 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:45.020901 21266 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:14:45.032778 21266 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:14:45.033313 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:45.040123 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:45.040508 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:46.041592 21266 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:14:46.047011 21266 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:14:46.047572 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:46.053439 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:46.053773 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:47.054730 21266 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:14:47.060341 21266 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:14:47.060745 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:47.065572 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:47.065961 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:48.067034 21266 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:14:48.073057 21266 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:14:48.073635 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:48.079707 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:48.080036 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:49.081063 21266 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:14:49.086587 21266 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:14:49.087158 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:49.092285 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:49.092686 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:50.375830 21266 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:14:50.381335 21266 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:14:50.381858 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:50.387455 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:50.387815 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:14:51.246270   717 debug-util.cc:398] Leaking SignalData structure 0x7b080011a9a0 after lost signal to thread 21269
W20260709 12:14:51.247922   717 debug-util.cc:398] Leaking SignalData structure 0x7b08002d76c0 after lost signal to thread 479
W20260709 12:14:51.249192   717 debug-util.cc:398] Leaking SignalData structure 0x7b0800389920 after lost signal to thread 571
W20260709 12:14:51.250713   717 debug-util.cc:398] Leaking SignalData structure 0x7b08002edda0 after lost signal to thread 646
W20260709 12:14:51.251883   717 debug-util.cc:398] Leaking SignalData structure 0x7b0800171e40 after lost signal to thread 720
I20260709 12:14:51.448130 21266 tablet_server.cc:179] TabletServer@127.20.196.129:0 shutting down...
W20260709 12:14:51.477010   661 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 9 similar messages]
W20260709 12:14:51.480826   661 consensus_peers.cc:597] T 07cbfec7b89b48f4bdc040734e73e4d7 P 21975c12fc284bc18715d45d96e9e63a -> Peer f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935): Couldn't send request to peer f5d77cbf0f464436a88ee930055f8e05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:51.498966 21266 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:51.500167 21266 tablet_replica.cc:333] T 40970913ee644c928ddad5cbfacd6ed9 P f5d77cbf0f464436a88ee930055f8e05: stopping tablet replica
I20260709 12:14:51.501610 21266 raft_consensus.cc:2243] T 40970913ee644c928ddad5cbfacd6ed9 P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.502677 21266 raft_consensus.cc:2272] T 40970913ee644c928ddad5cbfacd6ed9 P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.507164 21266 tablet_replica.cc:333] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P f5d77cbf0f464436a88ee930055f8e05: stopping tablet replica
I20260709 12:14:51.508226 21266 raft_consensus.cc:2243] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P f5d77cbf0f464436a88ee930055f8e05 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.509148 21266 raft_consensus.cc:2272] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P f5d77cbf0f464436a88ee930055f8e05 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.512979 21266 tablet_replica.cc:333] T 4836044424874856b0db3ba4cdacaf74 P f5d77cbf0f464436a88ee930055f8e05: stopping tablet replica
I20260709 12:14:51.513876 21266 raft_consensus.cc:2243] T 4836044424874856b0db3ba4cdacaf74 P f5d77cbf0f464436a88ee930055f8e05 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:51.515398 21266 raft_consensus.cc:2272] T 4836044424874856b0db3ba4cdacaf74 P f5d77cbf0f464436a88ee930055f8e05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.519594 21266 tablet_replica.cc:333] T bc2db88da3264b91b1e8ec6ab9a0804e P f5d77cbf0f464436a88ee930055f8e05: stopping tablet replica
I20260709 12:14:51.520756 21266 raft_consensus.cc:2243] T bc2db88da3264b91b1e8ec6ab9a0804e P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.521490 21266 raft_consensus.cc:2272] T bc2db88da3264b91b1e8ec6ab9a0804e P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.525490 21266 tablet_replica.cc:333] T e4898429379b4b4880b522f22145f62a P f5d77cbf0f464436a88ee930055f8e05: stopping tablet replica
I20260709 12:14:51.526467 21266 raft_consensus.cc:2243] T e4898429379b4b4880b522f22145f62a P f5d77cbf0f464436a88ee930055f8e05 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:51.527741 21266 raft_consensus.cc:2272] T e4898429379b4b4880b522f22145f62a P f5d77cbf0f464436a88ee930055f8e05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.531306 21266 tablet_replica.cc:333] T bccb6d19bc454739bd69c05e22938ca5 P f5d77cbf0f464436a88ee930055f8e05: stopping tablet replica
I20260709 12:14:51.532141 21266 raft_consensus.cc:2243] T bccb6d19bc454739bd69c05e22938ca5 P f5d77cbf0f464436a88ee930055f8e05 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:51.533347 21266 raft_consensus.cc:2272] T bccb6d19bc454739bd69c05e22938ca5 P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.536984 21266 tablet_replica.cc:333] T 7661cfdd4178479ba812b94315dd21ab P f5d77cbf0f464436a88ee930055f8e05: stopping tablet replica
I20260709 12:14:51.537853 21266 raft_consensus.cc:2243] T 7661cfdd4178479ba812b94315dd21ab P f5d77cbf0f464436a88ee930055f8e05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.538664 21266 raft_consensus.cc:2272] T 7661cfdd4178479ba812b94315dd21ab P f5d77cbf0f464436a88ee930055f8e05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.542466 21266 tablet_replica.cc:333] T 07cbfec7b89b48f4bdc040734e73e4d7 P f5d77cbf0f464436a88ee930055f8e05: stopping tablet replica
I20260709 12:14:51.543310 21266 raft_consensus.cc:2243] T 07cbfec7b89b48f4bdc040734e73e4d7 P f5d77cbf0f464436a88ee930055f8e05 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.543982 21266 raft_consensus.cc:2272] T 07cbfec7b89b48f4bdc040734e73e4d7 P f5d77cbf0f464436a88ee930055f8e05 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.547461 21266 tablet_replica.cc:333] T b949a4dcd53f45cb8acb010c7d4d0904 P f5d77cbf0f464436a88ee930055f8e05: stopping tablet replica
I20260709 12:14:51.548450 21266 raft_consensus.cc:2243] T b949a4dcd53f45cb8acb010c7d4d0904 P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.549105 21266 raft_consensus.cc:2272] T b949a4dcd53f45cb8acb010c7d4d0904 P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.552935 21266 tablet_replica.cc:333] T c4938b6e0a5145449cf5658d192995d7 P f5d77cbf0f464436a88ee930055f8e05: stopping tablet replica
I20260709 12:14:51.553809 21266 raft_consensus.cc:2243] T c4938b6e0a5145449cf5658d192995d7 P f5d77cbf0f464436a88ee930055f8e05 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.554500 21266 raft_consensus.cc:2272] T c4938b6e0a5145449cf5658d192995d7 P f5d77cbf0f464436a88ee930055f8e05 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.558012 21266 tablet_replica.cc:333] T 0595bc4b26de41a097a82c178a1df812 P f5d77cbf0f464436a88ee930055f8e05: stopping tablet replica
I20260709 12:14:51.558802 21266 raft_consensus.cc:2243] T 0595bc4b26de41a097a82c178a1df812 P f5d77cbf0f464436a88ee930055f8e05 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.559478 21266 raft_consensus.cc:2272] T 0595bc4b26de41a097a82c178a1df812 P f5d77cbf0f464436a88ee930055f8e05 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.563184 21266 tablet_replica.cc:333] T cd37500fb41a464bbe7f9a9652e5f0df P f5d77cbf0f464436a88ee930055f8e05: stopping tablet replica
I20260709 12:14:51.564057 21266 raft_consensus.cc:2243] T cd37500fb41a464bbe7f9a9652e5f0df P f5d77cbf0f464436a88ee930055f8e05 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:51.565411 21266 raft_consensus.cc:2272] T cd37500fb41a464bbe7f9a9652e5f0df P f5d77cbf0f464436a88ee930055f8e05 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:51.568986   661 consensus_peers.cc:597] T b5be268a4ee9400e94dc432e237e8774 P 21975c12fc284bc18715d45d96e9e63a -> Peer f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935): Couldn't send request to peer f5d77cbf0f464436a88ee930055f8e05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:51.569732 21266 tablet_replica.cc:333] T b5be268a4ee9400e94dc432e237e8774 P f5d77cbf0f464436a88ee930055f8e05: stopping tablet replica
I20260709 12:14:51.570722 21266 raft_consensus.cc:2243] T b5be268a4ee9400e94dc432e237e8774 P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.571420 21266 raft_consensus.cc:2272] T b5be268a4ee9400e94dc432e237e8774 P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.575157 21266 tablet_replica.cc:333] T adff2b2578704776809995fbb0a174b8 P f5d77cbf0f464436a88ee930055f8e05: stopping tablet replica
I20260709 12:14:51.575963 21266 raft_consensus.cc:2243] T adff2b2578704776809995fbb0a174b8 P f5d77cbf0f464436a88ee930055f8e05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.576833 21266 raft_consensus.cc:2272] T adff2b2578704776809995fbb0a174b8 P f5d77cbf0f464436a88ee930055f8e05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.580487 21266 tablet_replica.cc:333] T 84f90776262f4fe7901e972d2cfe0964 P f5d77cbf0f464436a88ee930055f8e05: stopping tablet replica
I20260709 12:14:51.581383 21266 raft_consensus.cc:2243] T 84f90776262f4fe7901e972d2cfe0964 P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.582047 21266 raft_consensus.cc:2272] T 84f90776262f4fe7901e972d2cfe0964 P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.585630 21266 tablet_replica.cc:333] T a660883dd53541948b37b480edad2988 P f5d77cbf0f464436a88ee930055f8e05: stopping tablet replica
I20260709 12:14:51.586503 21266 raft_consensus.cc:2243] T a660883dd53541948b37b480edad2988 P f5d77cbf0f464436a88ee930055f8e05 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:51.587747 21266 raft_consensus.cc:2272] T a660883dd53541948b37b480edad2988 P f5d77cbf0f464436a88ee930055f8e05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.591439 21266 tablet_replica.cc:333] T 687d784a386b40c797cfe8eb4778a7e6 P f5d77cbf0f464436a88ee930055f8e05: stopping tablet replica
I20260709 12:14:51.592228 21266 raft_consensus.cc:2243] T 687d784a386b40c797cfe8eb4778a7e6 P f5d77cbf0f464436a88ee930055f8e05 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:51.593459 21266 raft_consensus.cc:2272] T 687d784a386b40c797cfe8eb4778a7e6 P f5d77cbf0f464436a88ee930055f8e05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.596864 21266 tablet_replica.cc:333] T 83a2e1850e8c47b880013ccc28f23290 P f5d77cbf0f464436a88ee930055f8e05: stopping tablet replica
I20260709 12:14:51.597540 21266 raft_consensus.cc:2243] T 83a2e1850e8c47b880013ccc28f23290 P f5d77cbf0f464436a88ee930055f8e05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.598181 21266 raft_consensus.cc:2272] T 83a2e1850e8c47b880013ccc28f23290 P f5d77cbf0f464436a88ee930055f8e05 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:51.633848   661 consensus_peers.cc:597] T c4938b6e0a5145449cf5658d192995d7 P 21975c12fc284bc18715d45d96e9e63a -> Peer f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935): Couldn't send request to peer f5d77cbf0f464436a88ee930055f8e05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:51.656003   587 consensus_peers.cc:597] T 84f90776262f4fe7901e972d2cfe0964 P 41958dc5e81443978e08a337fbb255bc -> Peer f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935): Couldn't send request to peer f5d77cbf0f464436a88ee930055f8e05. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:38935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:51.659546 21266 tablet_server.cc:196] TabletServer@127.20.196.129:0 shutdown complete.
I20260709 12:14:51.715523 21266 tablet_server.cc:179] TabletServer@127.20.196.130:0 shutting down...
W20260709 12:14:51.731211   587 consensus_peers.cc:597] T adff2b2578704776809995fbb0a174b8 P 41958dc5e81443978e08a337fbb255bc -> Peer f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935): Couldn't send request to peer f5d77cbf0f464436a88ee930055f8e05. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:38935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:51.754467 21266 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:51.755659 21266 tablet_replica.cc:333] T 40970913ee644c928ddad5cbfacd6ed9 P 41958dc5e81443978e08a337fbb255bc: stopping tablet replica
I20260709 12:14:51.756899 21266 raft_consensus.cc:2243] T 40970913ee644c928ddad5cbfacd6ed9 P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.757572 21266 raft_consensus.cc:2272] T 40970913ee644c928ddad5cbfacd6ed9 P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.760687 21266 tablet_replica.cc:333] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 41958dc5e81443978e08a337fbb255bc: stopping tablet replica
I20260709 12:14:51.761442 21266 raft_consensus.cc:2243] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 41958dc5e81443978e08a337fbb255bc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.762096 21266 raft_consensus.cc:2272] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 41958dc5e81443978e08a337fbb255bc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.765075 21266 tablet_replica.cc:333] T 4836044424874856b0db3ba4cdacaf74 P 41958dc5e81443978e08a337fbb255bc: stopping tablet replica
I20260709 12:14:51.765682 21266 raft_consensus.cc:2243] T 4836044424874856b0db3ba4cdacaf74 P 41958dc5e81443978e08a337fbb255bc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.766345 21266 raft_consensus.cc:2272] T 4836044424874856b0db3ba4cdacaf74 P 41958dc5e81443978e08a337fbb255bc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.769239 21266 tablet_replica.cc:333] T bc2db88da3264b91b1e8ec6ab9a0804e P 41958dc5e81443978e08a337fbb255bc: stopping tablet replica
I20260709 12:14:51.769886 21266 raft_consensus.cc:2243] T bc2db88da3264b91b1e8ec6ab9a0804e P 41958dc5e81443978e08a337fbb255bc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:51.770884 21266 raft_consensus.cc:2272] T bc2db88da3264b91b1e8ec6ab9a0804e P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.773412 21266 tablet_replica.cc:333] T e4898429379b4b4880b522f22145f62a P 41958dc5e81443978e08a337fbb255bc: stopping tablet replica
I20260709 12:14:51.774102 21266 raft_consensus.cc:2243] T e4898429379b4b4880b522f22145f62a P 41958dc5e81443978e08a337fbb255bc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.774827 21266 raft_consensus.cc:2272] T e4898429379b4b4880b522f22145f62a P 41958dc5e81443978e08a337fbb255bc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.777379 21266 tablet_replica.cc:333] T 687d784a386b40c797cfe8eb4778a7e6 P 41958dc5e81443978e08a337fbb255bc: stopping tablet replica
I20260709 12:14:51.777951 21266 raft_consensus.cc:2243] T 687d784a386b40c797cfe8eb4778a7e6 P 41958dc5e81443978e08a337fbb255bc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.778461 21266 raft_consensus.cc:2272] T 687d784a386b40c797cfe8eb4778a7e6 P 41958dc5e81443978e08a337fbb255bc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.780992 21266 tablet_replica.cc:333] T 83a2e1850e8c47b880013ccc28f23290 P 41958dc5e81443978e08a337fbb255bc: stopping tablet replica
I20260709 12:14:51.781543 21266 raft_consensus.cc:2243] T 83a2e1850e8c47b880013ccc28f23290 P 41958dc5e81443978e08a337fbb255bc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:51.782554 21266 raft_consensus.cc:2272] T 83a2e1850e8c47b880013ccc28f23290 P 41958dc5e81443978e08a337fbb255bc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.784979 21266 tablet_replica.cc:333] T cd37500fb41a464bbe7f9a9652e5f0df P 41958dc5e81443978e08a337fbb255bc: stopping tablet replica
I20260709 12:14:51.785599 21266 raft_consensus.cc:2243] T cd37500fb41a464bbe7f9a9652e5f0df P 41958dc5e81443978e08a337fbb255bc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.786178 21266 raft_consensus.cc:2272] T cd37500fb41a464bbe7f9a9652e5f0df P 41958dc5e81443978e08a337fbb255bc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.788810 21266 tablet_replica.cc:333] T b5be268a4ee9400e94dc432e237e8774 P 41958dc5e81443978e08a337fbb255bc: stopping tablet replica
I20260709 12:14:51.789510 21266 raft_consensus.cc:2243] T b5be268a4ee9400e94dc432e237e8774 P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.790052 21266 raft_consensus.cc:2272] T b5be268a4ee9400e94dc432e237e8774 P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.793807 21266 tablet_replica.cc:333] T adff2b2578704776809995fbb0a174b8 P 41958dc5e81443978e08a337fbb255bc: stopping tablet replica
I20260709 12:14:51.794766 21266 raft_consensus.cc:2243] T adff2b2578704776809995fbb0a174b8 P 41958dc5e81443978e08a337fbb255bc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:51.795946 21266 raft_consensus.cc:2272] T adff2b2578704776809995fbb0a174b8 P 41958dc5e81443978e08a337fbb255bc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.798849 21266 tablet_replica.cc:333] T 84f90776262f4fe7901e972d2cfe0964 P 41958dc5e81443978e08a337fbb255bc: stopping tablet replica
I20260709 12:14:51.799504 21266 raft_consensus.cc:2243] T 84f90776262f4fe7901e972d2cfe0964 P 41958dc5e81443978e08a337fbb255bc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:51.800760 21266 raft_consensus.cc:2272] T 84f90776262f4fe7901e972d2cfe0964 P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.803301 21266 tablet_replica.cc:333] T a660883dd53541948b37b480edad2988 P 41958dc5e81443978e08a337fbb255bc: stopping tablet replica
I20260709 12:14:51.803833 21266 raft_consensus.cc:2243] T a660883dd53541948b37b480edad2988 P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.804306 21266 raft_consensus.cc:2272] T a660883dd53541948b37b480edad2988 P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.806885 21266 tablet_replica.cc:333] T c4938b6e0a5145449cf5658d192995d7 P 41958dc5e81443978e08a337fbb255bc: stopping tablet replica
I20260709 12:14:51.807467 21266 raft_consensus.cc:2243] T c4938b6e0a5145449cf5658d192995d7 P 41958dc5e81443978e08a337fbb255bc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.808208 21266 raft_consensus.cc:2272] T c4938b6e0a5145449cf5658d192995d7 P 41958dc5e81443978e08a337fbb255bc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.811482 21266 tablet_replica.cc:333] T b949a4dcd53f45cb8acb010c7d4d0904 P 41958dc5e81443978e08a337fbb255bc: stopping tablet replica
I20260709 12:14:51.812342 21266 raft_consensus.cc:2243] T b949a4dcd53f45cb8acb010c7d4d0904 P 41958dc5e81443978e08a337fbb255bc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:51.813515 21266 raft_consensus.cc:2272] T b949a4dcd53f45cb8acb010c7d4d0904 P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.818046 21266 tablet_replica.cc:333] T bccb6d19bc454739bd69c05e22938ca5 P 41958dc5e81443978e08a337fbb255bc: stopping tablet replica
I20260709 12:14:51.819113 21266 raft_consensus.cc:2243] T bccb6d19bc454739bd69c05e22938ca5 P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:51.819836   660 consensus_peers.cc:597] T b5be268a4ee9400e94dc432e237e8774 P 21975c12fc284bc18715d45d96e9e63a -> Peer 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883): Couldn't send request to peer 41958dc5e81443978e08a337fbb255bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:51.819854 21266 raft_consensus.cc:2272] T bccb6d19bc454739bd69c05e22938ca5 P 41958dc5e81443978e08a337fbb255bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.823576 21266 tablet_replica.cc:333] T 7661cfdd4178479ba812b94315dd21ab P 41958dc5e81443978e08a337fbb255bc: stopping tablet replica
I20260709 12:14:51.824363 21266 raft_consensus.cc:2243] T 7661cfdd4178479ba812b94315dd21ab P 41958dc5e81443978e08a337fbb255bc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:51.825420 21266 raft_consensus.cc:2272] T 7661cfdd4178479ba812b94315dd21ab P 41958dc5e81443978e08a337fbb255bc [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:51.825649   661 consensus_peers.cc:597] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a -> Peer f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935): Couldn't send request to peer f5d77cbf0f464436a88ee930055f8e05. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:38935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:51.828830 21266 tablet_replica.cc:333] T 07cbfec7b89b48f4bdc040734e73e4d7 P 41958dc5e81443978e08a337fbb255bc: stopping tablet replica
W20260709 12:14:51.829304   661 consensus_peers.cc:597] T 40970913ee644c928ddad5cbfacd6ed9 P 21975c12fc284bc18715d45d96e9e63a -> Peer f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935): Couldn't send request to peer f5d77cbf0f464436a88ee930055f8e05. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:38935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:51.829749 21266 raft_consensus.cc:2243] T 07cbfec7b89b48f4bdc040734e73e4d7 P 41958dc5e81443978e08a337fbb255bc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.830407 21266 raft_consensus.cc:2272] T 07cbfec7b89b48f4bdc040734e73e4d7 P 41958dc5e81443978e08a337fbb255bc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.833158 21266 tablet_replica.cc:333] T 0595bc4b26de41a097a82c178a1df812 P 41958dc5e81443978e08a337fbb255bc: stopping tablet replica
I20260709 12:14:51.833663 21266 raft_consensus.cc:2243] T 0595bc4b26de41a097a82c178a1df812 P 41958dc5e81443978e08a337fbb255bc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.834180 21266 raft_consensus.cc:2272] T 0595bc4b26de41a097a82c178a1df812 P 41958dc5e81443978e08a337fbb255bc [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:51.851727   660 consensus_peers.cc:597] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a -> Peer 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883): Couldn't send request to peer 41958dc5e81443978e08a337fbb255bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:51.853986   661 consensus_peers.cc:597] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a -> Peer f5d77cbf0f464436a88ee930055f8e05 (127.20.196.129:38935): Couldn't send request to peer f5d77cbf0f464436a88ee930055f8e05. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:38935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:51.863243   660 consensus_peers.cc:597] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a -> Peer 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883): Couldn't send request to peer 41958dc5e81443978e08a337fbb255bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:51.875624   660 consensus_peers.cc:597] T c4938b6e0a5145449cf5658d192995d7 P 21975c12fc284bc18715d45d96e9e63a -> Peer 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883): Couldn't send request to peer 41958dc5e81443978e08a337fbb255bc. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:34883: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:51.896235 21266 tablet_server.cc:196] TabletServer@127.20.196.130:0 shutdown complete.
W20260709 12:14:51.909998   660 consensus_peers.cc:597] T 40970913ee644c928ddad5cbfacd6ed9 P 21975c12fc284bc18715d45d96e9e63a -> Peer 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883): Couldn't send request to peer 41958dc5e81443978e08a337fbb255bc. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:34883: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:51.919278   660 consensus_peers.cc:597] T 07cbfec7b89b48f4bdc040734e73e4d7 P 21975c12fc284bc18715d45d96e9e63a -> Peer 41958dc5e81443978e08a337fbb255bc (127.20.196.130:34883): Couldn't send request to peer 41958dc5e81443978e08a337fbb255bc. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.130:34883: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:51.964236 21266 tablet_server.cc:179] TabletServer@127.20.196.131:0 shutting down...
I20260709 12:14:52.005918 21266 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:52.006891 21266 tablet_replica.cc:333] T 40970913ee644c928ddad5cbfacd6ed9 P 21975c12fc284bc18715d45d96e9e63a: stopping tablet replica
I20260709 12:14:52.007972 21266 raft_consensus.cc:2243] T 40970913ee644c928ddad5cbfacd6ed9 P 21975c12fc284bc18715d45d96e9e63a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:52.009227 21266 raft_consensus.cc:2272] T 40970913ee644c928ddad5cbfacd6ed9 P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.012950 21266 tablet_replica.cc:333] T bc2db88da3264b91b1e8ec6ab9a0804e P 21975c12fc284bc18715d45d96e9e63a: stopping tablet replica
I20260709 12:14:52.013839 21266 raft_consensus.cc:2243] T bc2db88da3264b91b1e8ec6ab9a0804e P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.014582 21266 raft_consensus.cc:2272] T bc2db88da3264b91b1e8ec6ab9a0804e P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.017943 21266 tablet_replica.cc:333] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a: stopping tablet replica
I20260709 12:14:52.018904 21266 raft_consensus.cc:2243] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:52.020227 21266 raft_consensus.cc:2272] T 72b3c830bc7346c5bcbb710b4c9cb9c0 P 21975c12fc284bc18715d45d96e9e63a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.023605 21266 tablet_replica.cc:333] T 4836044424874856b0db3ba4cdacaf74 P 21975c12fc284bc18715d45d96e9e63a: stopping tablet replica
I20260709 12:14:52.024511 21266 raft_consensus.cc:2243] T 4836044424874856b0db3ba4cdacaf74 P 21975c12fc284bc18715d45d96e9e63a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.025255 21266 raft_consensus.cc:2272] T 4836044424874856b0db3ba4cdacaf74 P 21975c12fc284bc18715d45d96e9e63a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.028685 21266 tablet_replica.cc:333] T bccb6d19bc454739bd69c05e22938ca5 P 21975c12fc284bc18715d45d96e9e63a: stopping tablet replica
I20260709 12:14:52.029520 21266 raft_consensus.cc:2243] T bccb6d19bc454739bd69c05e22938ca5 P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.030267 21266 raft_consensus.cc:2272] T bccb6d19bc454739bd69c05e22938ca5 P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.033644 21266 tablet_replica.cc:333] T 7661cfdd4178479ba812b94315dd21ab P 21975c12fc284bc18715d45d96e9e63a: stopping tablet replica
I20260709 12:14:52.034456 21266 raft_consensus.cc:2243] T 7661cfdd4178479ba812b94315dd21ab P 21975c12fc284bc18715d45d96e9e63a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.035171 21266 raft_consensus.cc:2272] T 7661cfdd4178479ba812b94315dd21ab P 21975c12fc284bc18715d45d96e9e63a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.038167 21266 tablet_replica.cc:333] T 07cbfec7b89b48f4bdc040734e73e4d7 P 21975c12fc284bc18715d45d96e9e63a: stopping tablet replica
I20260709 12:14:52.038949 21266 raft_consensus.cc:2243] T 07cbfec7b89b48f4bdc040734e73e4d7 P 21975c12fc284bc18715d45d96e9e63a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:52.040064 21266 raft_consensus.cc:2272] T 07cbfec7b89b48f4bdc040734e73e4d7 P 21975c12fc284bc18715d45d96e9e63a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.043284 21266 tablet_replica.cc:333] T e4898429379b4b4880b522f22145f62a P 21975c12fc284bc18715d45d96e9e63a: stopping tablet replica
I20260709 12:14:52.044150 21266 raft_consensus.cc:2243] T e4898429379b4b4880b522f22145f62a P 21975c12fc284bc18715d45d96e9e63a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.044914 21266 raft_consensus.cc:2272] T e4898429379b4b4880b522f22145f62a P 21975c12fc284bc18715d45d96e9e63a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.048200 21266 tablet_replica.cc:333] T cd37500fb41a464bbe7f9a9652e5f0df P 21975c12fc284bc18715d45d96e9e63a: stopping tablet replica
I20260709 12:14:52.049058 21266 raft_consensus.cc:2243] T cd37500fb41a464bbe7f9a9652e5f0df P 21975c12fc284bc18715d45d96e9e63a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.049738 21266 raft_consensus.cc:2272] T cd37500fb41a464bbe7f9a9652e5f0df P 21975c12fc284bc18715d45d96e9e63a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.053090 21266 tablet_replica.cc:333] T b5be268a4ee9400e94dc432e237e8774 P 21975c12fc284bc18715d45d96e9e63a: stopping tablet replica
I20260709 12:14:52.053977 21266 raft_consensus.cc:2243] T b5be268a4ee9400e94dc432e237e8774 P 21975c12fc284bc18715d45d96e9e63a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:52.055249 21266 raft_consensus.cc:2272] T b5be268a4ee9400e94dc432e237e8774 P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.058585 21266 tablet_replica.cc:333] T adff2b2578704776809995fbb0a174b8 P 21975c12fc284bc18715d45d96e9e63a: stopping tablet replica
I20260709 12:14:52.059403 21266 raft_consensus.cc:2243] T adff2b2578704776809995fbb0a174b8 P 21975c12fc284bc18715d45d96e9e63a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.060074 21266 raft_consensus.cc:2272] T adff2b2578704776809995fbb0a174b8 P 21975c12fc284bc18715d45d96e9e63a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.063180 21266 tablet_replica.cc:333] T 84f90776262f4fe7901e972d2cfe0964 P 21975c12fc284bc18715d45d96e9e63a: stopping tablet replica
I20260709 12:14:52.063930 21266 raft_consensus.cc:2243] T 84f90776262f4fe7901e972d2cfe0964 P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.064505 21266 raft_consensus.cc:2272] T 84f90776262f4fe7901e972d2cfe0964 P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.067895 21266 tablet_replica.cc:333] T c4938b6e0a5145449cf5658d192995d7 P 21975c12fc284bc18715d45d96e9e63a: stopping tablet replica
I20260709 12:14:52.068739 21266 raft_consensus.cc:2243] T c4938b6e0a5145449cf5658d192995d7 P 21975c12fc284bc18715d45d96e9e63a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:52.069865 21266 raft_consensus.cc:2272] T c4938b6e0a5145449cf5658d192995d7 P 21975c12fc284bc18715d45d96e9e63a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.073190 21266 tablet_replica.cc:333] T b949a4dcd53f45cb8acb010c7d4d0904 P 21975c12fc284bc18715d45d96e9e63a: stopping tablet replica
I20260709 12:14:52.073971 21266 raft_consensus.cc:2243] T b949a4dcd53f45cb8acb010c7d4d0904 P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.074594 21266 raft_consensus.cc:2272] T b949a4dcd53f45cb8acb010c7d4d0904 P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.077811 21266 tablet_replica.cc:333] T a660883dd53541948b37b480edad2988 P 21975c12fc284bc18715d45d96e9e63a: stopping tablet replica
I20260709 12:14:52.078572 21266 raft_consensus.cc:2243] T a660883dd53541948b37b480edad2988 P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.079212 21266 raft_consensus.cc:2272] T a660883dd53541948b37b480edad2988 P 21975c12fc284bc18715d45d96e9e63a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.082355 21266 tablet_replica.cc:333] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a: stopping tablet replica
I20260709 12:14:52.083175 21266 raft_consensus.cc:2243] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:52.084108 21266 raft_consensus.cc:2272] T 0595bc4b26de41a097a82c178a1df812 P 21975c12fc284bc18715d45d96e9e63a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.086427 21266 tablet_replica.cc:333] T 687d784a386b40c797cfe8eb4778a7e6 P 21975c12fc284bc18715d45d96e9e63a: stopping tablet replica
I20260709 12:14:52.086952 21266 raft_consensus.cc:2243] T 687d784a386b40c797cfe8eb4778a7e6 P 21975c12fc284bc18715d45d96e9e63a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.087525 21266 raft_consensus.cc:2272] T 687d784a386b40c797cfe8eb4778a7e6 P 21975c12fc284bc18715d45d96e9e63a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.089823 21266 tablet_replica.cc:333] T 83a2e1850e8c47b880013ccc28f23290 P 21975c12fc284bc18715d45d96e9e63a: stopping tablet replica
I20260709 12:14:52.090320 21266 raft_consensus.cc:2243] T 83a2e1850e8c47b880013ccc28f23290 P 21975c12fc284bc18715d45d96e9e63a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.090806 21266 raft_consensus.cc:2272] T 83a2e1850e8c47b880013ccc28f23290 P 21975c12fc284bc18715d45d96e9e63a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:53.133785 21266 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 717)
I20260709 12:14:53.991763 21266 tablet_server.cc:196] TabletServer@127.20.196.131:0 shutdown complete.
I20260709 12:14:54.029433 21266 master.cc:562] Master@127.20.196.190:36763 shutting down...
I20260709 12:14:54.054582 21266 raft_consensus.cc:2243] T 00000000000000000000000000000000 P da06e69c54bd4e21a51d544b95bbb1aa [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.055289 21266 raft_consensus.cc:2272] T 00000000000000000000000000000000 P da06e69c54bd4e21a51d544b95bbb1aa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.055644 21266 tablet_replica.cc:333] T 00000000000000000000000000000000 P da06e69c54bd4e21a51d544b95bbb1aa: stopping tablet replica
I20260709 12:14:54.077375 21266 master.cc:584] Master@127.20.196.190:36763 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (22826 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:14:54.138240 21266 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.196.190:34693
I20260709 12:14:54.139469 21266 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:54.146023  1033 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:54.146023  1034 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:54.146765  1036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:54.147109 21266 server_base.cc:1061] running on GCE node
I20260709 12:14:54.148201 21266 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:54.148430 21266 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:54.148598 21266 hybrid_clock.cc:648] HybridClock initialized: now 1783599294148581 us; error 0 us; skew 500 ppm
I20260709 12:14:54.149140 21266 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:54.151937 21266 webserver.cc:533] Webserver started at http://127.20.196.190:46841/ using document root <none> and password file <none>
I20260709 12:14:54.152417 21266 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:54.152623 21266 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:54.152901 21266 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:54.154036 21266 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894355727-21266-0/minicluster-data/master-0-root/instance:
uuid: "9f291740485b4332857608ac87420526"
format_stamp: "Formatted at 2026-07-09 12:14:54 on dist-test-slave-h6sg"
I20260709 12:14:54.158390 21266 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:14:54.161842  1041 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:54.162744 21266 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:14:54.163101 21266 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894355727-21266-0/minicluster-data/master-0-root
uuid: "9f291740485b4332857608ac87420526"
format_stamp: "Formatted at 2026-07-09 12:14:54 on dist-test-slave-h6sg"
I20260709 12:14:54.163398 21266 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894355727-21266-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894355727-21266-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894355727-21266-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:54.194487 21266 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:54.195811 21266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:54.237399 21266 rpc_server.cc:307] RPC server started. Bound to: 127.20.196.190:34693
I20260709 12:14:54.237499  1092 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.196.190:34693 every 8 connection(s)
I20260709 12:14:54.241259  1093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.252674  1093 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f291740485b4332857608ac87420526: Bootstrap starting.
I20260709 12:14:54.257633  1093 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9f291740485b4332857608ac87420526: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:54.261868  1093 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f291740485b4332857608ac87420526: No bootstrap required, opened a new log
I20260709 12:14:54.264222  1093 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9f291740485b4332857608ac87420526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f291740485b4332857608ac87420526" member_type: VOTER }
I20260709 12:14:54.264668  1093 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9f291740485b4332857608ac87420526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:54.264986  1093 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9f291740485b4332857608ac87420526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f291740485b4332857608ac87420526, State: Initialized, Role: FOLLOWER
I20260709 12:14:54.265662  1093 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9f291740485b4332857608ac87420526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f291740485b4332857608ac87420526" member_type: VOTER }
I20260709 12:14:54.266152  1093 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9f291740485b4332857608ac87420526 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:14:54.266379  1093 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9f291740485b4332857608ac87420526 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:14:54.266657  1093 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9f291740485b4332857608ac87420526 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:54.272251  1093 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9f291740485b4332857608ac87420526 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f291740485b4332857608ac87420526" member_type: VOTER }
I20260709 12:14:54.272763  1093 leader_election.cc:304] T 00000000000000000000000000000000 P 9f291740485b4332857608ac87420526 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9f291740485b4332857608ac87420526; no voters: 
I20260709 12:14:54.273931  1093 leader_election.cc:290] T 00000000000000000000000000000000 P 9f291740485b4332857608ac87420526 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:14:54.274379  1096 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9f291740485b4332857608ac87420526 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:54.275831  1096 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9f291740485b4332857608ac87420526 [term 1 LEADER]: Becoming Leader. State: Replica: 9f291740485b4332857608ac87420526, State: Running, Role: LEADER
I20260709 12:14:54.276551  1096 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9f291740485b4332857608ac87420526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f291740485b4332857608ac87420526" member_type: VOTER }
I20260709 12:14:54.276868  1093 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9f291740485b4332857608ac87420526 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:14:54.282087  1098 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f291740485b4332857608ac87420526 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9f291740485b4332857608ac87420526. Latest consensus state: current_term: 1 leader_uuid: "9f291740485b4332857608ac87420526" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f291740485b4332857608ac87420526" member_type: VOTER } }
I20260709 12:14:54.282121  1097 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f291740485b4332857608ac87420526 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9f291740485b4332857608ac87420526" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f291740485b4332857608ac87420526" member_type: VOTER } }
I20260709 12:14:54.283131  1097 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f291740485b4332857608ac87420526 [sys.catalog]: This master's current role is: LEADER
I20260709 12:14:54.283143  1098 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f291740485b4332857608ac87420526 [sys.catalog]: This master's current role is: LEADER
I20260709 12:14:54.285980  1103 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:14:54.290947  1103 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:14:54.295912 21266 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:14:54.300381  1103 catalog_manager.cc:1383] Generated new cluster ID: a5265ed25ed94a86b50c247f9f63bdc5
I20260709 12:14:54.300691  1103 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:14:54.330633  1103 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:14:54.332031  1103 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:14:54.351913  1103 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 9f291740485b4332857608ac87420526: Generated new TSK 0
I20260709 12:14:54.352548  1103 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:14:54.363744 21266 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:54.370365  1114 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:54.371374  1115 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:54.374166  1117 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:54.374953 21266 server_base.cc:1061] running on GCE node
I20260709 12:14:54.375945 21266 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:54.376127 21266 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:54.376256 21266 hybrid_clock.cc:648] HybridClock initialized: now 1783599294376244 us; error 0 us; skew 500 ppm
I20260709 12:14:54.376699 21266 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:54.379108 21266 webserver.cc:533] Webserver started at http://127.20.196.129:37227/ using document root <none> and password file <none>
I20260709 12:14:54.379525 21266 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:54.379686 21266 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:54.379892 21266 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:54.380874 21266 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894355727-21266-0/minicluster-data/ts-0-root/instance:
uuid: "48fd723a77ba455eabb997723f60371b"
format_stamp: "Formatted at 2026-07-09 12:14:54 on dist-test-slave-h6sg"
I20260709 12:14:54.385005 21266 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:14:54.388403  1122 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:54.389219 21266 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:14:54.389634 21266 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894355727-21266-0/minicluster-data/ts-0-root
uuid: "48fd723a77ba455eabb997723f60371b"
format_stamp: "Formatted at 2026-07-09 12:14:54 on dist-test-slave-h6sg"
I20260709 12:14:54.389957 21266 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894355727-21266-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894355727-21266-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894355727-21266-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:54.405249 21266 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:54.406437 21266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:54.407934 21266 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:54.410245 21266 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:54.410494 21266 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:54.410748 21266 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:54.410919 21266 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:54.451979 21266 rpc_server.cc:307] RPC server started. Bound to: 127.20.196.129:40613
I20260709 12:14:54.452142  1184 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.196.129:40613 every 8 connection(s)
I20260709 12:14:54.457032 21266 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:54.464682  1189 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:54.467710  1190 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:54.471205  1192 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:54.473480 21266 server_base.cc:1061] running on GCE node
I20260709 12:14:54.474803 21266 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:54.475054 21266 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:54.475225 21266 hybrid_clock.cc:648] HybridClock initialized: now 1783599294475209 us; error 0 us; skew 500 ppm
I20260709 12:14:54.475701 21266 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:54.478381 21266 webserver.cc:533] Webserver started at http://127.20.196.130:34449/ using document root <none> and password file <none>
I20260709 12:14:54.479085 21266 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:54.479355 21266 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:54.479674 21266 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:54.480001  1185 heartbeater.cc:344] Connected to a master server at 127.20.196.190:34693
I20260709 12:14:54.480417  1185 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:54.480990 21266 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894355727-21266-0/minicluster-data/ts-1-root/instance:
uuid: "ade8f52c75914406a928ad61a925ed1b"
format_stamp: "Formatted at 2026-07-09 12:14:54 on dist-test-slave-h6sg"
I20260709 12:14:54.481154  1185 heartbeater.cc:507] Master 127.20.196.190:34693 requested a full tablet report, sending...
I20260709 12:14:54.483454  1058 ts_manager.cc:194] Registered new tserver with Master: 48fd723a77ba455eabb997723f60371b (127.20.196.129:40613)
I20260709 12:14:54.485961  1058 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58524
I20260709 12:14:54.486747 21266 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:14:54.490362  1197 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:54.491194 21266 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 12:14:54.491490 21266 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894355727-21266-0/minicluster-data/ts-1-root
uuid: "ade8f52c75914406a928ad61a925ed1b"
format_stamp: "Formatted at 2026-07-09 12:14:54 on dist-test-slave-h6sg"
I20260709 12:14:54.491746 21266 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894355727-21266-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894355727-21266-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894355727-21266-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:54.506512 21266 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:54.507629 21266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:54.509007 21266 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:54.511253 21266 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:54.511426 21266 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:54.511723 21266 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:54.511886 21266 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:54.553737 21266 rpc_server.cc:307] RPC server started. Bound to: 127.20.196.130:40533
I20260709 12:14:54.553849  1259 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.196.130:40533 every 8 connection(s)
I20260709 12:14:54.558705 21266 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:54.565670  1263 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:54.566296  1264 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:54.569195 21266 server_base.cc:1061] running on GCE node
W20260709 12:14:54.570139  1267 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:54.570438  1260 heartbeater.cc:344] Connected to a master server at 127.20.196.190:34693
I20260709 12:14:54.570932  1260 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:54.571308 21266 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:54.571580 21266 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:54.571763 21266 hybrid_clock.cc:648] HybridClock initialized: now 1783599294571730 us; error 0 us; skew 500 ppm
I20260709 12:14:54.571781  1260 heartbeater.cc:507] Master 127.20.196.190:34693 requested a full tablet report, sending...
I20260709 12:14:54.572676 21266 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:54.574138  1058 ts_manager.cc:194] Registered new tserver with Master: ade8f52c75914406a928ad61a925ed1b (127.20.196.130:40533)
I20260709 12:14:54.575253 21266 webserver.cc:533] Webserver started at http://127.20.196.131:41485/ using document root <none> and password file <none>
I20260709 12:14:54.575685  1058 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58540
I20260709 12:14:54.575783 21266 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:54.576150 21266 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:54.576421 21266 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:54.577926 21266 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894355727-21266-0/minicluster-data/ts-2-root/instance:
uuid: "9281096d749a4bf691c774d3321672e7"
format_stamp: "Formatted at 2026-07-09 12:14:54 on dist-test-slave-h6sg"
I20260709 12:14:54.582367 21266 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.003s
I20260709 12:14:54.585654  1271 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:54.586674 21266 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:14:54.587052 21266 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894355727-21266-0/minicluster-data/ts-2-root
uuid: "9281096d749a4bf691c774d3321672e7"
format_stamp: "Formatted at 2026-07-09 12:14:54 on dist-test-slave-h6sg"
I20260709 12:14:54.587327 21266 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894355727-21266-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894355727-21266-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYbo22g/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894355727-21266-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:54.602212 21266 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:54.603485 21266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:54.605054 21266 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:54.607281 21266 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:54.607482 21266 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:54.607743 21266 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:54.607906 21266 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:54.650454 21266 rpc_server.cc:307] RPC server started. Bound to: 127.20.196.131:43381
I20260709 12:14:54.650583  1334 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.196.131:43381 every 8 connection(s)
I20260709 12:14:54.665410  1335 heartbeater.cc:344] Connected to a master server at 127.20.196.190:34693
I20260709 12:14:54.665902  1335 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:54.666710  1335 heartbeater.cc:507] Master 127.20.196.190:34693 requested a full tablet report, sending...
I20260709 12:14:54.669190  1058 ts_manager.cc:194] Registered new tserver with Master: 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381)
I20260709 12:14:54.670023 21266 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016427409s
I20260709 12:14:54.670930  1058 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58548
I20260709 12:14:54.697790  1058 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58552:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:14:54.700538  1058 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:14:54.787724  1225 tablet_service.cc:1511] Processing CreateTablet for tablet b2b62eae23264a6aa96a0a5899444f0e (DEFAULT_TABLE table=test-workload [id=c89492107a774de985ee8c381068bd59]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:54.789147  1225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2b62eae23264a6aa96a0a5899444f0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.789928  1300 tablet_service.cc:1511] Processing CreateTablet for tablet b2b62eae23264a6aa96a0a5899444f0e (DEFAULT_TABLE table=test-workload [id=c89492107a774de985ee8c381068bd59]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:54.791344  1300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2b62eae23264a6aa96a0a5899444f0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.791953  1296 tablet_service.cc:1511] Processing CreateTablet for tablet be816cce439f4fb9b32c1e557f424523 (DEFAULT_TABLE table=test-workload [id=c89492107a774de985ee8c381068bd59]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:54.793424  1296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be816cce439f4fb9b32c1e557f424523. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.793140  1223 tablet_service.cc:1511] Processing CreateTablet for tablet 2ef02663c5eb4a4c900ad78501828298 (DEFAULT_TABLE table=test-workload [id=c89492107a774de985ee8c381068bd59]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:54.794514  1223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ef02663c5eb4a4c900ad78501828298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.794334  1147 tablet_service.cc:1511] Processing CreateTablet for tablet 708dcd04a2de4a6ea0c2436ae59b3aca (DEFAULT_TABLE table=test-workload [id=c89492107a774de985ee8c381068bd59]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:54.795745  1147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 708dcd04a2de4a6ea0c2436ae59b3aca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.796173  1299 tablet_service.cc:1511] Processing CreateTablet for tablet 2a0060a4875345599fa7795fb8c284c0 (DEFAULT_TABLE table=test-workload [id=c89492107a774de985ee8c381068bd59]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:54.797564  1299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a0060a4875345599fa7795fb8c284c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.799011  1146 tablet_service.cc:1511] Processing CreateTablet for tablet be816cce439f4fb9b32c1e557f424523 (DEFAULT_TABLE table=test-workload [id=c89492107a774de985ee8c381068bd59]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:54.800411  1146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be816cce439f4fb9b32c1e557f424523. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.800109  1298 tablet_service.cc:1511] Processing CreateTablet for tablet 2ef02663c5eb4a4c900ad78501828298 (DEFAULT_TABLE table=test-workload [id=c89492107a774de985ee8c381068bd59]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:54.801440  1298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ef02663c5eb4a4c900ad78501828298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.791953  1224 tablet_service.cc:1511] Processing CreateTablet for tablet 2a0060a4875345599fa7795fb8c284c0 (DEFAULT_TABLE table=test-workload [id=c89492107a774de985ee8c381068bd59]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:54.802469  1149 tablet_service.cc:1511] Processing CreateTablet for tablet 2a0060a4875345599fa7795fb8c284c0 (DEFAULT_TABLE table=test-workload [id=c89492107a774de985ee8c381068bd59]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:54.803283  1224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a0060a4875345599fa7795fb8c284c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.787765  1150 tablet_service.cc:1511] Processing CreateTablet for tablet b2b62eae23264a6aa96a0a5899444f0e (DEFAULT_TABLE table=test-workload [id=c89492107a774de985ee8c381068bd59]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:54.804252  1149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a0060a4875345599fa7795fb8c284c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.805055  1150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2b62eae23264a6aa96a0a5899444f0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.803069  1222 tablet_service.cc:1511] Processing CreateTablet for tablet 708dcd04a2de4a6ea0c2436ae59b3aca (DEFAULT_TABLE table=test-workload [id=c89492107a774de985ee8c381068bd59]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:54.807377  1222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 708dcd04a2de4a6ea0c2436ae59b3aca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.793169  1148 tablet_service.cc:1511] Processing CreateTablet for tablet 2ef02663c5eb4a4c900ad78501828298 (DEFAULT_TABLE table=test-workload [id=c89492107a774de985ee8c381068bd59]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:54.810204  1148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ef02663c5eb4a4c900ad78501828298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.804432  1297 tablet_service.cc:1511] Processing CreateTablet for tablet 708dcd04a2de4a6ea0c2436ae59b3aca (DEFAULT_TABLE table=test-workload [id=c89492107a774de985ee8c381068bd59]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:54.813138  1297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 708dcd04a2de4a6ea0c2436ae59b3aca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.817133  1221 tablet_service.cc:1511] Processing CreateTablet for tablet be816cce439f4fb9b32c1e557f424523 (DEFAULT_TABLE table=test-workload [id=c89492107a774de985ee8c381068bd59]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:54.822103  1220 tablet_service.cc:1511] Processing CreateTablet for tablet 6f6d5246f47546cea93920208eb4c505 (DEFAULT_TABLE table=test-workload [id=c89492107a774de985ee8c381068bd59]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:54.827543  1221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be816cce439f4fb9b32c1e557f424523. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.830415  1219 tablet_service.cc:1511] Processing CreateTablet for tablet 062ef3d157f74d819a1e8c88524d15bb (DEFAULT_TABLE table=test-workload [id=c89492107a774de985ee8c381068bd59]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:54.832027  1219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 062ef3d157f74d819a1e8c88524d15bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.834611  1145 tablet_service.cc:1511] Processing CreateTablet for tablet 6f6d5246f47546cea93920208eb4c505 (DEFAULT_TABLE table=test-workload [id=c89492107a774de985ee8c381068bd59]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:54.836045  1145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f6d5246f47546cea93920208eb4c505. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.836241  1220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f6d5246f47546cea93920208eb4c505. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.849462  1295 tablet_service.cc:1511] Processing CreateTablet for tablet 6f6d5246f47546cea93920208eb4c505 (DEFAULT_TABLE table=test-workload [id=c89492107a774de985ee8c381068bd59]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:54.850597  1144 tablet_service.cc:1511] Processing CreateTablet for tablet 062ef3d157f74d819a1e8c88524d15bb (DEFAULT_TABLE table=test-workload [id=c89492107a774de985ee8c381068bd59]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:54.852092  1144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 062ef3d157f74d819a1e8c88524d15bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.852595  1295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f6d5246f47546cea93920208eb4c505. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.852221  1294 tablet_service.cc:1511] Processing CreateTablet for tablet 062ef3d157f74d819a1e8c88524d15bb (DEFAULT_TABLE table=test-workload [id=c89492107a774de985ee8c381068bd59]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:54.856658  1294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 062ef3d157f74d819a1e8c88524d15bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.856324  1143 tablet_service.cc:1511] Processing CreateTablet for tablet 023ba999f2974359812bb5a68e6a618c (DEFAULT_TABLE table=test-workload [id=c89492107a774de985ee8c381068bd59]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:54.857671  1143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 023ba999f2974359812bb5a68e6a618c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.869916  1218 tablet_service.cc:1511] Processing CreateTablet for tablet 023ba999f2974359812bb5a68e6a618c (DEFAULT_TABLE table=test-workload [id=c89492107a774de985ee8c381068bd59]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:54.871423  1218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 023ba999f2974359812bb5a68e6a618c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.876799  1293 tablet_service.cc:1511] Processing CreateTablet for tablet 023ba999f2974359812bb5a68e6a618c (DEFAULT_TABLE table=test-workload [id=c89492107a774de985ee8c381068bd59]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:54.878196  1293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 023ba999f2974359812bb5a68e6a618c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.879964  1142 tablet_service.cc:1511] Processing CreateTablet for tablet fa8e4b22b550472e9de5f6a9cc8e173c (DEFAULT_TABLE table=test-workload [id=c89492107a774de985ee8c381068bd59]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:54.881286  1142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa8e4b22b550472e9de5f6a9cc8e173c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.946743  1351 tablet_bootstrap.cc:492] T b2b62eae23264a6aa96a0a5899444f0e P 48fd723a77ba455eabb997723f60371b: Bootstrap starting.
I20260709 12:14:54.948817  1352 tablet_bootstrap.cc:492] T 2a0060a4875345599fa7795fb8c284c0 P 9281096d749a4bf691c774d3321672e7: Bootstrap starting.
I20260709 12:14:54.986644  1353 tablet_bootstrap.cc:492] T be816cce439f4fb9b32c1e557f424523 P ade8f52c75914406a928ad61a925ed1b: Bootstrap starting.
I20260709 12:14:55.084446  1221 tablet_service.cc:1511] Processing CreateTablet for tablet fa8e4b22b550472e9de5f6a9cc8e173c (DEFAULT_TABLE table=test-workload [id=c89492107a774de985ee8c381068bd59]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:55.088265  1221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa8e4b22b550472e9de5f6a9cc8e173c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:55.095417  1352 tablet_bootstrap.cc:654] T 2a0060a4875345599fa7795fb8c284c0 P 9281096d749a4bf691c774d3321672e7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:55.104451  1353 tablet_bootstrap.cc:654] T be816cce439f4fb9b32c1e557f424523 P ade8f52c75914406a928ad61a925ed1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:55.122733  1351 tablet_bootstrap.cc:654] T b2b62eae23264a6aa96a0a5899444f0e P 48fd723a77ba455eabb997723f60371b: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:55.123339  1295 tablet_service.cc:1511] Processing CreateTablet for tablet fa8e4b22b550472e9de5f6a9cc8e173c (DEFAULT_TABLE table=test-workload [id=c89492107a774de985ee8c381068bd59]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:55.129556  1295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa8e4b22b550472e9de5f6a9cc8e173c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:55.126103  1352 tablet_bootstrap.cc:492] T 2a0060a4875345599fa7795fb8c284c0 P 9281096d749a4bf691c774d3321672e7: No bootstrap required, opened a new log
I20260709 12:14:55.135711  1352 ts_tablet_manager.cc:1403] T 2a0060a4875345599fa7795fb8c284c0 P 9281096d749a4bf691c774d3321672e7: Time spent bootstrapping tablet: real 0.187s	user 0.012s	sys 0.018s
I20260709 12:14:55.146803  1353 tablet_bootstrap.cc:492] T be816cce439f4fb9b32c1e557f424523 P ade8f52c75914406a928ad61a925ed1b: No bootstrap required, opened a new log
I20260709 12:14:55.147665  1353 ts_tablet_manager.cc:1403] T be816cce439f4fb9b32c1e557f424523 P ade8f52c75914406a928ad61a925ed1b: Time spent bootstrapping tablet: real 0.161s	user 0.009s	sys 0.045s
I20260709 12:14:55.148617  1351 tablet_bootstrap.cc:492] T b2b62eae23264a6aa96a0a5899444f0e P 48fd723a77ba455eabb997723f60371b: No bootstrap required, opened a new log
I20260709 12:14:55.149365  1351 ts_tablet_manager.cc:1403] T b2b62eae23264a6aa96a0a5899444f0e P 48fd723a77ba455eabb997723f60371b: Time spent bootstrapping tablet: real 0.203s	user 0.009s	sys 0.016s
I20260709 12:14:55.149807  1352 raft_consensus.cc:359] T 2a0060a4875345599fa7795fb8c284c0 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.151110  1352 raft_consensus.cc:385] T 2a0060a4875345599fa7795fb8c284c0 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:55.151021  1353 raft_consensus.cc:359] T be816cce439f4fb9b32c1e557f424523 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.151779  1352 raft_consensus.cc:740] T 2a0060a4875345599fa7795fb8c284c0 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9281096d749a4bf691c774d3321672e7, State: Initialized, Role: FOLLOWER
I20260709 12:14:55.152261  1353 raft_consensus.cc:385] T be816cce439f4fb9b32c1e557f424523 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:55.152911  1353 raft_consensus.cc:740] T be816cce439f4fb9b32c1e557f424523 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade8f52c75914406a928ad61a925ed1b, State: Initialized, Role: FOLLOWER
I20260709 12:14:55.153159  1351 raft_consensus.cc:359] T b2b62eae23264a6aa96a0a5899444f0e P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } }
I20260709 12:14:55.152917  1352 consensus_queue.cc:260] T 2a0060a4875345599fa7795fb8c284c0 P 9281096d749a4bf691c774d3321672e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.154320  1351 raft_consensus.cc:385] T b2b62eae23264a6aa96a0a5899444f0e P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:55.154803  1351 raft_consensus.cc:740] T b2b62eae23264a6aa96a0a5899444f0e P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48fd723a77ba455eabb997723f60371b, State: Initialized, Role: FOLLOWER
I20260709 12:14:55.155833  1351 consensus_queue.cc:260] T b2b62eae23264a6aa96a0a5899444f0e P 48fd723a77ba455eabb997723f60371b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } }
I20260709 12:14:55.154953  1353 consensus_queue.cc:260] T be816cce439f4fb9b32c1e557f424523 P ade8f52c75914406a928ad61a925ed1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.158649  1185 heartbeater.cc:499] Master 127.20.196.190:34693 was elected leader, sending a full tablet report...
I20260709 12:14:55.159145  1351 ts_tablet_manager.cc:1434] T b2b62eae23264a6aa96a0a5899444f0e P 48fd723a77ba455eabb997723f60371b: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.001s
I20260709 12:14:55.160555  1351 tablet_bootstrap.cc:492] T be816cce439f4fb9b32c1e557f424523 P 48fd723a77ba455eabb997723f60371b: Bootstrap starting.
I20260709 12:14:55.167023  1352 ts_tablet_manager.cc:1434] T 2a0060a4875345599fa7795fb8c284c0 P 9281096d749a4bf691c774d3321672e7: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.012s
I20260709 12:14:55.170022  1351 tablet_bootstrap.cc:654] T be816cce439f4fb9b32c1e557f424523 P 48fd723a77ba455eabb997723f60371b: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:55.171067  1335 heartbeater.cc:499] Master 127.20.196.190:34693 was elected leader, sending a full tablet report...
I20260709 12:14:55.172060  1352 tablet_bootstrap.cc:492] T 062ef3d157f74d819a1e8c88524d15bb P 9281096d749a4bf691c774d3321672e7: Bootstrap starting.
I20260709 12:14:55.183775  1352 tablet_bootstrap.cc:654] T 062ef3d157f74d819a1e8c88524d15bb P 9281096d749a4bf691c774d3321672e7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:55.194715  1351 tablet_bootstrap.cc:492] T be816cce439f4fb9b32c1e557f424523 P 48fd723a77ba455eabb997723f60371b: No bootstrap required, opened a new log
I20260709 12:14:55.195389  1351 ts_tablet_manager.cc:1403] T be816cce439f4fb9b32c1e557f424523 P 48fd723a77ba455eabb997723f60371b: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.003s
I20260709 12:14:55.198684  1351 raft_consensus.cc:359] T be816cce439f4fb9b32c1e557f424523 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.199259  1260 heartbeater.cc:499] Master 127.20.196.190:34693 was elected leader, sending a full tablet report...
I20260709 12:14:55.200903  1353 ts_tablet_manager.cc:1434] T be816cce439f4fb9b32c1e557f424523 P ade8f52c75914406a928ad61a925ed1b: Time spent starting tablet: real 0.053s	user 0.035s	sys 0.010s
I20260709 12:14:55.202346  1352 tablet_bootstrap.cc:492] T 062ef3d157f74d819a1e8c88524d15bb P 9281096d749a4bf691c774d3321672e7: No bootstrap required, opened a new log
I20260709 12:14:55.202672  1353 tablet_bootstrap.cc:492] T 062ef3d157f74d819a1e8c88524d15bb P ade8f52c75914406a928ad61a925ed1b: Bootstrap starting.
I20260709 12:14:55.204511  1352 ts_tablet_manager.cc:1403] T 062ef3d157f74d819a1e8c88524d15bb P 9281096d749a4bf691c774d3321672e7: Time spent bootstrapping tablet: real 0.032s	user 0.027s	sys 0.002s
I20260709 12:14:55.205727  1351 raft_consensus.cc:385] T be816cce439f4fb9b32c1e557f424523 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:55.206127  1351 raft_consensus.cc:740] T be816cce439f4fb9b32c1e557f424523 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48fd723a77ba455eabb997723f60371b, State: Initialized, Role: FOLLOWER
W20260709 12:14:55.206561  1186 tablet.cc:2406] T b2b62eae23264a6aa96a0a5899444f0e P 48fd723a77ba455eabb997723f60371b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:14:55.207252  1351 consensus_queue.cc:260] T be816cce439f4fb9b32c1e557f424523 P 48fd723a77ba455eabb997723f60371b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.208160  1352 raft_consensus.cc:359] T 062ef3d157f74d819a1e8c88524d15bb P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.208918  1352 raft_consensus.cc:385] T 062ef3d157f74d819a1e8c88524d15bb P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:55.209228  1352 raft_consensus.cc:740] T 062ef3d157f74d819a1e8c88524d15bb P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9281096d749a4bf691c774d3321672e7, State: Initialized, Role: FOLLOWER
I20260709 12:14:55.210162  1352 consensus_queue.cc:260] T 062ef3d157f74d819a1e8c88524d15bb P 9281096d749a4bf691c774d3321672e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.211622  1351 ts_tablet_manager.cc:1434] T be816cce439f4fb9b32c1e557f424523 P 48fd723a77ba455eabb997723f60371b: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.003s
I20260709 12:14:55.212106  1353 tablet_bootstrap.cc:654] T 062ef3d157f74d819a1e8c88524d15bb P ade8f52c75914406a928ad61a925ed1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:55.212431  1352 ts_tablet_manager.cc:1434] T 062ef3d157f74d819a1e8c88524d15bb P 9281096d749a4bf691c774d3321672e7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:14:55.212760  1351 tablet_bootstrap.cc:492] T fa8e4b22b550472e9de5f6a9cc8e173c P 48fd723a77ba455eabb997723f60371b: Bootstrap starting.
I20260709 12:14:55.213599  1352 tablet_bootstrap.cc:492] T be816cce439f4fb9b32c1e557f424523 P 9281096d749a4bf691c774d3321672e7: Bootstrap starting.
I20260709 12:14:55.220511  1351 tablet_bootstrap.cc:654] T fa8e4b22b550472e9de5f6a9cc8e173c P 48fd723a77ba455eabb997723f60371b: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:55.221208  1352 tablet_bootstrap.cc:654] T be816cce439f4fb9b32c1e557f424523 P 9281096d749a4bf691c774d3321672e7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:55.230041  1351 tablet_bootstrap.cc:492] T fa8e4b22b550472e9de5f6a9cc8e173c P 48fd723a77ba455eabb997723f60371b: No bootstrap required, opened a new log
I20260709 12:14:55.230363  1353 tablet_bootstrap.cc:492] T 062ef3d157f74d819a1e8c88524d15bb P ade8f52c75914406a928ad61a925ed1b: No bootstrap required, opened a new log
I20260709 12:14:55.230590  1351 ts_tablet_manager.cc:1403] T fa8e4b22b550472e9de5f6a9cc8e173c P 48fd723a77ba455eabb997723f60371b: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.003s
I20260709 12:14:55.231237  1353 ts_tablet_manager.cc:1403] T 062ef3d157f74d819a1e8c88524d15bb P ade8f52c75914406a928ad61a925ed1b: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.008s
I20260709 12:14:55.233569  1352 tablet_bootstrap.cc:492] T be816cce439f4fb9b32c1e557f424523 P 9281096d749a4bf691c774d3321672e7: No bootstrap required, opened a new log
I20260709 12:14:55.234174  1352 ts_tablet_manager.cc:1403] T be816cce439f4fb9b32c1e557f424523 P 9281096d749a4bf691c774d3321672e7: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.012s
I20260709 12:14:55.234643  1353 raft_consensus.cc:359] T 062ef3d157f74d819a1e8c88524d15bb P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.235512  1353 raft_consensus.cc:385] T 062ef3d157f74d819a1e8c88524d15bb P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:55.235425  1351 raft_consensus.cc:359] T fa8e4b22b550472e9de5f6a9cc8e173c P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.236001  1353 raft_consensus.cc:740] T 062ef3d157f74d819a1e8c88524d15bb P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade8f52c75914406a928ad61a925ed1b, State: Initialized, Role: FOLLOWER
I20260709 12:14:55.236343  1351 raft_consensus.cc:385] T fa8e4b22b550472e9de5f6a9cc8e173c P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:55.236744  1351 raft_consensus.cc:740] T fa8e4b22b550472e9de5f6a9cc8e173c P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48fd723a77ba455eabb997723f60371b, State: Initialized, Role: FOLLOWER
I20260709 12:14:55.236963  1353 consensus_queue.cc:260] T 062ef3d157f74d819a1e8c88524d15bb P ade8f52c75914406a928ad61a925ed1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.237591  1352 raft_consensus.cc:359] T be816cce439f4fb9b32c1e557f424523 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.237699  1351 consensus_queue.cc:260] T fa8e4b22b550472e9de5f6a9cc8e173c P 48fd723a77ba455eabb997723f60371b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.238562  1352 raft_consensus.cc:385] T be816cce439f4fb9b32c1e557f424523 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:55.238963  1352 raft_consensus.cc:740] T be816cce439f4fb9b32c1e557f424523 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9281096d749a4bf691c774d3321672e7, State: Initialized, Role: FOLLOWER
I20260709 12:14:55.239951  1353 ts_tablet_manager.cc:1434] T 062ef3d157f74d819a1e8c88524d15bb P ade8f52c75914406a928ad61a925ed1b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:14:55.239815  1352 consensus_queue.cc:260] T be816cce439f4fb9b32c1e557f424523 P 9281096d749a4bf691c774d3321672e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.240504  1351 ts_tablet_manager.cc:1434] T fa8e4b22b550472e9de5f6a9cc8e173c P 48fd723a77ba455eabb997723f60371b: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:14:55.241204  1353 tablet_bootstrap.cc:492] T 2a0060a4875345599fa7795fb8c284c0 P ade8f52c75914406a928ad61a925ed1b: Bootstrap starting.
I20260709 12:14:55.241719  1351 tablet_bootstrap.cc:492] T 023ba999f2974359812bb5a68e6a618c P 48fd723a77ba455eabb997723f60371b: Bootstrap starting.
I20260709 12:14:55.243053  1352 ts_tablet_manager.cc:1434] T be816cce439f4fb9b32c1e557f424523 P 9281096d749a4bf691c774d3321672e7: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:14:55.249574  1353 tablet_bootstrap.cc:654] T 2a0060a4875345599fa7795fb8c284c0 P ade8f52c75914406a928ad61a925ed1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:55.249711  1351 tablet_bootstrap.cc:654] T 023ba999f2974359812bb5a68e6a618c P 48fd723a77ba455eabb997723f60371b: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:55.257682  1352 tablet_bootstrap.cc:492] T 2ef02663c5eb4a4c900ad78501828298 P 9281096d749a4bf691c774d3321672e7: Bootstrap starting.
I20260709 12:14:55.261242  1351 tablet_bootstrap.cc:492] T 023ba999f2974359812bb5a68e6a618c P 48fd723a77ba455eabb997723f60371b: No bootstrap required, opened a new log
I20260709 12:14:55.261628  1353 tablet_bootstrap.cc:492] T 2a0060a4875345599fa7795fb8c284c0 P ade8f52c75914406a928ad61a925ed1b: No bootstrap required, opened a new log
I20260709 12:14:55.261761  1351 ts_tablet_manager.cc:1403] T 023ba999f2974359812bb5a68e6a618c P 48fd723a77ba455eabb997723f60371b: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.011s
I20260709 12:14:55.262276  1353 ts_tablet_manager.cc:1403] T 2a0060a4875345599fa7795fb8c284c0 P ade8f52c75914406a928ad61a925ed1b: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.008s
I20260709 12:14:55.264422  1351 raft_consensus.cc:359] T 023ba999f2974359812bb5a68e6a618c P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.265132  1351 raft_consensus.cc:385] T 023ba999f2974359812bb5a68e6a618c P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:55.265379  1351 raft_consensus.cc:740] T 023ba999f2974359812bb5a68e6a618c P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48fd723a77ba455eabb997723f60371b, State: Initialized, Role: FOLLOWER
I20260709 12:14:55.265937  1352 tablet_bootstrap.cc:654] T 2ef02663c5eb4a4c900ad78501828298 P 9281096d749a4bf691c774d3321672e7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:55.265691  1353 raft_consensus.cc:359] T 2a0060a4875345599fa7795fb8c284c0 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.266440  1353 raft_consensus.cc:385] T 2a0060a4875345599fa7795fb8c284c0 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:55.266206  1351 consensus_queue.cc:260] T 023ba999f2974359812bb5a68e6a618c P 48fd723a77ba455eabb997723f60371b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.266788  1353 raft_consensus.cc:740] T 2a0060a4875345599fa7795fb8c284c0 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade8f52c75914406a928ad61a925ed1b, State: Initialized, Role: FOLLOWER
I20260709 12:14:55.267730  1353 consensus_queue.cc:260] T 2a0060a4875345599fa7795fb8c284c0 P ade8f52c75914406a928ad61a925ed1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.268642  1351 ts_tablet_manager.cc:1434] T 023ba999f2974359812bb5a68e6a618c P 48fd723a77ba455eabb997723f60371b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:14:55.269749  1351 tablet_bootstrap.cc:492] T 708dcd04a2de4a6ea0c2436ae59b3aca P 48fd723a77ba455eabb997723f60371b: Bootstrap starting.
I20260709 12:14:55.270352  1353 ts_tablet_manager.cc:1434] T 2a0060a4875345599fa7795fb8c284c0 P ade8f52c75914406a928ad61a925ed1b: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:14:55.272534  1353 tablet_bootstrap.cc:492] T 023ba999f2974359812bb5a68e6a618c P ade8f52c75914406a928ad61a925ed1b: Bootstrap starting.
I20260709 12:14:55.276947  1351 tablet_bootstrap.cc:654] T 708dcd04a2de4a6ea0c2436ae59b3aca P 48fd723a77ba455eabb997723f60371b: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:55.282769  1353 tablet_bootstrap.cc:654] T 023ba999f2974359812bb5a68e6a618c P ade8f52c75914406a928ad61a925ed1b: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:55.291394  1106 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:55.303174  1353 tablet_bootstrap.cc:492] T 023ba999f2974359812bb5a68e6a618c P ade8f52c75914406a928ad61a925ed1b: No bootstrap required, opened a new log
I20260709 12:14:55.303174  1352 tablet_bootstrap.cc:492] T 2ef02663c5eb4a4c900ad78501828298 P 9281096d749a4bf691c774d3321672e7: No bootstrap required, opened a new log
I20260709 12:14:55.303980  1353 ts_tablet_manager.cc:1403] T 023ba999f2974359812bb5a68e6a618c P ade8f52c75914406a928ad61a925ed1b: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.014s
I20260709 12:14:55.304100  1351 tablet_bootstrap.cc:492] T 708dcd04a2de4a6ea0c2436ae59b3aca P 48fd723a77ba455eabb997723f60371b: No bootstrap required, opened a new log
I20260709 12:14:55.303980  1352 ts_tablet_manager.cc:1403] T 2ef02663c5eb4a4c900ad78501828298 P 9281096d749a4bf691c774d3321672e7: Time spent bootstrapping tablet: real 0.047s	user 0.020s	sys 0.023s
I20260709 12:14:55.304941  1351 ts_tablet_manager.cc:1403] T 708dcd04a2de4a6ea0c2436ae59b3aca P 48fd723a77ba455eabb997723f60371b: Time spent bootstrapping tablet: real 0.035s	user 0.019s	sys 0.012s
I20260709 12:14:55.307655  1353 raft_consensus.cc:359] T 023ba999f2974359812bb5a68e6a618c P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.307870  1352 raft_consensus.cc:359] T 2ef02663c5eb4a4c900ad78501828298 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.308233  1359 raft_consensus.cc:493] T 2a0060a4875345599fa7795fb8c284c0 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.308594  1353 raft_consensus.cc:385] T 023ba999f2974359812bb5a68e6a618c P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:55.308710  1352 raft_consensus.cc:385] T 2ef02663c5eb4a4c900ad78501828298 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:55.308470  1351 raft_consensus.cc:359] T 708dcd04a2de4a6ea0c2436ae59b3aca P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.309233  1353 raft_consensus.cc:740] T 023ba999f2974359812bb5a68e6a618c P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade8f52c75914406a928ad61a925ed1b, State: Initialized, Role: FOLLOWER
I20260709 12:14:55.309294  1352 raft_consensus.cc:740] T 2ef02663c5eb4a4c900ad78501828298 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9281096d749a4bf691c774d3321672e7, State: Initialized, Role: FOLLOWER
I20260709 12:14:55.309659  1351 raft_consensus.cc:385] T 708dcd04a2de4a6ea0c2436ae59b3aca P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:55.310091  1351 raft_consensus.cc:740] T 708dcd04a2de4a6ea0c2436ae59b3aca P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48fd723a77ba455eabb997723f60371b, State: Initialized, Role: FOLLOWER
I20260709 12:14:55.310420  1353 consensus_queue.cc:260] T 023ba999f2974359812bb5a68e6a618c P ade8f52c75914406a928ad61a925ed1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.310420  1352 consensus_queue.cc:260] T 2ef02663c5eb4a4c900ad78501828298 P 9281096d749a4bf691c774d3321672e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.308971  1359 raft_consensus.cc:515] T 2a0060a4875345599fa7795fb8c284c0 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.310925  1351 consensus_queue.cc:260] T 708dcd04a2de4a6ea0c2436ae59b3aca P 48fd723a77ba455eabb997723f60371b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.313900  1351 ts_tablet_manager.cc:1434] T 708dcd04a2de4a6ea0c2436ae59b3aca P 48fd723a77ba455eabb997723f60371b: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 12:14:55.315179  1351 tablet_bootstrap.cc:492] T 2a0060a4875345599fa7795fb8c284c0 P 48fd723a77ba455eabb997723f60371b: Bootstrap starting.
I20260709 12:14:55.317721  1352 ts_tablet_manager.cc:1434] T 2ef02663c5eb4a4c900ad78501828298 P 9281096d749a4bf691c774d3321672e7: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:14:55.319348  1352 tablet_bootstrap.cc:492] T b2b62eae23264a6aa96a0a5899444f0e P 9281096d749a4bf691c774d3321672e7: Bootstrap starting.
I20260709 12:14:55.323257  1351 tablet_bootstrap.cc:654] T 2a0060a4875345599fa7795fb8c284c0 P 48fd723a77ba455eabb997723f60371b: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:55.326699  1352 tablet_bootstrap.cc:654] T b2b62eae23264a6aa96a0a5899444f0e P 9281096d749a4bf691c774d3321672e7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:55.329578  1353 ts_tablet_manager.cc:1434] T 023ba999f2974359812bb5a68e6a618c P ade8f52c75914406a928ad61a925ed1b: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.006s
I20260709 12:14:55.327809  1370 raft_consensus.cc:493] T 062ef3d157f74d819a1e8c88524d15bb P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.331094  1370 raft_consensus.cc:515] T 062ef3d157f74d819a1e8c88524d15bb P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.333482  1370 leader_election.cc:290] T 062ef3d157f74d819a1e8c88524d15bb P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48fd723a77ba455eabb997723f60371b (127.20.196.129:40613), 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381)
I20260709 12:14:55.330681  1353 tablet_bootstrap.cc:492] T 708dcd04a2de4a6ea0c2436ae59b3aca P ade8f52c75914406a928ad61a925ed1b: Bootstrap starting.
I20260709 12:14:55.338121  1359 leader_election.cc:290] T 2a0060a4875345599fa7795fb8c284c0 P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48fd723a77ba455eabb997723f60371b (127.20.196.129:40613), 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381)
I20260709 12:14:55.341665  1353 tablet_bootstrap.cc:654] T 708dcd04a2de4a6ea0c2436ae59b3aca P ade8f52c75914406a928ad61a925ed1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:55.344931  1352 tablet_bootstrap.cc:492] T b2b62eae23264a6aa96a0a5899444f0e P 9281096d749a4bf691c774d3321672e7: No bootstrap required, opened a new log
I20260709 12:14:55.345485  1352 ts_tablet_manager.cc:1403] T b2b62eae23264a6aa96a0a5899444f0e P 9281096d749a4bf691c774d3321672e7: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.000s
I20260709 12:14:55.347162  1351 tablet_bootstrap.cc:492] T 2a0060a4875345599fa7795fb8c284c0 P 48fd723a77ba455eabb997723f60371b: No bootstrap required, opened a new log
I20260709 12:14:55.347767  1351 ts_tablet_manager.cc:1403] T 2a0060a4875345599fa7795fb8c284c0 P 48fd723a77ba455eabb997723f60371b: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.015s
I20260709 12:14:55.348634  1352 raft_consensus.cc:359] T b2b62eae23264a6aa96a0a5899444f0e P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } }
I20260709 12:14:55.349550  1352 raft_consensus.cc:385] T b2b62eae23264a6aa96a0a5899444f0e P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:55.349887  1352 raft_consensus.cc:740] T b2b62eae23264a6aa96a0a5899444f0e P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9281096d749a4bf691c774d3321672e7, State: Initialized, Role: FOLLOWER
I20260709 12:14:55.350708  1351 raft_consensus.cc:359] T 2a0060a4875345599fa7795fb8c284c0 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.350841  1352 consensus_queue.cc:260] T b2b62eae23264a6aa96a0a5899444f0e P 9281096d749a4bf691c774d3321672e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } }
I20260709 12:14:55.351600  1351 raft_consensus.cc:385] T 2a0060a4875345599fa7795fb8c284c0 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:55.351962  1351 raft_consensus.cc:740] T 2a0060a4875345599fa7795fb8c284c0 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48fd723a77ba455eabb997723f60371b, State: Initialized, Role: FOLLOWER
I20260709 12:14:55.352732  1351 consensus_queue.cc:260] T 2a0060a4875345599fa7795fb8c284c0 P 48fd723a77ba455eabb997723f60371b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.354115  1352 ts_tablet_manager.cc:1434] T b2b62eae23264a6aa96a0a5899444f0e P 9281096d749a4bf691c774d3321672e7: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:14:55.355063  1351 ts_tablet_manager.cc:1434] T 2a0060a4875345599fa7795fb8c284c0 P 48fd723a77ba455eabb997723f60371b: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 12:14:55.358314  1352 tablet_bootstrap.cc:492] T 023ba999f2974359812bb5a68e6a618c P 9281096d749a4bf691c774d3321672e7: Bootstrap starting.
I20260709 12:14:55.358618  1351 tablet_bootstrap.cc:492] T 6f6d5246f47546cea93920208eb4c505 P 48fd723a77ba455eabb997723f60371b: Bootstrap starting.
I20260709 12:14:55.358389  1160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a0060a4875345599fa7795fb8c284c0" candidate_uuid: "ade8f52c75914406a928ad61a925ed1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48fd723a77ba455eabb997723f60371b" is_pre_election: true
I20260709 12:14:55.359431  1160 raft_consensus.cc:2468] T 2a0060a4875345599fa7795fb8c284c0 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ade8f52c75914406a928ad61a925ed1b in term 0.
I20260709 12:14:55.360857  1159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062ef3d157f74d819a1e8c88524d15bb" candidate_uuid: "ade8f52c75914406a928ad61a925ed1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48fd723a77ba455eabb997723f60371b" is_pre_election: true
I20260709 12:14:55.361335  1353 tablet_bootstrap.cc:492] T 708dcd04a2de4a6ea0c2436ae59b3aca P ade8f52c75914406a928ad61a925ed1b: No bootstrap required, opened a new log
I20260709 12:14:55.361893  1353 ts_tablet_manager.cc:1403] T 708dcd04a2de4a6ea0c2436ae59b3aca P ade8f52c75914406a928ad61a925ed1b: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.001s
I20260709 12:14:55.364571  1200 leader_election.cc:304] T 2a0060a4875345599fa7795fb8c284c0 P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48fd723a77ba455eabb997723f60371b, ade8f52c75914406a928ad61a925ed1b; no voters: 
I20260709 12:14:55.365284  1353 raft_consensus.cc:359] T 708dcd04a2de4a6ea0c2436ae59b3aca P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.366117  1353 raft_consensus.cc:385] T 708dcd04a2de4a6ea0c2436ae59b3aca P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:55.366176  1351 tablet_bootstrap.cc:654] T 6f6d5246f47546cea93920208eb4c505 P 48fd723a77ba455eabb997723f60371b: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:55.366540  1353 raft_consensus.cc:740] T 708dcd04a2de4a6ea0c2436ae59b3aca P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade8f52c75914406a928ad61a925ed1b, State: Initialized, Role: FOLLOWER
I20260709 12:14:55.367702  1353 consensus_queue.cc:260] T 708dcd04a2de4a6ea0c2436ae59b3aca P ade8f52c75914406a928ad61a925ed1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.370451  1359 raft_consensus.cc:2804] T 2a0060a4875345599fa7795fb8c284c0 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:55.370888  1359 raft_consensus.cc:493] T 2a0060a4875345599fa7795fb8c284c0 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:55.371269  1359 raft_consensus.cc:3060] T 2a0060a4875345599fa7795fb8c284c0 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.372283  1353 ts_tablet_manager.cc:1434] T 708dcd04a2de4a6ea0c2436ae59b3aca P ade8f52c75914406a928ad61a925ed1b: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 12:14:55.373404  1353 tablet_bootstrap.cc:492] T b2b62eae23264a6aa96a0a5899444f0e P ade8f52c75914406a928ad61a925ed1b: Bootstrap starting.
I20260709 12:14:55.377072  1352 tablet_bootstrap.cc:654] T 023ba999f2974359812bb5a68e6a618c P 9281096d749a4bf691c774d3321672e7: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:55.379025  1200 leader_election.cc:343] T 062ef3d157f74d819a1e8c88524d15bb P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48fd723a77ba455eabb997723f60371b (127.20.196.129:40613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:55.382028  1353 tablet_bootstrap.cc:654] T b2b62eae23264a6aa96a0a5899444f0e P ade8f52c75914406a928ad61a925ed1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:55.383860  1351 tablet_bootstrap.cc:492] T 6f6d5246f47546cea93920208eb4c505 P 48fd723a77ba455eabb997723f60371b: No bootstrap required, opened a new log
I20260709 12:14:55.384462  1351 ts_tablet_manager.cc:1403] T 6f6d5246f47546cea93920208eb4c505 P 48fd723a77ba455eabb997723f60371b: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.003s
I20260709 12:14:55.387255  1310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062ef3d157f74d819a1e8c88524d15bb" candidate_uuid: "ade8f52c75914406a928ad61a925ed1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9281096d749a4bf691c774d3321672e7" is_pre_election: true
I20260709 12:14:55.387986  1310 raft_consensus.cc:2468] T 062ef3d157f74d819a1e8c88524d15bb P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ade8f52c75914406a928ad61a925ed1b in term 0.
I20260709 12:14:55.387799  1351 raft_consensus.cc:359] T 6f6d5246f47546cea93920208eb4c505 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.388568  1351 raft_consensus.cc:385] T 6f6d5246f47546cea93920208eb4c505 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:55.388962  1351 raft_consensus.cc:740] T 6f6d5246f47546cea93920208eb4c505 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48fd723a77ba455eabb997723f60371b, State: Initialized, Role: FOLLOWER
I20260709 12:14:55.389855  1310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a0060a4875345599fa7795fb8c284c0" candidate_uuid: "ade8f52c75914406a928ad61a925ed1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9281096d749a4bf691c774d3321672e7" is_pre_election: true
I20260709 12:14:55.389986  1351 consensus_queue.cc:260] T 6f6d5246f47546cea93920208eb4c505 P 48fd723a77ba455eabb997723f60371b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.390547  1310 raft_consensus.cc:2468] T 2a0060a4875345599fa7795fb8c284c0 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ade8f52c75914406a928ad61a925ed1b in term 0.
I20260709 12:14:55.390782  1359 raft_consensus.cc:515] T 2a0060a4875345599fa7795fb8c284c0 P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.392509  1351 ts_tablet_manager.cc:1434] T 6f6d5246f47546cea93920208eb4c505 P 48fd723a77ba455eabb997723f60371b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:14:55.394032  1200 leader_election.cc:304] T 062ef3d157f74d819a1e8c88524d15bb P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9281096d749a4bf691c774d3321672e7, ade8f52c75914406a928ad61a925ed1b; no voters: 48fd723a77ba455eabb997723f60371b
I20260709 12:14:55.395097  1370 raft_consensus.cc:2804] T 062ef3d157f74d819a1e8c88524d15bb P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:55.395437  1351 tablet_bootstrap.cc:492] T 2ef02663c5eb4a4c900ad78501828298 P 48fd723a77ba455eabb997723f60371b: Bootstrap starting.
I20260709 12:14:55.397969  1159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a0060a4875345599fa7795fb8c284c0" candidate_uuid: "ade8f52c75914406a928ad61a925ed1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48fd723a77ba455eabb997723f60371b"
I20260709 12:14:55.398602  1159 raft_consensus.cc:3060] T 2a0060a4875345599fa7795fb8c284c0 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.399286  1353 tablet_bootstrap.cc:492] T b2b62eae23264a6aa96a0a5899444f0e P ade8f52c75914406a928ad61a925ed1b: No bootstrap required, opened a new log
I20260709 12:14:55.399688  1353 ts_tablet_manager.cc:1403] T b2b62eae23264a6aa96a0a5899444f0e P ade8f52c75914406a928ad61a925ed1b: Time spent bootstrapping tablet: real 0.027s	user 0.006s	sys 0.007s
I20260709 12:14:55.401957  1353 raft_consensus.cc:359] T b2b62eae23264a6aa96a0a5899444f0e P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } }
I20260709 12:14:55.402443  1353 raft_consensus.cc:385] T b2b62eae23264a6aa96a0a5899444f0e P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:55.402621  1353 raft_consensus.cc:740] T b2b62eae23264a6aa96a0a5899444f0e P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade8f52c75914406a928ad61a925ed1b, State: Initialized, Role: FOLLOWER
I20260709 12:14:55.395447  1370 raft_consensus.cc:493] T 062ef3d157f74d819a1e8c88524d15bb P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:55.397460  1358 raft_consensus.cc:493] T 6f6d5246f47546cea93920208eb4c505 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.403264  1370 raft_consensus.cc:3060] T 062ef3d157f74d819a1e8c88524d15bb P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.403203  1353 consensus_queue.cc:260] T b2b62eae23264a6aa96a0a5899444f0e P ade8f52c75914406a928ad61a925ed1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } }
I20260709 12:14:55.403599  1358 raft_consensus.cc:515] T 6f6d5246f47546cea93920208eb4c505 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.406487  1358 leader_election.cc:290] T 6f6d5246f47546cea93920208eb4c505 P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ade8f52c75914406a928ad61a925ed1b (127.20.196.130:40533), 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381)
I20260709 12:14:55.409214  1353 ts_tablet_manager.cc:1434] T b2b62eae23264a6aa96a0a5899444f0e P ade8f52c75914406a928ad61a925ed1b: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:14:55.418308  1351 tablet_bootstrap.cc:654] T 2ef02663c5eb4a4c900ad78501828298 P 48fd723a77ba455eabb997723f60371b: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:55.418923  1353 tablet_bootstrap.cc:492] T fa8e4b22b550472e9de5f6a9cc8e173c P ade8f52c75914406a928ad61a925ed1b: Bootstrap starting.
I20260709 12:14:55.420243  1373 raft_consensus.cc:493] T 708dcd04a2de4a6ea0c2436ae59b3aca P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.420769  1373 raft_consensus.cc:515] T 708dcd04a2de4a6ea0c2436ae59b3aca P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.423413  1373 leader_election.cc:290] T 708dcd04a2de4a6ea0c2436ae59b3aca P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48fd723a77ba455eabb997723f60371b (127.20.196.129:40613), 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381)
I20260709 12:14:55.424428  1370 raft_consensus.cc:515] T 062ef3d157f74d819a1e8c88524d15bb P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.425480  1310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a0060a4875345599fa7795fb8c284c0" candidate_uuid: "ade8f52c75914406a928ad61a925ed1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9281096d749a4bf691c774d3321672e7"
I20260709 12:14:55.431666  1310 raft_consensus.cc:3060] T 2a0060a4875345599fa7795fb8c284c0 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.432526  1353 tablet_bootstrap.cc:654] T fa8e4b22b550472e9de5f6a9cc8e173c P ade8f52c75914406a928ad61a925ed1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:55.403324  1359 leader_election.cc:290] T 2a0060a4875345599fa7795fb8c284c0 P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 1 election: Requested vote from peers 48fd723a77ba455eabb997723f60371b (127.20.196.129:40613), 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381)
I20260709 12:14:55.427055  1309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708dcd04a2de4a6ea0c2436ae59b3aca" candidate_uuid: "ade8f52c75914406a928ad61a925ed1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9281096d749a4bf691c774d3321672e7" is_pre_election: true
W20260709 12:14:55.440237  1200 leader_election.cc:343] T 708dcd04a2de4a6ea0c2436ae59b3aca P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:55.440557  1352 tablet_bootstrap.cc:492] T 023ba999f2974359812bb5a68e6a618c P 9281096d749a4bf691c774d3321672e7: No bootstrap required, opened a new log
I20260709 12:14:55.430760  1160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708dcd04a2de4a6ea0c2436ae59b3aca" candidate_uuid: "ade8f52c75914406a928ad61a925ed1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48fd723a77ba455eabb997723f60371b" is_pre_election: true
I20260709 12:14:55.444108  1352 ts_tablet_manager.cc:1403] T 023ba999f2974359812bb5a68e6a618c P 9281096d749a4bf691c774d3321672e7: Time spent bootstrapping tablet: real 0.086s	user 0.009s	sys 0.015s
I20260709 12:14:55.428889  1159 raft_consensus.cc:2468] T 2a0060a4875345599fa7795fb8c284c0 P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade8f52c75914406a928ad61a925ed1b in term 1.
I20260709 12:14:55.444075  1160 raft_consensus.cc:2468] T 708dcd04a2de4a6ea0c2436ae59b3aca P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ade8f52c75914406a928ad61a925ed1b in term 0.
I20260709 12:14:55.447386  1200 leader_election.cc:304] T 708dcd04a2de4a6ea0c2436ae59b3aca P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48fd723a77ba455eabb997723f60371b, ade8f52c75914406a928ad61a925ed1b; no voters: 9281096d749a4bf691c774d3321672e7
I20260709 12:14:55.448647  1200 leader_election.cc:304] T 2a0060a4875345599fa7795fb8c284c0 P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48fd723a77ba455eabb997723f60371b, ade8f52c75914406a928ad61a925ed1b; no voters: 
I20260709 12:14:55.449774  1359 raft_consensus.cc:2804] T 708dcd04a2de4a6ea0c2436ae59b3aca P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:55.450289  1359 raft_consensus.cc:493] T 708dcd04a2de4a6ea0c2436ae59b3aca P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:55.450713  1359 raft_consensus.cc:3060] T 708dcd04a2de4a6ea0c2436ae59b3aca P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.450858  1373 raft_consensus.cc:2804] T 2a0060a4875345599fa7795fb8c284c0 P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:55.451076  1309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062ef3d157f74d819a1e8c88524d15bb" candidate_uuid: "ade8f52c75914406a928ad61a925ed1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9281096d749a4bf691c774d3321672e7"
I20260709 12:14:55.451893  1309 raft_consensus.cc:3060] T 062ef3d157f74d819a1e8c88524d15bb P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.459460  1159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062ef3d157f74d819a1e8c88524d15bb" candidate_uuid: "ade8f52c75914406a928ad61a925ed1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48fd723a77ba455eabb997723f60371b"
I20260709 12:14:55.449499  1352 raft_consensus.cc:359] T 023ba999f2974359812bb5a68e6a618c P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.461136  1352 raft_consensus.cc:385] T 023ba999f2974359812bb5a68e6a618c P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:55.462520  1352 raft_consensus.cc:740] T 023ba999f2974359812bb5a68e6a618c P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9281096d749a4bf691c774d3321672e7, State: Initialized, Role: FOLLOWER
I20260709 12:14:55.465618  1352 consensus_queue.cc:260] T 023ba999f2974359812bb5a68e6a618c P 9281096d749a4bf691c774d3321672e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.464226  1308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6d5246f47546cea93920208eb4c505" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9281096d749a4bf691c774d3321672e7" is_pre_election: true
I20260709 12:14:55.469580  1352 ts_tablet_manager.cc:1434] T 023ba999f2974359812bb5a68e6a618c P 9281096d749a4bf691c774d3321672e7: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.002s
I20260709 12:14:55.469732  1353 tablet_bootstrap.cc:492] T fa8e4b22b550472e9de5f6a9cc8e173c P ade8f52c75914406a928ad61a925ed1b: No bootstrap required, opened a new log
I20260709 12:14:55.470336  1353 ts_tablet_manager.cc:1403] T fa8e4b22b550472e9de5f6a9cc8e173c P ade8f52c75914406a928ad61a925ed1b: Time spent bootstrapping tablet: real 0.052s	user 0.020s	sys 0.021s
I20260709 12:14:55.470860  1352 tablet_bootstrap.cc:492] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7: Bootstrap starting.
I20260709 12:14:55.449599  1370 leader_election.cc:290] T 062ef3d157f74d819a1e8c88524d15bb P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 1 election: Requested vote from peers 48fd723a77ba455eabb997723f60371b (127.20.196.129:40613), 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381)
I20260709 12:14:55.475907  1357 raft_consensus.cc:493] T be816cce439f4fb9b32c1e557f424523 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.476521  1357 raft_consensus.cc:515] T be816cce439f4fb9b32c1e557f424523 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.473767  1353 raft_consensus.cc:359] T fa8e4b22b550472e9de5f6a9cc8e173c P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.477535  1353 raft_consensus.cc:385] T fa8e4b22b550472e9de5f6a9cc8e173c P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:55.477886  1353 raft_consensus.cc:740] T fa8e4b22b550472e9de5f6a9cc8e173c P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade8f52c75914406a928ad61a925ed1b, State: Initialized, Role: FOLLOWER
I20260709 12:14:55.478128  1351 tablet_bootstrap.cc:492] T 2ef02663c5eb4a4c900ad78501828298 P 48fd723a77ba455eabb997723f60371b: No bootstrap required, opened a new log
I20260709 12:14:55.478420  1235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6d5246f47546cea93920208eb4c505" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade8f52c75914406a928ad61a925ed1b" is_pre_election: true
I20260709 12:14:55.442350  1310 raft_consensus.cc:2468] T 2a0060a4875345599fa7795fb8c284c0 P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade8f52c75914406a928ad61a925ed1b in term 1.
I20260709 12:14:55.480136  1359 raft_consensus.cc:515] T 708dcd04a2de4a6ea0c2436ae59b3aca P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
W20260709 12:14:55.480801  1123 leader_election.cc:343] T 6f6d5246f47546cea93920208eb4c505 P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ade8f52c75914406a928ad61a925ed1b (127.20.196.130:40533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:55.478695  1351 ts_tablet_manager.cc:1403] T 2ef02663c5eb4a4c900ad78501828298 P 48fd723a77ba455eabb997723f60371b: Time spent bootstrapping tablet: real 0.083s	user 0.007s	sys 0.011s
I20260709 12:14:55.479928  1353 consensus_queue.cc:260] T fa8e4b22b550472e9de5f6a9cc8e173c P ade8f52c75914406a928ad61a925ed1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.482612  1359 leader_election.cc:290] T 708dcd04a2de4a6ea0c2436ae59b3aca P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 1 election: Requested vote from peers 48fd723a77ba455eabb997723f60371b (127.20.196.129:40613), 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381)
I20260709 12:14:55.482892  1357 leader_election.cc:290] T be816cce439f4fb9b32c1e557f424523 P 9281096d749a4bf691c774d3321672e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48fd723a77ba455eabb997723f60371b (127.20.196.129:40613), ade8f52c75914406a928ad61a925ed1b (127.20.196.130:40533)
I20260709 12:14:55.485188  1351 raft_consensus.cc:359] T 2ef02663c5eb4a4c900ad78501828298 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.486157  1351 raft_consensus.cc:385] T 2ef02663c5eb4a4c900ad78501828298 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:55.486599  1351 raft_consensus.cc:740] T 2ef02663c5eb4a4c900ad78501828298 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48fd723a77ba455eabb997723f60371b, State: Initialized, Role: FOLLOWER
W20260709 12:14:55.461711  1200 leader_election.cc:343] T 062ef3d157f74d819a1e8c88524d15bb P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48fd723a77ba455eabb997723f60371b (127.20.196.129:40613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:55.487821  1352 tablet_bootstrap.cc:654] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:55.487725  1351 consensus_queue.cc:260] T 2ef02663c5eb4a4c900ad78501828298 P 48fd723a77ba455eabb997723f60371b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.491256  1351 ts_tablet_manager.cc:1434] T 2ef02663c5eb4a4c900ad78501828298 P 48fd723a77ba455eabb997723f60371b: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:14:55.492367  1351 tablet_bootstrap.cc:492] T 062ef3d157f74d819a1e8c88524d15bb P 48fd723a77ba455eabb997723f60371b: Bootstrap starting.
I20260709 12:14:55.495801  1309 raft_consensus.cc:2468] T 062ef3d157f74d819a1e8c88524d15bb P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade8f52c75914406a928ad61a925ed1b in term 1.
I20260709 12:14:55.502899  1373 raft_consensus.cc:697] T 2a0060a4875345599fa7795fb8c284c0 P ade8f52c75914406a928ad61a925ed1b [term 1 LEADER]: Becoming Leader. State: Replica: ade8f52c75914406a928ad61a925ed1b, State: Running, Role: LEADER
I20260709 12:14:55.504122  1373 consensus_queue.cc:237] T 2a0060a4875345599fa7795fb8c284c0 P ade8f52c75914406a928ad61a925ed1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.501569  1351 tablet_bootstrap.cc:654] T 062ef3d157f74d819a1e8c88524d15bb P 48fd723a77ba455eabb997723f60371b: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:55.515949  1200 leader_election.cc:304] T 062ef3d157f74d819a1e8c88524d15bb P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9281096d749a4bf691c774d3321672e7, ade8f52c75914406a928ad61a925ed1b; no voters: 48fd723a77ba455eabb997723f60371b
I20260709 12:14:55.516294  1159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be816cce439f4fb9b32c1e557f424523" candidate_uuid: "9281096d749a4bf691c774d3321672e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48fd723a77ba455eabb997723f60371b" is_pre_election: true
I20260709 12:14:55.516955  1159 raft_consensus.cc:2468] T be816cce439f4fb9b32c1e557f424523 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9281096d749a4bf691c774d3321672e7 in term 0.
I20260709 12:14:55.517424  1387 raft_consensus.cc:2804] T 062ef3d157f74d819a1e8c88524d15bb P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:55.518009  1387 raft_consensus.cc:697] T 062ef3d157f74d819a1e8c88524d15bb P ade8f52c75914406a928ad61a925ed1b [term 1 LEADER]: Becoming Leader. State: Replica: ade8f52c75914406a928ad61a925ed1b, State: Running, Role: LEADER
I20260709 12:14:55.518568  1274 leader_election.cc:304] T be816cce439f4fb9b32c1e557f424523 P 9281096d749a4bf691c774d3321672e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48fd723a77ba455eabb997723f60371b, 9281096d749a4bf691c774d3321672e7; no voters: 
I20260709 12:14:55.519006  1387 consensus_queue.cc:237] T 062ef3d157f74d819a1e8c88524d15bb P ade8f52c75914406a928ad61a925ed1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.519541  1357 raft_consensus.cc:2804] T be816cce439f4fb9b32c1e557f424523 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:55.523461  1357 raft_consensus.cc:493] T be816cce439f4fb9b32c1e557f424523 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:55.524003  1357 raft_consensus.cc:3060] T be816cce439f4fb9b32c1e557f424523 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.524037  1309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708dcd04a2de4a6ea0c2436ae59b3aca" candidate_uuid: "ade8f52c75914406a928ad61a925ed1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9281096d749a4bf691c774d3321672e7"
W20260709 12:14:55.525480  1200 leader_election.cc:343] T 708dcd04a2de4a6ea0c2436ae59b3aca P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:55.526619  1351 tablet_bootstrap.cc:492] T 062ef3d157f74d819a1e8c88524d15bb P 48fd723a77ba455eabb997723f60371b: No bootstrap required, opened a new log
I20260709 12:14:55.527174  1351 ts_tablet_manager.cc:1403] T 062ef3d157f74d819a1e8c88524d15bb P 48fd723a77ba455eabb997723f60371b: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.003s
I20260709 12:14:55.527845  1055 catalog_manager.cc:5697] T 2a0060a4875345599fa7795fb8c284c0 P ade8f52c75914406a928ad61a925ed1b reported cstate change: term changed from 0 to 1, leader changed from <none> to ade8f52c75914406a928ad61a925ed1b (127.20.196.130). New cstate: current_term: 1 leader_uuid: "ade8f52c75914406a928ad61a925ed1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:55.530170  1351 raft_consensus.cc:359] T 062ef3d157f74d819a1e8c88524d15bb P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.530912  1351 raft_consensus.cc:385] T 062ef3d157f74d819a1e8c88524d15bb P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:14:55.484956  1125 leader_election.cc:343] T 6f6d5246f47546cea93920208eb4c505 P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:55.531410  1351 raft_consensus.cc:740] T 062ef3d157f74d819a1e8c88524d15bb P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48fd723a77ba455eabb997723f60371b, State: Initialized, Role: FOLLOWER
I20260709 12:14:55.531942  1125 leader_election.cc:304] T 6f6d5246f47546cea93920208eb4c505 P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48fd723a77ba455eabb997723f60371b; no voters: 9281096d749a4bf691c774d3321672e7, ade8f52c75914406a928ad61a925ed1b
I20260709 12:14:55.532416  1351 consensus_queue.cc:260] T 062ef3d157f74d819a1e8c88524d15bb P 48fd723a77ba455eabb997723f60371b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
W20260709 12:14:55.533095  1125 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.131:43381, user_credentials={real_user=slave}} blocked reactor thread for 48292.5us
I20260709 12:14:55.534793  1358 raft_consensus.cc:2749] T 6f6d5246f47546cea93920208eb4c505 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:55.535775  1358 raft_consensus.cc:493] T b2b62eae23264a6aa96a0a5899444f0e P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.536239  1358 raft_consensus.cc:515] T b2b62eae23264a6aa96a0a5899444f0e P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } }
I20260709 12:14:55.538516  1358 leader_election.cc:290] T b2b62eae23264a6aa96a0a5899444f0e P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381), ade8f52c75914406a928ad61a925ed1b (127.20.196.130:40533)
I20260709 12:14:55.539474  1235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be816cce439f4fb9b32c1e557f424523" candidate_uuid: "9281096d749a4bf691c774d3321672e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade8f52c75914406a928ad61a925ed1b" is_pre_election: true
I20260709 12:14:55.540238  1235 raft_consensus.cc:2468] T be816cce439f4fb9b32c1e557f424523 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9281096d749a4bf691c774d3321672e7 in term 0.
I20260709 12:14:55.542173  1351 ts_tablet_manager.cc:1434] T 062ef3d157f74d819a1e8c88524d15bb P 48fd723a77ba455eabb997723f60371b: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.008s
I20260709 12:14:55.542637  1235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b62eae23264a6aa96a0a5899444f0e" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade8f52c75914406a928ad61a925ed1b" is_pre_election: true
I20260709 12:14:55.543819  1235 raft_consensus.cc:2468] T b2b62eae23264a6aa96a0a5899444f0e P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48fd723a77ba455eabb997723f60371b in term 0.
I20260709 12:14:55.545504  1123 leader_election.cc:304] T b2b62eae23264a6aa96a0a5899444f0e P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48fd723a77ba455eabb997723f60371b, ade8f52c75914406a928ad61a925ed1b; no voters: 
I20260709 12:14:55.546761  1395 raft_consensus.cc:2804] T b2b62eae23264a6aa96a0a5899444f0e P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:55.546818  1352 tablet_bootstrap.cc:492] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7: No bootstrap required, opened a new log
I20260709 12:14:55.547255  1395 raft_consensus.cc:493] T b2b62eae23264a6aa96a0a5899444f0e P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:55.547809  1395 raft_consensus.cc:3060] T b2b62eae23264a6aa96a0a5899444f0e P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.547957  1352 ts_tablet_manager.cc:1403] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7: Time spent bootstrapping tablet: real 0.077s	user 0.020s	sys 0.003s
I20260709 12:14:55.548782  1357 raft_consensus.cc:515] T be816cce439f4fb9b32c1e557f424523 P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.553220  1159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708dcd04a2de4a6ea0c2436ae59b3aca" candidate_uuid: "ade8f52c75914406a928ad61a925ed1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48fd723a77ba455eabb997723f60371b"
I20260709 12:14:55.555155  1309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b62eae23264a6aa96a0a5899444f0e" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9281096d749a4bf691c774d3321672e7" is_pre_election: true
I20260709 12:14:55.555395  1159 raft_consensus.cc:3060] T 708dcd04a2de4a6ea0c2436ae59b3aca P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.555804  1309 raft_consensus.cc:2468] T b2b62eae23264a6aa96a0a5899444f0e P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48fd723a77ba455eabb997723f60371b in term 0.
I20260709 12:14:55.552943  1352 raft_consensus.cc:359] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.560446  1352 raft_consensus.cc:385] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:55.560792  1352 raft_consensus.cc:740] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9281096d749a4bf691c774d3321672e7, State: Initialized, Role: FOLLOWER
I20260709 12:14:55.561928  1395 raft_consensus.cc:515] T b2b62eae23264a6aa96a0a5899444f0e P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } }
I20260709 12:14:55.564527  1357 leader_election.cc:290] T be816cce439f4fb9b32c1e557f424523 P 9281096d749a4bf691c774d3321672e7 [CANDIDATE]: Term 1 election: Requested vote from peers 48fd723a77ba455eabb997723f60371b (127.20.196.129:40613), ade8f52c75914406a928ad61a925ed1b (127.20.196.130:40533)
I20260709 12:14:55.564975  1352 consensus_queue.cc:260] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.566164  1160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be816cce439f4fb9b32c1e557f424523" candidate_uuid: "9281096d749a4bf691c774d3321672e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48fd723a77ba455eabb997723f60371b"
I20260709 12:14:55.566923  1160 raft_consensus.cc:3060] T be816cce439f4fb9b32c1e557f424523 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.567185  1309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b62eae23264a6aa96a0a5899444f0e" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9281096d749a4bf691c774d3321672e7"
I20260709 12:14:55.567811  1309 raft_consensus.cc:3060] T b2b62eae23264a6aa96a0a5899444f0e P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.568408  1352 ts_tablet_manager.cc:1434] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 12:14:55.569448  1352 tablet_bootstrap.cc:492] T 708dcd04a2de4a6ea0c2436ae59b3aca P 9281096d749a4bf691c774d3321672e7: Bootstrap starting.
I20260709 12:14:55.566169  1235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be816cce439f4fb9b32c1e557f424523" candidate_uuid: "9281096d749a4bf691c774d3321672e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade8f52c75914406a928ad61a925ed1b"
I20260709 12:14:55.570312  1235 raft_consensus.cc:3060] T be816cce439f4fb9b32c1e557f424523 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.575882  1309 raft_consensus.cc:2468] T b2b62eae23264a6aa96a0a5899444f0e P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48fd723a77ba455eabb997723f60371b in term 1.
I20260709 12:14:55.575902  1160 raft_consensus.cc:2468] T be816cce439f4fb9b32c1e557f424523 P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9281096d749a4bf691c774d3321672e7 in term 1.
I20260709 12:14:55.576366  1352 tablet_bootstrap.cc:654] T 708dcd04a2de4a6ea0c2436ae59b3aca P 9281096d749a4bf691c774d3321672e7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:55.577582  1274 leader_election.cc:304] T be816cce439f4fb9b32c1e557f424523 P 9281096d749a4bf691c774d3321672e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48fd723a77ba455eabb997723f60371b, 9281096d749a4bf691c774d3321672e7; no voters: 
I20260709 12:14:55.484120  1353 ts_tablet_manager.cc:1434] T fa8e4b22b550472e9de5f6a9cc8e173c P ade8f52c75914406a928ad61a925ed1b: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.002s
I20260709 12:14:55.578876  1357 raft_consensus.cc:2804] T be816cce439f4fb9b32c1e557f424523 P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:55.579465  1353 tablet_bootstrap.cc:492] T 2ef02663c5eb4a4c900ad78501828298 P ade8f52c75914406a928ad61a925ed1b: Bootstrap starting.
I20260709 12:14:55.577585  1125 leader_election.cc:304] T b2b62eae23264a6aa96a0a5899444f0e P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48fd723a77ba455eabb997723f60371b, 9281096d749a4bf691c774d3321672e7; no voters: 
I20260709 12:14:55.595889  1353 tablet_bootstrap.cc:654] T 2ef02663c5eb4a4c900ad78501828298 P ade8f52c75914406a928ad61a925ed1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:55.596338  1399 raft_consensus.cc:493] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.579671  1159 raft_consensus.cc:2468] T 708dcd04a2de4a6ea0c2436ae59b3aca P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade8f52c75914406a928ad61a925ed1b in term 1.
I20260709 12:14:55.597167  1399 raft_consensus.cc:515] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.598277  1200 leader_election.cc:304] T 708dcd04a2de4a6ea0c2436ae59b3aca P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48fd723a77ba455eabb997723f60371b, ade8f52c75914406a928ad61a925ed1b; no voters: 9281096d749a4bf691c774d3321672e7
I20260709 12:14:55.599895  1387 raft_consensus.cc:2804] T 708dcd04a2de4a6ea0c2436ae59b3aca P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:55.600517  1387 raft_consensus.cc:697] T 708dcd04a2de4a6ea0c2436ae59b3aca P ade8f52c75914406a928ad61a925ed1b [term 1 LEADER]: Becoming Leader. State: Replica: ade8f52c75914406a928ad61a925ed1b, State: Running, Role: LEADER
I20260709 12:14:55.601610  1387 consensus_queue.cc:237] T 708dcd04a2de4a6ea0c2436ae59b3aca P ade8f52c75914406a928ad61a925ed1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.604954  1352 tablet_bootstrap.cc:492] T 708dcd04a2de4a6ea0c2436ae59b3aca P 9281096d749a4bf691c774d3321672e7: No bootstrap required, opened a new log
I20260709 12:14:55.604992  1234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b62eae23264a6aa96a0a5899444f0e" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade8f52c75914406a928ad61a925ed1b"
I20260709 12:14:55.595132  1235 raft_consensus.cc:2468] T be816cce439f4fb9b32c1e557f424523 P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9281096d749a4bf691c774d3321672e7 in term 1.
I20260709 12:14:55.595228  1055 catalog_manager.cc:5697] T 062ef3d157f74d819a1e8c88524d15bb P ade8f52c75914406a928ad61a925ed1b reported cstate change: term changed from 0 to 1, leader changed from <none> to ade8f52c75914406a928ad61a925ed1b (127.20.196.130). New cstate: current_term: 1 leader_uuid: "ade8f52c75914406a928ad61a925ed1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:55.607607  1234 raft_consensus.cc:3060] T b2b62eae23264a6aa96a0a5899444f0e P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.608417  1233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6d5246f47546cea93920208eb4c505" candidate_uuid: "9281096d749a4bf691c774d3321672e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade8f52c75914406a928ad61a925ed1b" is_pre_election: true
W20260709 12:14:55.612123  1272 leader_election.cc:343] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ade8f52c75914406a928ad61a925ed1b (127.20.196.130:40533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:55.616109  1234 raft_consensus.cc:2468] T b2b62eae23264a6aa96a0a5899444f0e P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48fd723a77ba455eabb997723f60371b in term 1.
I20260709 12:14:55.616271  1395 leader_election.cc:290] T b2b62eae23264a6aa96a0a5899444f0e P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 election: Requested vote from peers 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381), ade8f52c75914406a928ad61a925ed1b (127.20.196.130:40533)
I20260709 12:14:55.616768  1399 leader_election.cc:290] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48fd723a77ba455eabb997723f60371b (127.20.196.129:40613), ade8f52c75914406a928ad61a925ed1b (127.20.196.130:40533)
I20260709 12:14:55.617079  1352 ts_tablet_manager.cc:1403] T 708dcd04a2de4a6ea0c2436ae59b3aca P 9281096d749a4bf691c774d3321672e7: Time spent bootstrapping tablet: real 0.048s	user 0.014s	sys 0.012s
I20260709 12:14:55.617702  1396 raft_consensus.cc:2804] T b2b62eae23264a6aa96a0a5899444f0e P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:55.621388  1396 raft_consensus.cc:697] T b2b62eae23264a6aa96a0a5899444f0e P 48fd723a77ba455eabb997723f60371b [term 1 LEADER]: Becoming Leader. State: Replica: 48fd723a77ba455eabb997723f60371b, State: Running, Role: LEADER
I20260709 12:14:55.620865  1352 raft_consensus.cc:359] T 708dcd04a2de4a6ea0c2436ae59b3aca P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.622380  1352 raft_consensus.cc:385] T 708dcd04a2de4a6ea0c2436ae59b3aca P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:55.622753  1352 raft_consensus.cc:740] T 708dcd04a2de4a6ea0c2436ae59b3aca P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9281096d749a4bf691c774d3321672e7, State: Initialized, Role: FOLLOWER
I20260709 12:14:55.623034  1353 tablet_bootstrap.cc:492] T 2ef02663c5eb4a4c900ad78501828298 P ade8f52c75914406a928ad61a925ed1b: No bootstrap required, opened a new log
I20260709 12:14:55.622426  1396 consensus_queue.cc:237] T b2b62eae23264a6aa96a0a5899444f0e P 48fd723a77ba455eabb997723f60371b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } }
I20260709 12:14:55.623793  1159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6d5246f47546cea93920208eb4c505" candidate_uuid: "9281096d749a4bf691c774d3321672e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48fd723a77ba455eabb997723f60371b" is_pre_election: true
I20260709 12:14:55.623543  1353 ts_tablet_manager.cc:1403] T 2ef02663c5eb4a4c900ad78501828298 P ade8f52c75914406a928ad61a925ed1b: Time spent bootstrapping tablet: real 0.044s	user 0.027s	sys 0.010s
I20260709 12:14:55.624595  1159 raft_consensus.cc:2468] T 6f6d5246f47546cea93920208eb4c505 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9281096d749a4bf691c774d3321672e7 in term 0.
I20260709 12:14:55.623675  1352 consensus_queue.cc:260] T 708dcd04a2de4a6ea0c2436ae59b3aca P 9281096d749a4bf691c774d3321672e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.587075  1357 raft_consensus.cc:697] T be816cce439f4fb9b32c1e557f424523 P 9281096d749a4bf691c774d3321672e7 [term 1 LEADER]: Becoming Leader. State: Replica: 9281096d749a4bf691c774d3321672e7, State: Running, Role: LEADER
I20260709 12:14:55.625916  1274 leader_election.cc:304] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48fd723a77ba455eabb997723f60371b, 9281096d749a4bf691c774d3321672e7; no voters: ade8f52c75914406a928ad61a925ed1b
I20260709 12:14:55.626379  1055 catalog_manager.cc:5697] T 708dcd04a2de4a6ea0c2436ae59b3aca P ade8f52c75914406a928ad61a925ed1b reported cstate change: term changed from 0 to 1, leader changed from <none> to ade8f52c75914406a928ad61a925ed1b (127.20.196.130). New cstate: current_term: 1 leader_uuid: "ade8f52c75914406a928ad61a925ed1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:55.627393  1357 consensus_queue.cc:237] T be816cce439f4fb9b32c1e557f424523 P 9281096d749a4bf691c774d3321672e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.627815  1399 raft_consensus.cc:2804] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:55.627682  1353 raft_consensus.cc:359] T 2ef02663c5eb4a4c900ad78501828298 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.628645  1399 raft_consensus.cc:493] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:55.629025  1353 raft_consensus.cc:385] T 2ef02663c5eb4a4c900ad78501828298 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:55.629108  1399 raft_consensus.cc:3060] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.629424  1353 raft_consensus.cc:740] T 2ef02663c5eb4a4c900ad78501828298 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade8f52c75914406a928ad61a925ed1b, State: Initialized, Role: FOLLOWER
I20260709 12:14:55.630384  1353 consensus_queue.cc:260] T 2ef02663c5eb4a4c900ad78501828298 P ade8f52c75914406a928ad61a925ed1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.633610  1353 ts_tablet_manager.cc:1434] T 2ef02663c5eb4a4c900ad78501828298 P ade8f52c75914406a928ad61a925ed1b: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 12:14:55.636273  1352 ts_tablet_manager.cc:1434] T 708dcd04a2de4a6ea0c2436ae59b3aca P 9281096d749a4bf691c774d3321672e7: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:14:55.636821  1353 tablet_bootstrap.cc:492] T 6f6d5246f47546cea93920208eb4c505 P ade8f52c75914406a928ad61a925ed1b: Bootstrap starting.
I20260709 12:14:55.637360  1352 tablet_bootstrap.cc:492] T fa8e4b22b550472e9de5f6a9cc8e173c P 9281096d749a4bf691c774d3321672e7: Bootstrap starting.
I20260709 12:14:55.640270  1395 raft_consensus.cc:493] T 023ba999f2974359812bb5a68e6a618c P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.640774  1395 raft_consensus.cc:515] T 023ba999f2974359812bb5a68e6a618c P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.642995  1395 leader_election.cc:290] T 023ba999f2974359812bb5a68e6a618c P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ade8f52c75914406a928ad61a925ed1b (127.20.196.130:40533), 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381)
I20260709 12:14:55.644632  1353 tablet_bootstrap.cc:654] T 6f6d5246f47546cea93920208eb4c505 P ade8f52c75914406a928ad61a925ed1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:55.644979  1234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023ba999f2974359812bb5a68e6a618c" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade8f52c75914406a928ad61a925ed1b" is_pre_election: true
I20260709 12:14:55.645666  1234 raft_consensus.cc:2468] T 023ba999f2974359812bb5a68e6a618c P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48fd723a77ba455eabb997723f60371b in term 0.
I20260709 12:14:55.646267  1399 raft_consensus.cc:515] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.646956  1123 leader_election.cc:304] T 023ba999f2974359812bb5a68e6a618c P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48fd723a77ba455eabb997723f60371b, ade8f52c75914406a928ad61a925ed1b; no voters: 
I20260709 12:14:55.647964  1395 raft_consensus.cc:2804] T 023ba999f2974359812bb5a68e6a618c P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:55.648474  1395 raft_consensus.cc:493] T 023ba999f2974359812bb5a68e6a618c P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:55.648916  1395 raft_consensus.cc:3060] T 023ba999f2974359812bb5a68e6a618c P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.650030  1159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6d5246f47546cea93920208eb4c505" candidate_uuid: "9281096d749a4bf691c774d3321672e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48fd723a77ba455eabb997723f60371b"
I20260709 12:14:55.650705  1159 raft_consensus.cc:3060] T 6f6d5246f47546cea93920208eb4c505 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.655930  1353 tablet_bootstrap.cc:492] T 6f6d5246f47546cea93920208eb4c505 P ade8f52c75914406a928ad61a925ed1b: No bootstrap required, opened a new log
I20260709 12:14:55.656510  1353 ts_tablet_manager.cc:1403] T 6f6d5246f47546cea93920208eb4c505 P ade8f52c75914406a928ad61a925ed1b: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.006s
I20260709 12:14:55.658792  1395 raft_consensus.cc:515] T 023ba999f2974359812bb5a68e6a618c P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.659548  1353 raft_consensus.cc:359] T 6f6d5246f47546cea93920208eb4c505 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.660318  1353 raft_consensus.cc:385] T 6f6d5246f47546cea93920208eb4c505 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:55.661715  1234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023ba999f2974359812bb5a68e6a618c" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade8f52c75914406a928ad61a925ed1b"
I20260709 12:14:55.661221  1055 catalog_manager.cc:5697] T b2b62eae23264a6aa96a0a5899444f0e P 48fd723a77ba455eabb997723f60371b reported cstate change: term changed from 0 to 1, leader changed from <none> to 48fd723a77ba455eabb997723f60371b (127.20.196.129). New cstate: current_term: 1 leader_uuid: "48fd723a77ba455eabb997723f60371b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:55.662340  1234 raft_consensus.cc:3060] T 023ba999f2974359812bb5a68e6a618c P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.663579  1387 raft_consensus.cc:493] T fa8e4b22b550472e9de5f6a9cc8e173c P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.660607  1353 raft_consensus.cc:740] T 6f6d5246f47546cea93920208eb4c505 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade8f52c75914406a928ad61a925ed1b, State: Initialized, Role: FOLLOWER
I20260709 12:14:55.664073  1387 raft_consensus.cc:515] T fa8e4b22b550472e9de5f6a9cc8e173c P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.665174  1353 consensus_queue.cc:260] T 6f6d5246f47546cea93920208eb4c505 P ade8f52c75914406a928ad61a925ed1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.666379  1387 leader_election.cc:290] T fa8e4b22b550472e9de5f6a9cc8e173c P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48fd723a77ba455eabb997723f60371b (127.20.196.129:40613), 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381)
I20260709 12:14:55.667649  1353 ts_tablet_manager.cc:1434] T 6f6d5246f47546cea93920208eb4c505 P ade8f52c75914406a928ad61a925ed1b: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:14:55.663041  1056 catalog_manager.cc:5697] T be816cce439f4fb9b32c1e557f424523 P 9281096d749a4bf691c774d3321672e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9281096d749a4bf691c774d3321672e7 (127.20.196.131). New cstate: current_term: 1 leader_uuid: "9281096d749a4bf691c774d3321672e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:55.669518  1160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8e4b22b550472e9de5f6a9cc8e173c" candidate_uuid: "ade8f52c75914406a928ad61a925ed1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48fd723a77ba455eabb997723f60371b" is_pre_election: true
I20260709 12:14:55.670210  1160 raft_consensus.cc:2468] T fa8e4b22b550472e9de5f6a9cc8e173c P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ade8f52c75914406a928ad61a925ed1b in term 0.
I20260709 12:14:55.671670  1200 leader_election.cc:304] T fa8e4b22b550472e9de5f6a9cc8e173c P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48fd723a77ba455eabb997723f60371b, ade8f52c75914406a928ad61a925ed1b; no voters: 
I20260709 12:14:55.672510  1387 raft_consensus.cc:2804] T fa8e4b22b550472e9de5f6a9cc8e173c P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:55.672873  1387 raft_consensus.cc:493] T fa8e4b22b550472e9de5f6a9cc8e173c P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:55.673208  1387 raft_consensus.cc:3060] T fa8e4b22b550472e9de5f6a9cc8e173c P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.675143  1399 leader_election.cc:290] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7 [CANDIDATE]: Term 1 election: Requested vote from peers 48fd723a77ba455eabb997723f60371b (127.20.196.129:40613), ade8f52c75914406a928ad61a925ed1b (127.20.196.130:40533)
I20260709 12:14:55.675438  1357 raft_consensus.cc:493] T 708dcd04a2de4a6ea0c2436ae59b3aca P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.676230  1357 raft_consensus.cc:515] T 708dcd04a2de4a6ea0c2436ae59b3aca P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.678821  1396 raft_consensus.cc:493] T 2ef02663c5eb4a4c900ad78501828298 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.679141  1352 tablet_bootstrap.cc:654] T fa8e4b22b550472e9de5f6a9cc8e173c P 9281096d749a4bf691c774d3321672e7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:55.679402  1396 raft_consensus.cc:515] T 2ef02663c5eb4a4c900ad78501828298 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.674031  1159 raft_consensus.cc:2468] T 6f6d5246f47546cea93920208eb4c505 P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9281096d749a4bf691c774d3321672e7 in term 1.
I20260709 12:14:55.682785  1274 leader_election.cc:304] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48fd723a77ba455eabb997723f60371b, 9281096d749a4bf691c774d3321672e7; no voters: 
I20260709 12:14:55.683729  1399 raft_consensus.cc:2804] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:55.684235  1399 raft_consensus.cc:697] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7 [term 1 LEADER]: Becoming Leader. State: Replica: 9281096d749a4bf691c774d3321672e7, State: Running, Role: LEADER
I20260709 12:14:55.685144  1399 consensus_queue.cc:237] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.688091  1396 leader_election.cc:290] T 2ef02663c5eb4a4c900ad78501828298 P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ade8f52c75914406a928ad61a925ed1b (127.20.196.130:40533), 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381)
I20260709 12:14:55.688805  1235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef02663c5eb4a4c900ad78501828298" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade8f52c75914406a928ad61a925ed1b" is_pre_election: true
I20260709 12:14:55.691826  1235 raft_consensus.cc:2468] T 2ef02663c5eb4a4c900ad78501828298 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48fd723a77ba455eabb997723f60371b in term 0.
I20260709 12:14:55.692196  1357 leader_election.cc:290] T 708dcd04a2de4a6ea0c2436ae59b3aca P 9281096d749a4bf691c774d3321672e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48fd723a77ba455eabb997723f60371b (127.20.196.129:40613), ade8f52c75914406a928ad61a925ed1b (127.20.196.130:40533)
I20260709 12:14:55.689309  1234 raft_consensus.cc:2468] T 023ba999f2974359812bb5a68e6a618c P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48fd723a77ba455eabb997723f60371b in term 1.
I20260709 12:14:55.692226  1159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708dcd04a2de4a6ea0c2436ae59b3aca" candidate_uuid: "9281096d749a4bf691c774d3321672e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48fd723a77ba455eabb997723f60371b" is_pre_election: true
I20260709 12:14:55.692900  1123 leader_election.cc:304] T 2ef02663c5eb4a4c900ad78501828298 P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48fd723a77ba455eabb997723f60371b, ade8f52c75914406a928ad61a925ed1b; no voters: 
I20260709 12:14:55.693534  1159 raft_consensus.cc:2393] T 708dcd04a2de4a6ea0c2436ae59b3aca P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9281096d749a4bf691c774d3321672e7 in current term 1: Already voted for candidate ade8f52c75914406a928ad61a925ed1b in this term.
I20260709 12:14:55.694299  1396 raft_consensus.cc:2804] T 2ef02663c5eb4a4c900ad78501828298 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:55.694471  1123 leader_election.cc:304] T 023ba999f2974359812bb5a68e6a618c P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48fd723a77ba455eabb997723f60371b, ade8f52c75914406a928ad61a925ed1b; no voters: 
I20260709 12:14:55.694738  1396 raft_consensus.cc:493] T 2ef02663c5eb4a4c900ad78501828298 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:55.695147  1396 raft_consensus.cc:3060] T 2ef02663c5eb4a4c900ad78501828298 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.695396  1358 raft_consensus.cc:2804] T 023ba999f2974359812bb5a68e6a618c P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:55.697511  1399 raft_consensus.cc:493] T 2ef02663c5eb4a4c900ad78501828298 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.697304  1387 raft_consensus.cc:515] T fa8e4b22b550472e9de5f6a9cc8e173c P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.698040  1399 raft_consensus.cc:515] T 2ef02663c5eb4a4c900ad78501828298 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.703773  1387 leader_election.cc:290] T fa8e4b22b550472e9de5f6a9cc8e173c P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 1 election: Requested vote from peers 48fd723a77ba455eabb997723f60371b (127.20.196.129:40613), 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381)
I20260709 12:14:55.703889  1159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef02663c5eb4a4c900ad78501828298" candidate_uuid: "9281096d749a4bf691c774d3321672e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48fd723a77ba455eabb997723f60371b" is_pre_election: true
I20260709 12:14:55.703295  1058 catalog_manager.cc:5697] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9281096d749a4bf691c774d3321672e7 (127.20.196.131). New cstate: current_term: 1 leader_uuid: "9281096d749a4bf691c774d3321672e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:55.704460  1160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8e4b22b550472e9de5f6a9cc8e173c" candidate_uuid: "ade8f52c75914406a928ad61a925ed1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48fd723a77ba455eabb997723f60371b"
I20260709 12:14:55.705052  1160 raft_consensus.cc:3060] T fa8e4b22b550472e9de5f6a9cc8e173c P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.705119  1399 leader_election.cc:290] T 2ef02663c5eb4a4c900ad78501828298 P 9281096d749a4bf691c774d3321672e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48fd723a77ba455eabb997723f60371b (127.20.196.129:40613), ade8f52c75914406a928ad61a925ed1b (127.20.196.130:40533)
I20260709 12:14:55.709519  1234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6d5246f47546cea93920208eb4c505" candidate_uuid: "9281096d749a4bf691c774d3321672e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade8f52c75914406a928ad61a925ed1b"
I20260709 12:14:55.710536  1234 raft_consensus.cc:3060] T 6f6d5246f47546cea93920208eb4c505 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.712672  1160 raft_consensus.cc:2468] T fa8e4b22b550472e9de5f6a9cc8e173c P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade8f52c75914406a928ad61a925ed1b in term 1.
I20260709 12:14:55.713898  1200 leader_election.cc:304] T fa8e4b22b550472e9de5f6a9cc8e173c P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48fd723a77ba455eabb997723f60371b, ade8f52c75914406a928ad61a925ed1b; no voters: 
I20260709 12:14:55.714762  1387 raft_consensus.cc:2804] T fa8e4b22b550472e9de5f6a9cc8e173c P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:55.691033  1395 leader_election.cc:290] T 023ba999f2974359812bb5a68e6a618c P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 election: Requested vote from peers ade8f52c75914406a928ad61a925ed1b (127.20.196.130:40533), 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381)
I20260709 12:14:55.716333  1387 raft_consensus.cc:697] T fa8e4b22b550472e9de5f6a9cc8e173c P ade8f52c75914406a928ad61a925ed1b [term 1 LEADER]: Becoming Leader. State: Replica: ade8f52c75914406a928ad61a925ed1b, State: Running, Role: LEADER
I20260709 12:14:55.718883  1387 consensus_queue.cc:237] T fa8e4b22b550472e9de5f6a9cc8e173c P ade8f52c75914406a928ad61a925ed1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.722862  1235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708dcd04a2de4a6ea0c2436ae59b3aca" candidate_uuid: "9281096d749a4bf691c774d3321672e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade8f52c75914406a928ad61a925ed1b" is_pre_election: true
I20260709 12:14:55.723958  1352 tablet_bootstrap.cc:492] T fa8e4b22b550472e9de5f6a9cc8e173c P 9281096d749a4bf691c774d3321672e7: No bootstrap required, opened a new log
I20260709 12:14:55.723759  1233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef02663c5eb4a4c900ad78501828298" candidate_uuid: "9281096d749a4bf691c774d3321672e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade8f52c75914406a928ad61a925ed1b" is_pre_election: true
I20260709 12:14:55.724499  1352 ts_tablet_manager.cc:1403] T fa8e4b22b550472e9de5f6a9cc8e173c P 9281096d749a4bf691c774d3321672e7: Time spent bootstrapping tablet: real 0.087s	user 0.016s	sys 0.013s
I20260709 12:14:55.724591  1233 raft_consensus.cc:2468] T 2ef02663c5eb4a4c900ad78501828298 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9281096d749a4bf691c774d3321672e7 in term 0.
I20260709 12:14:55.724730  1309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8e4b22b550472e9de5f6a9cc8e173c" candidate_uuid: "ade8f52c75914406a928ad61a925ed1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9281096d749a4bf691c774d3321672e7" is_pre_election: true
I20260709 12:14:55.726183  1310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8e4b22b550472e9de5f6a9cc8e173c" candidate_uuid: "ade8f52c75914406a928ad61a925ed1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9281096d749a4bf691c774d3321672e7"
I20260709 12:14:55.727842  1352 raft_consensus.cc:359] T fa8e4b22b550472e9de5f6a9cc8e173c P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.728698  1352 raft_consensus.cc:385] T fa8e4b22b550472e9de5f6a9cc8e173c P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:55.729084  1352 raft_consensus.cc:740] T fa8e4b22b550472e9de5f6a9cc8e173c P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9281096d749a4bf691c774d3321672e7, State: Initialized, Role: FOLLOWER
I20260709 12:14:55.728870  1234 raft_consensus.cc:2468] T 6f6d5246f47546cea93920208eb4c505 P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9281096d749a4bf691c774d3321672e7 in term 1.
I20260709 12:14:55.726328  1358 raft_consensus.cc:697] T 023ba999f2974359812bb5a68e6a618c P 48fd723a77ba455eabb997723f60371b [term 1 LEADER]: Becoming Leader. State: Replica: 48fd723a77ba455eabb997723f60371b, State: Running, Role: LEADER
I20260709 12:14:55.729888  1352 consensus_queue.cc:260] T fa8e4b22b550472e9de5f6a9cc8e173c P 9281096d749a4bf691c774d3321672e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.732640  1309 raft_consensus.cc:2468] T fa8e4b22b550472e9de5f6a9cc8e173c P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ade8f52c75914406a928ad61a925ed1b in term 0.
I20260709 12:14:55.734128  1352 ts_tablet_manager.cc:1434] T fa8e4b22b550472e9de5f6a9cc8e173c P 9281096d749a4bf691c774d3321672e7: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:14:55.735431  1358 consensus_queue.cc:237] T 023ba999f2974359812bb5a68e6a618c P 48fd723a77ba455eabb997723f60371b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.739648  1309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023ba999f2974359812bb5a68e6a618c" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9281096d749a4bf691c774d3321672e7" is_pre_election: true
I20260709 12:14:55.740379  1309 raft_consensus.cc:2468] T 023ba999f2974359812bb5a68e6a618c P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48fd723a77ba455eabb997723f60371b in term 0.
I20260709 12:14:55.741386  1396 raft_consensus.cc:515] T 2ef02663c5eb4a4c900ad78501828298 P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.743361  1159 raft_consensus.cc:2393] T 2ef02663c5eb4a4c900ad78501828298 P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9281096d749a4bf691c774d3321672e7 in current term 1: Already voted for candidate 48fd723a77ba455eabb997723f60371b in this term.
I20260709 12:14:55.744566  1234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef02663c5eb4a4c900ad78501828298" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade8f52c75914406a928ad61a925ed1b"
I20260709 12:14:55.745239  1234 raft_consensus.cc:3060] T 2ef02663c5eb4a4c900ad78501828298 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:55.746385  1200 leader_election.cc:343] T fa8e4b22b550472e9de5f6a9cc8e173c P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:55.746141  1058 catalog_manager.cc:5697] T fa8e4b22b550472e9de5f6a9cc8e173c P ade8f52c75914406a928ad61a925ed1b reported cstate change: term changed from 0 to 1, leader changed from <none> to ade8f52c75914406a928ad61a925ed1b (127.20.196.130). New cstate: current_term: 1 leader_uuid: "ade8f52c75914406a928ad61a925ed1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:55.746300  1310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023ba999f2974359812bb5a68e6a618c" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9281096d749a4bf691c774d3321672e7"
I20260709 12:14:55.747903  1310 raft_consensus.cc:3060] T 023ba999f2974359812bb5a68e6a618c P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.748342  1272 leader_election.cc:304] T 708dcd04a2de4a6ea0c2436ae59b3aca P 9281096d749a4bf691c774d3321672e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9281096d749a4bf691c774d3321672e7; no voters: 48fd723a77ba455eabb997723f60371b, ade8f52c75914406a928ad61a925ed1b
I20260709 12:14:55.749912  1396 leader_election.cc:290] T 2ef02663c5eb4a4c900ad78501828298 P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 election: Requested vote from peers ade8f52c75914406a928ad61a925ed1b (127.20.196.130:40533), 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381)
I20260709 12:14:55.751441  1399 raft_consensus.cc:3060] T 708dcd04a2de4a6ea0c2436ae59b3aca P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.751928  1272 leader_election.cc:304] T 2ef02663c5eb4a4c900ad78501828298 P 9281096d749a4bf691c774d3321672e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9281096d749a4bf691c774d3321672e7, ade8f52c75914406a928ad61a925ed1b; no voters: 48fd723a77ba455eabb997723f60371b
I20260709 12:14:55.753620  1404 raft_consensus.cc:2804] T 2ef02663c5eb4a4c900ad78501828298 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:55.754074  1404 raft_consensus.cc:493] T 2ef02663c5eb4a4c900ad78501828298 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:55.754467  1404 raft_consensus.cc:3060] T 2ef02663c5eb4a4c900ad78501828298 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.756165  1308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef02663c5eb4a4c900ad78501828298" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9281096d749a4bf691c774d3321672e7"
I20260709 12:14:55.759521  1309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef02663c5eb4a4c900ad78501828298" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9281096d749a4bf691c774d3321672e7" is_pre_election: true
I20260709 12:14:55.764362  1399 raft_consensus.cc:2749] T 708dcd04a2de4a6ea0c2436ae59b3aca P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:55.767053  1234 raft_consensus.cc:2468] T 2ef02663c5eb4a4c900ad78501828298 P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48fd723a77ba455eabb997723f60371b in term 1.
I20260709 12:14:55.768344  1123 leader_election.cc:304] T 2ef02663c5eb4a4c900ad78501828298 P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48fd723a77ba455eabb997723f60371b, ade8f52c75914406a928ad61a925ed1b; no voters: 
I20260709 12:14:55.769282  1358 raft_consensus.cc:2804] T 2ef02663c5eb4a4c900ad78501828298 P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:55.768959  1404 raft_consensus.cc:515] T 2ef02663c5eb4a4c900ad78501828298 P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.769915  1358 raft_consensus.cc:697] T 2ef02663c5eb4a4c900ad78501828298 P 48fd723a77ba455eabb997723f60371b [term 1 LEADER]: Becoming Leader. State: Replica: 48fd723a77ba455eabb997723f60371b, State: Running, Role: LEADER
I20260709 12:14:55.770169  1310 raft_consensus.cc:2468] T 023ba999f2974359812bb5a68e6a618c P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48fd723a77ba455eabb997723f60371b in term 1.
I20260709 12:14:55.770547  1308 raft_consensus.cc:2393] T 2ef02663c5eb4a4c900ad78501828298 P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 48fd723a77ba455eabb997723f60371b in current term 1: Already voted for candidate 9281096d749a4bf691c774d3321672e7 in this term.
I20260709 12:14:55.770944  1358 consensus_queue.cc:237] T 2ef02663c5eb4a4c900ad78501828298 P 48fd723a77ba455eabb997723f60371b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.771483  1056 catalog_manager.cc:5697] T 023ba999f2974359812bb5a68e6a618c P 48fd723a77ba455eabb997723f60371b reported cstate change: term changed from 0 to 1, leader changed from <none> to 48fd723a77ba455eabb997723f60371b (127.20.196.129). New cstate: current_term: 1 leader_uuid: "48fd723a77ba455eabb997723f60371b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:55.774262  1159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef02663c5eb4a4c900ad78501828298" candidate_uuid: "9281096d749a4bf691c774d3321672e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48fd723a77ba455eabb997723f60371b"
I20260709 12:14:55.774509  1404 leader_election.cc:290] T 2ef02663c5eb4a4c900ad78501828298 P 9281096d749a4bf691c774d3321672e7 [CANDIDATE]: Term 1 election: Requested vote from peers 48fd723a77ba455eabb997723f60371b (127.20.196.129:40613), ade8f52c75914406a928ad61a925ed1b (127.20.196.130:40533)
I20260709 12:14:55.776351  1396 raft_consensus.cc:493] T 062ef3d157f74d819a1e8c88524d15bb P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.776315  1234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef02663c5eb4a4c900ad78501828298" candidate_uuid: "9281096d749a4bf691c774d3321672e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade8f52c75914406a928ad61a925ed1b"
I20260709 12:14:55.777334  1234 raft_consensus.cc:2393] T 2ef02663c5eb4a4c900ad78501828298 P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9281096d749a4bf691c774d3321672e7 in current term 1: Already voted for candidate 48fd723a77ba455eabb997723f60371b in this term.
I20260709 12:14:55.777043  1396 raft_consensus.cc:515] T 062ef3d157f74d819a1e8c88524d15bb P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:55.778730  1272 leader_election.cc:304] T 2ef02663c5eb4a4c900ad78501828298 P 9281096d749a4bf691c774d3321672e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9281096d749a4bf691c774d3321672e7; no voters: 48fd723a77ba455eabb997723f60371b, ade8f52c75914406a928ad61a925ed1b
I20260709 12:14:55.779600  1404 raft_consensus.cc:2749] T 2ef02663c5eb4a4c900ad78501828298 P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:14:55.780074  1234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062ef3d157f74d819a1e8c88524d15bb" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade8f52c75914406a928ad61a925ed1b" is_pre_election: true
I20260709 12:14:55.780524  1396 leader_election.cc:290] T 062ef3d157f74d819a1e8c88524d15bb P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ade8f52c75914406a928ad61a925ed1b (127.20.196.130:40533), 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381)
I20260709 12:14:55.781355  1308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062ef3d157f74d819a1e8c88524d15bb" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9281096d749a4bf691c774d3321672e7" is_pre_election: true
I20260709 12:14:55.782166  1308 raft_consensus.cc:2393] T 062ef3d157f74d819a1e8c88524d15bb P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48fd723a77ba455eabb997723f60371b in current term 1: Already voted for candidate ade8f52c75914406a928ad61a925ed1b in this term.
I20260709 12:14:55.783179  1125 leader_election.cc:304] T 062ef3d157f74d819a1e8c88524d15bb P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48fd723a77ba455eabb997723f60371b; no voters: 9281096d749a4bf691c774d3321672e7, ade8f52c75914406a928ad61a925ed1b
I20260709 12:14:55.784204  1358 raft_consensus.cc:3060] T 062ef3d157f74d819a1e8c88524d15bb P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.789577  1056 catalog_manager.cc:5697] T 2ef02663c5eb4a4c900ad78501828298 P 48fd723a77ba455eabb997723f60371b reported cstate change: term changed from 0 to 1, leader changed from <none> to 48fd723a77ba455eabb997723f60371b (127.20.196.129). New cstate: current_term: 1 leader_uuid: "48fd723a77ba455eabb997723f60371b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:55.790407  1358 raft_consensus.cc:2749] T 062ef3d157f74d819a1e8c88524d15bb P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:55.912885  1387 consensus_queue.cc:1048] T 2a0060a4875345599fa7795fb8c284c0 P ade8f52c75914406a928ad61a925ed1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:55.925755  1359 consensus_queue.cc:1048] T 2a0060a4875345599fa7795fb8c284c0 P ade8f52c75914406a928ad61a925ed1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:55.964702  1234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a0060a4875345599fa7795fb8c284c0"
dest_uuid: "ade8f52c75914406a928ad61a925ed1b"
mode: GRACEFUL
new_leader_uuid: "48fd723a77ba455eabb997723f60371b"
 from {username='slave'} at 127.0.0.1:45714
I20260709 12:14:55.965463  1234 raft_consensus.cc:606] T 2a0060a4875345599fa7795fb8c284c0 P ade8f52c75914406a928ad61a925ed1b [term 1 LEADER]: Received request to transfer leadership to TS 48fd723a77ba455eabb997723f60371b
I20260709 12:14:55.973465  1234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "708dcd04a2de4a6ea0c2436ae59b3aca"
dest_uuid: "ade8f52c75914406a928ad61a925ed1b"
mode: GRACEFUL
new_leader_uuid: "48fd723a77ba455eabb997723f60371b"
 from {username='slave'} at 127.0.0.1:45714
I20260709 12:14:55.974017  1234 raft_consensus.cc:606] T 708dcd04a2de4a6ea0c2436ae59b3aca P ade8f52c75914406a928ad61a925ed1b [term 1 LEADER]: Received request to transfer leadership to TS 48fd723a77ba455eabb997723f60371b
I20260709 12:14:55.987193  1308 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be816cce439f4fb9b32c1e557f424523"
dest_uuid: "9281096d749a4bf691c774d3321672e7"
mode: GRACEFUL
new_leader_uuid: "ade8f52c75914406a928ad61a925ed1b"
 from {username='slave'} at 127.0.0.1:48964
I20260709 12:14:55.987749  1308 raft_consensus.cc:606] T be816cce439f4fb9b32c1e557f424523 P 9281096d749a4bf691c774d3321672e7 [term 1 LEADER]: Received request to transfer leadership to TS ade8f52c75914406a928ad61a925ed1b
I20260709 12:14:55.992990  1308 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f6d5246f47546cea93920208eb4c505"
dest_uuid: "9281096d749a4bf691c774d3321672e7"
mode: GRACEFUL
new_leader_uuid: "ade8f52c75914406a928ad61a925ed1b"
 from {username='slave'} at 127.0.0.1:48964
I20260709 12:14:55.993594  1308 raft_consensus.cc:606] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7 [term 1 LEADER]: Received request to transfer leadership to TS ade8f52c75914406a928ad61a925ed1b
I20260709 12:14:56.008615  1159 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "023ba999f2974359812bb5a68e6a618c"
dest_uuid: "48fd723a77ba455eabb997723f60371b"
mode: GRACEFUL
new_leader_uuid: "ade8f52c75914406a928ad61a925ed1b"
 from {username='slave'} at 127.0.0.1:46022
I20260709 12:14:56.009140  1159 raft_consensus.cc:606] T 023ba999f2974359812bb5a68e6a618c P 48fd723a77ba455eabb997723f60371b [term 1 LEADER]: Received request to transfer leadership to TS ade8f52c75914406a928ad61a925ed1b
I20260709 12:14:56.014372  1234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa8e4b22b550472e9de5f6a9cc8e173c"
dest_uuid: "ade8f52c75914406a928ad61a925ed1b"
mode: GRACEFUL
new_leader_uuid: "9281096d749a4bf691c774d3321672e7"
 from {username='slave'} at 127.0.0.1:45714
I20260709 12:14:56.014859  1234 raft_consensus.cc:606] T fa8e4b22b550472e9de5f6a9cc8e173c P ade8f52c75914406a928ad61a925ed1b [term 1 LEADER]: Received request to transfer leadership to TS 9281096d749a4bf691c774d3321672e7
I20260709 12:14:56.019781  1359 consensus_queue.cc:1048] T 062ef3d157f74d819a1e8c88524d15bb P ade8f52c75914406a928ad61a925ed1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:56.027348  1373 consensus_queue.cc:1048] T 708dcd04a2de4a6ea0c2436ae59b3aca P ade8f52c75914406a928ad61a925ed1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:56.031965  1399 consensus_queue.cc:1048] T be816cce439f4fb9b32c1e557f424523 P 9281096d749a4bf691c774d3321672e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:56.036058  1370 consensus_queue.cc:1048] T 062ef3d157f74d819a1e8c88524d15bb P ade8f52c75914406a928ad61a925ed1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:56.042698  1357 raft_consensus.cc:993] T be816cce439f4fb9b32c1e557f424523 P 9281096d749a4bf691c774d3321672e7: : Instructing follower ade8f52c75914406a928ad61a925ed1b to start an election
I20260709 12:14:56.043365  1357 raft_consensus.cc:1081] T be816cce439f4fb9b32c1e557f424523 P 9281096d749a4bf691c774d3321672e7 [term 1 LEADER]: Signalling peer ade8f52c75914406a928ad61a925ed1b to start an election
I20260709 12:14:56.048586  1404 consensus_queue.cc:1048] T be816cce439f4fb9b32c1e557f424523 P 9281096d749a4bf691c774d3321672e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:56.050050  1233 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be816cce439f4fb9b32c1e557f424523"
dest_uuid: "ade8f52c75914406a928ad61a925ed1b"
 from {username='slave'} at 127.0.0.1:50738
I20260709 12:14:56.051486  1233 raft_consensus.cc:493] T be816cce439f4fb9b32c1e557f424523 P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:56.051883  1233 raft_consensus.cc:3060] T be816cce439f4fb9b32c1e557f424523 P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:56.067422  1358 consensus_queue.cc:1048] T b2b62eae23264a6aa96a0a5899444f0e P 48fd723a77ba455eabb997723f60371b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:56.076097  1233 raft_consensus.cc:515] T be816cce439f4fb9b32c1e557f424523 P ade8f52c75914406a928ad61a925ed1b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:56.079964  1160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be816cce439f4fb9b32c1e557f424523" candidate_uuid: "ade8f52c75914406a928ad61a925ed1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48fd723a77ba455eabb997723f60371b"
I20260709 12:14:56.085525  1310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be816cce439f4fb9b32c1e557f424523" candidate_uuid: "ade8f52c75914406a928ad61a925ed1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9281096d749a4bf691c774d3321672e7"
I20260709 12:14:56.086323  1310 raft_consensus.cc:3055] T be816cce439f4fb9b32c1e557f424523 P 9281096d749a4bf691c774d3321672e7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:56.086747  1310 raft_consensus.cc:740] T be816cce439f4fb9b32c1e557f424523 P 9281096d749a4bf691c774d3321672e7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9281096d749a4bf691c774d3321672e7, State: Running, Role: LEADER
I20260709 12:14:56.087100  1233 leader_election.cc:290] T be816cce439f4fb9b32c1e557f424523 P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 2 election: Requested vote from peers 48fd723a77ba455eabb997723f60371b (127.20.196.129:40613), 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381)
I20260709 12:14:56.087862  1310 consensus_queue.cc:260] T be816cce439f4fb9b32c1e557f424523 P 9281096d749a4bf691c774d3321672e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:56.090476  1310 raft_consensus.cc:3060] T be816cce439f4fb9b32c1e557f424523 P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:56.096650  1421 consensus_queue.cc:1048] T 708dcd04a2de4a6ea0c2436ae59b3aca P ade8f52c75914406a928ad61a925ed1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:56.109035  1310 raft_consensus.cc:2468] T be816cce439f4fb9b32c1e557f424523 P 9281096d749a4bf691c774d3321672e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade8f52c75914406a928ad61a925ed1b in term 2.
I20260709 12:14:56.111558  1200 leader_election.cc:304] T be816cce439f4fb9b32c1e557f424523 P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9281096d749a4bf691c774d3321672e7, ade8f52c75914406a928ad61a925ed1b; no voters: 48fd723a77ba455eabb997723f60371b
I20260709 12:14:56.112772  1421 raft_consensus.cc:2804] T be816cce439f4fb9b32c1e557f424523 P ade8f52c75914406a928ad61a925ed1b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:56.113277  1421 raft_consensus.cc:697] T be816cce439f4fb9b32c1e557f424523 P ade8f52c75914406a928ad61a925ed1b [term 2 LEADER]: Becoming Leader. State: Replica: ade8f52c75914406a928ad61a925ed1b, State: Running, Role: LEADER
I20260709 12:14:56.114106  1421 consensus_queue.cc:237] T be816cce439f4fb9b32c1e557f424523 P ade8f52c75914406a928ad61a925ed1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:56.123555  1421 raft_consensus.cc:993] T 708dcd04a2de4a6ea0c2436ae59b3aca P ade8f52c75914406a928ad61a925ed1b: : Instructing follower 48fd723a77ba455eabb997723f60371b to start an election
I20260709 12:14:56.123993  1421 raft_consensus.cc:1081] T 708dcd04a2de4a6ea0c2436ae59b3aca P ade8f52c75914406a928ad61a925ed1b [term 1 LEADER]: Signalling peer 48fd723a77ba455eabb997723f60371b to start an election
I20260709 12:14:56.125278  1409 consensus_queue.cc:1048] T b2b62eae23264a6aa96a0a5899444f0e P 48fd723a77ba455eabb997723f60371b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:56.126147  1160 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "708dcd04a2de4a6ea0c2436ae59b3aca"
dest_uuid: "48fd723a77ba455eabb997723f60371b"
 from {username='slave'} at 127.0.0.1:37454
I20260709 12:14:56.126758  1160 raft_consensus.cc:493] T 708dcd04a2de4a6ea0c2436ae59b3aca P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:56.127168  1160 raft_consensus.cc:3060] T 708dcd04a2de4a6ea0c2436ae59b3aca P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:56.127207  1055 catalog_manager.cc:5697] T be816cce439f4fb9b32c1e557f424523 P ade8f52c75914406a928ad61a925ed1b reported cstate change: term changed from 1 to 2, leader changed from 9281096d749a4bf691c774d3321672e7 (127.20.196.131) to ade8f52c75914406a928ad61a925ed1b (127.20.196.130). New cstate: current_term: 2 leader_uuid: "ade8f52c75914406a928ad61a925ed1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:56.134563  1160 raft_consensus.cc:515] T 708dcd04a2de4a6ea0c2436ae59b3aca P 48fd723a77ba455eabb997723f60371b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:56.136574  1160 leader_election.cc:290] T 708dcd04a2de4a6ea0c2436ae59b3aca P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 2 election: Requested vote from peers ade8f52c75914406a928ad61a925ed1b (127.20.196.130:40533), 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381)
I20260709 12:14:56.137945  1309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708dcd04a2de4a6ea0c2436ae59b3aca" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9281096d749a4bf691c774d3321672e7"
I20260709 12:14:56.138635  1309 raft_consensus.cc:3060] T 708dcd04a2de4a6ea0c2436ae59b3aca P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:56.139300  1233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708dcd04a2de4a6ea0c2436ae59b3aca" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ade8f52c75914406a928ad61a925ed1b"
I20260709 12:14:56.139921  1233 raft_consensus.cc:3055] T 708dcd04a2de4a6ea0c2436ae59b3aca P ade8f52c75914406a928ad61a925ed1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:56.140239  1233 raft_consensus.cc:740] T 708dcd04a2de4a6ea0c2436ae59b3aca P ade8f52c75914406a928ad61a925ed1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ade8f52c75914406a928ad61a925ed1b, State: Running, Role: LEADER
I20260709 12:14:56.141047  1233 consensus_queue.cc:260] T 708dcd04a2de4a6ea0c2436ae59b3aca P ade8f52c75914406a928ad61a925ed1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:56.142256  1233 raft_consensus.cc:3060] T 708dcd04a2de4a6ea0c2436ae59b3aca P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:56.144621  1309 raft_consensus.cc:2468] T 708dcd04a2de4a6ea0c2436ae59b3aca P 9281096d749a4bf691c774d3321672e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48fd723a77ba455eabb997723f60371b in term 2.
I20260709 12:14:56.145673  1125 leader_election.cc:304] T 708dcd04a2de4a6ea0c2436ae59b3aca P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48fd723a77ba455eabb997723f60371b, 9281096d749a4bf691c774d3321672e7; no voters: 
I20260709 12:14:56.146476  1409 raft_consensus.cc:2804] T 708dcd04a2de4a6ea0c2436ae59b3aca P 48fd723a77ba455eabb997723f60371b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:56.146816  1409 raft_consensus.cc:697] T 708dcd04a2de4a6ea0c2436ae59b3aca P 48fd723a77ba455eabb997723f60371b [term 2 LEADER]: Becoming Leader. State: Replica: 48fd723a77ba455eabb997723f60371b, State: Running, Role: LEADER
I20260709 12:14:56.147707  1409 consensus_queue.cc:237] T 708dcd04a2de4a6ea0c2436ae59b3aca P 48fd723a77ba455eabb997723f60371b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:56.151268  1233 raft_consensus.cc:2468] T 708dcd04a2de4a6ea0c2436ae59b3aca P ade8f52c75914406a928ad61a925ed1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48fd723a77ba455eabb997723f60371b in term 2.
I20260709 12:14:56.155941  1409 consensus_queue.cc:1048] T 023ba999f2974359812bb5a68e6a618c P 48fd723a77ba455eabb997723f60371b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:56.157116  1056 catalog_manager.cc:5697] T 708dcd04a2de4a6ea0c2436ae59b3aca P 48fd723a77ba455eabb997723f60371b reported cstate change: term changed from 1 to 2, leader changed from ade8f52c75914406a928ad61a925ed1b (127.20.196.130) to 48fd723a77ba455eabb997723f60371b (127.20.196.129). New cstate: current_term: 2 leader_uuid: "48fd723a77ba455eabb997723f60371b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:56.168062  1395 consensus_queue.cc:1048] T 023ba999f2974359812bb5a68e6a618c P 48fd723a77ba455eabb997723f60371b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:56.179869  1395 raft_consensus.cc:993] T 023ba999f2974359812bb5a68e6a618c P 48fd723a77ba455eabb997723f60371b: : Instructing follower ade8f52c75914406a928ad61a925ed1b to start an election
I20260709 12:14:56.180368  1395 raft_consensus.cc:1081] T 023ba999f2974359812bb5a68e6a618c P 48fd723a77ba455eabb997723f60371b [term 1 LEADER]: Signalling peer ade8f52c75914406a928ad61a925ed1b to start an election
I20260709 12:14:56.181398  1370 consensus_queue.cc:1048] T fa8e4b22b550472e9de5f6a9cc8e173c P ade8f52c75914406a928ad61a925ed1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:56.181972  1234 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "023ba999f2974359812bb5a68e6a618c"
dest_uuid: "ade8f52c75914406a928ad61a925ed1b"
 from {username='slave'} at 127.0.0.1:50722
I20260709 12:14:56.181845  1404 consensus_queue.cc:1048] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:56.182715  1234 raft_consensus.cc:493] T 023ba999f2974359812bb5a68e6a618c P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:56.183168  1234 raft_consensus.cc:3060] T 023ba999f2974359812bb5a68e6a618c P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:56.190276  1399 raft_consensus.cc:993] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7: : Instructing follower ade8f52c75914406a928ad61a925ed1b to start an election
I20260709 12:14:56.190783  1399 raft_consensus.cc:1081] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7 [term 1 LEADER]: Signalling peer ade8f52c75914406a928ad61a925ed1b to start an election
I20260709 12:14:56.193194  1235 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f6d5246f47546cea93920208eb4c505"
dest_uuid: "ade8f52c75914406a928ad61a925ed1b"
 from {username='slave'} at 127.0.0.1:50738
I20260709 12:14:56.193689  1235 raft_consensus.cc:493] T 6f6d5246f47546cea93920208eb4c505 P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:56.194021  1235 raft_consensus.cc:3060] T 6f6d5246f47546cea93920208eb4c505 P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:56.195890  1309 raft_consensus.cc:3060] T fa8e4b22b550472e9de5f6a9cc8e173c P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:56.196273  1234 raft_consensus.cc:515] T 023ba999f2974359812bb5a68e6a618c P ade8f52c75914406a928ad61a925ed1b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:56.199630  1234 leader_election.cc:290] T 023ba999f2974359812bb5a68e6a618c P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 2 election: Requested vote from peers 48fd723a77ba455eabb997723f60371b (127.20.196.129:40613), 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381)
I20260709 12:14:56.199713  1310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023ba999f2974359812bb5a68e6a618c" candidate_uuid: "ade8f52c75914406a928ad61a925ed1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9281096d749a4bf691c774d3321672e7"
I20260709 12:14:56.200434  1310 raft_consensus.cc:3060] T 023ba999f2974359812bb5a68e6a618c P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:56.205116  1158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023ba999f2974359812bb5a68e6a618c" candidate_uuid: "ade8f52c75914406a928ad61a925ed1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48fd723a77ba455eabb997723f60371b"
I20260709 12:14:56.205832  1158 raft_consensus.cc:3055] T 023ba999f2974359812bb5a68e6a618c P 48fd723a77ba455eabb997723f60371b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:56.206164  1158 raft_consensus.cc:740] T 023ba999f2974359812bb5a68e6a618c P 48fd723a77ba455eabb997723f60371b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48fd723a77ba455eabb997723f60371b, State: Running, Role: LEADER
I20260709 12:14:56.206688  1399 consensus_queue.cc:1048] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:56.207010  1158 consensus_queue.cc:260] T 023ba999f2974359812bb5a68e6a618c P 48fd723a77ba455eabb997723f60371b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:56.208426  1158 raft_consensus.cc:3060] T 023ba999f2974359812bb5a68e6a618c P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:56.212580  1310 raft_consensus.cc:2468] T 023ba999f2974359812bb5a68e6a618c P 9281096d749a4bf691c774d3321672e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade8f52c75914406a928ad61a925ed1b in term 2.
I20260709 12:14:56.213904  1200 leader_election.cc:304] T 023ba999f2974359812bb5a68e6a618c P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9281096d749a4bf691c774d3321672e7, ade8f52c75914406a928ad61a925ed1b; no voters: 
I20260709 12:14:56.214643  1373 raft_consensus.cc:2804] T 023ba999f2974359812bb5a68e6a618c P ade8f52c75914406a928ad61a925ed1b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:56.215123  1373 raft_consensus.cc:697] T 023ba999f2974359812bb5a68e6a618c P ade8f52c75914406a928ad61a925ed1b [term 2 LEADER]: Becoming Leader. State: Replica: ade8f52c75914406a928ad61a925ed1b, State: Running, Role: LEADER
I20260709 12:14:56.215538  1359 consensus_queue.cc:1048] T fa8e4b22b550472e9de5f6a9cc8e173c P ade8f52c75914406a928ad61a925ed1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:56.215930  1373 consensus_queue.cc:237] T 023ba999f2974359812bb5a68e6a618c P ade8f52c75914406a928ad61a925ed1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:56.221901  1158 raft_consensus.cc:2468] T 023ba999f2974359812bb5a68e6a618c P 48fd723a77ba455eabb997723f60371b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade8f52c75914406a928ad61a925ed1b in term 2.
I20260709 12:14:56.227041  1235 raft_consensus.cc:515] T 6f6d5246f47546cea93920208eb4c505 P ade8f52c75914406a928ad61a925ed1b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:56.230640  1233 raft_consensus.cc:1240] T 6f6d5246f47546cea93920208eb4c505 P ade8f52c75914406a928ad61a925ed1b [term 2 FOLLOWER]: Rejecting Update request from peer 9281096d749a4bf691c774d3321672e7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:56.233664  1235 leader_election.cc:290] T 6f6d5246f47546cea93920208eb4c505 P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 2 election: Requested vote from peers 48fd723a77ba455eabb997723f60371b (127.20.196.129:40613), 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381)
I20260709 12:14:56.235737  1310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6d5246f47546cea93920208eb4c505" candidate_uuid: "ade8f52c75914406a928ad61a925ed1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9281096d749a4bf691c774d3321672e7"
I20260709 12:14:56.236447  1310 raft_consensus.cc:3055] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:56.236809  1310 raft_consensus.cc:740] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9281096d749a4bf691c774d3321672e7, State: Running, Role: LEADER
I20260709 12:14:56.237640  1310 consensus_queue.cc:260] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:56.238447  1160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6d5246f47546cea93920208eb4c505" candidate_uuid: "ade8f52c75914406a928ad61a925ed1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48fd723a77ba455eabb997723f60371b"
I20260709 12:14:56.238827  1310 raft_consensus.cc:3060] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:56.239041  1160 raft_consensus.cc:3060] T 6f6d5246f47546cea93920208eb4c505 P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:56.239045  1404 consensus_queue.cc:1175] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ade8f52c75914406a928ad61a925ed1b" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 0 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9281096d749a4bf691c774d3321672e7 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:14:56.241374  1058 catalog_manager.cc:5697] T 023ba999f2974359812bb5a68e6a618c P ade8f52c75914406a928ad61a925ed1b reported cstate change: term changed from 1 to 2, leader changed from 48fd723a77ba455eabb997723f60371b (127.20.196.129) to ade8f52c75914406a928ad61a925ed1b (127.20.196.130). New cstate: current_term: 2 leader_uuid: "ade8f52c75914406a928ad61a925ed1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:56.246321  1310 raft_consensus.cc:2468] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade8f52c75914406a928ad61a925ed1b in term 2.
I20260709 12:14:56.246737  1160 raft_consensus.cc:2468] T 6f6d5246f47546cea93920208eb4c505 P 48fd723a77ba455eabb997723f60371b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade8f52c75914406a928ad61a925ed1b in term 2.
I20260709 12:14:56.247666  1200 leader_election.cc:304] T 6f6d5246f47546cea93920208eb4c505 P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9281096d749a4bf691c774d3321672e7, ade8f52c75914406a928ad61a925ed1b; no voters: 
I20260709 12:14:56.249018  1373 raft_consensus.cc:2804] T 6f6d5246f47546cea93920208eb4c505 P ade8f52c75914406a928ad61a925ed1b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:56.249459  1373 raft_consensus.cc:697] T 6f6d5246f47546cea93920208eb4c505 P ade8f52c75914406a928ad61a925ed1b [term 2 LEADER]: Becoming Leader. State: Replica: ade8f52c75914406a928ad61a925ed1b, State: Running, Role: LEADER
I20260709 12:14:56.250273  1373 consensus_queue.cc:237] T 6f6d5246f47546cea93920208eb4c505 P ade8f52c75914406a928ad61a925ed1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:56.251212  1421 raft_consensus.cc:993] T fa8e4b22b550472e9de5f6a9cc8e173c P ade8f52c75914406a928ad61a925ed1b: : Instructing follower 9281096d749a4bf691c774d3321672e7 to start an election
I20260709 12:14:56.251704  1421 raft_consensus.cc:1081] T fa8e4b22b550472e9de5f6a9cc8e173c P ade8f52c75914406a928ad61a925ed1b [term 1 LEADER]: Signalling peer 9281096d749a4bf691c774d3321672e7 to start an election
I20260709 12:14:56.253548  1310 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa8e4b22b550472e9de5f6a9cc8e173c"
dest_uuid: "9281096d749a4bf691c774d3321672e7"
 from {username='slave'} at 127.0.0.1:44808
I20260709 12:14:56.254148  1310 raft_consensus.cc:493] T fa8e4b22b550472e9de5f6a9cc8e173c P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:56.254528  1310 raft_consensus.cc:3060] T fa8e4b22b550472e9de5f6a9cc8e173c P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:56.257781  1058 catalog_manager.cc:5697] T 6f6d5246f47546cea93920208eb4c505 P ade8f52c75914406a928ad61a925ed1b reported cstate change: term changed from 1 to 2, leader changed from 9281096d749a4bf691c774d3321672e7 (127.20.196.131) to ade8f52c75914406a928ad61a925ed1b (127.20.196.130). New cstate: current_term: 2 leader_uuid: "ade8f52c75914406a928ad61a925ed1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:56.260322  1310 raft_consensus.cc:515] T fa8e4b22b550472e9de5f6a9cc8e173c P 9281096d749a4bf691c774d3321672e7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:56.262912  1160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8e4b22b550472e9de5f6a9cc8e173c" candidate_uuid: "9281096d749a4bf691c774d3321672e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48fd723a77ba455eabb997723f60371b"
I20260709 12:14:56.263572  1160 raft_consensus.cc:3060] T fa8e4b22b550472e9de5f6a9cc8e173c P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:56.263720  1233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8e4b22b550472e9de5f6a9cc8e173c" candidate_uuid: "9281096d749a4bf691c774d3321672e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ade8f52c75914406a928ad61a925ed1b"
I20260709 12:14:56.264329  1233 raft_consensus.cc:3055] T fa8e4b22b550472e9de5f6a9cc8e173c P ade8f52c75914406a928ad61a925ed1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:56.264652  1233 raft_consensus.cc:740] T fa8e4b22b550472e9de5f6a9cc8e173c P ade8f52c75914406a928ad61a925ed1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ade8f52c75914406a928ad61a925ed1b, State: Running, Role: LEADER
I20260709 12:14:56.265440  1233 consensus_queue.cc:260] T fa8e4b22b550472e9de5f6a9cc8e173c P ade8f52c75914406a928ad61a925ed1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:56.265974  1310 leader_election.cc:290] T fa8e4b22b550472e9de5f6a9cc8e173c P 9281096d749a4bf691c774d3321672e7 [CANDIDATE]: Term 2 election: Requested vote from peers 48fd723a77ba455eabb997723f60371b (127.20.196.129:40613), ade8f52c75914406a928ad61a925ed1b (127.20.196.130:40533)
I20260709 12:14:56.266957  1233 raft_consensus.cc:3060] T fa8e4b22b550472e9de5f6a9cc8e173c P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:56.270131  1160 raft_consensus.cc:2468] T fa8e4b22b550472e9de5f6a9cc8e173c P 48fd723a77ba455eabb997723f60371b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9281096d749a4bf691c774d3321672e7 in term 2.
I20260709 12:14:56.271201  1274 leader_election.cc:304] T fa8e4b22b550472e9de5f6a9cc8e173c P 9281096d749a4bf691c774d3321672e7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48fd723a77ba455eabb997723f60371b, 9281096d749a4bf691c774d3321672e7; no voters: 
I20260709 12:14:56.271905  1404 raft_consensus.cc:2804] T fa8e4b22b550472e9de5f6a9cc8e173c P 9281096d749a4bf691c774d3321672e7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:56.272393  1404 raft_consensus.cc:697] T fa8e4b22b550472e9de5f6a9cc8e173c P 9281096d749a4bf691c774d3321672e7 [term 2 LEADER]: Becoming Leader. State: Replica: 9281096d749a4bf691c774d3321672e7, State: Running, Role: LEADER
I20260709 12:14:56.273360  1233 raft_consensus.cc:2468] T fa8e4b22b550472e9de5f6a9cc8e173c P ade8f52c75914406a928ad61a925ed1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9281096d749a4bf691c774d3321672e7 in term 2.
I20260709 12:14:56.273221  1404 consensus_queue.cc:237] T fa8e4b22b550472e9de5f6a9cc8e173c P 9281096d749a4bf691c774d3321672e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:56.279829  1058 catalog_manager.cc:5697] T fa8e4b22b550472e9de5f6a9cc8e173c P 9281096d749a4bf691c774d3321672e7 reported cstate change: term changed from 1 to 2, leader changed from ade8f52c75914406a928ad61a925ed1b (127.20.196.130) to 9281096d749a4bf691c774d3321672e7 (127.20.196.131). New cstate: current_term: 2 leader_uuid: "9281096d749a4bf691c774d3321672e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:56.295295  1409 consensus_queue.cc:1048] T 2ef02663c5eb4a4c900ad78501828298 P 48fd723a77ba455eabb997723f60371b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:56.305997  1396 consensus_queue.cc:1048] T 2ef02663c5eb4a4c900ad78501828298 P 48fd723a77ba455eabb997723f60371b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:56.416874  1373 raft_consensus.cc:993] T 2a0060a4875345599fa7795fb8c284c0 P ade8f52c75914406a928ad61a925ed1b: : Instructing follower 48fd723a77ba455eabb997723f60371b to start an election
I20260709 12:14:56.417339  1359 raft_consensus.cc:1081] T 2a0060a4875345599fa7795fb8c284c0 P ade8f52c75914406a928ad61a925ed1b [term 1 LEADER]: Signalling peer 48fd723a77ba455eabb997723f60371b to start an election
I20260709 12:14:56.418812  1158 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a0060a4875345599fa7795fb8c284c0"
dest_uuid: "48fd723a77ba455eabb997723f60371b"
 from {username='slave'} at 127.0.0.1:37454
I20260709 12:14:56.419317  1158 raft_consensus.cc:493] T 2a0060a4875345599fa7795fb8c284c0 P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:56.419574  1158 raft_consensus.cc:3060] T 2a0060a4875345599fa7795fb8c284c0 P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:56.425659  1158 raft_consensus.cc:515] T 2a0060a4875345599fa7795fb8c284c0 P 48fd723a77ba455eabb997723f60371b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:56.427647  1158 leader_election.cc:290] T 2a0060a4875345599fa7795fb8c284c0 P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 2 election: Requested vote from peers ade8f52c75914406a928ad61a925ed1b (127.20.196.130:40533), 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381)
I20260709 12:14:56.428646  1310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a0060a4875345599fa7795fb8c284c0" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9281096d749a4bf691c774d3321672e7"
I20260709 12:14:56.429304  1310 raft_consensus.cc:3060] T 2a0060a4875345599fa7795fb8c284c0 P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:56.429430  1233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a0060a4875345599fa7795fb8c284c0" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ade8f52c75914406a928ad61a925ed1b"
I20260709 12:14:56.430086  1233 raft_consensus.cc:3055] T 2a0060a4875345599fa7795fb8c284c0 P ade8f52c75914406a928ad61a925ed1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:56.430449  1233 raft_consensus.cc:740] T 2a0060a4875345599fa7795fb8c284c0 P ade8f52c75914406a928ad61a925ed1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ade8f52c75914406a928ad61a925ed1b, State: Running, Role: LEADER
I20260709 12:14:56.431882  1233 consensus_queue.cc:260] T 2a0060a4875345599fa7795fb8c284c0 P ade8f52c75914406a928ad61a925ed1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:56.432901  1233 raft_consensus.cc:3060] T 2a0060a4875345599fa7795fb8c284c0 P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:56.436308  1310 raft_consensus.cc:2468] T 2a0060a4875345599fa7795fb8c284c0 P 9281096d749a4bf691c774d3321672e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48fd723a77ba455eabb997723f60371b in term 2.
I20260709 12:14:56.437407  1125 leader_election.cc:304] T 2a0060a4875345599fa7795fb8c284c0 P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48fd723a77ba455eabb997723f60371b, 9281096d749a4bf691c774d3321672e7; no voters: 
I20260709 12:14:56.438174  1409 raft_consensus.cc:2804] T 2a0060a4875345599fa7795fb8c284c0 P 48fd723a77ba455eabb997723f60371b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:56.438606  1409 raft_consensus.cc:697] T 2a0060a4875345599fa7795fb8c284c0 P 48fd723a77ba455eabb997723f60371b [term 2 LEADER]: Becoming Leader. State: Replica: 48fd723a77ba455eabb997723f60371b, State: Running, Role: LEADER
I20260709 12:14:56.439364  1409 consensus_queue.cc:237] T 2a0060a4875345599fa7795fb8c284c0 P 48fd723a77ba455eabb997723f60371b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:56.439527  1233 raft_consensus.cc:2468] T 2a0060a4875345599fa7795fb8c284c0 P ade8f52c75914406a928ad61a925ed1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48fd723a77ba455eabb997723f60371b in term 2.
I20260709 12:14:56.445616  1058 catalog_manager.cc:5697] T 2a0060a4875345599fa7795fb8c284c0 P 48fd723a77ba455eabb997723f60371b reported cstate change: term changed from 1 to 2, leader changed from ade8f52c75914406a928ad61a925ed1b (127.20.196.130) to 48fd723a77ba455eabb997723f60371b (127.20.196.129). New cstate: current_term: 2 leader_uuid: "48fd723a77ba455eabb997723f60371b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:56.518527  1310 raft_consensus.cc:1275] T be816cce439f4fb9b32c1e557f424523 P 9281096d749a4bf691c774d3321672e7 [term 2 FOLLOWER]: Refusing update from remote peer ade8f52c75914406a928ad61a925ed1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:56.519906  1359 consensus_queue.cc:1048] T be816cce439f4fb9b32c1e557f424523 P ade8f52c75914406a928ad61a925ed1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:56.529418  1158 raft_consensus.cc:3060] T be816cce439f4fb9b32c1e557f424523 P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:56.533939  1233 raft_consensus.cc:1275] T 708dcd04a2de4a6ea0c2436ae59b3aca P ade8f52c75914406a928ad61a925ed1b [term 2 FOLLOWER]: Refusing update from remote peer 48fd723a77ba455eabb997723f60371b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:56.535779  1409 consensus_queue.cc:1048] T 708dcd04a2de4a6ea0c2436ae59b3aca P 48fd723a77ba455eabb997723f60371b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:56.537240  1158 raft_consensus.cc:1275] T be816cce439f4fb9b32c1e557f424523 P 48fd723a77ba455eabb997723f60371b [term 2 FOLLOWER]: Refusing update from remote peer ade8f52c75914406a928ad61a925ed1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:56.538708  1359 consensus_queue.cc:1048] T be816cce439f4fb9b32c1e557f424523 P ade8f52c75914406a928ad61a925ed1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:56.543979  1310 raft_consensus.cc:1275] T 708dcd04a2de4a6ea0c2436ae59b3aca P 9281096d749a4bf691c774d3321672e7 [term 2 FOLLOWER]: Refusing update from remote peer 48fd723a77ba455eabb997723f60371b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:56.550050  1396 consensus_queue.cc:1048] T 708dcd04a2de4a6ea0c2436ae59b3aca P 48fd723a77ba455eabb997723f60371b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:56.635514  1158 raft_consensus.cc:1275] T 023ba999f2974359812bb5a68e6a618c P 48fd723a77ba455eabb997723f60371b [term 2 FOLLOWER]: Refusing update from remote peer ade8f52c75914406a928ad61a925ed1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:56.636756  1359 consensus_queue.cc:1048] T 023ba999f2974359812bb5a68e6a618c P ade8f52c75914406a928ad61a925ed1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:56.642470  1158 raft_consensus.cc:1275] T 6f6d5246f47546cea93920208eb4c505 P 48fd723a77ba455eabb997723f60371b [term 2 FOLLOWER]: Refusing update from remote peer ade8f52c75914406a928ad61a925ed1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:56.644167  1373 consensus_queue.cc:1048] T 6f6d5246f47546cea93920208eb4c505 P ade8f52c75914406a928ad61a925ed1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:56.647665  1310 raft_consensus.cc:1275] T 023ba999f2974359812bb5a68e6a618c P 9281096d749a4bf691c774d3321672e7 [term 2 FOLLOWER]: Refusing update from remote peer ade8f52c75914406a928ad61a925ed1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:56.649088  1387 consensus_queue.cc:1048] T 023ba999f2974359812bb5a68e6a618c P ade8f52c75914406a928ad61a925ed1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:56.654793  1309 raft_consensus.cc:1275] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7 [term 2 FOLLOWER]: Refusing update from remote peer ade8f52c75914406a928ad61a925ed1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:56.658047  1421 consensus_queue.cc:1048] T 6f6d5246f47546cea93920208eb4c505 P ade8f52c75914406a928ad61a925ed1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:56.764636  1158 raft_consensus.cc:1275] T fa8e4b22b550472e9de5f6a9cc8e173c P 48fd723a77ba455eabb997723f60371b [term 2 FOLLOWER]: Refusing update from remote peer 9281096d749a4bf691c774d3321672e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:56.766216  1404 consensus_queue.cc:1048] T fa8e4b22b550472e9de5f6a9cc8e173c P 9281096d749a4bf691c774d3321672e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:56.774479  1233 raft_consensus.cc:1275] T fa8e4b22b550472e9de5f6a9cc8e173c P ade8f52c75914406a928ad61a925ed1b [term 2 FOLLOWER]: Refusing update from remote peer 9281096d749a4bf691c774d3321672e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:56.776551  1439 consensus_queue.cc:1048] T fa8e4b22b550472e9de5f6a9cc8e173c P 9281096d749a4bf691c774d3321672e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:56.831485  1233 raft_consensus.cc:1275] T 2a0060a4875345599fa7795fb8c284c0 P ade8f52c75914406a928ad61a925ed1b [term 2 FOLLOWER]: Refusing update from remote peer 48fd723a77ba455eabb997723f60371b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:56.833089  1395 consensus_queue.cc:1048] T 2a0060a4875345599fa7795fb8c284c0 P 48fd723a77ba455eabb997723f60371b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:56.834553  1309 raft_consensus.cc:1275] T 2a0060a4875345599fa7795fb8c284c0 P 9281096d749a4bf691c774d3321672e7 [term 2 FOLLOWER]: Refusing update from remote peer 48fd723a77ba455eabb997723f60371b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:56.836170  1395 consensus_queue.cc:1048] T 2a0060a4875345599fa7795fb8c284c0 P 48fd723a77ba455eabb997723f60371b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:59.042621  1055 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60616:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:14:59.044981  1055 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:14:59.096202  1148 tablet_service.cc:1511] Processing CreateTablet for tablet 4e3a90ba50264ff59de7e64f04e7cbde (DEFAULT_TABLE table=soft_deleted_table [id=9eee5303430b4e4aad32f306464681c9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:59.097188  1223 tablet_service.cc:1511] Processing CreateTablet for tablet 4e3a90ba50264ff59de7e64f04e7cbde (DEFAULT_TABLE table=soft_deleted_table [id=9eee5303430b4e4aad32f306464681c9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:59.097679  1148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e3a90ba50264ff59de7e64f04e7cbde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:59.098336  1223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e3a90ba50264ff59de7e64f04e7cbde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:59.101076  1220 tablet_service.cc:1511] Processing CreateTablet for tablet 7910908273664e89a7c9dc67ae63027e (DEFAULT_TABLE table=soft_deleted_table [id=9eee5303430b4e4aad32f306464681c9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:59.102353  1220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7910908273664e89a7c9dc67ae63027e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:59.103314  1295 tablet_service.cc:1511] Processing CreateTablet for tablet 4e3a90ba50264ff59de7e64f04e7cbde (DEFAULT_TABLE table=soft_deleted_table [id=9eee5303430b4e4aad32f306464681c9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:59.104545  1295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e3a90ba50264ff59de7e64f04e7cbde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:59.108081  1144 tablet_service.cc:1511] Processing CreateTablet for tablet 7910908273664e89a7c9dc67ae63027e (DEFAULT_TABLE table=soft_deleted_table [id=9eee5303430b4e4aad32f306464681c9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:59.109359  1144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7910908273664e89a7c9dc67ae63027e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:59.109500  1297 tablet_service.cc:1511] Processing CreateTablet for tablet 7910908273664e89a7c9dc67ae63027e (DEFAULT_TABLE table=soft_deleted_table [id=9eee5303430b4e4aad32f306464681c9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:59.110741  1297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7910908273664e89a7c9dc67ae63027e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:59.111977  1221 tablet_service.cc:1511] Processing CreateTablet for tablet 28d226ed3f0e4fb8bae68b4340e8e4a1 (DEFAULT_TABLE table=soft_deleted_table [id=9eee5303430b4e4aad32f306464681c9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:59.113256  1221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28d226ed3f0e4fb8bae68b4340e8e4a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:59.116781  1225 tablet_service.cc:1511] Processing CreateTablet for tablet fa41764beac241228184f7b2c3a4b1a5 (DEFAULT_TABLE table=soft_deleted_table [id=9eee5303430b4e4aad32f306464681c9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:59.119505  1225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa41764beac241228184f7b2c3a4b1a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:59.119545  1149 tablet_service.cc:1511] Processing CreateTablet for tablet fa41764beac241228184f7b2c3a4b1a5 (DEFAULT_TABLE table=soft_deleted_table [id=9eee5303430b4e4aad32f306464681c9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:59.120101  1145 tablet_service.cc:1511] Processing CreateTablet for tablet 28d226ed3f0e4fb8bae68b4340e8e4a1 (DEFAULT_TABLE table=soft_deleted_table [id=9eee5303430b4e4aad32f306464681c9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:59.121393  1149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa41764beac241228184f7b2c3a4b1a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:59.121176  1294 tablet_service.cc:1511] Processing CreateTablet for tablet 28d226ed3f0e4fb8bae68b4340e8e4a1 (DEFAULT_TABLE table=soft_deleted_table [id=9eee5303430b4e4aad32f306464681c9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:59.122040  1145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28d226ed3f0e4fb8bae68b4340e8e4a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:59.125433  1294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28d226ed3f0e4fb8bae68b4340e8e4a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:59.132894  1296 tablet_service.cc:1511] Processing CreateTablet for tablet fa41764beac241228184f7b2c3a4b1a5 (DEFAULT_TABLE table=soft_deleted_table [id=9eee5303430b4e4aad32f306464681c9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:59.133760  1147 tablet_service.cc:1511] Processing CreateTablet for tablet 6dae4debcb434769a07d735facc9817f (DEFAULT_TABLE table=soft_deleted_table [id=9eee5303430b4e4aad32f306464681c9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:59.134368  1296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa41764beac241228184f7b2c3a4b1a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:59.135082  1147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dae4debcb434769a07d735facc9817f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:59.146341  1222 tablet_service.cc:1511] Processing CreateTablet for tablet 6dae4debcb434769a07d735facc9817f (DEFAULT_TABLE table=soft_deleted_table [id=9eee5303430b4e4aad32f306464681c9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:59.147732  1222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dae4debcb434769a07d735facc9817f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:59.150380  1142 tablet_service.cc:1511] Processing CreateTablet for tablet 20c09a31d7a545b2ba4bb6853c19cab3 (DEFAULT_TABLE table=soft_deleted_table [id=9eee5303430b4e4aad32f306464681c9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:59.151865  1142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20c09a31d7a545b2ba4bb6853c19cab3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:59.156140  1143 tablet_service.cc:1511] Processing CreateTablet for tablet 6f7eb2b18b3e4b0eba971970313a52c2 (DEFAULT_TABLE table=soft_deleted_table [id=9eee5303430b4e4aad32f306464681c9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:59.156318  1219 tablet_service.cc:1511] Processing CreateTablet for tablet 20c09a31d7a545b2ba4bb6853c19cab3 (DEFAULT_TABLE table=soft_deleted_table [id=9eee5303430b4e4aad32f306464681c9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:59.157486  1143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f7eb2b18b3e4b0eba971970313a52c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:59.157799  1219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20c09a31d7a545b2ba4bb6853c19cab3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:59.164866  1300 tablet_service.cc:1511] Processing CreateTablet for tablet 6dae4debcb434769a07d735facc9817f (DEFAULT_TABLE table=soft_deleted_table [id=9eee5303430b4e4aad32f306464681c9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:59.166496  1300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dae4debcb434769a07d735facc9817f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:59.168869  1293 tablet_service.cc:1511] Processing CreateTablet for tablet 20c09a31d7a545b2ba4bb6853c19cab3 (DEFAULT_TABLE table=soft_deleted_table [id=9eee5303430b4e4aad32f306464681c9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:59.170362  1293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20c09a31d7a545b2ba4bb6853c19cab3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:59.171435  1455 tablet_bootstrap.cc:492] T 4e3a90ba50264ff59de7e64f04e7cbde P ade8f52c75914406a928ad61a925ed1b: Bootstrap starting.
I20260709 12:14:59.177055  1456 tablet_bootstrap.cc:492] T 7910908273664e89a7c9dc67ae63027e P 48fd723a77ba455eabb997723f60371b: Bootstrap starting.
I20260709 12:14:59.177309  1220 tablet_service.cc:1511] Processing CreateTablet for tablet 6f7eb2b18b3e4b0eba971970313a52c2 (DEFAULT_TABLE table=soft_deleted_table [id=9eee5303430b4e4aad32f306464681c9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:59.179661  1298 tablet_service.cc:1511] Processing CreateTablet for tablet 6f7eb2b18b3e4b0eba971970313a52c2 (DEFAULT_TABLE table=soft_deleted_table [id=9eee5303430b4e4aad32f306464681c9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:59.180953  1298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f7eb2b18b3e4b0eba971970313a52c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:59.182081  1220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f7eb2b18b3e4b0eba971970313a52c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:59.185292  1456 tablet_bootstrap.cc:654] T 7910908273664e89a7c9dc67ae63027e P 48fd723a77ba455eabb997723f60371b: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:59.189522  1455 tablet_bootstrap.cc:654] T 4e3a90ba50264ff59de7e64f04e7cbde P ade8f52c75914406a928ad61a925ed1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:59.194061  1147 tablet_service.cc:1511] Processing CreateTablet for tablet 02297d83178f4c368a44b55829b3085e (DEFAULT_TABLE table=soft_deleted_table [id=9eee5303430b4e4aad32f306464681c9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:59.195439  1147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02297d83178f4c368a44b55829b3085e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:59.200591  1222 tablet_service.cc:1511] Processing CreateTablet for tablet 02297d83178f4c368a44b55829b3085e (DEFAULT_TABLE table=soft_deleted_table [id=9eee5303430b4e4aad32f306464681c9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:59.201995  1222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02297d83178f4c368a44b55829b3085e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:59.205080  1299 tablet_service.cc:1511] Processing CreateTablet for tablet 02297d83178f4c368a44b55829b3085e (DEFAULT_TABLE table=soft_deleted_table [id=9eee5303430b4e4aad32f306464681c9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:59.206427  1299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02297d83178f4c368a44b55829b3085e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:59.206594  1456 tablet_bootstrap.cc:492] T 7910908273664e89a7c9dc67ae63027e P 48fd723a77ba455eabb997723f60371b: No bootstrap required, opened a new log
I20260709 12:14:59.207170  1456 ts_tablet_manager.cc:1403] T 7910908273664e89a7c9dc67ae63027e P 48fd723a77ba455eabb997723f60371b: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.000s
I20260709 12:14:59.210307  1456 raft_consensus.cc:359] T 7910908273664e89a7c9dc67ae63027e P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.211014  1456 raft_consensus.cc:385] T 7910908273664e89a7c9dc67ae63027e P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:59.220114  1456 raft_consensus.cc:740] T 7910908273664e89a7c9dc67ae63027e P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48fd723a77ba455eabb997723f60371b, State: Initialized, Role: FOLLOWER
I20260709 12:14:59.223443  1144 tablet_service.cc:1511] Processing CreateTablet for tablet 3ac88bcbdd344e7bba9a49e2e766242c (DEFAULT_TABLE table=soft_deleted_table [id=9eee5303430b4e4aad32f306464681c9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:59.224810  1144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ac88bcbdd344e7bba9a49e2e766242c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:59.243752  1456 consensus_queue.cc:260] T 7910908273664e89a7c9dc67ae63027e P 48fd723a77ba455eabb997723f60371b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.245357  1220 tablet_service.cc:1511] Processing CreateTablet for tablet 3ac88bcbdd344e7bba9a49e2e766242c (DEFAULT_TABLE table=soft_deleted_table [id=9eee5303430b4e4aad32f306464681c9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:59.245934  1443 raft_consensus.cc:493] T 7910908273664e89a7c9dc67ae63027e P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.246743  1220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ac88bcbdd344e7bba9a49e2e766242c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:59.246443  1443 raft_consensus.cc:515] T 7910908273664e89a7c9dc67ae63027e P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.248462  1292 tablet_service.cc:1511] Processing CreateTablet for tablet 3ac88bcbdd344e7bba9a49e2e766242c (DEFAULT_TABLE table=soft_deleted_table [id=9eee5303430b4e4aad32f306464681c9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:59.249761  1292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ac88bcbdd344e7bba9a49e2e766242c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:59.250835  1443 leader_election.cc:290] T 7910908273664e89a7c9dc67ae63027e P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ade8f52c75914406a928ad61a925ed1b (127.20.196.130:40533), 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381)
I20260709 12:14:59.253572  1456 ts_tablet_manager.cc:1434] T 7910908273664e89a7c9dc67ae63027e P 48fd723a77ba455eabb997723f60371b: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.000s
I20260709 12:14:59.255023  1233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910908273664e89a7c9dc67ae63027e" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade8f52c75914406a928ad61a925ed1b" is_pre_election: true
W20260709 12:14:59.258062  1125 leader_election.cc:343] T 7910908273664e89a7c9dc67ae63027e P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381): Not found: Tablet not found: 7910908273664e89a7c9dc67ae63027e
W20260709 12:14:59.260888  1123 leader_election.cc:343] T 7910908273664e89a7c9dc67ae63027e P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ade8f52c75914406a928ad61a925ed1b (127.20.196.130:40533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:59.261327  1123 leader_election.cc:304] T 7910908273664e89a7c9dc67ae63027e P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48fd723a77ba455eabb997723f60371b; no voters: 9281096d749a4bf691c774d3321672e7, ade8f52c75914406a928ad61a925ed1b
I20260709 12:14:59.262480  1443 raft_consensus.cc:2749] T 7910908273664e89a7c9dc67ae63027e P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:59.264219  1456 tablet_bootstrap.cc:492] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 48fd723a77ba455eabb997723f60371b: Bootstrap starting.
I20260709 12:14:59.281802  1456 tablet_bootstrap.cc:654] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 48fd723a77ba455eabb997723f60371b: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:59.292543  1456 tablet_bootstrap.cc:492] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 48fd723a77ba455eabb997723f60371b: No bootstrap required, opened a new log
I20260709 12:14:59.294358  1456 ts_tablet_manager.cc:1403] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 48fd723a77ba455eabb997723f60371b: Time spent bootstrapping tablet: real 0.030s	user 0.006s	sys 0.006s
I20260709 12:14:59.297956  1456 raft_consensus.cc:359] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.302207  1456 raft_consensus.cc:385] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:59.302958  1456 raft_consensus.cc:740] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48fd723a77ba455eabb997723f60371b, State: Initialized, Role: FOLLOWER
I20260709 12:14:59.304209  1456 consensus_queue.cc:260] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 48fd723a77ba455eabb997723f60371b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.308403  1456 ts_tablet_manager.cc:1434] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 48fd723a77ba455eabb997723f60371b: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
I20260709 12:14:59.311060  1455 tablet_bootstrap.cc:492] T 4e3a90ba50264ff59de7e64f04e7cbde P ade8f52c75914406a928ad61a925ed1b: No bootstrap required, opened a new log
I20260709 12:14:59.311669  1455 ts_tablet_manager.cc:1403] T 4e3a90ba50264ff59de7e64f04e7cbde P ade8f52c75914406a928ad61a925ed1b: Time spent bootstrapping tablet: real 0.141s	user 0.031s	sys 0.015s
I20260709 12:14:59.315254  1459 tablet_bootstrap.cc:492] T 6f7eb2b18b3e4b0eba971970313a52c2 P 9281096d749a4bf691c774d3321672e7: Bootstrap starting.
I20260709 12:14:59.318162  1456 tablet_bootstrap.cc:492] T fa41764beac241228184f7b2c3a4b1a5 P 48fd723a77ba455eabb997723f60371b: Bootstrap starting.
I20260709 12:14:59.318650  1455 raft_consensus.cc:359] T 4e3a90ba50264ff59de7e64f04e7cbde P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.320406  1455 raft_consensus.cc:385] T 4e3a90ba50264ff59de7e64f04e7cbde P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:59.320807  1455 raft_consensus.cc:740] T 4e3a90ba50264ff59de7e64f04e7cbde P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade8f52c75914406a928ad61a925ed1b, State: Initialized, Role: FOLLOWER
I20260709 12:14:59.321674  1455 consensus_queue.cc:260] T 4e3a90ba50264ff59de7e64f04e7cbde P ade8f52c75914406a928ad61a925ed1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.324345  1455 ts_tablet_manager.cc:1434] T 4e3a90ba50264ff59de7e64f04e7cbde P ade8f52c75914406a928ad61a925ed1b: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:14:59.325486  1455 tablet_bootstrap.cc:492] T fa41764beac241228184f7b2c3a4b1a5 P ade8f52c75914406a928ad61a925ed1b: Bootstrap starting.
I20260709 12:14:59.325803  1456 tablet_bootstrap.cc:654] T fa41764beac241228184f7b2c3a4b1a5 P 48fd723a77ba455eabb997723f60371b: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:59.332540  1455 tablet_bootstrap.cc:654] T fa41764beac241228184f7b2c3a4b1a5 P ade8f52c75914406a928ad61a925ed1b: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:59.334450  1106 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:59.344072  1456 tablet_bootstrap.cc:492] T fa41764beac241228184f7b2c3a4b1a5 P 48fd723a77ba455eabb997723f60371b: No bootstrap required, opened a new log
I20260709 12:14:59.344743  1456 ts_tablet_manager.cc:1403] T fa41764beac241228184f7b2c3a4b1a5 P 48fd723a77ba455eabb997723f60371b: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.009s
I20260709 12:14:59.347958  1456 raft_consensus.cc:359] T fa41764beac241228184f7b2c3a4b1a5 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.348570  1456 raft_consensus.cc:385] T fa41764beac241228184f7b2c3a4b1a5 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:59.348930  1456 raft_consensus.cc:740] T fa41764beac241228184f7b2c3a4b1a5 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48fd723a77ba455eabb997723f60371b, State: Initialized, Role: FOLLOWER
I20260709 12:14:59.349668  1456 consensus_queue.cc:260] T fa41764beac241228184f7b2c3a4b1a5 P 48fd723a77ba455eabb997723f60371b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.352044  1456 ts_tablet_manager.cc:1434] T fa41764beac241228184f7b2c3a4b1a5 P 48fd723a77ba455eabb997723f60371b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:14:59.353461  1456 tablet_bootstrap.cc:492] T 6dae4debcb434769a07d735facc9817f P 48fd723a77ba455eabb997723f60371b: Bootstrap starting.
I20260709 12:14:59.354382  1459 tablet_bootstrap.cc:654] T 6f7eb2b18b3e4b0eba971970313a52c2 P 9281096d749a4bf691c774d3321672e7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:59.360023  1455 tablet_bootstrap.cc:492] T fa41764beac241228184f7b2c3a4b1a5 P ade8f52c75914406a928ad61a925ed1b: No bootstrap required, opened a new log
I20260709 12:14:59.360590  1455 ts_tablet_manager.cc:1403] T fa41764beac241228184f7b2c3a4b1a5 P ade8f52c75914406a928ad61a925ed1b: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.010s
I20260709 12:14:59.361466  1456 tablet_bootstrap.cc:654] T 6dae4debcb434769a07d735facc9817f P 48fd723a77ba455eabb997723f60371b: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:59.362154  1459 tablet_bootstrap.cc:492] T 6f7eb2b18b3e4b0eba971970313a52c2 P 9281096d749a4bf691c774d3321672e7: No bootstrap required, opened a new log
I20260709 12:14:59.362759  1459 ts_tablet_manager.cc:1403] T 6f7eb2b18b3e4b0eba971970313a52c2 P 9281096d749a4bf691c774d3321672e7: Time spent bootstrapping tablet: real 0.048s	user 0.010s	sys 0.003s
I20260709 12:14:59.364061  1455 raft_consensus.cc:359] T fa41764beac241228184f7b2c3a4b1a5 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.365033  1455 raft_consensus.cc:385] T fa41764beac241228184f7b2c3a4b1a5 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:59.365504  1455 raft_consensus.cc:740] T fa41764beac241228184f7b2c3a4b1a5 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade8f52c75914406a928ad61a925ed1b, State: Initialized, Role: FOLLOWER
I20260709 12:14:59.365859  1459 raft_consensus.cc:359] T 6f7eb2b18b3e4b0eba971970313a52c2 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.366727  1459 raft_consensus.cc:385] T 6f7eb2b18b3e4b0eba971970313a52c2 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:59.367332  1459 raft_consensus.cc:740] T 6f7eb2b18b3e4b0eba971970313a52c2 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9281096d749a4bf691c774d3321672e7, State: Initialized, Role: FOLLOWER
I20260709 12:14:59.366698  1455 consensus_queue.cc:260] T fa41764beac241228184f7b2c3a4b1a5 P ade8f52c75914406a928ad61a925ed1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.368062  1459 consensus_queue.cc:260] T 6f7eb2b18b3e4b0eba971970313a52c2 P 9281096d749a4bf691c774d3321672e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.370328  1459 ts_tablet_manager.cc:1434] T 6f7eb2b18b3e4b0eba971970313a52c2 P 9281096d749a4bf691c774d3321672e7: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:14:59.370993  1455 ts_tablet_manager.cc:1434] T fa41764beac241228184f7b2c3a4b1a5 P ade8f52c75914406a928ad61a925ed1b: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:14:59.371610  1459 tablet_bootstrap.cc:492] T 02297d83178f4c368a44b55829b3085e P 9281096d749a4bf691c774d3321672e7: Bootstrap starting.
I20260709 12:14:59.372347  1455 tablet_bootstrap.cc:492] T 7910908273664e89a7c9dc67ae63027e P ade8f52c75914406a928ad61a925ed1b: Bootstrap starting.
I20260709 12:14:59.378912  1459 tablet_bootstrap.cc:654] T 02297d83178f4c368a44b55829b3085e P 9281096d749a4bf691c774d3321672e7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:59.381188  1455 tablet_bootstrap.cc:654] T 7910908273664e89a7c9dc67ae63027e P ade8f52c75914406a928ad61a925ed1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:59.382807  1456 tablet_bootstrap.cc:492] T 6dae4debcb434769a07d735facc9817f P 48fd723a77ba455eabb997723f60371b: No bootstrap required, opened a new log
I20260709 12:14:59.383448  1456 ts_tablet_manager.cc:1403] T 6dae4debcb434769a07d735facc9817f P 48fd723a77ba455eabb997723f60371b: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.012s
I20260709 12:14:59.387223  1456 raft_consensus.cc:359] T 6dae4debcb434769a07d735facc9817f P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.388258  1456 raft_consensus.cc:385] T 6dae4debcb434769a07d735facc9817f P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:59.388700  1456 raft_consensus.cc:740] T 6dae4debcb434769a07d735facc9817f P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48fd723a77ba455eabb997723f60371b, State: Initialized, Role: FOLLOWER
I20260709 12:14:59.390051  1456 consensus_queue.cc:260] T 6dae4debcb434769a07d735facc9817f P 48fd723a77ba455eabb997723f60371b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.392846  1455 tablet_bootstrap.cc:492] T 7910908273664e89a7c9dc67ae63027e P ade8f52c75914406a928ad61a925ed1b: No bootstrap required, opened a new log
I20260709 12:14:59.393419  1455 ts_tablet_manager.cc:1403] T 7910908273664e89a7c9dc67ae63027e P ade8f52c75914406a928ad61a925ed1b: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.005s
I20260709 12:14:59.393743  1456 ts_tablet_manager.cc:1434] T 6dae4debcb434769a07d735facc9817f P 48fd723a77ba455eabb997723f60371b: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:14:59.395285  1456 tablet_bootstrap.cc:492] T 02297d83178f4c368a44b55829b3085e P 48fd723a77ba455eabb997723f60371b: Bootstrap starting.
I20260709 12:14:59.396333  1455 raft_consensus.cc:359] T 7910908273664e89a7c9dc67ae63027e P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.397078  1455 raft_consensus.cc:385] T 7910908273664e89a7c9dc67ae63027e P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:59.397399  1455 raft_consensus.cc:740] T 7910908273664e89a7c9dc67ae63027e P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade8f52c75914406a928ad61a925ed1b, State: Initialized, Role: FOLLOWER
I20260709 12:14:59.398191  1455 consensus_queue.cc:260] T 7910908273664e89a7c9dc67ae63027e P ade8f52c75914406a928ad61a925ed1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.399909  1455 ts_tablet_manager.cc:1434] T 7910908273664e89a7c9dc67ae63027e P ade8f52c75914406a928ad61a925ed1b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:14:59.400888  1455 tablet_bootstrap.cc:492] T 6dae4debcb434769a07d735facc9817f P ade8f52c75914406a928ad61a925ed1b: Bootstrap starting.
I20260709 12:14:59.407250  1455 tablet_bootstrap.cc:654] T 6dae4debcb434769a07d735facc9817f P ade8f52c75914406a928ad61a925ed1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:59.424149  1456 tablet_bootstrap.cc:654] T 02297d83178f4c368a44b55829b3085e P 48fd723a77ba455eabb997723f60371b: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:59.432729  1455 tablet_bootstrap.cc:492] T 6dae4debcb434769a07d735facc9817f P ade8f52c75914406a928ad61a925ed1b: No bootstrap required, opened a new log
I20260709 12:14:59.433025  1456 tablet_bootstrap.cc:492] T 02297d83178f4c368a44b55829b3085e P 48fd723a77ba455eabb997723f60371b: No bootstrap required, opened a new log
I20260709 12:14:59.433049  1459 tablet_bootstrap.cc:492] T 02297d83178f4c368a44b55829b3085e P 9281096d749a4bf691c774d3321672e7: No bootstrap required, opened a new log
I20260709 12:14:59.433205  1455 ts_tablet_manager.cc:1403] T 6dae4debcb434769a07d735facc9817f P ade8f52c75914406a928ad61a925ed1b: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.016s
I20260709 12:14:59.433844  1456 ts_tablet_manager.cc:1403] T 02297d83178f4c368a44b55829b3085e P 48fd723a77ba455eabb997723f60371b: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.005s
I20260709 12:14:59.433867  1459 ts_tablet_manager.cc:1403] T 02297d83178f4c368a44b55829b3085e P 9281096d749a4bf691c774d3321672e7: Time spent bootstrapping tablet: real 0.063s	user 0.020s	sys 0.039s
I20260709 12:14:59.436133  1455 raft_consensus.cc:359] T 6dae4debcb434769a07d735facc9817f P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.436915  1455 raft_consensus.cc:385] T 6dae4debcb434769a07d735facc9817f P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:59.437244  1455 raft_consensus.cc:740] T 6dae4debcb434769a07d735facc9817f P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade8f52c75914406a928ad61a925ed1b, State: Initialized, Role: FOLLOWER
I20260709 12:14:59.437120  1459 raft_consensus.cc:359] T 02297d83178f4c368a44b55829b3085e P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.437282  1456 raft_consensus.cc:359] T 02297d83178f4c368a44b55829b3085e P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.438151  1459 raft_consensus.cc:385] T 02297d83178f4c368a44b55829b3085e P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:59.438228  1456 raft_consensus.cc:385] T 02297d83178f4c368a44b55829b3085e P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:59.438585  1459 raft_consensus.cc:740] T 02297d83178f4c368a44b55829b3085e P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9281096d749a4bf691c774d3321672e7, State: Initialized, Role: FOLLOWER
I20260709 12:14:59.438637  1456 raft_consensus.cc:740] T 02297d83178f4c368a44b55829b3085e P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48fd723a77ba455eabb997723f60371b, State: Initialized, Role: FOLLOWER
I20260709 12:14:59.438381  1455 consensus_queue.cc:260] T 6dae4debcb434769a07d735facc9817f P ade8f52c75914406a928ad61a925ed1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.439628  1459 consensus_queue.cc:260] T 02297d83178f4c368a44b55829b3085e P 9281096d749a4bf691c774d3321672e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.439738  1456 consensus_queue.cc:260] T 02297d83178f4c368a44b55829b3085e P 48fd723a77ba455eabb997723f60371b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.441062  1455 ts_tablet_manager.cc:1434] T 6dae4debcb434769a07d735facc9817f P ade8f52c75914406a928ad61a925ed1b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:14:59.442104  1455 tablet_bootstrap.cc:492] T 6f7eb2b18b3e4b0eba971970313a52c2 P ade8f52c75914406a928ad61a925ed1b: Bootstrap starting.
I20260709 12:14:59.444298  1459 ts_tablet_manager.cc:1434] T 02297d83178f4c368a44b55829b3085e P 9281096d749a4bf691c774d3321672e7: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 12:14:59.445333  1459 tablet_bootstrap.cc:492] T fa41764beac241228184f7b2c3a4b1a5 P 9281096d749a4bf691c774d3321672e7: Bootstrap starting.
I20260709 12:14:59.449028  1455 tablet_bootstrap.cc:654] T 6f7eb2b18b3e4b0eba971970313a52c2 P ade8f52c75914406a928ad61a925ed1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:59.450184  1456 ts_tablet_manager.cc:1434] T 02297d83178f4c368a44b55829b3085e P 48fd723a77ba455eabb997723f60371b: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:14:59.451834  1459 tablet_bootstrap.cc:654] T fa41764beac241228184f7b2c3a4b1a5 P 9281096d749a4bf691c774d3321672e7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:59.454651  1456 tablet_bootstrap.cc:492] T 6f7eb2b18b3e4b0eba971970313a52c2 P 48fd723a77ba455eabb997723f60371b: Bootstrap starting.
I20260709 12:14:59.461941  1443 raft_consensus.cc:493] T 6dae4debcb434769a07d735facc9817f P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.462713  1443 raft_consensus.cc:515] T 6dae4debcb434769a07d735facc9817f P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.465906  1443 leader_election.cc:290] T 6dae4debcb434769a07d735facc9817f P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ade8f52c75914406a928ad61a925ed1b (127.20.196.130:40533), 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381)
I20260709 12:14:59.466053  1233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dae4debcb434769a07d735facc9817f" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade8f52c75914406a928ad61a925ed1b" is_pre_election: true
I20260709 12:14:59.461943  1455 tablet_bootstrap.cc:492] T 6f7eb2b18b3e4b0eba971970313a52c2 P ade8f52c75914406a928ad61a925ed1b: No bootstrap required, opened a new log
I20260709 12:14:59.466759  1233 raft_consensus.cc:2468] T 6dae4debcb434769a07d735facc9817f P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48fd723a77ba455eabb997723f60371b in term 0.
I20260709 12:14:59.466946  1455 ts_tablet_manager.cc:1403] T 6f7eb2b18b3e4b0eba971970313a52c2 P ade8f52c75914406a928ad61a925ed1b: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.007s
I20260709 12:14:59.466964  1309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dae4debcb434769a07d735facc9817f" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9281096d749a4bf691c774d3321672e7" is_pre_election: true
I20260709 12:14:59.468227  1123 leader_election.cc:304] T 6dae4debcb434769a07d735facc9817f P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48fd723a77ba455eabb997723f60371b, ade8f52c75914406a928ad61a925ed1b; no voters: 
W20260709 12:14:59.468802  1125 leader_election.cc:343] T 6dae4debcb434769a07d735facc9817f P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:59.469105  1443 raft_consensus.cc:2804] T 6dae4debcb434769a07d735facc9817f P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:59.469508  1443 raft_consensus.cc:493] T 6dae4debcb434769a07d735facc9817f P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:59.469847  1443 raft_consensus.cc:3060] T 6dae4debcb434769a07d735facc9817f P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:59.470394  1455 raft_consensus.cc:359] T 6f7eb2b18b3e4b0eba971970313a52c2 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.471184  1455 raft_consensus.cc:385] T 6f7eb2b18b3e4b0eba971970313a52c2 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:59.471482  1455 raft_consensus.cc:740] T 6f7eb2b18b3e4b0eba971970313a52c2 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade8f52c75914406a928ad61a925ed1b, State: Initialized, Role: FOLLOWER
I20260709 12:14:59.474514  1456 tablet_bootstrap.cc:654] T 6f7eb2b18b3e4b0eba971970313a52c2 P 48fd723a77ba455eabb997723f60371b: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:59.474691  1455 consensus_queue.cc:260] T 6f7eb2b18b3e4b0eba971970313a52c2 P ade8f52c75914406a928ad61a925ed1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.477078  1455 ts_tablet_manager.cc:1434] T 6f7eb2b18b3e4b0eba971970313a52c2 P ade8f52c75914406a928ad61a925ed1b: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:14:59.478344  1455 tablet_bootstrap.cc:492] T 02297d83178f4c368a44b55829b3085e P ade8f52c75914406a928ad61a925ed1b: Bootstrap starting.
I20260709 12:14:59.480931  1459 tablet_bootstrap.cc:492] T fa41764beac241228184f7b2c3a4b1a5 P 9281096d749a4bf691c774d3321672e7: No bootstrap required, opened a new log
I20260709 12:14:59.481906  1459 ts_tablet_manager.cc:1403] T fa41764beac241228184f7b2c3a4b1a5 P 9281096d749a4bf691c774d3321672e7: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.007s
I20260709 12:14:59.484827  1455 tablet_bootstrap.cc:654] T 02297d83178f4c368a44b55829b3085e P ade8f52c75914406a928ad61a925ed1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:59.483795  1443 raft_consensus.cc:515] T 6dae4debcb434769a07d735facc9817f P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.491358  1233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dae4debcb434769a07d735facc9817f" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade8f52c75914406a928ad61a925ed1b"
I20260709 12:14:59.491964  1456 tablet_bootstrap.cc:492] T 6f7eb2b18b3e4b0eba971970313a52c2 P 48fd723a77ba455eabb997723f60371b: No bootstrap required, opened a new log
I20260709 12:14:59.491959  1233 raft_consensus.cc:3060] T 6dae4debcb434769a07d735facc9817f P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:59.492599  1456 ts_tablet_manager.cc:1403] T 6f7eb2b18b3e4b0eba971970313a52c2 P 48fd723a77ba455eabb997723f60371b: Time spent bootstrapping tablet: real 0.038s	user 0.019s	sys 0.007s
I20260709 12:14:59.499147  1459 raft_consensus.cc:359] T fa41764beac241228184f7b2c3a4b1a5 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.499338  1456 raft_consensus.cc:359] T 6f7eb2b18b3e4b0eba971970313a52c2 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.500010  1459 raft_consensus.cc:385] T fa41764beac241228184f7b2c3a4b1a5 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:59.500170  1455 tablet_bootstrap.cc:492] T 02297d83178f4c368a44b55829b3085e P ade8f52c75914406a928ad61a925ed1b: No bootstrap required, opened a new log
I20260709 12:14:59.500257  1456 raft_consensus.cc:385] T 6f7eb2b18b3e4b0eba971970313a52c2 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:59.500900  1455 ts_tablet_manager.cc:1403] T 02297d83178f4c368a44b55829b3085e P ade8f52c75914406a928ad61a925ed1b: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.003s
I20260709 12:14:59.500955  1456 raft_consensus.cc:740] T 6f7eb2b18b3e4b0eba971970313a52c2 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48fd723a77ba455eabb997723f60371b, State: Initialized, Role: FOLLOWER
I20260709 12:14:59.501163  1233 raft_consensus.cc:2468] T 6dae4debcb434769a07d735facc9817f P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48fd723a77ba455eabb997723f60371b in term 1.
I20260709 12:14:59.502358  1309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dae4debcb434769a07d735facc9817f" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9281096d749a4bf691c774d3321672e7"
I20260709 12:14:59.502285  1456 consensus_queue.cc:260] T 6f7eb2b18b3e4b0eba971970313a52c2 P 48fd723a77ba455eabb997723f60371b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.503012  1123 leader_election.cc:304] T 6dae4debcb434769a07d735facc9817f P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48fd723a77ba455eabb997723f60371b, ade8f52c75914406a928ad61a925ed1b; no voters: 
W20260709 12:14:59.503887  1125 leader_election.cc:343] T 6dae4debcb434769a07d735facc9817f P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:59.504247  1455 raft_consensus.cc:359] T 02297d83178f4c368a44b55829b3085e P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.504454  1443 leader_election.cc:290] T 6dae4debcb434769a07d735facc9817f P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 election: Requested vote from peers ade8f52c75914406a928ad61a925ed1b (127.20.196.130:40533), 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381)
I20260709 12:14:59.504511  1444 raft_consensus.cc:2804] T 6dae4debcb434769a07d735facc9817f P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:59.504801  1456 ts_tablet_manager.cc:1434] T 6f7eb2b18b3e4b0eba971970313a52c2 P 48fd723a77ba455eabb997723f60371b: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.001s
I20260709 12:14:59.504984  1455 raft_consensus.cc:385] T 02297d83178f4c368a44b55829b3085e P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:59.505697  1455 raft_consensus.cc:740] T 02297d83178f4c368a44b55829b3085e P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade8f52c75914406a928ad61a925ed1b, State: Initialized, Role: FOLLOWER
I20260709 12:14:59.506073  1456 tablet_bootstrap.cc:492] T 3ac88bcbdd344e7bba9a49e2e766242c P 48fd723a77ba455eabb997723f60371b: Bootstrap starting.
I20260709 12:14:59.506907  1455 consensus_queue.cc:260] T 02297d83178f4c368a44b55829b3085e P ade8f52c75914406a928ad61a925ed1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.508019  1444 raft_consensus.cc:697] T 6dae4debcb434769a07d735facc9817f P 48fd723a77ba455eabb997723f60371b [term 1 LEADER]: Becoming Leader. State: Replica: 48fd723a77ba455eabb997723f60371b, State: Running, Role: LEADER
I20260709 12:14:59.509050  1444 consensus_queue.cc:237] T 6dae4debcb434769a07d735facc9817f P 48fd723a77ba455eabb997723f60371b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.500383  1459 raft_consensus.cc:740] T fa41764beac241228184f7b2c3a4b1a5 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9281096d749a4bf691c774d3321672e7, State: Initialized, Role: FOLLOWER
I20260709 12:14:59.510970  1459 consensus_queue.cc:260] T fa41764beac241228184f7b2c3a4b1a5 P 9281096d749a4bf691c774d3321672e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.513437  1456 tablet_bootstrap.cc:654] T 3ac88bcbdd344e7bba9a49e2e766242c P 48fd723a77ba455eabb997723f60371b: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:59.513772  1459 ts_tablet_manager.cc:1434] T fa41764beac241228184f7b2c3a4b1a5 P 9281096d749a4bf691c774d3321672e7: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 12:14:59.524398  1459 tablet_bootstrap.cc:492] T 3ac88bcbdd344e7bba9a49e2e766242c P 9281096d749a4bf691c774d3321672e7: Bootstrap starting.
I20260709 12:14:59.524595  1455 ts_tablet_manager.cc:1434] T 02297d83178f4c368a44b55829b3085e P ade8f52c75914406a928ad61a925ed1b: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.004s
I20260709 12:14:59.525771  1455 tablet_bootstrap.cc:492] T 3ac88bcbdd344e7bba9a49e2e766242c P ade8f52c75914406a928ad61a925ed1b: Bootstrap starting.
I20260709 12:14:59.519171  1421 raft_consensus.cc:493] T 7910908273664e89a7c9dc67ae63027e P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.527696  1421 raft_consensus.cc:515] T 7910908273664e89a7c9dc67ae63027e P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.530356  1421 leader_election.cc:290] T 7910908273664e89a7c9dc67ae63027e P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48fd723a77ba455eabb997723f60371b (127.20.196.129:40613), 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381)
I20260709 12:14:59.531251  1158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910908273664e89a7c9dc67ae63027e" candidate_uuid: "ade8f52c75914406a928ad61a925ed1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48fd723a77ba455eabb997723f60371b" is_pre_election: true
I20260709 12:14:59.531983  1158 raft_consensus.cc:2468] T 7910908273664e89a7c9dc67ae63027e P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ade8f52c75914406a928ad61a925ed1b in term 0.
I20260709 12:14:59.532169  1473 raft_consensus.cc:493] T fa41764beac241228184f7b2c3a4b1a5 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.532753  1473 raft_consensus.cc:515] T fa41764beac241228184f7b2c3a4b1a5 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.534251  1309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910908273664e89a7c9dc67ae63027e" candidate_uuid: "ade8f52c75914406a928ad61a925ed1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9281096d749a4bf691c774d3321672e7" is_pre_election: true
I20260709 12:14:59.533845  1200 leader_election.cc:304] T 7910908273664e89a7c9dc67ae63027e P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48fd723a77ba455eabb997723f60371b, ade8f52c75914406a928ad61a925ed1b; no voters: 
I20260709 12:14:59.538914  1443 raft_consensus.cc:493] T 02297d83178f4c368a44b55829b3085e P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.541605  1443 raft_consensus.cc:515] T 02297d83178f4c368a44b55829b3085e P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.542276  1421 raft_consensus.cc:2804] T 7910908273664e89a7c9dc67ae63027e P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:59.542955  1421 raft_consensus.cc:493] T 7910908273664e89a7c9dc67ae63027e P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:59.543494  1421 raft_consensus.cc:3060] T 7910908273664e89a7c9dc67ae63027e P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:59.548062  1309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02297d83178f4c368a44b55829b3085e" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9281096d749a4bf691c774d3321672e7" is_pre_election: true
I20260709 12:14:59.548208  1233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02297d83178f4c368a44b55829b3085e" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade8f52c75914406a928ad61a925ed1b" is_pre_election: true
I20260709 12:14:59.548900  1309 raft_consensus.cc:2468] T 02297d83178f4c368a44b55829b3085e P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48fd723a77ba455eabb997723f60371b in term 0.
I20260709 12:14:59.548987  1233 raft_consensus.cc:2468] T 02297d83178f4c368a44b55829b3085e P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48fd723a77ba455eabb997723f60371b in term 0.
I20260709 12:14:59.550452  1125 leader_election.cc:304] T 02297d83178f4c368a44b55829b3085e P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48fd723a77ba455eabb997723f60371b, 9281096d749a4bf691c774d3321672e7; no voters: 
I20260709 12:14:59.551539  1443 leader_election.cc:290] T 02297d83178f4c368a44b55829b3085e P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ade8f52c75914406a928ad61a925ed1b (127.20.196.130:40533), 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381)
I20260709 12:14:59.552385  1443 raft_consensus.cc:2804] T 02297d83178f4c368a44b55829b3085e P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:59.552785  1443 raft_consensus.cc:493] T 02297d83178f4c368a44b55829b3085e P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:59.553326  1443 raft_consensus.cc:3060] T 02297d83178f4c368a44b55829b3085e P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:59.554337  1459 tablet_bootstrap.cc:654] T 3ac88bcbdd344e7bba9a49e2e766242c P 9281096d749a4bf691c774d3321672e7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:59.556408  1233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa41764beac241228184f7b2c3a4b1a5" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade8f52c75914406a928ad61a925ed1b" is_pre_election: true
I20260709 12:14:59.557153  1233 raft_consensus.cc:2468] T fa41764beac241228184f7b2c3a4b1a5 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48fd723a77ba455eabb997723f60371b in term 0.
I20260709 12:14:59.557406  1309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa41764beac241228184f7b2c3a4b1a5" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9281096d749a4bf691c774d3321672e7" is_pre_election: true
I20260709 12:14:59.558048  1309 raft_consensus.cc:2468] T fa41764beac241228184f7b2c3a4b1a5 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48fd723a77ba455eabb997723f60371b in term 0.
I20260709 12:14:59.558907  1123 leader_election.cc:304] T fa41764beac241228184f7b2c3a4b1a5 P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48fd723a77ba455eabb997723f60371b, ade8f52c75914406a928ad61a925ed1b; no voters: 
I20260709 12:14:59.559885  1473 leader_election.cc:290] T fa41764beac241228184f7b2c3a4b1a5 P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ade8f52c75914406a928ad61a925ed1b (127.20.196.130:40533), 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381)
I20260709 12:14:59.560506  1444 raft_consensus.cc:2804] T fa41764beac241228184f7b2c3a4b1a5 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:59.560968  1444 raft_consensus.cc:493] T fa41764beac241228184f7b2c3a4b1a5 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:59.561367  1444 raft_consensus.cc:3060] T fa41764beac241228184f7b2c3a4b1a5 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:59.561486  1456 tablet_bootstrap.cc:492] T 3ac88bcbdd344e7bba9a49e2e766242c P 48fd723a77ba455eabb997723f60371b: No bootstrap required, opened a new log
I20260709 12:14:59.562093  1456 ts_tablet_manager.cc:1403] T 3ac88bcbdd344e7bba9a49e2e766242c P 48fd723a77ba455eabb997723f60371b: Time spent bootstrapping tablet: real 0.056s	user 0.011s	sys 0.012s
I20260709 12:14:59.564436  1455 tablet_bootstrap.cc:654] T 3ac88bcbdd344e7bba9a49e2e766242c P ade8f52c75914406a928ad61a925ed1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:59.568061  1057 catalog_manager.cc:5697] T 6dae4debcb434769a07d735facc9817f P 48fd723a77ba455eabb997723f60371b reported cstate change: term changed from 0 to 1, leader changed from <none> to 48fd723a77ba455eabb997723f60371b (127.20.196.129). New cstate: current_term: 1 leader_uuid: "48fd723a77ba455eabb997723f60371b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:59.571137  1443 raft_consensus.cc:515] T 02297d83178f4c368a44b55829b3085e P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.566324  1421 raft_consensus.cc:515] T 7910908273664e89a7c9dc67ae63027e P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.574142  1421 leader_election.cc:290] T 7910908273664e89a7c9dc67ae63027e P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 1 election: Requested vote from peers 48fd723a77ba455eabb997723f60371b (127.20.196.129:40613), 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381)
I20260709 12:14:59.575192  1459 tablet_bootstrap.cc:492] T 3ac88bcbdd344e7bba9a49e2e766242c P 9281096d749a4bf691c774d3321672e7: No bootstrap required, opened a new log
I20260709 12:14:59.575949  1459 ts_tablet_manager.cc:1403] T 3ac88bcbdd344e7bba9a49e2e766242c P 9281096d749a4bf691c774d3321672e7: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.006s
I20260709 12:14:59.576221  1443 leader_election.cc:290] T 02297d83178f4c368a44b55829b3085e P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 election: Requested vote from peers ade8f52c75914406a928ad61a925ed1b (127.20.196.130:40533), 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381)
I20260709 12:14:59.565641  1456 raft_consensus.cc:359] T 3ac88bcbdd344e7bba9a49e2e766242c P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.576905  1456 raft_consensus.cc:385] T 3ac88bcbdd344e7bba9a49e2e766242c P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:59.577293  1456 raft_consensus.cc:740] T 3ac88bcbdd344e7bba9a49e2e766242c P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48fd723a77ba455eabb997723f60371b, State: Initialized, Role: FOLLOWER
I20260709 12:14:59.577061  1444 raft_consensus.cc:515] T fa41764beac241228184f7b2c3a4b1a5 P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.577435  1233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02297d83178f4c368a44b55829b3085e" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade8f52c75914406a928ad61a925ed1b"
I20260709 12:14:59.578619  1309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02297d83178f4c368a44b55829b3085e" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9281096d749a4bf691c774d3321672e7"
I20260709 12:14:59.581295  1233 raft_consensus.cc:3060] T 02297d83178f4c368a44b55829b3085e P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:59.581378  1309 raft_consensus.cc:3060] T 02297d83178f4c368a44b55829b3085e P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:59.587965  1443 raft_consensus.cc:493] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.591679  1443 raft_consensus.cc:515] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.579536  1459 raft_consensus.cc:359] T 3ac88bcbdd344e7bba9a49e2e766242c P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.592274  1235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa41764beac241228184f7b2c3a4b1a5" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade8f52c75914406a928ad61a925ed1b"
I20260709 12:14:59.592636  1459 raft_consensus.cc:385] T 3ac88bcbdd344e7bba9a49e2e766242c P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:59.593083  1459 raft_consensus.cc:740] T 3ac88bcbdd344e7bba9a49e2e766242c P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9281096d749a4bf691c774d3321672e7, State: Initialized, Role: FOLLOWER
I20260709 12:14:59.594380  1443 leader_election.cc:290] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ade8f52c75914406a928ad61a925ed1b (127.20.196.130:40533), 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381)
I20260709 12:14:59.594362  1459 consensus_queue.cc:260] T 3ac88bcbdd344e7bba9a49e2e766242c P 9281096d749a4bf691c774d3321672e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.595958  1234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d226ed3f0e4fb8bae68b4340e8e4a1" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade8f52c75914406a928ad61a925ed1b" is_pre_election: true
I20260709 12:14:59.594301  1310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa41764beac241228184f7b2c3a4b1a5" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9281096d749a4bf691c774d3321672e7"
I20260709 12:14:59.596936  1310 raft_consensus.cc:3060] T fa41764beac241228184f7b2c3a4b1a5 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:59.597296  1459 ts_tablet_manager.cc:1434] T 3ac88bcbdd344e7bba9a49e2e766242c P 9281096d749a4bf691c774d3321672e7: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.003s
W20260709 12:14:59.597697  1123 leader_election.cc:343] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ade8f52c75914406a928ad61a925ed1b (127.20.196.130:40533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:59.588428  1309 raft_consensus.cc:2468] T 02297d83178f4c368a44b55829b3085e P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48fd723a77ba455eabb997723f60371b in term 1.
I20260709 12:14:59.598357  1459 tablet_bootstrap.cc:492] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 9281096d749a4bf691c774d3321672e7: Bootstrap starting.
I20260709 12:14:59.578310  1456 consensus_queue.cc:260] T 3ac88bcbdd344e7bba9a49e2e766242c P 48fd723a77ba455eabb997723f60371b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.599797  1125 leader_election.cc:304] T 02297d83178f4c368a44b55829b3085e P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48fd723a77ba455eabb997723f60371b, 9281096d749a4bf691c774d3321672e7; no voters: 
I20260709 12:14:59.600903  1473 raft_consensus.cc:2804] T 02297d83178f4c368a44b55829b3085e P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:59.601351  1473 raft_consensus.cc:697] T 02297d83178f4c368a44b55829b3085e P 48fd723a77ba455eabb997723f60371b [term 1 LEADER]: Becoming Leader. State: Replica: 48fd723a77ba455eabb997723f60371b, State: Running, Role: LEADER
I20260709 12:14:59.601449  1456 ts_tablet_manager.cc:1434] T 3ac88bcbdd344e7bba9a49e2e766242c P 48fd723a77ba455eabb997723f60371b: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 12:14:59.602528  1456 tablet_bootstrap.cc:492] T 4e3a90ba50264ff59de7e64f04e7cbde P 48fd723a77ba455eabb997723f60371b: Bootstrap starting.
I20260709 12:14:59.602252  1473 consensus_queue.cc:237] T 02297d83178f4c368a44b55829b3085e P 48fd723a77ba455eabb997723f60371b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.605696  1459 tablet_bootstrap.cc:654] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 9281096d749a4bf691c774d3321672e7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:59.609892  1456 tablet_bootstrap.cc:654] T 4e3a90ba50264ff59de7e64f04e7cbde P 48fd723a77ba455eabb997723f60371b: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:59.590664  1455 tablet_bootstrap.cc:492] T 3ac88bcbdd344e7bba9a49e2e766242c P ade8f52c75914406a928ad61a925ed1b: No bootstrap required, opened a new log
I20260709 12:14:59.580060  1421 raft_consensus.cc:493] T 4e3a90ba50264ff59de7e64f04e7cbde P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.613114  1310 raft_consensus.cc:2468] T fa41764beac241228184f7b2c3a4b1a5 P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48fd723a77ba455eabb997723f60371b in term 1.
I20260709 12:14:59.613454  1421 raft_consensus.cc:515] T 4e3a90ba50264ff59de7e64f04e7cbde P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.614763  1125 leader_election.cc:304] T fa41764beac241228184f7b2c3a4b1a5 P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48fd723a77ba455eabb997723f60371b, 9281096d749a4bf691c774d3321672e7; no voters: 
I20260709 12:14:59.615563  1421 leader_election.cc:290] T 4e3a90ba50264ff59de7e64f04e7cbde P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48fd723a77ba455eabb997723f60371b (127.20.196.129:40613), 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381)
I20260709 12:14:59.593003  1235 raft_consensus.cc:3060] T fa41764beac241228184f7b2c3a4b1a5 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:59.613178  1455 ts_tablet_manager.cc:1403] T 3ac88bcbdd344e7bba9a49e2e766242c P ade8f52c75914406a928ad61a925ed1b: Time spent bootstrapping tablet: real 0.088s	user 0.015s	sys 0.005s
I20260709 12:14:59.616149  1443 raft_consensus.cc:2804] T fa41764beac241228184f7b2c3a4b1a5 P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:59.617637  1444 leader_election.cc:290] T fa41764beac241228184f7b2c3a4b1a5 P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 election: Requested vote from peers ade8f52c75914406a928ad61a925ed1b (127.20.196.130:40533), 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381)
I20260709 12:14:59.618472  1459 tablet_bootstrap.cc:492] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 9281096d749a4bf691c774d3321672e7: No bootstrap required, opened a new log
I20260709 12:14:59.619184  1459 ts_tablet_manager.cc:1403] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 9281096d749a4bf691c774d3321672e7: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
W20260709 12:14:59.580612  1200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.196.129:40613, user_credentials={real_user=slave}} blocked reactor thread for 46868.7us
I20260709 12:14:59.589591  1233 raft_consensus.cc:2468] T 02297d83178f4c368a44b55829b3085e P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48fd723a77ba455eabb997723f60371b in term 1.
I20260709 12:14:59.623342  1459 raft_consensus.cc:359] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.619067  1455 raft_consensus.cc:359] T 3ac88bcbdd344e7bba9a49e2e766242c P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.624579  1455 raft_consensus.cc:385] T 3ac88bcbdd344e7bba9a49e2e766242c P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:59.624361  1459 raft_consensus.cc:385] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:59.595865  1308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d226ed3f0e4fb8bae68b4340e8e4a1" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9281096d749a4bf691c774d3321672e7" is_pre_election: true
I20260709 12:14:59.625188  1459 raft_consensus.cc:740] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9281096d749a4bf691c774d3321672e7, State: Initialized, Role: FOLLOWER
I20260709 12:14:59.626660  1443 raft_consensus.cc:697] T fa41764beac241228184f7b2c3a4b1a5 P 48fd723a77ba455eabb997723f60371b [term 1 LEADER]: Becoming Leader. State: Replica: 48fd723a77ba455eabb997723f60371b, State: Running, Role: LEADER
I20260709 12:14:59.624961  1455 raft_consensus.cc:740] T 3ac88bcbdd344e7bba9a49e2e766242c P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade8f52c75914406a928ad61a925ed1b, State: Initialized, Role: FOLLOWER
I20260709 12:14:59.628054  1309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910908273664e89a7c9dc67ae63027e" candidate_uuid: "ade8f52c75914406a928ad61a925ed1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9281096d749a4bf691c774d3321672e7"
I20260709 12:14:59.627810  1158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910908273664e89a7c9dc67ae63027e" candidate_uuid: "ade8f52c75914406a928ad61a925ed1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48fd723a77ba455eabb997723f60371b"
I20260709 12:14:59.628777  1158 raft_consensus.cc:3060] T 7910908273664e89a7c9dc67ae63027e P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:59.629575  1459 consensus_queue.cc:260] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 9281096d749a4bf691c774d3321672e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.629261  1057 catalog_manager.cc:5697] T 02297d83178f4c368a44b55829b3085e P 48fd723a77ba455eabb997723f60371b reported cstate change: term changed from 0 to 1, leader changed from <none> to 48fd723a77ba455eabb997723f60371b (127.20.196.129). New cstate: current_term: 1 leader_uuid: "48fd723a77ba455eabb997723f60371b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:59.631484  1308 raft_consensus.cc:2468] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48fd723a77ba455eabb997723f60371b in term 0.
I20260709 12:14:59.631983  1459 ts_tablet_manager.cc:1434] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 9281096d749a4bf691c774d3321672e7: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:14:59.633059  1459 tablet_bootstrap.cc:492] T 20c09a31d7a545b2ba4bb6853c19cab3 P 9281096d749a4bf691c774d3321672e7: Bootstrap starting.
I20260709 12:14:59.633307  1125 leader_election.cc:304] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48fd723a77ba455eabb997723f60371b, 9281096d749a4bf691c774d3321672e7; no voters: ade8f52c75914406a928ad61a925ed1b
I20260709 12:14:59.625682  1421 raft_consensus.cc:493] T 6f7eb2b18b3e4b0eba971970313a52c2 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.634249  1421 raft_consensus.cc:515] T 6f7eb2b18b3e4b0eba971970313a52c2 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.636329  1421 leader_election.cc:290] T 6f7eb2b18b3e4b0eba971970313a52c2 P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48fd723a77ba455eabb997723f60371b (127.20.196.129:40613), 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381)
I20260709 12:14:59.636921  1444 raft_consensus.cc:2804] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:59.637390  1444 raft_consensus.cc:493] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:59.637557  1308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e3a90ba50264ff59de7e64f04e7cbde" candidate_uuid: "ade8f52c75914406a928ad61a925ed1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9281096d749a4bf691c774d3321672e7" is_pre_election: true
I20260709 12:14:59.637740  1444 raft_consensus.cc:3060] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:59.639394  1160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e3a90ba50264ff59de7e64f04e7cbde" candidate_uuid: "ade8f52c75914406a928ad61a925ed1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48fd723a77ba455eabb997723f60371b" is_pre_election: true
I20260709 12:14:59.640015  1459 tablet_bootstrap.cc:654] T 20c09a31d7a545b2ba4bb6853c19cab3 P 9281096d749a4bf691c774d3321672e7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:59.644068  1443 consensus_queue.cc:237] T fa41764beac241228184f7b2c3a4b1a5 P 48fd723a77ba455eabb997723f60371b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
W20260709 12:14:59.644711  1200 leader_election.cc:343] T 7910908273664e89a7c9dc67ae63027e P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:59.645752  1200 leader_election.cc:343] T 7910908273664e89a7c9dc67ae63027e P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:59.646358  1200 leader_election.cc:343] T 4e3a90ba50264ff59de7e64f04e7cbde P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:59.648577  1455 consensus_queue.cc:260] T 3ac88bcbdd344e7bba9a49e2e766242c P ade8f52c75914406a928ad61a925ed1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.649317  1308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7eb2b18b3e4b0eba971970313a52c2" candidate_uuid: "ade8f52c75914406a928ad61a925ed1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9281096d749a4bf691c774d3321672e7" is_pre_election: true
I20260709 12:14:59.650089  1308 raft_consensus.cc:2468] T 6f7eb2b18b3e4b0eba971970313a52c2 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ade8f52c75914406a928ad61a925ed1b in term 0.
I20260709 12:14:59.652487  1444 raft_consensus.cc:515] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.653893  1158 raft_consensus.cc:2468] T 7910908273664e89a7c9dc67ae63027e P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade8f52c75914406a928ad61a925ed1b in term 1.
I20260709 12:14:59.655838  1233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d226ed3f0e4fb8bae68b4340e8e4a1" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade8f52c75914406a928ad61a925ed1b"
W20260709 12:14:59.657269  1123 leader_election.cc:343] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ade8f52c75914406a928ad61a925ed1b (127.20.196.130:40533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:59.626284  1235 raft_consensus.cc:2468] T fa41764beac241228184f7b2c3a4b1a5 P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48fd723a77ba455eabb997723f60371b in term 1.
I20260709 12:14:59.658444  1444 leader_election.cc:290] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 election: Requested vote from peers ade8f52c75914406a928ad61a925ed1b (127.20.196.130:40533), 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381)
I20260709 12:14:59.654543  1160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7eb2b18b3e4b0eba971970313a52c2" candidate_uuid: "ade8f52c75914406a928ad61a925ed1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48fd723a77ba455eabb997723f60371b" is_pre_election: true
I20260709 12:14:59.666579  1160 raft_consensus.cc:2468] T 6f7eb2b18b3e4b0eba971970313a52c2 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ade8f52c75914406a928ad61a925ed1b in term 0.
I20260709 12:14:59.668809  1310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d226ed3f0e4fb8bae68b4340e8e4a1" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9281096d749a4bf691c774d3321672e7"
I20260709 12:14:59.669689  1310 raft_consensus.cc:3060] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:59.679495  1455 ts_tablet_manager.cc:1434] T 3ac88bcbdd344e7bba9a49e2e766242c P ade8f52c75914406a928ad61a925ed1b: Time spent starting tablet: real 0.063s	user 0.003s	sys 0.005s
I20260709 12:14:59.681052  1455 tablet_bootstrap.cc:492] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P ade8f52c75914406a928ad61a925ed1b: Bootstrap starting.
I20260709 12:14:59.685621  1456 tablet_bootstrap.cc:492] T 4e3a90ba50264ff59de7e64f04e7cbde P 48fd723a77ba455eabb997723f60371b: No bootstrap required, opened a new log
I20260709 12:14:59.686308  1456 ts_tablet_manager.cc:1403] T 4e3a90ba50264ff59de7e64f04e7cbde P 48fd723a77ba455eabb997723f60371b: Time spent bootstrapping tablet: real 0.084s	user 0.023s	sys 0.012s
W20260709 12:14:59.665166  1200 leader_election.cc:343] T 4e3a90ba50264ff59de7e64f04e7cbde P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48fd723a77ba455eabb997723f60371b (127.20.196.129:40613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:59.687247  1200 leader_election.cc:304] T 4e3a90ba50264ff59de7e64f04e7cbde P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade8f52c75914406a928ad61a925ed1b; no voters: 48fd723a77ba455eabb997723f60371b, 9281096d749a4bf691c774d3321672e7
I20260709 12:14:59.688092  1421 raft_consensus.cc:2749] T 4e3a90ba50264ff59de7e64f04e7cbde P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:59.690831  1459 tablet_bootstrap.cc:492] T 20c09a31d7a545b2ba4bb6853c19cab3 P 9281096d749a4bf691c774d3321672e7: No bootstrap required, opened a new log
I20260709 12:14:59.691957  1459 ts_tablet_manager.cc:1403] T 20c09a31d7a545b2ba4bb6853c19cab3 P 9281096d749a4bf691c774d3321672e7: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.012s
I20260709 12:14:59.693787  1200 leader_election.cc:304] T 7910908273664e89a7c9dc67ae63027e P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48fd723a77ba455eabb997723f60371b, ade8f52c75914406a928ad61a925ed1b; no voters: 9281096d749a4bf691c774d3321672e7
I20260709 12:14:59.694732  1421 raft_consensus.cc:2804] T 7910908273664e89a7c9dc67ae63027e P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:59.695235  1421 raft_consensus.cc:697] T 7910908273664e89a7c9dc67ae63027e P ade8f52c75914406a928ad61a925ed1b [term 1 LEADER]: Becoming Leader. State: Replica: ade8f52c75914406a928ad61a925ed1b, State: Running, Role: LEADER
I20260709 12:14:59.696045  1421 consensus_queue.cc:237] T 7910908273664e89a7c9dc67ae63027e P ade8f52c75914406a928ad61a925ed1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.696444  1456 raft_consensus.cc:359] T 4e3a90ba50264ff59de7e64f04e7cbde P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.697431  1456 raft_consensus.cc:385] T 4e3a90ba50264ff59de7e64f04e7cbde P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:59.697774  1456 raft_consensus.cc:740] T 4e3a90ba50264ff59de7e64f04e7cbde P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48fd723a77ba455eabb997723f60371b, State: Initialized, Role: FOLLOWER
I20260709 12:14:59.698661  1456 consensus_queue.cc:260] T 4e3a90ba50264ff59de7e64f04e7cbde P 48fd723a77ba455eabb997723f60371b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.700424  1200 leader_election.cc:304] T 6f7eb2b18b3e4b0eba971970313a52c2 P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48fd723a77ba455eabb997723f60371b, ade8f52c75914406a928ad61a925ed1b; no voters: 
I20260709 12:14:59.701345  1456 ts_tablet_manager.cc:1434] T 4e3a90ba50264ff59de7e64f04e7cbde P 48fd723a77ba455eabb997723f60371b: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 12:14:59.701766  1476 raft_consensus.cc:2804] T 6f7eb2b18b3e4b0eba971970313a52c2 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:59.702198  1476 raft_consensus.cc:493] T 6f7eb2b18b3e4b0eba971970313a52c2 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:59.702498  1476 raft_consensus.cc:3060] T 6f7eb2b18b3e4b0eba971970313a52c2 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:59.702621  1456 tablet_bootstrap.cc:492] T 20c09a31d7a545b2ba4bb6853c19cab3 P 48fd723a77ba455eabb997723f60371b: Bootstrap starting.
I20260709 12:14:59.707492  1459 raft_consensus.cc:359] T 20c09a31d7a545b2ba4bb6853c19cab3 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.708551  1459 raft_consensus.cc:385] T 20c09a31d7a545b2ba4bb6853c19cab3 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:59.708930  1459 raft_consensus.cc:740] T 20c09a31d7a545b2ba4bb6853c19cab3 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9281096d749a4bf691c774d3321672e7, State: Initialized, Role: FOLLOWER
I20260709 12:14:59.709849  1476 raft_consensus.cc:515] T 6f7eb2b18b3e4b0eba971970313a52c2 P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.709856  1459 consensus_queue.cc:260] T 20c09a31d7a545b2ba4bb6853c19cab3 P 9281096d749a4bf691c774d3321672e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.720602  1476 leader_election.cc:290] T 6f7eb2b18b3e4b0eba971970313a52c2 P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 1 election: Requested vote from peers 48fd723a77ba455eabb997723f60371b (127.20.196.129:40613), 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381)
I20260709 12:14:59.721948  1459 ts_tablet_manager.cc:1434] T 20c09a31d7a545b2ba4bb6853c19cab3 P 9281096d749a4bf691c774d3321672e7: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.002s
I20260709 12:14:59.723351  1459 tablet_bootstrap.cc:492] T 4e3a90ba50264ff59de7e64f04e7cbde P 9281096d749a4bf691c774d3321672e7: Bootstrap starting.
I20260709 12:14:59.723516  1455 tablet_bootstrap.cc:654] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P ade8f52c75914406a928ad61a925ed1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:59.730517  1455 tablet_bootstrap.cc:492] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P ade8f52c75914406a928ad61a925ed1b: No bootstrap required, opened a new log
I20260709 12:14:59.731103  1455 ts_tablet_manager.cc:1403] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P ade8f52c75914406a928ad61a925ed1b: Time spent bootstrapping tablet: real 0.050s	user 0.007s	sys 0.005s
I20260709 12:14:59.732173  1160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7eb2b18b3e4b0eba971970313a52c2" candidate_uuid: "ade8f52c75914406a928ad61a925ed1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48fd723a77ba455eabb997723f60371b"
I20260709 12:14:59.732965  1160 raft_consensus.cc:3060] T 6f7eb2b18b3e4b0eba971970313a52c2 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:59.732189  1056 catalog_manager.cc:5697] T fa41764beac241228184f7b2c3a4b1a5 P 48fd723a77ba455eabb997723f60371b reported cstate change: term changed from 0 to 1, leader changed from <none> to 48fd723a77ba455eabb997723f60371b (127.20.196.129). New cstate: current_term: 1 leader_uuid: "48fd723a77ba455eabb997723f60371b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:59.733668  1459 tablet_bootstrap.cc:654] T 4e3a90ba50264ff59de7e64f04e7cbde P 9281096d749a4bf691c774d3321672e7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:59.734092  1455 raft_consensus.cc:359] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.734838  1455 raft_consensus.cc:385] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:59.735131  1455 raft_consensus.cc:740] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade8f52c75914406a928ad61a925ed1b, State: Initialized, Role: FOLLOWER
I20260709 12:14:59.736045  1455 consensus_queue.cc:260] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P ade8f52c75914406a928ad61a925ed1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.738658  1455 ts_tablet_manager.cc:1434] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P ade8f52c75914406a928ad61a925ed1b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:14:59.739943  1455 tablet_bootstrap.cc:492] T 20c09a31d7a545b2ba4bb6853c19cab3 P ade8f52c75914406a928ad61a925ed1b: Bootstrap starting.
I20260709 12:14:59.743299  1421 raft_consensus.cc:493] T 3ac88bcbdd344e7bba9a49e2e766242c P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.743826  1421 raft_consensus.cc:515] T 3ac88bcbdd344e7bba9a49e2e766242c P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.745559  1160 raft_consensus.cc:2468] T 6f7eb2b18b3e4b0eba971970313a52c2 P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade8f52c75914406a928ad61a925ed1b in term 1.
I20260709 12:14:59.745833  1421 leader_election.cc:290] T 3ac88bcbdd344e7bba9a49e2e766242c P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48fd723a77ba455eabb997723f60371b (127.20.196.129:40613), 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381)
I20260709 12:14:59.713431  1310 raft_consensus.cc:2468] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48fd723a77ba455eabb997723f60371b in term 1.
I20260709 12:14:59.718191  1456 tablet_bootstrap.cc:654] T 20c09a31d7a545b2ba4bb6853c19cab3 P 48fd723a77ba455eabb997723f60371b: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:59.747517  1308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7eb2b18b3e4b0eba971970313a52c2" candidate_uuid: "ade8f52c75914406a928ad61a925ed1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9281096d749a4bf691c774d3321672e7"
I20260709 12:14:59.748106  1308 raft_consensus.cc:3060] T 6f7eb2b18b3e4b0eba971970313a52c2 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:59.717805  1057 catalog_manager.cc:5697] T 7910908273664e89a7c9dc67ae63027e P ade8f52c75914406a928ad61a925ed1b reported cstate change: term changed from 0 to 1, leader changed from <none> to ade8f52c75914406a928ad61a925ed1b (127.20.196.130). New cstate: current_term: 1 leader_uuid: "ade8f52c75914406a928ad61a925ed1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:59.750626  1310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac88bcbdd344e7bba9a49e2e766242c" candidate_uuid: "ade8f52c75914406a928ad61a925ed1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9281096d749a4bf691c774d3321672e7" is_pre_election: true
I20260709 12:14:59.751369  1310 raft_consensus.cc:2468] T 3ac88bcbdd344e7bba9a49e2e766242c P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ade8f52c75914406a928ad61a925ed1b in term 0.
I20260709 12:14:59.751852  1125 leader_election.cc:304] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48fd723a77ba455eabb997723f60371b, 9281096d749a4bf691c774d3321672e7; no voters: ade8f52c75914406a928ad61a925ed1b
I20260709 12:14:59.753486  1444 raft_consensus.cc:2804] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:59.754129  1444 raft_consensus.cc:697] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 48fd723a77ba455eabb997723f60371b [term 1 LEADER]: Becoming Leader. State: Replica: 48fd723a77ba455eabb997723f60371b, State: Running, Role: LEADER
I20260709 12:14:59.752631  1200 leader_election.cc:304] T 6f7eb2b18b3e4b0eba971970313a52c2 P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48fd723a77ba455eabb997723f60371b, ade8f52c75914406a928ad61a925ed1b; no voters: 
I20260709 12:14:59.755857  1200 leader_election.cc:304] T 3ac88bcbdd344e7bba9a49e2e766242c P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9281096d749a4bf691c774d3321672e7, ade8f52c75914406a928ad61a925ed1b; no voters: 
I20260709 12:14:59.756737  1421 raft_consensus.cc:2804] T 6f7eb2b18b3e4b0eba971970313a52c2 P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:59.757994  1444 consensus_queue.cc:237] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 48fd723a77ba455eabb997723f60371b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.762496  1489 raft_consensus.cc:2804] T 3ac88bcbdd344e7bba9a49e2e766242c P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:59.763013  1421 raft_consensus.cc:697] T 6f7eb2b18b3e4b0eba971970313a52c2 P ade8f52c75914406a928ad61a925ed1b [term 1 LEADER]: Becoming Leader. State: Replica: ade8f52c75914406a928ad61a925ed1b, State: Running, Role: LEADER
I20260709 12:14:59.764142  1421 consensus_queue.cc:237] T 6f7eb2b18b3e4b0eba971970313a52c2 P ade8f52c75914406a928ad61a925ed1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.767865  1489 raft_consensus.cc:493] T 3ac88bcbdd344e7bba9a49e2e766242c P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:59.768304  1489 raft_consensus.cc:3060] T 3ac88bcbdd344e7bba9a49e2e766242c P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:59.769721  1308 raft_consensus.cc:2468] T 6f7eb2b18b3e4b0eba971970313a52c2 P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade8f52c75914406a928ad61a925ed1b in term 1.
I20260709 12:14:59.771114  1160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac88bcbdd344e7bba9a49e2e766242c" candidate_uuid: "ade8f52c75914406a928ad61a925ed1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48fd723a77ba455eabb997723f60371b" is_pre_election: true
I20260709 12:14:59.771911  1160 raft_consensus.cc:2468] T 3ac88bcbdd344e7bba9a49e2e766242c P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ade8f52c75914406a928ad61a925ed1b in term 0.
I20260709 12:14:59.776432  1455 tablet_bootstrap.cc:654] T 20c09a31d7a545b2ba4bb6853c19cab3 P ade8f52c75914406a928ad61a925ed1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:59.784543  1456 tablet_bootstrap.cc:492] T 20c09a31d7a545b2ba4bb6853c19cab3 P 48fd723a77ba455eabb997723f60371b: No bootstrap required, opened a new log
I20260709 12:14:59.785288  1456 ts_tablet_manager.cc:1403] T 20c09a31d7a545b2ba4bb6853c19cab3 P 48fd723a77ba455eabb997723f60371b: Time spent bootstrapping tablet: real 0.083s	user 0.013s	sys 0.017s
I20260709 12:14:59.789310  1456 raft_consensus.cc:359] T 20c09a31d7a545b2ba4bb6853c19cab3 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.789885  1489 raft_consensus.cc:515] T 3ac88bcbdd344e7bba9a49e2e766242c P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.790743  1456 raft_consensus.cc:385] T 20c09a31d7a545b2ba4bb6853c19cab3 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:59.791285  1456 raft_consensus.cc:740] T 20c09a31d7a545b2ba4bb6853c19cab3 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48fd723a77ba455eabb997723f60371b, State: Initialized, Role: FOLLOWER
I20260709 12:14:59.792481  1456 consensus_queue.cc:260] T 20c09a31d7a545b2ba4bb6853c19cab3 P 48fd723a77ba455eabb997723f60371b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.793120  1421 raft_consensus.cc:493] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.794780  1058 catalog_manager.cc:5697] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 48fd723a77ba455eabb997723f60371b reported cstate change: term changed from 0 to 1, leader changed from <none> to 48fd723a77ba455eabb997723f60371b (127.20.196.129). New cstate: current_term: 1 leader_uuid: "48fd723a77ba455eabb997723f60371b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:59.795285  1421 raft_consensus.cc:515] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.792541  1056 catalog_manager.cc:5697] T 6f7eb2b18b3e4b0eba971970313a52c2 P ade8f52c75914406a928ad61a925ed1b reported cstate change: term changed from 0 to 1, leader changed from <none> to ade8f52c75914406a928ad61a925ed1b (127.20.196.130). New cstate: current_term: 1 leader_uuid: "ade8f52c75914406a928ad61a925ed1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:59.797966  1421 leader_election.cc:290] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48fd723a77ba455eabb997723f60371b (127.20.196.129:40613), 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381)
I20260709 12:14:59.798130  1308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac88bcbdd344e7bba9a49e2e766242c" candidate_uuid: "ade8f52c75914406a928ad61a925ed1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9281096d749a4bf691c774d3321672e7"
I20260709 12:14:59.798763  1308 raft_consensus.cc:3060] T 3ac88bcbdd344e7bba9a49e2e766242c P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:59.793767  1160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac88bcbdd344e7bba9a49e2e766242c" candidate_uuid: "ade8f52c75914406a928ad61a925ed1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48fd723a77ba455eabb997723f60371b"
I20260709 12:14:59.799403  1160 raft_consensus.cc:3060] T 3ac88bcbdd344e7bba9a49e2e766242c P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:59.806056  1310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d226ed3f0e4fb8bae68b4340e8e4a1" candidate_uuid: "ade8f52c75914406a928ad61a925ed1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9281096d749a4bf691c774d3321672e7" is_pre_election: true
I20260709 12:14:59.807216  1160 raft_consensus.cc:2468] T 3ac88bcbdd344e7bba9a49e2e766242c P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade8f52c75914406a928ad61a925ed1b in term 1.
I20260709 12:14:59.807721  1158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d226ed3f0e4fb8bae68b4340e8e4a1" candidate_uuid: "ade8f52c75914406a928ad61a925ed1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48fd723a77ba455eabb997723f60371b" is_pre_election: true
I20260709 12:14:59.806882  1310 raft_consensus.cc:2393] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ade8f52c75914406a928ad61a925ed1b in current term 1: Already voted for candidate 48fd723a77ba455eabb997723f60371b in this term.
I20260709 12:14:59.810757  1456 ts_tablet_manager.cc:1434] T 20c09a31d7a545b2ba4bb6853c19cab3 P 48fd723a77ba455eabb997723f60371b: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.003s
I20260709 12:14:59.810706  1200 leader_election.cc:304] T 3ac88bcbdd344e7bba9a49e2e766242c P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48fd723a77ba455eabb997723f60371b, ade8f52c75914406a928ad61a925ed1b; no voters: 
I20260709 12:14:59.814360  1200 leader_election.cc:304] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade8f52c75914406a928ad61a925ed1b; no voters: 48fd723a77ba455eabb997723f60371b, 9281096d749a4bf691c774d3321672e7
I20260709 12:14:59.815487  1476 raft_consensus.cc:2804] T 3ac88bcbdd344e7bba9a49e2e766242c P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:59.815979  1421 raft_consensus.cc:3060] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:59.816097  1308 raft_consensus.cc:2468] T 3ac88bcbdd344e7bba9a49e2e766242c P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade8f52c75914406a928ad61a925ed1b in term 1.
I20260709 12:14:59.819135  1489 leader_election.cc:290] T 3ac88bcbdd344e7bba9a49e2e766242c P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 1 election: Requested vote from peers 48fd723a77ba455eabb997723f60371b (127.20.196.129:40613), 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381)
I20260709 12:14:59.825877  1476 raft_consensus.cc:697] T 3ac88bcbdd344e7bba9a49e2e766242c P ade8f52c75914406a928ad61a925ed1b [term 1 LEADER]: Becoming Leader. State: Replica: ade8f52c75914406a928ad61a925ed1b, State: Running, Role: LEADER
I20260709 12:14:59.826943  1444 raft_consensus.cc:493] T 20c09a31d7a545b2ba4bb6853c19cab3 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.827325  1476 consensus_queue.cc:237] T 3ac88bcbdd344e7bba9a49e2e766242c P ade8f52c75914406a928ad61a925ed1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.827502  1444 raft_consensus.cc:515] T 20c09a31d7a545b2ba4bb6853c19cab3 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.826665  1421 raft_consensus.cc:2749] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:59.830073  1444 leader_election.cc:290] T 20c09a31d7a545b2ba4bb6853c19cab3 P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ade8f52c75914406a928ad61a925ed1b (127.20.196.130:40533), 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381)
I20260709 12:14:59.831131  1308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c09a31d7a545b2ba4bb6853c19cab3" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9281096d749a4bf691c774d3321672e7" is_pre_election: true
I20260709 12:14:59.831791  1308 raft_consensus.cc:2468] T 20c09a31d7a545b2ba4bb6853c19cab3 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48fd723a77ba455eabb997723f60371b in term 0.
I20260709 12:14:59.831609  1235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c09a31d7a545b2ba4bb6853c19cab3" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade8f52c75914406a928ad61a925ed1b" is_pre_election: true
I20260709 12:14:59.832957  1125 leader_election.cc:304] T 20c09a31d7a545b2ba4bb6853c19cab3 P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48fd723a77ba455eabb997723f60371b, 9281096d749a4bf691c774d3321672e7; no voters: 
W20260709 12:14:59.833773  1123 leader_election.cc:343] T 20c09a31d7a545b2ba4bb6853c19cab3 P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ade8f52c75914406a928ad61a925ed1b (127.20.196.130:40533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:59.834713  1444 raft_consensus.cc:2804] T 20c09a31d7a545b2ba4bb6853c19cab3 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:59.835354  1444 raft_consensus.cc:493] T 20c09a31d7a545b2ba4bb6853c19cab3 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:59.835856  1444 raft_consensus.cc:3060] T 20c09a31d7a545b2ba4bb6853c19cab3 P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:59.844436  1455 tablet_bootstrap.cc:492] T 20c09a31d7a545b2ba4bb6853c19cab3 P ade8f52c75914406a928ad61a925ed1b: No bootstrap required, opened a new log
I20260709 12:14:59.845103  1455 ts_tablet_manager.cc:1403] T 20c09a31d7a545b2ba4bb6853c19cab3 P ade8f52c75914406a928ad61a925ed1b: Time spent bootstrapping tablet: real 0.105s	user 0.019s	sys 0.009s
I20260709 12:14:59.846504  1459 tablet_bootstrap.cc:492] T 4e3a90ba50264ff59de7e64f04e7cbde P 9281096d749a4bf691c774d3321672e7: No bootstrap required, opened a new log
I20260709 12:14:59.846424  1444 raft_consensus.cc:515] T 20c09a31d7a545b2ba4bb6853c19cab3 P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.847263  1459 ts_tablet_manager.cc:1403] T 4e3a90ba50264ff59de7e64f04e7cbde P 9281096d749a4bf691c774d3321672e7: Time spent bootstrapping tablet: real 0.124s	user 0.037s	sys 0.032s
I20260709 12:14:59.847929  1455 raft_consensus.cc:359] T 20c09a31d7a545b2ba4bb6853c19cab3 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.848717  1455 raft_consensus.cc:385] T 20c09a31d7a545b2ba4bb6853c19cab3 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:59.849076  1455 raft_consensus.cc:740] T 20c09a31d7a545b2ba4bb6853c19cab3 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade8f52c75914406a928ad61a925ed1b, State: Initialized, Role: FOLLOWER
I20260709 12:14:59.848446  1058 catalog_manager.cc:5697] T 3ac88bcbdd344e7bba9a49e2e766242c P ade8f52c75914406a928ad61a925ed1b reported cstate change: term changed from 0 to 1, leader changed from <none> to ade8f52c75914406a928ad61a925ed1b (127.20.196.130). New cstate: current_term: 1 leader_uuid: "ade8f52c75914406a928ad61a925ed1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:59.855532  1455 consensus_queue.cc:260] T 20c09a31d7a545b2ba4bb6853c19cab3 P ade8f52c75914406a928ad61a925ed1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.857682  1455 ts_tablet_manager.cc:1434] T 20c09a31d7a545b2ba4bb6853c19cab3 P ade8f52c75914406a928ad61a925ed1b: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.003s
I20260709 12:14:59.858264  1235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c09a31d7a545b2ba4bb6853c19cab3" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade8f52c75914406a928ad61a925ed1b"
I20260709 12:14:59.858927  1235 raft_consensus.cc:3060] T 20c09a31d7a545b2ba4bb6853c19cab3 P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:59.859367  1308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c09a31d7a545b2ba4bb6853c19cab3" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9281096d749a4bf691c774d3321672e7"
I20260709 12:14:59.860090  1308 raft_consensus.cc:3060] T 20c09a31d7a545b2ba4bb6853c19cab3 P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:59.857324  1459 raft_consensus.cc:359] T 4e3a90ba50264ff59de7e64f04e7cbde P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.864863  1235 raft_consensus.cc:2468] T 20c09a31d7a545b2ba4bb6853c19cab3 P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48fd723a77ba455eabb997723f60371b in term 1.
I20260709 12:14:59.866338  1123 leader_election.cc:304] T 20c09a31d7a545b2ba4bb6853c19cab3 P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48fd723a77ba455eabb997723f60371b, ade8f52c75914406a928ad61a925ed1b; no voters: 
I20260709 12:14:59.866765  1308 raft_consensus.cc:2468] T 20c09a31d7a545b2ba4bb6853c19cab3 P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48fd723a77ba455eabb997723f60371b in term 1.
I20260709 12:14:59.867164  1444 leader_election.cc:290] T 20c09a31d7a545b2ba4bb6853c19cab3 P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 election: Requested vote from peers ade8f52c75914406a928ad61a925ed1b (127.20.196.130:40533), 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381)
I20260709 12:14:59.867272  1443 raft_consensus.cc:2804] T 20c09a31d7a545b2ba4bb6853c19cab3 P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:59.867929  1443 raft_consensus.cc:697] T 20c09a31d7a545b2ba4bb6853c19cab3 P 48fd723a77ba455eabb997723f60371b [term 1 LEADER]: Becoming Leader. State: Replica: 48fd723a77ba455eabb997723f60371b, State: Running, Role: LEADER
I20260709 12:14:59.865139  1459 raft_consensus.cc:385] T 4e3a90ba50264ff59de7e64f04e7cbde P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:59.868758  1443 consensus_queue.cc:237] T 20c09a31d7a545b2ba4bb6853c19cab3 P 48fd723a77ba455eabb997723f60371b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.869237  1459 raft_consensus.cc:740] T 4e3a90ba50264ff59de7e64f04e7cbde P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9281096d749a4bf691c774d3321672e7, State: Initialized, Role: FOLLOWER
I20260709 12:14:59.870189  1459 consensus_queue.cc:260] T 4e3a90ba50264ff59de7e64f04e7cbde P 9281096d749a4bf691c774d3321672e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.872769  1459 ts_tablet_manager.cc:1434] T 4e3a90ba50264ff59de7e64f04e7cbde P 9281096d749a4bf691c774d3321672e7: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:14:59.875177  1459 tablet_bootstrap.cc:492] T 6dae4debcb434769a07d735facc9817f P 9281096d749a4bf691c774d3321672e7: Bootstrap starting.
I20260709 12:14:59.878782  1057 catalog_manager.cc:5697] T 20c09a31d7a545b2ba4bb6853c19cab3 P 48fd723a77ba455eabb997723f60371b reported cstate change: term changed from 0 to 1, leader changed from <none> to 48fd723a77ba455eabb997723f60371b (127.20.196.129). New cstate: current_term: 1 leader_uuid: "48fd723a77ba455eabb997723f60371b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:59.880244  1459 tablet_bootstrap.cc:654] T 6dae4debcb434769a07d735facc9817f P 9281096d749a4bf691c774d3321672e7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:59.886288  1459 tablet_bootstrap.cc:492] T 6dae4debcb434769a07d735facc9817f P 9281096d749a4bf691c774d3321672e7: No bootstrap required, opened a new log
I20260709 12:14:59.886750  1459 ts_tablet_manager.cc:1403] T 6dae4debcb434769a07d735facc9817f P 9281096d749a4bf691c774d3321672e7: Time spent bootstrapping tablet: real 0.012s	user 0.006s	sys 0.003s
I20260709 12:14:59.889396  1459 raft_consensus.cc:359] T 6dae4debcb434769a07d735facc9817f P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.890064  1459 raft_consensus.cc:385] T 6dae4debcb434769a07d735facc9817f P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:59.890323  1459 raft_consensus.cc:740] T 6dae4debcb434769a07d735facc9817f P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9281096d749a4bf691c774d3321672e7, State: Initialized, Role: FOLLOWER
I20260709 12:14:59.890879  1459 consensus_queue.cc:260] T 6dae4debcb434769a07d735facc9817f P 9281096d749a4bf691c774d3321672e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.892674  1459 ts_tablet_manager.cc:1434] T 6dae4debcb434769a07d735facc9817f P 9281096d749a4bf691c774d3321672e7: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:14:59.893563  1459 tablet_bootstrap.cc:492] T 7910908273664e89a7c9dc67ae63027e P 9281096d749a4bf691c774d3321672e7: Bootstrap starting.
I20260709 12:14:59.898041  1459 tablet_bootstrap.cc:654] T 7910908273664e89a7c9dc67ae63027e P 9281096d749a4bf691c774d3321672e7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:59.902861  1459 tablet_bootstrap.cc:492] T 7910908273664e89a7c9dc67ae63027e P 9281096d749a4bf691c774d3321672e7: No bootstrap required, opened a new log
I20260709 12:14:59.903383  1459 ts_tablet_manager.cc:1403] T 7910908273664e89a7c9dc67ae63027e P 9281096d749a4bf691c774d3321672e7: Time spent bootstrapping tablet: real 0.010s	user 0.005s	sys 0.004s
I20260709 12:14:59.905802  1459 raft_consensus.cc:359] T 7910908273664e89a7c9dc67ae63027e P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.906231  1459 raft_consensus.cc:385] T 7910908273664e89a7c9dc67ae63027e P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:59.906394  1459 raft_consensus.cc:740] T 7910908273664e89a7c9dc67ae63027e P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9281096d749a4bf691c774d3321672e7, State: Initialized, Role: FOLLOWER
I20260709 12:14:59.906919  1459 consensus_queue.cc:260] T 7910908273664e89a7c9dc67ae63027e P 9281096d749a4bf691c774d3321672e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.908488  1459 ts_tablet_manager.cc:1434] T 7910908273664e89a7c9dc67ae63027e P 9281096d749a4bf691c774d3321672e7: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:14:59.911648  1308 raft_consensus.cc:3060] T 6dae4debcb434769a07d735facc9817f P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:59.919090  1443 consensus_queue.cc:1048] T 6dae4debcb434769a07d735facc9817f P 48fd723a77ba455eabb997723f60371b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:59.935195  1444 consensus_queue.cc:1048] T 6dae4debcb434769a07d735facc9817f P 48fd723a77ba455eabb997723f60371b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:59.988318  1444 raft_consensus.cc:493] T 4e3a90ba50264ff59de7e64f04e7cbde P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.988883  1444 raft_consensus.cc:515] T 4e3a90ba50264ff59de7e64f04e7cbde P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:14:59.990931  1444 leader_election.cc:290] T 4e3a90ba50264ff59de7e64f04e7cbde P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ade8f52c75914406a928ad61a925ed1b (127.20.196.130:40533), 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381)
I20260709 12:14:59.991637  1235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e3a90ba50264ff59de7e64f04e7cbde" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade8f52c75914406a928ad61a925ed1b" is_pre_election: true
I20260709 12:14:59.991938  1308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e3a90ba50264ff59de7e64f04e7cbde" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9281096d749a4bf691c774d3321672e7" is_pre_election: true
I20260709 12:14:59.992393  1235 raft_consensus.cc:2468] T 4e3a90ba50264ff59de7e64f04e7cbde P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48fd723a77ba455eabb997723f60371b in term 0.
I20260709 12:14:59.992703  1308 raft_consensus.cc:2468] T 4e3a90ba50264ff59de7e64f04e7cbde P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48fd723a77ba455eabb997723f60371b in term 0.
I20260709 12:14:59.993631  1123 leader_election.cc:304] T 4e3a90ba50264ff59de7e64f04e7cbde P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48fd723a77ba455eabb997723f60371b, ade8f52c75914406a928ad61a925ed1b; no voters: 
I20260709 12:14:59.994393  1444 raft_consensus.cc:2804] T 4e3a90ba50264ff59de7e64f04e7cbde P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:59.994722  1444 raft_consensus.cc:493] T 4e3a90ba50264ff59de7e64f04e7cbde P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:59.995045  1444 raft_consensus.cc:3060] T 4e3a90ba50264ff59de7e64f04e7cbde P 48fd723a77ba455eabb997723f60371b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:00.000483  1444 raft_consensus.cc:515] T 4e3a90ba50264ff59de7e64f04e7cbde P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:15:00.002140  1444 leader_election.cc:290] T 4e3a90ba50264ff59de7e64f04e7cbde P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 election: Requested vote from peers ade8f52c75914406a928ad61a925ed1b (127.20.196.130:40533), 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381)
I20260709 12:15:00.003115  1235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e3a90ba50264ff59de7e64f04e7cbde" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade8f52c75914406a928ad61a925ed1b"
I20260709 12:15:00.003278  1308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e3a90ba50264ff59de7e64f04e7cbde" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9281096d749a4bf691c774d3321672e7"
I20260709 12:15:00.003754  1235 raft_consensus.cc:3060] T 4e3a90ba50264ff59de7e64f04e7cbde P ade8f52c75914406a928ad61a925ed1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:00.004024  1308 raft_consensus.cc:3060] T 4e3a90ba50264ff59de7e64f04e7cbde P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:00.011406  1235 raft_consensus.cc:2468] T 4e3a90ba50264ff59de7e64f04e7cbde P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48fd723a77ba455eabb997723f60371b in term 1.
I20260709 12:15:00.011406  1308 raft_consensus.cc:2468] T 4e3a90ba50264ff59de7e64f04e7cbde P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48fd723a77ba455eabb997723f60371b in term 1.
I20260709 12:15:00.012531  1123 leader_election.cc:304] T 4e3a90ba50264ff59de7e64f04e7cbde P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48fd723a77ba455eabb997723f60371b, ade8f52c75914406a928ad61a925ed1b; no voters: 
I20260709 12:15:00.013294  1481 raft_consensus.cc:2804] T 4e3a90ba50264ff59de7e64f04e7cbde P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:00.013773  1481 raft_consensus.cc:697] T 4e3a90ba50264ff59de7e64f04e7cbde P 48fd723a77ba455eabb997723f60371b [term 1 LEADER]: Becoming Leader. State: Replica: 48fd723a77ba455eabb997723f60371b, State: Running, Role: LEADER
I20260709 12:15:00.014590  1481 consensus_queue.cc:237] T 4e3a90ba50264ff59de7e64f04e7cbde P 48fd723a77ba455eabb997723f60371b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:15:00.022203  1058 catalog_manager.cc:5697] T 4e3a90ba50264ff59de7e64f04e7cbde P 48fd723a77ba455eabb997723f60371b reported cstate change: term changed from 0 to 1, leader changed from <none> to 48fd723a77ba455eabb997723f60371b (127.20.196.129). New cstate: current_term: 1 leader_uuid: "48fd723a77ba455eabb997723f60371b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:00.104539  1476 consensus_queue.cc:1048] T 7910908273664e89a7c9dc67ae63027e P ade8f52c75914406a928ad61a925ed1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:00.114024  1308 raft_consensus.cc:3060] T 7910908273664e89a7c9dc67ae63027e P 9281096d749a4bf691c774d3321672e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:00.122610  1421 consensus_queue.cc:1048] T 7910908273664e89a7c9dc67ae63027e P ade8f52c75914406a928ad61a925ed1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:00.125000  1481 consensus_queue.cc:1048] T 02297d83178f4c368a44b55829b3085e P 48fd723a77ba455eabb997723f60371b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:00.125751  1444 consensus_queue.cc:1048] T 02297d83178f4c368a44b55829b3085e P 48fd723a77ba455eabb997723f60371b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:00.151437  1233 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7910908273664e89a7c9dc67ae63027e"
dest_uuid: "ade8f52c75914406a928ad61a925ed1b"
mode: GRACEFUL
new_leader_uuid: "48fd723a77ba455eabb997723f60371b"
 from {username='slave'} at 127.0.0.1:45714
I20260709 12:15:00.152110  1233 raft_consensus.cc:606] T 7910908273664e89a7c9dc67ae63027e P ade8f52c75914406a928ad61a925ed1b [term 1 LEADER]: Received request to transfer leadership to TS 48fd723a77ba455eabb997723f60371b
I20260709 12:15:00.155339  1443 consensus_queue.cc:1048] T fa41764beac241228184f7b2c3a4b1a5 P 48fd723a77ba455eabb997723f60371b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:00.168282  1160 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6dae4debcb434769a07d735facc9817f"
dest_uuid: "48fd723a77ba455eabb997723f60371b"
mode: GRACEFUL
new_leader_uuid: "ade8f52c75914406a928ad61a925ed1b"
 from {username='slave'} at 127.0.0.1:46022
I20260709 12:15:00.168910  1160 raft_consensus.cc:606] T 6dae4debcb434769a07d735facc9817f P 48fd723a77ba455eabb997723f60371b [term 1 LEADER]: Received request to transfer leadership to TS ade8f52c75914406a928ad61a925ed1b
I20260709 12:15:00.170176  1473 consensus_queue.cc:1048] T fa41764beac241228184f7b2c3a4b1a5 P 48fd723a77ba455eabb997723f60371b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:00.177376  1160 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20c09a31d7a545b2ba4bb6853c19cab3"
dest_uuid: "48fd723a77ba455eabb997723f60371b"
mode: GRACEFUL
new_leader_uuid: "ade8f52c75914406a928ad61a925ed1b"
 from {username='slave'} at 127.0.0.1:46022
I20260709 12:15:00.178001  1160 raft_consensus.cc:606] T 20c09a31d7a545b2ba4bb6853c19cab3 P 48fd723a77ba455eabb997723f60371b [term 1 LEADER]: Received request to transfer leadership to TS ade8f52c75914406a928ad61a925ed1b
I20260709 12:15:00.188100  1160 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02297d83178f4c368a44b55829b3085e"
dest_uuid: "48fd723a77ba455eabb997723f60371b"
mode: GRACEFUL
new_leader_uuid: "ade8f52c75914406a928ad61a925ed1b"
 from {username='slave'} at 127.0.0.1:46022
I20260709 12:15:00.188759  1160 raft_consensus.cc:606] T 02297d83178f4c368a44b55829b3085e P 48fd723a77ba455eabb997723f60371b [term 1 LEADER]: Received request to transfer leadership to TS ade8f52c75914406a928ad61a925ed1b
I20260709 12:15:00.193825  1233 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ac88bcbdd344e7bba9a49e2e766242c"
dest_uuid: "ade8f52c75914406a928ad61a925ed1b"
mode: GRACEFUL
new_leader_uuid: "9281096d749a4bf691c774d3321672e7"
 from {username='slave'} at 127.0.0.1:45714
I20260709 12:15:00.194307  1233 raft_consensus.cc:606] T 3ac88bcbdd344e7bba9a49e2e766242c P ade8f52c75914406a928ad61a925ed1b [term 1 LEADER]: Received request to transfer leadership to TS 9281096d749a4bf691c774d3321672e7
I20260709 12:15:00.215368  1421 consensus_queue.cc:1048] T 3ac88bcbdd344e7bba9a49e2e766242c P ade8f52c75914406a928ad61a925ed1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:00.225644  1421 consensus_queue.cc:1048] T 3ac88bcbdd344e7bba9a49e2e766242c P ade8f52c75914406a928ad61a925ed1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:00.234970  1421 raft_consensus.cc:993] T 3ac88bcbdd344e7bba9a49e2e766242c P ade8f52c75914406a928ad61a925ed1b: : Instructing follower 9281096d749a4bf691c774d3321672e7 to start an election
I20260709 12:15:00.235481  1476 raft_consensus.cc:1081] T 3ac88bcbdd344e7bba9a49e2e766242c P ade8f52c75914406a928ad61a925ed1b [term 1 LEADER]: Signalling peer 9281096d749a4bf691c774d3321672e7 to start an election
I20260709 12:15:00.236985  1308 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ac88bcbdd344e7bba9a49e2e766242c"
dest_uuid: "9281096d749a4bf691c774d3321672e7"
 from {username='slave'} at 127.0.0.1:44808
I20260709 12:15:00.237506  1308 raft_consensus.cc:493] T 3ac88bcbdd344e7bba9a49e2e766242c P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:00.237888  1308 raft_consensus.cc:3060] T 3ac88bcbdd344e7bba9a49e2e766242c P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:00.242947  1308 raft_consensus.cc:515] T 3ac88bcbdd344e7bba9a49e2e766242c P 9281096d749a4bf691c774d3321672e7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:15:00.244935  1308 leader_election.cc:290] T 3ac88bcbdd344e7bba9a49e2e766242c P 9281096d749a4bf691c774d3321672e7 [CANDIDATE]: Term 2 election: Requested vote from peers 48fd723a77ba455eabb997723f60371b (127.20.196.129:40613), ade8f52c75914406a928ad61a925ed1b (127.20.196.130:40533)
I20260709 12:15:00.245719  1160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac88bcbdd344e7bba9a49e2e766242c" candidate_uuid: "9281096d749a4bf691c774d3321672e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48fd723a77ba455eabb997723f60371b"
I20260709 12:15:00.246133  1233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac88bcbdd344e7bba9a49e2e766242c" candidate_uuid: "9281096d749a4bf691c774d3321672e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ade8f52c75914406a928ad61a925ed1b"
I20260709 12:15:00.246486  1160 raft_consensus.cc:3060] T 3ac88bcbdd344e7bba9a49e2e766242c P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:00.246798  1233 raft_consensus.cc:3055] T 3ac88bcbdd344e7bba9a49e2e766242c P ade8f52c75914406a928ad61a925ed1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:00.247213  1233 raft_consensus.cc:740] T 3ac88bcbdd344e7bba9a49e2e766242c P ade8f52c75914406a928ad61a925ed1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ade8f52c75914406a928ad61a925ed1b, State: Running, Role: LEADER
I20260709 12:15:00.247951  1233 consensus_queue.cc:260] T 3ac88bcbdd344e7bba9a49e2e766242c P ade8f52c75914406a928ad61a925ed1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:15:00.248919  1233 raft_consensus.cc:3060] T 3ac88bcbdd344e7bba9a49e2e766242c P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:00.253162  1444 consensus_queue.cc:1048] T 20c09a31d7a545b2ba4bb6853c19cab3 P 48fd723a77ba455eabb997723f60371b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:00.253610  1160 raft_consensus.cc:2468] T 3ac88bcbdd344e7bba9a49e2e766242c P 48fd723a77ba455eabb997723f60371b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9281096d749a4bf691c774d3321672e7 in term 2.
I20260709 12:15:00.254900  1274 leader_election.cc:304] T 3ac88bcbdd344e7bba9a49e2e766242c P 9281096d749a4bf691c774d3321672e7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48fd723a77ba455eabb997723f60371b, 9281096d749a4bf691c774d3321672e7; no voters: 
I20260709 12:15:00.255709  1233 raft_consensus.cc:2468] T 3ac88bcbdd344e7bba9a49e2e766242c P ade8f52c75914406a928ad61a925ed1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9281096d749a4bf691c774d3321672e7 in term 2.
I20260709 12:15:00.255923  1442 raft_consensus.cc:2804] T 3ac88bcbdd344e7bba9a49e2e766242c P 9281096d749a4bf691c774d3321672e7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:00.260269  1444 consensus_queue.cc:1048] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 48fd723a77ba455eabb997723f60371b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:00.264829  1443 raft_consensus.cc:993] T 20c09a31d7a545b2ba4bb6853c19cab3 P 48fd723a77ba455eabb997723f60371b: : Instructing follower ade8f52c75914406a928ad61a925ed1b to start an election
I20260709 12:15:00.262413  1442 raft_consensus.cc:697] T 3ac88bcbdd344e7bba9a49e2e766242c P 9281096d749a4bf691c774d3321672e7 [term 2 LEADER]: Becoming Leader. State: Replica: 9281096d749a4bf691c774d3321672e7, State: Running, Role: LEADER
I20260709 12:15:00.266860  1443 raft_consensus.cc:1081] T 20c09a31d7a545b2ba4bb6853c19cab3 P 48fd723a77ba455eabb997723f60371b [term 1 LEADER]: Signalling peer ade8f52c75914406a928ad61a925ed1b to start an election
I20260709 12:15:00.267278  1442 consensus_queue.cc:237] T 3ac88bcbdd344e7bba9a49e2e766242c P 9281096d749a4bf691c774d3321672e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:15:00.270174  1421 consensus_queue.cc:1048] T 6f7eb2b18b3e4b0eba971970313a52c2 P ade8f52c75914406a928ad61a925ed1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:00.273675  1473 consensus_queue.cc:1048] T 20c09a31d7a545b2ba4bb6853c19cab3 P 48fd723a77ba455eabb997723f60371b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:00.277176  1233 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "20c09a31d7a545b2ba4bb6853c19cab3"
dest_uuid: "ade8f52c75914406a928ad61a925ed1b"
 from {username='slave'} at 127.0.0.1:50722
I20260709 12:15:00.277815  1233 raft_consensus.cc:493] T 20c09a31d7a545b2ba4bb6853c19cab3 P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:00.278226  1233 raft_consensus.cc:3060] T 20c09a31d7a545b2ba4bb6853c19cab3 P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:00.287467  1233 raft_consensus.cc:515] T 20c09a31d7a545b2ba4bb6853c19cab3 P ade8f52c75914406a928ad61a925ed1b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:15:00.288728  1058 catalog_manager.cc:5697] T 3ac88bcbdd344e7bba9a49e2e766242c P 9281096d749a4bf691c774d3321672e7 reported cstate change: term changed from 1 to 2, leader changed from ade8f52c75914406a928ad61a925ed1b (127.20.196.130) to 9281096d749a4bf691c774d3321672e7 (127.20.196.131). New cstate: current_term: 2 leader_uuid: "9281096d749a4bf691c774d3321672e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:00.292058  1233 leader_election.cc:290] T 20c09a31d7a545b2ba4bb6853c19cab3 P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 2 election: Requested vote from peers 48fd723a77ba455eabb997723f60371b (127.20.196.129:40613), 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381)
I20260709 12:15:00.293478  1160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c09a31d7a545b2ba4bb6853c19cab3" candidate_uuid: "ade8f52c75914406a928ad61a925ed1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48fd723a77ba455eabb997723f60371b"
I20260709 12:15:00.294134  1160 raft_consensus.cc:3055] T 20c09a31d7a545b2ba4bb6853c19cab3 P 48fd723a77ba455eabb997723f60371b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:00.294490  1160 raft_consensus.cc:740] T 20c09a31d7a545b2ba4bb6853c19cab3 P 48fd723a77ba455eabb997723f60371b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48fd723a77ba455eabb997723f60371b, State: Running, Role: LEADER
I20260709 12:15:00.295312  1160 consensus_queue.cc:260] T 20c09a31d7a545b2ba4bb6853c19cab3 P 48fd723a77ba455eabb997723f60371b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:15:00.296581  1160 raft_consensus.cc:3060] T 20c09a31d7a545b2ba4bb6853c19cab3 P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:00.293833  1309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c09a31d7a545b2ba4bb6853c19cab3" candidate_uuid: "ade8f52c75914406a928ad61a925ed1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9281096d749a4bf691c774d3321672e7"
I20260709 12:15:00.299167  1309 raft_consensus.cc:3060] T 20c09a31d7a545b2ba4bb6853c19cab3 P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:00.301355  1476 consensus_queue.cc:1048] T 6f7eb2b18b3e4b0eba971970313a52c2 P ade8f52c75914406a928ad61a925ed1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:00.304044  1160 raft_consensus.cc:2468] T 20c09a31d7a545b2ba4bb6853c19cab3 P 48fd723a77ba455eabb997723f60371b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade8f52c75914406a928ad61a925ed1b in term 2.
I20260709 12:15:00.305352  1200 leader_election.cc:304] T 20c09a31d7a545b2ba4bb6853c19cab3 P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48fd723a77ba455eabb997723f60371b, ade8f52c75914406a928ad61a925ed1b; no voters: 
I20260709 12:15:00.306186  1476 raft_consensus.cc:2804] T 20c09a31d7a545b2ba4bb6853c19cab3 P ade8f52c75914406a928ad61a925ed1b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:00.306444  1309 raft_consensus.cc:2468] T 20c09a31d7a545b2ba4bb6853c19cab3 P 9281096d749a4bf691c774d3321672e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade8f52c75914406a928ad61a925ed1b in term 2.
I20260709 12:15:00.307745  1444 consensus_queue.cc:1048] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 48fd723a77ba455eabb997723f60371b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:00.306669  1476 raft_consensus.cc:697] T 20c09a31d7a545b2ba4bb6853c19cab3 P ade8f52c75914406a928ad61a925ed1b [term 2 LEADER]: Becoming Leader. State: Replica: ade8f52c75914406a928ad61a925ed1b, State: Running, Role: LEADER
I20260709 12:15:00.311791  1476 consensus_queue.cc:237] T 20c09a31d7a545b2ba4bb6853c19cab3 P ade8f52c75914406a928ad61a925ed1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:15:00.331184  1056 catalog_manager.cc:5697] T 20c09a31d7a545b2ba4bb6853c19cab3 P ade8f52c75914406a928ad61a925ed1b reported cstate change: term changed from 1 to 2, leader changed from 48fd723a77ba455eabb997723f60371b (127.20.196.129) to ade8f52c75914406a928ad61a925ed1b (127.20.196.130). New cstate: current_term: 2 leader_uuid: "ade8f52c75914406a928ad61a925ed1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:00.381448  1473 raft_consensus.cc:993] T 6dae4debcb434769a07d735facc9817f P 48fd723a77ba455eabb997723f60371b: : Instructing follower ade8f52c75914406a928ad61a925ed1b to start an election
I20260709 12:15:00.381934  1481 raft_consensus.cc:1081] T 6dae4debcb434769a07d735facc9817f P 48fd723a77ba455eabb997723f60371b [term 1 LEADER]: Signalling peer ade8f52c75914406a928ad61a925ed1b to start an election
I20260709 12:15:00.383376  1233 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6dae4debcb434769a07d735facc9817f"
dest_uuid: "ade8f52c75914406a928ad61a925ed1b"
 from {username='slave'} at 127.0.0.1:50722
I20260709 12:15:00.383836  1233 raft_consensus.cc:493] T 6dae4debcb434769a07d735facc9817f P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:00.384116  1233 raft_consensus.cc:3060] T 6dae4debcb434769a07d735facc9817f P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:00.388743  1233 raft_consensus.cc:515] T 6dae4debcb434769a07d735facc9817f P ade8f52c75914406a928ad61a925ed1b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:15:00.390249  1233 leader_election.cc:290] T 6dae4debcb434769a07d735facc9817f P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 2 election: Requested vote from peers 48fd723a77ba455eabb997723f60371b (127.20.196.129:40613), 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381)
I20260709 12:15:00.391170  1158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dae4debcb434769a07d735facc9817f" candidate_uuid: "ade8f52c75914406a928ad61a925ed1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48fd723a77ba455eabb997723f60371b"
I20260709 12:15:00.391434  1309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dae4debcb434769a07d735facc9817f" candidate_uuid: "ade8f52c75914406a928ad61a925ed1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9281096d749a4bf691c774d3321672e7"
I20260709 12:15:00.391816  1158 raft_consensus.cc:3055] T 6dae4debcb434769a07d735facc9817f P 48fd723a77ba455eabb997723f60371b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:00.392081  1309 raft_consensus.cc:3060] T 6dae4debcb434769a07d735facc9817f P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:00.392266  1158 raft_consensus.cc:740] T 6dae4debcb434769a07d735facc9817f P 48fd723a77ba455eabb997723f60371b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48fd723a77ba455eabb997723f60371b, State: Running, Role: LEADER
I20260709 12:15:00.393278  1158 consensus_queue.cc:260] T 6dae4debcb434769a07d735facc9817f P 48fd723a77ba455eabb997723f60371b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:15:00.394253  1158 raft_consensus.cc:3060] T 6dae4debcb434769a07d735facc9817f P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:00.397554  1309 raft_consensus.cc:2468] T 6dae4debcb434769a07d735facc9817f P 9281096d749a4bf691c774d3321672e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade8f52c75914406a928ad61a925ed1b in term 2.
I20260709 12:15:00.398792  1200 leader_election.cc:304] T 6dae4debcb434769a07d735facc9817f P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9281096d749a4bf691c774d3321672e7, ade8f52c75914406a928ad61a925ed1b; no voters: 
I20260709 12:15:00.399602  1158 raft_consensus.cc:2468] T 6dae4debcb434769a07d735facc9817f P 48fd723a77ba455eabb997723f60371b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade8f52c75914406a928ad61a925ed1b in term 2.
I20260709 12:15:00.399609  1476 raft_consensus.cc:2804] T 6dae4debcb434769a07d735facc9817f P ade8f52c75914406a928ad61a925ed1b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:00.400295  1476 raft_consensus.cc:697] T 6dae4debcb434769a07d735facc9817f P ade8f52c75914406a928ad61a925ed1b [term 2 LEADER]: Becoming Leader. State: Replica: ade8f52c75914406a928ad61a925ed1b, State: Running, Role: LEADER
I20260709 12:15:00.401011  1476 consensus_queue.cc:237] T 6dae4debcb434769a07d735facc9817f P ade8f52c75914406a928ad61a925ed1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:15:00.408182  1058 catalog_manager.cc:5697] T 6dae4debcb434769a07d735facc9817f P ade8f52c75914406a928ad61a925ed1b reported cstate change: term changed from 1 to 2, leader changed from 48fd723a77ba455eabb997723f60371b (127.20.196.129) to ade8f52c75914406a928ad61a925ed1b (127.20.196.130). New cstate: current_term: 2 leader_uuid: "ade8f52c75914406a928ad61a925ed1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:00.525225  1481 consensus_queue.cc:1048] T 4e3a90ba50264ff59de7e64f04e7cbde P 48fd723a77ba455eabb997723f60371b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:00.535790  1481 consensus_queue.cc:1048] T 4e3a90ba50264ff59de7e64f04e7cbde P 48fd723a77ba455eabb997723f60371b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:00.708029  1476 raft_consensus.cc:993] T 7910908273664e89a7c9dc67ae63027e P ade8f52c75914406a928ad61a925ed1b: : Instructing follower 48fd723a77ba455eabb997723f60371b to start an election
I20260709 12:15:00.708492  1493 raft_consensus.cc:1081] T 7910908273664e89a7c9dc67ae63027e P ade8f52c75914406a928ad61a925ed1b [term 1 LEADER]: Signalling peer 48fd723a77ba455eabb997723f60371b to start an election
I20260709 12:15:00.710572  1158 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7910908273664e89a7c9dc67ae63027e"
dest_uuid: "48fd723a77ba455eabb997723f60371b"
 from {username='slave'} at 127.0.0.1:37454
I20260709 12:15:00.711199  1158 raft_consensus.cc:493] T 7910908273664e89a7c9dc67ae63027e P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:00.711808  1158 raft_consensus.cc:3060] T 7910908273664e89a7c9dc67ae63027e P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:00.717667  1158 raft_consensus.cc:515] T 7910908273664e89a7c9dc67ae63027e P 48fd723a77ba455eabb997723f60371b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:15:00.719607  1158 leader_election.cc:290] T 7910908273664e89a7c9dc67ae63027e P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 2 election: Requested vote from peers ade8f52c75914406a928ad61a925ed1b (127.20.196.130:40533), 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381)
I20260709 12:15:00.720623  1309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910908273664e89a7c9dc67ae63027e" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9281096d749a4bf691c774d3321672e7"
I20260709 12:15:00.720769  1233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7910908273664e89a7c9dc67ae63027e" candidate_uuid: "48fd723a77ba455eabb997723f60371b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ade8f52c75914406a928ad61a925ed1b"
I20260709 12:15:00.721309  1309 raft_consensus.cc:3060] T 7910908273664e89a7c9dc67ae63027e P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:00.721400  1233 raft_consensus.cc:3055] T 7910908273664e89a7c9dc67ae63027e P ade8f52c75914406a928ad61a925ed1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:00.721839  1233 raft_consensus.cc:740] T 7910908273664e89a7c9dc67ae63027e P ade8f52c75914406a928ad61a925ed1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ade8f52c75914406a928ad61a925ed1b, State: Running, Role: LEADER
I20260709 12:15:00.723062  1443 raft_consensus.cc:993] T 02297d83178f4c368a44b55829b3085e P 48fd723a77ba455eabb997723f60371b: : Instructing follower ade8f52c75914406a928ad61a925ed1b to start an election
I20260709 12:15:00.722808  1233 consensus_queue.cc:260] T 7910908273664e89a7c9dc67ae63027e P ade8f52c75914406a928ad61a925ed1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:15:00.723564  1443 raft_consensus.cc:1081] T 02297d83178f4c368a44b55829b3085e P 48fd723a77ba455eabb997723f60371b [term 1 LEADER]: Signalling peer ade8f52c75914406a928ad61a925ed1b to start an election
I20260709 12:15:00.724027  1233 raft_consensus.cc:3060] T 7910908273664e89a7c9dc67ae63027e P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:00.725306  1234 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02297d83178f4c368a44b55829b3085e"
dest_uuid: "ade8f52c75914406a928ad61a925ed1b"
 from {username='slave'} at 127.0.0.1:50722
I20260709 12:15:00.725903  1234 raft_consensus.cc:493] T 02297d83178f4c368a44b55829b3085e P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:00.726250  1234 raft_consensus.cc:3060] T 02297d83178f4c368a44b55829b3085e P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:00.728125  1309 raft_consensus.cc:2468] T 7910908273664e89a7c9dc67ae63027e P 9281096d749a4bf691c774d3321672e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48fd723a77ba455eabb997723f60371b in term 2.
I20260709 12:15:00.729602  1125 leader_election.cc:304] T 7910908273664e89a7c9dc67ae63027e P 48fd723a77ba455eabb997723f60371b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48fd723a77ba455eabb997723f60371b, 9281096d749a4bf691c774d3321672e7; no voters: 
I20260709 12:15:00.730069  1235 raft_consensus.cc:1275] T 3ac88bcbdd344e7bba9a49e2e766242c P ade8f52c75914406a928ad61a925ed1b [term 2 FOLLOWER]: Refusing update from remote peer 9281096d749a4bf691c774d3321672e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:00.730104  1233 raft_consensus.cc:2468] T 7910908273664e89a7c9dc67ae63027e P ade8f52c75914406a928ad61a925ed1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48fd723a77ba455eabb997723f60371b in term 2.
I20260709 12:15:00.730471  1443 raft_consensus.cc:2804] T 7910908273664e89a7c9dc67ae63027e P 48fd723a77ba455eabb997723f60371b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:00.731115  1443 raft_consensus.cc:697] T 7910908273664e89a7c9dc67ae63027e P 48fd723a77ba455eabb997723f60371b [term 2 LEADER]: Becoming Leader. State: Replica: 48fd723a77ba455eabb997723f60371b, State: Running, Role: LEADER
I20260709 12:15:00.731751  1517 consensus_queue.cc:1048] T 3ac88bcbdd344e7bba9a49e2e766242c P 9281096d749a4bf691c774d3321672e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:00.731945  1443 consensus_queue.cc:237] T 7910908273664e89a7c9dc67ae63027e P 48fd723a77ba455eabb997723f60371b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:15:00.740584  1158 raft_consensus.cc:1275] T 3ac88bcbdd344e7bba9a49e2e766242c P 48fd723a77ba455eabb997723f60371b [term 2 FOLLOWER]: Refusing update from remote peer 9281096d749a4bf691c774d3321672e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:00.735859  1234 raft_consensus.cc:515] T 02297d83178f4c368a44b55829b3085e P ade8f52c75914406a928ad61a925ed1b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:15:00.744968  1517 consensus_queue.cc:1048] T 3ac88bcbdd344e7bba9a49e2e766242c P 9281096d749a4bf691c774d3321672e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:00.745370  1058 catalog_manager.cc:5697] T 7910908273664e89a7c9dc67ae63027e P 48fd723a77ba455eabb997723f60371b reported cstate change: term changed from 1 to 2, leader changed from ade8f52c75914406a928ad61a925ed1b (127.20.196.130) to 48fd723a77ba455eabb997723f60371b (127.20.196.129). New cstate: current_term: 2 leader_uuid: "48fd723a77ba455eabb997723f60371b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:00.746939  1158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02297d83178f4c368a44b55829b3085e" candidate_uuid: "ade8f52c75914406a928ad61a925ed1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48fd723a77ba455eabb997723f60371b"
I20260709 12:15:00.747591  1158 raft_consensus.cc:3055] T 02297d83178f4c368a44b55829b3085e P 48fd723a77ba455eabb997723f60371b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:00.747773  1309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02297d83178f4c368a44b55829b3085e" candidate_uuid: "ade8f52c75914406a928ad61a925ed1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9281096d749a4bf691c774d3321672e7"
I20260709 12:15:00.747903  1158 raft_consensus.cc:740] T 02297d83178f4c368a44b55829b3085e P 48fd723a77ba455eabb997723f60371b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48fd723a77ba455eabb997723f60371b, State: Running, Role: LEADER
I20260709 12:15:00.748402  1309 raft_consensus.cc:3060] T 02297d83178f4c368a44b55829b3085e P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:00.749162  1158 consensus_queue.cc:260] T 02297d83178f4c368a44b55829b3085e P 48fd723a77ba455eabb997723f60371b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:15:00.750231  1158 raft_consensus.cc:3060] T 02297d83178f4c368a44b55829b3085e P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:00.755514  1309 raft_consensus.cc:2468] T 02297d83178f4c368a44b55829b3085e P 9281096d749a4bf691c774d3321672e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade8f52c75914406a928ad61a925ed1b in term 2.
I20260709 12:15:00.756671  1200 leader_election.cc:304] T 02297d83178f4c368a44b55829b3085e P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9281096d749a4bf691c774d3321672e7, ade8f52c75914406a928ad61a925ed1b; no voters: 
I20260709 12:15:00.757490  1476 raft_consensus.cc:2804] T 02297d83178f4c368a44b55829b3085e P ade8f52c75914406a928ad61a925ed1b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:00.745425  1234 leader_election.cc:290] T 02297d83178f4c368a44b55829b3085e P ade8f52c75914406a928ad61a925ed1b [CANDIDATE]: Term 2 election: Requested vote from peers 48fd723a77ba455eabb997723f60371b (127.20.196.129:40613), 9281096d749a4bf691c774d3321672e7 (127.20.196.131:43381)
I20260709 12:15:00.758046  1476 raft_consensus.cc:697] T 02297d83178f4c368a44b55829b3085e P ade8f52c75914406a928ad61a925ed1b [term 2 LEADER]: Becoming Leader. State: Replica: ade8f52c75914406a928ad61a925ed1b, State: Running, Role: LEADER
I20260709 12:15:00.758391  1158 raft_consensus.cc:2468] T 02297d83178f4c368a44b55829b3085e P 48fd723a77ba455eabb997723f60371b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade8f52c75914406a928ad61a925ed1b in term 2.
I20260709 12:15:00.759002  1476 consensus_queue.cc:237] T 02297d83178f4c368a44b55829b3085e P ade8f52c75914406a928ad61a925ed1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:15:00.764662  1309 raft_consensus.cc:1275] T 20c09a31d7a545b2ba4bb6853c19cab3 P 9281096d749a4bf691c774d3321672e7 [term 2 FOLLOWER]: Refusing update from remote peer ade8f52c75914406a928ad61a925ed1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:00.766018  1476 consensus_queue.cc:1048] T 20c09a31d7a545b2ba4bb6853c19cab3 P ade8f52c75914406a928ad61a925ed1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:00.773491  1056 catalog_manager.cc:5697] T 02297d83178f4c368a44b55829b3085e P ade8f52c75914406a928ad61a925ed1b reported cstate change: term changed from 1 to 2, leader changed from 48fd723a77ba455eabb997723f60371b (127.20.196.129) to ade8f52c75914406a928ad61a925ed1b (127.20.196.130). New cstate: current_term: 2 leader_uuid: "ade8f52c75914406a928ad61a925ed1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:00.776093  1158 raft_consensus.cc:1275] T 20c09a31d7a545b2ba4bb6853c19cab3 P 48fd723a77ba455eabb997723f60371b [term 2 FOLLOWER]: Refusing update from remote peer ade8f52c75914406a928ad61a925ed1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:00.777915  1522 consensus_queue.cc:1048] T 20c09a31d7a545b2ba4bb6853c19cab3 P ade8f52c75914406a928ad61a925ed1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:00.891834  1158 raft_consensus.cc:1275] T 6dae4debcb434769a07d735facc9817f P 48fd723a77ba455eabb997723f60371b [term 2 FOLLOWER]: Refusing update from remote peer ade8f52c75914406a928ad61a925ed1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:00.893152  1522 consensus_queue.cc:1048] T 6dae4debcb434769a07d735facc9817f P ade8f52c75914406a928ad61a925ed1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:00.900663  1309 raft_consensus.cc:1275] T 6dae4debcb434769a07d735facc9817f P 9281096d749a4bf691c774d3321672e7 [term 2 FOLLOWER]: Refusing update from remote peer ade8f52c75914406a928ad61a925ed1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:00.902107  1493 consensus_queue.cc:1048] T 6dae4debcb434769a07d735facc9817f P ade8f52c75914406a928ad61a925ed1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:01.203985  1234 raft_consensus.cc:1275] T 7910908273664e89a7c9dc67ae63027e P ade8f52c75914406a928ad61a925ed1b [term 2 FOLLOWER]: Refusing update from remote peer 48fd723a77ba455eabb997723f60371b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:01.205305  1481 consensus_queue.cc:1048] T 7910908273664e89a7c9dc67ae63027e P 48fd723a77ba455eabb997723f60371b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:01.213981  1309 raft_consensus.cc:1275] T 7910908273664e89a7c9dc67ae63027e P 9281096d749a4bf691c774d3321672e7 [term 2 FOLLOWER]: Refusing update from remote peer 48fd723a77ba455eabb997723f60371b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:01.215803  1444 consensus_queue.cc:1048] T 7910908273664e89a7c9dc67ae63027e P 48fd723a77ba455eabb997723f60371b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:01.216897  1158 raft_consensus.cc:1275] T 02297d83178f4c368a44b55829b3085e P 48fd723a77ba455eabb997723f60371b [term 2 FOLLOWER]: Refusing update from remote peer ade8f52c75914406a928ad61a925ed1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:01.218526  1493 consensus_queue.cc:1048] T 02297d83178f4c368a44b55829b3085e P ade8f52c75914406a928ad61a925ed1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:01.232108  1309 raft_consensus.cc:1275] T 02297d83178f4c368a44b55829b3085e P 9281096d749a4bf691c774d3321672e7 [term 2 FOLLOWER]: Refusing update from remote peer ade8f52c75914406a928ad61a925ed1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:01.235524  1493 consensus_queue.cc:1048] T 02297d83178f4c368a44b55829b3085e P ade8f52c75914406a928ad61a925ed1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:03.197321  1058 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60616:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:15:03.216243  1058 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60616:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:15:03.295913 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:03.397996  1563 tablet.cc:1724] T 7910908273664e89a7c9dc67ae63027e P 48fd723a77ba455eabb997723f60371b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:03.398288  1566 tablet.cc:1724] T 7910908273664e89a7c9dc67ae63027e P 9281096d749a4bf691c774d3321672e7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:15:03.442289  1557 log.cc:927] Time spent T fa41764beac241228184f7b2c3a4b1a5 P 48fd723a77ba455eabb997723f60371b: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 12:15:03.449179  1558 log.cc:927] Time spent T 28d226ed3f0e4fb8bae68b4340e8e4a1 P ade8f52c75914406a928ad61a925ed1b: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:15:03.450399  1568 tablet.cc:1724] T 4e3a90ba50264ff59de7e64f04e7cbde P 48fd723a77ba455eabb997723f60371b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:03.464840  1566 tablet.cc:1724] T 4e3a90ba50264ff59de7e64f04e7cbde P 9281096d749a4bf691c774d3321672e7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:03.513000  1568 tablet.cc:1724] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 48fd723a77ba455eabb997723f60371b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:15:03.515496  1200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:43381, user_credentials={real_user=slave}} blocked reactor thread for 44235.4us
I20260709 12:15:03.572507  1582 tablet.cc:1724] T 7910908273664e89a7c9dc67ae63027e P ade8f52c75914406a928ad61a925ed1b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:03.563706  1235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f6d5246f47546cea93920208eb4c505"
dest_uuid: "ade8f52c75914406a928ad61a925ed1b"
mode: GRACEFUL
new_leader_uuid: "9281096d749a4bf691c774d3321672e7"
 from {username='slave'} at 127.0.0.1:45716
I20260709 12:15:03.599434  1235 raft_consensus.cc:606] T 6f6d5246f47546cea93920208eb4c505 P ade8f52c75914406a928ad61a925ed1b [term 2 LEADER]: Received request to transfer leadership to TS 9281096d749a4bf691c774d3321672e7
W20260709 12:15:03.623663  1200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.196.131:43381, user_credentials={real_user=slave}} blocked reactor thread for 54253.3us
I20260709 12:15:03.634799  1572 tablet.cc:1724] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 9281096d749a4bf691c774d3321672e7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:03.637748  1566 tablet.cc:1724] T 6dae4debcb434769a07d735facc9817f P 9281096d749a4bf691c774d3321672e7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:03.653659  1563 tablet.cc:1724] T 3ac88bcbdd344e7bba9a49e2e766242c P 48fd723a77ba455eabb997723f60371b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:03.681572  1592 tablet.cc:1724] T 6dae4debcb434769a07d735facc9817f P ade8f52c75914406a928ad61a925ed1b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:15:03.706501  1587 log.cc:927] Time spent T fa41764beac241228184f7b2c3a4b1a5 P 9281096d749a4bf691c774d3321672e7: Append to log took a long time: real 0.095s	user 0.002s	sys 0.000s
I20260709 12:15:03.710942  1578 raft_consensus.cc:993] T 6f6d5246f47546cea93920208eb4c505 P ade8f52c75914406a928ad61a925ed1b: : Instructing follower 9281096d749a4bf691c774d3321672e7 to start an election
I20260709 12:15:03.684623  1581 tablet.cc:1724] T 6dae4debcb434769a07d735facc9817f P 48fd723a77ba455eabb997723f60371b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:03.722271  1563 tablet.cc:1724] T fa41764beac241228184f7b2c3a4b1a5 P 48fd723a77ba455eabb997723f60371b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:03.737776  1578 raft_consensus.cc:1081] T 6f6d5246f47546cea93920208eb4c505 P ade8f52c75914406a928ad61a925ed1b [term 2 LEADER]: Signalling peer 9281096d749a4bf691c774d3321672e7 to start an election
I20260709 12:15:03.785910  1592 tablet.cc:1724] T 3ac88bcbdd344e7bba9a49e2e766242c P ade8f52c75914406a928ad61a925ed1b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:03.794791  1605 tablet.cc:1724] T 3ac88bcbdd344e7bba9a49e2e766242c P 9281096d749a4bf691c774d3321672e7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:03.800782  1310 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f6d5246f47546cea93920208eb4c505"
dest_uuid: "9281096d749a4bf691c774d3321672e7"
 from {username='slave'} at 127.0.0.1:44808
I20260709 12:15:03.801489  1310 raft_consensus.cc:493] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:03.801930  1310 raft_consensus.cc:3060] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:03.811872  1600 tablet.cc:1724] T fa41764beac241228184f7b2c3a4b1a5 P 9281096d749a4bf691c774d3321672e7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:03.816092  1572 tablet.cc:1724] T 6f7eb2b18b3e4b0eba971970313a52c2 P 9281096d749a4bf691c774d3321672e7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:03.809150  1582 tablet.cc:1724] T 6f7eb2b18b3e4b0eba971970313a52c2 P ade8f52c75914406a928ad61a925ed1b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:03.819516  1310 raft_consensus.cc:515] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:15:03.826355  1310 leader_election.cc:290] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7 [CANDIDATE]: Term 3 election: Requested vote from peers 48fd723a77ba455eabb997723f60371b (127.20.196.129:40613), ade8f52c75914406a928ad61a925ed1b (127.20.196.130:40533)
I20260709 12:15:03.827957  1235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6d5246f47546cea93920208eb4c505" candidate_uuid: "9281096d749a4bf691c774d3321672e7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ade8f52c75914406a928ad61a925ed1b"
I20260709 12:15:03.828634  1235 raft_consensus.cc:3055] T 6f6d5246f47546cea93920208eb4c505 P ade8f52c75914406a928ad61a925ed1b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:03.828958  1235 raft_consensus.cc:740] T 6f6d5246f47546cea93920208eb4c505 P ade8f52c75914406a928ad61a925ed1b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ade8f52c75914406a928ad61a925ed1b, State: Running, Role: LEADER
I20260709 12:15:03.829041  1581 tablet.cc:1724] T 02297d83178f4c368a44b55829b3085e P 48fd723a77ba455eabb997723f60371b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:03.829818  1235 consensus_queue.cc:260] T 6f6d5246f47546cea93920208eb4c505 P ade8f52c75914406a928ad61a925ed1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:15:03.831221  1235 raft_consensus.cc:3060] T 6f6d5246f47546cea93920208eb4c505 P ade8f52c75914406a928ad61a925ed1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:03.847661  1566 tablet.cc:1724] T 20c09a31d7a545b2ba4bb6853c19cab3 P 9281096d749a4bf691c774d3321672e7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:03.848713  1563 tablet.cc:1724] T 20c09a31d7a545b2ba4bb6853c19cab3 P 48fd723a77ba455eabb997723f60371b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:03.851656  1604 tablet.cc:1724] T 4e3a90ba50264ff59de7e64f04e7cbde P ade8f52c75914406a928ad61a925ed1b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:03.860689  1158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6d5246f47546cea93920208eb4c505" candidate_uuid: "9281096d749a4bf691c774d3321672e7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "48fd723a77ba455eabb997723f60371b"
I20260709 12:15:03.861377  1158 raft_consensus.cc:3060] T 6f6d5246f47546cea93920208eb4c505 P 48fd723a77ba455eabb997723f60371b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:03.866796  1607 tablet.cc:1724] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P ade8f52c75914406a928ad61a925ed1b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:03.871304  1235 raft_consensus.cc:2468] T 6f6d5246f47546cea93920208eb4c505 P ade8f52c75914406a928ad61a925ed1b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9281096d749a4bf691c774d3321672e7 in term 3.
I20260709 12:15:03.872906  1272 leader_election.cc:304] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9281096d749a4bf691c774d3321672e7, ade8f52c75914406a928ad61a925ed1b; no voters: 
I20260709 12:15:03.873651  1517 raft_consensus.cc:2804] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:03.874189  1517 raft_consensus.cc:697] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7 [term 3 LEADER]: Becoming Leader. State: Replica: 9281096d749a4bf691c774d3321672e7, State: Running, Role: LEADER
I20260709 12:15:03.875077  1158 raft_consensus.cc:2468] T 6f6d5246f47546cea93920208eb4c505 P 48fd723a77ba455eabb997723f60371b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9281096d749a4bf691c774d3321672e7 in term 3.
I20260709 12:15:03.877744  1517 consensus_queue.cc:237] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:15:03.885672  1592 tablet.cc:1724] T 02297d83178f4c368a44b55829b3085e P ade8f52c75914406a928ad61a925ed1b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:03.886399  1158 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "708dcd04a2de4a6ea0c2436ae59b3aca"
dest_uuid: "48fd723a77ba455eabb997723f60371b"
mode: GRACEFUL
new_leader_uuid: "9281096d749a4bf691c774d3321672e7"
 from {username='slave'} at 127.0.0.1:46036
I20260709 12:15:03.887607  1158 raft_consensus.cc:606] T 708dcd04a2de4a6ea0c2436ae59b3aca P 48fd723a77ba455eabb997723f60371b [term 2 LEADER]: Received request to transfer leadership to TS 9281096d749a4bf691c774d3321672e7
I20260709 12:15:03.889300 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:15:03.889916 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:03.896662  1563 tablet.cc:1724] T 6f7eb2b18b3e4b0eba971970313a52c2 P 48fd723a77ba455eabb997723f60371b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:03.903854  1607 tablet.cc:1724] T 20c09a31d7a545b2ba4bb6853c19cab3 P ade8f52c75914406a928ad61a925ed1b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:03.904677  1592 tablet.cc:1724] T fa41764beac241228184f7b2c3a4b1a5 P ade8f52c75914406a928ad61a925ed1b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:03.908401  1566 tablet.cc:1724] T 02297d83178f4c368a44b55829b3085e P 9281096d749a4bf691c774d3321672e7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:03.917377  1055 catalog_manager.cc:5697] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7 reported cstate change: term changed from 2 to 3, leader changed from ade8f52c75914406a928ad61a925ed1b (127.20.196.130) to 9281096d749a4bf691c774d3321672e7 (127.20.196.131). New cstate: current_term: 3 leader_uuid: "9281096d749a4bf691c774d3321672e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:03.924346  1598 raft_consensus.cc:993] T 708dcd04a2de4a6ea0c2436ae59b3aca P 48fd723a77ba455eabb997723f60371b: : Instructing follower 9281096d749a4bf691c774d3321672e7 to start an election
I20260709 12:15:03.924849  1598 raft_consensus.cc:1081] T 708dcd04a2de4a6ea0c2436ae59b3aca P 48fd723a77ba455eabb997723f60371b [term 2 LEADER]: Signalling peer 9281096d749a4bf691c774d3321672e7 to start an election
I20260709 12:15:03.926815  1309 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "708dcd04a2de4a6ea0c2436ae59b3aca"
dest_uuid: "9281096d749a4bf691c774d3321672e7"
 from {username='slave'} at 127.0.0.1:44820
I20260709 12:15:03.927382  1309 raft_consensus.cc:493] T 708dcd04a2de4a6ea0c2436ae59b3aca P 9281096d749a4bf691c774d3321672e7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:03.927719  1309 raft_consensus.cc:3060] T 708dcd04a2de4a6ea0c2436ae59b3aca P 9281096d749a4bf691c774d3321672e7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:03.934582  1309 raft_consensus.cc:515] T 708dcd04a2de4a6ea0c2436ae59b3aca P 9281096d749a4bf691c774d3321672e7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:15:03.946307  1235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708dcd04a2de4a6ea0c2436ae59b3aca" candidate_uuid: "9281096d749a4bf691c774d3321672e7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ade8f52c75914406a928ad61a925ed1b"
I20260709 12:15:03.946468  1309 leader_election.cc:290] T 708dcd04a2de4a6ea0c2436ae59b3aca P 9281096d749a4bf691c774d3321672e7 [CANDIDATE]: Term 3 election: Requested vote from peers 48fd723a77ba455eabb997723f60371b (127.20.196.129:40613), ade8f52c75914406a928ad61a925ed1b (127.20.196.130:40533)
I20260709 12:15:03.951936  1235 raft_consensus.cc:3060] T 708dcd04a2de4a6ea0c2436ae59b3aca P ade8f52c75914406a928ad61a925ed1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:03.946898  1158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708dcd04a2de4a6ea0c2436ae59b3aca" candidate_uuid: "9281096d749a4bf691c774d3321672e7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "48fd723a77ba455eabb997723f60371b"
I20260709 12:15:03.953006  1158 raft_consensus.cc:3055] T 708dcd04a2de4a6ea0c2436ae59b3aca P 48fd723a77ba455eabb997723f60371b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:03.953222  1158 raft_consensus.cc:740] T 708dcd04a2de4a6ea0c2436ae59b3aca P 48fd723a77ba455eabb997723f60371b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 48fd723a77ba455eabb997723f60371b, State: Running, Role: LEADER
I20260709 12:15:03.953822  1158 consensus_queue.cc:260] T 708dcd04a2de4a6ea0c2436ae59b3aca P 48fd723a77ba455eabb997723f60371b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:15:03.954713  1158 raft_consensus.cc:3060] T 708dcd04a2de4a6ea0c2436ae59b3aca P 48fd723a77ba455eabb997723f60371b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:03.960613  1056 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 9f291740485b4332857608ac87420526: soft_deleted_table [id=9eee5303430b4e4aad32f306464681c9] alter complete (version 1)
I20260709 12:15:03.962155  1235 raft_consensus.cc:2468] T 708dcd04a2de4a6ea0c2436ae59b3aca P ade8f52c75914406a928ad61a925ed1b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9281096d749a4bf691c774d3321672e7 in term 3.
I20260709 12:15:03.963248  1272 leader_election.cc:304] T 708dcd04a2de4a6ea0c2436ae59b3aca P 9281096d749a4bf691c774d3321672e7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9281096d749a4bf691c774d3321672e7, ade8f52c75914406a928ad61a925ed1b; no voters: 
I20260709 12:15:03.963433  1158 raft_consensus.cc:2468] T 708dcd04a2de4a6ea0c2436ae59b3aca P 48fd723a77ba455eabb997723f60371b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9281096d749a4bf691c774d3321672e7 in term 3.
I20260709 12:15:03.963912  1517 raft_consensus.cc:2804] T 708dcd04a2de4a6ea0c2436ae59b3aca P 9281096d749a4bf691c774d3321672e7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:03.965374  1517 raft_consensus.cc:697] T 708dcd04a2de4a6ea0c2436ae59b3aca P 9281096d749a4bf691c774d3321672e7 [term 3 LEADER]: Becoming Leader. State: Replica: 9281096d749a4bf691c774d3321672e7, State: Running, Role: LEADER
I20260709 12:15:03.967578  1517 consensus_queue.cc:237] T 708dcd04a2de4a6ea0c2436ae59b3aca P 9281096d749a4bf691c774d3321672e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } }
I20260709 12:15:03.978847  1056 catalog_manager.cc:5697] T 708dcd04a2de4a6ea0c2436ae59b3aca P 9281096d749a4bf691c774d3321672e7 reported cstate change: term changed from 2 to 3, leader changed from 48fd723a77ba455eabb997723f60371b (127.20.196.129) to 9281096d749a4bf691c774d3321672e7 (127.20.196.131). New cstate: current_term: 3 leader_uuid: "9281096d749a4bf691c774d3321672e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9281096d749a4bf691c774d3321672e7" member_type: VOTER last_known_addr { host: "127.20.196.131" port: 43381 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:04.272993  1158 raft_consensus.cc:1275] T 6f6d5246f47546cea93920208eb4c505 P 48fd723a77ba455eabb997723f60371b [term 3 FOLLOWER]: Refusing update from remote peer 9281096d749a4bf691c774d3321672e7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:04.274353  1517 consensus_queue.cc:1048] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:04.284022  1235 raft_consensus.cc:1275] T 6f6d5246f47546cea93920208eb4c505 P ade8f52c75914406a928ad61a925ed1b [term 3 FOLLOWER]: Refusing update from remote peer 9281096d749a4bf691c774d3321672e7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:04.285856  1616 consensus_queue.cc:1048] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:04.396422  1158 raft_consensus.cc:1275] T 708dcd04a2de4a6ea0c2436ae59b3aca P 48fd723a77ba455eabb997723f60371b [term 3 FOLLOWER]: Refusing update from remote peer 9281096d749a4bf691c774d3321672e7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:04.397639  1616 consensus_queue.cc:1048] T 708dcd04a2de4a6ea0c2436ae59b3aca P 9281096d749a4bf691c774d3321672e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48fd723a77ba455eabb997723f60371b" member_type: VOTER last_known_addr { host: "127.20.196.129" port: 40613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:04.406883  1235 raft_consensus.cc:1275] T 708dcd04a2de4a6ea0c2436ae59b3aca P ade8f52c75914406a928ad61a925ed1b [term 3 FOLLOWER]: Refusing update from remote peer 9281096d749a4bf691c774d3321672e7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:04.408370  1517 consensus_queue.cc:1048] T 708dcd04a2de4a6ea0c2436ae59b3aca P 9281096d749a4bf691c774d3321672e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade8f52c75914406a928ad61a925ed1b" member_type: VOTER last_known_addr { host: "127.20.196.130" port: 40533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:04.891170 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:04.897830 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:04.898187 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:05.899511 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:05.905086 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:05.905551 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:06.906701 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:06.912088 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:06.912524 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:07.913442 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:07.918530 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:07.919337 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:08.920488 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:08.925827 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:08.926327 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:09.927388 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:09.932389 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:09.932842 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:10.933877 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:10.939297 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:10.939847 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:11.940840 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:11.946285 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:11.946847 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:12.948089 21266 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:12.953858 21266 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:12.954357 21266 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:14.009824 21266 tablet_server.cc:179] TabletServer@127.20.196.129:0 shutting down...
W20260709 12:15:14.015479  1274 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 16 similar messages]
W20260709 12:15:14.021582  1274 consensus_peers.cc:597] T 3ac88bcbdd344e7bba9a49e2e766242c P 9281096d749a4bf691c774d3321672e7 -> Peer 48fd723a77ba455eabb997723f60371b (127.20.196.129:40613): Couldn't send request to peer 48fd723a77ba455eabb997723f60371b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:14.049444 21266 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:14.050344 21266 tablet_replica.cc:333] T 6f7eb2b18b3e4b0eba971970313a52c2 P 48fd723a77ba455eabb997723f60371b: stopping tablet replica
I20260709 12:15:14.051329 21266 raft_consensus.cc:2243] T 6f7eb2b18b3e4b0eba971970313a52c2 P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:14.052109 21266 raft_consensus.cc:2272] T 6f7eb2b18b3e4b0eba971970313a52c2 P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.054850 21266 tablet_replica.cc:333] T 3ac88bcbdd344e7bba9a49e2e766242c P 48fd723a77ba455eabb997723f60371b: stopping tablet replica
I20260709 12:15:14.055619 21266 raft_consensus.cc:2243] T 3ac88bcbdd344e7bba9a49e2e766242c P 48fd723a77ba455eabb997723f60371b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:14.056317 21266 raft_consensus.cc:2272] T 3ac88bcbdd344e7bba9a49e2e766242c P 48fd723a77ba455eabb997723f60371b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.058933 21266 tablet_replica.cc:333] T 02297d83178f4c368a44b55829b3085e P 48fd723a77ba455eabb997723f60371b: stopping tablet replica
I20260709 12:15:14.059705 21266 raft_consensus.cc:2243] T 02297d83178f4c368a44b55829b3085e P 48fd723a77ba455eabb997723f60371b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:14.060292 21266 raft_consensus.cc:2272] T 02297d83178f4c368a44b55829b3085e P 48fd723a77ba455eabb997723f60371b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.062700 21266 tablet_replica.cc:333] T fa41764beac241228184f7b2c3a4b1a5 P 48fd723a77ba455eabb997723f60371b: stopping tablet replica
I20260709 12:15:14.063364 21266 raft_consensus.cc:2243] T fa41764beac241228184f7b2c3a4b1a5 P 48fd723a77ba455eabb997723f60371b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:14.064297 21266 raft_consensus.cc:2272] T fa41764beac241228184f7b2c3a4b1a5 P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.067301 21266 tablet_replica.cc:333] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 48fd723a77ba455eabb997723f60371b: stopping tablet replica
I20260709 12:15:14.068195 21266 raft_consensus.cc:2243] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 48fd723a77ba455eabb997723f60371b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:14.069336 21266 raft_consensus.cc:2272] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.072024 21266 tablet_replica.cc:333] T 062ef3d157f74d819a1e8c88524d15bb P 48fd723a77ba455eabb997723f60371b: stopping tablet replica
I20260709 12:15:14.072726 21266 raft_consensus.cc:2243] T 062ef3d157f74d819a1e8c88524d15bb P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:14.073350 21266 raft_consensus.cc:2272] T 062ef3d157f74d819a1e8c88524d15bb P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.076557 21266 tablet_replica.cc:333] T 20c09a31d7a545b2ba4bb6853c19cab3 P 48fd723a77ba455eabb997723f60371b: stopping tablet replica
I20260709 12:15:14.077201 21266 raft_consensus.cc:2243] T 20c09a31d7a545b2ba4bb6853c19cab3 P 48fd723a77ba455eabb997723f60371b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:14.077824 21266 raft_consensus.cc:2272] T 20c09a31d7a545b2ba4bb6853c19cab3 P 48fd723a77ba455eabb997723f60371b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.080389 21266 tablet_replica.cc:333] T b2b62eae23264a6aa96a0a5899444f0e P 48fd723a77ba455eabb997723f60371b: stopping tablet replica
I20260709 12:15:14.081023 21266 raft_consensus.cc:2243] T b2b62eae23264a6aa96a0a5899444f0e P 48fd723a77ba455eabb997723f60371b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:14.081954 21266 raft_consensus.cc:2272] T b2b62eae23264a6aa96a0a5899444f0e P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.084908 21266 tablet_replica.cc:333] T 2a0060a4875345599fa7795fb8c284c0 P 48fd723a77ba455eabb997723f60371b: stopping tablet replica
I20260709 12:15:14.085661 21266 raft_consensus.cc:2243] T 2a0060a4875345599fa7795fb8c284c0 P 48fd723a77ba455eabb997723f60371b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:14.086704 21266 raft_consensus.cc:2272] T 2a0060a4875345599fa7795fb8c284c0 P 48fd723a77ba455eabb997723f60371b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.089084 21266 tablet_replica.cc:333] T 7910908273664e89a7c9dc67ae63027e P 48fd723a77ba455eabb997723f60371b: stopping tablet replica
I20260709 12:15:14.089741 21266 raft_consensus.cc:2243] T 7910908273664e89a7c9dc67ae63027e P 48fd723a77ba455eabb997723f60371b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:14.090677 21266 raft_consensus.cc:2272] T 7910908273664e89a7c9dc67ae63027e P 48fd723a77ba455eabb997723f60371b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.093151 21266 tablet_replica.cc:333] T 4e3a90ba50264ff59de7e64f04e7cbde P 48fd723a77ba455eabb997723f60371b: stopping tablet replica
I20260709 12:15:14.093832 21266 raft_consensus.cc:2243] T 4e3a90ba50264ff59de7e64f04e7cbde P 48fd723a77ba455eabb997723f60371b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:14.094870 21266 raft_consensus.cc:2272] T 4e3a90ba50264ff59de7e64f04e7cbde P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.097271 21266 tablet_replica.cc:333] T 6f6d5246f47546cea93920208eb4c505 P 48fd723a77ba455eabb997723f60371b: stopping tablet replica
I20260709 12:15:14.097914 21266 raft_consensus.cc:2243] T 6f6d5246f47546cea93920208eb4c505 P 48fd723a77ba455eabb997723f60371b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:14.098538 21266 raft_consensus.cc:2272] T 6f6d5246f47546cea93920208eb4c505 P 48fd723a77ba455eabb997723f60371b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.101255 21266 tablet_replica.cc:333] T 023ba999f2974359812bb5a68e6a618c P 48fd723a77ba455eabb997723f60371b: stopping tablet replica
I20260709 12:15:14.101756 21266 raft_consensus.cc:2243] T 023ba999f2974359812bb5a68e6a618c P 48fd723a77ba455eabb997723f60371b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:14.102216 21266 raft_consensus.cc:2272] T 023ba999f2974359812bb5a68e6a618c P 48fd723a77ba455eabb997723f60371b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.104492 21266 tablet_replica.cc:333] T fa8e4b22b550472e9de5f6a9cc8e173c P 48fd723a77ba455eabb997723f60371b: stopping tablet replica
I20260709 12:15:14.105124 21266 raft_consensus.cc:2243] T fa8e4b22b550472e9de5f6a9cc8e173c P 48fd723a77ba455eabb997723f60371b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:14.105645 21266 raft_consensus.cc:2272] T fa8e4b22b550472e9de5f6a9cc8e173c P 48fd723a77ba455eabb997723f60371b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.108592 21266 tablet_replica.cc:333] T 708dcd04a2de4a6ea0c2436ae59b3aca P 48fd723a77ba455eabb997723f60371b: stopping tablet replica
I20260709 12:15:14.109382 21266 raft_consensus.cc:2243] T 708dcd04a2de4a6ea0c2436ae59b3aca P 48fd723a77ba455eabb997723f60371b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:14.110148 21266 raft_consensus.cc:2272] T 708dcd04a2de4a6ea0c2436ae59b3aca P 48fd723a77ba455eabb997723f60371b [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:14.112572  1200 consensus_peers.cc:597] T 02297d83178f4c368a44b55829b3085e P ade8f52c75914406a928ad61a925ed1b -> Peer 48fd723a77ba455eabb997723f60371b (127.20.196.129:40613): Couldn't send request to peer 48fd723a77ba455eabb997723f60371b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:14.113523 21266 tablet_replica.cc:333] T be816cce439f4fb9b32c1e557f424523 P 48fd723a77ba455eabb997723f60371b: stopping tablet replica
I20260709 12:15:14.114117 21266 raft_consensus.cc:2243] T be816cce439f4fb9b32c1e557f424523 P 48fd723a77ba455eabb997723f60371b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:14.114655 21266 raft_consensus.cc:2272] T be816cce439f4fb9b32c1e557f424523 P 48fd723a77ba455eabb997723f60371b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.116920 21266 tablet_replica.cc:333] T 6dae4debcb434769a07d735facc9817f P 48fd723a77ba455eabb997723f60371b: stopping tablet replica
I20260709 12:15:14.117422 21266 raft_consensus.cc:2243] T 6dae4debcb434769a07d735facc9817f P 48fd723a77ba455eabb997723f60371b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:14.117991 21266 raft_consensus.cc:2272] T 6dae4debcb434769a07d735facc9817f P 48fd723a77ba455eabb997723f60371b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.120739 21266 tablet_replica.cc:333] T 2ef02663c5eb4a4c900ad78501828298 P 48fd723a77ba455eabb997723f60371b: stopping tablet replica
I20260709 12:15:14.121253 21266 raft_consensus.cc:2243] T 2ef02663c5eb4a4c900ad78501828298 P 48fd723a77ba455eabb997723f60371b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:14.122123 21266 raft_consensus.cc:2272] T 2ef02663c5eb4a4c900ad78501828298 P 48fd723a77ba455eabb997723f60371b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:14.128939  1200 consensus_peers.cc:597] T 20c09a31d7a545b2ba4bb6853c19cab3 P ade8f52c75914406a928ad61a925ed1b -> Peer 48fd723a77ba455eabb997723f60371b (127.20.196.129:40613): Couldn't send request to peer 48fd723a77ba455eabb997723f60371b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:14.133725  1274 consensus_peers.cc:597] T fa8e4b22b550472e9de5f6a9cc8e173c P 9281096d749a4bf691c774d3321672e7 -> Peer 48fd723a77ba455eabb997723f60371b (127.20.196.129:40613): Couldn't send request to peer 48fd723a77ba455eabb997723f60371b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:14.170038 21266 tablet_server.cc:196] TabletServer@127.20.196.129:0 shutdown complete.
W20260709 12:15:14.203878  1200 consensus_peers.cc:597] T be816cce439f4fb9b32c1e557f424523 P ade8f52c75914406a928ad61a925ed1b -> Peer 48fd723a77ba455eabb997723f60371b (127.20.196.129:40613): Couldn't send request to peer 48fd723a77ba455eabb997723f60371b. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40613: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:14.218628 21266 tablet_server.cc:179] TabletServer@127.20.196.130:0 shutting down...
W20260709 12:15:14.240046  1200 consensus_peers.cc:597] T 6dae4debcb434769a07d735facc9817f P ade8f52c75914406a928ad61a925ed1b -> Peer 48fd723a77ba455eabb997723f60371b (127.20.196.129:40613): Couldn't send request to peer 48fd723a77ba455eabb997723f60371b. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40613: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:14.254257 21266 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:14.255425 21266 tablet_replica.cc:333] T 3ac88bcbdd344e7bba9a49e2e766242c P ade8f52c75914406a928ad61a925ed1b: stopping tablet replica
I20260709 12:15:14.256470 21266 raft_consensus.cc:2243] T 3ac88bcbdd344e7bba9a49e2e766242c P ade8f52c75914406a928ad61a925ed1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:14.257121 21266 raft_consensus.cc:2272] T 3ac88bcbdd344e7bba9a49e2e766242c P ade8f52c75914406a928ad61a925ed1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.260154 21266 tablet_replica.cc:333] T 02297d83178f4c368a44b55829b3085e P ade8f52c75914406a928ad61a925ed1b: stopping tablet replica
I20260709 12:15:14.260702 21266 raft_consensus.cc:2243] T 02297d83178f4c368a44b55829b3085e P ade8f52c75914406a928ad61a925ed1b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:14.261523 21266 raft_consensus.cc:2272] T 02297d83178f4c368a44b55829b3085e P ade8f52c75914406a928ad61a925ed1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.263756 21266 tablet_replica.cc:333] T 6f7eb2b18b3e4b0eba971970313a52c2 P ade8f52c75914406a928ad61a925ed1b: stopping tablet replica
I20260709 12:15:14.264298 21266 raft_consensus.cc:2243] T 6f7eb2b18b3e4b0eba971970313a52c2 P ade8f52c75914406a928ad61a925ed1b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:14.265237 21266 raft_consensus.cc:2272] T 6f7eb2b18b3e4b0eba971970313a52c2 P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.267742 21266 tablet_replica.cc:333] T 7910908273664e89a7c9dc67ae63027e P ade8f52c75914406a928ad61a925ed1b: stopping tablet replica
I20260709 12:15:14.268254 21266 raft_consensus.cc:2243] T 7910908273664e89a7c9dc67ae63027e P ade8f52c75914406a928ad61a925ed1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:14.268728 21266 raft_consensus.cc:2272] T 7910908273664e89a7c9dc67ae63027e P ade8f52c75914406a928ad61a925ed1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.270787 21266 tablet_replica.cc:333] T 6f6d5246f47546cea93920208eb4c505 P ade8f52c75914406a928ad61a925ed1b: stopping tablet replica
I20260709 12:15:14.271466 21266 raft_consensus.cc:2243] T 6f6d5246f47546cea93920208eb4c505 P ade8f52c75914406a928ad61a925ed1b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:14.272056 21266 raft_consensus.cc:2272] T 6f6d5246f47546cea93920208eb4c505 P ade8f52c75914406a928ad61a925ed1b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.275279 21266 tablet_replica.cc:333] T 4e3a90ba50264ff59de7e64f04e7cbde P ade8f52c75914406a928ad61a925ed1b: stopping tablet replica
I20260709 12:15:14.276091 21266 raft_consensus.cc:2243] T 4e3a90ba50264ff59de7e64f04e7cbde P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:14.276662 21266 raft_consensus.cc:2272] T 4e3a90ba50264ff59de7e64f04e7cbde P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:14.276708  1274 consensus_peers.cc:597] T 708dcd04a2de4a6ea0c2436ae59b3aca P 9281096d749a4bf691c774d3321672e7 -> Peer 48fd723a77ba455eabb997723f60371b (127.20.196.129:40613): Couldn't send request to peer 48fd723a77ba455eabb997723f60371b. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40613: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:14.279317 21266 tablet_replica.cc:333] T 6dae4debcb434769a07d735facc9817f P ade8f52c75914406a928ad61a925ed1b: stopping tablet replica
I20260709 12:15:14.279841 21266 raft_consensus.cc:2243] T 6dae4debcb434769a07d735facc9817f P ade8f52c75914406a928ad61a925ed1b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:14.280637 21266 raft_consensus.cc:2272] T 6dae4debcb434769a07d735facc9817f P ade8f52c75914406a928ad61a925ed1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.282832 21266 tablet_replica.cc:333] T 2ef02663c5eb4a4c900ad78501828298 P ade8f52c75914406a928ad61a925ed1b: stopping tablet replica
I20260709 12:15:14.283425 21266 raft_consensus.cc:2243] T 2ef02663c5eb4a4c900ad78501828298 P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:14.283838 21266 raft_consensus.cc:2272] T 2ef02663c5eb4a4c900ad78501828298 P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.285965 21266 tablet_replica.cc:333] T 20c09a31d7a545b2ba4bb6853c19cab3 P ade8f52c75914406a928ad61a925ed1b: stopping tablet replica
I20260709 12:15:14.286492 21266 raft_consensus.cc:2243] T 20c09a31d7a545b2ba4bb6853c19cab3 P ade8f52c75914406a928ad61a925ed1b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:14.287325 21266 raft_consensus.cc:2272] T 20c09a31d7a545b2ba4bb6853c19cab3 P ade8f52c75914406a928ad61a925ed1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.289736 21266 tablet_replica.cc:333] T 2a0060a4875345599fa7795fb8c284c0 P ade8f52c75914406a928ad61a925ed1b: stopping tablet replica
I20260709 12:15:14.290241 21266 raft_consensus.cc:2243] T 2a0060a4875345599fa7795fb8c284c0 P ade8f52c75914406a928ad61a925ed1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:14.290642 21266 raft_consensus.cc:2272] T 2a0060a4875345599fa7795fb8c284c0 P ade8f52c75914406a928ad61a925ed1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.292814 21266 tablet_replica.cc:333] T b2b62eae23264a6aa96a0a5899444f0e P ade8f52c75914406a928ad61a925ed1b: stopping tablet replica
I20260709 12:15:14.293354 21266 raft_consensus.cc:2243] T b2b62eae23264a6aa96a0a5899444f0e P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:14.293815 21266 raft_consensus.cc:2272] T b2b62eae23264a6aa96a0a5899444f0e P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.296133 21266 tablet_replica.cc:333] T fa8e4b22b550472e9de5f6a9cc8e173c P ade8f52c75914406a928ad61a925ed1b: stopping tablet replica
I20260709 12:15:14.296710 21266 raft_consensus.cc:2243] T fa8e4b22b550472e9de5f6a9cc8e173c P ade8f52c75914406a928ad61a925ed1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:14.297211 21266 raft_consensus.cc:2272] T fa8e4b22b550472e9de5f6a9cc8e173c P ade8f52c75914406a928ad61a925ed1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.299628 21266 tablet_replica.cc:333] T 023ba999f2974359812bb5a68e6a618c P ade8f52c75914406a928ad61a925ed1b: stopping tablet replica
I20260709 12:15:14.300163 21266 raft_consensus.cc:2243] T 023ba999f2974359812bb5a68e6a618c P ade8f52c75914406a928ad61a925ed1b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:14.301033 21266 raft_consensus.cc:2272] T 023ba999f2974359812bb5a68e6a618c P ade8f52c75914406a928ad61a925ed1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.303332 21266 tablet_replica.cc:333] T 708dcd04a2de4a6ea0c2436ae59b3aca P ade8f52c75914406a928ad61a925ed1b: stopping tablet replica
I20260709 12:15:14.303871 21266 raft_consensus.cc:2243] T 708dcd04a2de4a6ea0c2436ae59b3aca P ade8f52c75914406a928ad61a925ed1b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:14.304382 21266 raft_consensus.cc:2272] T 708dcd04a2de4a6ea0c2436ae59b3aca P ade8f52c75914406a928ad61a925ed1b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.306490 21266 tablet_replica.cc:333] T fa41764beac241228184f7b2c3a4b1a5 P ade8f52c75914406a928ad61a925ed1b: stopping tablet replica
I20260709 12:15:14.307080 21266 raft_consensus.cc:2243] T fa41764beac241228184f7b2c3a4b1a5 P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:14.307596 21266 raft_consensus.cc:2272] T fa41764beac241228184f7b2c3a4b1a5 P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.309755 21266 tablet_replica.cc:333] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P ade8f52c75914406a928ad61a925ed1b: stopping tablet replica
I20260709 12:15:14.310264 21266 raft_consensus.cc:2243] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:14.310743 21266 raft_consensus.cc:2272] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.312933 21266 tablet_replica.cc:333] T 062ef3d157f74d819a1e8c88524d15bb P ade8f52c75914406a928ad61a925ed1b: stopping tablet replica
I20260709 12:15:14.313438 21266 raft_consensus.cc:2243] T 062ef3d157f74d819a1e8c88524d15bb P ade8f52c75914406a928ad61a925ed1b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:14.314267 21266 raft_consensus.cc:2272] T 062ef3d157f74d819a1e8c88524d15bb P ade8f52c75914406a928ad61a925ed1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.316375 21266 tablet_replica.cc:333] T be816cce439f4fb9b32c1e557f424523 P ade8f52c75914406a928ad61a925ed1b: stopping tablet replica
I20260709 12:15:14.316865 21266 raft_consensus.cc:2243] T be816cce439f4fb9b32c1e557f424523 P ade8f52c75914406a928ad61a925ed1b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:14.317682 21266 raft_consensus.cc:2272] T be816cce439f4fb9b32c1e557f424523 P ade8f52c75914406a928ad61a925ed1b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:14.334558  1274 consensus_peers.cc:597] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7 -> Peer 48fd723a77ba455eabb997723f60371b (127.20.196.129:40613): Couldn't send request to peer 48fd723a77ba455eabb997723f60371b. Status: Network error: Client connection negotiation failed: client connection to 127.20.196.129:40613: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:14.362287 21266 tablet_server.cc:196] TabletServer@127.20.196.130:0 shutdown complete.
I20260709 12:15:14.403982 21266 tablet_server.cc:179] TabletServer@127.20.196.131:0 shutting down...
I20260709 12:15:14.438884 21266 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:14.439723 21266 tablet_replica.cc:333] T 7910908273664e89a7c9dc67ae63027e P 9281096d749a4bf691c774d3321672e7: stopping tablet replica
I20260709 12:15:14.440893 21266 raft_consensus.cc:2243] T 7910908273664e89a7c9dc67ae63027e P 9281096d749a4bf691c774d3321672e7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:14.441627 21266 raft_consensus.cc:2272] T 7910908273664e89a7c9dc67ae63027e P 9281096d749a4bf691c774d3321672e7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.444023 21266 tablet_replica.cc:333] T fa41764beac241228184f7b2c3a4b1a5 P 9281096d749a4bf691c774d3321672e7: stopping tablet replica
I20260709 12:15:14.444558 21266 raft_consensus.cc:2243] T fa41764beac241228184f7b2c3a4b1a5 P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:14.444970 21266 raft_consensus.cc:2272] T fa41764beac241228184f7b2c3a4b1a5 P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.447163 21266 tablet_replica.cc:333] T 3ac88bcbdd344e7bba9a49e2e766242c P 9281096d749a4bf691c774d3321672e7: stopping tablet replica
I20260709 12:15:14.447700 21266 raft_consensus.cc:2243] T 3ac88bcbdd344e7bba9a49e2e766242c P 9281096d749a4bf691c774d3321672e7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:14.448523 21266 raft_consensus.cc:2272] T 3ac88bcbdd344e7bba9a49e2e766242c P 9281096d749a4bf691c774d3321672e7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.450659 21266 tablet_replica.cc:333] T 02297d83178f4c368a44b55829b3085e P 9281096d749a4bf691c774d3321672e7: stopping tablet replica
I20260709 12:15:14.451262 21266 raft_consensus.cc:2243] T 02297d83178f4c368a44b55829b3085e P 9281096d749a4bf691c774d3321672e7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:14.451746 21266 raft_consensus.cc:2272] T 02297d83178f4c368a44b55829b3085e P 9281096d749a4bf691c774d3321672e7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.453780 21266 tablet_replica.cc:333] T 708dcd04a2de4a6ea0c2436ae59b3aca P 9281096d749a4bf691c774d3321672e7: stopping tablet replica
I20260709 12:15:14.454294 21266 raft_consensus.cc:2243] T 708dcd04a2de4a6ea0c2436ae59b3aca P 9281096d749a4bf691c774d3321672e7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:14.455113 21266 raft_consensus.cc:2272] T 708dcd04a2de4a6ea0c2436ae59b3aca P 9281096d749a4bf691c774d3321672e7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.457119 21266 tablet_replica.cc:333] T fa8e4b22b550472e9de5f6a9cc8e173c P 9281096d749a4bf691c774d3321672e7: stopping tablet replica
I20260709 12:15:14.457618 21266 raft_consensus.cc:2243] T fa8e4b22b550472e9de5f6a9cc8e173c P 9281096d749a4bf691c774d3321672e7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:14.458516 21266 raft_consensus.cc:2272] T fa8e4b22b550472e9de5f6a9cc8e173c P 9281096d749a4bf691c774d3321672e7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.460628 21266 tablet_replica.cc:333] T 4e3a90ba50264ff59de7e64f04e7cbde P 9281096d749a4bf691c774d3321672e7: stopping tablet replica
I20260709 12:15:14.461230 21266 raft_consensus.cc:2243] T 4e3a90ba50264ff59de7e64f04e7cbde P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:14.461663 21266 raft_consensus.cc:2272] T 4e3a90ba50264ff59de7e64f04e7cbde P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.463624 21266 tablet_replica.cc:333] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7: stopping tablet replica
I20260709 12:15:14.464104 21266 raft_consensus.cc:2243] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:14.464958 21266 raft_consensus.cc:2272] T 6f6d5246f47546cea93920208eb4c505 P 9281096d749a4bf691c774d3321672e7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.467200 21266 tablet_replica.cc:333] T 023ba999f2974359812bb5a68e6a618c P 9281096d749a4bf691c774d3321672e7: stopping tablet replica
I20260709 12:15:14.467695 21266 raft_consensus.cc:2243] T 023ba999f2974359812bb5a68e6a618c P 9281096d749a4bf691c774d3321672e7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:14.468087 21266 raft_consensus.cc:2272] T 023ba999f2974359812bb5a68e6a618c P 9281096d749a4bf691c774d3321672e7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.470043 21266 tablet_replica.cc:333] T 20c09a31d7a545b2ba4bb6853c19cab3 P 9281096d749a4bf691c774d3321672e7: stopping tablet replica
I20260709 12:15:14.470587 21266 raft_consensus.cc:2243] T 20c09a31d7a545b2ba4bb6853c19cab3 P 9281096d749a4bf691c774d3321672e7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:14.471082 21266 raft_consensus.cc:2272] T 20c09a31d7a545b2ba4bb6853c19cab3 P 9281096d749a4bf691c774d3321672e7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.473192 21266 tablet_replica.cc:333] T 2a0060a4875345599fa7795fb8c284c0 P 9281096d749a4bf691c774d3321672e7: stopping tablet replica
I20260709 12:15:14.473721 21266 raft_consensus.cc:2243] T 2a0060a4875345599fa7795fb8c284c0 P 9281096d749a4bf691c774d3321672e7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:14.474229 21266 raft_consensus.cc:2272] T 2a0060a4875345599fa7795fb8c284c0 P 9281096d749a4bf691c774d3321672e7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.476347 21266 tablet_replica.cc:333] T b2b62eae23264a6aa96a0a5899444f0e P 9281096d749a4bf691c774d3321672e7: stopping tablet replica
I20260709 12:15:14.476881 21266 raft_consensus.cc:2243] T b2b62eae23264a6aa96a0a5899444f0e P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:14.477312 21266 raft_consensus.cc:2272] T b2b62eae23264a6aa96a0a5899444f0e P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.479550 21266 tablet_replica.cc:333] T 6dae4debcb434769a07d735facc9817f P 9281096d749a4bf691c774d3321672e7: stopping tablet replica
I20260709 12:15:14.480077 21266 raft_consensus.cc:2243] T 6dae4debcb434769a07d735facc9817f P 9281096d749a4bf691c774d3321672e7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:14.480590 21266 raft_consensus.cc:2272] T 6dae4debcb434769a07d735facc9817f P 9281096d749a4bf691c774d3321672e7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.482583 21266 tablet_replica.cc:333] T 2ef02663c5eb4a4c900ad78501828298 P 9281096d749a4bf691c774d3321672e7: stopping tablet replica
I20260709 12:15:14.483115 21266 raft_consensus.cc:2243] T 2ef02663c5eb4a4c900ad78501828298 P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:14.483539 21266 raft_consensus.cc:2272] T 2ef02663c5eb4a4c900ad78501828298 P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.485577 21266 tablet_replica.cc:333] T be816cce439f4fb9b32c1e557f424523 P 9281096d749a4bf691c774d3321672e7: stopping tablet replica
I20260709 12:15:14.486063 21266 raft_consensus.cc:2243] T be816cce439f4fb9b32c1e557f424523 P 9281096d749a4bf691c774d3321672e7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:14.486510 21266 raft_consensus.cc:2272] T be816cce439f4fb9b32c1e557f424523 P 9281096d749a4bf691c774d3321672e7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.488550 21266 tablet_replica.cc:333] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 9281096d749a4bf691c774d3321672e7: stopping tablet replica
I20260709 12:15:14.489043 21266 raft_consensus.cc:2243] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:14.489557 21266 raft_consensus.cc:2272] T 28d226ed3f0e4fb8bae68b4340e8e4a1 P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.491621 21266 tablet_replica.cc:333] T 062ef3d157f74d819a1e8c88524d15bb P 9281096d749a4bf691c774d3321672e7: stopping tablet replica
I20260709 12:15:14.492106 21266 raft_consensus.cc:2243] T 062ef3d157f74d819a1e8c88524d15bb P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:14.492552 21266 raft_consensus.cc:2272] T 062ef3d157f74d819a1e8c88524d15bb P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.494647 21266 tablet_replica.cc:333] T 6f7eb2b18b3e4b0eba971970313a52c2 P 9281096d749a4bf691c774d3321672e7: stopping tablet replica
I20260709 12:15:14.495150 21266 raft_consensus.cc:2243] T 6f7eb2b18b3e4b0eba971970313a52c2 P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:14.495633 21266 raft_consensus.cc:2272] T 6f7eb2b18b3e4b0eba971970313a52c2 P 9281096d749a4bf691c774d3321672e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.536453 21266 tablet_server.cc:196] TabletServer@127.20.196.131:0 shutdown complete.
I20260709 12:15:14.575721 21266 master.cc:562] Master@127.20.196.190:34693 shutting down...
I20260709 12:15:14.598771 21266 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9f291740485b4332857608ac87420526 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:14.599442 21266 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9f291740485b4332857608ac87420526 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:14.599805 21266 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9f291740485b4332857608ac87420526: stopping tablet replica
I20260709 12:15:14.621064 21266 master.cc:584] Master@127.20.196.190:34693 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (20535 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (43361 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (420152 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 12:15:14.676896 21266 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2269 messages since previous log ~34 seconds ago
I20260709 12:15:14.677152 21266 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2269 messages since previous log ~34 seconds ago
I20260709 12:15:14.677351 21266 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2268 messages since previous log ~34 seconds ago
I20260709 12:15:14.677574 21266 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~51 seconds ago
I20260709 12:15:14.677771 21266 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~51 seconds ago
I20260709 12:15:14.677995 21266 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 1 messages since previous log ~281 seconds ago
I20260709 12:15:14.678231 21266 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:5227: suppressed but not reported on 4 messages since previous log ~265 seconds ago
I20260709 12:15:14.678483 21266 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 8 messages since previous log ~0 seconds ago
I20260709 12:15:14.678799 21266 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 52 messages since previous log ~19 seconds ago
